Instrumental convergence thesis (131-140)

a set of instrumental goals likely to be pursued by any superintelligent agent because some objectives seem necessary to achieve most final goals

Self-preservation

an agents wants to ensure it stays able to achieve its final goals in the future

Goal-content integrity

ensuring present final goals are not altered with ensures that final goals will be realisable in the future. tho certain circumstances might make it desirable to change final goal e.g. social signalling, social preference, preferences concerning own goal content, storage costs (133)

Cognitive enhancement

improvements in rationality and decision making will achieving the agents final goal more likely. an agent might acquire exactly that amount of information it requires at a given pot

Technological perfection

an agent will most likely strive for technological perfection to make achieving its final goal more efficient

Resource acquisition

broad resource acquisition will enable efficiency and the ability to discover more ways of achieving a final goal. also acquiring large amount of resources can help to protect against competing agents that endanger the realisation of the agents final goal.

Possible failure modes