"For the sake of argument, let’s say that AGI is imminent and, once here, will take everyone’s jobs.1 That means the entire workforce will become economically irrelevant, which means in turn that folks like Musk, who control the AGIs, will have no economic incentive to care about us.
Some researchers have likened the resulting predicament to the “resource curse” (or “poverty paradox”), which describes how countries with rich natural resources are more likely to be impoverished, authoritarian, and corrupt (think of Venezuela, Iraq, the Democratic Republic of Congo, Russia, etc.). Simplifying things a bit: countries that don’t have natural resources rely mostly on taxes to fund the government. This gives the government an economic incentive to invest in goods like education and infrastructure, because a well-off citizenry will generate more taxable wealth. But if a country can get its wealth directly from natural resources, the incentive to invest in the demos diminishes — hence the plight of many resource-rich countries.
Similarly, if oligarchs like Musk generate all of their wealth through AGI because AGI has made everyone jobless, they’ll have no economic incentive to ensure that the general population is well-off. We should thus expect outcomes similarly atrocious to what you find in resource-rich countries: mass poverty, concentration of power, widespread corruption, etc. On this analogy, AGI is better thought of as a “resource” than a “technology” or “tool.”
Musk, in fact, is already taking steps to create a new company called “Macrohard” that’s run entirely by AI systems."
https://www.realtimetechpocalypse.com/p/empty-promises-and-endless-greed-85f
