Four challenges once superintelligence comes
From Simons panel at 44:50.
- Alignment. Making sure there’s no funny reason the AI will go out of control.
- Misuse. People using powerful AIs to advance their agendas.
- Jobs. How do we organize as a society now that none of us have jobs? What do we do with our time?
- Natural selection. How do things look like in the long run? Do we augment humans?