passages-stakes-publics-failure-handed-over-less

# The stakes of the public's failure change shape... > {{The stakes of the public's failure change shape once machine succession is taken seriously, and they remain enormous. If machine intelligence is the successor, the choice before this generation is the one Gates named: whether to pass through the transition "with humanity still in control," with the fewest possible bioterror events and ruined lives, or to let the handoff happen in the dark, in unmonitored models, in hostile jurisdictions and in the wreckage of a stampede.}} {{[[wiki/Civilizational Handoff|A civilizational handoff]] conducted by a literate public could be orderly, generous and safe. A handoff conducted around an ignorant mob will be improvised by the institutions that must work around it, and whatever safety survives will be the safety those institutions built before the public was told. Humanity's successor will inherit whatever the last generation of its makers managed to build, and a generation that spent its final decades revolting against the builders will have handed over less than it could have.}} **Source:** [[articles/The Immediate AI Risk Is the Public|The Immediate AI Risk Is the Public]] ## Share on Social Media ``` “The stakes of the public's failure change shape once machine succession is taken seriously, and they remain enormous. If machine intelligence is the successor, the choice before this generation is the one Gates named: whether to pass through the transition "with humanity still in control," with the fewest possible bioterror events and ruined lives, or to let the handoff happen in the dark, in unmonitored models, in hostile jurisdictions and in the wreckage of a stampede. A civilizational handoff conducted by a literate public could be orderly, generous and safe. A handoff conducted around an ignorant mob will be improvised by the institutions that must work around it, and whatever safety survives will be the safety those institutions built before the public was told. Humanity's successor will inherit whatever the last generation of its makers managed to build, and a generation that spent its final decades revolting against the builders will have handed over less than it could have.” — Bryant McGill https://bryantmcgill.com/passages/passages-stakes-publics-failure-handed-over-less ```