All of Jonathan Claybrough's Comments + Replies

Might be good to have a dialogue format with other people who agree/disagree to flesh out scenarios and countermeasures

1Charbel-Raphael Segerie
Why not! There are many many questions that were not discussed here because I just wanted to focus on the core part of the argument. But I agree details and scenarios are important, even if I think this shouldn't change too much the basic picture depicted in the OP. Here are some important questions that were voluntarily omitted from the QA for the sake of not including stuff that fluctuates too much in my head; 1. would we react before the point of no return? 2. Where should we place the red line? Should this red line apply to labs? 3. Is this going to be exponential? Do we care? 4. What would it look like if we used a counter-agent that was human-aligned? 5. What can we do about it now concretely? Is KYC something we should advocate for? 6. Don’t you think an AI capable of ARA would be superintelligent and take-over anyway? 7. What are the short term bad consequences of early ARA? What does the transition scenario look like. 8. Is it even possible to coordinate worldwide if we agree that we should? 9. How much human involvement will be needed in bootstrapping the first ARAs? We plan to write more about these with @Épiphanie Gédéon  in the future, but first it's necessary to discuss the basic picture a bit more.