All of davekasten's Comments + Replies

Possibly misguided question given the context -- I see you incorporating imperfect information in "the attack fails silently", why not also a distinction between "the attack succeeds noisily, the AI wins and we know it won" and "the attack succeeds silently, the AI wins and we don't know it won" ? 

3Buck Shlegeris
My reasoning is: “If the AI won, who cares if we know it or not? We’ll find out eventually :/“ This isn’t totally correct but it seems like a fine approximation given all the other approximations here.

So, I really, really am not trying to be snarky here but am worried this comment will come across this way regardless.  I think this is actually quite important as a core factual question given that you've been around this community for a while, and I'm asking you in your capacity as "person who's been around for a minute".  It's non-hyperbolically true that no one has published this sort of list before in this community?  

I'm asking, because if that's the case, someone should, e.g., just write a series of posts that just marches through US government best-practices documents on these domains (e.g., Chemical Safety Board, DoD NISPOM, etc.) and draws out conclusions on AI policy.   

5Buck Shlegeris
FWIW, the there are some people around the AI safety space, especially people who work on safety cases, who have that experience. E.g. UK AISI works with some people who are experienced safety analysts from other industries.