AI ALIGNMENT FORUM
AF

All of Archimedes's Comments + Replies

What is the most impressive game LLMs can play well?
Archimedes50

Related question: What is the least impressive game current LLMs struggle with?

I’ve heard they’re pretty bad at Tic Tac Toe.

Reply1
2Vanessa Kosoy
Relevant link
My Current Take on Counterfactuals
Archimedes00

I'm having trouble accepting that the Troll Bridge scenario is well-posed as opposed to a Russell-like paradox. Perhaps someone can clarify what I'm missing.

In my mind, there are two options:

  1. If PA is inconsistent, then math is in ruins and any PA-based reasoning for crossing the bridge could be inconsistent and the troll blows up the bridge. Do not cross.

  2. If PA is consistent, then the agent cannot prove U = -10 (or anything else inconsistent) under the assumption that the agent already crossed, and therefore Löb's theorem fails to apply. In this case,

... (read more)
Reply
2Abram Demski
I think this is the wrong step. Why do you think this? Just because PA is consistent doesn't mean you can't prove weird things under assumption. Look at the structure of the proof. You're objecting to an assumption. ("Suppose PA proves that crossing -> U=-10") That's a pretty weird way to object to a proof. I'm allowed to make any assumptions I like. My guess is that you are wrestling with Lobs theorem itself. Lobs theorem is pretty weird!