AI ALIGNMENT FORUM
AF

AIXI Agent foundations
AI
Frontpage

20

Formalizing Embeddedness Failures in Universal Artificial Intelligence

by Cole Wyeth
26th May 2025
1 min read
0

20

This is a linkpost for https://arxiv.org/abs/2505.17882
AI
Frontpage
Previous:
Free Will and Dodging Anvils: AIXI Off-Policy
No comments39 karma
Next:
Unbounded Embedded Agency: AEDT w.r.t. rOSI
No comments29 karma
Log in to save where you left off
New Comment
Moderation Log
More from Cole Wyeth
View more
Curated and popular this week
0Comments

AIXI is a dualistic agent that can't work as an embedded agent... right? I couldn't find a solid formal proof of this claim, so I investigated it myself (with Marcus Hutter). It turns out there are some surprising positive and negative results to be derived as easy corollaries of the paper "Universal Prediction of Selected Bits." Interestingly, further technical advances in algorithmic information theory could substantially strengthen our results - I would welcome collaborations with strong theoretical computer scientists, (deep familiarity with agent foundations not required).

This work was supported by the Long-Term Future Fund and presented at the CMU agent foundations conference in 2025.