AI ALIGNMENT FORUM
AF

Wikitags

Iterated Amplification

Edited by Ben Pace, Bird Concept last updated 17th Jul 2020

Iterated Amplification is an approach to AI alignment, spearheaded by Paul Christiano. In this setup, we build powerful, aligned ML systems through a process of initially building weak aligned AIs, and recursively using each new AI to build a slightly smarter and still aligned AI. 

See also: Factored cognition. 

Subscribe
Subscribe
Discussion0
Discussion0
Posts tagged Iterated Amplification
14Iterated Distillation and Amplification
Ajeya Cotra
7y
7
42Paul's research agenda FAQ
zhukeepa
7y
34
43Challenges to Christiano’s capability amplification proposal
Eliezer Yudkowsky
7y
2
28A guide to Iterated Amplification & Debate
Rafael Harth
5y
0
11AlphaGo Zero and capability amplification
paulfchristiano
7y
16
64Debate update: Obfuscated arguments problem
Beth Barnes
5y
15
41My Understanding of Paul Christiano's Iterated Amplification AI Safety Research Agenda
Chi Nguyen
5y
12
72An overview of 11 proposals for building safe advanced AI
evhub
5y
32
38My Overview of the AI Alignment Landscape: A Bird's Eye View
Neel Nanda
4y
4
50Writeup: Progress on AI Safety via Debate
Beth Barnes, paulfchristiano
5y
15
23Garrabrant and Shah on human modeling in AGI
Rob Bensinger
4y
7
21Prize for probable problems
paulfchristiano
7y
0
24Corrigibility
paulfchristiano
7y
3
16Factored Cognition
stuhlmueller
7y
1
11Preface to the sequence on iterated amplification
paulfchristiano
7y
3
Load More (15/46)
Add Posts