AI ALIGNMENT FORUM
AF

Nominated Posts for the 2019 Review

Posts need at least 2 nominations to continue into the Review Phase.

Nominate posts that you have personally found useful and important.

Sort by: fewest nominations

25Misconceptions about continuous takeoff

Matthew Barnett

5y

12

1 • 0

51The Commitment Races problem

Daniel Kokotajlo

5y

36

1 • 0

20How common is it for one entity to have a 3+ year technological lead on its nearest competitor?

Daniel Kokotajlo

4y

1

1 • 0

20AGI will drastically increase economies of scale

5y

15

1 • 0

28But exactly how complex and fragile?

4y

30

2 • 1

34The strategy-stealing assumption

Paul Christiano

4y

45

2 • 3

52Gradient hacking

5y

33

2 • 2

29Reframing Impact

4y

4

2 • 1

38Reframing Superintelligence: Comprehensive AI Services as General Intelligence

5y

29

2 • 2

36The Credit Assignment Problem

4y

32

2 • 1

45AI Safety "Success Stories"

5y

11

2 • 1

50Thoughts on Human Models

Ramana Kumar, Scott Garrabrant

5y

9

2 • 1

51Utility ≠ Reward

Vladimir Mikulik

5y

16

2 • 2

39Soft takeoff can still lead to decisive strategic advantage

Daniel Kokotajlo

5y

34

2 • 4

56Selection vs Control

5y

14

2 • 2

101What failure looks like

Paul Christiano

5y

28

2 • 2

25Strategic implications of AIs' ability to coordinate at low cost, for example by merging

5y

22

2 • 1

27Six AI Risk/Strategy Ideas

5y

14

2 • 1

26Classifying specification problems as variants of Goodhart's Law

Victoria Krakovna

5y

5

2 • 1

66Chris Olah’s views on AGI safety

4y

30

2 • 2

63Debate on Instrumental Convergence between LeCun, Russell, Bengio, Zador, and More

5y

17

2 • 2

56Alignment Research Field Guide

5y

6

2 • 2

55Seeking Power is Often Convergently Instrumental in MDPs

Alex Turner, Logan Riggs Smith

4y

34

2 • 2

47Why Subagents?

5y

12

2 • 1

53Evolution of Modularity

4y

6

2 • 1

58Risks from Learned Optimization: Introduction

Evan Hubinger, Chris van Merwijk, Vladimir Mikulik, Joar Skalse, Scott Garrabrant

5y

33

3 • 3

52Understanding “Deep Double Descent”

4y

35

3 • 4

87The Parable of Predict-O-Matic

4y

16

5 • 4

2019 Review Discussion