Alignment Agendas
What is inverse reinforcement learning?
Who is Buck Shlegeris?
A hypothesized period of time during which humanity works out how best to realize its long-term potential
What is the long reflection?
A 1997 chess match between an AI and a world chess champion
What is Deep Blue vs Garry Kasparov?
a fictional world and civilization invented by Eliezer Yudkowsky
Dath Ilan
The full expression for G.O.W.A.W.
What is Go Out With A Whimper?
This person famously declared, "These atoms fight back!"
Who is George Hotz?
Toby Ord's probability of existential risk in the next century (reported in The Precipice)
1/6
A 2016 Go match between an AI and a top Go player
What is AlphaGo vs Lee Sedol?
"...most people may not realize how much of this entire field is myself wearing various ______." -- Eliezer, List of Lethalities comment
What are trenchcoats?
The full name for H.C.H.
What is Humans Consulting H.C.H.?
These two sub-agents are collectively known as Janus
Laria and Kyle
This technique is applied to shrimp eyestalks (and neural nets)
What is ablation?
The CNN that won the 2012 ImageNet Challenge
What is AlexNet?
What is one hundred billion (10^11)
What are Robust Agent-Agnostic Processes?
The situational awareness benchmark prototype that Rudolf and Alex built last weekend
SADDER
A thought experiment demonstrating that an updateless decision theory using logical counterfactuals is better than an evidential updateless decision theory
What is the Troll Bridge?
The three labs that signed the White House voluntary commitments but are not members of the Frontier Model Forum
What are Amazon, Inflection, and Meta?
The Lovecraftian race that created the Shoggoth
What are The Elder Things?
The two documents named as inspiration for Claude's constitution
What are the UN Declaration of Human Rights and Apple's Terms of Service?
This was Ethan Edwards' DJ name at the mid-program party
Who is DJ Kernel Clustered
A "rule" that a modal decision theory agent with a fixed proof search ordering can follow to avoid the 5-and-10 problem
What is the Chicken Rule?
The first major theorem to be proved using a computer
What is the four color theorem?
ChatGPT's MBTI type (as tested by a random Reddit user 8 months ago by feeding it the questions and having it answer)
What is ENFJ?