MIRI Newsletter #121
MIRI updates Eliezer Yudkowsky joined Stephen Wolfram on the Machine Learning Street Talk podcast to discuss AI risk (a phrase that Eliezer objects to: “if there were an asteroid straight on course for...
View ArticleThe Sun is big, but superintelligences will not spare Earth a little sunlight
Crossposted from Twitter with Eliezer’s permission i. A common claim among e/accs is that, since the solar system is big, Earth will be left alone by superintelligences. A simple rejoinder is that just...
View ArticleCommunications in Hard Mode
Six months ago, I was a high school English teacher. I wasn’t looking to change careers, even after nineteen sometimes-difficult years. I was good at it. I enjoyed it. After long experimentation, I had...
View ArticleMIRI’s 2024 End-of-Year Update
MIRI is a nonprofit research organization with a mission of addressing the most serious hazards posed by smarter-than-human artificial intelligence. In our general strategy update and communications...
View ArticleOctober 2024 newsletter
News and links Geoffrey Hinton and John Hopfield were awarded this year’s Nobel Prize in Physics for their foundational contributions to machine learning. In a press conference following the...
View ArticleSeptember 2024 Newsletter
MIRI updates Aaron Scher and Joe Collman have joined the Technical Governance Team at MIRI as researchers. Aaron previously did independent research related to sycophancy in language models and...
View ArticleJuly 2024 Newsletter
Update (7-15-2024): this newsletter originally included Eliezer’s interview with Bloomberg’s Nate Lanxon and Jackie Davalos, which I mistakenly thought was released recently. That interview was...
View ArticleJune 2024 Newsletter
MIRI updates MIRI Communications Manager Gretta Duleba explains MIRI’s current communications strategy. We hope to clearly communicate to policymakers and the general public why there’s an urgent need...
View ArticleMIRI 2024 Communications Strategy
As we explained in our MIRI 2024 Mission and Strategy update, MIRI has pivoted to prioritize policy, communications, and technical governance research over technical alignment research. This follow-up...
View ArticleOctober 2024 newsletter
News and links Geoffrey Hinton and John Hopfield were awarded this year’s Nobel Prize in Physics for their foundational contributions to machine learning. In a press conference following the...
View ArticleSeptember 2024 Newsletter
MIRI updates Aaron Scher and Joe Collman have joined the Technical Governance Team at MIRI as researchers. Aaron previously did independent research related to sycophancy in language models and...
View ArticleJuly 2024 Newsletter
Update (7-15-2024): this newsletter originally included Eliezer’s interview with Bloomberg’s Nate Lanxon and Jackie Davalos, which I mistakenly thought was released recently. That interview was...
View ArticleJune 2024 Newsletter
MIRI updates MIRI Communications Manager Gretta Duleba explains MIRI’s current communications strategy. We hope to clearly communicate to policymakers and the general public why there’s an urgent need...
View ArticleMIRI 2024 Communications Strategy
As we explained in our MIRI 2024 Mission and Strategy update, MIRI has pivoted to prioritize policy, communications, and technical governance research over technical alignment research. This follow-up...
View ArticleMay 2024 Newsletter
Update (5-15-2024): I wrote that “it appears that not all of the leading AI labs are honoring the voluntary agreements they made at [AI Safety Summit],” citing a Politico article. However, after...
View ArticleApril 2024 Newsletter
The MIRI Newsletter is back in action after a hiatus since July 2022. To recap some of the biggest MIRI developments since then: MIRI released its 2024 Mission and Strategy Update, announcing a major...
View ArticleMIRI 2024 Mission and Strategy Update
As we announced back in October, I have taken on the senior leadership role at MIRI as its CEO. It’s a big pair of shoes to fill, and an awesome responsibility that I’m honored to take on. There have...
View ArticleWritten statement of MIRI CEO Malo Bourgon to the AI Insight Forum
Today, December 6th, 2023, I participated in the U.S. Senate’s eighth bipartisan AI Insight Forum, which focused on the topic of “Risk, Alignment, & Guarding Against Doomsday Scenarios.” I’d like...
View ArticleAbility to solve long-horizon tasks correlates with wanting things in the...
Status: Vague, sorry. The point seems almost tautological to me, and yet also seems like the correct answer to the people going around saying “LLMs turned out to be not very want-y, when are the people...
View ArticleThoughts on the AI Safety Summit company policy requests and responses
Over the next two days, the UK government is hosting an AI Safety Summit focused on “the safe and responsible development of frontier AI”. They requested that seven companies (Amazon, Anthropic,...
View Article