Bifalgorithm post
Why did you leave OpenAI to form Anthropic? Yeah, so there was a group of us within OpenAI that, in the wake of making GPT-2 and GPT-3, had a kind of very strong focused belief in two things. I think even more so than most people there. One was the idea that if you pour more compute into these models, they'll get better and better, and that there's almost no end to this. I think this is much more widely accepted now, but I think we were among the first believers in it. You needed something in addition to just scaling the models up, which is alignment or safety. You don't tell the models what their values are just by pouring more compute into them. And so there were a set of people who believed in those two ideas. We really trusted each other and wanted to work together. And so we went off and started our own company with that idea in mind.
Why did you leave OpenAI to form Anthropic? Yeah, so there was a group of us within OpenAI that, in the wake of making GPT-2 and GPT-3, had a kind of very stro…
Ideas in this flowchart
- Reason for Leaving OpenAI
- Belief in Compute Scaling
- More Compute Improves Models
- Early Believers in Compute Scaling
- Need for Alignment and Safety
- Models Require Values Beyond Compute
- Formation of Anthropic
- Shared Beliefs and Trust
- Desire to Work Together
