Where We Go From Here with OpenAI’s Mira Murati
As part of the a16z Revolution Series, Mira Murati CTO of OpenAI talks to Andreesen Horowitz’s Martin Casado about where OpenAI is going in the next few years.
Martin Casado:
I would love for you to prognosticate a little bit on where you think this is all going like three years or five years or ten years.
Mira Murati:
I think that the foundation models today obviously have this great representation of the world in text, and we’re adding other modalities like images and video and various other things so these models can get a more comprehensive sense of the world around us, similar to how we understand and observe the world.
The world is not just in text, it’s also in images. So I think that will certainly expand in that direction. And we’ll have these bigger models that will have all these modalities. And that’s kind of the pretraining part of the work where we really want to get these pretrained models that understand the world like we do.
There is the output part of the model where we introduce reinforcement learning with human feedback. And we want the model to do actually the thing that we ask it to do. And we want that to be reliable.
There is a ton of work that needs to happen here. And maybe introducing browsing so you can get fresh information and you can cite information and solve hallucinations I don’t think that’s impossible. I
I think that’s achievable on the product side. I think we want to put this all together in this collection of agents that people collaborate with and really provide a platform where people can build on top of.
If you extrapolate really far out, these models are going to be incredibly, incredibly powerful. And with that, obviously, comes fear of them being misaligned, having this very powerful models that are misaligned with our intentions. So then a huge challenge becomes the challenge of super alignment, which is a difficult technical challenge. And we’ve assembled an entire team at OpenAI to just focus on this very last question.