After GPT-4 arrived in 2023, expectations grew for GPT-5, while rumors about projects called Strawberry and Orion circulated. OpenAI released o1 in December, introducing a reasoning-focused model that outperformed GPT-4 on math, coding, and logic. Orion became GPT-4.5, a much larger model built by scaling pretraining and post-training.
GPT-4.5 = Big Model Energy
An unnamed Y Combinator presenter explains what GPT-4.5 offers, where it falls short, and how it may fit into OpenAI’s future models.
OpenAI researchers describe GPT-4.5 as better at understanding what people mean and having nuanced conversations. It scored 61.9% on SimpleQA, compared with GPT-4o’s 38.4%, and its reported hallucination rate was 37%, versus 61.2% for GPT-4o. The presenter says it also performs well at writing, storytelling, humor, and brainstorming.
The presenter says GPT-4.5 performed better on softer tasks in internal testing, with some evaluation relying on human feedback and subjective judgment. Researchers asked testers where it improved or regressed and used their feedback to guide alignment. Because writing quality and emotional intelligence are difficult to measure consistently, OpenAI wants public users to try the model and share their impressions.
GPT-4.5 costs 30 times more per input token and 15 times more per output token than GPT-4o, making it difficult to justify for large-scale deployment. It also trails reasoning-focused models such as o1 on complex STEM, advanced math, and difficult coding tasks. The presenter argues that broad pretraining and inference-time reasoning can complement each other, and describes GPT-4.5 as a bridge toward models that combine both.
Takeaways
- Compare model quality against task-specific needs, especially when costs differ sharply.
- GPT-4.5 may suit creative work and general inquiries better than demanding structured reasoning.
- Treat subjective quality claims as context-dependent and test them with representative users.
- Pretraining and inference-time reasoning may provide complementary capabilities in future models.
Mentioned in this talk
Search inside this talk
What was claimed 9
- featureGPT-4.5: Excels at natural conversation, creative tasks, and complex planning
“GPT-4.5 excels at natural conversation, creative tasks, and complex planning”
YouTube Unverified1 source· Talk
- featureGPT-4.5: OpenAI's largest and most humanlike model to date
“OpenAI’s largest and most humanlike model to date”
YouTube Unverified1 source· Talk
- role atSam Altman is CEO at
OpenAI“OpenAI is going really well.”
0:09inChoosing Projects, Creating Value, and Finding PurposeYouTube Verified3 sources· Talk
- metric
GPT-4o: 61.2% hallucination rate“from GPT-4o’s 61.2%”
YouTube Unverified1 source· Talk
- metricGPT-4.5: Roughly 37% hallucination rate
“down to roughly 37%”
YouTube Unverified1 source· Talk
- metric
GPT-4o: 38.4% accuracy on SimpleQA“That compares with GPT-4o’s 38.4%”
YouTube Unverified1 source· Talk
- metricGPT-4.5: 61.9% accuracy on SimpleQA
“GPT-4.5 achieves around 61.9% accuracy”
YouTube Unverified1 source· Talk
- featureGPT-4.5: Falls short of specialized reasoning-first models on structured reasoning, complex STEM, advanced math, and tough coding challenges
“falls notably short in structured reasoning domains”
YouTube Unverified1 source· Talk
- metricGPT-4.5: Input tokens cost 30 times more than GPT-4o; output tokens cost 15 times more
“30 times more expensive than GPT-4o ... 15 times more expensive”
YouTube Unverified1 source· Talk








