Grok 4 - 10 New Things to Know

Gro 4 is out and it's a pretty good AI model, but there is going to be more noise about this language model than possibly any other. So hopefully I can give you a little signal amid the chaos. Let's boil things down to just 10 things to know about the newest and possibly smartest AI model. Point one is that Croc 4 might just be the smartest model around, at least according to the benchmarks.

In certain settings on high school math competitions, it beats out OpenAI's best model and Google's best model. The same is true for a fairly famous science benchmark, the Google proof Q&A, where it again beats out Anthropic's best model and Google's. Likewise on at least one coding benchmark, but Elon Musk went much further saying about Gro 4 that quote it's smarter than almost all graduate students in all disciplines simultaneously. That quote is of course going to be picked up by everyone, but it needs three important caveats.

First from me is that Grock 4 is still a language model, which means it's still going to be prone to all those hallucinations you're familiar with. It's not a new paradigm of AI. Second, we have heard that kind of hype before, notably from the Google DeepMind CEO Demesis Saris almost 18 months ago saying that Gemini 2 was better than almost all human experts. amazing about Gemini is that it's so good at so many things.

As we started getting to the end of the training, for example, each of the 50 different subject areas that we tested on, um, it's as good as the best expert humans in those areas. That was an exaggeration then and Musk is exaggerating now because real world performance doesn't always match up to benchmark performance. Expertise is way more than answering multiple choice questions. Hence the third bit of context coming from Musk himself the CEO of XAI saying that that quote about being smarter than graduates was at least with respect to academic questions.

Gro four is a postgrad level in everything like it's it just some of these things are just worth repeating like Grock 4 is postgraduate like PhD level in everything better than Ph but like most PhDs would fail so it's better that said I mean at least with respect to academic questions point number two is that I've been ...