This chatbot is free, and yet it outperforms GPT-4o and o1 on ChatGPT

xAI, Elon Musk's artificial intelligence startup, has made its Grok 2 chatbot available for free to all users of X (formerly Twitter).

Good performance

The performances announced by xAI are particularly impressive: according to their internal benchmarks, Grok 2 would outperform OpenAI's GPT-4o and o1 on several tests.

Only the Claude 3.5 Sonnet model from Anthropic would manage to maintain its first place position. However, these results deserve to be qualified, because they come from internal tests and have not yet been validated by independent evaluations.

One of the most notable features of Grok 2 is its ability to access information in real time, both through the X platform and on the web.

Moreover, the chatbot systematically cites its sources, it allows users to check the origin of the information.

Also new is the Grok button, intended to provide contextual and general information about ongoing discussions. For example, Grok can explain the meaning of a particular image with the press of a button.

Multimodal integration is also a strong point: Grok 2 can now generate images. Even if the first tests show that this AI can now create ultra-realistic photos without any ethical limits.

To go further
You can generate anything with Elon Musk's Grok 2, and that's a problem

The Grok 2 and Grok 2 Vision API (rok-2-1212 and grok-2-vision-1212) is also available, with rather aggressive pricing.