Top stories today:

1. Google’s open weights Gemma 2 nears Microsoft’s Phi-3 on benchmarks
2. Q1 GDP revised up from 1.3% to 1.4%
3. OpenAI announces CriticGPT, model to help human trainers in RLHF
4. ChatGPT web visits +16% MoM, +96% YoY to 2.9B in June

0. Data and calendar

Correction: We reported yesterday that Amazon's +4% to $2T market cap was based on no news. In fact, the rise was connected to the report that Amazon plans to launch a Temu-like store. h/t to our reader FD.

1. Google’s open weights Gemma 2 nears Microsoft’s Phi-3 on benchmarks

Google curiously didn’t explicitly compare Gemma 2 with Phi-3 in their launch post:

• Gemma 2 runs on a single NVIDIA H100.

Phi-3 continues to be the leading open weights small language model according to MMLU, having a 78.2 score

• TBD: Human comparisons between the 2 models.

2. Q1 GDP revised up from 1.3% to 1.4%

• From 3.4% in Q4.

• Durable goods orders: 0.1% MoM in May, vs -0.5% expected, from 0.2% in the prior month.

  • Core: -0.1%, vs. 0.2%, from 0.4%.

• UK GDP for Q1 updated from 0.6% to 0.7%.

4. OpenAI announces CriticGPT, model to help human trainers spot mistakes during RLHF

Humans + CriticGPT provided more comprehensive critiques and hallucinated less often than just humans: