- Bay Area Times
- Posts
- Alibaba’s Qwen, Meta’s Llama 3 lead Hugging Face’s new open weights LLM leaderboard
Alibaba’s Qwen, Meta’s Llama 3 lead Hugging Face’s new open weights LLM leaderboard
Bay Area Times
July 01, 2024
Brought to you by:
Top stories today:
- Alibaba’s Qwen leads Hugging Face’s open weights LLM leaderboard
- AirPods with camera modules may launch in 2026
- 51M people watched CNN debate live, skewing towards 55+
0. Data and calendar
All values as of 6 AM ET / 3 AM PT, other than S&P500 and NASDAQ close (4 PM ET / 1 PM PT).
All times are ET.
1. Alibaba’s Qwen, Meta’s Llama 3 lead Hugging Face’s new open weights LLM leaderboard
Benchmarks used: MMLU-Pro, GPQA, MuSR, MATH, IFEval, and BBH, as the standard benchmarks like MMLU “became too easy for models.”
June 3: when MMLU-Pro was released.
Google’s Gemma 2 is the leading open model on LMSYS’s leaderboard, where people vote (blindly) on which AI chatbot is best
2. AirPods with camera modules may launch in 2026
Goal is to improve surround sound capabilities, not to take pictures.
IR camera similar to the iPhone Face ID receiver.
Apple is already working on iOS 19, macOS 16, watch OS 12, and visionOS 3.
Apple Intelligence is coming to Vision Pro, but not the HomePod.
The cheaper Vision may have a larger, lower-res screen (2 to 2.1 inch, with a pixel density of 1700 pixels per inch (PPI), vs. 1.42 inch and 3,386 PPI.
Be part of the open source rewards revolution. Join Homebrew creator Max Howell on his mission to reward open source developers for their valuable contributions.
Proof-of- Contribution (“PoC”): OSS projects are rewarded based on their impact via this novel consensus mechanism. Valuable codebases garner higher rewards.
Not a developer? Receive rewards by supporting your favourite open source projects and securing the OSS ecosystem.
Sign up for tea’s incentivized testnet today for the chance to earn rewards.
*Sponsored. Click the links to subscribe to tea's newsletter and learn more about how to get rewards for your open-source contributions.
