- Bay Area Times
- Posts
- Llama 3.1 405B launches: at GPT-4o quality, open weights
Llama 3.1 405B launches: at GPT-4o quality, open weights
Bay Area Times
July 24, 2024
Brought to you by:
Top stories today:
- Llama 3.1 405B launches: at GPT-4o quality, open weights
- Foldable iPhone with ‘clamshell’ design rumored for 2026
- Alphabet’s revenue +14% to $84.7B in Q2
- Tesla stock -8% as profits -45% to $1.5B
- Ethereum ETFs see $1B in trades, net inflows of $107M
- Harris odds climbs from 32% to 36% after positive polling, 1st rally
0. Data and calendar
All values as of 6 AM ET / 3 AM PT, other than S&P500 and NASDAQ close (4 PM ET / 1 PM PT).
1. Llama 3.1 405B launches: at GPT-4o quality, open weights
128K context window.
Trained on 15T tokens.
16K NVIDIA H100 GPUs used for training.
Llama 3.1 405B can be accessed for as low as $3 per 1M output tokens (on Fireworks), 5x cheaper than GPT-4o and Claude 3.5 Sonnet
2 DGX 8xH100 systems are currently required to run Llama 3.1 405B, but prices should continue to go down over time.
Our view: Llama 3.1 threatens the viability of startups such as OpenAI, Anthropic, xAI, Mistral
They will likely need to develop new architectures, as we are seeing a plateau in the quality of Transformers models.
Getting promoted is hard. Being a leader is hard. And every day, there are a ton of things you’d love advice on, but there is no one to ask.
Blogs are okay. Podcasts are long. How the f*** are you going to level up without people to learn from?
Enter Sidebar. A staggering 93% of members say Sidebar has been a game-changer in their professional path. Using their matching engine and a unique vetting process, Sidebar finds your people. Sidebar’s small groups are led by world-class facilitators, so you’re never wasting time. Get the advice you need and get back to crushing your goals.
Learn more at sidebar.com, and see why over 35K top leaders from companies like Amazon and Microsoft have taken the first step towards career growth.
*Sponsored.
