• Bay Area Times
  • Posts
  • Llama 3.1 405B launches: at GPT-4o quality, open weights

Llama 3.1 405B launches: at GPT-4o quality, open weights

Brought to you by:

Top stories today:

  1. Llama 3.1 405B launches: at GPT-4o quality, open weights
  2. Foldable iPhone with ‘clamshell’ design rumored for 2026
  3. Alphabet’s revenue +14% to $84.7B in Q2
  4. Tesla stock -8% as profits -45% to $1.5B
  5. Ethereum ETFs see $1B in trades, net inflows of $107M
  6. Harris odds climbs from 32% to 36% after positive polling, 1st rally

0. Data and calendar

All values as of 6 AM ET / 3 AM PT, other than S&P500 and NASDAQ close (4 PM ET / 1 PM PT).

1. Llama 3.1 405B launches: at GPT-4o quality, open weights

  • 128K context window.

  • Trained on 15T tokens.

  • 16K NVIDIA H100 GPUs used for training.

Llama 3.1 405B can be accessed for as low as $3 per 1M output tokens (on Fireworks), 5x cheaper than GPT-4o and Claude 3.5 Sonnet

  • 2 DGX 8xH100 systems are currently required to run Llama 3.1 405B, but prices should continue to go down over time.

Our view: Llama 3.1 threatens the viability of startups such as OpenAI, Anthropic, xAI, Mistral

  • They will likely need to develop new architectures, as we are seeing a plateau in the quality of Transformers models.

  • Getting promoted is hard. Being a leader is hard. And every day, there are a ton of things you’d love advice on, but there is no one to ask.

  • Blogs are okay. Podcasts are long. How the f*** are you going to level up without people to learn from?

  • Enter Sidebar. A staggering 93% of members say Sidebar has been a game-changer in their professional path. Using their matching engine and a unique vetting process, Sidebar finds your people. Sidebar’s small groups are led by world-class facilitators, so you’re never wasting time. Get the advice you need and get back to crushing your goals.

  • Learn more at sidebar.com, and see why over 35K top leaders from companies like Amazon and Microsoft have taken the first step towards career growth.

*Sponsored.

3. Foldable iPhone with ‘clamshell’ design rumored for 2026

Subscribe to keep reading

This content is free, but you must be subscribed to Bay Area Times to continue reading.

Already a subscriber?Sign In.Not now