- Bay Area Times
- Posts
- Mistral releases Codestral Mamba 7B, Mathstral 7B, claimed to be best small open models for coding, STEM
Mistral releases Codestral Mamba 7B, Mathstral 7B, claimed to be best small open models for coding, STEM
Bay Area Times
July 17, 2024
Brought to you by:
Top stories today:
- Mistral releases Codestral Mamba 7B, Mathstral 7B
- SpaceX, X moving headquarters from CA to TX
- Andreessen, Horowitz endorse Trump, announce donations
- ASML’s sales -10% YoY to €6.2B in Q2
- Streaming reaches record 40.3% of TV time, YouTube, Netflix lead
0. Data and calendar
All values as of 6 AM ET / 3 AM PT, other than S&P500 and NASDAQ close (4 PM ET / 1 PM PT).
All times are ET.
1. Mistral releases Codestral Mamba 7B, Mathstral 7B, claimed to be best small open models for coding, STEM
Codestral Mamba 7B uses the Mamba architecture, rather than Transformers, and has a context length of 256K:
TBD: independent benchmarks.
Mathstral does particularly well on the MATH benchmark, but its broader MMLU is only 63% (vs. 68% for Microsoft’s Phi-3 Mini 4B):
2. SpaceX, X moving headquarters from CA to TX
X: moving to Austin from San Francisco.
SpaceX: to Starbase from Hawthorne.
3. Andreessen, Horowitz endorse Trump, announce donations
With “Little Tech” arguments: they were historically bipartisan, but argue that the Biden administration has been particularly against M&A, startups, and crypto.
Be part of the open source rewards revolution. Join Homebrew creator Max Howell on his mission to reward open source developers for their valuable contributions.
Proof-of- Contribution (“PoC”):OSS projects are rewarded based on their impact via this novel consensus mechanism. Valuable codebases garner higher rewards.
Not a developer? Receive rewards by supporting your favourite open source projects and securing the OSS ecosystem.
Sign up for tea’s incentivized testnet today for the chance to earn rewards.
*Sponsored. Click the links to subscribe to tea's newsletter and learn more about how to get rewards for your open-source contributions.
