AI Development
Release of Mistral 7B open-weight model
Editorial Analysis
Mistral's first model release disrupted the market by outperforming larger models like Llama 2 13B. It introduced Grouped-query attention (GQA) and Sliding Window Attention (SWA) to the mainstream, optimizing for speed and efficiency.
At a Glance
Date
September 27, 2023
Importance
High
5/5
Category
model
Axis of Change
Capability Gain
Organizations
Models Affected
Sources