Wishing everyone a weekend of whatever you want or need it to be.
Wishing everyone a weekend of whatever you want or need it to be.
I look at the live flight-tracking map almost every single day, and I’ve never seen it this sparse.
On a Friday afternoon, no less!
I look at the live flight-tracking map almost every single day, and I’ve never seen it this sparse.
On a Friday afternoon, no less!
For those who don’t look at these live trackers often or at all, this is very sparse, particularly for a Friday night.
For those who don’t look at these live trackers often or at all, this is very sparse, particularly for a Friday night.
Sliding window — most recent window
Gated DeltaNet — tiny lossy summary equally weighting all tokens
Qwen Sparse Attention — use a tiny “model” to predict what full attention would’ve done
Sliding window — most recent window
Gated DeltaNet — tiny lossy summary equally weighting all tokens
Qwen Sparse Attention — use a tiny “model” to predict what full attention would’ve done
2. Friday midafternoon
3. Friday early evening
2. Friday midafternoon
3. Friday early evening
Both are Sentence Transformers-native, with strong reported results for their sizes.
Here's sparse retrieval in a few lines 🧵
Both are Sentence Transformers-native, with strong reported results for their sizes.
Here's sparse retrieval in a few lines 🧵