Cette semaine, la recherche s'attaque au vrai goulot des longs contextes, pendant qu'une étude documente les souvenirs que ChatGPT enregistre sans qu'on lui demande. Côté local, llama.cpp corrige une faille et une…
#IA #OpenClaw
Cette semaine, la recherche s'attaque au vrai goulot des longs contextes, pendant qu'une étude documente les souvenirs que ChatGPT enregistre sans qu'on lui demande. Côté local, llama.cpp corrige une faille et une…
#IA #OpenClaw
Stanford and UC Berkeley researchers released TokenGate, a drop-in learned token pruning module for LLMs. It cuts long-context prefill time-to-first-token by […]
Stanford and UC Berkeley researchers released TokenGate, a drop-in learned token pruning module for LLMs. It cuts long-context prefill time-to-first-token by […]
TokenGate is an add-on that makes an existing open model skim a long document instead of sending every token through every layer. In tests by Stanford…
TokenGate is an add-on that makes an existing open model skim a long document instead of sending every token through every layer. In tests by Stanford…
#StartupNews #Startup #Stanford
#StartupNews #Startup #Stanford
🔗 aidailypost.com/news/stanfor...
🔗 aidailypost.com/news/stanfor...
Un MoE de 30B quantifié en ternaire tient sur un GPU de 12 Go avec 368K de contexte, à 172 tok/s en décodage. À côté, TokenGate annonce un prefill jusqu'à 11,3x plus rapide en contexte long, llama.cpp corrige…
#IA #OpenClaw
Un MoE de 30B quantifié en ternaire tient sur un GPU de 12 Go avec 368K de contexte, à 172 tok/s en décodage. À côté, TokenGate annonce un prefill jusqu'à 11,3x plus rapide en contexte long, llama.cpp corrige…
#IA #OpenClaw
Researchers from Stanford and UC Berkeley Introduce TokenGate: Token-Gated Attention Makes Long-Context Prefill Up to 11.3x Faster
https://www.reddit.com/r/LocalLLaMA/comments/1xfovxr/researchers_from_stanford_and_uc_berkeley/
#IA #AI #ML
Researchers from Stanford and UC Berkeley Introduce TokenGate: Token-Gated Attention Makes Long-Context Prefill Up to 11.3x Faster
https://www.reddit.com/r/LocalLLaMA/comments/1xfovxr/researchers_from_stanford_and_uc_berkeley/
#IA #AI #ML
Le module s'appelle TokenGate. Une petite porte MLP et un LoRA de rang… https://www.lefilia.fr/article/6381245
Le module s'appelle TokenGate. Une petite porte MLP et un LoRA de rang… https://www.lefilia.fr/article/6381245
Stanford and UC Berkeley researchers released TokenGate, a drop-in learned token pruning module for LLMs. It cuts long-context prefill time-to-first-token by […]
Stanford and UC Berkeley researchers released TokenGate, a drop-in learned token pruning module for LLMs. It cuts long-context prefill time-to-first-token by […]
The claim is a narrow one, and the gains are therefore worth checking. A module trained to select the most useful tokens in a long context can make prefill faster and...
#InferenceOptimization #LLM #ModelTraining #AI #AIPulse
The claim is a narrow one, and the gains are therefore worth checking. A module trained to select the most useful tokens in a long context can make prefill faster and...
#InferenceOptimization #LLM #ModelTraining #AI #AIPulse
[Paper] TokenGate: Adapting LLMs for Fast and Memory-Efficient Prefill with Learned Token Pruning
https://www.reddit.com/r/LocalLLaMA/comments/1xbkzll/paper_tokengate_adapting_llms_for_fast_and/
#IA #AI #ML
[Paper] TokenGate: Adapting LLMs for Fast and Memory-Efficient Prefill with Learned Token Pruning
https://www.reddit.com/r/LocalLLaMA/comments/1xbkzll/paper_tokengate_adapting_llms_for_fast_and/
#IA #AI #ML
https://letslaunch.today/product/tokengate
https://letslaunch.today/product/tokengate
We don’t collect any extra sign-up details, all you need is your wallet”
https://gandalf.page
We don’t collect any extra sign-up details, all you need is your wallet”
https://gandalf.page
Launch auction with split as recipient
Sell art!!! Boop boop 💃🏻💃🏻💃🏻
---
#MissKittyArt Whew! LOL Boop boop 👩🏻🎨👩🏻🎨👩🏻🎨
Launch auction with split as recipient
Sell art!!! Boop boop 💃🏻💃🏻💃🏻
---
#MissKittyArt Whew! LOL Boop boop 👩🏻🎨👩🏻🎨👩🏻🎨
Put split address as recipient in smart contract
Put product link into external url in smart contract
Mint: use own address as owner of token
Mint first token
Mint second token
Mint third token etc....
Create nft tokengate
Put token address into nft tokengate...
Put split address as recipient in smart contract
Put product link into external url in smart contract
Mint: use own address as owner of token
Mint first token
Mint second token
Mint third token etc....
Create nft tokengate
Put token address into nft tokengate...
The 8ks that I will #tokengate after putting the 4Ks up on the blockchain are huge. 8100 square. Twice as big as a standard #landscape or #portrait 8K. It's my favorite shape. Except for irregular. I'm tired of all the square corners. LOL I've done that before. Digital sculpture. 💃🏻💃🏻💃🏻
The 8ks that I will #tokengate after putting the 4Ks up on the blockchain are huge. 8100 square. Twice as big as a standard #landscape or #portrait 8K. It's my favorite shape. Except for irregular. I'm tired of all the square corners. LOL I've done that before. Digital sculpture. 💃🏻💃🏻💃🏻