With that said, I got the following stack working: ollama + gemma2 + GenKit.
With that said, I got the following stack working: ollama + gemma2 + GenKit.
I used the 9B version in the past for document understanding and it was similar to Qwen2 VL 7B, so this one should be better (it's also explicitly mentioned "Enhanced Document Understanding" as a key feature).
huggingface.co/AIDC-AI/Ovis1.6-Gemma2-27B
I used the 9B version in the past for document understanding and it was similar to Qwen2 VL 7B, so this one should be better (it's also explicitly mentioned "Enhanced Document Understanding" as a key feature).
huggingface.co/AIDC-AI/Ovis1.6-Gemma2-27B
I tested Mistral - it's not terrible but it's much worse than Llama3. Of the open source models in Ollama, which other ones are worth testing? 👀 👀
( MLSky DH CSS blueskAI 🤖 )
Glows.ai provides high-performance, cost-effective AI cloud solutions, integrating advanced compute resources and tools to streamline development for users.
#DevOps #Cloud #glows.ai #konsttech #AIcomputing
Glows.ai provides high-performance, cost-effective AI cloud solutions, integrating advanced compute resources and tools to streamline development for users.
#DevOps #Cloud #glows.ai #konsttech #AIcomputing
Integrated to obsidian in minutes.
Such a great project: ollama.com
Integrated to obsidian in minutes.
Such a great project: ollama.com
you can't just count what it was *prompted* with
you can't just count what it was *prompted* with
It was pretty fun and all LOCAL
No API calls to a 'Strawberry model';
no data for ya 🍓
Happy New Year 🎇
It was pretty fun and all LOCAL
No API calls to a 'Strawberry model';
no data for ya 🍓
Happy New Year 🎇
Glows.ai provides high-performance, cost-effective AI cloud solutions, integrating advanced compute resources and tools to streamline development for users.
#DevOps #Cloud #glows.ai #konsttech #AIcomputing
Glows.ai provides high-performance, cost-effective AI cloud solutions, integrating advanced compute resources and tools to streamline development for users.
#DevOps #Cloud #glows.ai #konsttech #AIcomputing
server <- function(input, output, session) {
chat <- ellmer::chat_ollama(model = "gemma2")
observeEvent(input$chat_user_input, {
stream <- chat$stream_async(input$chat_user_input)
chat_append("chat", stream)
})
}
shinyApp(ui, server)
2/2 #RStats #GenAI
#GoogleIO
#GoogleIO
I am doing a #Gemma2 > Android integration.
Pretty happy with a 2 day part time effort!
Sweet points:
• Ollama
• Open #LLM
• 9B parameter size
• Cloud GPU acceleration
Nicer GUI next!
I can see the privacy use cases 🕵️ since we control the whole API
#Gemmaverse
I am doing a #Gemma2 > Android integration.
Pretty happy with a 2 day part time effort!
Sweet points:
• Ollama
• Open #LLM
• 9B parameter size
• Cloud GPU acceleration
Nicer GUI next!
I can see the privacy use cases 🕵️ since we control the whole API
#Gemmaverse
#VTuber #VTuberUprising
www.twitch.tv/megami_infini
#VTuber #VTuberUprising
www.twitch.tv/megami_infini
models.bggpt.ai/blog/
models.bggpt.ai/blog/
digitalcookie.girlscouts.org/scout/gemma2...
digitalcookie.girlscouts.org/scout/gemma2...
1) the language model they use (gemma2) is trained using massive amounts of stolen data
2) they're refusing artists who want their contributions removed from the game
1) the language model they use (gemma2) is trained using massive amounts of stolen data
2) they're refusing artists who want their contributions removed from the game
www.kaggle.com/code/felipem...
www.kaggle.com/code/felipem...
ollama.com
Then:
ollama pull gemma2:27b-instruct-q4_K_M
ollama run gemma2:27b-instruct-q4_K_M
This will drop you into an interactive chat session with a "state of the art" local model
ollama.com
Then:
ollama pull gemma2:27b-instruct-q4_K_M
ollama run gemma2:27b-instruct-q4_K_M
This will drop you into an interactive chat session with a "state of the art" local model