Built something fun: PangeaAI, a local LLM assistant for my homelab. Runs entirely on my workstation’s RTX 3090 using a RAG based policy system so questions about my homelab pull only from my own docs. No hallucinations. Quality Data...but there's more.....

#Homelab #LLM #RAG #AI #OpenSource

It pulls from my own documents, chunks them, embeds them on GPU #2 (a tiny T400), and answers with sources. RAG policy documents, not RAG scores determine local knowledge vs Model knowledge. Policy Driven Rag. As simple or complex as needed.
#HomelabLife #PangeaAI #RAG #OpenAI #policy-driven-RAG