AI / Infrastructure
sret-rag
Self-Hosted RAG on a 4-PC LAN Cluster
About this project
Built for offline AI access at college with zero cloud dependency. Fully offline, self-hosted Retrieval-Augmented Generation system distributed across 4 budget PCs on a LAN: a FastAPI gateway, dedicated embedder, FAISS vector index, and a llama.cpp/Qwen2.5 LLM node. ChatGPT-style UI, cited answers, embed caching, doc dedup, and session-based auth.
- Category
- AI / Infrastructure
- Built by
- Jeyadev R
- Source code
- github.com/jeyadev-jd/sret-rag
