GhostVaultfront matter

[17]entry 17 of 34

GhostVault

AI · privacy2024

Fig. 1. A sealed sphere with everything inside it: a document, its passages as three clusters placed by meaning, and a question drifting among them that reaches for the passages nearest to it.

this entry is written twice, in full

  1. 1.in brief

    private, fully-offline local RAG system

  2. 2.in general

    Document Q&A with three AI personalities, none of which phone home.

  3. 3.in particular

    A privacy-first RAG system that runs entirely offline with automatic document ingestion and source attribution.

  1. 1.in brief

    a private document assistant that never touches the internet

  2. 2.in general

    Ask questions about your own documents, answered by three characters, none of whom phone home.

  3. 3.in particular

    It reads your files, answers questions about them, cites the exact page, and does all of it on your machine.


note

Three personalities (The Architect, The Executive, The Skeptic) answer questions over your documents with exact page-level source attribution. The Skeptic is the one you end up using. No cloud APIs, complete privacy. LlamaIndex2 drives the pipeline, Ollama4 runs Llama3 locally, ChromaDB5 handles vectors, and Watchdog auto-indexes the data folder on change.

note

Three personalities, an architect, an executive and a sceptic, answer questions about your own documents and tell you exactly which page they got it from. The sceptic is the one you end up using. Nothing goes to anyone else’s computer: the language model runs locally, the search index is local, and the folder is watched so a new document is absorbed the moment you drop it in.