Full-stack AI developer to set up a secure local GPT-like assistant with doc analysis and memory.

Seeking a highly competent AI engineer to build a fully local, modular AI assistant designed for legal analysis, document synthesis, clinical planning, and research-intensive writing. This is a mission-critical cognitive environment, not a chatbot or LLM toy. The system must run entirely offline, preserve compartmentalized memory, and support vector-based document ingestion — all deployed on a MacBook Pro M4 Max (64GB RAM, 2TB SSD). It must be auditable, inspectable, and fully under user control at every layer. Build Scope (Three Phases – One Builder Only) You will be contracted to deliver the entire architecture across three phases: Phase 1 — ("Legal & Tax Office") • LM Studio / llama.cpp optimized for Apple Silicon • Vector DB setup (Chroma/Qdrant/Weaviate) with local document parsing • UI (Streamlit, Electron, or lightweight shell) • PDF/DOCX ingestion with embedded citation + source trace • Memory persistence: prompt saving, tone tagging, output control • Output styles: affidavit, brief, memo, etc. • No cloud sync. No logging. Fully local. Phase 2 — ("The Board Room") Multi-Domain Strategic Workspace • Add support for clinical workflows, estate planning, strategic writing • Improved memory containers (per domain) • API access wrapper to GPT-4 or Claude 3 (via user-owned keys ONLY) • Enhanced persona switching, tone locks, exportable sessions Phase 3 — ("The Den") Private Cognitive Module • Separate vault for high-context reasoning and longform writing • Firewalled from Office; no cross-contamination • Persistent memory, stylistic voice preservation, session archiving • Local-only inference with optional narrative assistive tools • Optional future integration: multimodal parsing, encryption layers Security & Audit Clauses (Non-Negotiable) • You must consent to third-party code audit after each phase • No proprietary wrappers • No API calls unless explicitly declared and authorized • All configuration paths, prompts, vector stores, and memory logs must be accessible to the user • You will provide: • Full install scripts • Summary.txt documenting build logic, parameters, dependencies • Notes to replicate install from clean OS Payment Structure This is an hourly project with a firm "not-to-exceed" ceiling, payable at the end of each phase upon satisfactory completion and code audit. Terms: • You (the builder) are committing to the entire 3-phase build, unless mutually terminated. • I (the client) commit to paying for each completed phase promptly and fully once: • Deliverables are met • The audit review is cleared • I reserve the right to end the project after any phase, for any reason, without obligation to proceed further. • You agree that no partial or hidden ownership exists — all build components, logic, and configuration must be shared in full and are under the client’s control. Summary: PhaseDeliverable Payment Exit Clause Phase 1 Inference + UI Paid after audit Client may exit Phase 2 Vector Store + API logic Paid after audit Client may exit Phase 3 Final Memory Shell + Vault Split Paid after audit Final Please submit your hourly rate and your not-to-exceed cap (USD) for the full build. System Context You’ll be working on a clean Apple M4 Max MacBook Pro (64GB RAM, 2TB SSD), macOS Sonoma. Pre-installed: • LM Studio • Homebrew • Git Available access: • AnyDesk (if needed) • Local data files (legal PDFs, notes, DOCXs, etc.) Preferred Stack (flexible with reasoned alternatives) Layer Preferred Tool Inference LM Studio / llama.cpp Vector DB Chroma or Qdrant File Parsing PyMuPDF, unstructured.io UI Streamlit or Electron Memory Logic JSON store or LangGraph API Gateway (Phase 2–3) GPT-4/Claude via secure keys Models to install/test: • MythoMax 13B Q5 • Chronos Hermes 13B • Mistral 7B Instruct
(Final quantization/tuning TBD based on your advice) ✅ You Should Apply If You: • Have built secure local GPT-style systems before • Know vector stores, LLM inference, and UI wiring well • Understand data compartmentalization • Are comfortable being audited • Can document your work cleanly • Are discreet and professional in high-trust builds Bonus if you’ve worked with: • Apple Silicon • Clinical/legal data environments • High-context cognitive tools (not just chat interfaces) How to Apply In your message, please include: 1. A short list of similar builds (esp. local/private GPT) 2. Your preferred stack and why 3. Your hourly rate 4. Your not-to-exceed ceiling for all three phases 5. Confirmation you accept the audit clause and early termination terms Apply Job! Apply to this Job