Maple
Role
Design & development
Type
Desktop AI assistant
Stack
Vec
A modular local AI assistant that runs entirely on my own hardware, with open-weight models and a vector database for memory.
The challenge
Use capable language models privately and offline, on a consumer GPU, with an interface pleasant enough for daily use.
What I built
A Python desktop app built with PySide6. Models run locally with GPU acceleration, a vector database provides retrieval, and each capability is a module that can be swapped.
Highlights
- 01Runs fully offline on a local GPU
- 02Open-weight models: Llama and DeepSeek
- 03Vector database for retrieval
- 04Modular architecture
Built with
PythonPySide6LlamaDeepSeekVecVector DB