Hacker Noon

Running an Embedding Model Next to My Notes on an iPhone | HackerNoon

How I built private, on-device semantic search for a notes app using a 350M-parameter embedding model, SQLite, ExecuTorch, and llama.cpp.