Private LLM is an offline AI chatbot for iOS and macOS that offers full privacy and offline use without a network connection or subscription. It supports several open-source LLM models like Llama 3 and Mixtral 8x7B that you can download directly to your devices. It also includes features like customizable system prompts, integration with Siri and Shortcuts, and full security. It's a good option for individuals and families who want a private AI assistant.
Another good option is Layla, a private, offline AI chatbot that runs on your devices without an internet connection. It has customizable settings and personalities, converses, generates stories and answers questions. Layla uses state-of-the-art LLMs to learn from user interactions and adapt to individual preferences, offering a personalized experience while keeping your data completely private.
For bigger business needs, AnythingLLM is a flexible tool that can be used to process and analyze large documents using any LLM, including custom models like GPT-4. It can handle 100% privacy preserving data handling and can run fully offline, so it can be used in environments with limited or no internet access. It's available as a hosted cloud solution or can be installed on desktops for maximum privacy.