Question: Is there a desktop app that allows me to experiment with different Large Language Models without requiring an internet connection?

If you want a desktop app to try out Large Language Models (LLMs) without going online, LM Studio is a good option. This cross-platform app supports a variety of Hugging Face-compatible models and works even when you're offline. It's got a simple graphical interface to set up models and run inferences, and it'll use your GPU for speed. LM Studio is free for personal use, doesn't track you, and doesn't collect data.

Another good option is AnythingLLM, a full-featured business intelligence tool that can run fully offline. It lets companies process and analyze documents by the gigabyte using any LLM, including their own, and gives them full control over those models. AnythingLLM can be used as a hosted cloud service or installed on a desktop, and it offers 100% privacy.

If you want a local AI chatbot, Private LLM is a good option. It supports a variety of open-source LLM models and runs offline, with features like grammar correction, summarization and text expansion in multiple languages. It also integrates with Siri and Shortcuts, so you can have a private and secure AI assistant.

If you want a platform to build and manage your own LLMs, Lamini is geared for software teams. It can run in air-gapped environments and has features like memory tuning and high-throughput inference. Lamini can be installed on-premise or in the cloud, so it's a good option for managing the model lifecycle.