Question: I need a tool to manage and version my LLM prompts, do you know of any solutions?

If you're looking for a tool to manage and version your LLM prompts, Humanloop is a great choice. It has a collaborative prompt management system with version control and history, which can help you work more efficiently and collaborate with others. Humanloop also offers tools for assessing and monitoring AI performance, so it's a good choice for managing AI development projects.

Another good option is Knit, an end-to-end AI prompt management platform geared for prompt creators. Knit has project management with permission levels, multiple custom prompt editors and strong version control with edit history. It also supports models from multiple providers and has security features like encryption, so it's a good option for sensitive prompts.

If you're looking for an open-source option, Langfuse is worth a look. Langfuse offers prompt versioning, score calculation for LLM completions and detailed analytics. It supports multiple SDKs and integrates with multiple LLM providers, so you can be flexible and customize it. Langfuse also has security built in, with compliance with standards like SOC 2 Type II and ISO 27001.

Last, check out Prompt Mixer, a collaborative workspace for building AI features. It has automatic version control, Markdown-based prompt construction and scoring metrics like semantic similarity and regex matching. With built-in connectors to multiple AI providers and support for custom JavaScript or Python code, Prompt Mixer is a good option for managing and scoring AI prompts.