Question: What are some portable AI solutions that can be deployed on-premise or through cloud services?

Another option is Anyscale, which lets you build, deploy and scale AI applications. Based on the open-source Ray framework, Anyscale spans multiple clouds and can run on-premises, automatically manages instances, and optimizes resources. It's a good choice for companies trying to cut costs while improving performance and efficiency in AI model deployment.

If data sovereignty and ease of use are top priorities, Prem is a platform for personalized Large Language Models (LLMs). Prem lets you fine-tune and deploy models on-premise, so sensitive data stays in the organization. It also comes with a library of Small Language Models (SLMs) you can use for custom tasks, which makes it a good fit for companies that want to keep their AI applications in house.

Last, dstack automates the provisioning of infrastructure for AI model development and deployment on a variety of cloud providers and data centers. The open-source engine makes it easier to manage AI workloads so you can concentrate on data and research instead of infrastructure. It supports a broad range of cloud providers and on-prem servers, so it's a good option for running AI models wherever you need.