Oumi:build state-of-the-art foundation models, end-to-end.
Oumi is a fully open-source platform designed to train, evaluate, and deploy foundation models end-to-end.
It supports models from 10M to 405B parameters, enabling fine-tuning using LoRA, QLoRA, DPO, and other techniques.
It integrates with popular inference engines (vLLM, SGLang) and works across laptops, clusters, and cloud platforms (AWS, Azure, GCP, Lambda, etc.).
Supports multimodal models like Llama, DeepSeek, and Phi.
βοΈ Key Benefits
β Oumi simplifies model training with a unified API, allowing seamless model fine-tuning, data synthesis, and evaluation. Supports both open-source and commercial APIs like OpenAI, Anthropic, and Vertex AI, making it highly flexible.
β Enables fast inference with optimized engines such as vLLM and SGLang, ensuring efficient deployment. Installation is straightforward with pip install oumi, supporting both CPU and GPU setups.
β Features a CLI tool (oumi train, oumi evaluate, oumi infer) for easy model training, evaluation, and inference.
β Supports cloud-based training with direct job execution on AWS, Azure, GCP, and Lambda.
β Includes prebuilt ready-to-use training recipes for LLM fine-tuning, distillation, evaluation, and inference.
β 100% open-source under Apache 2.0 license, with an active community on Discord and GitHub.