#mlops

Apache Airflow - A platform to programmatically author, schedule, and monitor workflows

The AI developer platform. Use Weights & Biases to train and fine-tune models, and manage models from experimentation to production.

Workflow Engine for Kubernetes

Kedro is a toolbox for production-ready data science. It uses software engineering best practices to help you create data engineering and data science pipelines that are reproducible, maintainable, and modular.

The open source AI engineering platform for agents, LLMs, and ML models. MLflow enables teams of all sizes to debug, evaluate, monitor, and optimize production-quality AI applications while controlling costs and managing access to models and data.

Build, Manage and Deploy AI/ML Systems

The simplest way to serve AI/ML models in production

An orchestration platform for the development, production, and observation of data assets.

The Open Source Feature Store for AI/ML

Always know what to expect from your data.

Standardized Distributed Generative and Predictive AI Inference Platform for Scalable, Multi-Framework Deployment on Kubernetes

Weaviate is an open-source vector database that stores both objects and vectors, allowing for the combination of vector search with structured filtering with the fault tolerance and scalability of a cloud-native database​.

ZenML 🙏: One AI Platform from Pipelines to Agents. https://zenml.io.

🐢 Open-Source Evaluation & Testing library for LLM Agents

Open Lakehouse Format for Multimodal AI. Convert from Parquet in 2 lines of code for 100x faster random access, vector index, and data versioning. Compatible with Pandas, DuckDB, Polars, Pyarrow, and PyTorch with more integrations coming..

Community maintained hardware plugin for vLLM on Huawei Ascend

Build applications that make decisions (chatbots, agents, simulations, etc...). Monitor, trace, persist, and execute on your own infrastructure.

The easiest way to serve AI apps and models - Build Model Inference APIs, Job queues, LLM apps, Multi-model pipelines, and more!

Dynamic, resilient AI orchestration. Coordinate data, models, and compute as you build AI workflows.

Managing the lifecycle of machine learning to support scalability, impact, collaboration, compliance and sharing.

MLRun is an open source MLOps platform for quickly building and managing continuous ML applications across their lifecycle. MLRun integrates into your development and CI/CD environment and automates the delivery of production data, ML pipelines, and online applications.

NucliaDB, The AI Search database for RAG

The unified multimodal backend for AI data apps. Database, orchestration, and serving in one Python file.

The AI Compute Platform for frontier teams. SkyPilot turns fragmented AI compute into one AI supercomputer, so frontier AI teams build custom intelligence faster.

Streamlining reinforcement learning with RLOps. State-of-the-art RL algorithms and tools, with 10x faster training through evolutionary hyperparameter optimization.

The data factory for next gen AI

⚡️SwanLab - an open-source, modern-design AI training tracking and visualization tool. Supports Cloud / Self-hosted use. Integrated with PyTorch / Transformers / verl / LLaMA Factory / ms-swift / Ultralytics / MMEngine / Keras etc.

ClearML - Auto-Magical CI/CD to streamline your AI workload. Experiment Management, Data Management, Pipeline, Orchestration, Scheduling & Serving in one MLOps/LLMOps solution

Stop trusting your pipeline. Verify it; visually on a canvas or in Python. Self-hosted platform + library.