model-deployment

Free MLOps course from DataTalks.Club

Simple and Distributed Machine Learning Python Library porting ML algorithms for Spark

RAG (Retrieval Augmented Generation) Framework for building modular, open source applications for production by TrueFoundry

FEDML - The unified and scalable ML library for large-scale distributed training, model serving, and federated learning. FEDML Launch, a cross-cloud scheduler, further enables running any AI jobs on any GPU cloud or on-premise cluster. Built on this library, TensorOpera AI (https://TensorOpera.ai) is your generative AI platform at scale.

Python + Inference - Model Deployment library in Python. Simplest model inference server ever.