mlops

ML web service on FastAPI

A hybrid router that uses Spot GPU instances to reduce costs and Serverless GPUs for making Cold Starts faster.

A complete, hands-on roadmap to becoming an AI Engineer, from Python basics to production RAG, Agents, and Fine-Tuning. 10 modules, 20+ notebooks, 15 real projects. Free, open source, built for the community.

Kubernetes scanner that discovers LLMs running on vLLM and extracts their deployment and runtime facts.

An imperative command-line-interface for AI workload orchestration

A comprehensive, professional guide explaining the differences, strengths, and best practices of Retrieval-Augmented Generation (RAG) and Fine-Tuning for LLMs, including workflows, comparisons, decision frameworks, and real-world hybrid AI use cases.

🎹 Instruct.KR 2025 Summer Meetup: 오픈소스 LLM, vLLM으로 Production까지 🎹

Open-source benchmark for evaluating LLMs on 220 real professional tasks across 9 sectors and 44 occupations. Reproducible experiments, artifact validation, grading, and a live evidence dashboard.

This repository has been created to keep track of my 5 days progress.

Proxima lets existing GPUs serve 4x more concurrent requests

Why is LLM inference slow — and how do you make it fast? A hands-on, first-principles course: roofline → KV cache → quantization → parallelism → vLLM/SGLang, with GPU labs on open models.

Toolchain for creating custom datasets and training Stable Diffusion (1.x, 2.x, XL) models and LoRAs

A comprehensive, production-focused guide to acing AI/ML system design interviews at top tech companies.

面向小团队的一站式 NLP 小模型平台:数据集版本管理 · 训练 · 评估 · 在线部署 · Badcase 闭环,内置大模型 Prompt 盲测评测(人工 + AI 双指标)。

🚀 The Ultimate Curated List of LLMOps Tools, Frameworks, and Resources - A comprehensive collection of the best tools for Large Language Model Operations

Miscellaneous codes and writings for MLOps

Hands-on GPU/HPC infrastructure operations: K8s GPU scheduling, HAMi sharing, Slurm, observability & vLLM inference. Learn it free on a laptop; validate on one cheap GPU.

A complete roadmap to become an AI/LLM Engineer in 2026. Free & paid courses, 5 portfolio projects, interview prep, and resources. For software engineers with Python & ML basics who want to break into AI. Covers Transformers, RAG, fine-tuning, agents, LangChain, MLOps, and deployment.

I have fineTuned FinBert Model on 4.9k Financial News Headlines, Got 81-82% ACC and it perfrom well in Financial Stock News Sentiment Analysis

Honeycomb Lab — hex map + OpenAI gateway control plane for a home AI fleet