knowledge-distillation

将冰冷的离别化为温暖的 Skill，欢迎加入数字生命1.0！Transforming cold farewells into warm skills? It's giving rebirth era. Welcome to Digital Life 1.0. 🫶

把书、长视频、播客等高价值内容蒸馏成可执行的 Agent Skills

Awesome Knowledge Distillation

Collection of AWESOME vision-language models for vision tasks

AI Powered Knowledge Graph Generator

EasyNLP: A Comprehensive and Easy-to-use NLP Toolkit

A curated list for Efficient Large Language Models

Segmind Distilled diffusion

[ICML 2026] GRACE-VLM: deployable INT4 Qwen3-VL via quantization-aware distillation.

大师.skill — 输入行业，自动调研 6 轨[行业大佬 / 工具地图 / 工作流 / 知识正典 / 信息源 / 术语标准] → 提炼为可运行的行业 Master OS skill；装到任意 Claude Code / OpenClaw / Codex / Hermes agent 即让其进入「这一行的资深人」模式。MIT，Python + Shell。

A collection of resources on using BERT (https://arxiv.org/abs/1810.04805 ) and related Language Models in production environments.

Awesome-3D/Multimodal-Anomaly-Detection-and-Localization/Segmentation/3D-KD/3D-knowledge-distillation

easy-bert是一个中文NLP工具，提供诸多bert变体调用和调参方法，极速上手；清晰的设计和代码注释，也很适合学习

Open-source platform for creating, distributing and running sovereign EU-compliant LLMs. Verticalize any model for your domain, language and brand. AI Act ready.

Biologically-grounded adversarial training platform: cyclic Wake/Dream/Nightmare/Compress phases that accumulate model robustness without catastrophic forgetting. Dockerized, EU AI Act compliance reporting.

Structured pruning, knowledge distillation, and fairness analysis for Large Language Models.

Synthetic medical VQA pipeline: 119K images annotated by frontier VLMs, cross-validated at 93% agreement, fine-tuned on 3 model families (2-3B params)

[MICCAI 2023] Fundus-Enhanced Disease-Aware Distillation Model for Retinal Disease Classification from OCT Images

Enterprise-grade Knowledge Distillation framework for Persian Mental Health analysis. Distills reasoning capabilities from Llama-3-70b into a local Gemma-3-1b model using QLoRA and synthetic Chain-of-Thought datasets.

Distilling Task-Specific Knowledge from Teacher Model into BiLSTM