llm

Local CLI for Google's TranslateGemma translation models with multi-platform support (MLX for Apple Silicon, PyTorch for CUDA/CPU).

AstorAI is a user-friendly medical chatbot powered by Retrieval-Augmented Generation (RAG) and the advanced LLama 3 model. It offers real-time, accurate responses to a wide range of medical queries, ensuring privacy and security in every interaction. Designed for ease of use, AstorAI provides reliable health information on various topics 24/7.

GraphRAG over any codebase — a Neo4j knowledge graph of code entities plus a 3072-dim vector index, bridged so one natural-language query walks structure and ranks by meaning. Python · Neo4j · OpenAI embeddings · Streamlit · Docker. Hybrid semantic + structural code search.

An open source framework for Retrieval-Augmented System (RAG) uses semantic search helps to retrieve the expected results and generate human readable conversational response with the help of LLM (Large Language Model).

We introduce new approach, Token Reduction using CLIP Metric (TRIM), aimed at improving the efficiency of MLLMs without sacrificing their performance.

AI at your fingertips: powerful CLI tools for speech, text, and language processing

Open-source desktop client for the xAI Grok API — chat, image & video generation, voice, and an agentic coding module with local file access. Bring your own key, no telemetry.

An open-source, model-agnostic agent harness for local LLMs. Define agents in YAML (tools, memory, deny-first permissions) and run them against any OpenAI-compatible endpoint: vLLM, Ollama, LM Studio, or llama.cpp.

A fine-tuning SDK — any open model, any harness, any method. 12 training methods behind one argument; pure-stdlib core.

Using langchain framework created some useful Ai applications.

AI orbit monitor — papers, models, benchmarks, company news in one dashboard. 40+ sources, LMArena leaderboard, local LLM summary.

Open-source Prompt Firewall — deflect up to 95% of redundant LLM traffic before it leaves your infrastructure. Documents: https://isartor-ai.github.io/Isartor/index.html

Production-grade framework for building multi-agent AI systems. Graph-based orchestration, LLM-agnostic (OpenAI, Google GenAI, Anthropic), 3-layer memory (Redis cache + Postgres + vector store), live agents, parallel tool execution, and native MCP. Ships a full ecosystem: backend, REST API + CLI, TypeScript SDK, and React playground

Minimal, async-first Python framework for production LLM apps- 2 hard deps, no magic, no SaaS.

FinRAGBench-V: A Benchmark for Multimodal RAG with Visual Citation in the Financial Domain (EMNLP 2025)

🦉 Generate quizzes from video application

Talk to your coding agents — press a hotkey, speak your prompt, and it lands in Claude Code, Codex, or Cursor. Fully local voice dictation (Parakeet + Gemma), nothing leaves your machine. Windows, macOS & Linux.

Low-Cost Cross-Domain Web Structured Information Extraction using specialized LoRA adapters.

Fine-tune the newly released Llama-3.2 lightweight models.

📘 Taiwan-LLM Tutor: Large Language Models for Taiwanese Secondary Education