ai-scraping

The context API to search, scrape, and interact with the web at scale. 🔥

🕷️ An adaptive Web Scraping framework that handles everything from a single request to a full-scale crawl!

Python scraper based on AI

AnyCrawl 🚀: A Node.js/TypeScript crawler that turns websites into LLM-ready data and extracts structured SERP results from Google/Bing/Baidu/etc. Native multi-threading for bulk processing.

A Powerful web scraper powered by LLM | OpenAI, Gemini & Ollama

Crawl a website starting from a URL, find relevant pages, and extract data – all guided by your natural language prompt.

Fast, local-first web content extraction for LLMs. Scrape, crawl, extract structured data — all from Rust. CLI, REST API, and MCP server.

🔥 This repository contains complete application examples, including websites and other projects, developed using Firecrawl.