web-scraping

Collect structured responses from a ChatGPT scraper by sending a prompt with valid ChatGPT scraping API credentials. Enable live search, inject HTML context, and automate intelligent scraper ChatGPT workflows in just a few parameters.

Official Agent skills of Oxylabs products

Open source web infrastructure for AI. Scrape, crawl, and automate the web, clean markdown, browser sessions, ready for your agents.

Fast, stateless CLI for web search and scrape. Built for AI agents.

A skill for AI agents: search the web with SearXNG, browse with Camofox, bypass protections with CloakBrowser. Anti-hallucination by design. Self-hosted, free, unlimited.

Self-hosted URL- and file-to-Markdown service for humans and AI agents - web pages, documents, images, audio, YouTube. PWA + REST + MCP + Claude Code skill, Reddit-aware, refreshable share links.

MinerU-HTML: An SLM-powered HTML main content extractor that outputs clean HTML bodies. Perfect for Deep Research Agents, RAG applications, and training data generation.

A hand-picked collection of AI tools for content, automation, e-commerce, web building, voice, and growth.

Self-hosted search + markdown harvester for AI agents. SearXNG (100+ engines) + FastAPI + trafilatura. Tavily-compatible /search plus /extract with size presets and pagination. One-command Docker Compose.

OpenClaw skill for scraping any URL using the Decodo Web Scraping API.

Keyscan: AI-powered API key scanner for GitHub Gists.

Pareto-optimal models for cleaning the web — fast, encoder-based main-content extraction from HTML.

Automated Deep Research with LLMs, web search, paper parsing, and didactic summarization.

AI Lead Generation Agent that automatically discovers and qualifies potential leads from Quora. Using Firecrawl for intelligent web scraping, Phidata for agent orchestration, and Composio for Google Sheets integration, you'll create a system that can continuously generate and organize qualified leads with minimal human intervention!

Free open-source business data enrichment engine. The open-source alternative to Apollo, ZoomInfo, and Clearbit.

DeepSearchJobs is a job-discovery engine that uncovers hidden, niche, and low-competition opportunities not found on major platforms. It uses smart scraping, async pipelines, worker processing, and data extraction to surface high-value jobs and direct hiring contacts, usable via Play2Path or locally with your own data.

Your agent seeks what search can't find. A self-hosted perception MCP server that transcribes speech, reads behind logins, sees images and video frames, crosses languages, and remembers.

Turn any website into clean, LLM-ready data. Open-source web crawler with stealth mode, distributed crawling, real-time WebSocket progress & Markdown output. Power your AI apps with GcrawlAI.

Web Scraping, Document Deduplication & GPT-2 Fine-tuning with a newly created scam dataset.

Low-Cost Cross-Domain Web Structured Information Extraction using specialized LoRA adapters.