Search tools, frameworks, libraries, categories and domains
API and open-source crawler that turns websites into clean Markdown or structured data for LLMs.
npm i @mendable/firecrawl-js
Package firecrawl-py, last 26 weeks.
firecrawl-py
Other tools in the same categories.
docling-project/docling
IBM-born toolkit that converts PDFs, DOCX, PPTX and images into structured Markdown/JSON with layout and tables.
microsoft/markitdown
Microsoft utility that converts Office files, PDFs, HTML and more into Markdown for LLM input.
Unstructured-IO/unstructured
Open-source ETL library for partitioning and chunking dozens of document types for RAG pipelines.
opendatalab/MinerU
High-accuracy PDF-to-Markdown/JSON extractor from OpenDataLab, strong on formulas, tables and Chinese docs.
llamaindex.ai
LlamaIndex's hosted, LLM-powered document parser for complex PDFs, tables and charts.
unclecode/crawl4ai
Open-source async web crawler and scraper producing LLM-friendly Markdown, built on Playwright.
infiniflow/ragflow
Open-source RAG engine with deep document understanding, chunk visualization and agent workflows.
microsoft/graphrag
Microsoft's pipeline that builds a knowledge graph from documents to answer global, multi-hop questions.
HKUDS/LightRAG
Simple, fast graph-based RAG combining knowledge graphs with vector retrieval at lower cost than GraphRAG.