Firecrawl

Firecrawl is an API that turns websites into clean, LLM-ready markdown. It handles JavaScript rendering, anti-bot bypassing, and structured extraction. Given a URL, Firecrawl returns the page content as markdown with metadata — perfect for feeding web content into RAG pipelines, AI agents, and research tools. Also supports full-site crawling and sitemap generation.