Skip to main content

Documentation Index

Fetch the complete documentation index at: https://firecrawl-mog-search-exclude-include-domains.mintlify.app/llms.txt

Use this file to discover all available pages before exploring further.

The Firecrawl API gives you programmatic access to web data. All endpoints share a common base URL, authentication scheme, and response format described on this page.

​
Features

Scrape

Extract content from any webpage in markdown or json format.

Parse

Upload files and parse them into markdown or other formats.

Crawl

Crawl entire websites and get content from all pages.

Map

Get a complete list of URLs from any website quickly and reliably.

Search

Search the web and get full page content in any format.

​
Agentic Features

Agent

Autonomous web data gathering powered by AI.

Browser

Create and control browser sessions for interactive web tasks.

​
Base URL

All requests use the following base URL: 
https://api.firecrawl.dev

​
Authentication

Every request requires an Authorization header with your API key: 
Authorization: Bearer fc-YOUR-API-KEY
Include this header in all API calls. You can find your API key in the Firecrawl dashboard. 
curl -X POST "https://api.firecrawl.dev/v2/scrape" \
  -H "Authorization: Bearer fc-YOUR-API-KEY" \
  -H "Content-Type: application/json" \
  -d '{"url": "https://example.com"}'

​
Response codes

Firecrawl uses conventional HTTP status codes to indicate the outcome of your requests. Codes in the 2xx range indicate success, 4xx codes indicate client errors, and 5xx codes indicate server errors. See Errors for the full reference, including the error string returned for each failure mode, retry guidance, and a copy-pasteable backoff snippet.

​
Rate limit

The Firecrawl API enforces rate limits on all endpoints to ensure service stability. Rate limits are based on the number of requests within a specific time window. When you exceed the rate limit, the API returns a 429 status code. Back off and retry the request after a short delay.