Firecrawl
Firecrawl automates web crawling and data extraction, enabling organizations to gather content, index sites, and gain insights from online sources at scale
7 actionsAPI key
What your bot can do in Firecrawl
Looks up
- Get the status of a crawl jobRetrieves the current status, progress, and details of a web crawl job, using the job id obtained when the crawl was initiated.
- Map multiple URLsMaps a website by discovering urls from a starting base url, with options to customize the crawl via search query, subdomain inclusion,…
Takes action
- Cancel a crawl jobCancels an active or queued web crawl job using its id.
- Extract structured dataExtracts structured data from web pages by initiating an extraction job and polling for completion.
- Scrape URLScrapes a publicly accessible url, optionally performing pre-scrape browser actions or extracting structured json using an llm, to…
- SearchPerforms a web search for a query, scrapes content from the top search results using firecrawl, and returns details in specified formats.
- Start a web crawlInitiates a firecrawl web crawl from a given url, applying various filtering and content extraction rules, and polls until the job is…
