firecrawl-build-crawl

Integrate Firecrawl `/crawl` into product code for bulk extraction across a site or site section. Use when a feature needs many related pages, such as documentation sets, help centers, or blogs, and page-by-page `/scrape` would be too manual.

firecrawl/skills556 installsISCSynced Aug 25

Works with

Claude CodeCursorCodex CLIGitHub CopilotGemini CLI
---
name: firecrawl-build-crawl
description: Integrate Firecrawl `/crawl` into product code for bulk extraction across a site or site section. Use when a feature needs many related pages, such as documentation sets, help centers, or blogs, and page-by-page `/scrape` would be too manual.
license: ISC
---

# Firecrawl Build Crawl

Use this when the product needs many pages from the same site, not just one.

## Use This When

- the feature targets a docs section, blog, or help center
- you need bulk extraction with path or depth boundaries
- the product should ingest or refresh a site section at once

## Guidance

- Keep crawl scope narrow with path, depth, or page-count constraints.
- Prefer `/crawl` over many manual `/scrape` calls when the site structure is stable.
- Treat this as secondary to `/scrape`, `/search`, and `/interact` unless the feature is clearly site-wide.

## When Not To Use It

- If you only need one known URL, use [firecrawl-build-scrape](../firecrawl-build-scrape/SKILL.md).
- If you first need to discover URLs on a single site, start with [firecrawl-build-map](../firecrawl-build-map/SKILL.md).

## Docs (Source of Truth)

Read the docs for request/response schemas, parameters, and SDK examples before writing integration code:

- [docs.firecrawl.dev/features/crawl](https://docs.firecrawl.dev/features/crawl)

## See Also

- [firecrawl-build](../firecrawl-build/SKILL.md)
- [firecrawl-build-map](../firecrawl-build-map/SKILL.md)
- [firecrawl-build-scrape](../firecrawl-build-scrape/SKILL.md)

More Writing & Documentation skills

paper-context-resolver

lllllllama/rigorpilot-skills

Rigor Paper Context helper for README-first deep learning repo reproduction. Use only when the README and repository files leave a narrow reproduction-critical gap and the task is to resolve a specific paper detail such as dataset split, preprocessing, evaluation protocol, checkpoint mapping, or runtime assumption from primary paper sources while recording conflicts. Do not use for general paper summary, repo scanning, environment setup, command execution, title-only paper lookup, or replacing README guidance by default.

450.8k

repo-intake-and-plan

lllllllama/rigorpilot-skills

Rigor Intake helper for README-first deep learning repo reproduction. Use when the task is specifically to scan a repository, read the README and common project files, extract documented commands, classify inference, evaluation, and training candidates, and return the smallest trustworthy reproduction plan to the main orchestrator. Do not use for environment setup, asset download, command execution, final reporting, paper lookup, or end-to-end orchestration.

450.0k

minimal-run-and-audit

lllllllama/rigorpilot-skills

Rigor Run skill for README-first deep learning repo reproduction. Use when the task is specifically to capture or normalize evidence from the selected smoke test or documented inference or evaluation command and write standardized `repro_outputs/` files, including patch notes when repository files changed. Do not use for training execution, initial repo intake, generic environment setup, paper lookup, target selection, hidden scientific-meaning changes, or end-to-end orchestration by itself.

449.9k

← All Writing & Documentation skills

Check your AI visibility

One URL in, a 0–100 score and the exact fixes out.

RUN THE CHECK

Browse all the tools

15 tools across six categories
13 of them never send your data anywhere

Free · No signup · No trial clock

SEE THE DIRECTORY