Crawling
Starting a New Crawl
Configure and start a scan: Quick vs Advanced, page budget, device, sitemap, form filling.
Last updated: May 28, 2026
Starting a Scan
Click Run a scan in a project (or add a new project). The scan modal has two modes.
Quick
One click, no decisions. Quick runs a thorough crawl using your plan’s full page allowance with sensible defaults (deep crawl, sitemap parsing, forms filled but not submitted). Best for the first scan of a site.
Advanced
| Option | What it does |
|---|---|
| Max pages | Cap on pages crawled. Defaults to your plan’s limit (shown in the banner). |
| Max depth | How many links deep to follow from the start URL. |
| Device | Desktop or mobile emulation. |
| Only this page | Audit a single URL with no navigation. |
| Use sitemap.xml | Seed the crawl with URLs from your sitemap. |
| Fill / submit forms | Auto-fill forms during the crawl; optionally submit them (may create data — off by default). |
Page budget
The number of pages a scan can cover is set by your plan. The modal shows your cap; paid plans (and the 14-day trial) raise it substantially. Free is capped to a small number of pages per scan.
After you start
You land on the Report lens with a “scan in progress” banner; pages stream in live. When the crawl completes, AI test generation kicks off automatically and the report fills in with audits and tests. If a scan can’t finish (site blocked the crawler, login required, or no content), the report shows the reason.
Was this helpful?