AegisRunner
Start free
All docs

Crawling

Starting a New Crawl

Configure and start a scan: Quick vs Advanced, page budget, device, sitemap, form filling.

Last updated: May 28, 2026

Starting a Scan

Click Run a scan in a project (or add a new project). The scan modal has two modes.

Quick

One click, no decisions. Quick runs a thorough crawl using your plan’s full page allowance with sensible defaults (deep crawl, sitemap parsing, forms filled but not submitted). Best for the first scan of a site.

Advanced

OptionWhat it does
Max pagesCap on pages crawled. Defaults to your plan’s limit (shown in the banner).
Max depthHow many links deep to follow from the start URL.
DeviceDesktop or mobile emulation.
Only this pageAudit a single URL with no navigation.
Use sitemap.xmlSeed the crawl with URLs from your sitemap.
Fill / submit formsAuto-fill forms during the crawl; optionally submit them (may create data — off by default).

Page budget

The number of pages a scan can cover is set by your plan. The modal shows your cap; paid plans (and the 14-day trial) raise it substantially. Free is capped to a small number of pages per scan.

After you start

You land on the Report lens with a “scan in progress” banner; pages stream in live. When the crawl completes, AI test generation kicks off automatically and the report fills in with audits and tests. If a scan can’t finish (site blocked the crawler, login required, or no content), the report shows the reason.