01 / CORE HTML
The everyday crawl
Metadata, links, images, redirects, indexing, canonicals, structured data and a sitemap-only page.
/core/ · HTML · 200-page cap · sitemap discovery on
A controlled testing ground
Known problems.
Measurable results.
A fictional workshop website built to put crawlers through their paces. Every test has a purpose, and the answer sheet tells you what to expect.
114Finite published URLs
57Current rules mapped
0Databases to configure
First, check the installation
A short browser check of real responses from this copy of the lab.- Not checked yet. Run this after uploading the files.
Passing these checks confirms the sampled hosting behaviour. It does not prove crawler accuracy or qualify every server setting.
Choose a test run
Separate runs keep the evidence comparable.02 / RENDERED
What changes in the browser
Scripts change titles, canonicals, directives and links. Real failed resources and an oversized image add response evidence.
/rendered/ · JavaScript · 30-page cap · sitemaps off
03 / HTML CONTROL
The same pages without JavaScript
Run the rendered suite in HTML mode. Missing resource measurements should remain unknown; browser comparisons should be skipped.
/rendered/ · HTML · 30-page cap · sitemaps off
04 / INCOMPLETE + SITEMAP FAULTS
Make uncertainty visible
A two-page crawl must not claim the whole graph is healthy. A separate, manually installed robots profile enables malformed and looping sitemap tests.
Use the included testing guide for these two separate profiles.
COMPLETE GRAPH CONTROL
Orphans and navigation depth
This isolated suite has no deliberate request failures. It can establish graph closure, reveal a six-link-deep page and identify a sitemap-only orphan.
/graph/ · HTML · 30-page cap · sitemaps on
LOCAL RESULTS CHECK
Check your CrawlPrism export
Load an all-pages JSON export and compare the listed assertions. The helper checks crawl settings and highlights mismatches. Your file stays in your browser.
Open the results checker →Use the same settings. Content area
main; title guide 60 characters; description 160; minimum words 50; depth guide 4; image budget 200,000 bytes; alt guide 125. Expected-indexable path /core/noindex; heuristic exclusion /core/excluded-short. Leave robots compliance on. These guides are test settings, not universal SEO requirements.The answer sheet
Assertions apply to the named rule and profile, not every finding on a page.| Run | Page path | Rule | Expected state | What to verify |
|---|
What this lab cannot prove
DNS failure, root robots failure and browser crash/deadline injection stay in the isolated harness. Public tests do not qualify large-site performance, long-running stability or every hosting platform. A passing result is specific to the evidence and settings used.
Screaming Frog Free can compare the core HTML cases within its 500-URL limit. JavaScript rendering and some configuration/reporting features need its paid licence. Compare underlying observations, not identical issue names or totals.