Build a technical SEO crawler that thinks like Googlebot
Lessons from building a Node.js SEO crawler with ~100 checks: robots.txt matching is subtle, soft 404s are everywhere, and why every rule needs a source.
2 min read#seo#nodejs#nextjs
1 post
Lessons from building a Node.js SEO crawler with ~100 checks: robots.txt matching is subtle, soft 404s are everywhere, and why every rule needs a source.