Sitemap URL Extractor — Pull Every Page URL From Any Website Into a CSV
The problem:SEO audits, competitor research, and content gap analysis all start the same way: you need a list of every page on a website. Manually clicking through a site to find pages takes hours and misses most of them. Paid SEO tools charge $99/month for what should be a simple export.What this does:✅ Auto-discovers sitemaps via /sitemap.xml, /sitemap_index.xml, and robots.txt — no manual URL hunting✅ Handles sitemap index files recursively — works on sites with thousands of pages across dozens of sub-sitemaps✅ Extracts URL, lastmod date, changefreq, and priority for every page✅ Exports to CSV — open directly in Excel or Google Sheets✅ --limit flag to grab a sample without waiting for a full crawl✅ Zero dependencies — uses Python's built-in libraries only, nothing to installWho it's for:- SEO professionals building site audits for clients- Content marketers doing competitor research and gap analysis- Freelancers who need to map a site's structure quickly- Agency owners who audit multiple sites and need a fast, repeatable workflowWhat you get:- Python script (main.py) — runs on Windows, Mac, Linux- requirements.txt — no dependencies (stdlib only)- Step-by-step README.md — no coding experience neededRequirements:- Python 3.8+ installed (free at python.org)- No API keys, no accounts, no subscriptionsSetup takes 2 minutes:1. Install Python if you haven't (free at python.org)2. Open a terminal and run: python main.py https://yoursite.com3. Open the CSV in Excel or Google Sheets30-day refund policy. If it doesn't work on your machine, email me and I'll fix it or refund you.
Get it → 5938983212988.gumroad.com