Sitemap
🗺️ PhantomBlackOP Sitemap Generator
🧠 Overview
This repo powers a dynamic “sitemap.xml” generator that:
- 🚀 Crawls a rendered sitemap page built with Google Sites
- 📅 Extracts precise last modified times from Google Sites metadata (
data-last-updated-at-time) - 🐦 Decodes tweet timestamps using Twitter/X Snowflake ID logic
- ✨ Gracefully assigns UTC fallback dates to non-crawlable links (like
mailto:or.app) - 🔁 Auto-generates and commits sitemap via GitHub Actions daily at 03:00 UTC
🛠️ Tech Stack
- Python 3.11
- Playwright for headless browsing and metadata scraping
- BeautifulSoup for DOM parsing
- GitHub Actions for CI/CD automation
⚡ Usage
To run locally:
python scripts/generate_sitemap.py
Sample output:
✅ Extracted 57 links.
https://www.trevorion.io/home → lastmod: 2025-07-16T17:34:08.726000Z
...
✅ Sitemap successfully written to sitemap.xml
🔥 Credits
Created and curated by Trevor Grech (@Trevorion)
Home of the mythkeeper’s flame, daily experiments, and structured defiance.