jmh108

Python-based web crawler extracts website content into markdown files, enabling efficient content aggregation and site archiving.

Extracts and transforms webpage content into clean, LLM-optimized Markdown by removing non-essential elements while preserving key metadata.