Tag: anti-crawling ecology

The High Wall of the Login-Free Garden: Xiaohongshu Verdict of Zero Apertures, Three Login-Free Pipelines of WeChat Official Accounts, and the Final Accounting of the Free-Scraping Map

Extending the forty-round methodology from X, the scraping survey brought Xiaohongshu and WeChat official accounts into range: Xiaohongshu, after ten rounds plus twenty plus supplements, settles at zero login-free apertures — the edith API rejects all unauthenticated calls, public RSSHub instances carry no route, the signature scheme drifts with versions, and HuggingFace datasets only solve history; WeChat official accounts yield three field-tested login-free routes — Sogou WeChat search (20 per page without login, six rapid calls without throttling), direct article links (with a URL the full HTML pours out), and the self-hosted wewe-rss bridge (one scan-to-login subscribes any account); the X side, after three verifications plus five and then ten more rounds, settles at six channel classes (Nitter/Shitter RSS, three-tier detail sources, trends24 trends, the Archive.org historical archive, dual-source instance discovery, twiiit fallback), good for 500-5,000 items a day per IP and past ten thousand with GitHub Actions IP rotation.