Tagged Web scraping

All posts

3 posts on Web scraping.

Hackathon Explorer: 10,014 winners in a 4 MB JSON, and why 78% of them are 'Global'

6 min read

A single-page React app that bundles a hand-scraped database of hackathon winners from 1999 to 2026. Zero backend. Every visitor downloads the whole dataset and filters locally. Also a candid diary of what the scraper couldn't recover.

HackathonWeb scrapingDevpostReact

A Heroku clock dyno that scraped my own LeetCode profile at 3 AM, and the MongoDB creds I leaked with it

7 min read

About 90 lines of Python, one Procfile, a Selenium instance that stops working every time LeetCode changes a Tailwind class, and a MongoDB Atlas connection string I committed in plain text. All of it educational.

HerokuSeleniumMongoDB AtlasAPScheduler

Scraping YouTube's Most-Replayed heatmap, weeks after it went public

5 min read

Three 2022 repos: a scratch pad, a clean library that returns the heatMarkerRenderer triples, and a Selenium-driven demo that opens the peak clip in a new tab. What the intensity curve actually looks like decoded.

YouTubeWeb scrapingPythonSelenium

Other topics

Python24Security10Memoir9SAP9React7System Design6Architecture5Next.js5RAG5Android4CipherStack4College project4