1 posts tagged with scraping.
Displaying 1 through 1 of 1. Subscribe:

git-history: a tool for analyzing scraped data collected using Git and SQLite

I've been exploring a way of running web scrapers for a few years that I call Git scraping: the idea is to scrape a source of data (like a "current power outages" map from an electricity company) into a Git repository such that the history of that repository tells the story of changes to that information over time. git-history is a new command-line utility I've released which helps convert that collected history into a SQLite database to support analysis using my Datasette tool.
posted by simonw on Dec 12, 2021 - 6 comments

Page: 1