r/PythonProjects2 • • 2d ago

Resource I built a Python repository collector that resumes interrupted runs using SQLite

Interrupted API collection can mean lost progress, repeated requests, and incomplete reports. I built Python Workflow Automation Lab to preserve progress between runs.

It collects public GitHub repository metadata, saves checkpoints in SQLite, and resumes from the last completed page. It also supports ETag caching, pauses when rate limits are reached, and exports JSON and CSV reports.

Built with Python’s standard library, with no external dependencies or API token required. The video demonstrates the workflow using offline sample data.

source

2 Upvotes

0 comments sorted by