Skip to content

Latest commit

 

History

History
29 lines (20 loc) · 1.19 KB

README.md

File metadata and controls

29 lines (20 loc) · 1.19 KB
Raw

Repology link checker

Build Status Coverage Status

This is a standalone link validity checker daemon for Repology project.

It operates on links table in Repology PostgreSQL database, which contains homepage and download URLs of F/OSS projects extracted from packages by Repology, taking URLs from there, checking their validity and accessibility via both IPv4 and IPv6 and writes the status back.

Features

  • asyncio based, which means it doesn't require a lot of resources, but still can process a lot of links in parallel
  • it takes most care to not generate excess load on servers by maintaining per-host queues and adding delays between consequential requests to a single host
  • (TODO) checks link availability via both IPv4 and IPv6
  • (TODO) capable of FTP link checking

Author

License

GPLv3 or later, see COPYING.