URLFrontier

Develop a API between web crawler and frontier
Is freely licensed? ✅
Website https://github.com/crawler-commons/url-frontier
Source https://github.com/crawler-commons/url-frontier
NLNet grant pages