« Changelog History


krawler v0.4.4 Release Notes

Release Date: 2020-01-29 // about 4 years ago
    • ⬆️ Upgrade Kotlin to 1.3.61
    • ⚡️ Upgrade kotlinx.coroutines. This required an update to some of the places where coroutine builders were called internally.
    • ⬆️ Upgrade Gradle wrapper

Previous changes from v0.4.3

    • ➕ Added ability to clear crawl queues by RequestId and Age, see Krawler#removeUrlsByRootPage
      🚚 and Krawler#removeUrlsByAge
    • ➕ Added config option to prevent crawler shutdown on empty queues
    • ➕ Added new single byte priority field to KrawlQueueEntry. Queues will always attempt to pop the lowest priority
      entry available. Priority can be assigned by overriding the Krawler#assignQueuePriorty method.
    • ⚡️ Update dependencies