Optimized crawl efficiency in specific situations
Added 2022-11-07 05:56:32 +0000 UTCIf the user sets the posting date range (such as setting to crawl works in 2022-2023):
Previously, the downloader would make a request for all fetched works to get their publication date.
Now the downloader has built-in time data of the works, and can know the approximate publication date of each work, and judge the works that do not meet the conditions in advance, so there is no need to crawl them.
This improves crawling efficiency.
