IS downloaded pics detection enable by default?

[yqluo168301]

I tried twice downloading from same deviant art url and found out the terminal log is printing like "downloading all pics" again.
Anyone knows how the process detect downloaded pics? I find something like --download-archive FILE or -NO skip in option, but by default it seems the process can't recognize downloaded pics in the same download folder.
I used powerful pixiv downloader before and that tool has cache that records all downloaded pics, so when you start scrapping from same url it will skip all downloaded pics and start from new ones. I wonder if this works the same

[mikf]

It is enabled by default.
https://gdl-org.github.io/docs/configuration.html#extractor-skip

It will still extract all download URLs, but won't re-download them. You can use options like -A/--abort or --filter "date >= datetime(2024, 9, 15) or abort()" to stop the data extraction process earlier.

[yqluo168301]

thanks!