v1.24.0

Additions

• [exhentai] add metadata to search results (#3181)
• [gelbooru_v02] implement notes extraction
• [instagram] add guide extractor (#3192)
• [lolisafe] add support for xbunkr (#3153, #3156)
• [mastodon] add instance_remote metadata field (#3119)
• [nitter] add extractors for Nitter instances (#2415, #2696)
• [pixiv] add support for new daily AI rankings category (#3214, #3221)
• [twitter] add avatar and background extractors (#349, #3023)
• [uploadir] add support for uploadir.com (#3162)
• [wallhaven] add user extractor (#3212, #3213, #3226)
• [downloader:http] add chunk-size option (#3143)
• [downloader:http] add file signature check for .mp4 files
• [downloader:http] add file signature check and MIME type for .avif files
• [postprocessor] implement post-after event (#3117)
• [postprocessor:metadata] implement "mode": "jsonl"
• [postprocessor:metadata] add open, encoding, and private options
• add --chunk-size command-line option (#3143)
• add --user-agent command-line option
• implement http-metadata option
• implement "user-agent": "browser" (#2636)

Changes

• [deviantart] restore cookies warning for mature scraps (#3129)
• [instagram] use REST API for unauthenticated users by default
• [downloader:http] increase default chunk-size to 32768 bytes (#3143)
• build Windows executables using py2exe's new freeze() API
• build executables on GitHub Actions with Python 3.11
• reword error text for unsupported URLs

Fixes

• [exhentai] fix pagination (#3181)
• [khinsider] fix extraction (#3215, #3219)
• [realbooru] fix download URLs (#2530)
• [realbooru] fix tags extraction (#2530)
• [tumblr] fall back to gifv when possible (#3095, #3159)
• [twitter] fix login (#3220)
• [twitter] update URL for syndication API (#3160)
• [weibo] send Referer headers (#3188)
• [ytdl] update parse_bytes location (#3256)

Improvements

• [imxto] extract additional metadata (#3118, #3175)
• [instagram] allow downloading avatars for private profiles (#3255)
• [pixiv] raise error for invalid search/ranking parameters (#3214)
• [twitter] update bookmarks pagination (#3172)
• [downloader:http] refactor file signature checks
• [downloader:http] improve -r/--limit-rate accuracy (#3143)
• add loaded config files to debug output
• improve -K output for lists

Removals

• [instagram] remove login support (#3139, #3141, #3191)
• [instagram] remove channel extractor
• [ngomik] remove module

v1.23.5

Fixes

• [instagram] fix AttributeError on user stories extraction (#3123)

v1.23.4

Additions

• [aibooru] add support for aibooru.online (#3075)
• [instagram] add avatar extractor (#929, #1097, #2992)
• [instagram] support instagram.com/s/ highlight URLs (#3076)
• [instagram] extract coauthors metadata (#3107)
• [mangasee] add support for mangalife (#3086)
• [mastodon] add bookmark extractor (#3109)
• [mastodon] support cross-instance user references and /web/ URLs (#3109)
• [moebooru] implement notes extraction (#3094)
• [pixiv] extend metadata option (#3057)
• [reactor] match best, new, all URLs (#3073)
• [smugloli] add smugloli extractors (#3060)
• [tumblr] add fallback-delay and fallback-retries options (#2957)
• [vichan] add generic extractors for vichan imageboards

Fixes

• [bcy] fix extraction (#3103)
• [gelbooru] support alternate parameter order in post URLs (#2821)
• [hentai2read] support minor versions in chapter URLs (#3089)
• [hentaihere] support minor versions in chapter URLs
• [kemonoparty] fix dms extraction (#3106)
• [kemonoparty] update pagination offset
• [manganelo] update domain to chapmanganato.com (#3097)
• [pixiv] use exact_match_for_tags as default search mode (#3092)
• [redgifs] fix token extraction (#3080, #3081)
• [skeb] fix extraction (#3112)
• improve compatibility of DownloadArchive (#3078)

v1.23.3

Additions

• [2chen] Add 2chen.moe extractor (#2707)
• [8chan] add thread and board extractors (#2938)
• [deviantart] add group option (#3018)
• [fanbox] add content metadata field (#3020)
• [instagram] restore cursor functionality (#2991)
• [instagram] restore warnings for private profiles (#3004, #3045)
• [nana] add nana extractors (#2967)
• [nijie] add feed and followed extractors (#3048)
• [tumblr] support https://www.tumblr.com/BLOGNAME URLs (#3034)
• [tumblr] add offset option
• [vk] add tagged extractor (#2997)
• add path-extended option (#3021)
• emit debug logging messages before calling time.sleep() (#2982)

Changes

• [postprocessor:metadata] assume "mode": "custom" when format is given

Fixes

• [artstation] skip missing projects (#3016)
• [danbooru] fix ugoira metadata extraction (#3056)
• [deviantart] fix deviation extraction (#2981)
• [hitomi] fall back to webp when selected format is not available (#3030)
• [imagefap] fix and improve folder extraction and gallery pagination (#3013)
• [instagram] fix login (#3011, #3015)
• [nozomi] fix extraction (#3051)
• [redgifs] fix extraction (#3037)
• [tumblr] sleep between fallback retries (#2957)
• [vk] unescape error messages
• fix duplicated metadata bug with -j (#3033)
• fix bug when processing input file comments (#2808)

v1.23.2

Additions

• [artstation] support search filters (#2970)
• [blogger] add label and query metadata fields (#2930)
• [exhentai] add a slash to the end of gallery URLs (#2947)
• [instagram] add count metadata field (#2979)
• [instagram] add api option
• [kemonoparty] add count metadata field (#2952)
• [mastodon] warn about moved accounts (#2939)
• [newgrounds] add games extractor (#2955)
• [newgrounds] extract type metadata
• [pixiv] add series extractor (#2964)
• [sankaku] implement refresh option (#2958)
• [skeb] add search extractor and filters option (#2945)

Fixes

• [deviantart] fix extraction (#2981, #2983)
• [fappic] fix extraction
• [instagram] extract higher-resolution photos (#2666)
• [instagram] fix username and fullname metadata for saved posts (#2911)
• [instagram] update API headers
• [kemonoparty] send Referer headers (#2989, #2990)
• [kemonoparty] restore favorites API endpoints (#2994)
• [myportfolio] use fallback when no images are found (#2959)
• [plurk] fix extraction (#2977)
• [sankaku] detect expired links (#2958)
• [tumblr] retry extraction of failed higher-resolution images (#2957)

v1.23.1

Additions

• [flickr] add support for secure.flickr.com URLs (#2910)
• [hotleak] add hotleak extractors (#2890, #2909)
• [instagram] add highlight_title and date metadata for highlight downloads (#2879)
• [paheal] add support for videos (#2892)
• [tumblr] fetch high-quality inline images (#2877)
• [tumblr] implement ratelimit option (#2919)
• [twitter] add general support for unified cards (#2875)
• [twitter] implement cards-blacklist option (#2875)
• [zerochan] add metadata option (#2861)
• [postprocessor:zip] implement files option (#2872)

Fixes

• [bunkr] fix extraction (#2903)
• [bunkr] use media-files servers for m4v and mov downloads (#2925)
• [exhentai] improve 509.gif detection (#2901)
• [exhentai] guess extension for original files (#2842)
• [poipiku] use img-org.poipiku.com as image domain (#2796)
• [reddit] prevent exception with empty submission URLs (#2913)
• [redgifs] fix download URLs (#2884)
• [smugmug] update default API credentials (#2881)
• [twitter] provide proper date for syndication results (#2920)
• [twitter] fix new-style /card_img/ URLs
• remove all whitespace before comments after input file URLs (#2808)

v1.23.0

Changes

• [twitter] update user and author metdata fields
  • for URLs with a single username or ID like https://twitter.com/USER or a search with a single from: statement, user will now always refer to the user referenced in the URL.
  • for all other URLs like https://twitter.com/i/bookmarks, user and author refer to the same user
  • author will always refer to the original Tweet author
• [twitter] update quote_id and quote_by metadata fields
  • quote_id is now non-zero for quoted Tweets and contains the Tweet ID of the quotng Tweet (was the other way round before)
  • quote_by is only defined for quoted Tweets like before, but now contains the screen name of the user quoting this Tweet
• [skeb] improve archive IDs for thumbnails and article images

Additions

• [artstation] add num and count metadata fields (#2764)
• [catbox] add album extractor (#2410)
• [blogger] emit metadata for posts without files (#2789)
• [foolfuuka] update supported domains
• [gelbooru] add support for api_key and user_id (#2767)
• [gelbooru] implement pagination for pool results (#2853)
• [instagram] add support for a user's saved collections (#2769)
• [instagram] provide date for directory format strings (#2830)
• [kemonoparty] add favorites option (#2826, #2831)
• [oauth] add host config option (#2806)
• [rule34] implement pagination for pool results (#2853)
• [skeb] add option to download article images (#1031)
• [tumblr] download higher-quality images (#2761)
• [tumblr] add count metadata field (#2804)
• [wallhaven] implement metadata option (#2803)
• [zerochan] add tag and image extractors (#1434)
• [zerochan] implement login with username & password (#1434)
• [postprocessor:metadata] implement mode: modify and mode: delete (#2640)
• [formatter] add g conversion for slugifying a string (#2410)
• [formatter] apply :J only to lists (#2833)
• implement path-metadata option (#2734)
• allow comments after input file URLs (#2808)
• add global warnings option to control urllib3 warning behavior (#2762)

Fixes

• [bunkr] fix extraction (#2788)
• [deviantart] use public access token for journals (#2702)
• [e621] fix extraction of popular posts
• [fanbox] download cover images in original size (#2784)
• [mastodon] allow downloading without access token (#2782)
• [hitomi] update cache expiry time (#2863)
• [hitomi] fix error when number of tag results is a multiple of 25 (#2870)
• [mangahere] fix page-reverse option (#2795)
• [poipiku] fix posts with more than one image (#2796)
• [poipiku] update filter for static images (#2796)
• [slideshare] fix metadata extraction
• [twitter] unescape + in search queries (#2226)
• [twitter] fall back to unfiltered search (#2766)
• [twitter] ignore invalid user entries (#2850)
• [vk] prevent exceptions for broken/invalid photos (#2774)
• [vsco] fix collection extraction
• [weibo] prevent exception for missing playback_list (#2792)
• [weibo] prevent errors when paginating over album entries (#2817)

v1.22.4

Additions

• [instagram] add pinned metadata field (#2752)
• [itaku] categorize sections by group (#1842)
• [khinsider] extract platform metadata
• [tumblr] support /blog/view URLs (#2760)
• [twitter] implement strategy option (#2712)
• [twitter] add count metadata field (#2741)
• [formatter] implement O format specifier (#2736)
• [postprocessor:mtime] add value option (#2739)
• add --no-postprocessors command-line option (#2725)
• implement format-separator option (#2737)

Changes

• [pinterest] handle section pins with separate extractors (#2684)
• [postprocessor:ugoira] enable mtime by default (#2714)

Fixes

• [bunkr] fix extraction (#2732)
• [hentaifoundry] fix metadata extraction
• [itaku] fix user caching (#1842)
• [itaku] fix date parsing
• [kemonoparty] ensure all files have an extension (#2740)
• [komikcast] update domain
• [mangakakalot] update domain
• [newgrounds] only attempt to login if necessary (#2715)
• [newgrounds] prevent exception on empty results (#2727)
• [nozomi] reduce memory consumption during searches (#2754)
• [pixiv] fix default background filenames
• [sankaku] rewrite file URLs to s.sankakucomplex.com (#2746)
• [slideshare] fix description extraction
• [twitter] ignore previously seen Tweets (#2712)
• [twitter] unescape HTML entities in content (#2757)
• [weibo] handle invalid or broken status objects
• [postprocessor:zip] ensure target directory exists (#2758)
• make brotli an optional dependency (#2716)
• limit path length for --write-pages output on Windows (#2733)

Removals

• [foolfuuka] remove archive.wakarimasen.moe

v1.22.3

Changes

• [twitter] revert strategy changes for user URLs (#2712, #2710)
• update default User-Agent headers

v1.22.2

Additions

• [cyberdrop] add fallback URLs (#2668)
• [horne] add support for horne.red (#2700)
• [itaku] add gallery and image extractors (#1842)
• [poipiku] add user and post extractors (#1602)
• [skeb] add following extractor (#2698)
• [twitter] implement expand option (#2665)
• [twitter] implement csrf option (#2676)
• [unsplash] add collection_title and collection_id metadata fields (#2670)
• [weibo] support tabtype=video listings (#2601)
• [formatter] implement slice operator as format specifier
• support cygwin/BSD/etc for --cookies-from-browser

Fixes

• [instagram] improve metadata generated by _parse_post_api() (#2695, #2660)
• [instagram} fix tag extractor (#2659)
• [instagram] automatically invalidate expired login sessions
• [twitter] fix pagination for conversion tweets
• [twitter] improve "replies": "self" (#2665)
• [twitter] improve strategy for user URLs (#2665)
• [vk] take URLs from *_src entries (#2535)
• [weibo] fix URLs generated by user extractor (#2601)
• [weibo] fix retweets (#2601)
• [downloader:ytdl] update _set_outtmpl() (#2692)
• [formatter] fix !j conversion for non-serializable types (#2624)
• [snap] Fix missing libslang dependency (#2655)