Changelog

1.31.5 - 2026-01-31

Extractors

Additions

• [discord] add server-search extractor

• [listal] add image & people extractors (#1589 #8921)

• [mangafreak] add support (#8928)

• [mangatown] add support (#8925)

• [xenforo] support titsintops.com (#8945)

• [xenforo] support forums.socialmediagirls.com (#8964)

Fixes

• [civitai:user-posts] fix pagination (#8955)

• [imhentai] detect galleries without image data (#8951)

• [kemono] fix possible AttributeError when processing revisions (#8929)

• [mangataro] fix manga extractor (#8930)

• [pornhub] fix 400 Bad Request when logged in (#8942)

• [tiktok] solve JS challenges (#8850)

• [tiktok] fix account extraction (#8931)

• [tiktok] extract more story item list pages (#8932)

• [tiktok] do not fail story extraction if a user has no stories (#8938)

• [weebdex] make metadata extraction non-fatal (#8939 #8954)

• [weibo] fix KeyError - 'pid' when processing subalbums (#8792)

• [xenforo] improve attachment extraction (#8947)

• [xenforo] fix cookies check before login (#8919)

Improvements

• [exhentai] implement Multi-Page Viewer support (#2616 #5268)

• [kemono] reduce revisions API requests when possible

• [tiktok] implement subtitles support (#8805)

• [tiktok] implement downloading all cover types (#8805)

• [tiktok] do not stop extraction if a post fails (#8962)

• [weebdex] add lang option (#8957)

• [weebdex] support query parameter filters

• [weibo] add subalbums include (#8792)

• [xenforo] improve error message extraction (#8919)

• [xenforo] decode /goto/link-confirmation links (#8964)

Post Processors

• [mtime] fix overwriting Last-Modified mtime when selecting invalid values (#8918)

Miscellaneous

• [docs/options] add Table of Contents

• [job] add output.jsonl option (#8953)

• [job] add extractor.*.parent option

• [job] enable all parent-… options for parent extractors by default

1.31.4 - 2026-01-24

Extractors

Additions

• [kaliscan] add support (#8917)

• [turbo] add support - rewrite saint extractors (#8893 #8896)

• [xenforo] support celebforum.to (#8902)

• [xenforo] add media-album extractor (#8902)

Fixes

• [mangafire] fix extractors - generate vrf tokens (#8400 #8906)

• [nitter] use gallery-dl/<version> User-Agent (#7045 #8130 #8409)

• [tiktok] fix following extractor (#8849)

• [xenforo] fix using cookies for custom instances (#8902)

Improvements

• [imagebam] raise NotFoundError for deleted images & galleries (#8890)

• [kemono:discord] improve filename parsing

• [kemono:discord] support server URLs with trailing /

• [tiktok] download best quality videos (#8846)

• [tiktok] prefer legacy endpoint for user post extraction (#8812 #8847)

• [twitter] implement "ratelimit": "abort:N" (#5251 #8864)

• [weebdex] add data-saver option (#8914)

• [xenforo] ignore links starting with #

Metadata

• [kemono:discord] extract archives metadata (#8898)

• [xenforo:media-album] extract album metadata (#8902)

Removals

• [batoto] remove module (#8834 #8908)

Miscellaneous

• [common] implement parent-session option

• [common] add googlebot User-Agent preset

• [docker] build from python:3.14-alpine

• [release] add more checks before committing a release

• [util] replace classes with functions for predicates, Popen, HTTPBasicAuth

1.31.3 - 2026-01-16

Extractors

Additions

• [booth] add category extractor (#8867)

• [thefap] add support (#8821 #8822)

• [xenforo] implement media support (#8785)

  • add media-item, media-user, media-category extractors

Fixes

• [ahottie:album] support multiple pages (#8862 #8886)

• [bellazon] use data-full-image URLs if available (#8833)

• [fanbox] make comments extraction non-fatal (#8814)

• [imagevenue] fix NotFoundError for valid image links (#8818)

• [xenforo] fix/improve bb*Wrapper extraction (#8868)

Improvements

• [bellazon] match thread URLs with escaped characters

• [bilibili] add support for Live Photo downloads (#8860)

• [booth:item] support URLs with language codes

• [chevereto] implement password support

• [chevereto:user] support album results

• [dankefuerslesen] support /reader/series URLs (#8811)

• [furaffinity:favorite] support URLs with custom start position

• [imagetwist:gallery] support multiple pages (#8826)

• [koofr] refactor (#8803)

• [pixeldrain:album] add zip option

• [pixeldrain] warn about hotlink-protected files (#8803)

• [pixeldrain] improve filename parsing

• [rule34xyz] support URLs with www subdomain (#8875)

• [saint] support turbovid.cr & turbo.cr URLs (#8851 #8888)

• [shopify] support URLs starting with language codes

• [webtoons] extend bgm option (#8733)

• [weibo:album] implement subalbum support (#8792)

• [wikimedia] use gallery-dl/<version> User-Agent (#8770 #8861)

Metadata

• [bellazon] unescape thread[slug] names

• [imagetwist:gallery] extract gallery_title & gallery_id metadata

• [motherless] fix gallery media metadata issues (#8873)

• [rule34xyz] recognize system & meta tag types

• [sexcom] fix tags when passing cookies (#8880)

• [tiktok] provide post_type metadata (#8815)

• [xenforo] extract author_slug metadata (#8785)

Downloaders

• [ytdl] implement _ytdl_manifest_remux

Miscellaneous

• [common] implement "user-agent": "+PRESET"

• [docs/README] add Discord link

• [formatter] overload . operator

• [job] fix extractor kwdict values being unavailable in filters

• [util] adjust Firefox/Chrome User-Agent versions

• [util] rename USERAGENT to USERAGENT_GALLERYDL (#8836)

1.31.2 - 2026-01-02

Extractors

Additions

• [ahottie] add aupport (#8710)

• [discord] add server-assets extractor (#8589)

• [imgpv] add image extractor (#8773)

• [manganelo] add bookmark extractor (#8776)

• [tiktok] add support for stories, liked posts, saved posts, reposts (#8035 #8466 #8715)

• [twitter] add notifications extractor (#7974)

• [whyp] add support (#8725)

• [yourlesbians] add album extractor (#8713)

Fixes

• [batoto] replace k-subdomain image URLs with n-subdomain (#8791)

• [civitai] update quality-videos default (#8787)

• [deviantart:stash] fix JSONDecodeEerror for folders (#8750)

• [exhentai] fix possible exception in finalize() (#8741)

• [instagram:stories] extract correct expires dates (#8764)

• [sankaku] fix re-authentication (#8779)

• [tapas] unescape HTML entities in image URLs (#8790)

• [tumblr:search] prevent KeyError when using offset pagination (#8720)

• [xenforo] fix incomplete video URLs (#8786)

Improvements

• [bunkr] detect new maintenance video file (#8802)

• [fansly] disable formats check by default (#8757)

• [instagram] detect homepage redirects (#8714)

• [instagram] don't warn on minor image size differences (#8300)

• [pixiv] support sketch include (#8789)

• [subscribestar] support filterting user posts by tag (#8737)

• [tiktok] remove yt-dlp dependency (#7246 #8466 #8730 #8715)

• [webtoons] download episode background music (#8733)

• [xenforo] support /#post-ID URLs

Metadata

• [pixiv] provide count metadata (#8794)

• [tiktok] combine …_id fields into a single file_id one (#8804)

• [webtoons] extract num_play & num_stop for background music (#8733 #8755)

Options

• [facebook] add loop option (#8696)

• [fansly] add previews option (#8686)

• [koofr] implement zip option (#6582 #8700)

• [tiktok] add order-posts option (#8730 #8715)

Downloaders

• [http] add MIME type and signature for .aac files

• [ytdl] fix overwriting mtime of downloaded files (#8767)

• [ytdl] expect all exception types when extracting info_dict (#8343)

Miscellaneous

• [actions] fix abort (#8753)

• [options] add --sleep-skip (#6582)

1.31.1 - 2025-12-20

Extractors

Additions

• [2chen] implement generic 2chen board extractors

  • support https://schan.help/ (#8680)

• [aryion] add watch extractor (#8705)

• [comedywildlifephoto] add gallery extractor (#8690)

• [koofr] add shared extractor (#8700)

• [picazor] add user extractor (#7083 #7504 #7795 #8717)

• [weebdex] add support (#8722)

• [xenforo] support allthefallen.moe/forum (#3249 #8268)

Fixes

• [aryion:favorite] fix extraction (#8705 #8723 #8728)

• [aryion] fix description metadata

• [boosty] include Authorization header with file downloads (#8704)

• [fanbox] make _extract_post() non-fatal (#8711)

• [furaffinity] fix tags metadata (#8724)

• [mastodon] fix AttributeError: 'parse_datetime_iso' (#8709)

• [tenor] fix title metadata

• [twitter] fix avatar & background downloads with "expand": true (#8698)

Improvements

• [boosty] warn about expired auth cookie tokens (#8704)

• [misskey] implement order-posts option (#8516)

• [reddit] use "videos": "dash" by default (#8657)

• [pixiv] warn about invalid PHPSESSID cookie (#8689)

Downloaders

• [ytdl] fix UnboundLocalError: 'tries' (#8707)

• [ytdl] respect --no-skip

Miscellaneous

• [path] implement dynamic length directories (#1350)

• [formatter] add I format specifier - identity

• [tests] add path tests

1.31.0 - 2025-12-12

Extractors

Additions

• [arena] add channel extractor (#5847 #8509)

• [aryion] add search extractor (#8567)

• [audiochan] add support (#8602)

• [cfake] add support (#707 #6021 #8549 #8687 #8430)

• [cyberfile] add shared extractor (#8323)

• [Danbooru] add media-asset extractor (#8580)

• [e621] add artist & artist-search extractors (#8448)

• [eporner] add support (#8581)

• [fikfap] add support (#8673)

• [fitnakedgirls] add support (#8671)

• [myhentaigallery] add tag extractor (#8537)

• [nudostarforum] add support (#8664)

• [okporn] add support (#8575)

• [pornpics] add category & listing extractors (#8662)

• [pornstarstube] add support (#8576)

• [sexcom] add feed extractor (#8519)

• [shimmie2] support soybooru.com (#8467)

• [sxypix] add support (#4507 #8391 #8574)

• [xenforo] implement generic XenForo forum extractors

Fixes

• [bellazon] fix errors when handling guest users (#8397)

• [belazon] fix starting from a specific page

• [cien] fix creator & recent extractors (#8524)

• [fanbox:redirect] disable cookie usage (#8565)

• [gofile] fix extraction (#8681 #8683)

• [imagebam] fix filename & extension for names without ext (#8476)

• [instagram] fix AttributeError: 'videos_dash' (#8561)

• [motherless] fix gallery_title extraction (#8605)

• [paheal] fix AttributeError

• [pixiv] fix KeyError: 'is_bookmarked' (#8398)

• [postimg] fix extraction (#8505)

• [rawkuma] update extractors to new site layout (#8568)

• [realbooru] fix tags for video posts (#8455)

• [reddit] fix KeyError: 'media_metadata' for embeds (#8551)

• [sankaku][idolcomplex] fix download URLs (#8666)

• [schalenetwork] fix tags categories (#8625)

• [silverpic] fix extraction & force .net TLD

• [simpcity] fix content for first post of a thread

• [simpcity] fix starting from a specific page (#8599)

• [twitter] fix KeyError for temporarily unavailable users (#8423)

• [twitter] fix KeyError - 'source_id' with disabled transform (#8429)

• [twitter] fix AttributeError for search-pagination": "max_id" (#8613)

• [twitter] update & fix pinned Tweet extraction (#8500)

• [vsco] use "browser": "firefox" by default (#8127)

• [webtoons] fix thumbnail extraction (#8413)

• [xasiat] fix IndexError for albums without category (#8569)

Improvements

• [2ch] support .org TLD (#8629)

• [bunkr] detect when an album is deleted mid-download (#8619)

• [cyberdrop] update domain to cyberdrop.cr (#8496)

• [cyberfile:folder] support subfolders (#8323)

• [deviantart:gallery] match URLs with query parameters (#8514)

• [discord] limit length of default filenames (#6582)

• [erome] improve error message for deleted & copyrighted albums (#8665)

• [fansly] handle posts without accountId/contentId/attachments (#8572)

• [flickr] extract public API key from website (#7564 #7649 #7700 #8553)

• [imagehost] improve filename & extension handling

• [imagetwist] detect deleted images (#8415)

• [imagevenue] improve error for deleted images (#8477)

• [imgbox] match direct links (#8474)

• [imhentai:search] support /advanced-search/ URLs (#8507)

• [instagram] improve error for non-existent profiles (#8550)

• [jpgfish] update domain to jpg7.cr (#8530)

• [newgrounds] set error status when encountering inaccessible posts (#8654)

• [realbooru] extract video fallbacks (#8661)

• [reddit] use REST API by default (#8559)

• [reddit] support comment share link (#8434)

• [rule34us:tag] support URLs with empty q query parameter (#8546)

• [pixhost] force .to TLD (#8428)

• [postimg] force postimg.cc domain (#8505)

• [sankaku][idolcomplex] support URLs with locale code (#8667)

• [simpcity] implement login with username & password (#8418)

• [simpcity] extract attachment/inline files (#8560)

• [simpcity] extract click to load media URLs (#8609)

• [tiktok] ignore empty music entries (#8571)

• [twitter] restore better user NotFoundError messages (#8621)

• [twitter] implement workarounds for empty core data (#8613)

• [wikimedia] add format=original to fandom/wikigg file URLs (#5512)

• [wikimedia] implement config lookups for fandom/wikigg sites (#7283)

Metadata

• [bellazon] add num_internal & num_external metadata fields (#8415)

• [bellazon] remove query parameters from attachment IDs (#8544)

• [bunkr] extract album_… metadata for /f/ URLs (#8405)

• [chevereto] extract album_id & album_slug metadata (#8604)

• [chevereto:album] extract count & num metadata (#8604)

• [civitai] implement extracting tags metadata (#8626)

• [fanbox] return metadata of inaccessible posts (#8643)

• [hentaifoundry] extract categories metadata (#8656)

• [imagehosts] provide post_url metadata (#6582)

• [instagram] extract subscription metadata for story/highlight items (#8459)

• [instagram] extract correct width & height for videos (#8399)

• [kemono] improve filename

• [patreon] include full metadata with each URL (#4286 #8498)

• [pixhost] extract directory metadata (#6582)

• [subscribestar] improve filename (#8416)

• [wikimedia] provide lang metadata (#7283)

Options

• [bluesky] add api-server option (#8668)

• [civitai] add sort & period options (#8426)

• [fanbox:creator] add offset option (#6582)

• [itaku] add order option

• [mangadex] add data-saver option (#8573)

• [misskey] add date-min & date-max options (#8516)

• [misskey] add text-posts option (#8516)

• [patreon] add order-posts option (#7856 #8482)

• [schalenetwork][hdoujin] re-implement cbz option (#8431)

• [tiktok] add covers option (#8515)

• [twitter] add general limit option (#8173)

• [twitter] implement retries-api option (#8317)

• [twitter] implement search-results option (#8613)

• [twitter] implement using fallback values for search-limit (#8173)

• [weibo] add text option (#8422)

Removals

• [redbust] remove module (#6582)

Common

• allow general ISO 8601 values for date-min & date-max

• use parent value as parent-metadata default (#8525 #8604)

Downloaders

• [http] fail downloads of empty files (#8661)

• [http] implement _http_segmented (#8602)

• [ytdl] implement retry functionality (#1131 #8269)

• [ytdl] improve error detection

• [ytdl] improve error message when importing default ytdl modules

• [ytdl] update _extract_manifest()

• [ytdl] forward _ytdl_manifest_headers to formats

• [ytdl] restructure code

Post Processors

• [metadata] add newline option (#8439)

• [exec] add verbose option (#7743)

Formatter

• add Lb format specifier - L for bytes

• add Xb format specifier - X for bytes (#6582)

Job

• add keywords-global option (#6582)

• implement post-filter & post-range options

• implement "archive-event": "after" (#8373)

• use identity checks

• inline dispatch loop

Path

• implement conditional part-directory (#8329)

• treat broken symlinks as existing files (#8490)

• improve exists() performance

Miscellaneous

• [cookies] fix cookie count logging message order (#8414)

• [dt] move datetime utils into separate dt module

• [output] add defer option for logging files (#8523)

• [output] add Logger.traceback() helper

• [scripts/init] fix error when running with default values (#8583)

• [util] support integer values for …-range options (#8604)

• [workflows:tests] include Python 3.14 & pypy3.11

1.30.10 - 2025-10-12

Extractors

Additions

• [bluesky] add bookmark extractor (#8370)

• [dandadan] add support (#8381)

Fixes

• [bellazon] fix video URL extraction (#8392)

• [bluesky] handle exceptions during file extraction

• [civitai] prevent downloading random posts from deleted users (#8299)

• [girlsreleased] update API endpoints (#8360)

• [instagram] restore video_dash_manifest downloads (#8364)

• [kemono] prevent fatal exceptions when retrieving user profile data (#8382)

• [mangadex] fix RuntimeError for titles without a description (#8389)

• [naver-blog] fix video extraction (#8385)

• [poipiku] fix original file downloads (#8356)

• [weibo] fix retrieving followers-only content (#6447 #7939 #8063 #8354 #8357)

• [weibo] use page parameter for feed results (#7523 #8128 #8357)

• [wikimedia] fix name & extension of files without an extension (#8344)

• [wikimedia] ignore missing files (#8388)

Improvements

• [bellazon] ignore links to other threads (#8392)

• [common] disable delay for request_location()

• [fansly] update format selection (#4401)

• [fansly] download user posts from all account walls (#4401)

• [instagram] support /share/SHORTCODE URLs (#8340)

• [weibo] ignore ongoing live streams (#8339)

• [zerochan] forward URL parameters to API requests (#8377)

Metadata

• [instagram] extract subscription metadata (#8349)

• [webtoons] fix episode metadata extraction (#2591)

Removals

• [twitter] remove login support (#4202 #6029 #6040 #8362)

Post Processors

• [exec] support {_temppath} replacement fields (#8329)

Miscellaneous

• [formatter] improve error messages (#8369)

• [path] implement conditional base-directory

• use utf-8 encoding when opening files in text mode (#8376)

1.30.9 - 2025-10-03

Extractors

Additions

• [mangafire] add support (#7064 #7701)

• [mangareader] add support (#6529 #6868)

• [patreon] add collection extractor (#8286)

• [s3ndpics] add support (#8322)

Fixes

• [chevereto] fix id for links without file name (#8307)

• [chevereto:album] fix video downloads (#8149 #8295)

• [hdoujin] fix KeyError: 13 by adding reclass tag type (#8290)

• [misskey] include withRenotes parameter in API requests (#8285)

• [nozomi] percent-encode search tags (#8328)

• [simpcity] fix KeyError: 'url' when thread author is deleted (#8323)

• [twitter] fix quote_id of individual Tweets (#8284)

• [zerochan] prevent HttpError: '503 Service Temporarily Unavailable' (#8288)

Improvements

• [chevereto] support URLs with www subdomain (#8149)

• [imxto:gallery] support multiple pages (#8282)

• [instagram] add warn-images & warn-videos options (#8283)

• [instagram] use reel subcategory for /reel/SHORTCODE URLs (#8274)

• [instagram] support /reels/SHORTCODE URLs (#8318)

• [paheal] normalize No results output message (#8313)

• [pixiv] implement searching past 5000 results (#1686 #7082 #8298)

• [thehentaiworld] support more post URL formats (#8277)

• [weibo] download .m3u8 manifests with ytdl (#8339)

• [weibo] resolve wblive-out.api.weibo.com URLs (#8339)

• [weibo] use replay_hd URLs as video fallback (#8339)

• [wikimedia] add ability to download image revisions (#7283 #8330)

• [zerochan] normalize No results output message (#8313)

Metadata

• [hdoujin] extract source metadata (#8280)

• [instagram] provide type metadata (#8274)

• [mangadex] extract more manga-related metadata (#8325)

Removals

• [chevereto] remove img.kiwi

Downloaders

• [http] add MIME type and signature for m3u8 & mpd files (#8339)

Post Processors

• [python] restore archive functionality

Miscellaneous

• [cookies] add support for Orion browser (#8303)

• [docker] include more optional Python dependencies (#8026)

• [docs] update configuration.rst formatting

1.30.8 - 2025-09-23

Extractors

Additions

• [chevereto] support imglike.com (#5179)

• [chevereto] add category extractor (#5179)

• [Danbooru] add random extractor (#8270)

• [hdoujin] add support (#6810)

• [imgpile] add support (#5044)

• [mangadex] add covers extractor (#4994)

• [mangataro] add support (#8237)

• [thehentaiworld] add support (#274 #8237)

Fixes

• [4archive] fix TypeError (#8217)

• [bellazon] fix video attachments (#8239)

• [bunkr] fix JSONDecodeError for files with URL slugs containing apostrophes ' (#8150)

• [instagram] ensure manifest data exists before attempting a DASH download (#8267)

• [schalenetwork] fix extraction (#6948 #7391 #7728)

• [twitter] fix quoted Tweets being marked as deleted (#8225)

Improvements

• [2ch] update domain to 2ch.su, support 2ch.life URLs (#8216)

• [bellazon][simpcity][vipergirls] process threads in descending order (#8248)

• [bellazon] extract inline images (##8247)

• [bellazon] support video embeds (#8239)

• [bellazon] support #comment-12345 post links (#8239)

• [lensdump] support new direct file URL pattern (#8251)

• [simpcity] extract URLs of <iframe> embeds (#8214 #8256)

• [simpcity] improve post content extraction (#8214)

Metadata

• [facebook] extract biography metadata (#8233)

• [instagram:tagged] provide full tagged_… metadata when using id:… URLs (#8263)

• [iwara] extract more metadata (#6582)

• [iwara] make type available for directories (#8245)

• [reddit] provide comment metadata for all media files (#8228)

Options

• [bellazon] add quoted option (#8247)

• [bellazon] implement order-posts option (#8248)

• [kemono:discord] implement order-posts option (#8241)

• [simpcity] implement order-posts option (#8248)

• [vipergirls] implement order-posts option (#8248)

Downloaders

• [ytdl] fix errors caused by deprecated options removal

Post Processors

• [metadata] add "mode": "print" (#2691)

• [python] add "mode": "eval"

• close archive database connections (#8243)

Miscellaneous

• [util] define __enter__ & __exit__ methods for NullResponse objects (#8227)

• [util] extend list of ISO 639 language codes

1.30.7 - 2025-09-14

Extractors

Additions

• [bellazon] add support (#7480)

• [cyberfile] add support (#5015)

• [fansly] add creator-media extractor (#4401)

• [simpcity] add support (#3127 #5145 #5879 #8187)

Fixes

• [aibooru] fix download URLs (#8212)

• [ao3] fix pagination (#8206)

• [boosty] fix extracting accessToken from cookies (#8203)

• [comick] update buildId on 404 errors (#8157)

• [facebook] fix /photo/?fbid=…&set=… URLs being handled as a set (#8181)

• [fansly] fix & improve format selection (#4401)

• [fansly] fix posts with more than 5 files (#4401)

• [imgbb] fix & update (#7936)

• [tiktok] fix KeyError: 'author' (#8189)

Improvements

• [comick] handle redirects

• [fansly] provide fallback URL for manifest downloads (#4401)

• [fansly:creator] support custom wall IDs (#4401)

• [tungsten:user] support filtering results by tag (#8061)

• [twitter] continue searches on empty response (#8173)

• [twitter] implement various search-… options (#8173)

Miscellaneous

• [formatter] exclude <>\ characters from !R results (#8180)

• [formatter] support negative indicies

• [util] emit debug Proxy Map logging message (#8195)

1.30.6 - 2025-09-06

Extractors

Additions

• [chevereto] add video extractor (#8149)

• [comick] add covers extractor

• [fansly] add support (#4401)

• [instagram] add stories-tray extractor (#6582)

• [shimmie2] support co.llection.pics (#8166)

• [tungsten] add support (#8061)

• [vk] add wall-post extractor (#474 #6378 #8159)

Fixes

• [bunkr] fix downloading albums with more than 100 files (#8150 #8155 #8175)

• [chevereto:user] fix names starting with an a (#8149)

• [common] prevent exception when using empty user-agent (#8116)

• [deviantart:search] fix extraction (#8083)

• [hentaifoundry:story] fix src & description extraction (#8163)

• [imagebam] update guard page bypass cookies (#8123)

• [kemono] fix .bin archive files not being added to archives list (#8156)

• [reddit] fix TypeaError when processing comments (#8139)

• [tumblr] fix pagination when using date-max

• [twitter] prevent exceptions in _transform_community() (#8134)

• [twitter] prevent KeyError: 'name' in _transform_user() (#8154)

• [twitter] fix KeyError: 'core' when processing communities (#8141)

• [zerochan] fix 500 Internal Server Error during login (#8097 #8114)

Improvements

• [comick] detect broken chapters (#8054)

• [erome] handle reposts on user profiles (#6582)

• [instagram] improve video quality warning regex (#8078)

• [jpgfish] update domain to jpg6.su

• [reddit] add api & limit options (#7997 #8012 #8092)

• [reddit] support video embeds (#8139)

• [tumblr:tagged] support /archive/tagged/ URLs (#8160)

Metadata

• [khinsider] extract description metadata

• [tumblr:tagged] provide search_tags metadata (#8160)

• [vk] parse date & description metadata (#8029)

• [vk:album] extract more metadata (#8029)

Downloaders

• [ytdl] implement _ytdl_manifest_cookies

Miscellaneous

• [formatter] add R conversion - extract URLs (#8125)

• [options] add -a as short option for --user-agent

• [scripts/init] implement -s/--subcategory

1.30.5 - 2025-08-24

Extractors

Additions

• [shimmie2] support noz.rip/booru (#8101)

• [sizebooru] add support (#7667)

• [twitter] add highlights extractor (#7826)

• [twitter] add home extractor (#7974)

Fixes

• [aryion] fix pagination (#8091)

• [rule34] support using api-key & user-id (#8077 #8088 #8098)

• [tumblr:search] fix ValueError: not enough values to unpack (#8079)

• [twitter] handle KeyError: 'result' for retweets (#8072)

• [zerochan] expect 500 Internal Server Error responses for HTML requests (#8097)

Improvements

• [civitai:search] add token option (#8093)

• [instagram] warn about lower quality video downloads (#7921 #8078)

• [instagram] remove candidates warning (#7921 #7989 #8071)

• [oauth] improve error messages (#8086)

• [pixiv] distinguish empty from deleted profiles (#8066)

• [twitter] update API endpoint query hashes & parameters

Metadata

• [batoto] extract more metadata (#7994)

• [instagram:highlights] extract author & owner & user metadata (#7846)

• [newgrounds] extract slug metadata (#8064)

• [twitter] extract community metadata (#7424)

Removals

• [shimmie2] remove sizechangebooru.com (#7667)

• [zzup] remove module (#4604)

Downloaders

• [ytdl] improve playlist handling (#8085)

Scripts

• implement rm helper script

• add -g/--git command-line options

• [util] add git() & lines() helper functions

Miscellaneous

• [config] add conf argument to config.load() (#8084)

1.30.4 - 2025-08-16

Extractors

Additions

• [civitai] add 'videos' extractor (#6644)

Fixes

• [civitai] fix posts not returning video files (#8053)

• [civitai] fix '403 Forbidden' errors for searches

• [kemono] use 'Accept: text/css' for API requests (#8047 #8057)

Improvements

• [newgrounds] add fallback for images with empty 'full_image_text' 'src'

Miscellaneous

• fix accessing methods through 'path-metadata' proxy (#6582)

1.30.3 - 2025-08-15

Extractors

Additions

• [booth] add support (#7920)

• [civitai] add collection & user-collections extractors (#8005)

• [facebook] add info extractor (#6582)

• [facebook] add albums extractor (#7848)

• [imgdrive] add image extractor (#7976)

• [imgtaxi] add image extractor (#8019)

• [imgwallet] add image extractor (#8021)

• [picstate] add image extractor (#7946)

• [silverpic] add image extractor (#8020)

• [tumblr] add following & followers extractors (#8018)

• [xasiat] add support (#4161 #5929 #7934)

Fixes

• [blogger] fix video extraction (#7892)

• [comick] handle chapters without chapter data (#7972)

• [comick] handle volume-only chapters (#8043)

• [comick] fix exception when filtering by translation group (#8045)

• [deviantart:tiptap] fix KeyError: 'attrs' (#7929)

• [everia] fix image extraction (#7973 #7977)

• [facebook] fix avatar extraction for empty profiles (#7962)

• [facebook] handle profiles without photos or set_id (#7962)

• [fappic] rewrite thumbnail URLs (#8013)

• [idolcomplex] update to new domain and interface (#7559 #8009)

• [kemono][coomer] fix extraction (#8028 #8031)

• [kemono] update /creators endpoint (#8039 #8040)

• [kemono] don't set error status for posts without comments (#7961)

• [pixiv] fix IndexError for unviewable works (#7940)

• [pixiv] fix artworks downloads when using expired cookies (#7987)

• [scrolller] fix NSFW subreddit pagination (#7945)

• [twitter] fix potential UnboundLocalError when videos are disabled (#7932)

• [vsco] disable TLS 1.2 cipher suites by default (#7984 #7986)

• [wikimedia:wiki] fix AttributeError: 'subcategories' (#7931)

Improvements

• [aibooru] support general.aibooru.online & aibooru.download

• [comick] add lang option (#7938)

• [hentaifoundry] add descriptions option (#7952)

• [facebook] raise AuthRequired for profiles requiring cookies (#7962)

• [instagram] warn about lower quality image downloads (#7921)

• [kemono] support "endpoint": "posts+" for full metadata (#8028)

• [misskey] support misskey.art (#7923)

• [motherless] detect 404/File not found pages

• [pixiv] detect suspended/deleted accounts (#7990)

• [pixiv] improve API error messages

• [pixiv] remove redundant cookies initialization code

• [scrolller] limit title length in default filenames

• [skeb] implement include option (#6558 #7267)

• [vk] update default archive_fmt (#8030)

Metadata

• [cien] provide author[id] metadata (#6582)

• [dankefuerslesen] extract more metadata (#7915)

• [dankefuerslesen:manga] fix metadata being overwritten

• [facebook] ensure numeric user_id values (#7953)

• [facebook:set] fix/improve user_id extraction (#7848)

• [fappic] fix filename values

Common

• [common] implement "user-agent": "@BROWSER" (#7947)

• [common] improve error message for non-Netscape cookie files (#8014)

Downloaders

• [ytdl] don't overwrite existing filename data (#7964)

Miscellaneous

• [docs/configuration] improve client-id & api-key instructions

• [docs/formatting] update and improve

• [job] apply extension-map to SimulationJob results (#7954)

• [job] improve URL scheme extraction performance

• [job] split collected DataJob results

• [path] implement path-convert option (#493 #6582)

• [scripts] improve and extend init, generate_test_result, and pyprint

• extend -A/--abort & "skip": "abort" functionality (#7891)

• use more f-strings (#7671)

1.30.2 - 2025-07-27

Extractors

Additions

• [itaku] add posts & bookmarks extractors (#7707)

Fixes

• [kemono] support new kemono.cr domain (#7902 #7909 #7911 #7913 #7904)

• [coomer] support new coomer.st domain (#7907 #7909 #7911 #7904)

Post Processors

• [exec] use False as start_new_session default to avoid a TypeError (#7899)

Miscellaneous

• [tests/postprocessor] fix TypeError when logging an error (#6582)

1.30.1 - 2025-07-26

Extractors

Additions

• [civitai] add generated extractor (#7796)

• [facebook] add avatar extractor (#7848)

• [imgadult] add image extractor (#7893)

• [itaku] add following & followers extractors (#7707)

• [leakgallery] add support (#7872)

• [madokami] add manga extractor (#7828)

Changes

• [civitai] change default user includes to ["user-images", "user-videos"] (#7874)

Fixes

• [behance] fix 403 Forbidden errors by using "browser": "firefox" (#7803 #7877)

• [civitai] fix AttributeError when a file's post was deleted (#7860)

• [pornhub] fix gallery extractor (#7842)

• [readcomiconline] force One page reading mode (#7890)

• [sexcom] update search extractor (#7807)

• [urlgalleries] fix extraction (#7858)

• [wikimedia] add missing self argument when calling prepare() (#7835)

Improvements

• [4chan] detect files containing only null bytes (#7883)

• [azurelanewiki] prevent Anubis challenge

• [bilibili] warn about blocked articles (#7880)

• [civitai] fix extension for videos without name and mimeType

• [common] detect Cloudflare & DDoS-Guard challenge pages in request_json() & request_xml() (#7833)

• [facebook] add retries to profile page requests (#7725 #7834 #7852)

• [facebook] implement include option (#7848)

• [itaku] implement include option (#7707)

• [patreon] implement cursor support (#7856)

• [patreon] support date-max for /home URLs (#7856)

• [pixiv] improve AJAX error messages (#7896)

Metadata

• [behance] provide creator[name] metadata (#7885)

• [civitai] ensure file & post data has a date value (#7548)

• [inkbunny] enable pool metadata (#7850)

• [nhentai] provide gallery_id for pagination results (#7868)

Downloaders

• [ytdl] add deprecations option

Post Processors

• [exec] add session option (#6582)

Snap

• migrate base to core22 (#7841)

• switch to yt-dlp (#7865)

• fix deprecated CRAFT_ARCH_TRIPLET usage (#7866)

Formatter

• add Jinja template support (#1390)

• add W conversion - sanitize whitespace (#6582)

Miscellaneous

• [actions] fix parse_logging import (#7837)

• [options] add --sleep-429 command-line option (#7871)

• [scripts] ensure files use utf-8 encoding and \n newlines (#7872)

• [tests/extractor] improve example URL mismatch error message (#7872)

• [tests/results] fix #log checks for URLs raising exceptions

• fix exit status for requests' JSONDecodeError (#4380)

• use walrus operators := in if statements (#7671)

1.30.0 - 2025-07-15

Changes

• raise minimum supported Python version to 3.8 (#7671)

• update extractor names (#7746 #7612)

  • Old	New
    kemonoparty	kemono
    coomerparty	coomer
    koharu	schalenetwork
    naver	naver-blog
    chzzk	naver-chzzk
    naverwebtoon	naver-webtoon
    pixiv:novel	pixiv-novel:novel
    pixiv:novel-user	pixiv-novel:user
    pixiv:novel-series	pixiv-novel:series
    pixiv:novel-bookmark	pixiv-novel:bookmark

  • config settings will automatically use the old values

  • target directories using {category} will use the new category names by default

  • use --compat or "category-map": "compat" to restore old category names

• include exit status bitmasks of NotFoundError (8) and NoExtractorError (64) into general HttpError (4) and InputError (32) respectively

Extractors

Additions

• [civitai] add search-images and posts extractors (#7609)

• [comick] add support (#1825 #6782)

• [dankefuerslesen] add support (#7669)

• [dynastyscans] add anthology extractor (#7627)

• [girlsreleased] add support (#6200)

• [girlswithmuscle] add support (#4493 #6016)

• [iwara] add support (#2652 #5840 #7785)

• [kemono] add artists extractor (#7582)

• [misskey] add avatar, background, and info extractors (#5347)

• [motherless] add group extractor (#7774 #7787)

• [naver-chzzk] add comment and community extractors (#7735 #7741)

• [nudostar] add support (#5735 #6556)

• [rawkuma] add support (#4571)

• [redbust] add support (#6759 #6918 #7043)

Fixes

• [4archive] fix thread extractor

• [arcalive] fix download URLs (#7678)

• [arcalive] replace ac-p.namu subdomains with ac-o.namu (#7556)

• [archivedmoe] fix redirection issue (#7652 #7653 #7664)

• [aryion] fix favorite extractor (#7775)

• [batoto] fix downloading manga with alerts/notices (#7657)

• [behance] fix 403 Forbidden errors (#7710)

• [bunkr] fix file downloads (#7747)

• [civitai] fix & update search extractor (#7609)

• [danbooru] fix Ugoira conversions for posts without ZIP:ZipFileName (#7630)

• [deviantart:tag] fix username (#7587)

• [deviantart:tiptap] fix TypeError when textAlign is null (#7639)

• [directlink] fix config lookups by subcategory (#6582)

• [discord] support forwarded messages & handle missing threads (#7706 #7722)

• [furaffinity] fix submissions results (#7759)

• [hitomi] fix negative tag searches (#7694)

• [kemono] fix tagged creator posts

• [mangadex:list] fix config lookups for list-feed subcategory

• [nijie] fix file extraction (#7624)

• [paheal] fix 404 Not Found error for tags with URL encoded characters (#7642)

• [patreon] send Referer header when downloading .m3u8 videos (#7571)

• [patreon] fix campaign_id extraction from Next.js 13 creator pages (#7773)

• [readcomiconline] fix extraction (#7606 #7789)

• [reddit] fix archive IDs of fallback files (#7760)

• [rule34] fix file downloads (#7697)

• [sankaku] fix extracting extended tag categories (#7744)

• [sexcom] prevent .css file downloads (#7632)

• [skeb] fix KeyError - 'frame_rate' (#7798)

• [tiktok] handle exceptions when extracting avatars (#7682)

• [vsco] fix JSON returned by VSCO (#7821)

• [warosu] HTML attribute fix (#7676 #7677 #7777)

Improvements

• [artstation] support downloading .mview files (#7812)

• [civitai] support "My Reactions" results for videos (#7608)

• [e621] support e621.cc/posts URLs (#6809)

• [erome] restructure extractor hierarchy (#7804)

• [everia] prevent redirect when fetching post pages

• [exhentai] ensure file signature bytes aren`t all zero (#4902)

• [exhentai] implement "source": "metadata" (#4902)

• [fanbox] return fileMap files in order (#2718)

• [gelbooru] improve error message for 401 Unauthorized responses (#7674)

• [imagevenue] detect 404 image files (#7570)

• [instagram] provide more descriptive URLs for video_dash_manifest videos (#7631)

• [pinterest] support pin.it redirects to board (#7805)

• [pinterest] match board URLs with query strings (#7805)

• [rule34us] prioritize video.rule34.us for video downloads (#6582)

• [rule34xyz] implement login with username & password (#7736)

• [sankaku] allow passing cookies (#7333)

• [sexcom] support /pics/ URLs (#7611)

• [tiktok] detect login page redirects (#7716)

• [vk] detect challenge page redirects (#7650)

• [vk] prevent 404 Not Found errors for file downloads

• [vk] add continuation message (#7650)

• [warosu] detect missing images by checking hostname (#7698 #7699)

• [ytdl] set domain as subcategory when using Generic extractor (#6582)

Metadata

• [civitai] always provide file[…] metadata (#7548)

• [everia] improve filename by unquoting URLs (#7620)

• [fanbox] extract archives metadata (#7454)

• [gelbooru_v02] extract total/search_count metadata (#7689)

• [instagram] provide post_url for stories and highlights (#7810)

• [kemono:discord] update server & channel metadata (#7569)

• [mangaread] fix manga_alt metadata

• [newgrounds] filter <script> content in tags (#7604)

• [patreon] return metadata for paywalled posts (#6582)

• [pinterest] remove excess whitespace from description fields (#4335)

• [pixiv] remove /jump.php from caption links (#4327)

• [tenor] extract more metadata

• [twitter] extract source_id and source_user metadata (#7470 #7640)

• [twitter] extract sensitive_flags metadata (#2523)

• [vk] fix user metadata extraction

Options

• [civitai] add option to retrieve post metadata (#7548)

• [exhentai] add limits-action option (#6504)

• [fanbox] add fee-max option (#7726)

• [kemono] extend duplicates option (#7696)

• [mangadex] allow ratings to be a (comma-separated) string (#7799)

• [misskey] add include option (#5347)

• [sankaku] remove id-format option (#5073 #6808)

• [webtoons] add banners and thumbnails options (#6468 #7441)

Common

• update browser User-Agents and headers

• allow using predefined Firefox/Chrome headers & ciphers

• allow overriding user-agent when browser is used (#7647)

• support using system certificates via truststore (#6582)

• fix URLs not getting written to -e/--error-file (#7758)

• raise ChallengeError for Cloudflare & DDoS-Guard challenge pages (#1945)

• prevent exceptions for for non-fatal requests (#7598)

• simplify user extractors by using Dispatch mixin

• allow GalleryExtractor instances to return additional asset files

Removals

• [mangasee] remove module

Downloaders

• support dynamic download rate limits (#7638)

• [http] fail downloads with HTML content (#4798 #7697)

• [http] add MIME type and signature check for .html files

• [http] fix potential FileExistsError when .part file moved (#5385)

• [http] implement _http_signature checks (#4902)

• [ytdl] fix KeyError - 'filepath' when using legacy youtube_dl (#6949 #7752 #7824)

• [ytdl] fix postprocessing/merge errors (#7581)

• [ytdl] detect yt-dlp independent of module name (#7599)

• [ytdl] support custom headers when fetching HLS/DASH manifests

Post Processors

• implement shortcuts for mode and event options (e.g. metadata/jsonl@post)

• [exec] implement commands option

Options

• add category-map and config-map (#7612)

• add signals-actions (#1861 #6582)

• add --compat command-line option

• add --Print command-line option

• swap --print and --Print semantics

Cookies

• add native support for LibreWolf profiles (#4101 #7625)

• improve cookie-related logging messages

• update expired cookie messages (#7644)

Formatter

• add D conversion - ISO 8601 string to datetime

• add L conversion - ISO 639-1 code to language name

• change old L/length conversion to n

• implement M format specifier

Optimizations

• replace %-formatted and .format(…) strings with f-strings (#7671)

• improve regular expression usage

• replace match.group(N) with match[N] (#7671)

• update match.lastindex usage

• remove pre-3.8 workarounds (#7671)

• remove @staticmethod decorators

• add request_json() and request_xml() functions

• slightly improve performance of extract functions

• slightly improve filter performance

Miscellaneous

• [actions] add flag and raise actions

• [job] refactor parent-child config path building (#7527)

• [job:data] wrap exceptions in a dict (#7723)

• [path] support character sequences in path-restrict replacements (#1707)

• [pyinstaller] exclude pkg_resources module (#7592)

• [scripts/init] add scripts to generate initial extractor code and test results

• [scripts/options] make output width independent of terminal size

• fix Last-Modified mtime overwriting post processor mtime (#7529)

• use pip for make install (#7628)

1.29.7 - 2025-05-23

Extractors

Additions

• [mangadex] add following extractor (#7487)

• [pixeldrain] add support for filesystem URLs (#7473)

Fixes

• [bluesky] handle posts without record data (#7499)

• [civitai] fix & improve video downloads (#7502)

• [civitai] fix exception for images without modelVersionId (#7432)

• [civitai] make metadata extraction non-fatal (#7562)

• [fanbox] use "browser": "firefox" by default (#7490)

• [idolcomplex] fix pagination logic (#7549)

• [idolcomplex] fix 429 error during login by adding a 10s delay

• [instagram:stories] fix post_date metadata (#7521)

• [motherless] fix video gallery downloads (#7530)

• [pinterest] handle story_pin_product_sticker_block blocks (#7563)

• [subscribestar] fix content and title metadata (#7486 #7526)

Improvements

• [arcalive] allow overriding default User-Agent header (#7556)

• [fanbox] update API headers (#7490)

• [flickr] add info option (#4720 #6817)

• [flickr] add profile option

• [instagram:stories] add split option (#7521)

• [mangadex] implement login with client credentials

• [mangadex] send Authorization header only when necessary

• [mastodon] support Akkoma/Pleroma /notice/:ID URLs (#7496)

• [mastodon] support Akkoma/Pleroma /objects/:UUID URLs (#7497)

• [pixiv] Implement sanity handling for ugoira works (#4327 #6297 #7285 #7434)

• [twitter:ctid] reduce chance of generating the same ID

Metadata

• [civitai] provide proper extension for model files (#7432)

• [flickr] provide license_name metadata

• [sankaku] support new tags categories (#7333 #7553)

• [vipergirls] provide num and count metadata (#7479)

• [vipergirls] extract more metadata & rename fields (#7479)

Downloaders

• [http] fix setting mtime per file (#7529)

• [ytdl] improve temp/part file handling (#6949 #7494)

Cookies

• support Zen browser (#7233 #7546)

1.29.6 - 2025-05-04

Extractors

Additions

• [manganelo] support nelomanga.net and mirror domains (#7423)

Fixes

• [deviantart] unescape \' in JSON data (#6653)

• [kemonoparty] revert to using default creator posts endpoint (#7438 #7450 #7462)

• [pixiv:novel] fix embeds extraction by using AJAX API (#7422 #7435)

• [scrolller] fix exception for albums with missing media (#7428)

• [twitter] fix 404 Not Found () errors (#7382 #7386 #7426 #7430 #7431 #7445 #7459)

Improvements

• [kemonoparty] add endpoint option (#7438 #7450 #7462)

• [tumblr] improve error message for dashboard-only blogs (#7455)

• [weasyl] support /view/ URLs (#7469)

Metadata

• [chevereto] extract date metadata (#7437)

• [civitai] implement retrieving model and version metadata (#7432)

• [manganelo] extract more metadata