Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[TWITTER] past broadcasts are not downloading #2985

Closed
AdamSaketume26 opened this issue Sep 29, 2022 · 11 comments
Closed

[TWITTER] past broadcasts are not downloading #2985

AdamSaketume26 opened this issue Sep 29, 2022 · 11 comments

Comments

@AdamSaketume26
Copy link

gallery-dl -o extractor.twitter.cards="true" https://twitter.com/i/broadcasts/1YqGoANwQpNxv
[gallery-dl][error] No suitable extractor found for 'https://twitter.com/i/broadcasts/1YqGoANwQpNxv'

i tried searching for issues and i saw 2875 #937 but those urls dont have /i/broadcast. they say enable twitter cards but i did and still doesnt work for me

version 1.23

@mikf
Copy link
Owner

mikf commented Sep 30, 2022

Just download it with yt-dlp/youtube-dl. Links that can only be downloaded via HLS or DASH would need ytdl support with gallery-dl anyway, so you might as well use it directly.

Or you invoke ytdl with gallery-dl: gallery-dl ytdl:https://twitter.com/i/broadcasts/1YqGoANwQpNxv

@mikf mikf closed this as not planned Won't fix, can't repro, duplicate, stale Sep 30, 2022
@AdamSaketume26
Copy link
Author

but these are past broadcasts so archived videos of the broadcast. gallery-dl still cant download them?

if its still not appropriate could you make an option so if it encounters broadcasts it invokes ytdl automatically? because i dont think ytdl supports scraping all tweets for broadcasts like gallerydl does

@mikf
Copy link
Owner

mikf commented Sep 30, 2022

You can make gallery-dl automatically invoke ytdl by setting cards to "ytdl"
and using the actual Tweet URL or a timeline URL. /i/broadcasts/ URLs will remain unsupported.

$ gallery-dl -o cards=ytdl https://twitter.com/BSSportsbook/status/1575640086766653440
/tmp/twitter/BSSportsbook/1575640086766653440_1.mp4

@AdamSaketume26
Copy link
Author

to make sure can i do that and use https://twitter.com/BSSportsbook/ instead to download all broadcasts if it finds them?

@mikf
Copy link
Owner

mikf commented Sep 30, 2022

Yeah, that works. It will also download all other media though, which you could partially filter with
--filter "extension not in ('jpg', 'png')"

@AdamSaketume26
Copy link
Author

got it i will create a separate run using this to only get past video broadcasts

could i also use cards whitelist to only include "twitter.com/i/broadcasts"?

@mikf
Copy link
Owner

mikf commented Sep 30, 2022

There is no cards whitelist option, only a blacklist one.

Also, in addition to the filter from #2985 (comment), you can add 'mp4' to the list to ignore regular videos. Anything that gets downloaded with ytdl does not have a filename extension when --filter gets checked, meaning it will only download cards videos that use ytdl.

@AdamSaketume26
Copy link
Author

I noticed this doesnt work because the graphql endpoint used shows all media. if someone is livestreaming a twitter broadcast when you click media on their twitter account the broadcast card is not there so this doesnt work

the broadcast card is only listed under their tweets. is there a way to tell gallerydl to look at the first 10 tweets to get all cards and other media from it instead?

@mikf
Copy link
Owner

mikf commented Oct 5, 2022

the broadcast card is only listed under their tweets

Then try https://twitter.com/USER/tweets as URL or set strategy to "tweets"

is there a way to tell gallerydl to look at the first 10 tweets to get all cards and other media from it instead?

Not exactly. You could try --range 1-10, but that restricts it to the first 10 files, not tweets.

@AdamSaketume26
Copy link
Author

I tried that and it works now ty! But I wish it wasn't blocking the thread while downloading the livestream so other content can download at the same time.

@AdamSaketume26
Copy link
Author

for people in the future you can add audiospaces to your cards blacklist to avoid spaces

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

2 participants