Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[TWITTER] mtime-from-date does not work well with syndication #2978

Open
AdamSaketume26 opened this issue Sep 28, 2022 · 6 comments
Open

[TWITTER] mtime-from-date does not work well with syndication #2978

AdamSaketume26 opened this issue Sep 28, 2022 · 6 comments

Comments

@AdamSaketume26
Copy link

i had issue with twitter module not setting the modified time for some posts when using --mtime-from-date. I use cookies file but also do set twitter syndication to true in case there are issues. I realized now that my cookies file was either rewritten or I never saved properly (but i could get protected accounts no problem so idk) so gallery-dl kept falling to the syndication api.

When using syndication api the images saved never changed modified date to when the post was made. Videos werent affected it seems.

When I updated my cookies and removed syndication api option, --mtime-from-date worked fine for photos and videos no problem.

I think using twitter syndication option has problem extracting date for images.

@AdamSaketume26
Copy link
Author

works no problem if using both syndication and cookie option, but syndication alone fails and if cookie is invalid and uses syndication it also fails

@AdamSaketume26
Copy link
Author

i noticed now that cookies keep overriding and becoming invalid but idk why. maybe twitter api rate limit blocks me or its because i use twitter logout option in case of blocks and that is what overrides

@mikf
Copy link
Owner

mikf commented Sep 29, 2022

What version of gallery-dl are you using?
The issue with broken date metadata and --mtime-from-date not working for syndication results was fixed in v1.23.1 (#2920). Upgrading to that will at least fix this one issue.

Your cookie file being overwritten can be controlled with the cookies-update option, but it being enabled should not cause any issues, least of all produce a broken cookies.txt file. What addon/userscript are you using to export your cookies?

@AdamSaketume26
Copy link
Author

1.23 i think so i need to update ty

for cookies my cookies are valid to begin with but sometime after running more than once i noticed cookies was overridded with cookies that did not have my login. i did cookies update to false and it fixed that issue

@mikf
Copy link
Owner

mikf commented Sep 30, 2022

i noticed cookies was overridded with cookies that did not have my login

That's why I was asking which software you used to extract your cookies. I'd like to reproduce this myself and fix this potential bug.

From what I can tell, the cookies.txt file produced by the addon I am using (Export Cookies) works as it should, so want to see if some other cookies.txt format from something else would cause problems.

@AdamSaketume26
Copy link
Author

i used edit this cookie on chrome browser and changed cookie format to netscape

to repeat, it works the first time maybe a little more after but at some point it changed my cookie file to be logged out. i dont know when it happened or why.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants