Sudden failures of ITV shows #205
Comments
Hi 😄 ... By what you say, it looks to me as if, for some obscure reason, the downloaded MPEG-TS container file is not remuxed to the MP4 container that iTunes can import and play back (don't worry if you don't understand the terminology I used, the maintainer and several other members here do and should be able to help... 😉 )... Can you post the complete filename of the ITV downloaded file (that would play in VLC but not in iTunes)?
Have you tried generating a verbose log ? It will divulge more useful info about what is failing in your setup (please attach it here or paste it to a GitHub gist; DO NOT post it in the body of your comment/reply)... Regards |
|
Can you please be specific about which show isn't working for you? I'm not seeing any problems in general with ITV shows, though one show (Take the Tower) fails to download. |
|
Hi, I’m not at my desk to add the verbose logs today, but I tried a variety of ITV shows and got the same result, namely Bad Move Episode 1, and Strangers episodes 1-5. Thanks, P
… On 15 Oct 2018, at 03:40, Scott Kovatch ***@***.***> wrote:
Can you please be specific about which show isn't working for you? I'm not seeing any problems in general with ITV shows, though one show (Take the Tower) fails to download.
—
You are receiving this because you authored the thread.
Reply to this email directly, view it on GitHub, or mute the thread.
|
|
I am finding that all ITV shows fail to download. The process begins and then exits after reaching approx. 0.4%. I am left with a number of temporary files after the process exits. Shows I am having problems with include: I have tried reinstalling GetiPlayerAutomator but that has not resolved the issue. |
Hi Ben 😄 - you appear to be located within the UK, so geo-blocking shouldn't be an issue in your case 😉 ...
OT: Notice to overseas users: During the last 7-10 days, ITV have unleashed a new round of blocking, in a blanket fashion, many commercial UK VPN/Proxy servers; all services hosted on Digital Ocean (DO) UK nodes took a direct blow and no longer work (they get stopped at the |
|
I too have tried to reinstall, and also tried previous versions of GIA, but no joy I’m afraid. I’m the U.K. so not using VPN.
P
… On 15 Oct 2018, at 14:55, Vangelis66 ***@***.***> wrote:
I am finding that all ITV shows fail to download.
The process begins and then exits after reaching approx. 0.4%.
(snip)
2a5287a0005 - Strangers
Hi Ben 😄 - you appear to be located within the UK, so geo-blocking shouldn't be an issue in your case 😉 ...
I understand my reply is not much help, but using the standalone latest (2018.10.05) version of youtube-dl (on Windows) and a whitelisted UK VPN (that won't be named...), I find the download progress passes the 0.4% point...
youtube-dl --console-title --hls-prefer-native --hls-use-mpegts -c --no-part --fixup never "https://www.itv.com/hub/strangers/2a5287a0005" --write-sub --convert-subs=srt -o "ITV1_Strangers_Se1Ep5_201810082100[2a5287a0005].ts" =>
[ITV] 2a5287a0005: Downloading webpage
[ITV] 2a5287a0005: Downloading XML
WARNING: Unable to download XML: HTTP Error 504: Gateway Time-out
[ITV] 2a5287a0005: Downloading JSON metadata
[ITV] 2a5287a0005: Downloading m3u8 information
[info] Writing video subtitles to: ITV1_Strangers_Se1Ep5_201810082100[2a5287a000
5].en.vtt
[hlsnative] Downloading m3u8 manifest
[hlsnative] Total fragments: 225
[download] Destination: ITV1_Strangers_Se1Ep5_201810082100[2a5287a0005].ts
[download] 1.8% of ~488.69MiB at 442.72KiB/s ETA 28:24
youtube-dl is the helper tool used inside GiA to actually manage ITVHub fetches...
OT: Notice to overseas users: During the last 7-10 days, ITV have unleashed a new round of blocking, in a blanket fashion, many commercial UK VPN/Proxy servers; all services hosted on Digital Ocean (DO) UK nodes took a direct blow and no longer work (they get stopped at the Downloading JSON metadata stage); so if you find your ITV shows to suddenly NOT download at ALL (not start and stall), first place to look is your UK VPN... 😠
—
You are receiving this because you authored the thread.
Reply to this email directly, view it on GitHub, or mute the thread.
|
|
OK, the fault is entirely mine. Two firewall rules were at fault. After I enabled access to the following addresses, Get iPlayer Automator began functioning correctly:
Other users experiencing similar problems may want to check their firewall rules and content blocker settings. |
... that explains it then! 👍 For those who want a detailed explanation:
(this is in fact contained inside the HLSe variant playlist...); GiA (actually youtube-dl) successfully downloads the first encrypted HLSe segment (roughly 0.4% of total file size), requests (on-the-fly) the keys to decrypt it, but because access to the lic server is firewalled, fails to do so, hence it aborts the whole download... ... Now back to trying to solve OP's predicament 😕 |
|
Hi again, an example of the filename it downloads is: Bad Move.s02e01.Episode 1.mp4 However the computer doesn't automatically recognise it as an iTunes compatible file and won't play it except with VLC. It is however 100% complete. |
|
I'm using a VPN (UK) in Thaland. ITV stopped working two days ago. Switching off the firewall (iMac) made no difference. BBC is working fine
|
|
Can you start your own thread? VPN’s are a totally different issue I think.
… On 16 Oct 2018, at 06:25, msg362 ***@***.***> wrote:
I'm using a VPN (UK) in Thaland. ITV stopped working two days ago. Switching off the firewall (iMac) made no difference. BBC is working fine
'download failed' Unknown PID Not found, trying to downoad 'butterfly' but no prgramme is downloadable
Untitled.pdf
—
You are receiving this because you authored the thread.
Reply to this email directly, view it on GitHub, or mute the thread.
|
|
It seems to be that ITV have blocked many VPNs but I'm not sure |
|
Contact your VPN provider. I heard that some have already fixed the ITV issue |
|
I can watch but not download on GIA it says PID not found
On Wed, 17 Oct 2018 at 22:13, naq59 ***@***.***> wrote:
Contact your VPN provider. I heard that some have already fixed the ITV
issue
—
You are receiving this because you commented.
Reply to this email directly, view it on GitHub
<#205 (comment)>,
or mute the thread
<https://github.com/notifications/unsubscribe-auth/AqJBwpjrfHkMaF1i4uFdK7yp57riJRdrks5ul0kNgaJpZM4XbSTJ>
.
--
Mike from iPhone
|
|
Try version 1.13.10 of GIA. That might work better |
|
Sorry to be a pain, but my original issue has nothing to do with VPNs so please start a separate thread for those. I need to know why GIA is not actioning the conversion and import after download..
… On 17 Oct 2018, at 16:20, naq59 ***@***.***> wrote:
Try version 1.13.10 of GIA. That might work better
—
You are receiving this because you authored the thread.
Reply to this email directly, view it on GitHub, or mute the thread.
|
|
I'm on 1.13.16, but away for a few days, will try again on saturday, thanks
Mike
Sankamphaeng
Chiang Mai
Thailand
…On Wed, 17 Oct 2018 at 22:26, pmhird ***@***.***> wrote:
Sorry to be a pain, but my original issue has nothing to do with VPNs so
please start a separate thread for those. I need to know why GIA is not
actioning the conversion and import after download..
> On 17 Oct 2018, at 16:20, naq59 ***@***.***> wrote:
>
> Try version 1.13.10 of GIA. That might work better
>
> —
> You are receiving this because you authored the thread.
> Reply to this email directly, view it on GitHub, or mute the thread.
—
You are receiving this because you commented.
Reply to this email directly, view it on GitHub
<#205 (comment)>,
or mute the thread
<https://github.com/notifications/unsubscribe-auth/AqJBwkl0Y1tRWyhQ5SnYJonEy7NtNyCyks5ul0w6gaJpZM4XbSTJ>
.
|
|
@pmhird wrote:
You're absolutely correct ! 👍 However, @msg362 did as advised and opened #206; this was closed, in the assumption it is VPN related, due to the NOTE proviso in Reporting-Issues... I am confident the maintainer discourages further VPN-related discussions, but if anyone feels absolutely compelled to add something provenly helpful to Mike's predicament, issue 206 is the better place for that... 😉
The filename looks OK; still, it can be a misnamed MPEG-TS file... For the more tech savvy: Your reported symptoms lead me to believe that this final remux for some reason fails to happen; but this is just an educated guess on my part; you have yet to share results from the troubleshooting steps you were advised to take previously in this thread, for now only speculations can be offered... Even if your troubleshooting sustains my hypothesis, it'd be difficult for me to offer definitive cure, especially since I know very little about the insides of a Mac (despite being savvy on streaming methodologies and media file manipulation)... Other members here will have to intervene, but that's the joy of a joint effort 😜 By the looks of it, your copy of FFmpeg misbehaves on those ITV downloaded files, but what I am puzzled about is that the same thing does not happen with Beeb files (that also undergo similar remux):
Cheers |
|
This has now progressed to not even downloading the incomplete file. Any attempt to download an ITV show (I'm in the UK) just fails instantly now. |
|
I am travelling will try when I get back on Sunday
On Fri, 19 Oct 2018 at 16:57, pmhird ***@***.***> wrote:
This has now progressed to not even downloading the incomplete file. Any
attempt to download an ITV show (I'm in the UK) just fails instantly now.
—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHub
<#205 (comment)>,
or mute the thread
<https://github.com/notifications/unsubscribe-auth/AqJBwjME_LfqQ_b7L97Tlk_6vell4Gx2ks5umaIBgaJpZM4XbSTJ>
.
--
Mike from iPhone
|
|
I have just upgraded to GIA 1.13.16 but its made no difference. BBC shows are still fine. |
|
Heres a PDF of my Verbose log |
|
Okay, that's helpful -- youtube-dl is trying to launch ffmpeg to convert the downloaded file into something that can be used by iTunes, but is failing for some reason. This bug from youtube-dl looks like it might be related: ytdl-org/youtube-dl#7172 -- you're on macOS 10.11 which might be related here. In Terminal, can you try |
|
I may have to include libav in the package if it does, but it will be tough to test as I don't have any machines with that OS on it. |
|
Ok will try tonight.
… On 19 Oct 2018, at 17:26, Scott Kovatch ***@***.***> wrote:
I may have to include libav in the package if it does, but it will be tough to test as I don't have any machines with that OS on it.
—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHub, or mute the thread.
|
|
So i pasted that brew command into Terminal and that faulted too... Homebrew has enabled anonymous aggregate formulae and cask analytics. xcrun: error: invalid active developer path (/Library/Developer/CommandLineTools), missing xcrun at: /Library/Developer/CommandLineTools/usr/bin/xcrun |
|
Oh, brew wants you to have Xcode installed. That makes sense, as it's mainly used by developers to get libraries or other tools for building applications, but I won't ask you to install a 5 GB app just so we can build a library. Let me look into some other possibilities. |
|
Any news on this? My GIA is now updated to latest release, and any attempt to download from ITV just fails without any file being downloaded at all now. |
|
This seems to be where it fails in the log: ValueError: insecure string pickle Any ideas what that means? |
|
I'm also on the latest release. Several things:
1: My VPN ( I'm in Thailand remember) was not accepted by ITV but by
switching to a smart a DNS I could get some programmes.
2:There is a known bug and because I had not loaded the ITV cache, it
failed. Loading the cache helped.
3: Even then, while I could run all ITV programmes on my iMac, some would
still not download, they would appear in the list and be recognised, but
when the download started, it would change to 'PID' not recognised and
fail.
I'll live with that as I don't download many ITV programmes.
Hope it works out for you
Mike
Sankamphaeng
Chiang Mai
Thailand
…On Tue, 30 Oct 2018 at 04:16, pmhird ***@***.***> wrote:
This seems to be where it fails in the log:
ValueError: insecure string pickle
Any ideas what that means?
—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHub
<#205 (comment)>,
or mute the thread
<https://github.com/notifications/unsubscribe-auth/AqJBwjjbVDpnQPaLnYqPL0R4eMijfpA8ks5up3AfgaJpZM4XbSTJ>
.
|
|
@pmhird My apologies for dropping this; the problem is your python installation doesn't have the necessary libraries to launch ffmpeg to convert the downloaded file into something iTunes can use. I was trying to find a solution that doesn't require you to install anything more than you need but I'm not sure that's going to be possible yet. Right now the only solutions I can think of are installing Xcode so you can use the How old is your hardware? Can you update to a newer OS? |
|
Thanks,
I"m on High Safari 10.13.6 ,my iMac is old and I'll not update to Mojave
yet. BTW I don't load into iTunes, I simply download, that check box is
disabled. Thanks for your earlier help, it got me this far.
Mike
Sankamphaeng
Chiang Mai
Thailand
…On Tue, 30 Oct 2018 at 08:27, Scott Kovatch ***@***.***> wrote:
@pmhird <https://github.com/pmhird> My apologies for dropping this; the
problem is your python installation doesn't have the necessary libraries to
launch ffmpeg to convert the downloaded file into something iTunes can use.
I was trying to find a solution that doesn't require you to install
anything more than you need but I'm not sure that's going to be possible
yet. Right now the only solutions I can think of are installing Xcode so
you can use the brew install libav, or updating your OS or python.
How old is your hardware? Can you update to a newer OS?
—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHub
<#205 (comment)>,
or mute the thread
<https://github.com/notifications/unsubscribe-auth/AqJBwh-_puDQW6LEM6sCWqq9RnVoZLTCks5up6sFgaJpZM4XbSTJ>
.
|
|
Hi guys, thanks for your help. Just to clarify I’m not overseas at the moment so my issue isn’t related to VPN. I don’t want to upgrade to a newer Os if possible as I am still using some legacy software that won’t work under a newer environment.
Originally my problem was downloading an episode and not converting but now it fails before it’s even downloaded a file. Are we sure it’s an FFMPEG issue therefore?
Cheers
… On 30 Oct 2018, at 00:59, msg362 ***@***.***> wrote:
I'm also on the latest release. Several things:
1: My VPN ( I'm in Thailand remember) was not accepted by ITV but by
switching to a smart a DNS I could get some programmes.
2:There is a known bug and because I had not loaded the ITV cache, it
failed. Loading the cache helped.
3: Even then, while I could run all ITV programmes on my iMac, some would
still not download, they would appear in the list and be recognised, but
when the download started, it would change to 'PID' not recognised and
fail.
I'll live with that as I don't download many ITV programmes.
Hope it works out for you
Mike
Sankamphaeng
Chiang Mai
Thailand
On Tue, 30 Oct 2018 at 04:16, pmhird ***@***.***> wrote:
> This seems to be where it fails in the log:
>
> ValueError: insecure string pickle
>
> Any ideas what that means?
>
> —
> You are receiving this because you were mentioned.
> Reply to this email directly, view it on GitHub
> <#205 (comment)>,
> or mute the thread
> <https://github.com/notifications/unsubscribe-auth/AqJBwjjbVDpnQPaLnYqPL0R4eMijfpA8ks5up3AfgaJpZM4XbSTJ>
> .
>
—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHub, or mute the thread.
|
That's completely understandable. It does make it a bit harder to find a non-complicated solution, but I wouldn't do it either if I didn't have to.
Hmm... can you post another verbose log? Make sure ITV caching is enabled. Regarding the conversion, It's not so much an ffmpeg version as it is a Python problem, which is what youtube-dl is based on. youtube-dl is trying to figure out what version of ffmpeg is available but that's failing for some reason. |
|
GiA 1.13.16 MacOS 10.14.1 Dark Heart Episode 1 and other ITV videos -- BBC works fine. Downie is less affected than GiA, Downie finished downloading the Dark Heart episode on second try. Does yt-dl have an option to increase the size of the time-out interval? Or decrease the number of concurrently downloaded fragments? Edit: Switching DNS service fixed this for me. |
|
Here’s where it gets interesting, I remembered I had an old laptop also on 10.11.6, so I put GIA 1.13.16 on that, enabled ITV caching, and straightaway it downloaded 2 series of ITV shows without any issue whatsoever. Now I’m stumped!
… On 2 Nov 2018, at 11:03, Hugo Falkman ***@***.***> wrote:
GiA 1.13.16 MacOS 10.14.1 Dark Heart Episode 1 and other ITV videos -- BBC works fine.
Attached log speaks for itself, I just kept restarting the download without erasing the parts already downloaded, until download completed successfully.
Downie is less affected than GiA, Downie finished downloading the Dark Heart episode on second try.
Charlie Monroe, the creator of Downie writes: "There can be multiple reasons for this behavior, ranging from a bug in macOS, networking issue to itv.com servers actively holding connections in order to prevent DDoS attacks (this is a common prevention - DDoS is based on many connections being made to a server until it crashes. This prevention increases delay with which it answers to each connection from the same IP address.)."
Does yt-dl have an option to increase the size of the time-out interval? Or decrease the number of concurrently downloaded fragments?
Verbose Log.txt
—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHub, or mute the thread.
|
|
OK, i had to reset a few things due to some other software issues I was having with iTunes, and randomly GIA is now fully operational, downloading ITV and importing to iTunes! I have no idea why it didn't work or indeed why it now does but never mind, and apologies for wasting your time. Thanks for all the tips though! |
|
@pmhird I don't think you should close this issue (yet). The problems with ITV come and go, yes this morning it worked flawlessly, but only yesterday I still had problems. What I have done is to in Preferences set the option "Auto-retry Failed Downloads After" to 15 seconds (0.25 minutes). Most of the time this works even on bad ITV days, and when it doesn't I download with Downie. My earlier questions remain: "Does yt-dl have an option to increase the size of the time-out interval? Or decrease the number of concurrently downloaded fragments?" |
All of a sudden ITV shows have started failing for me. I'm using Mc OS 10.11, and GIA 1.13.15. The show appears to download normally to 100% and creates a file with an .MP4 extension, but as soon as the download reaches 100% it reports download failed. The resultant file is not added to iTunes, and cannot be played by iTunes, but can be played perfectly well by VLC. It seems to me (a complete coding numpty) that the software is not converting the downloaded file to a usable tv show, and the log doesn;t help, it just says download failed, problem unknown.
BBC shows are unaffected and both BBC radio and TV work fine.
Any ideas?
The text was updated successfully, but these errors were encountered: