CKAN slow to launch, downloads time out

[YellowApple]

Background

CKAN Version: v1.25.3

KSP Version: 1.5.1

Operating System: Slackware64-current (Linux 4.14.67, Mono 5.0.1.1)

Have you made any manual changes to your GameData folder (i.e., not via CKAN)? No

Problem

What steps did you take in CKAN?

• Open a terminal in ~/.steam/steam/steamapps/common/Kerbal Space Program
• Run cert-sync /etc/ssl/certs/ca-certificates.crt (says everything's already imported)
• Run mono ckan.exe
• Wait for 5 minutes for CKAN to actually launch (!) (including another 5 minutes to get through the dialog asking if I want CKAN to automatically update itself)
• Select 3 mods (IndicatorLights, IndicatorLightsCommunityExtensions, ModuleManager)
• Click "Apply changes" (and the confirmation button afterward)

What did you expect to happen? Successful download and installation into ~/.steam/steam/steamapps/common/Kerbal Space Program, and also for CKAN to launch a lot faster (I suspect these issues might be related).

What happened instead? The below pop-up window, and the below entries in STDOUT. Also, the aforementioned slow startup (it's been awhile since I've used CKAN, but I've never seen this kind of sluggishness before - and this is on a Threadripper with oodles of RAM and SSD capacity, so I can't think of any hardware-related reason why it'd be this slow).

Screenshots:

CKAN error codes (if applicable):

103836 [1] WARN CKAN.Curl (null) - Curl environment not pre-initialised, performing non-threadsafe init.
35346047 [1] ERROR CKAN.ErrorDialog (null) - One or more downloads were unsuccessful:

Error downloading IndicatorLights 1.4: Error: ConnectFailure (Connection timed out)
Error downloading IndicatorLightsCommunityExtensions 1.4: Error: ConnectFailure (Connection timed out)
Error downloading ModuleManager 3.1.0: Error: ConnectFailure (Connection timed out)

[YellowApple]

Looks like the command-line approach has the same issue with downloading (but at least it's quicker to start up):

bash-4.4$ mono ckan.exe install IndicatorLights
About to install...

 * IndicatorLights 1.4 (spacedock.info, 202.2 KB)
 * Module Manager 3.1.0 (ksp.sarbian.com, 47.4 KB)

Continue? [Y/n] 

Downloading "https://spacedock.info/mod/566/IndicatorLights/download/1.4"
Downloading "https://ksp.sarbian.com/jenkins/job/ModuleManager/143/artifact/ModuleManager-3.1.0.zip"
One or more downloads were unsuccessful:

Error downloading IndicatorLights 1.4: Error: ConnectFailure (Connection timed out)
Error downloading ModuleManager 3.1.0: Error: ConnectFailure (Connection timed out)

I should also note that my Internet connection is working fine (I'm writing this comment from the same machine experiencing the issue, and said machine can also access SpaceDock and that other site perfectly fine via a browser).

[HebaruSan]

Make sure your mono install is complete and up to date. We had a report recently that was caused by an out of date version of libmono-*security.
#2527 (comment)

[YellowApple]

Upgraded to the latest Mono (5.16.0.179). CKAN starts up a lot quicker now, but now I'm getting a new error when downloading:

2899 [1] WARN CKAN.Curl (null) - Curl environment not pre-initialised, performing non-threadsafe init.
26679 [1] ERROR CKAN.ErrorDialog (null) - One or more downloads were unsuccessful:

Error downloading IndicatorLights 1.4: An exception occurred during a WebClient request.
Error downloading IndicatorLightsCommunityExtensions 1.4: An exception occurred during a WebClient request.
Error downloading ModuleManager 3.1.0: An exception occurred during a WebClient request.

Kinda wish it would tell me what exception occurred. Is there a "verbose" mode or something like that so I can get stack traces or something? EDIT: there is indeed a --verbose flag, apparently. Verbose output of that full procedure below:

bash-4.4$ mono ckan.exe --verbose
129 [1] INFO CKAN.CmdLine.CommonOptions (null) - Verbose logging enabled
270 [1] INFO CKAN.Main (null) - Starting the GUI
458 [1] INFO CKAN.KSP (null) - KSP found at /home/northrup/.local/share/Steam/steamapps/common/Kerbal Space Program
587 [1] INFO CKAN.KSP (null) - Initialising /home/northrup/.local/share/Steam/steamapps/common/Kerbal Space Program/CKAN
588 [1] INFO CKAN.KSP (null) - Initialised /home/northrup/.local/share/Steam/steamapps/common/Kerbal Space Program/CKAN
2745 [1] INFO CKAN.RegistryManager (null) - Loaded CKAN registry at /home/northrup/.local/share/Steam/steamapps/common/Kerbal Space Program/CKAN/registry.json
2911 [1] INFO CKAN.Main (null) - Making auto-update call
2919 [1] INFO CKAN.Net (null) - Download failed, trying with curlsharp...
2920 [1] WARN CKAN.Curl (null) - Curl environment not pre-initialised, performing non-threadsafe init.
2926 [1] INFO CKAN.Curl (null) - Using curl-ca bundle: (none)
3875 [1] INFO CKAN.URLHandlers (null) - Trying to register URL handler
3894 [1] INFO CKAN.Main (null) - Updating the mod list
5261 [1] INFO CKAN.RegistryManager (null) - Saving CKAN registry at /home/northrup/.local/share/Steam/steamapps/common/Kerbal Space Program/CKAN/registry.json
5852 [1] INFO CKAN.Main (null) - GUI started
5884 [Thread Pool Worker] INFO CKAN.Repo (null) - About to update default
5886 [Thread Pool Worker] INFO CKAN.Net (null) - Download failed, trying with curlsharp...
5887 [Thread Pool Worker] INFO CKAN.Curl (null) - Using curl-ca bundle: (none)
6619 [Thread Pool Worker] INFO CKAN.Repo (null) - Downloading https://github.com/KSP-CKAN/CKAN-meta/archive/master.tar.gz
6622 [Thread Pool Worker] INFO CKAN.Net (null) - Download failed, trying with curlsharp...
6622 [Thread Pool Worker] INFO CKAN.Curl (null) - Curl init already performed, not running twice
6623 [Thread Pool Worker] INFO CKAN.Curl (null) - Using curl-ca bundle: (none)
10258 [Thread Pool Worker] INFO CKAN.JsonIgnoreBadUrlConverter (null) - http://Included%20in%20download is not a valid URL, ignoring
10443 [Thread Pool Worker] INFO CKAN.JsonIgnoreBadUrlConverter (null) - http://the%20mod%20is%20the%20code is not a valid URL, ignoring
10479 [Thread Pool Worker] INFO CKAN.JsonIgnoreBadUrlConverter (null) - BobsPanicBox is not a valid URL, ignoring
10479 [Thread Pool Worker] INFO CKAN.JsonIgnoreBadUrlConverter (null) - BobsPanicBox is not a valid URL, ignoring
10479 [Thread Pool Worker] INFO CKAN.JsonIgnoreBadUrlConverter (null) - BobsPanicBox is not a valid URL, ignoring
10480 [Thread Pool Worker] INFO CKAN.JsonIgnoreBadUrlConverter (null) - BobsPanicBox is not a valid URL, ignoring
10480 [Thread Pool Worker] INFO CKAN.JsonIgnoreBadUrlConverter (null) - BobsPanicBox is not a valid URL, ignoring
10480 [Thread Pool Worker] INFO CKAN.JsonIgnoreBadUrlConverter (null) - BobsPanicBox is not a valid URL, ignoring
10480 [Thread Pool Worker] INFO CKAN.JsonIgnoreBadUrlConverter (null) - BobsPanicBox is not a valid URL, ignoring
10480 [Thread Pool Worker] INFO CKAN.JsonIgnoreBadUrlConverter (null) - BobsPanicBox is not a valid URL, ignoring
10481 [Thread Pool Worker] INFO CKAN.JsonIgnoreBadUrlConverter (null) - BobsPanicBox is not a valid URL, ignoring
10481 [Thread Pool Worker] INFO CKAN.JsonIgnoreBadUrlConverter (null) - BobsPanicBox is not a valid URL, ignoring
10481 [Thread Pool Worker] INFO CKAN.JsonIgnoreBadUrlConverter (null) - BobsPanicBox is not a valid URL, ignoring
10481 [Thread Pool Worker] INFO CKAN.JsonIgnoreBadUrlConverter (null) - BobsPanicBox is not a valid URL, ignoring
10482 [Thread Pool Worker] INFO CKAN.JsonIgnoreBadUrlConverter (null) - BobsPanicBox is not a valid URL, ignoring
10482 [Thread Pool Worker] INFO CKAN.JsonIgnoreBadUrlConverter (null) - BobsPanicBox is not a valid URL, ignoring
10482 [Thread Pool Worker] INFO CKAN.JsonIgnoreBadUrlConverter (null) - BobsPanicBox is not a valid URL, ignoring
10483 [Thread Pool Worker] INFO CKAN.JsonIgnoreBadUrlConverter (null) - BobsPanicBox is not a valid URL, ignoring
10561 [Thread Pool Worker] INFO CKAN.JsonIgnoreBadUrlConverter (null) - http://Included%20in%20download is not a valid URL, ignoring
10562 [Thread Pool Worker] INFO CKAN.JsonIgnoreBadUrlConverter (null) - http://Included%20in%20download is not a valid URL, ignoring
10562 [Thread Pool Worker] INFO CKAN.JsonIgnoreBadUrlConverter (null) - http://Included%20in%20download is not a valid URL, ignoring
10562 [Thread Pool Worker] INFO CKAN.JsonIgnoreBadUrlConverter (null) - http://Included%20in%20download is not a valid URL, ignoring
10815 [Thread Pool Worker] INFO CKAN.JsonIgnoreBadUrlConverter (null) - http://Included%20in%20Zip is not a valid URL, ignoring
10816 [Thread Pool Worker] INFO CKAN.JsonIgnoreBadUrlConverter (null) - http://Included%20in%20Zip is not a valid URL, ignoring
10942 [Thread Pool Worker] INFO CKAN.JsonIgnoreBadUrlConverter (null) - http://in%20the%20zip is not a valid URL, ignoring
10943 [Thread Pool Worker] INFO CKAN.JsonIgnoreBadUrlConverter (null) - http://in%20the%20zip is not a valid URL, ignoring
10943 [Thread Pool Worker] INFO CKAN.JsonIgnoreBadUrlConverter (null) - http://in%20the%20zip is not a valid URL, ignoring
11092 [Thread Pool Worker] INFO CKAN.JsonIgnoreBadUrlConverter (null) - http://The%20config%20itself is not a valid URL, ignoring
11092 [Thread Pool Worker] INFO CKAN.JsonIgnoreBadUrlConverter (null) - http://The%20config%20itself is not a valid URL, ignoring
11093 [Thread Pool Worker] INFO CKAN.JsonIgnoreBadUrlConverter (null) - http://The%20config%20itself is not a valid URL, ignoring
11093 [Thread Pool Worker] INFO CKAN.JsonIgnoreBadUrlConverter (null) - http://The%20config%20itself is not a valid URL, ignoring
11093 [Thread Pool Worker] INFO CKAN.JsonIgnoreBadUrlConverter (null) - http://The%20config%20itself is not a valid URL, ignoring
11093 [Thread Pool Worker] INFO CKAN.JsonIgnoreBadUrlConverter (null) - http://The%20config%20itself is not a valid URL, ignoring
11234 [Thread Pool Worker] INFO CKAN.JsonIgnoreBadUrlConverter (null) - http://included%20in%20download is not a valid URL, ignoring
11891 [Thread Pool Worker] INFO CKAN.JsonIgnoreBadUrlConverter (null) - http://Config%20File. is not a valid URL, ignoring
12734 [Thread Pool Worker] INFO CKAN.JsonIgnoreBadUrlConverter (null) - http://the%20mod%20is%20the%20code is not a valid URL, ignoring
12889 [Thread Pool Worker] INFO CKAN.JsonIgnoreBadUrlConverter (null) - http://Included%20in%20archive is not a valid URL, ignoring
13233 [Thread Pool Worker] INFO CKAN.JsonIgnoreBadUrlConverter (null) - http://on%20the%20zip is not a valid URL, ignoring
13250 [Thread Pool Worker] INFO CKAN.Repo (null) - Updated default
13486 [Thread Pool Worker] INFO CKAN.RegistryManager (null) - Saving CKAN registry at /home/northrup/.local/share/Steam/steamapps/common/Kerbal Space Program/CKAN/registry.json
14355 [1] INFO CKAN.Main (null) - Updating the mod list
62735 [Thread Pool Worker] INFO CKAN.NetAsyncDownloader (null) - Setting MIME type application/zip;q=1.0,application/octet-stream;q=0.9
62736 [Thread Pool Worker] INFO CKAN.NetAsyncDownloader (null) - Setting MIME type application/zip;q=1.0,application/octet-stream;q=0.9
62736 [Thread Pool Worker] INFO CKAN.NetAsyncDownloader (null) - Setting MIME type application/zip;q=1.0,application/octet-stream;q=0.9
62740 [Thread Pool Worker] INFO CKAN.NetAsyncDownloader (null) - Error downloading https://spacedock.info/mod/566/IndicatorLights/download/1.4: System.Net.WebException: An exception occurred during a WebClient request. ---> System.NullReferenceException: Object reference not set to an instance of an object
  at System.Net.WebRequestPrefixElement..ctor (System.String P, System.Type creatorType) [0x00018] in <ce09a167297e4f4c919a79bddbcc98c5>:0 
  at System.Net.WebRequest.PopulatePrefixList () [0x00040] in <ce09a167297e4f4c919a79bddbcc98c5>:0 
  at System.Net.WebRequest.get_PrefixList () [0x00022] in <ce09a167297e4f4c919a79bddbcc98c5>:0 
  at System.Net.WebRequest.Create (System.Uri requestUri, System.Boolean useUriBase) [0x0002e] in <ce09a167297e4f4c919a79bddbcc98c5>:0 
  at System.Net.WebRequest.Create (System.Uri requestUri) [0x00014] in <ce09a167297e4f4c919a79bddbcc98c5>:0 
  at System.Net.WebClient.GetWebRequest (System.Uri address) [0x00000] in <ce09a167297e4f4c919a79bddbcc98c5>:0 
  at System.Net.WebClient.DownloadFileAsync (System.Uri address, System.String fileName, System.Object userToken) [0x00032] in <ce09a167297e4f4c919a79bddbcc98c5>:0 
   --- End of inner exception stack trace ---
62743 [Thread Pool Worker] INFO CKAN.NetAsyncDownloader (null) - Trying fallback URL: https://archive.org/download/IndicatorLights-1.4/5DA35133-IndicatorLights-1.4.zip
62743 [Thread Pool Worker] INFO CKAN.NetAsyncDownloader (null) - Error downloading https://spacedock.info/mod/974/IndicatorLights Community Extensions/download/1.4: System.Net.WebException: An exception occurred during a WebClient request. ---> System.NullReferenceException: Object reference not set to an instance of an object
  at System.Net.WebRequestPrefixElement..ctor (System.String P, System.Type creatorType) [0x00018] in <ce09a167297e4f4c919a79bddbcc98c5>:0 
  at System.Net.WebRequest.PopulatePrefixList () [0x00040] in <ce09a167297e4f4c919a79bddbcc98c5>:0 
  at System.Net.WebRequest.get_PrefixList () [0x00022] in <ce09a167297e4f4c919a79bddbcc98c5>:0 
  at System.Net.WebRequest.Create (System.Uri requestUri, System.Boolean useUriBase) [0x0002e] in <ce09a167297e4f4c919a79bddbcc98c5>:0 
  at System.Net.WebRequest.Create (System.Uri requestUri) [0x00014] in <ce09a167297e4f4c919a79bddbcc98c5>:0 
  at System.Net.WebClient.GetWebRequest (System.Uri address) [0x00000] in <ce09a167297e4f4c919a79bddbcc98c5>:0 
  at System.Net.WebClient.DownloadFileAsync (System.Uri address, System.String fileName, System.Object userToken) [0x00032] in <ce09a167297e4f4c919a79bddbcc98c5>:0 
   --- End of inner exception stack trace ---
62744 [Thread Pool Worker] INFO CKAN.NetAsyncDownloader (null) - Error downloading https://spacedock.info/mod/566/IndicatorLights/download/1.4: System.Net.WebException: An exception occurred during a WebClient request. ---> System.NullReferenceException: Object reference not set to an instance of an object
  at System.Net.WebRequestPrefixElement..ctor (System.String P, System.Type creatorType) [0x00018] in <ce09a167297e4f4c919a79bddbcc98c5>:0 
  at System.Net.WebRequest.PopulatePrefixList () [0x00040] in <ce09a167297e4f4c919a79bddbcc98c5>:0 
  at System.Net.WebRequest.get_PrefixList () [0x00022] in <ce09a167297e4f4c919a79bddbcc98c5>:0 
  at System.Net.WebRequest.Create (System.Uri requestUri, System.Boolean useUriBase) [0x0002e] in <ce09a167297e4f4c919a79bddbcc98c5>:0 
  at System.Net.WebRequest.Create (System.Uri requestUri) [0x00014] in <ce09a167297e4f4c919a79bddbcc98c5>:0 
  at System.Net.WebClient.GetWebRequest (System.Uri address) [0x00000] in <ce09a167297e4f4c919a79bddbcc98c5>:0 
  at System.Net.WebClient.DownloadFileAsync (System.Uri address, System.String fileName, System.Object userToken) [0x00032] in <ce09a167297e4f4c919a79bddbcc98c5>:0 
   --- End of inner exception stack trace ---
62744 [Thread Pool Worker] INFO CKAN.NetAsyncDownloader (null) - Trying fallback URL: https://archive.org/download/IndicatorLightsCommunityExtensions-1.4/24B89A6D-IndicatorLightsCommunityExtensions-1.4.zip
62745 [Thread Pool Worker] INFO CKAN.NetAsyncDownloader (null) - Error downloading https://spacedock.info/mod/974/IndicatorLights Community Extensions/download/1.4: System.Net.WebException: An exception occurred during a WebClient request. ---> System.NullReferenceException: Object reference not set to an instance of an object
  at System.Net.WebRequestPrefixElement..ctor (System.String P, System.Type creatorType) [0x00018] in <ce09a167297e4f4c919a79bddbcc98c5>:0 
  at System.Net.WebRequest.PopulatePrefixList () [0x00040] in <ce09a167297e4f4c919a79bddbcc98c5>:0 
  at System.Net.WebRequest.get_PrefixList () [0x00022] in <ce09a167297e4f4c919a79bddbcc98c5>:0 
  at System.Net.WebRequest.Create (System.Uri requestUri, System.Boolean useUriBase) [0x0002e] in <ce09a167297e4f4c919a79bddbcc98c5>:0 
  at System.Net.WebRequest.Create (System.Uri requestUri) [0x00014] in <ce09a167297e4f4c919a79bddbcc98c5>:0 
  at System.Net.WebClient.GetWebRequest (System.Uri address) [0x00000] in <ce09a167297e4f4c919a79bddbcc98c5>:0 
  at System.Net.WebClient.DownloadFileAsync (System.Uri address, System.String fileName, System.Object userToken) [0x00032] in <ce09a167297e4f4c919a79bddbcc98c5>:0 
   --- End of inner exception stack trace ---
62745 [Thread Pool Worker] INFO CKAN.NetAsyncDownloader (null) - Error downloading https://ksp.sarbian.com/jenkins/job/ModuleManager/143/artifact/ModuleManager-3.1.0.zip: System.Net.WebException: An exception occurred during a WebClient request. ---> System.NullReferenceException: Object reference not set to an instance of an object
  at System.Net.WebRequestPrefixElement..ctor (System.String P, System.Type creatorType) [0x00018] in <ce09a167297e4f4c919a79bddbcc98c5>:0 
  at System.Net.WebRequest.PopulatePrefixList () [0x00040] in <ce09a167297e4f4c919a79bddbcc98c5>:0 
  at System.Net.WebRequest.get_PrefixList () [0x00022] in <ce09a167297e4f4c919a79bddbcc98c5>:0 
  at System.Net.WebRequest.Create (System.Uri requestUri, System.Boolean useUriBase) [0x0002e] in <ce09a167297e4f4c919a79bddbcc98c5>:0 
  at System.Net.WebRequest.Create (System.Uri requestUri) [0x00014] in <ce09a167297e4f4c919a79bddbcc98c5>:0 
  at System.Net.WebClient.GetWebRequest (System.Uri address) [0x00000] in <ce09a167297e4f4c919a79bddbcc98c5>:0 
  at System.Net.WebClient.DownloadFileAsync (System.Uri address, System.String fileName, System.Object userToken) [0x00032] in <ce09a167297e4f4c919a79bddbcc98c5>:0 
   --- End of inner exception stack trace ---
62746 [Thread Pool Worker] INFO CKAN.NetAsyncDownloader (null) - Trying fallback URL: https://archive.org/download/ModuleManager-3.1.0/7D0F3B9D-ModuleManager-3.1.0.zip
62746 [Thread Pool Worker] INFO CKAN.NetAsyncDownloader (null) - Error downloading https://ksp.sarbian.com/jenkins/job/ModuleManager/143/artifact/ModuleManager-3.1.0.zip: System.Net.WebException: An exception occurred during a WebClient request. ---> System.NullReferenceException: Object reference not set to an instance of an object
  at System.Net.WebRequestPrefixElement..ctor (System.String P, System.Type creatorType) [0x00018] in <ce09a167297e4f4c919a79bddbcc98c5>:0 
  at System.Net.WebRequest.PopulatePrefixList () [0x00040] in <ce09a167297e4f4c919a79bddbcc98c5>:0 
  at System.Net.WebRequest.get_PrefixList () [0x00022] in <ce09a167297e4f4c919a79bddbcc98c5>:0 
  at System.Net.WebRequest.Create (System.Uri requestUri, System.Boolean useUriBase) [0x0002e] in <ce09a167297e4f4c919a79bddbcc98c5>:0 
  at System.Net.WebRequest.Create (System.Uri requestUri) [0x00014] in <ce09a167297e4f4c919a79bddbcc98c5>:0 
  at System.Net.WebClient.GetWebRequest (System.Uri address) [0x00000] in <ce09a167297e4f4c919a79bddbcc98c5>:0 
  at System.Net.WebClient.DownloadFileAsync (System.Uri address, System.String fileName, System.Object userToken) [0x00032] in <ce09a167297e4f4c919a79bddbcc98c5>:0 
   --- End of inner exception stack trace ---
62746 [Thread Pool Worker] INFO CKAN.NetAsyncDownloader (null) - All files finished downloading
62755 [1] ERROR CKAN.ErrorDialog (null) - One or more downloads were unsuccessful:

Error downloading IndicatorLights 1.4: An exception occurred during a WebClient request.
Error downloading IndicatorLightsCommunityExtensions 1.4: An exception occurred during a WebClient request.
Error downloading ModuleManager 3.1.0: An exception occurred during a WebClient request.

68359 [1] INFO CKAN.CmdLine.MainClass (null) - CKAN exiting.

[HebaruSan]

Yeah, the annoying "An exception" thing is addressed in #2528.

Still looks like a Mono install problem. You're getting a null reference exception inside some Mono library constructor. That's not something CKAN can cause or fix.

[HebaruSan]

Here's where that exception was thrown, in case it helps:

https://github.com/mono/mono/blob/4a6b11577fe06a58e6326b1c3a3bb58cfee6185c/mcs/class/referencesource/System/net/System/Net/Internal.cs#L1664-L1675

References that might be null in that code:

• typeof(IWebRequestCreate)
• SR (this is a class rather than a reference)
• this

I don't think any of those could be null without something along the lines of a missing DLL.

[YellowApple]

Ah geez, I found the issue, and it was indeed an issue with my install.

The install itself was complete (all the DLLs were there), but I forgot to let slackpkg go through its typical config update process after upgrading Mono to the latest version, so it was still sitting there with outdated versions of /etc/mono/config and /etc/mono/$API_VERSION/machine.config. Overwriting those with the supposed-to-be-newly-installed versions fixed the issue entirely, and I'm now able to install those mods (and then some) without any issue at all.

So moral of the story: make sure everything under /etc/mono is up to date if you upgrade Mono :)

Thanks for your help/patience with this.