Download Links in Harvested Records - Unwanted downloads

[srappel]

This record links directly to a download. Probably not what people want to happen. I will have to check this out.

[srappel]

This will probably require changes in the DCAT harvester script, so this issue should really be over in GeoDiscovery-Utils.

[srappel]

https://data2017-04-05t135915451z-waupacacounty.opendata.arcgis.com/documents/waupacacounty::2018-contours-north-eastern-quadrant-shp/about

Another example from Waupaca.

We could look in the DCAT to see if the Landing Page URL matches the Distribution > Shapefile > accessURL link?

"@type": "dcat:Dataset",
			"identifier": "https://www.arcgis.com/home/item.html?id=de17272ab3e6434f950e4b8b17908bc8",
			"landingPage": "https://data2017-04-05t135915451z-waupacacounty.opendata.arcgis.com/documents/waupacacounty::2018-contours-north-eastern-quadrant-shp",
			"title": "2018 Contours - North Eastern Quadrant (.shp)",
			"description": "<span style='overflow: auto;'><span><span style='color: rgb(0, 0, 205);'><font size='4'><span style='font-weight: bold;'>703 MB ZIP FILE Contains Shapefiles.  </span></font></span></span></span><font size='3'><span style='color: rgb(0, 0, 0);'><span style='overflow: auto;'><span><span style='overflow: auto;'><span>Elevation </span></span><span style='overflow: auto;'><span><span style='overflow: auto;'><span><span style='overflow: auto;'><span>values are referenced to NADV88.  </span></span></span></span></span></span></span></span></span></font><font size='3'><span style='color: rgb(0, 0, 0);'><span style='overflow: auto;'><span><span style='overflow: auto;'><span><span style='overflow: auto;'><span><span style='overflow: auto;'><span><span style='overflow: auto;'><span><span style='overflow: auto;'><span><span style='overflow: auto;'><span></span></span></span></span></span></span></span></span></span></span></span></span></span></span></span></font>",
			"keyword": [
				"Open Data",
				"Elevation"
			],
			"issued": "2019-07-09T16:54:00.000Z",
			"modified": "2019-07-12T20:37:31.000Z",
			"publisher": {
				"name": "Waupaca County Land Information"
			},
			"contactPoint": {
				"@type": "vcard:Contact",
				"fn": "WaupacaCounty_LIO",
				"hasEmail": "mailto:[email protected]"
			},
			"accessLevel": "public",
			"spatial": "-89.3348,44.2259,-88.3440,44.6891",
			"license": "http://creativecommons.org/licenses/by/4.0",
			"distribution": [
				{
					"@type": "dcat:Distribution",
					"title": "ArcGIS Hub Dataset",
					"format": "Web Page",
					"mediaType": "text/html",
					"accessURL": "https://data2017-04-05t135915451z-waupacacounty.opendata.arcgis.com/documents/waupacacounty::2018-contours-north-eastern-quadrant-shp"
				},
				{
					"@type": "dcat:Distribution",
					"title": "ArcGIS GeoService",
					"format": "ArcGIS GeoServices REST API",
					"mediaType": "application/json",
					"accessURL": "https://wclio-lidar-2018.s3.amazonaws.com/Contours/shp/WCGIS_2018_Contours_ne_shp.zip"
				}
			],
			"theme": [
				"geospatial"

[srappel]

In all honesty, this isn't a huge issue. Here is the above dataset on Geodata@Wisconsin... it does the same thing:

https://geodata.wisc.edu/catalog/WaukeshaCounty-8218c3405342459c8513143c2f5239e4

[srappel]

BTAA handles links really well: