Harvester / Simple URL / ODS improvement

[fxprunayre]

• Ignore "null" value
• Add support for "metas/dcat"
• Fix path for language and license when using v2 API
• Add spatial and temporal extent when available
• Add extra keywords based one "metas/dcat/temporal" and "metas/default/territory"
• Add resource identifier
• Add record count and geometry type
• Add lineage and credit
• Add references
• Cleanup namespaces

Information displayed on ODS information page are now quite similar to the harvested content. Can probably be improved on publisher/creator/contributor element (to which contact contact_name/contact_email is attached to?) which is a bit unclear in the model.

Follow up of #7201 Related to #8359

Can be tested with

{"@id":"4284","@type":"simpleurl","owner":["70"],"ownerGroup":[14697],"ownerUser":["70"],"site":{"name":"odwb","uuid":"1f4e3e33-be43-486e-a371-f9fed31d4df1","account":{"use":false,"username":[],"password":[]},"url":"https://www.odwb.be/api/explore/v2.0/catalog/datasets?limit=10&offset=0&timezone=UTC&include_links=false&include_app_metas=false","icon":"blank.png","loopElement":"/datasets","numberOfRecordPath":"/total_count","recordIdPath":"/dataset/dataset_id","pageSizeParam":"limit","pageFromParam":"offset","toISOConversion":"schema:iso19115-3.2018:convert/fromJsonOpenDataSoft"},"content":{"validate":"NOVALIDATION","importxslt":"none","batchEdits":"[]"},"options":{"every":"0 0 0 ? * *","oneRunOnly":false,"overrideUuid":"SKIP","status":"active"},"privileges":[{"@id":"1","operation":[{"@name":"view"},{"@name":"dynamic"},{"@name":"download"}]}],"ifRecordExistAppendPrivileges":false,"info":{"lastRun":"2024-10-03T22:00:00.009288Z","running":false,"result":{"added":"0","atomicDatasetRecords":"0","badFormat":"0","collectionDatasetRecords":"0","datasetUuidExist":"1","privilegesAppendedOnExistingRecord":"0","doesNotValidate":"0","xpathFilterExcluded":"0","duplicatedResource":"0","fragmentsMatched":"0","fragmentsReturned":"0","fragmentsUnknownSchema":"0","incompatible":"0","recordsBuilt":"0","recordsUpdated":"0","removed":"0","serviceRecords":"0","subtemplatesAdded":"0","subtemplatesRemoved":"0","subtemplatesUpdated":"0","total":"1078","unchanged":"0","unknownSchema":"0","unretrievable":"0","updated":"1077","thumbnails":"0","thumbnailsFailed":"0","errors":[]}}}

Checklist

• I have read the contribution guidelines
• Pull request provided for main branch, backports managed with label
• Good housekeeping of code, cleaning up comments, tests, and documentation
• Clean commit history broken into understandable chucks, avoiding big commits with hundreds of files, cautious of reformatting and whitespace changes
• Clean commit messages, longer verbose messages are encouraged
• API Changes are identified in commit messages
• Testing provided for features or enhancements using automatic tests
• User documentation provided for new features or enhancements in manual
• Build documentation provided for development instructions in README.md files
• Library management using pom.xml dependency management. Update build documentation with intended library use and library tutorials or documentation

Funded by Service Public de Wallonie

[sonarcloud]

Quality Gate passed

Issues
1 New issue
0 Accepted issues

Measures
0 Security Hotspots
0.0% Coverage on New Code
0.0% Duplication on New Code

See analysis details on SonarCloud

[josegar74]

Tested and the harvester works fine.

The XSLT changes seem fine, although the mapping dataset/metas/dcat/temporal to a keyword is not very clear to me. But I don't know anything about the ODS format.