v0.8
What's Changed
- Improve resolve speed and prevent hitting re3data.org servers by @J535D165 in #52
- Add extensible support for handle systems and metadata by @J535D165 in #56
- Auto unzip option #53 by @davetromp in #55
- Fix datahugger errors for CrossRef DOIs by @J535D165 in #58
New Contributors
- @davetromp made their first contribution in #55
Full Changelog: v0.7...v0.8
Coverage report
The following benchmark was applied to 500 randomly selected records from Datacite.
Percentages
Percentage of datasets supported: 22.4%
Percentage of datasets not supported: 60.6%
Percentage of datasets with error: 17.0%
Table with unexpected errors
| id | type | url | service | error | |
|---|---|---|---|---|---|
| 7 | 10.60516/au6956100 | dois | https://pid.geoscience.gov.au/sample/AU6956100 | nan | 'unknown' |
| 9 | 10.48448/kgfs-s492 | dois | https://underline.io/lecture/50210-findings-thai-nested-named-entity-recognition-corpus | nan | 500 Server Error: Internal Server Error for url: https://underline.io/lecture/50210-findings-thai-nested-named-entity-recognition-corpus |
| 12 | 10.26197/ala.f34c149a-4578-47c5-83fc-52ba63e37cad | dois | https://doi.ala.org.au/doi/f34c149a-4578-47c5-83fc-52ba63e37cad | nan | 'other' |
| 13 | 10.60494/4013-gm34 | dois | https://pid.geoscience.gov.au/sample/AU9420041 | nan | 'unknown' |
| 18 | 10.60516/au4510089 | dois | https://pid.geoscience.gov.au/sample/AU4510089 | nan | 'unknown' |
| 20 | 10.60516/au4857683 | dois | https://pid.geoscience.gov.au/sample/AU4857683 | nan | 'unknown' |
| 52 | 10.18730/v7c2= | dois | https://glis.fao.org/glis/doi/10.18730/V7C2= | nan | '10.18730/v7c2=' is not a correct resource identifier (e.g. a URL, DOI, Handle) |
| 53 | 10.60494/ksh4-h631 | dois | https://pid.geoscience.gov.au/sample/AU8303563 | nan | 'unknown' |
| 55 | 10.13145/bacdive5076.20230509.8 | dois | https://bacdive.dsmz.de/index.php?site=pdf_view&id=5076&doi=doi:10.13145/bacdive5076.20230509.8 | nan | 'unknown' |
| 57 | 10.60516/au1215414 | dois | https://pid.geoscience.gov.au/sample/AU1215414 | nan | 'unknown' |
| 68 | 10.1594/pangaea.318586 | dois | https://doi.pangaea.de/10.1594/PANGAEA.318586 | nan | 'other' |
| 73 | 10.20345/digitue.1029.61 | dois | http://idb.ub.uni-tuebingen.de/opendigi/litrdsch_1902#p=141 | nan | 500 Server Error: Internal Server Error for url: https://idb.ub.uni-tuebingen.de/opendigi/litrdsch_1902#p=141 |
| 75 | 10.60516/au5331689 | dois | https://pid.geoscience.gov.au/sample/AU5331689 | nan | 'unknown' |
| 81 | 10.7916/d8-qcx3-yp94 | dois | https://dlc.library.columbia.edu/resolve/10.7916/d8-qcx3-yp94 | nan | 500 Server Error: Internal Server Error for url: https://dlc.library.columbia.edu/catalog/10.7916/d8-qcx3-yp94 |
| 84 | 10.60494/azah-y520 | dois | https://pid.geoscience.gov.au/sample/AU9449409 | nan | 'unknown' |
| 85 | 10.60516/au6810190 | dois | https://pid.geoscience.gov.au/sample/AU6810190 | nan | 'unknown' |
| 92 | 10.60516/au2514496 | dois | https://pid.geoscience.gov.au/sample/AU2514496 | nan | 'unknown' |
| 96 | 10.17876/plate/dr.2/plates/201_33742 | dois | https://www.plate-archive.org/objects/dr.2/plates/201_33742 | nan | 500 Server Error: Internal Server Error for url: https://www.plate-archive.org/objects/dr.2/plates/201_33742/ |
| 105 | 10.1594/pangaea.887329 | dois | https://doi.pangaea.de/10.1594/PANGAEA.887329 | nan | 'other' |
| 114 | 10.5883/bold:aai9740 | dois | http://www.boldsystems.org/index.php/Public_BarcodeCluster?clusterguid=BOLD:AAI9740 | nan | 'unknown' |
| 155 | 10.1594/pangaea.857760 | dois | https://doi.pangaea.de/10.1594/PANGAEA.857760 | nan | 'other' |
| 157 | 10.60516/au5932991 | dois | https://pid.geoscience.gov.au/sample/AU5932991 | nan | 'unknown' |
| 164 | 10.13145/bacdive117785.20201210.5 | dois | https://bacdive.dsmz.de/index.php?site=pdf_view&id=117785&doi=doi:10.13145/bacdive117785.20201210.5 | nan | 'unknown' |
| 166 | 10.60516/au7650397 | dois | https://pid.geoscience.gov.au/sample/AU7650397 | nan | 'unknown' |
| 173 | 10.60516/au6574128 | dois | https://pid.geoscience.gov.au/sample/AU6574128 | nan | 'unknown' |
| 175 | 10.13145/bacdive155893.20201210.5 | dois | https://bacdive.dsmz.de/index.php?site=pdf_view&id=155893&doi=doi:10.13145/bacdive155893.20201210.5 | nan | 'unknown' |
| 176 | 10.60516/au1083122 | dois | https://pid.geoscience.gov.au/sample/AU1083122 | nan | 'unknown' |
| 177 | 10.1594/pangaea.883932 | dois | https://doi.pangaea.de/10.1594/PANGAEA.883932 | nan | 'other' |
| 180 | 10.60516/au6270094 | dois | https://pid.geoscience.gov.au/sample/AU6270094 | nan | 'unknown' |
| 181 | 10.60516/au6875833 | dois | https://pid.geoscience.gov.au/sample/AU6875833 | nan | 'unknown' |
| 187 | 10.5284/1084027 | dois | http://archaeologydataservice.ac.uk/archives/view/greylit/details.cfm?id=69278 | nan | 'other' |
| 194 | 10.60516/au6409783 | dois | https://pid.geoscience.gov.au/sample/AU6409783 | nan | 'unknown' |
| 200 | 10.23725/akhp-6959 | dois | https://ors.datacite.org/doi:/10.23725/akhp-6959 | nan | HTTPSConnectionPool(host='ors.datacite.org', port=443): Max retries exceeded with url: /doi:/10.23725/akhp-6959 (Caused by NameResolutionError("<urllib3.connection.HTTPSConnection object at 0x7f53936f1350>: Failed to resolve 'ors.datacite.org' ([Errno -2] Name or service not known)")) |
| 215 | 10.60516/au7418578 | dois | https://pid.geoscience.gov.au/sample/AU7418578 | nan | 'unknown' |
| 220 | 10.60510/awfwi01197 | dois | https://dataservices.gfz-potsdam.de/igsn/awi/index.php?igsn=AWFWI01197 | nan | 'other' |
| 227 | 10.13145/bacdive148698.20191129.4.1 | dois | https://bacdive.dsmz.de/index.php?site=pdf_view&id=148698&doi=doi:10.13145/bacdive148698.20191129.4.1 | nan | 'unknown' |
| 237 | 10.13145/bacdive163219.20221219.7.1 | dois | https://bacdive.dsmz.de/index.php?site=pdf_view&id=163219&doi=doi:10.13145/bacdive163219.20221219.7.1 | nan | 'unknown' |
| 241 | 10.60516/au2220918 | dois | https://pid.geoscience.gov.au/sample/AU2220918 | nan | 'unknown' |
| 244 | 10.60516/au5793649 | dois | https://pid.geoscience.gov.au/sample/AU5793649 | nan | 'unknown' |
| 245 | 10.60494/3vjm-ya78 | dois | https://pid.geoscience.gov.au/sample/AU8682676 | nan | 'unknown' |
| 246 | 10.60494/rfad-eb36 | dois | https://pid.geoscience.gov.au/sample/AU8512891 | nan | 'unknown' |
| 252 | 10.14469/ch/129258 | dois | https://spectradspace.lib.imperial.ac.uk:8443/dspace/handle/10042/134211 | nan | HTTPSConnectionPool(host='spectradspace.lib.imperial.ac.uk', port=8443): Max retries exceeded with url: /dspace/handle/10042/134211 (Caused by SSLError(SSLError(1, '[SSL: SSLV3_ALERT_HANDSHAKE_FAILURE] sslv3 alert handshake failure (_ssl.c:1006)'))) |
| 253 | 10.60516/au5843197 | dois | https://pid.geoscience.gov.au/sample/AU5843197 | nan | 'unknown' |
| 254 | 10.60494/5emh-6x61 | dois | https://pid.geoscience.gov.au/sample/AU9406895 | nan | 'unknown' |
| 258 | 10.14469/ch/41814 | dois | https://spectradspace.lib.imperial.ac.uk:8443/dspace/handle/10042/48213 | nan | HTTPSConnectionPool(host='spectradspace.lib.imperial.ac.uk', port=8443): Max retries exceeded with url: /dspace/handle/10042/48213 (Caused by SSLError(SSLError(1, '[SSL: SSLV3_ALERT_HANDSHAKE_FAILURE] sslv3 alert handshake failure (_ssl.c:1006)'))) |
| 265 | 10.60516/au913451 | dois | https://pid.geoscience.gov.au/sample/AU913451 | nan | 'unknown' |
| 267 | 10.60494/6kby-at17 | dois | https://pid.geoscience.gov.au/sample/AU9117423 | nan | 'unknown' |
| 278 | 10.60516/au5584202 | dois | https://pid.geoscience.gov.au/sample/AU5584202 | nan | 'unknown' |
| 279 | 10.60516/au6134099 | dois | https://pid.geoscience.gov.au/sample/AU6134099 | nan | 'unknown' |
| 283 | 10.18730/12n7m$ | dois | https://glis.fao.org/glis/doi/10.18730/12N7M$ | nan | '10.18730/12n7m$' is not a correct resource identifier (e.g. a URL, DOI, Handle) |
| 284 | 10.60494/f3dg-ae55 | dois | https://pid.geoscience.gov.au/sample/AU9173890 | nan | 'unknown' |
| 285 | 10.60494/pra7-0w90 | dois | https://pid.geoscience.gov.au/sample/AU8631669 | nan | 'unknown' |
| 293 | 10.26197/5d6b7ab05d3f1 | dois | https://doi.ala.org.au/doi/5387cf92-bb54-4582-abed-0eb5b200f4e6 | nan | 'other' |
| 295 | 10.17182/hepdata.31726.v1/t5 | dois | https://www.hepdata.net/record/31746 | nan | 'other' |
| 296 | 10.14457/cmu.the.2009.132 | dois | http://doi.nrct.go.th/?page=resolve_doi&resolve_doi=10.14457/CMU.the.2009.132 | nan | HTTPSConnectionPool(host='doi.nrct.go.th', port=443): Read timed out. (read timeout=10) |
| 298 | 10.60516/au5917525 | dois | https://pid.geoscience.gov.au/sample/AU5917525 | nan | 'unknown' |
| 304 | 10.60494/159q-ny03 | dois | https://pid.geoscience.gov.au/sample/AU9563288 | nan | 'unknown' |
| 312 | 10.60494/5yvg-7595 | dois | https://pid.geoscience.gov.au/sample/AU8523302 | nan | 'unknown' |
| 313 | 10.60494/0np6-vp91 | dois | https://pid.geoscience.gov.au/sample/AU8947552 | nan | 'unknown' |
| 316 | 10.14469/ch/90617 | dois | https://spectradspace.lib.imperial.ac.uk:8443/dspace/handle/10042/97675 | nan | HTTPSConnectionPool(host='spectradspace.lib.imperial.ac.uk', port=8443): Max retries exceeded with url: /dspace/handle/10042/97675 (Caused by SSLError(SSLError(1, '[SSL: SSLV3_ALERT_HANDSHAKE_FAILURE] sslv3 alert handshake failure (_ssl.c:1006)'))) |
| 321 | 10.14456/apsr.2022.3 | dois | http://doi.nrct.go.th/?page=resolve_doi&resolve_doi=10.14456/apsr.2022.3 | nan | HTTPSConnectionPool(host='doi.nrct.go.th', port=443): Read timed out. (read timeout=10) |
| 331 | 10.60516/au454276 | dois | https://pid.geoscience.gov.au/sample/AU454276 | nan | 'unknown' |
| 345 | 10.60516/au7503595 | dois | https://pid.geoscience.gov.au/sample/AU7503595 | nan | 'unknown' |
| 357 | 10.60516/au4537408 | dois | https://pid.geoscience.gov.au/sample/AU4537408 | nan | 'unknown' |
| 362 | 10.60516/au1488156 | dois | https://pid.geoscience.gov.au/sample/AU1488156 | nan | 'unknown' |
| 364 | 10.13145/bacdive4260.20170425.1 | dois | http://bacdive.dsmz.de/index.php?site=pdf_view&id=4260&doi=doi:10.13145/bacdive4260.20170425.1 | nan | 'unknown' |
| 371 | 10.60516/au2286817 | dois | https://pid.geoscience.gov.au/sample/AU2286817 | nan | 'unknown' |
| 380 | 10.60516/au1516563 | dois | https://pid.geoscience.gov.au/sample/AU1516563 | nan | 'unknown' |
| 391 | 10.6084/m9.figshare.c.4949373.v1 | dois | https://springernature.figshare.com/collections/Effectiveness_and_cost-effectiveness_of_stratified_blended_physiotherapy_in_patients_with_non-specific_low_back_pain_study_protocol_of_a_cluster_randomized_controlled_trial/4949373/1 | nan | 'other' |
| 394 | 10.5287/bodleianjpcy.2 | dois | https://databank.ora.ox.ac.uk/ww1archives/datasets/ww1-3945?version=2 | nan | HTTPSConnectionPool(host='databank.ora.ox.ac.uk', port=443): Max retries exceeded with url: /ww1archives/datasets/ww1-3945?version=2 (Caused by ConnectTimeoutError(<urllib3.connection.HTTPSConnection object at 0x7f53933ae210>, 'Connection to databank.ora.ox.ac.uk timed out. (connect timeout=3)')) |
| 395 | 10.60516/au5711353 | dois | https://pid.geoscience.gov.au/sample/AU5711353 | nan | 'unknown' |
| 397 | 10.6084/m9.figshare.c.5098016 | dois | https://springernature.figshare.com/collections/CORE-OM_as_a_routine_outcome_measure_for_adolescents_with_emotional_disorders_factor_structure_and_psychometric_properties/5098016 | nan | 'other' |
| 401 | 10.60516/au6358772 | dois | https://pid.geoscience.gov.au/sample/AU6358772 | nan | 'unknown' |
| 407 | 10.60516/au2201831 | dois | https://pid.geoscience.gov.au/sample/AU2201831 | nan | 'unknown' |
| 431 | 10.60516/au7016001 | dois | https://pid.geoscience.gov.au/sample/AU7016001 | nan | 'unknown' |
| 444 | 10.7270/q2xg9rp9 | dois | https://www.bindingdb.org/entry/50035335 | nan | 'other' |
| 446 | 10.60516/au1175633 | dois | https://pid.geoscience.gov.au/sample/AU1175633 | nan | 'unknown' |
| 452 | 10.60516/au5927949 | dois | https://pid.geoscience.gov.au/sample/AU5927949 | nan | 'unknown' |
| 453 | 10.60494/sc8d-vx44 | dois | https://pid.geoscience.gov.au/sample/AU8444049 | nan | 'unknown' |
| 466 | 10.60516/au5564299 | dois | https://pid.geoscience.gov.au/sample/AU5564299 | nan | 'unknown' |
| 474 | 10.1594/pangaea.823423 | dois | https://doi.pangaea.de/10.1594/PANGAEA.823423 | nan | 'other' |
| 475 | 10.60516/au5660712 | dois | https://pid.geoscience.gov.au/sample/AU5660712 | nan | 'unknown' |
| 486 | 10.60516/au5937070 | dois | https://pid.geoscience.gov.au/sample/AU5937070 | nan | 'unknown' |
| 493 | 10.7916/d8-47rs-s759 | dois | https://dlc.library.columbia.edu/resolve/10.7916/d8-47rs-s759 | nan | 500 Server Error: Internal Server Error for url: https://dlc.library.columbia.edu/catalog/10.7916/d8-47rs-s759 |
| 495 | 10.60516/au6607568 | dois | https://pid.geoscience.gov.au/sample/AU6607568 | nan | 'unknown' |
Contributors
davetromp and J535D165