Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Iqss/6489 - Direct uploads to S3 using presigned URLs #6490

Merged
merged 164 commits into from
Mar 23, 2020
Merged

Iqss/6489 - Direct uploads to S3 using presigned URLs #6490

merged 164 commits into from
Mar 23, 2020

Commits on Oct 16, 2018

  1. typos, fix for empty string

    @qqmyers
    qqmyers committed Oct 16, 2018
    Configuration menu
    Copy the full SHA
    34a2453 View commit details
    Browse the repository at this point in the history

  2. use String return value 

    the JsonObjectBuilders were getting cleared in the build().toString()
used to generate the log message, so the returned value was mostly
empty...
    @qqmyers
    qqmyers committed Oct 16, 2018
    Configuration menu
    Copy the full SHA
    e353ccc View commit details
    Browse the repository at this point in the history

  3. filter custom roles

    @qqmyers
    qqmyers committed Oct 16, 2018
    Configuration menu
    Copy the full SHA
    7a0f302 View commit details
    Browse the repository at this point in the history

Commits on Nov 12, 2018

  1. Don't open input stream when not needed.

    @qqmyers
    qqmyers committed Nov 12, 2018
    Configuration menu
    Copy the full SHA
    2910168 View commit details
    Browse the repository at this point in the history

Commits on Nov 13, 2018

  1. simplify

    @qqmyers
    qqmyers committed Nov 13, 2018
    Configuration menu
    Copy the full SHA
    7ed30fb View commit details
    Browse the repository at this point in the history

  2. add @OverRide

    @qqmyers
    qqmyers committed Nov 13, 2018
    Configuration menu
    Copy the full SHA
    08a0e7e View commit details
    Browse the repository at this point in the history

  3. override getReadChannel as well

    @qqmyers
    qqmyers committed Nov 13, 2018
    Configuration menu
    Copy the full SHA
    e5fed4a View commit details
    Browse the repository at this point in the history

Commits on Dec 21, 2018

  1. Merge tag 'v4.10' into v4.10-tdl

    @qqmyers
    qqmyers committed Dec 21, 2018
    Configuration menu
    Copy the full SHA
    7070e26 View commit details
    Browse the repository at this point in the history

  2. TDL image and release name changes

    @qqmyers
    qqmyers committed Dec 21, 2018
    Configuration menu
    Copy the full SHA
    6ea2524 View commit details
    Browse the repository at this point in the history

  3. text changes

    @qqmyers
    qqmyers committed Dec 21, 2018
    Configuration menu
    Copy the full SHA
    d7571ac View commit details
    Browse the repository at this point in the history

Commits on Dec 26, 2018

  1. TDRDV-46

    @qqmyers
    qqmyers committed Dec 26, 2018
    Configuration menu
    Copy the full SHA
    7998929 View commit details
    Browse the repository at this point in the history

Commits on Dec 28, 2018

  1. TDRDV-46 

    use javascript to scroll within panel after update
    @qqmyers
    qqmyers committed Dec 28, 2018
    Configuration menu
    Copy the full SHA
    247dd32 View commit details
    Browse the repository at this point in the history

Commits on Sep 26, 2019

  1. Merge tag 'v4.16' into v4.16-tdl 

    Conflicts:
	pom.xml
	src/main/java/Bundle.properties
	src/main/java/edu/harvard/iq/dataverse/DataversePage.java
	src/main/webapp/dataverse.xhtml
	src/main/webapp/resources/images/favicondataverse.png
    @qqmyers
    qqmyers committed Sep 26, 2019
    Configuration menu
    Copy the full SHA
    2ddfd84 View commit details
    Browse the repository at this point in the history

  2. TDL custom strings

    @qqmyers
    qqmyers committed Sep 26, 2019
    Configuration menu
    Copy the full SHA
    1f8b528 View commit details
    Browse the repository at this point in the history

Commits on Oct 3, 2019

  1. new fav icons for TDL

    @qqmyers
    qqmyers committed Oct 3, 2019
    Configuration menu
    Copy the full SHA
    19ebd02 View commit details
    Browse the repository at this point in the history

  2. more TDL icons

    @qqmyers
    qqmyers committed Oct 3, 2019
    Configuration menu
    Copy the full SHA
    4e1327a View commit details
    Browse the repository at this point in the history

  3. Merge pull request IQSS#6254 from IQSS/develop 

    v4.17
    @kcondon
    kcondon authored Oct 3, 2019
    Configuration menu
    Copy the full SHA
    51739f6 View commit details
    Browse the repository at this point in the history

Commits on Oct 10, 2019

  1. Merge tag 'v4.17' into v4.17-tdl 

    Conflicts:
	pom.xml
    @qqmyers
    qqmyers committed Oct 10, 2019
    Configuration menu
    Copy the full SHA
    c64481f View commit details
    Browse the repository at this point in the history

Commits on Oct 18, 2019

  1. Merge tag 'v4.17' into v4.17-tdl 

    Conflicts:
	pom.xml
    @qqmyers
    qqmyers committed Oct 18, 2019
    Configuration menu
    Copy the full SHA
    18c7f31 View commit details
    Browse the repository at this point in the history

Commits on Oct 24, 2019

  1. IQSS#6137 make DataCite API URL for MDC configurable

    @qqmyers
    qqmye authored and qqmyers committed Oct 24, 2019
    Configuration menu
    Copy the full SHA
    07e6a0a View commit details
    Browse the repository at this point in the history

  2. doc/install updates for IQSS#6137

    @qqmyers
    qqmye authored and qqmyers committed Oct 24, 2019
    Configuration menu
    Copy the full SHA
    feac172 View commit details
    Browse the repository at this point in the history

  3. cut/paste issue

    @qqmyers
    qqmye authored and qqmyers committed Oct 24, 2019
    Configuration menu
    Copy the full SHA
    3404453 View commit details
    Browse the repository at this point in the history

  4. two commas

    @qqmyers
    qqmyers committed Oct 24, 2019
    Configuration menu
    Copy the full SHA
    47f2ffe View commit details
    Browse the repository at this point in the history

  5. add note in admin guide

    @qqmyers
    qqmyers committed Oct 24, 2019
    Configuration menu
    Copy the full SHA
    a6e657c View commit details
    Browse the repository at this point in the history

  6. consistent naming for jvm option

    @qqmyers
    qqmyers committed Oct 24, 2019
    Configuration menu
    Copy the full SHA
    59519df View commit details
    Browse the repository at this point in the history

  7. add logging of MDC citation get URL and tweak docs IQSS#6137 

    Conflicts:
	doc/sphinx-guides/source/admin/make-data-count.rst
    @pdurbin @qqmyers
    pdurbin authored and qqmyers committed Oct 24, 2019
    Configuration menu
    Copy the full SHA
    4c1a2e2 View commit details
    Browse the repository at this point in the history

  8. separate MDC logging and display 

    Conflicts:
	src/main/java/edu/harvard/iq/dataverse/settings/SettingsServiceBean.java
    @qqmyers
    qqmye authored and qqmyers committed Oct 24, 2019
    Configuration menu
    Copy the full SHA
    e1d953c View commit details
    Browse the repository at this point in the history

  9. Doc updates for :DisplayMDCMetrics

    @qqmyers
    qqmye authored and qqmyers committed Oct 24, 2019
    Configuration menu
    Copy the full SHA
    ad784d7 View commit details
    Browse the repository at this point in the history

  10. use SettingsWrapper per comments

    @qqmyers
    qqmye authored and qqmyers committed Oct 24, 2019
    Configuration menu
    Copy the full SHA
    29c9bac View commit details
    Browse the repository at this point in the history

  11. closed ) in docs

    @djbrooke @qqmyers
    djbrooke authored and qqmyers committed Oct 24, 2019
    Configuration menu
    Copy the full SHA
    bdaa0cc View commit details
    Browse the repository at this point in the history

  12. remove blank line per comment

    @qqmyers
    qqmyers committed Oct 24, 2019
    Configuration menu
    Copy the full SHA
    110cd1c View commit details
    Browse the repository at this point in the history

  13. Merge branch 'develop' of 

    https://github.com/TexasDigitalLibrary/dataverse.git into develop

Conflicts:
	doc/sphinx-guides/source/admin/make-data-count.rst
    @qqmyers
    qqmyers committed Oct 24, 2019
    Configuration menu
    Copy the full SHA
    c7504b1 View commit details
    Browse the repository at this point in the history

  14. Revert "add logging of MDC citation get URL and tweak docs IQSS#6137" 

    This reverts commit 4c1a2e2.
    @qqmyers
    qqmyers committed Oct 24, 2019
    Configuration menu
    Copy the full SHA
    f8dada8 View commit details
    Browse the repository at this point in the history

  15. Revert "consistent naming for jvm option" 

    This reverts commit 59519df.
    @qqmyers
    qqmyers committed Oct 24, 2019
    Configuration menu
    Copy the full SHA
    5fff437 View commit details
    Browse the repository at this point in the history

  16. Revert "add note in admin guide" 

    This reverts commit a6e657c.
    @qqmyers
    qqmyers committed Oct 24, 2019
    Configuration menu
    Copy the full SHA
    77b99f3 View commit details
    Browse the repository at this point in the history

  17. Revert "two commas" 

    This reverts commit 47f2ffe.
    @qqmyers
    qqmyers committed Oct 24, 2019
    Configuration menu
    Copy the full SHA
    750ed11 View commit details
    Browse the repository at this point in the history

  18. Revert "cut/paste issue" 

    This reverts commit 3404453.
    @qqmyers
    qqmyers committed Oct 24, 2019
    Configuration menu
    Copy the full SHA
    88a90fb View commit details
    Browse the repository at this point in the history

  19. Revert "doc/install updates for IQSS#6137" 

    This reverts commit feac172.
    @qqmyers
    qqmyers committed Oct 24, 2019
    Configuration menu
    Copy the full SHA
    92e5160 View commit details
    Browse the repository at this point in the history

  20. Revert "IQSS#6137 make DataCite API URL for MDC configurable" 

    This reverts commit 07e6a0a.
    @qqmyers
    qqmyers committed Oct 24, 2019
    Configuration menu
    Copy the full SHA
    ebff193 View commit details
    Browse the repository at this point in the history

  21. version update to add -dev

    @qqmyers
    qqmyers committed Oct 24, 2019
    Configuration menu
    Copy the full SHA
    d774717 View commit details
    Browse the repository at this point in the history

  22. initial presigned upload uri api

    @qqmyers
    qqmyers committed Oct 24, 2019
    Configuration menu
    Copy the full SHA
    a6600fe View commit details
    Browse the repository at this point in the history

Commits on Oct 25, 2019

  1. adding transfer of file name, mimetype and md5 hash 

    updating upload processing to handle a remote file
currently bypassing all the special processing.
    @qqmyers
    qqmyers committed Oct 25, 2019
    Configuration menu
    Copy the full SHA
    ef9190f View commit details
    Browse the repository at this point in the history

  2. update plugin version

    @qqmyers
    qqmyers committed Oct 25, 2019
    Configuration menu
    Copy the full SHA
    bc96ef7 View commit details
    Browse the repository at this point in the history

Commits on Oct 28, 2019

  1. using profiles to get correct compile flags

    @qqmyers
    qqmyers committed Oct 28, 2019
    Configuration menu
    Copy the full SHA
    95aeea0 View commit details
    Browse the repository at this point in the history

  2. Merge branch 'v4.17-tdl' of 

    https://github.com/TexasDigitalLibrary/dataverse.git into v4.17-tdl

Conflicts:
	pom.xml
    @qqmyers
    qqmyers committed Oct 28, 2019
    Configuration menu
    Copy the full SHA
    6e0c28e View commit details
    Browse the repository at this point in the history

  3. Merge branch 'develop' of https://github.com/TexasDigitalLibrary/data… 

    …verse.git into develop
    @qqmyers
    qqmyers committed Oct 28, 2019
    Configuration menu
    Copy the full SHA
    99c8b25 View commit details
    Browse the repository at this point in the history

  4. Merge branch 'v4.17-tdl' into develop

    @qqmyers
    qqmyers committed Oct 28, 2019
    Configuration menu
    Copy the full SHA
    bf504ab View commit details
    Browse the repository at this point in the history

  5. add nulls for missing params recently added

    @qqmyers
    qqmyers committed Oct 28, 2019
    Configuration menu
    Copy the full SHA
    bddccd7 View commit details
    Browse the repository at this point in the history

Commits on Oct 30, 2019

  1. fix logic, adjust indent

    @qqmyers
    qqmyers committed Oct 30, 2019
    Configuration menu
    Copy the full SHA
    b465234 View commit details
    Browse the repository at this point in the history

Commits on Nov 14, 2019

  1. bugfix, pickup bucket from properties

    @qqmyers
    qqmyers committed Nov 14, 2019
    Configuration menu
    Copy the full SHA
    4095466 View commit details
    Browse the repository at this point in the history

  2. Merge pull request IQSS#6369 from IQSS/develop 

    v4.18
    @kcondon
    kcondon authored Nov 14, 2019
    Configuration menu
    Copy the full SHA
    118aa71 View commit details
    Browse the repository at this point in the history

Commits on Nov 20, 2019

  1. Merge pull request IQSS#6390 from IQSS/develop 

    KC_Merge_4_18_1
    @kcondon
    kcondon authored Nov 20, 2019
    Configuration menu
    Copy the full SHA
    a91d370 View commit details
    Browse the repository at this point in the history

Commits on Nov 26, 2019

  1. Merge tag 'v4.18.1' into v4.18.1-tdl

    @qqmyers
    qqmyers committed Nov 26, 2019
    Configuration menu
    Copy the full SHA
    024e4c8 View commit details
    Browse the repository at this point in the history

  2. Merge remote-tracking branch 'IQSS/develop' into IQSS/6138

    @qqmyers
    qqmyers committed Nov 26, 2019
    Configuration menu
    Copy the full SHA
    606326f View commit details
    Browse the repository at this point in the history

  3. use newer poi

    @qqmyers
    qqmyers committed Nov 26, 2019
    Configuration menu
    Copy the full SHA
    84297e5 View commit details
    Browse the repository at this point in the history

  4. Merge pull request IQSS#6394 from QualitativeDataRepository/IQSS/6389 

    fix for "generating apiTokens can break manual create apiToken interface" IQSS#6389
    @kcondon @qqmyers
    kcondon authored and qqmyers committed Nov 26, 2019
    Configuration menu
    Copy the full SHA
    0bd7e22 View commit details
    Browse the repository at this point in the history

  5. Merge pull request IQSS#6414 from QualitativeDataRepository/IQSS/6411 

    only report MDC for calls on released versions
    @kcondon @qqmyers
    kcondon authored and qqmyers committed Nov 26, 2019
    Configuration menu
    Copy the full SHA
    76242e9 View commit details
    Browse the repository at this point in the history

  6. Handle expired or multiple tokens per user 

    Conflicts:
	src/main/java/edu/harvard/iq/dataverse/authorization/AuthenticationServiceBean.java

Conflicts:
	src/main/java/edu/harvard/iq/dataverse/authorization/AuthenticationServiceBean.java
    @qqmyers
    qqmyers committed Nov 26, 2019
    Configuration menu
    Copy the full SHA
    1ccec27 View commit details
    Browse the repository at this point in the history

Commits on Dec 4, 2019

  1. missing keys

    @qqmyers
    qqmyers committed Dec 4, 2019
    Configuration menu
    Copy the full SHA
    0b8b2a8 View commit details
    Browse the repository at this point in the history

  2. multistore implementation (built on direct upload)

    @qqmyers
    qqmyers committed Dec 4, 2019
    Configuration menu
    Copy the full SHA
    08f6849 View commit details
    Browse the repository at this point in the history

Commits on Dec 5, 2019

  1. enforce permissions on upload url

    @qqmyers
    qqmyers committed Dec 5, 2019
    Configuration menu
    Copy the full SHA
    2d104f6 View commit details
    Browse the repository at this point in the history

  2. enforce permissions on upload url 

    Conflicts:
	src/main/java/edu/harvard/iq/dataverse/api/Datasets.java
    @qqmyers
    qqmyers committed Dec 5, 2019
    Configuration menu
    Copy the full SHA
    83dcec4 View commit details
    Browse the repository at this point in the history

  3. missing keys

    @qqmyers
    qqmyers committed Dec 5, 2019
    Configuration menu
    Copy the full SHA
    5eb7fa8 View commit details
    Browse the repository at this point in the history

  4. error msg fix

    @qqmyers
    qqmyers committed Dec 5, 2019
    Configuration menu
    Copy the full SHA
    c393181 View commit details
    Browse the repository at this point in the history

  5. check if store allows direct upload

    @qqmyers
    qqmyers committed Dec 5, 2019
    Configuration menu
    Copy the full SHA
    6c2e220 View commit details
    Browse the repository at this point in the history

  6. capture file list in js

    @qqmyers
    qqmyers committed Dec 5, 2019
    Configuration menu
    Copy the full SHA
    08ad964 View commit details
    Browse the repository at this point in the history

Commits on Dec 6, 2019

  1. toggle auto upload based on directupload property

    @qqmyers
    qqmyers committed Dec 6, 2019
    Configuration menu
    Copy the full SHA
    43f78ce View commit details
    Browse the repository at this point in the history

Commits on Dec 9, 2019

  1. implement proxying

    @qqmyers
    qqmyers committed Dec 9, 2019
    Configuration menu
    Copy the full SHA
    14e43bd View commit details
    Browse the repository at this point in the history

  2. implement proxy

    @qqmyers
    qqmyers committed Dec 9, 2019
    Configuration menu
    Copy the full SHA
    9c01f28 View commit details
    Browse the repository at this point in the history

  3. further updates to direct upload files

    @qqmyers
    qqmyers committed Dec 9, 2019
    Configuration menu
    Copy the full SHA
    0fe9918 View commit details
    Browse the repository at this point in the history

Commits on Dec 13, 2019

  1. add driver to upload url response

    @qqmyers
    qqmyers committed Dec 13, 2019
    Configuration menu
    Copy the full SHA
    518e2d2 View commit details
    Browse the repository at this point in the history

  2. fix proxy url replacement

    @qqmyers
    qqmyers committed Dec 13, 2019
    Configuration menu
    Copy the full SHA
    076c75a View commit details
    Browse the repository at this point in the history

Commits on Jan 2, 2020

  1. single file, no hash upload via GUI minimally working

    @qqmyers
    qqmyers committed Jan 2, 2020
    Configuration menu
    Copy the full SHA
    2f7102d View commit details
    Browse the repository at this point in the history

  2. send ID without dataset path

    @qqmyers
    qqmyers committed Jan 2, 2020
    Configuration menu
    Copy the full SHA
    d8de35f View commit details
    Browse the repository at this point in the history

  3. add md5

    @qqmyers
    qqmyers committed Jan 2, 2020
    Configuration menu
    Copy the full SHA
    c1db7a5 View commit details
    Browse the repository at this point in the history

  4. bug: switch to calling uploadFinished at oncomplete

    @qqmyers
    qqmyers committed Jan 2, 2020
    Configuration menu
    Copy the full SHA
    707709f View commit details
    Browse the repository at this point in the history

  5. fix exist test for direct access

    @qqmyers
    qqmyers committed Jan 2, 2020
    Configuration menu
    Copy the full SHA
    25c1739 View commit details
    Browse the repository at this point in the history

  6. debug constraint violations

    @qqmyers
    qqmyers committed Jan 2, 2020
    Configuration menu
    Copy the full SHA
    dd1cca0 View commit details
    Browse the repository at this point in the history

  7. typo, clear file list after upload complete

    @qqmyers
    qqmyers committed Jan 2, 2020
    Configuration menu
    Copy the full SHA
    a02980b View commit details
    Browse the repository at this point in the history

  8. use new method

    @qqmyers
    qqmyers committed Jan 2, 2020
    Configuration menu
    Copy the full SHA
    cafcfee View commit details
    Browse the repository at this point in the history

  9. catch empty contentType not just null

    @qqmyers
    qqmyers committed Jan 2, 2020
    Configuration menu
    Copy the full SHA
    8859e1d View commit details
    Browse the repository at this point in the history

  10. List any constraint violations

    @qqmyers
    qqmyers committed Jan 2, 2020
    Configuration menu
    Copy the full SHA
    25da677 View commit details
    Browse the repository at this point in the history

  11. try adding multifile support, fix repeat uploads

    @qqmyers
    qqmyers committed Jan 2, 2020
    Configuration menu
    Copy the full SHA
    e07b2df View commit details
    Browse the repository at this point in the history

  12. just pop for multifile

    @qqmyers
    qqmyers committed Jan 2, 2020
    Configuration menu
    Copy the full SHA
    407ed1c View commit details
    Browse the repository at this point in the history

Commits on Jan 3, 2020

  1. control store via dataverse.storagedriver param 

    manageable by superuser only
    @qqmyers
    qqmyers committed Jan 3, 2020
    Configuration menu
    Copy the full SHA
    36e409f View commit details
    Browse the repository at this point in the history

Commits on Jan 6, 2020

  1. fix temporary(which is also final) file delete for direct upload

    @qqmyers
    qqmyers committed Jan 6, 2020
    Configuration menu
    Copy the full SHA
    0911571 View commit details
    Browse the repository at this point in the history

  2. progress bar styling

    @qqmyers
    qqmyers committed Jan 6, 2020
    Configuration menu
    Copy the full SHA
    150d52e View commit details
    Browse the repository at this point in the history

  3. remove drag/drop message once file(s) are selected in direct upload

    @qqmyers
    qqmyers committed Jan 6, 2020
    Configuration menu
    Copy the full SHA
    92dbb2e View commit details
    Browse the repository at this point in the history

  4. bugfix apply styles to progress element to make it appear

    @qqmyers
    qqmyers committed Jan 6, 2020
    Configuration menu
    Copy the full SHA
    216a7de View commit details
    Browse the repository at this point in the history

  5. bugfix for failing s3 delete

    @qqmyers
    qqmyers committed Jan 6, 2020
    Configuration menu
    Copy the full SHA
    6f56da2 View commit details
    Browse the repository at this point in the history

  6. bugfix - temporarily set datafile owner for location calculation

    @qqmyers
    qqmyers committed Jan 6, 2020
    Configuration menu
    Copy the full SHA
    1895611 View commit details
    Browse the repository at this point in the history

  7. bugfix: use direct storage for delete

    @qqmyers
    qqmyers committed Jan 6, 2020
    Configuration menu
    Copy the full SHA
    ca6b4d4 View commit details
    Browse the repository at this point in the history

Commits on Jan 7, 2020

  1. Merge branch 'multistore' into develop 

    Conflicts:
	src/main/java/edu/harvard/iq/dataverse/api/Datasets.java
    @qqmyers
    qqmyers committed Jan 7, 2020
    Configuration menu
    Copy the full SHA
    db1d985 View commit details
    Browse the repository at this point in the history

  2. Merge remote-tracking branch 'IQSS/develop' into develop

    @qqmyers
    qqmyers committed Jan 7, 2020
    Configuration menu
    Copy the full SHA
    ff1488e View commit details
    Browse the repository at this point in the history

  3. Merge branch 'IQSS/6485' into develop 

    Conflicts:
	src/main/java/edu/harvard/iq/dataverse/dataaccess/DataAccess.java
	src/main/java/edu/harvard/iq/dataverse/dataaccess/S3AccessIO.java
	src/main/java/edu/harvard/iq/dataverse/ingest/IngestServiceBean.java
	src/main/java/edu/harvard/iq/dataverse/util/FileUtil.java
    @qqmyers
    qqmyers committed Jan 7, 2020
    Configuration menu
    Copy the full SHA
    a7829c5 View commit details
    Browse the repository at this point in the history

  4. Merge remote-tracking branch 'IQSS/develop' into develop

    @qqmyers
    qqmyers committed Jan 7, 2020
    Configuration menu
    Copy the full SHA
    e68c23f View commit details
    Browse the repository at this point in the history

  5. cleanup

    @qqmyers
    qqmyers committed Jan 7, 2020
    Configuration menu
    Copy the full SHA
    5d4ce21 View commit details
    Browse the repository at this point in the history

  6. remove tdl customizations

    @qqmyers
    qqmyers committed Jan 7, 2020
    Configuration menu
    Copy the full SHA
    d72bf84 View commit details
    Browse the repository at this point in the history

  7. docs

    @qqmyers
    qqmyers committed Jan 7, 2020
    Configuration menu
    Copy the full SHA
    b9eb0c3 View commit details
    Browse the repository at this point in the history

  8. pom version

    @qqmyers
    qqmyers committed Jan 7, 2020
    Configuration menu
    Copy the full SHA
    f6af668 View commit details
    Browse the repository at this point in the history

Commits on Jan 8, 2020

  1. add tabular and fits metadata processing to direct uploads 

    with size limit
    @qqmyers
    qqmyers committed Jan 8, 2020
    Configuration menu
    Copy the full SHA
    86d7ee6 View commit details
    Browse the repository at this point in the history

  2. docs update

    @qqmyers
    qqmyers committed Jan 8, 2020
    Configuration menu
    Copy the full SHA
    b373a72 View commit details
    Browse the repository at this point in the history

  3. fix tests

    @qqmyers
    qqmyers committed Jan 8, 2020
    Configuration menu
    Copy the full SHA
    93de5ce View commit details
    Browse the repository at this point in the history

  4. test fixes

    @qqmyers
    qqmyers committed Jan 8, 2020
    Configuration menu
    Copy the full SHA
    0cda1d0 View commit details
    Browse the repository at this point in the history

  5. define 'file' store type for default test

    @qqmyers
    qqmyers committed Jan 8, 2020
    Configuration menu
    Copy the full SHA
    14c7134 View commit details
    Browse the repository at this point in the history

Commits on Jan 30, 2020

  1. broken logic for normal upload

    @qqmyers
    qqmyers committed Jan 30, 2020
    Configuration menu
    Copy the full SHA
    d41b27b View commit details
    Browse the repository at this point in the history

  2. fix create mode 

    Need the dataset PID to be assigned to be able to provide a direct S3
URL.
    @qqmyers
    qqmyers committed Jan 30, 2020
    Configuration menu
    Copy the full SHA
    588dec8 View commit details
    Browse the repository at this point in the history

  3. Merge remote-tracking branch 'IQSS/develop' into IQSS/6489 

    Conflicts:
	src/main/java/edu/harvard/iq/dataverse/ingest/IngestServiceBean.java
    @qqmyers
    qqmyers committed Jan 30, 2020
    Configuration menu
    Copy the full SHA
    06f305d View commit details
    Browse the repository at this point in the history

Commits on Jan 31, 2020

  1. Merge branch 'IQSS/6485' into IQSS/6489 

    Conflicts:
	src/main/java/edu/harvard/iq/dataverse/dataaccess/DataAccess.java
	src/main/java/edu/harvard/iq/dataverse/ingest/IngestServiceBean.java
    @qqmyers
    qqmyers committed Jan 31, 2020
    Configuration menu
    Copy the full SHA
    9812ebc View commit details
    Browse the repository at this point in the history

Commits on Feb 5, 2020

  1. Merge branch 'IQSS/6485' into IQSS/6489 

    Conflicts:
	src/main/java/edu/harvard/iq/dataverse/ingest/IngestServiceBean.java
    @qqmyers
    qqmyers committed Feb 5, 2020
    Configuration menu
    Copy the full SHA
    0125133 View commit details
    Browse the repository at this point in the history

Commits on Feb 7, 2020

  1. Merge branch 'IQSS/6485' into IQSS/6489

    @qqmyers
    qqmyers committed Feb 7, 2020
    Configuration menu
    Copy the full SHA
    3e3f82b View commit details
    Browse the repository at this point in the history

Commits on Feb 8, 2020

  1. Merge branch 'IQSS/6485' into IQSS/6489 

    Conflicts:
	src/main/java/edu/harvard/iq/dataverse/ingest/IngestServiceBean.java
    @qqmyers
    qqmyers committed Feb 8, 2020
    Configuration menu
    Copy the full SHA
    f5d63da View commit details
    Browse the repository at this point in the history

Commits on Feb 11, 2020

  1. Merge branch 'IQSS/6485' into IQSS/6489

    @qqmyers
    qqmyers committed Feb 11, 2020
    Configuration menu
    Copy the full SHA
    60c7789 View commit details
    Browse the repository at this point in the history

Commits on Feb 19, 2020

  1. Merge branch 'IQSS/6485' into IQSS/6489

    @qqmyers
    qqmyers committed Feb 19, 2020
    Configuration menu
    Copy the full SHA
    d4f84cb View commit details
    Browse the repository at this point in the history

Commits on Feb 20, 2020

  1. fix merge issue

    @qqmyers
    qqmyers committed Feb 20, 2020
    Configuration menu
    Copy the full SHA
    4b0528b View commit details
    Browse the repository at this point in the history

  2. direct upload release notes

    @qqmyers
    qqmyers committed Feb 20, 2020
    Configuration menu
    Copy the full SHA
    019862b View commit details
    Browse the repository at this point in the history

Commits on Feb 21, 2020

  1. Disallow 'placeholder' storageIO ~clones

    @qqmyers
    qqmyers committed Feb 21, 2020
    Configuration menu
    Copy the full SHA
    ddfeb3e View commit details
    Browse the repository at this point in the history

  2. bug fix for exporting 

    plus some cleanup to let one exporter fail without stopping an overall
loop through all formats.
    @qqmyers
    qqmyers committed Feb 21, 2020
    Configuration menu
    Copy the full SHA
    de4c5d0 View commit details
    Browse the repository at this point in the history

Commits on Feb 24, 2020

  1. typo

    @djbrooke
    djbrooke authored Feb 24, 2020
    Configuration menu
    Copy the full SHA
    2e5009c View commit details
    Browse the repository at this point in the history

Commits on Feb 26, 2020

  1. Merge remote-tracking branch 'IQSS/develop' into IQSS/6489

    @qqmyers
    qqmyers committed Feb 26, 2020
    Configuration menu
    Copy the full SHA
    93d325f View commit details
    Browse the repository at this point in the history

  2. Merge remote-tracking branch 'origin/IQSS/6489' into IQSS/6489

    @qqmyers
    qqmyers committed Feb 26, 2020
    Configuration menu
    Copy the full SHA
    e92cf2a View commit details
    Browse the repository at this point in the history

  3. get the effective storage driver

    @qqmyers
    qqmyers committed Feb 26, 2020
    Configuration menu
    Copy the full SHA
    e6aee06 View commit details
    Browse the repository at this point in the history

  4. Merge remote-tracking branch 'IQSS/develop' into IQSS/6489

    @qqmyers
    qqmyers committed Feb 26, 2020
    Configuration menu
    Copy the full SHA
    cc3a2fd View commit details
    Browse the repository at this point in the history

Commits on Feb 27, 2020

  1. Merge remote-tracking branch 'IQSS/develop' into IQSS/6489 

    Conflicts:
	src/main/java/edu/harvard/iq/dataverse/dataaccess/DataAccess.java
    @qqmyers
    qqmyers committed Feb 27, 2020
    Configuration menu
    Copy the full SHA
    447bd27 View commit details
    Browse the repository at this point in the history

Commits on Mar 2, 2020

  1. don't wrap file

    @qqmyers
    qqmyers committed Mar 2, 2020
    Configuration menu
    Copy the full SHA
    91f4275 View commit details
    Browse the repository at this point in the history

Commits on Mar 3, 2020

  1. give default selection a value 

    Conflicts:
	src/main/webapp/dataverse.xhtml
    @qqmyers
    qqmyers committed Mar 3, 2020
    Configuration menu
    Copy the full SHA
    0052eef View commit details
    Browse the repository at this point in the history

  2. typo

    @qqmyers
    qqmyers committed Mar 3, 2020
    Configuration menu
    Copy the full SHA
    48d176e View commit details
    Browse the repository at this point in the history

  3. use non-null indicator for default 

    for reported dataverse.storageIdentifier value

Also fix fromAncestor logic

Conflicts:
	src/main/java/edu/harvard/iq/dataverse/dataaccess/DataAccess.java
    @qqmyers
    qqmyers committed Mar 3, 2020
    Configuration menu
    Copy the full SHA
    94abdda View commit details
    Browse the repository at this point in the history

  4. using S3 tag for temp files

    @qqmyers
    qqmyers committed Mar 3, 2020
    Configuration menu
    Copy the full SHA
    17936da View commit details
    Browse the repository at this point in the history

  5. ignore tag issues on Minio

    @qqmyers
    qqmyers committed Mar 3, 2020
    Configuration menu
    Copy the full SHA
    34c8ee2 View commit details
    Browse the repository at this point in the history

  6. new progress color

    @qqmyers
    qqmyers committed Mar 3, 2020
    Configuration menu
    Copy the full SHA
    5c721ff View commit details
    Browse the repository at this point in the history

  7. remove obsolete storage default string

    @qqmyers
    qqmyers committed Mar 3, 2020
    Configuration menu
    Copy the full SHA
    2a78a68 View commit details
    Browse the repository at this point in the history

Commits on Mar 4, 2020

  1. remove unused methods and tests of them

    @qqmyers
    qqmyers committed Mar 4, 2020
    Configuration menu
    Copy the full SHA
    66a48ee View commit details
    Browse the repository at this point in the history

  2. make max file size limit per store

    @qqmyers
    qqmyers committed Mar 4, 2020
    Configuration menu
    Copy the full SHA
    560c973 View commit details
    Browse the repository at this point in the history

  3. get max file size after dataset is initialized

    @qqmyers
    qqmyers committed Mar 4, 2020
    Configuration menu
    Copy the full SHA
    84f57a3 View commit details
    Browse the repository at this point in the history

  4. remove systemconfig default methods

    @qqmyers
    qqmyers committed Mar 4, 2020
    Configuration menu
    Copy the full SHA
    500094f View commit details
    Browse the repository at this point in the history

  5. Merge remote-tracking branch 'IQSS/develop' into IQSS/6489

    @qqmyers
    qqmyers committed Mar 4, 2020
    Configuration menu
    Copy the full SHA
    e7d8d60 View commit details
    Browse the repository at this point in the history

  6. restore test fix

    @qqmyers
    qqmyers committed Mar 4, 2020
    Configuration menu
    Copy the full SHA
    9113612 View commit details
    Browse the repository at this point in the history

  7. document per store file upload size limits

    @qqmyers
    qqmyers committed Mar 4, 2020
    Configuration menu
    Copy the full SHA
    d3c2539 View commit details
    Browse the repository at this point in the history

  8. doc of new features

    @qqmyers
    qqmyers committed Mar 4, 2020
    Configuration menu
    Copy the full SHA
    abbebd8 View commit details
    Browse the repository at this point in the history

Commits on Mar 5, 2020

  1. avoid resetting mimetype for normal upload

    @qqmyers
    qqmyers committed Mar 5, 2020
    Configuration menu
    Copy the full SHA
    5cd8744 View commit details
    Browse the repository at this point in the history

Commits on Mar 6, 2020

  1. Update 6489-release-notes.md

    @kcondon
    kcondon authored Mar 6, 2020
    Configuration menu
    Copy the full SHA
    d600593 View commit details
    Browse the repository at this point in the history

  2. Update 6489-release-notes.md

    @kcondon
    kcondon authored Mar 6, 2020
    Configuration menu
    Copy the full SHA
    0f4b5f0 View commit details
    Browse the repository at this point in the history

  3. initialize storageDriver to null 

    affects root dataverse
also checking isBlank on storagedriver rather than ==null as backward
compatibility for devs.
    @qqmyers
    qqmyers committed Mar 6, 2020
    Configuration menu
    Copy the full SHA
    e235d8c View commit details
    Browse the repository at this point in the history

  4. set alreadyExists(DVObject) false to allow direct upload 

    during create mode with directupload, this will get called, and true
would cause a failure
    @qqmyers
    qqmyers committed Mar 6, 2020
    Configuration menu
    Copy the full SHA
    a8c8e00 View commit details
    Browse the repository at this point in the history

  5. Merge remote-tracking branch 'IQSS/develop' into IQSS/6489

    @qqmyers
    qqmyers committed Mar 6, 2020
    Configuration menu
    Copy the full SHA
    a5dbdf2 View commit details
    Browse the repository at this point in the history

  6. Merge remote-tracking branch 'origin/IQSS/6489' into IQSS/6489

    @qqmyers
    qqmyers committed Mar 6, 2020
    Configuration menu
    Copy the full SHA
    aca7fa5 View commit details
    Browse the repository at this point in the history

  7. remove debug logging

    @qqmyers
    qqmyers committed Mar 6, 2020
    Configuration menu
    Copy the full SHA
    5584adc View commit details
    Browse the repository at this point in the history

Commits on Mar 12, 2020

  1. retry to give S3 time to 'index' new objects 

    eventual consistency...
    @qqmyers
    qqmyers committed Mar 12, 2020
    Configuration menu
    Copy the full SHA
    00c62d2 View commit details
    Browse the repository at this point in the history

Commits on Mar 13, 2020

  1. cors configuration example 

    Added an example of an S3 bucket CORS configuration. Mostly to emphasize that it is required.
    @landreev
    landreev authored Mar 13, 2020
    Configuration menu
    Copy the full SHA
    2d28a71 View commit details
    Browse the repository at this point in the history

  2. fix duplicate id issue with direct upload

    @qqmyers
    qqmyers committed Mar 13, 2020
    Configuration menu
    Copy the full SHA
    ab4f6c9 View commit details
    Browse the repository at this point in the history

  3. Merge remote-tracking branch 'origin/IQSS/6489' into IQSS/6489

    @qqmyers
    qqmyers committed Mar 13, 2020
    Configuration menu
    Copy the full SHA
    187797f View commit details
    Browse the repository at this point in the history

  4. Merge remote-tracking branch 'IQSS/develop' into IQSS/6489

    @qqmyers
    qqmyers committed Mar 13, 2020
    Configuration menu
    Copy the full SHA
    55abdab View commit details
    Browse the repository at this point in the history

Commits on Mar 18, 2020

  1. update script with version changes (per discussion)

    @qqmyers
    qqmyers committed Mar 18, 2020
    Configuration menu
    Copy the full SHA
    b1221c1 View commit details
    Browse the repository at this point in the history

  2. limit parallel requests (to 4 at the moment)

    @qqmyers
    qqmyers committed Mar 18, 2020
    Configuration menu
    Copy the full SHA
    be03ead View commit details
    Browse the repository at this point in the history

Commits on Mar 19, 2020

  1. handle progress bars, avoid calling AllUploadsFinished more than once

    @qqmyers
    qqmyers committed Mar 19, 2020
    Configuration menu
    Copy the full SHA
    c2cf275 View commit details
    Browse the repository at this point in the history

  2. Add support for drag and drop

    @qqmyers
    qqmyers committed Mar 19, 2020
    Configuration menu
    Copy the full SHA
    df5ec27 View commit details
    Browse the repository at this point in the history

Commits on Mar 20, 2020

  1. cut/paste error and adding an error handler

    @qqmyers
    qqmyers committed Mar 20, 2020
    Configuration menu
    Copy the full SHA
    f358295 View commit details
    Browse the repository at this point in the history

  2. more error handling

    @qqmyers
    qqmyers committed Mar 20, 2020
    Configuration menu
    Copy the full SHA
    3226d43 View commit details
    Browse the repository at this point in the history

  3. increasing retries and adding logging for testing

    @qqmyers
    qqmyers committed Mar 20, 2020
    Configuration menu
    Copy the full SHA
    9668c5f View commit details
    Browse the repository at this point in the history

  4. add error handling and pre/post S3 logging

    @qqmyers
    qqmyers committed Mar 20, 2020
    Configuration menu
    Copy the full SHA
    21f7361 View commit details
    Browse the repository at this point in the history

  5. tighten up on async issues 

    create local vars from global ones so that value isn't changed by
another async callback before we use it.
    @qqmyers
    qqmyers committed Mar 20, 2020
    Configuration menu
    Copy the full SHA
    a15b83d View commit details
    Browse the repository at this point in the history

  6. remove debug log message

    @qqmyers
    qqmyers committed Mar 20, 2020
    Configuration menu
    Copy the full SHA
    3a9e811 View commit details
    Browse the repository at this point in the history

Commits on Mar 23, 2020

  1. only warn if a retry occurred

    @qqmyers
    qqmyers committed Mar 23, 2020
    Configuration menu
    Copy the full SHA
    29ac854 View commit details
    Browse the repository at this point in the history