Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Update 2.x with latest commits on main #1070

Merged
merged 30 commits into from
Oct 5, 2023

Conversation

derek-ho
Copy link
Collaborator

@derek-ho derek-ho commented Oct 4, 2023

Description

[Describe what this change achieves]

Issues Resolved

[List any issues this PR will resolve]

Check List

  • New functionality includes testing.
    • All tests pass, including unit test, integration test and doctest
  • New functionality has been documented.
    • New functionality has javadoc added
    • New functionality has user manual doc added
  • Commits are signed per the DCO using --signoff

By submitting this pull request, I confirm that my contribution is made under the terms of the Apache 2.0 license.
For more information on following Developer Certificate of Origin and signing off your commits, please check here.

Swiddis and others added 16 commits October 4, 2023 18:42
* Update mocha

Signed-off-by: Simeon Widdis <[email protected]>

* Update mocha to 10.2.0

Signed-off-by: Simeon Widdis <[email protected]>

* Revert mocha to 10.1.0 for OSD compat.

Signed-off-by: Simeon Widdis <[email protected]>

* Remove random added yaml dep

Signed-off-by: Simeon Widdis <[email protected]>

---------

Signed-off-by: Simeon Widdis <[email protected]>
Signed-off-by: Derek Ho <[email protected]>
opensearch-project#928)

* added code for the change of design of the sidebar, fixed overriding spinner bug, changed font size

Signed-off-by: sumukhswamy <[email protected]>

* addressed PR comments

Signed-off-by: sumukhswamy <[email protected]>

* code for overriding pattern

Signed-off-by: sumukhswamy <[email protected]>

* updated snapshots

Signed-off-by: sumukhswamy <[email protected]>

---------

Signed-off-by: sumukhswamy <[email protected]>
* remove unused files

Signed-off-by: Eric Wei <[email protected]>

* missing snapshots

Signed-off-by: Eric Wei <[email protected]>

* minimal changes to remove log explorer tab

Signed-off-by: Eric <[email protected]>

* skip tab related tests

Signed-off-by: Eric <[email protected]>

* update snapshots

Signed-off-by: Eric <[email protected]>

* remove missed logging

Signed-off-by: Eric <[email protected]>

* add path to constant

Signed-off-by: Eric <[email protected]>

---------

Signed-off-by: Eric Wei <[email protected]>
Signed-off-by: Eric <[email protected]>
* horizontal to vertical hits/timechart
* Added timespan to the header
* Color and y-axis name change

---------

Signed-off-by: Paul Sebastian <[email protected]>
Signed-off-by: Simeon Widdis <[email protected]>
Signed-off-by: Derek Ho <[email protected]>
* Empty bucket addition proof of concept

Signed-off-by: Paul Sebastian <[email protected]>

* Use the page's interval period for empty buckets

Signed-off-by: Paul Sebastian <[email protected]>

* redid empty bucket loop design to be more intuitive

Signed-off-by: Paul Sebastian <[email protected]>

* Added dynamic start and end datetime info to new count distribution

Signed-off-by: Paul Sebastian <[email protected]>

* use interval period to align count distribution rebucketing

Signed-off-by: Paul Sebastian <[email protected]>

* count distribution snapshot
Signed-off-by: Paul Sebastian <[email protected]>

* moved empty bucket adding functionality out to a util file and generalized

Signed-off-by: Paul Sebastian <[email protected]>

* util func tests

Signed-off-by: Paul Sebastian <[email protected]>

* added stricter types for input and return in util func

Signed-off-by: Paul Sebastian <[email protected]>

* needed to update util test

Signed-off-by: Paul Sebastian <[email protected]>

---------

Signed-off-by: Paul Sebastian <[email protected]>
* refactored classnames for sidebar
---------

Signed-off-by: sumukhswamy <[email protected]>
…1009)

* Stub catalog reader interface

Signed-off-by: Simeon Widdis <[email protected]>

* Add basic catalog functionality to new catalog reader

Signed-off-by: Simeon Widdis <[email protected]>

* Refactor validation logic with a deeper interface

Signed-off-by: Simeon Widdis <[email protected]>

* Refactor validation logic with a deeper interface

Signed-off-by: Simeon Widdis <[email protected]>

* Remove redundant test.

This test is unneeded after 12c4bcf

Signed-off-by: Simeon Widdis <[email protected]>

* Add tests for new validators

Signed-off-by: Simeon Widdis <[email protected]>

* Make better failure mode for invalid objects

Signed-off-by: Simeon Widdis <[email protected]>

* Generalize Result type

Signed-off-by: Simeon Widdis <[email protected]>

* Convert backend to use catalog reader (unstable)

Signed-off-by: Simeon Widdis <[email protected]>

* Repair tests for integrations class (unstable)

Signed-off-by: Simeon Widdis <[email protected]>

* Refactor repository for new integration interface

Signed-off-by: Simeon Widdis <[email protected]>

* Fix outer repository and backend tests

Signed-off-by: Simeon Widdis <[email protected]>

* Add tests for sample data

Signed-off-by: Simeon Widdis <[email protected]>

* Add CatalogReader JavaDocs

Signed-off-by: Simeon Widdis <[email protected]>

* Repair integrations builder

Signed-off-by: Simeon Widdis <[email protected]>

* Remove extra commented test

Signed-off-by: Simeon Widdis <[email protected]>

* Remove unnecessary log statement

Signed-off-by: Simeon Widdis <[email protected]>

* Repair getSchemas behavior to return correct type

Let it be known at on this day, with this commit,
I have truly grokked why we don't use `any` in typescript.

Signed-off-by: Simeon Widdis <[email protected]>

* Add tests for getSchemas

Signed-off-by: Simeon Widdis <[email protected]>

* Add tests for asset and sample data backend methods

Signed-off-by: Simeon Widdis <[email protected]>

* Break flyout validation methods out of constructing method

Signed-off-by: Simeon Widdis <[email protected]>

* Add tests for extracted flyout methods

Signed-off-by: Simeon Widdis <[email protected]>

* Switch validation method to use ValidationResult

Signed-off-by: Simeon Widdis <[email protected]>

* Swap out flyout for hello-world setup page

Signed-off-by: Simeon Widdis <[email protected]>

* Add basic step incrementing

Signed-off-by: Simeon Widdis <[email protected]>

* Add basic field skeleton for each step

Signed-off-by: Simeon Widdis <[email protected]>

* Add a cancel button

Signed-off-by: Simeon Widdis <[email protected]>

* Add config type to developing form

Signed-off-by: Simeon Widdis <[email protected]>

* Flatten integration config

Signed-off-by: Simeon Widdis <[email protected]>

* Add sample data table modal

Signed-off-by: Simeon Widdis <[email protected]>

* Add toggle for standard and advanced asset config

Signed-off-by: Simeon Widdis <[email protected]>

* Simplify imports

Signed-off-by: Simeon Widdis <[email protected]>

* Refactor major class names

Signed-off-by: Simeon Widdis <[email protected]>

* (WIP) begin refactoring functionality into adaptor

Signed-off-by: Simeon Widdis <[email protected]>

* Finish migrating functionality to data adaptor

Signed-off-by: Simeon Widdis <[email protected]>

* Rename integration types for more clarity

Signed-off-by: Simeon Widdis <[email protected]>

* Refactor component usage

Signed-off-by: Simeon Widdis <[email protected]>

* Connect forms to config state

Signed-off-by: Simeon Widdis <[email protected]>

* Fix filetype selector

Signed-off-by: Simeon Widdis <[email protected]>

* Remove hardcoded name in path

Signed-off-by: Simeon Widdis <[email protected]>

* Write one snapshot test

Signed-off-by: Simeon Widdis <[email protected]>

* Add more tests

Signed-off-by: Simeon Widdis <[email protected]>

* Fix test naming

Signed-off-by: Simeon Widdis <[email protected]>

* Update obsolete snapshots

Signed-off-by: Simeon Widdis <[email protected]>

---------

Signed-off-by: Simeon Widdis <[email protected]>
…roject#1035)

* Manage datasources (opensearch-project#967)

* fix name change bug and modify test to test behavior

Signed-off-by: Derek Ho <[email protected]>

* get rid of lint

Signed-off-by: Derek Ho <[email protected]>

* test for flyout

Signed-off-by: Derek Ho <[email protected]>

* flyout to medium size

Signed-off-by: Derek Ho <[email protected]>

* make accelerate extensible

Signed-off-by: Derek Ho <[email protected]>

* get datasources and hook up to pplservice

Signed-off-by: Derek Ho <[email protected]>

* get flint working

Signed-off-by: Derek Ho <[email protected]>

* add datasource page with steps and buttons on bottom bar

Signed-off-by: Derek Ho <[email protected]>

* datasources as a new plugin and mostly working

Signed-off-by: Derek Ho <[email protected]>

* hook up manage to show datasources call

Signed-off-by: Derek Ho <[email protected]>

* update two tables with descriptions

Signed-off-by: Derek Ho <[email protected]>

* make some updates to the page

Signed-off-by: Derek Ho <[email protected]>

* cleanup unused files for data connections

Signed-off-by: Derek Ho <[email protected]>

* cleanup and add overview panel columns

Signed-off-by: Derek Ho <[email protected]>

* render tabs

Signed-off-by: Derek Ho <[email protected]>

* add unit tests

Signed-off-by: Derek Ho <[email protected]>

* update data test subj and snapshot

Signed-off-by: Derek Ho <[email protected]>

* Add datasources to management overview

Signed-off-by: Derek Ho <[email protected]>

* remove spark logo and update snapshot

Signed-off-by: Derek Ho <[email protected]>

* refactor routes out

Signed-off-by: Derek Ho <[email protected]>

* separate out the roles

Signed-off-by: Derek Ho <[email protected]>

* bump version back to 3.0

Signed-off-by: Derek Ho <[email protected]>

---------

Signed-off-by: Derek Ho <[email protected]>

* Add acceleration management UI  (opensearch-project#989)

* add acceleration management UI skeleton

Signed-off-by: Shenoy Pratik <[email protected]>

* Create new documentation link for acc

Signed-off-by: Shenoy Pratik <[email protected]>

* fix typos and minor bugs

Signed-off-by: Shenoy Pratik <[email protected]>

* update snapshot

Signed-off-by: Shenoy Pratik <[email protected]>

* update window location to hash

Signed-off-by: Shenoy Pratik <[email protected]>

* remove unused headers

Signed-off-by: Shenoy Pratik <[email protected]>

---------

Signed-off-by: Shenoy Pratik <[email protected]>

* Rename data sources to data connections (opensearch-project#1004)

* rename data sources to data connections

Signed-off-by: Derek Ho <[email protected]>

* final cleanup

Signed-off-by: Derek Ho <[email protected]>

* update acceleration breadcrumb

Signed-off-by: Derek Ho <[email protected]>

* fix API call for data connection page

Signed-off-by: Derek Ho <[email protected]>

* fix integ test and data test subj and snapshot

Signed-off-by: Derek Ho <[email protected]>

---------

Signed-off-by: Derek Ho <[email protected]>

* Add fallback to show if user does not have datasource API permissions (opensearch-project#1008)

* add fallback ui for manage and view datasources

Signed-off-by: Derek Ho <[email protected]>

* always show datasources via pplservice

Signed-off-by: Derek Ho <[email protected]>

---------

Signed-off-by: Derek Ho <[email protected]>

* Add access control tab content (opensearch-project#992)

* basic rendering for the access control tab

Signed-off-by: Derek Ho <[email protected]>

* hook up basic radio groups and euicombo boxes for query and acceleration permissions

Signed-off-by: Derek Ho <[email protected]>

* refactor and clean up unuseed inports

Signed-off-by: Derek Ho <[email protected]>

* remove unused import

Signed-off-by: Derek Ho <[email protected]>

* fix import and snapshot

Signed-off-by: Derek Ho <[email protected]>

* fix test

Signed-off-by: Derek Ho <[email protected]>

* Address PR comments

Signed-off-by: Derek Ho <[email protected]>

* Address PR comments

Signed-off-by: Derek Ho <[email protected]>

* Remove unused files and variables

Signed-off-by: Derek Ho <[email protected]>

---------

Signed-off-by: Derek Ho <[email protected]>

* Delete datasource and Connection Configuration Tab (opensearch-project#1024)

* Address previous PR comments and implement rudimentary delete

Signed-off-by: Derek Ho <[email protected]>

* Implement modal and instant delete showing up in list

Signed-off-by: Derek Ho <[email protected]>

* Refactor save or cancel to a shared component, implement hard coded datasource configurations tab

Signed-off-by: Derek Ho <[email protected]>

* Update test with mock role data

Signed-off-by: Derek Ho <[email protected]>

* Add most functionality of edit connectiondetails

Signed-off-by: Derek Ho <[email protected]>

* Address PR comments

Signed-off-by: Derek Ho <[email protected]>

---------

Signed-off-by: Derek Ho <[email protected]>

* remove acceleration components

Signed-off-by: Shenoy Pratik <[email protected]>

---------

Signed-off-by: Derek Ho <[email protected]>
Signed-off-by: Shenoy Pratik <[email protected]>
Co-authored-by: Shenoy Pratik <[email protected]>
* Manage datasources (opensearch-project#967)

* fix name change bug and modify test to test behavior

Signed-off-by: Derek Ho <[email protected]>

* get rid of lint

Signed-off-by: Derek Ho <[email protected]>

* test for flyout

Signed-off-by: Derek Ho <[email protected]>

* flyout to medium size

Signed-off-by: Derek Ho <[email protected]>

* make accelerate extensible

Signed-off-by: Derek Ho <[email protected]>

* get datasources and hook up to pplservice

Signed-off-by: Derek Ho <[email protected]>

* get flint working

Signed-off-by: Derek Ho <[email protected]>

* add datasource page with steps and buttons on bottom bar

Signed-off-by: Derek Ho <[email protected]>

* datasources as a new plugin and mostly working

Signed-off-by: Derek Ho <[email protected]>

* hook up manage to show datasources call

Signed-off-by: Derek Ho <[email protected]>

* update two tables with descriptions

Signed-off-by: Derek Ho <[email protected]>

* make some updates to the page

Signed-off-by: Derek Ho <[email protected]>

* cleanup unused files for data connections

Signed-off-by: Derek Ho <[email protected]>

* cleanup and add overview panel columns

Signed-off-by: Derek Ho <[email protected]>

* render tabs

Signed-off-by: Derek Ho <[email protected]>

* add unit tests

Signed-off-by: Derek Ho <[email protected]>

* update data test subj and snapshot

Signed-off-by: Derek Ho <[email protected]>

* Add datasources to management overview

Signed-off-by: Derek Ho <[email protected]>

* remove spark logo and update snapshot

Signed-off-by: Derek Ho <[email protected]>

* refactor routes out

Signed-off-by: Derek Ho <[email protected]>

* separate out the roles

Signed-off-by: Derek Ho <[email protected]>

* bump version back to 3.0

Signed-off-by: Derek Ho <[email protected]>

---------

Signed-off-by: Derek Ho <[email protected]>

* Add acceleration management UI  (opensearch-project#989)

* add acceleration management UI skeleton

Signed-off-by: Shenoy Pratik <[email protected]>

* Create new documentation link for acc

Signed-off-by: Shenoy Pratik <[email protected]>

* fix typos and minor bugs

Signed-off-by: Shenoy Pratik <[email protected]>

* update snapshot

Signed-off-by: Shenoy Pratik <[email protected]>

* update window location to hash

Signed-off-by: Shenoy Pratik <[email protected]>

* remove unused headers

Signed-off-by: Shenoy Pratik <[email protected]>

---------

Signed-off-by: Shenoy Pratik <[email protected]>

* Rename data sources to data connections (opensearch-project#1004)

* rename data sources to data connections

Signed-off-by: Derek Ho <[email protected]>

* final cleanup

Signed-off-by: Derek Ho <[email protected]>

* update acceleration breadcrumb

Signed-off-by: Derek Ho <[email protected]>

* fix API call for data connection page

Signed-off-by: Derek Ho <[email protected]>

* fix integ test and data test subj and snapshot

Signed-off-by: Derek Ho <[email protected]>

---------

Signed-off-by: Derek Ho <[email protected]>

* Add fallback to show if user does not have datasource API permissions (opensearch-project#1008)

* add fallback ui for manage and view datasources

Signed-off-by: Derek Ho <[email protected]>

* always show datasources via pplservice

Signed-off-by: Derek Ho <[email protected]>

---------

Signed-off-by: Derek Ho <[email protected]>

* Add access control tab content (opensearch-project#992)

* basic rendering for the access control tab

Signed-off-by: Derek Ho <[email protected]>

* hook up basic radio groups and euicombo boxes for query and acceleration permissions

Signed-off-by: Derek Ho <[email protected]>

* refactor and clean up unuseed inports

Signed-off-by: Derek Ho <[email protected]>

* remove unused import

Signed-off-by: Derek Ho <[email protected]>

* fix import and snapshot

Signed-off-by: Derek Ho <[email protected]>

* fix test

Signed-off-by: Derek Ho <[email protected]>

* Address PR comments

Signed-off-by: Derek Ho <[email protected]>

* Address PR comments

Signed-off-by: Derek Ho <[email protected]>

* Remove unused files and variables

Signed-off-by: Derek Ho <[email protected]>

---------

Signed-off-by: Derek Ho <[email protected]>

* Delete datasource and Connection Configuration Tab (opensearch-project#1024)

* Address previous PR comments and implement rudimentary delete

Signed-off-by: Derek Ho <[email protected]>

* Implement modal and instant delete showing up in list

Signed-off-by: Derek Ho <[email protected]>

* Refactor save or cancel to a shared component, implement hard coded datasource configurations tab

Signed-off-by: Derek Ho <[email protected]>

* Update test with mock role data

Signed-off-by: Derek Ho <[email protected]>

* Add most functionality of edit connectiondetails

Signed-off-by: Derek Ho <[email protected]>

* Address PR comments

Signed-off-by: Derek Ho <[email protected]>

---------

Signed-off-by: Derek Ho <[email protected]>

* Get most of the workflow working for configure datasource

Signed-off-by: Derek Ho <[email protected]>

* remove acceleration components

Signed-off-by: Shenoy Pratik <[email protected]>

* Update data connection to datasources in a few more places and update tests

Signed-off-by: Derek Ho <[email protected]>

* Rename and re-organize in folders

Signed-off-by: Derek Ho <[email protected]>

* Fix import path in testing file

Signed-off-by: Derek Ho <[email protected]>

* Get Initial S3 configuration working

Signed-off-by: Derek Ho <[email protected]>

* Configure S3 Data Source Working

Signed-off-by: Derek Ho <[email protected]>

* Fix query permissions display

Signed-off-by: Derek Ho <[email protected]>

* Fix merge conflict

Signed-off-by: Derek Ho <[email protected]>

* Clean up PR

Signed-off-by: Derek Ho <[email protected]>

* Add s3 logo in manage table

Signed-off-by: Derek Ho <[email protected]>

* Fix up PR according to UX feedback

Signed-off-by: Derek Ho <[email protected]>

* Remove successfully

Signed-off-by: Derek Ho <[email protected]>

* Update test

Signed-off-by: Derek Ho <[email protected]>

* Address PR comments

Signed-off-by: Derek Ho <[email protected]>

* Update test in accordance to useLocation

Signed-off-by: Derek Ho <[email protected]>

---------

Signed-off-by: Derek Ho <[email protected]>
Signed-off-by: Shenoy Pratik <[email protected]>
Co-authored-by: Shenoy Pratik <[email protected]>
…rch-project#1041)

* initial data grid column change with hardcoded vals

Signed-off-by: Paul Sebastian <[email protected]>

* basic render cell data added

Signed-off-by: Paul Sebastian <[email protected]>

* added memoization for all components and redid cell rendering

Signed-off-by: Paul Sebastian <[email protected]>

* allow for any kind of field to be shown

Signed-off-by: Paul Sebastian <[email protected]>

* basic pagination only with queried data

Signed-off-by: Paul Sebastian <[email protected]>

* sorting and pagination effect onto query support

Signed-off-by: Paul Sebastian <[email protected]>

* fully functional flyout

Signed-off-by: Paul Sebastian <[email protected]>

* removed unneeded code and fixed typing errors

Signed-off-by: Paul Sebastian <[email protected]>

* fixed field sorting/paginating issue with sidebar integration and expfield storing

Signed-off-by: Paul Sebastian <[email protected]>

* code cleanup

Signed-off-by: Paul Sebastian <[email protected]>

* fixed a lot of tests

Signed-off-by: Paul Sebastian <[email protected]>

* reduce sidebar code redundancy

Signed-off-by: Paul Sebastian <[email protected]>

* remove commented code

Signed-off-by: Paul Sebastian <[email protected]>

* test constant

Signed-off-by: Paul Sebastian <[email protected]>

* flyout testing code

Signed-off-by: Paul Sebastian <[email protected]>

* fixed small sidebar init issue

Signed-off-by: Paul Sebastian <[email protected]>

* changed default page size from 25 to 100

Signed-off-by: Paul Sebastian <[email protected]>

* updated snapshot

Signed-off-by: Paul Sebastian <[email protected]>

* small changes + source column prettied + snapshot

Signed-off-by: Paul Sebastian <[email protected]>

* small todos and code coverage change

Signed-off-by: Paul Sebastian <[email protected]>

* moved redo query to util function

Signed-off-by: Paul Sebastian <[email protected]>

* redoQuery testing

Signed-off-by: Paul Sebastian <[email protected]>

* redoQuery testing

Signed-off-by: Paul Sebastian <[email protected]>

* redoQuery testing

Signed-off-by: Paul Sebastian <[email protected]>

* modified redo func in utils test

Signed-off-by: Paul Sebastian <[email protected]>

* small pr changes

Signed-off-by: Paul Sebastian <[email protected]>

---------

Signed-off-by: Paul Sebastian <[email protected]>
Signed-off-by: Derek Ho <[email protected]>
@derek-ho
Copy link
Collaborator Author

derek-ho commented Oct 4, 2023

Cherry-picks all commits in main up to ae399e2 onto 2.x line

derek-ho and others added 11 commits October 4, 2023 18:59
* Manage datasources (opensearch-project#967)

* fix name change bug and modify test to test behavior

Signed-off-by: Derek Ho <[email protected]>

* get rid of lint

Signed-off-by: Derek Ho <[email protected]>

* test for flyout

Signed-off-by: Derek Ho <[email protected]>

* flyout to medium size

Signed-off-by: Derek Ho <[email protected]>

* make accelerate extensible

Signed-off-by: Derek Ho <[email protected]>

* get datasources and hook up to pplservice

Signed-off-by: Derek Ho <[email protected]>

* get flint working

Signed-off-by: Derek Ho <[email protected]>

* add datasource page with steps and buttons on bottom bar

Signed-off-by: Derek Ho <[email protected]>

* datasources as a new plugin and mostly working

Signed-off-by: Derek Ho <[email protected]>

* hook up manage to show datasources call

Signed-off-by: Derek Ho <[email protected]>

* update two tables with descriptions

Signed-off-by: Derek Ho <[email protected]>

* make some updates to the page

Signed-off-by: Derek Ho <[email protected]>

* cleanup unused files for data connections

Signed-off-by: Derek Ho <[email protected]>

* cleanup and add overview panel columns

Signed-off-by: Derek Ho <[email protected]>

* render tabs

Signed-off-by: Derek Ho <[email protected]>

* add unit tests

Signed-off-by: Derek Ho <[email protected]>

* update data test subj and snapshot

Signed-off-by: Derek Ho <[email protected]>

* Add datasources to management overview

Signed-off-by: Derek Ho <[email protected]>

* remove spark logo and update snapshot

Signed-off-by: Derek Ho <[email protected]>

* refactor routes out

Signed-off-by: Derek Ho <[email protected]>

* separate out the roles

Signed-off-by: Derek Ho <[email protected]>

* bump version back to 3.0

Signed-off-by: Derek Ho <[email protected]>

---------

Signed-off-by: Derek Ho <[email protected]>

* Add acceleration management UI  (opensearch-project#989)

* add acceleration management UI skeleton

Signed-off-by: Shenoy Pratik <[email protected]>

* Create new documentation link for acc

Signed-off-by: Shenoy Pratik <[email protected]>

* fix typos and minor bugs

Signed-off-by: Shenoy Pratik <[email protected]>

* update snapshot

Signed-off-by: Shenoy Pratik <[email protected]>

* update window location to hash

Signed-off-by: Shenoy Pratik <[email protected]>

* remove unused headers

Signed-off-by: Shenoy Pratik <[email protected]>

---------

Signed-off-by: Shenoy Pratik <[email protected]>

* Rename data sources to data connections (opensearch-project#1004)

* rename data sources to data connections

Signed-off-by: Derek Ho <[email protected]>

* final cleanup

Signed-off-by: Derek Ho <[email protected]>

* update acceleration breadcrumb

Signed-off-by: Derek Ho <[email protected]>

* fix API call for data connection page

Signed-off-by: Derek Ho <[email protected]>

* fix integ test and data test subj and snapshot

Signed-off-by: Derek Ho <[email protected]>

---------

Signed-off-by: Derek Ho <[email protected]>

* Add fallback to show if user does not have datasource API permissions (opensearch-project#1008)

* add fallback ui for manage and view datasources

Signed-off-by: Derek Ho <[email protected]>

* always show datasources via pplservice

Signed-off-by: Derek Ho <[email protected]>

---------

Signed-off-by: Derek Ho <[email protected]>

* Add access control tab content (opensearch-project#992)

* basic rendering for the access control tab

Signed-off-by: Derek Ho <[email protected]>

* hook up basic radio groups and euicombo boxes for query and acceleration permissions

Signed-off-by: Derek Ho <[email protected]>

* refactor and clean up unuseed inports

Signed-off-by: Derek Ho <[email protected]>

* remove unused import

Signed-off-by: Derek Ho <[email protected]>

* fix import and snapshot

Signed-off-by: Derek Ho <[email protected]>

* fix test

Signed-off-by: Derek Ho <[email protected]>

* Address PR comments

Signed-off-by: Derek Ho <[email protected]>

* Address PR comments

Signed-off-by: Derek Ho <[email protected]>

* Remove unused files and variables

Signed-off-by: Derek Ho <[email protected]>

---------

Signed-off-by: Derek Ho <[email protected]>

* Delete datasource and Connection Configuration Tab (opensearch-project#1024)

* Address previous PR comments and implement rudimentary delete

Signed-off-by: Derek Ho <[email protected]>

* Implement modal and instant delete showing up in list

Signed-off-by: Derek Ho <[email protected]>

* Refactor save or cancel to a shared component, implement hard coded datasource configurations tab

Signed-off-by: Derek Ho <[email protected]>

* Update test with mock role data

Signed-off-by: Derek Ho <[email protected]>

* Add most functionality of edit connectiondetails

Signed-off-by: Derek Ho <[email protected]>

* Address PR comments

Signed-off-by: Derek Ho <[email protected]>

---------

Signed-off-by: Derek Ho <[email protected]>

* Get most of the workflow working for configure datasource

Signed-off-by: Derek Ho <[email protected]>

* remove acceleration components

Signed-off-by: Shenoy Pratik <[email protected]>

* Update data connection to datasources in a few more places and update tests

Signed-off-by: Derek Ho <[email protected]>

* Rename and re-organize in folders

Signed-off-by: Derek Ho <[email protected]>

* Fix import path in testing file

Signed-off-by: Derek Ho <[email protected]>

* Get Initial S3 configuration working

Signed-off-by: Derek Ho <[email protected]>

* Configure S3 Data Source Working

Signed-off-by: Derek Ho <[email protected]>

* Fix query permissions display

Signed-off-by: Derek Ho <[email protected]>

* Fix merge conflict

Signed-off-by: Derek Ho <[email protected]>

* Clean up PR

Signed-off-by: Derek Ho <[email protected]>

* Add s3 logo in manage table

Signed-off-by: Derek Ho <[email protected]>

* Fix up PR according to UX feedback

Signed-off-by: Derek Ho <[email protected]>

* Remove successfully

Signed-off-by: Derek Ho <[email protected]>

* Update test

Signed-off-by: Derek Ho <[email protected]>

* Initial commit adding prometheus logo and icon

Signed-off-by: Derek Ho <[email protected]>

* Get the major flow working

Signed-off-by: Derek Ho <[email protected]>

* Fix app navigation

Signed-off-by: Derek Ho <[email protected]>

* Fix up PR

Signed-off-by: Derek Ho <[email protected]>

* Remove management redirection for now and fix test and add cards

Signed-off-by: Derek Ho <[email protected]>

* Remove type filter and update test according to UX feedback

Signed-off-by: Derek Ho <[email protected]>

* Add link and update test

Signed-off-by: Derek Ho <[email protected]>

* Address PR comments

Signed-off-by: Derek Ho <[email protected]>

* Include useful info in the error toast

Signed-off-by: Derek Ho <[email protected]>

* Update actions in manage table according to UX feedback

Signed-off-by: Derek Ho <[email protected]>

* Add update button and update tests

Signed-off-by: Derek Ho <[email protected]>

* Remove unused code until further implementation

Signed-off-by: Derek Ho <[email protected]>

* Fix router files

Signed-off-by: Derek Ho <[email protected]>

---------

Signed-off-by: Derek Ho <[email protected]>
Signed-off-by: Shenoy Pratik <[email protected]>
Co-authored-by: Shenoy Pratik <[email protected]>
* Stub catalog reader interface

Signed-off-by: Simeon Widdis <[email protected]>

* Add basic catalog functionality to new catalog reader

Signed-off-by: Simeon Widdis <[email protected]>

* Refactor validation logic with a deeper interface

Signed-off-by: Simeon Widdis <[email protected]>

* Refactor validation logic with a deeper interface

Signed-off-by: Simeon Widdis <[email protected]>

* Remove redundant test.

This test is unneeded after 12c4bcf

Signed-off-by: Simeon Widdis <[email protected]>

* Add tests for new validators

Signed-off-by: Simeon Widdis <[email protected]>

* Make better failure mode for invalid objects

Signed-off-by: Simeon Widdis <[email protected]>

* Generalize Result type

Signed-off-by: Simeon Widdis <[email protected]>

* Convert backend to use catalog reader (unstable)

Signed-off-by: Simeon Widdis <[email protected]>

* Repair tests for integrations class (unstable)

Signed-off-by: Simeon Widdis <[email protected]>

* Refactor repository for new integration interface

Signed-off-by: Simeon Widdis <[email protected]>

* Fix outer repository and backend tests

Signed-off-by: Simeon Widdis <[email protected]>

* Add tests for sample data

Signed-off-by: Simeon Widdis <[email protected]>

* Add CatalogReader JavaDocs

Signed-off-by: Simeon Widdis <[email protected]>

* Repair integrations builder

Signed-off-by: Simeon Widdis <[email protected]>

* Remove extra commented test

Signed-off-by: Simeon Widdis <[email protected]>

* Remove unnecessary log statement

Signed-off-by: Simeon Widdis <[email protected]>

* Repair getSchemas behavior to return correct type

Let it be known at on this day, with this commit,
I have truly grokked why we don't use `any` in typescript.

Signed-off-by: Simeon Widdis <[email protected]>

* Add tests for getSchemas

Signed-off-by: Simeon Widdis <[email protected]>

* Add tests for asset and sample data backend methods

Signed-off-by: Simeon Widdis <[email protected]>

* Break flyout validation methods out of constructing method

Signed-off-by: Simeon Widdis <[email protected]>

* Add tests for extracted flyout methods

Signed-off-by: Simeon Widdis <[email protected]>

* Switch validation method to use ValidationResult

Signed-off-by: Simeon Widdis <[email protected]>

* Swap out flyout for hello-world setup page

Signed-off-by: Simeon Widdis <[email protected]>

* Add basic step incrementing

Signed-off-by: Simeon Widdis <[email protected]>

* Add basic field skeleton for each step

Signed-off-by: Simeon Widdis <[email protected]>

* Add a cancel button

Signed-off-by: Simeon Widdis <[email protected]>

* Add config type to developing form

Signed-off-by: Simeon Widdis <[email protected]>

* Flatten integration config

Signed-off-by: Simeon Widdis <[email protected]>

* Add sample data table modal

Signed-off-by: Simeon Widdis <[email protected]>

* Add toggle for standard and advanced asset config

Signed-off-by: Simeon Widdis <[email protected]>

* Simplify imports

Signed-off-by: Simeon Widdis <[email protected]>

* Refactor major class names

Signed-off-by: Simeon Widdis <[email protected]>

* (WIP) begin refactoring functionality into adaptor

Signed-off-by: Simeon Widdis <[email protected]>

* Finish migrating functionality to data adaptor

Signed-off-by: Simeon Widdis <[email protected]>

* Rename integration types for more clarity

Signed-off-by: Simeon Widdis <[email protected]>

* Refactor component usage

Signed-off-by: Simeon Widdis <[email protected]>

* Connect forms to config state

Signed-off-by: Simeon Widdis <[email protected]>

* Fix filetype selector

Signed-off-by: Simeon Widdis <[email protected]>

* Remove hardcoded name in path

Signed-off-by: Simeon Widdis <[email protected]>

* Write one snapshot test

Signed-off-by: Simeon Widdis <[email protected]>

* Add more tests

Signed-off-by: Simeon Widdis <[email protected]>

* Fix test naming

Signed-off-by: Simeon Widdis <[email protected]>

* Update obsolete snapshots

Signed-off-by: Simeon Widdis <[email protected]>

* Move integration creation helpers to own file

Signed-off-by: Simeon Widdis <[email protected]>

* Break out integration creation methods

Signed-off-by: Simeon Widdis <[email protected]>

* Isolate more create_integration helpers

Signed-off-by: Simeon Widdis <[email protected]>

* Simplify setup form

Signed-off-by: Simeon Widdis <[email protected]>

* Add data source picker items

Signed-off-by: Simeon Widdis <[email protected]>

* Add better selector logic

Signed-off-by: Simeon Widdis <[email protected]>

* Add queries for data sources

Signed-off-by: Simeon Widdis <[email protected]>

* Switch from selector to combobox

Signed-off-by: Simeon Widdis <[email protected]>

* Update snapshots

Signed-off-by: Simeon Widdis <[email protected]>

* Connect validation button to data source validation method

Signed-off-by: Simeon Widdis <[email protected]>

* Reimplement add integration button

Signed-off-by: Simeon Widdis <[email protected]>

* Temporarily remove validate button

Signed-off-by: Simeon Widdis <[email protected]>

* Simplify dynamic table term selection

Signed-off-by: Simeon Widdis <[email protected]>

* Remove unused validate code

Signed-off-by: Simeon Widdis <[email protected]>

* Undo wildcard import

Signed-off-by: Simeon Widdis <[email protected]>

* Switch from proxy to dataconnections endpoint

Signed-off-by: Simeon Widdis <[email protected]>

* Remove unused table fields

Signed-off-by: Simeon Widdis <[email protected]>

* Switch dataconnections base to const

Signed-off-by: Simeon Widdis <[email protected]>

* Add console proxy to route constants

Signed-off-by: Simeon Widdis <[email protected]>

* Update snapshots

Signed-off-by: Simeon Widdis <[email protected]>

* Move color to constants

Signed-off-by: Simeon Widdis <[email protected]>

* Move index name validation to constants and improve matching

Signed-off-by: Simeon Widdis <[email protected]>

* Move test constants to test constants

Signed-off-by: Simeon Widdis <[email protected]>

---------

Signed-off-by: Simeon Widdis <[email protected]>
* Make UI changes based on UX feedback

Signed-off-by: Derek Ho <[email protected]>

* Remove notifications pass through props

Signed-off-by: Derek Ho <[email protected]>

* Fix steps

Signed-off-by: Derek Ho <[email protected]>

* Remove edit buttons, delete files, update tests

Signed-off-by: Derek Ho <[email protected]>

* Finish fixing promtheus flow

Signed-off-by: Derek Ho <[email protected]>

* fix up s3 flow

Signed-off-by: Derek Ho <[email protected]>

* Hook up fields to actual call

Signed-off-by: Derek Ho <[email protected]>

* Update according to UX feedback and tests

Signed-off-by: Derek Ho <[email protected]>

* Add test

Signed-off-by: Derek Ho <[email protected]>

* Finish up test coverage for manage flow

Signed-off-by: Derek Ho <[email protected]>

---------

Signed-off-by: Derek Ho <[email protected]>
@derek-ho derek-ho marked this pull request as ready for review October 4, 2023 23:08
@derek-ho
Copy link
Collaborator Author

derek-ho commented Oct 4, 2023

Cherry-picks all PRs on main except e21dcf2, which will be backported separately

Swiddis and others added 2 commits October 4, 2023 17:48
Signed-off-by: Simeon Widdis <[email protected]>
@codecov
Copy link

codecov bot commented Oct 5, 2023

Codecov Report

Merging #1070 (95c3e14) into 2.x (ed572dc) will increase coverage by 0.40%.
Report is 2 commits behind head on 2.x.
The diff coverage is n/a.

@@            Coverage Diff             @@
##              2.x    #1070      +/-   ##
==========================================
+ Coverage   43.55%   43.96%   +0.40%     
==========================================
  Files         313      325      +12     
  Lines       18708    19366     +658     
  Branches     4517     4626     +109     
==========================================
+ Hits         8149     8514     +365     
- Misses      10517    10808     +291     
- Partials       42       44       +2     
Flag Coverage Δ
dashboards-observability 43.96% <ø> (+0.40%) ⬆️

Flags with carried forward coverage won't be shown. Click here to find out more.

see 53 files with indirect coverage changes

Signed-off-by: Derek Ho <[email protected]>
@pjfitzgibbons pjfitzgibbons merged commit 171acde into opensearch-project:2.x Oct 5, 2023
6 of 8 checks passed
amsiglan pushed a commit to amsiglan/dashboards-observability that referenced this pull request Jun 7, 2024
* Update mocha (opensearch-project#960)
* added code for the change of design of the sidebar, fixed overriding … (opensearch-project#928)
* Refactor add_integration_flyout to break out nested methods (opensearch-project#956)
* [Log Explorer] Remove top level tabs (opensearch-project#970)
* Explorer's timeheader & color change (opensearch-project#959)
* Update caching (opensearch-project#965)
* Move query_utils to /public (opensearch-project#983)
* Remove Zeppelin Parser from Notebook (opensearch-project#985)
* Explorer empty bucket (opensearch-project#990)
* refactored classnames for sidebar (opensearch-project#933)
* Refactor Integrations Backend to abstract IO (opensearch-project#947)
* Create React component for Integrations Setup UI (opensearch-project#1009)
* Create Data sources plugin with Manage Datasources Flow  (opensearch-project#1035)
* Manage datasources (opensearch-project#967)
* Add acceleration management UI  (opensearch-project#989)
* Rename data sources to data connections (opensearch-project#1004)
* Add fallback to show if user does not have datasource API permissions (opensearch-project#1008)
* Add access control tab content (opensearch-project#992)
* Delete datasource and Connection Configuration Tab (opensearch-project#1024)
* adjust explorer chart color and spacing (opensearch-project#1051)
* Configure S3 datasource flow (opensearch-project#1049)
* Manage datasources (opensearch-project#967)
* Add acceleration management UI  (opensearch-project#989)
* Rename data sources to data connections (opensearch-project#1004)
* Add fallback to show if user does not have datasource API permissions (opensearch-project#1008)
* Add access control tab content (opensearch-project#992)
* Delete datasource and Connection Configuration Tab (opensearch-project#1024)
* modified explorer data grid to follow discover look and feel (opensearch-project#1041)
* Create prometheus datasource flow (opensearch-project#1054)
* Manage datasources (opensearch-project#967)
* Add acceleration management UI  (opensearch-project#989)
* Rename data sources to data connections (opensearch-project#1004)
* Add fallback to show if user does not have datasource API permissions (opensearch-project#1008)
* Add access control tab content (opensearch-project#992)
* Delete datasource and Connection Configuration Tab (opensearch-project#1024)
* added design changes for sidebar (opensearch-project#1061)
* updated snapshots (opensearch-project#1062)
* Update UI for integrations setup (opensearch-project#1052)
* Data sources UI improvements (opensearch-project#1059)
* adding redirection to datasources (opensearch-project#1063)
* Move convertDateTime, refactor query_utils (opensearch-project#1064)
* Setup S3 connection with integrations (opensearch-project#1057)
* Use approved svg from UX (opensearch-project#1066)
* Fix missing import 'moment' on query_utils. (opensearch-project#1067)

---------

Signed-off-by: Derek Ho <[email protected]>
Signed-off-by: sumukhswamy <[email protected]>
Signed-off-by: Eric Wei <[email protected]>
Signed-off-by: Paul Sebastian <[email protected]>
Signed-off-by: Peter Fitzgibbons <[email protected]>
Signed-off-by: Shenoy Pratik <[email protected]>
Signed-off-by: Simeon Widdis <[email protected]>
Co-authored-by: sumukhswamy <[email protected]>
Co-authored-by: Eric Wei <[email protected]>
Co-authored-by: Paul Sebastian <[email protected]>
Co-authored-by: Peter Fitzgibbons <[email protected]>
Co-authored-by: Paul Sebastian <[email protected]>
Co-authored-by: Shenoy Pratik <[email protected]>
Co-authored-by: Simeon Widdis <[email protected]>
(cherry picked from commit 171acde)
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

7 participants