[Discover-next] dataframes respects datasources

[kavilla]

Description

Parses user string between ::datasource:: to get the data source Then appends the dataSourceId in the meta.

Also creates the data frame before the interceptor to keep the meta info passed around.

If this gets accepted follow ups need to happen:

• should be ensuring the virtual index pattern includes the data source name with the index pattern name to avoid conflicts and a weird state.
• some reason dataframe is being always wiped out the first call in the search source. need to fix so that the schema is persisted
• weird initial load state. likely just too many things at once so we should make sure the usual and fresh experience is respected
• better indicator on the datasource, or just autocomplete that displays all the datasource connections when user types initial ::.

Issues Related

#6957

Screenshot

Testing the changes

run yarn opensearch snapshot --sql
run yarn start:enhancements

add a new data source connection

Changelog

• feat: onboard dataframes to MDS

Check List

• All tests pass
  • yarn test:jest
  • yarn test:jest_integration
• New functionality includes testing.
• New functionality has been documented.
• Update CHANGELOG.md
• Commits are signed per the DCO using --signoff

[github-actions]

❌ Invalid Prefix

Invalid description prefix. Found "". Expected "breaking", "deprecate", "feat", "fix", "infra", "doc", "chore", "refactor", "security", "skip", or "test".

[github-actions]

❌ Invalid Prefix

Invalid description prefix. Found "". Expected "breaking", "deprecate", "feat", "fix", "infra", "doc", "chore", "refactor", "security", "skip", or "test".

[github-actions]

❌ Invalid Prefix

Invalid description prefix. Found "". Expected "breaking", "deprecate", "feat", "fix", "infra", "doc", "chore", "refactor", "security", "skip", or "test".

[codecov]

Codecov Report

Attention: Patch coverage is 3.44828% with 28 lines in your changes missing coverage. Please review.

Project coverage is 67.42%. Comparing base (7f0e9d0) to head (371869c).

Files	Patch %	Lines
.../data/common/search/search_source/search_source.ts	0.00%	9 Missing ⚠️
src/plugins/data/common/data_frames/utils.ts	11.11%	8 Missing ⚠️
src/plugins/data/public/search/search_service.ts	0.00%	4 Missing ⚠️
src/plugins/data/server/search/search_service.ts	0.00%	4 Missing ⚠️
...on/index_patterns/index_patterns/index_patterns.ts	0.00%	3 Missing ⚠️

Additional details and impacted files

@@            Coverage Diff             @@
##             main    #7092      +/-   ##
==========================================
- Coverage   67.45%   67.42%   -0.03%     
==========================================
  Files        3448     3448              
  Lines       67916    67945      +29     
  Branches    11042    11052      +10     
==========================================
+ Hits        45812    45815       +3     
- Misses      19435    19462      +27     
+ Partials     2669     2668       -1     

Flag	Coverage Δ
Linux_1	33.05% <3.44%> (-0.02%)	⬇️
Linux_2	55.05% <4.00%> (-0.06%)	⬇️
Linux_3	45.23% <3.44%> (-0.05%)	⬇️
Linux_4	34.83% <3.44%> (-0.03%)	⬇️
Windows_1	33.08% <3.44%> (-0.02%)	⬇️
Windows_2	55.00% <4.00%> (-0.06%)	⬇️
Windows_3	45.26% <3.44%> (-0.03%)	⬇️
Windows_4	34.83% <3.44%> (-0.03%)	⬇️

Flags with carried forward coverage won't be shown. Click here to find out more.

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.