Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

feat: merge main into v0.9 #3969

Merged
merged 46 commits into from
Jul 26, 2024
Merged

Conversation

zhanghaohit
Copy link
Collaborator

No description provided.

greatljn and others added 30 commits April 28, 2024 12:43
* refactor!: relocate go sdk

moving to https://github.com/4paradigm/openmldb-go-sdk

* go readme

* ci: fix sdk workflow
raw SQL request mode example was wrong because execute_mode should be request
* fix: make clients use auth by default

* fix: let skip auth flag only affect verify
* fix: make clients use auth by default

* fix: let skip auth flag only affect verify

* feat: tablets get user table remotely

* fix: use FLAGS_system_table_replica_num for user table
* feat: merge AIOS DAG SQL

* feat: mergeDAGSQL

* add AIOSUtil

* feat: add AIOS merge SQL test case

* feat: split margeDAGSQL and validateSQLInRequest
* fix: gcformat space

* fix: gcformat continuous sign use hash

* fix: delete incorrect comments
* Set s3 and aws dependencies ad provided (4paradigm#3897)

* feat: execlude zookeeper for curator (4paradigm#3899)

* Execlude zookeeper when using curator

* Fix local build java
* fix: make clients use auth by default

* fix: let skip auth flag only affect verify

* feat: tablets get user table remotely

* fix: use FLAGS_system_table_replica_num for user table

* feat: consistent user cruds

* fix: pass instance of tablet and nameserver into auth lambda to allow locking

* feat: best effort try to flush user data to all tablets

* fix: lock scope

* fix: stop user sync thread safely

* fix: default values for user table columns
* feat(parser): simple ANSI SQL rewriter

* feat(draft): translate request mode query

* feat: request query rewriter

* test: tpc rewrite cases

* feat(rewrite): enable ansi sql rewriter in `ExecuteSQL`

You may explicitly set this feature on via `set session ansi_sql_rewriter
= 'true'`

TODO: this rewriter feature should be off by default
…digm#3948)

Bumps [urllib3](https://github.com/urllib3/urllib3) from 1.26.18 to 1.26.19.
- [Release notes](https://github.com/urllib3/urllib3/releases)
- [Changelog](https://github.com/urllib3/urllib3/blob/1.26.19/CHANGES.rst)
- [Commits](urllib3/urllib3@1.26.18...1.26.19)

---
updated-dependencies:
- dependency-name: urllib3
  dependency-type: indirect
...

Signed-off-by: dependabot[bot] <[email protected]>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
* feat(udf): array_combine

* feat(udf): new functions

- array_combine
- array_join

* feat: casting arrays to array<string> for array_combine

WIP, string allocation need fix

* fix: array_combine with non-string types

* feat(array_combine): handle null inputs

* fix(array_combine): behavior tweaks

- use empty string if delimiter is null
- restrict to array_combine(string, array<T> ...)
* feat: change user table to match mysql

* feat: support user authz

* fix: cean up created users
…igm#3951)

Bumps [requests](https://github.com/psf/requests) from 2.31.0 to 2.32.2.
- [Release notes](https://github.com/psf/requests/releases)
- [Changelog](https://github.com/psf/requests/blob/main/HISTORY.md)
- [Commits](psf/requests@v2.31.0...v2.32.2)

---
updated-dependencies:
- dependency-name: requests
  dependency-type: indirect
...

Signed-off-by: dependabot[bot] <[email protected]>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Bumps org.apache.derby:derby from 10.14.2.0 to 10.17.1.0.

---
updated-dependencies:
- dependency-name: org.apache.derby:derby
  dependency-type: direct:development
...

Signed-off-by: dependabot[bot] <[email protected]>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Bumps [org.postgresql:postgresql](https://github.com/pgjdbc/pgjdbc) from 42.3.3 to 42.3.9.
- [Release notes](https://github.com/pgjdbc/pgjdbc/releases)
- [Changelog](https://github.com/pgjdbc/pgjdbc/blob/master/CHANGELOG.md)
- [Commits](pgjdbc/pgjdbc@REL42.3.3...REL42.3.9)

---
updated-dependencies:
- dependency-name: org.postgresql:postgresql
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <[email protected]>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
* feat: iot table

* fix

* fix

* fix delete key entry

* fix comment

* ut

* ut test

* fix ut

* sleep more for truncate

* sleep 16

* tool pytest fix and swig fix

* fix

* clean

* move to base

* fix

* fix coverage ut

* fix

---------

Co-authored-by: Huang Wei <[email protected]>
* feat(open-mysql-db): refactor

1. remove unnecessary instance var port
2. fix cause null bug
3. remove unnecessary throws
4. fix ctx.close() sequence bug
5. config sessionTimeout and requestTimeout
6. add docs of SqlEngine

* feat(open-mysql-db): refactor

* feat(open-mysql-db): revert passsword

* feat(open-mysql-db): mock commit and schema table count

* feat(open-mysql-db): replace data type text with string

* feat(open-mysql-db): remove null

---------

Co-authored-by: yangwucheng <[email protected]>
* fix: drop aggr tables in drop table

* fix

* fix test

* fix

* fix

---------

Co-authored-by: Huang Wei <[email protected]>
* ci(4paradigm#3954): fix checkout action on old glibc OS

* ci: include checkout fix in all workflows

* ci: fix python-sdk
node-3 is not available, moving to node-2
Elliezza and others added 6 commits July 25, 2024 18:42
* Include new posts

* update links

* minor change
… rm deprecated file sync (4paradigm#3964)

* Updated create-pull-request action to v6 in udf-doc-gen workflow

* Removed references to docs/en/reference/sql/udfs_8h.md as the file no longer exists
@github-actions github-actions bot added documentation Improvements or additions to documentation workflow CICD related build openmldb compiling and installing docker openmldb compile image or demo image batch-engine openmldb batch(offline) engine sdk openmldb java/python sdk execute-engine hybridse sql engine storage-engine openmldb storage engine. nameserver & tablet task-manager openmldb taskmanager labels Jul 26, 2024
Copy link
Contributor

github-actions bot commented Jul 26, 2024

SDK Test Report

102 files   - 3  102 suites   - 3   2m 14s ⏱️ -10s
359 tests ±0  345 ✅ ±0  14 💤 ±0  0 ❌ ±0 
487 runs  ±0  473 ✅ ±0  14 💤 ±0  0 ❌ ±0 

Results for commit 289d685. ± Comparison against base commit ba5e85b.

♻️ This comment has been updated with latest results.

Copy link

codecov bot commented Jul 26, 2024

Codecov Report

Attention: Patch coverage is 20.00000% with 8 lines in your changes missing coverage. Please review.

Project coverage is 74.79%. Comparing base (ba5e85b) to head (289d685).

Files Patch % Lines
...paradigm/openmldb/taskmanager/JobInfoManager.scala 0.00% 4 Missing ⚠️
src/sdk/sql_cluster_router.cc 40.00% 3 Missing ⚠️
hybridse/src/case/sql_case.cc 0.00% 1 Missing ⚠️
Additional details and impacted files
@@             Coverage Diff             @@
##             v0.9    #3969       +/-   ##
===========================================
+ Coverage        0   74.79%   +74.79%     
- Complexity      0      711      +711     
===========================================
  Files           0      762      +762     
  Lines           0   137457   +137457     
  Branches        0     1534     +1534     
===========================================
+ Hits            0   102808   +102808     
- Misses          0    34346    +34346     
- Partials        0      303      +303     

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

Copy link
Contributor

github-actions bot commented Jul 26, 2024

HybridSE Mac Test Report

0 tests   0 ✅  0s ⏱️
0 suites  0 💤
0 files    0 ❌

Results for commit 289d685.

♻️ This comment has been updated with latest results.

Copy link
Contributor

github-actions bot commented Jul 26, 2024

HybridSE Linux Test Report

20 433 tests   20 431 ✅  6m 41s ⏱️
   262 suites       2 💤
    69 files         0 ❌

Results for commit 289d685.

♻️ This comment has been updated with latest results.

@zhanghaohit zhanghaohit marked this pull request as draft July 26, 2024 09:02
Copy link
Contributor

github-actions bot commented Jul 26, 2024

Linux Test Report

    60 files  ±0     253 suites  ±0   2h 2m 44s ⏱️ + 2m 25s
13 605 tests ±0  13 598 ✅ ±0  7 💤 ±0  0 ❌ ±0 
19 317 runs  ±0  19 310 ✅ ±0  7 💤 ±0  0 ❌ ±0 

Results for commit 289d685. ± Comparison against base commit ba5e85b.

♻️ This comment has been updated with latest results.

@zhanghaohit zhanghaohit marked this pull request as ready for review July 26, 2024 11:34
Copy link
Collaborator

@tobegit3hub tobegit3hub left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

Copy link
Collaborator

@tobegit3hub tobegit3hub left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@tobegit3hub tobegit3hub merged commit bfe5ba6 into 4paradigm:v0.9 Jul 26, 2024
33 of 36 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
batch-engine openmldb batch(offline) engine build openmldb compiling and installing docker openmldb compile image or demo image documentation Improvements or additions to documentation execute-engine hybridse sql engine sdk openmldb java/python sdk storage-engine openmldb storage engine. nameserver & tablet task-manager openmldb taskmanager workflow CICD related
Projects
None yet
Development

Successfully merging this pull request may close these issues.