Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Update data_migrate.go #4137

Open
wants to merge 99 commits into
base: master
Choose a base branch
from
Open

Update data_migrate.go #4137

wants to merge 99 commits into from

Conversation

Ametsuji-akiya
Copy link

Ⅰ. Describe what this PR does

pkg\ddc\juicefs\data_migrate.go:42:47: corrected "transfromer" to "transformers"

Ⅱ. Does this pull request fix one issue?

fixes #4136

Ⅲ. List the added test cases (unit test/integration test) if any, please explain if no tests are needed.

Ⅳ. Describe how to verify it

Ⅴ. Special notes for reviews

@fluid-e2e-bot fluid-e2e-bot
Copy link

fluid-e2e-bot bot commented May 27, 2024

[APPROVALNOTIFIER] This PR is NOT APPROVED

This pull-request has been approved by:
Once this PR has been reviewed and has the lgtm label, please assign ronggu for approval by writing /assign @ronggu in a comment. For more information see:The Kubernetes Code Review Process.

The full list of commands accepted by this bot can be found here.

Needs approval from an approver in each of these files:

Approvers can indicate their approval by writing /approve in a comment
Approvers can cancel approval by writing /approve cancel in a comment

@fluid-e2e-bot fluid-e2e-bot
Copy link

fluid-e2e-bot bot commented May 27, 2024

Hi @Ametsuji-akiya. Thanks for your PR.

I'm waiting for a fluid-cloudnative member to verify that this patch is reasonable to test. If it is, they should reply with /ok-to-test on its own line. Until that is done, I will not automatically test new commits in this PR, but the usual testing commands by org members will still work. Regular contributors should join the org to skip this step.

Once the patch is verified, the new status will be reflected by the ok-to-test label.

I understand the commands that are listed here.

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes/test-infra repository.

@sonarcloud SonarCloud
Copy link

sonarcloud bot commented May 27, 2024

Quality Gate Passed Quality Gate passed

Issues
0 New issues
0 Accepted issues

Measures
0 Security Hotspots
No data about Coverage
No data about Duplication

See analysis details on SonarCloud

Ametsuji-akiya and others added 26 commits July 16, 2024 10:47
@Ametsuji-akiya @cheyang
Update data_migrate.go
ee71a4c 
typo "transfromer" to "transformers"

Signed-off-by: cheyang <[email protected]>
@cheyang
Build docker images for dataflow, To #55315018 (fluid-cloudnative#4135)
2918a34 
Signed-off-by: cheyang <[email protected]>
@JJjjxx @cheyang
modify License of cmd/goosefs/app/version.go (fluid-cloudnative#4047)
78eeac5 
Signed-off-by: JJjjxx <[email protected]>
Signed-off-by: cheyang <[email protected]>
@dependabot @cheyang
Bump golang.org/x/time from 0.3.0 to 0.5.0 (fluid-cloudnative#4111)
e763252 
Bumps [golang.org/x/time](https://github.com/golang/time) from 0.3.0 to 0.5.0.
- [Commits](golang/time@v0.3.0...v0.5.0)

---
updated-dependencies:
- dependency-name: golang.org/x/time
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <[email protected]>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Signed-off-by: cheyang <[email protected]>
@dashanji @cheyang
Fix the inconsistent rpc socket port with assigned port in vineyard w…
43b7c03 
…orker. (fluid-cloudnative#4141)

Signed-off-by: Ye Cao <[email protected]>
Signed-off-by: cheyang <[email protected]>
@xliuqq @cheyang
refactor: remove deprecated data operation interface (fluid-cloudnati…
ea03462 
…ve#4130)

* remove useless data operation methods

Signed-off-by: xliuqq <[email protected]>

* remove deprecated data operation interface

Signed-off-by: xliuqq <[email protected]>

* remove unused methods and constants

Signed-off-by: xliuqq <[email protected]>

---------

Signed-off-by: xliuqq <[email protected]>
@cheyang
Build docker image for code refactoring, To #54583165 (fluid-cloudnat…
d94d389 
…ive#4143)

Signed-off-by: cheyang <[email protected]>
@tzwo @cheyang
no.154 (fluid-cloudnative#4049)
48e108b 
Signed-off-by: tzwo <[email protected]>
Signed-off-by: cheyang <[email protected]>
@cheyang
Fix NPE of runtime controller (fluid-cloudnative#4139)
53e168a 
* Fix logging for  runtime, To #54583165

Signed-off-by: cheyang <[email protected]>

* Fix logging issue for  runtime, To #54583165

Signed-off-by: cheyang <[email protected]>

* Fix logging issue for  runtime, To #54583165

Signed-off-by: cheyang <[email protected]>

---------

Signed-off-by: cheyang <[email protected]>
@VictorChen77 @cheyang
this pr is to fix a wrong time of Copyright (fluid-cloudnative#4044)
9bad344 
Co-authored-by: Victor Chan <[email protected]>
Signed-off-by: cheyang <[email protected]>
@Axnco @cheyang
task168 (fluid-cloudnative#4051)
c5b8cf7 
Signed-off-by: LY <[email protected]>
Signed-off-by: cheyang <[email protected]>
@ljyzzZ @cheyang
This pr is to add a Copyright to normalize the License (fluid-cloudna…
2141a42 
…tive#4075)

Signed-off-by: ljyzzZ <[email protected]>
Signed-off-by: cheyang <[email protected]>
@njuqj @cheyang
Standardize License Information (fluid-cloudnative#4053)
9502fc2 
Signed-off-by: qiji <[email protected]>
Signed-off-by: cheyang <[email protected]>
@melldy @cheyang
This pr is to add license to ./pkg/common/constants.go (fluid-cloudna…
81e7110 
…tive#4056)

* add license to ./pkg/common/constants.go

Signed-off-by: melldy <[email protected]>

* This pr is to add license to ./pkg/common/constants.go

Signed-off-by: melldy <[email protected]>

* This pr is to add license to ./pkg/common/constants.go

Signed-off-by: melldy <[email protected]>

* This pr is to add license to ./pkg/common/constants.go

Signed-off-by: melldy <[email protected]>

* This pr is to add license to ./pkg/common/constants.go

Signed-off-by: melldy <[email protected]>

* This pr is to add license to ./pkg/common/constants.go

Signed-off-by: melldy <[email protected]>

* This pr is to add license to ./pkg/common/constants.go

Signed-off-by: melldy <[email protected]>

* This pr is to add license to ./pkg/common/constants.go

Signed-off-by: melldy <[email protected]>

---------

Signed-off-by: melldy <[email protected]>
Signed-off-by: cheyang <[email protected]>
@whatAboutluv @cheyang
This pr is to add the modification of the year of pkg/base/base/opera…
a9c11e2 
…tion_lock.go (fluid-cloudnative#4055)

Signed-off-by: whatAboutluv <[email protected]>
Signed-off-by: cheyang <[email protected]>
@DREAMINGtimezero @cheyang
changing 2023 to correct time 2020-s (fluid-cloudnative#4046)
c53c446 
* changing 2023 to correct time 2020-s

* changing 2020 to correct time 2023

Signed-off-by: dreamingtimezero <[email protected]>

* -schanging 2023 to correct time 2020

---------

Signed-off-by: dreamingtimezero <[email protected]>
Signed-off-by: cheyang <[email protected]>
@211820252 @cheyang
corrected a word (fluid-cloudnative#4060)
bb3eeb3 
Signed-off-by: 211820252 <[email protected]>
Signed-off-by: cheyang <[email protected]>
@dependabot @cheyang
Bump github.com/onsi/gomega from 1.27.10 to 1.33.1 (fluid-cloudnative…
8c0c3e7 
…#4142)

Bumps [github.com/onsi/gomega](https://github.com/onsi/gomega) from 1.27.10 to 1.33.1.
- [Release notes](https://github.com/onsi/gomega/releases)
- [Changelog](https://github.com/onsi/gomega/blob/master/CHANGELOG.md)
- [Commits](onsi/gomega@v1.27.10...v1.33.1)

---
updated-dependencies:
- dependency-name: github.com/onsi/gomega
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <[email protected]>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Signed-off-by: cheyang <[email protected]>
@xACE123 @cheyang
add license (fluid-cloudnative#4061)
6c1f776 
Signed-off-by: xACE123 <[email protected]>
Signed-off-by: cheyang <[email protected]>
@HistoriaY @cheyang
modify year of license in pkg/ddc/alluxio/engine.go (fluid-cloudnativ…
477b063 
…e#4062)

Signed-off-by: historia <[email protected]>
Signed-off-by: cheyang <[email protected]>
@ttkyhy @cheyang
This pr is to change the time of Copyright (fluid-cloudnative#4064)
3046f3f 
Signed-off-by: ttkyhy <[email protected]>
Signed-off-by: cheyang <[email protected]>
@DestroyFlag @cheyang
This pr is to correct the year of the License (fluid-cloudnative#4065)
1d7077c 
Signed-off-by: DestroyFlag <[email protected]>
Signed-off-by: cheyang <[email protected]>
@littledoublelin @cheyang
Changed Copyright date from 2023 to 2020. (fluid-cloudnative#4066)
d13dbf8 
Signed-off-by: littledoublelin <[email protected]>
Signed-off-by: cheyang <[email protected]>
@same-pxt @cheyang
Standardized license information of cmd/thin/app/thin.go (fluid-cloud…
f327b24 
…native#4069)

Signed-off-by: same-pxt <[email protected]>
Signed-off-by: cheyang <[email protected]>
@NightStar808 @cheyang
add License to ./pkg/common/alluxio.go (fluid-cloudnative#4074)
3361df9 
Signed-off-by: NightStar808 <[email protected]>
Signed-off-by: cheyang <[email protected]>
@kangkanghanhan @cheyang
修改日期 (fluid-cloudnative#4076)
11131ee 
Signed-off-by: kangkanghanhan <[email protected]>
Signed-off-by: cheyang <[email protected]>
xliuqq and others added 29 commits July 16, 2024 10:49
@xliuqq @cheyang
move dataflow affinity logic to fluidapp controller (fluid-cloudnativ…
e717541 
…e#4138)

* use fluidapp to support data flow affinity

Signed-off-by: xliuqq <[email protected]>

* make fluidapp dataop controller optional

Signed-off-by: xliuqq <[email protected]>

* fix check

Signed-off-by: xliuqq <[email protected]>

* add unit test for injectPodNodeLabelsToJob

Signed-off-by: xliuqq <[email protected]>

* fix: use library.fluid.labels instead of fluid.io/managed-by

Signed-off-by: xliuqq <[email protected]>

* fix comment error and reslove conflicts

Signed-off-by: xliuqq <[email protected]>

* fix annotation nil error

Signed-off-by: xliuqq <[email protected]>

* fix e2e test, serverless pod use serverless.fluid.io/inject and fluid.io/managed-by two labels

Signed-off-by: xliuqq <[email protected]>

---------

Signed-off-by: xliuqq <[email protected]>
Signed-off-by: cheyang <[email protected]>
@cheyang
Build docker images for refactoring dataflow controller, To #57240825 (…
d173184 
…fluid-cloudnative#4181)

Signed-off-by: cheyang <[email protected]>
@wjlwjlwjlwjlwjlwjlwjl @cheyang
wjl (fluid-cloudnative#4039)
8db6420 
Signed-off-by: wjlwjlwjlwjlwjlwjlwjl <[email protected]>
Co-authored-by: cheyang <[email protected]>
Signed-off-by: cheyang <[email protected]>
@dependabot @cheyang
Bump github.com/spf13/cobra from 1.8.0 to 1.8.1 (fluid-cloudnative#4166)
9c86707 
Bumps [github.com/spf13/cobra](https://github.com/spf13/cobra) from 1.8.0 to 1.8.1.
- [Release notes](https://github.com/spf13/cobra/releases)
- [Commits](spf13/cobra@v1.8.0...v1.8.1)

---
updated-dependencies:
- dependency-name: github.com/spf13/cobra
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <[email protected]>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Signed-off-by: cheyang <[email protected]>
@shengdewo @cheyang
Update utils.go (fluid-cloudnative#4116)
5731ec3 
addcopyright

Signed-off-by: cheyang <[email protected]>
@TrafalgarZZZ @cheyang
Do not skip mutation for fluid pods (fluid-cloudnative#4184)
b0c7d65 
Signed-off-by: trafalgarzzz <[email protected]>
Signed-off-by: cheyang <[email protected]>
@dependabot @cheyang
Bump github.com/felixge/fgprof from 0.9.3 to 0.9.4 (fluid-cloudnative…
d0a9dc2 
…#4169)

Bumps [github.com/felixge/fgprof](https://github.com/felixge/fgprof) from 0.9.3 to 0.9.4.
- [Release notes](https://github.com/felixge/fgprof/releases)
- [Commits](felixge/fgprof@v0.9.3...v0.9.4)

---
updated-dependencies:
- dependency-name: github.com/felixge/fgprof
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <[email protected]>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Signed-off-by: cheyang <[email protected]>
@TrafalgarZZZ @cheyang
bugfix: fix application controller manage pod lifecycle (fluid-cloudn…
f3f89cb 
…ative#4185)

Signed-off-by: trafalgarzzz <[email protected]>
Signed-off-by: cheyang <[email protected]>
@dependabot @cheyang
Bump github.com/go-logr/logr from 1.4.1 to 1.4.2 (fluid-cloudnative#4174
1c7f248 
)

Bumps [github.com/go-logr/logr](https://github.com/go-logr/logr) from 1.4.1 to 1.4.2.
- [Release notes](https://github.com/go-logr/logr/releases)
- [Changelog](https://github.com/go-logr/logr/blob/master/CHANGELOG.md)
- [Commits](go-logr/logr@v1.4.1...v1.4.2)

---
updated-dependencies:
- dependency-name: github.com/go-logr/logr
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <[email protected]>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Signed-off-by: cheyang <[email protected]>
@KlarkeZ @cheyang
cm1 (fluid-cloudnative#4114)
df3e360 
Signed-off-by: cheyang <[email protected]>
@wangshulei098 @cheyang
dataset add storageSize (fluid-cloudnative#4178)
453952f 
Signed-off-by: wangshulei098 <[email protected]>
Signed-off-by: cheyang <[email protected]>
@cheyang
Build docker images for specifying pvc storage size, To #54250932 (fl…
097dffb 
…uid-cloudnative#4187)

Signed-off-by: cheyang <[email protected]>
@backsapce @cheyang
docs: dev guide for en missing GOPATH setup (fluid-cloudnative#4188)
cf2d629 
Signed-off-by: backspace <[email protected]>
Signed-off-by: cheyang <[email protected]>
@rodestexas @cheyang
Update operation_helm.go (fluid-cloudnative#4129)
ca0ac92 
* Update operation_helm.go

modify copyright time

* Update operation_helm.go

modify copyright time.

Signed-off-by: rodestexas <[email protected]>

---------

Signed-off-by: rodestexas <[email protected]>
Signed-off-by: cheyang <[email protected]>
@dependabot @cheyang
Bump k8s.io/klog/v2 from 2.120.1 to 2.130.1 (fluid-cloudnative#4183)
cd47b6e 
Bumps [k8s.io/klog/v2](https://github.com/kubernetes/klog) from 2.120.1 to 2.130.1.
- [Release notes](https://github.com/kubernetes/klog/releases)
- [Changelog](https://github.com/kubernetes/klog/blob/main/RELEASE.md)
- [Commits](kubernetes/klog@v2.120.1...v2.130.1)

---
updated-dependencies:
- dependency-name: k8s.io/klog/v2
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <[email protected]>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Signed-off-by: cheyang <[email protected]>
@TrafalgarZZZ @cheyang
bugfix: allow users to override juicefs attr-cache and entry-cache op…
543b18e 
…tions (fluid-cloudnative#4194)

* bugfix: allow users override attr-cache and entry-cache in JuiceFS

Signed-off-by: trafalgarzzz <[email protected]>

* go fmt

Signed-off-by: trafalgarzzz <[email protected]>

---------

Signed-off-by: trafalgarzzz <[email protected]>
Signed-off-by: cheyang <[email protected]>
@dependabot @cheyang
Bump google.golang.org/grpc from 1.64.0 to 1.65.0 (fluid-cloudnative#…
d379ecc 
…4191)

Bumps [google.golang.org/grpc](https://github.com/grpc/grpc-go) from 1.64.0 to 1.65.0.
- [Release notes](https://github.com/grpc/grpc-go/releases)
- [Commits](grpc/grpc-go@v1.64.0...v1.65.0)

---
updated-dependencies:
- dependency-name: google.golang.org/grpc
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <[email protected]>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Signed-off-by: cheyang <[email protected]>
@cheyang
Update go.mod to comply with Go 1.21 toolchain syntax (fluid-cloudnat…
ba5ef52 
…ive#4196)

* Update go mod to 1.21.10, To #57240825

Signed-off-by: cheyang <[email protected]>

* Update go mod to 1.21.10, To #57240825

Signed-off-by: cheyang <[email protected]>

---------

Signed-off-by: cheyang <[email protected]>
@cheyang
Build docker images for fixing juicefs timeout, To #57240825 (fluid-c…
2808a59 
…loudnative#4197)

Signed-off-by: cheyang <[email protected]>
@TrafalgarZZZ @cheyang
bugfix: fix early break when cleaning mount point in NodeUnpublishVol…
6f91cfb 
…ume (fluid-cloudnative#4198)

* Clean up corrupted mount points in NodeUnpublishVolume

Signed-off-by: trafalgarzzz <[email protected]>

* Clean up corrupted mount points in NodeUnpublishVolume

Signed-off-by: trafalgarzzz <[email protected]>

---------

Signed-off-by: trafalgarzzz <[email protected]>
Signed-off-by: cheyang <[email protected]>
@zrywby @cheyang
This pr is to add the translation of the Apache License notice (fluid…
7aa74a6 
…-cloudnative#4078)

* Update thin.go

Signed-off-by: cheyang <[email protected]>

* Update thin.go

Signed-off-by: cheyang <[email protected]>

* Update thin.go license header, To #54250932

Signed-off-by: cheyang <[email protected]>

* Update thin.go license header, To #54250932

Signed-off-by: cheyang <[email protected]>

---------

Signed-off-by: cheyang <[email protected]>
Co-authored-by: cheyang <[email protected]>
Signed-off-by: cheyang <[email protected]>
@dependabot @cheyang
Bump github.com/agiledragon/gomonkey/v2 from 2.11.0 to 2.12.0 (fluid-…
4c497d3 
…cloudnative#4199)

Bumps [github.com/agiledragon/gomonkey/v2](https://github.com/agiledragon/gomonkey) from 2.11.0 to 2.12.0.
- [Release notes](https://github.com/agiledragon/gomonkey/releases)
- [Commits](agiledragon/gomonkey@v2.11.0...v2.12.0)

---
updated-dependencies:
- dependency-name: github.com/agiledragon/gomonkey/v2
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <[email protected]>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Signed-off-by: cheyang <[email protected]>
@TrafalgarZZZ @cheyang
bugfix: fix jindoruntime name cannot contain jindofs (fluid-cloudnati…
cd6570e 
…ve#4202)

* bugfix: JindoRuntime cannot use a name containing "jindofs"

Signed-off-by: trafalgarzzz <[email protected]>

* todo: add todo for handling fullnameOverride

Signed-off-by: trafalgarzzz <[email protected]>

---------

Signed-off-by: trafalgarzzz <[email protected]>
Signed-off-by: cheyang <[email protected]>
@TrafalgarZZZ @cheyang
revert: "upgrade jindocache to 6.4.0 version (fluid-cloudnative#4126)…
19af9b8 
…" and downgrade JindoCache to 6.2.0 (fluid-cloudnative#4205)

Signed-off-by: trafalgarzzz <[email protected]>
Signed-off-by: cheyang <[email protected]>
@cheyang
Build docker images for reverting jindoruntime from 6.4 to 6.2, To #5…
85a18bd 
…7978385 (fluid-cloudnative#4206)

Signed-off-by: cheyang <[email protected]>
@dependabot @cheyang
Bump golang.org/x/net from 0.26.0 to 0.27.0 (fluid-cloudnative#4200)
4eb7c35 
Bumps [golang.org/x/net](https://github.com/golang/net) from 0.26.0 to 0.27.0.
- [Commits](golang/net@v0.26.0...v0.27.0)

---
updated-dependencies:
- dependency-name: golang.org/x/net
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <[email protected]>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Signed-off-by: cheyang <[email protected]>
@cheyang
Prepare 1.0.2, To #57978385 (fluid-cloudnative#4207)
78b21d1 
Signed-off-by: cheyang <[email protected]>
@dashanji @cheyang
Delete the unused rbac roles for vineyard runtime. (fluid-cloudnative…
cfcd07c 
…#4208)

Signed-off-by: Ye Cao <[email protected]>
Signed-off-by: cheyang <[email protected]>
@cheyang
Update docker image to fluid 1.0.2, To #54250932 (fluid-cloudnative#4210
80c60e6 
)

Signed-off-by: cheyang <[email protected]>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers
No reviews
Assignees
No one assigned
Labels
needs-ok-to-test
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.

[DOC] fix typo in data_migrate.go