Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Delete unsupported special column DELETE_FLAG #7068

Merged
merged 2 commits into from
Jul 26, 2024

Conversation

zverevgeny
Copy link
Collaborator

Add special column DELETE_FLAG for forward compatibility with 24.3

Copy link

github-actions bot commented Jul 24, 2024

2024-07-24 19:55:26 UTC Pre-commit check for feb6005 has started.
2024-07-24 19:55:29 UTC Build linux-x86_64-release-asan is running...
🔴 2024-07-24 21:03:30 UTC Build failed. see the build logs.
🔴 2024-07-24 21:04:58 UTC Tests run skipped.

Copy link

github-actions bot commented Jul 24, 2024

2024-07-24 19:55:47 UTC Pre-commit check for feb6005 has started.
2024-07-24 19:55:50 UTC Build linux-x86_64-release-clang14 is running...
🔴 2024-07-24 21:16:39 UTC Build failed. see the build logs.

Copy link

github-actions bot commented Jul 24, 2024

2024-07-24 19:56:02 UTC Pre-commit check for feb6005 has started.
2024-07-24 19:56:05 UTC Build linux-x86_64-relwithdebinfo is running...
🔴 2024-07-24 21:13:00 UTC Build failed. see the build logs.
🔴 2024-07-24 21:14:35 UTC Tests run skipped.

Copy link

github-actions bot commented Jul 25, 2024

2024-07-25 05:41:47 UTC Pre-commit check for fc9b614 has started.
2024-07-25 05:41:49 UTC Build linux-x86_64-release-asan is running...
🟢 2024-07-25 06:51:34 UTC Build successful.
2024-07-25 06:53:17 UTC Tests are running...
🔴 2024-07-25 08:45:03 UTC Some tests failed, follow the links below.

Test history

TESTS PASSED ERRORS FAILED SKIPPED MUTED?
9200 8688 0 413 53 46

Copy link

github-actions bot commented Jul 25, 2024

2024-07-25 05:42:06 UTC Pre-commit check for fc9b614 has started.
2024-07-25 05:42:08 UTC Build linux-x86_64-release-clang14 is running...
🟢 2024-07-25 06:57:13 UTC Build successful.

Copy link

github-actions bot commented Jul 25, 2024

2024-07-25 05:42:16 UTC Pre-commit check for fc9b614 has started.
2024-07-25 05:42:19 UTC Build linux-x86_64-relwithdebinfo is running...
🟢 2024-07-25 06:58:15 UTC Build successful.
2024-07-25 07:00:04 UTC Tests are running...
🔴 2024-07-25 08:28:05 UTC Some tests failed, follow the links below.

Test history

TESTS PASSED ERRORS FAILED SKIPPED MUTED?
9629 9139 0 410 31 49

@zverevgeny zverevgeny self-assigned this Jul 25, 2024
@zverevgeny zverevgeny linked an issue Jul 25, 2024 that may be closed by this pull request
Copy link

github-actions bot commented Jul 25, 2024

2024-07-25 16:47:15 UTC Pre-commit check for 5758dfd has started.
2024-07-25 16:47:17 UTC Build linux-x86_64-relwithdebinfo is running...
2024-07-25 16:52:07 UTC Check cancelled

Copy link

github-actions bot commented Jul 25, 2024

2024-07-25 16:47:29 UTC Pre-commit check for 5758dfd has started.
2024-07-25 16:47:32 UTC Build linux-x86_64-release-asan is running...
2024-07-25 16:52:07 UTC Check cancelled

Copy link

github-actions bot commented Jul 25, 2024

2024-07-25 16:47:47 UTC Pre-commit check for 5758dfd has started.
2024-07-25 16:47:49 UTC Build linux-x86_64-release-clang14 is running...
2024-07-25 16:52:07 UTC Check cancelled

@zverevgeny zverevgeny changed the title Add special column DELETE_FLAG for forward compatibility Delete unsupported special column DELETE_FLAG Jul 25, 2024
Copy link

github-actions bot commented Jul 25, 2024

2024-07-25 16:53:13 UTC Pre-commit check for 7344015 has started.
2024-07-25 16:53:14 UTC Build linux-x86_64-release-asan is running...
🟢 2024-07-25 17:55:35 UTC Build successful.
2024-07-25 17:57:19 UTC Tests are running...
🔴 2024-07-25 19:48:38 UTC Some tests failed, follow the links below.

Test history

TESTS PASSED ERRORS FAILED SKIPPED MUTED?
9196 9115 0 12 45 24

Copy link

github-actions bot commented Jul 25, 2024

2024-07-25 16:53:22 UTC Pre-commit check for 7344015 has started.
2024-07-25 16:53:23 UTC Build linux-x86_64-release-clang14 is running...
🟢 2024-07-25 18:05:33 UTC Build successful.

Copy link

github-actions bot commented Jul 25, 2024

2024-07-25 16:53:34 UTC Pre-commit check for 7344015 has started.
2024-07-25 16:53:36 UTC Build linux-x86_64-relwithdebinfo is running...
🟢 2024-07-25 18:04:34 UTC Build successful.
2024-07-25 18:06:20 UTC Tests are running...
🔴 2024-07-25 19:32:16 UTC Some tests failed, follow the links below.

Test history

TESTS PASSED ERRORS FAILED SKIPPED MUTED?
9628 9570 0 3 33 22

@@ -53,6 +53,7 @@ namespace NKikimr::NOlap {
enum class ENormalizerSequentialId : ui32 {
Granules = 1,
Chunks,
DeleteUnsupportedSpecialColumns,
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

добавление должно идти последовательно. это SequentialId
на этом построена схема запуска новых

Copy link
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Но у нас же падение в следующем нормализаторе.

@@ -98,6 +98,8 @@ TString TIndexInfo::GetColumnName(ui32 id, bool required) const {
return SPEC_COL_PLAN_STEP;
} else if (ESpecialColumn(id) == ESpecialColumn::TX_ID) {
return SPEC_COL_TX_ID;
} else if (ESpecialColumn(id) == ESpecialColumn::DELETE_FLAG) {
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

здесь я бы не добавлял. может не упасть там где надо

Copy link
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

В каком случае?


using TKeyBatch = std::vector<TKey>;

std::optional<std::vector<TKeyBatch>> KeysToDelete(NTabletFlatExecutor::TTransactionContext& txc, size_t maxBatchSize) {
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

const size_t

}

ui64 GetSize() const override {
return 0;
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

а это точно правильно?

Copy link
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

поправил

Copy link

github-actions bot commented Jul 26, 2024

2024-07-26 05:19:32 UTC Pre-commit check for 145eaa8 has started.
2024-07-26 05:19:35 UTC Build linux-x86_64-release-asan is running...
🟢 2024-07-26 06:24:05 UTC Build successful.
2024-07-26 06:25:47 UTC Tests are running...
🔴 2024-07-26 08:17:22 UTC Some tests failed, follow the links below.

Test history

TESTS PASSED ERRORS FAILED SKIPPED MUTED?
9196 9099 0 8 50 39

Copy link

github-actions bot commented Jul 26, 2024

2024-07-26 05:21:10 UTC Pre-commit check for 145eaa8 has started.
2024-07-26 05:21:13 UTC Build linux-x86_64-release-clang14 is running...
🟢 2024-07-26 06:41:02 UTC Build successful.

@zverevgeny zverevgeny marked this pull request as ready for review July 26, 2024 05:22
@zverevgeny zverevgeny requested a review from a team as a code owner July 26, 2024 05:22
Copy link

github-actions bot commented Jul 26, 2024

2024-07-26 05:24:38 UTC Pre-commit check for 145eaa8 has started.
2024-07-26 05:24:41 UTC Build linux-x86_64-relwithdebinfo is running...
🟢 2024-07-26 06:33:22 UTC Build successful.
2024-07-26 06:35:05 UTC Tests are running...
🔴 2024-07-26 08:01:29 UTC Some tests failed, follow the links below.

Test history

TESTS PASSED ERRORS FAILED SKIPPED MUTED?
9627 9557 0 1 32 37

@zverevgeny zverevgeny merged commit 1cbae05 into ydb-platform:stable-24-2 Jul 26, 2024
3 of 5 checks passed
zverevgeny added a commit to zverevgeny/ydb that referenced this pull request Jul 29, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

CS fails when downgrade from 24.3 to 24.2
3 participants