Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Introduce 24-1-async-replication #5418

Merged
merged 65 commits into from
Jun 10, 2024
Merged

Introduce 24-1-async-replication #5418

merged 65 commits into from
Jun 10, 2024

Commits on Jun 10, 2024

  1. Local table writer tests KIKIMR-20902 (ydb-platform#1656)

    @CyberROFL
    CyberROFL committed Jun 10, 2024
    Configuration menu
    Copy the full SHA
    fb923da View commit details
    Browse the repository at this point in the history

  2. Make UTs reachable KIKIMR-20902 (ydb-platform#1700)

    @CyberROFL
    CyberROFL committed Jun 10, 2024
    Configuration menu
    Copy the full SHA
    078230e View commit details
    Browse the repository at this point in the history

  3. Make UTs reachable (attempt 2) KIKIMR-20902 (ydb-platform#1715)

    @CyberROFL
    CyberROFL committed Jun 10, 2024
    Configuration menu
    Copy the full SHA
    e4e75ae View commit details
    Browse the repository at this point in the history

  4. Test supported types KIKIMR-20902 (ydb-platform#1865)

    @CyberROFL
    CyberROFL committed Jun 10, 2024
    Configuration menu
    Copy the full SHA
    228e4ee View commit details
    Browse the repository at this point in the history

  5. Logging & tagging KIKIMR-21006 (ydb-platform#1881)

    @CyberROFL
    CyberROFL committed Jun 10, 2024
    Configuration menu
    Copy the full SHA
    df9df42 View commit details
    Browse the repository at this point in the history

  6. Custom TEvWorker::TEvGone with status KIKIMR-21006 (ydb-platform#1946)

    @CyberROFL
    CyberROFL committed Jun 10, 2024
    Configuration menu
    Copy the full SHA
    742eaa0 View commit details
    Browse the repository at this point in the history

  7. (refactoring) Move TTestTableDescription to ut_helpers KIKIMR-21006 (y… 

    …db-platform#1985)
    @CyberROFL
    CyberROFL committed Jun 10, 2024
    Configuration menu
    Copy the full SHA
    dde3b30 View commit details
    Browse the repository at this point in the history

  8. Auto-commit offsets KIKIMR-21006 (ydb-platform#2029)

    @CyberROFL
    CyberROFL committed Jun 10, 2024
    Configuration menu
    Copy the full SHA
    374405f View commit details
    Browse the repository at this point in the history

  9. Worker implementation & tests KIKIMR-21006 (ydb-platform#2079)

    @CyberROFL
    CyberROFL committed Jun 10, 2024
    Configuration menu
    Copy the full SHA
    2f6daac View commit details
    Browse the repository at this point in the history

  10. Make ut_worker reachable KIKIMR-21006 (ydb-platform#2119)

    @CyberROFL
    CyberROFL committed Jun 10, 2024
    Configuration menu
    Copy the full SHA
    dc01fc8 View commit details
    Browse the repository at this point in the history

  11. Cosmetic changes KIKIMR-21006 (ydb-platform#2120)

    @CyberROFL
    CyberROFL committed Jun 10, 2024
    Configuration menu
    Copy the full SHA
    aca7eef View commit details
    Browse the repository at this point in the history

  12. Fix & unmute ReadTopic test KIKIMR-21110 (ydb-platform#2121)

    @CyberROFL
    CyberROFL committed Jun 10, 2024
    Configuration menu
    Copy the full SHA
    0130524 View commit details
    Browse the repository at this point in the history

  13. Add OAuth support ydb-platform#2311 (ydb-platform#2312)

    @CyberROFL
    CyberROFL committed Jun 10, 2024
    Configuration menu
    Copy the full SHA
    32ba92d View commit details
    Browse the repository at this point in the history

  14. Printable status & results (ydb-platform#2446)

    @CyberROFL
    CyberROFL committed Jun 10, 2024
    Configuration menu
    Copy the full SHA
    be59bf4 View commit details
    Browse the repository at this point in the history

  15. Fix dst creator, add tests (ydb-platform#2497)

    @CyberROFL
    CyberROFL committed Jun 10, 2024
    Configuration menu
    Copy the full SHA
    8e7559c View commit details
    Browse the repository at this point in the history

  16. Move printers to corresponding */out.cpp files (ydb-platform#2502)

    @CyberROFL
    CyberROFL committed Jun 10, 2024
    Configuration menu
    Copy the full SHA
    9a843f6 View commit details
    Browse the repository at this point in the history

  17. Get rid of hard-coded test table name (ydb-platform#2503)

    @CyberROFL
    CyberROFL committed Jun 10, 2024
    Configuration menu
    Copy the full SHA
    f312aeb View commit details
    Browse the repository at this point in the history

  18. Additional tests for dst creator (ydb-platform#2600)

    @CyberROFL
    CyberROFL committed Jun 10, 2024
    Configuration menu
    Copy the full SHA
    2cb5c7f View commit details
    Browse the repository at this point in the history

  19. Apply table profiles (ydb-platform#2627)

    @CyberROFL
    CyberROFL committed Jun 10, 2024
    Configuration menu
    Copy the full SHA
    051b187 View commit details
    Browse the repository at this point in the history

  20. Set & check replication config (ydb-platform#2649)

    @CyberROFL
    CyberROFL committed Jun 10, 2024
    Configuration menu
    Copy the full SHA
    46f95cd View commit details
    Browse the repository at this point in the history

  21. Create target discoverer once (ydb-platform#2665)

    @CyberROFL
    CyberROFL committed Jun 10, 2024
    Configuration menu
    Copy the full SHA
    5df1408 View commit details
    Browse the repository at this point in the history

  22. Introduce sessions between controller & service (ydb-platform#2744)

    @CyberROFL
    CyberROFL committed Jun 10, 2024
    Configuration menu
    Copy the full SHA
    1944053 View commit details
    Browse the repository at this point in the history

  23. (refactoring) Pass replication object to Progress() instead of a bunc… 

    …h of arguments (ydb-platform#2766)
    @CyberROFL
    CyberROFL committed Jun 10, 2024
    Configuration menu
    Copy the full SHA
    175a050 View commit details
    Browse the repository at this point in the history

  24. (refactoring) Simplify child actors creation (ydb-platform#2782)

    @CyberROFL
    CyberROFL committed Jun 10, 2024
    Configuration menu
    Copy the full SHA
    93623c0 View commit details
    Browse the repository at this point in the history

  25. (refactoring) Explicit connection params (ydb-platform#2801)

    @CyberROFL
    CyberROFL committed Jun 10, 2024
    Configuration menu
    Copy the full SHA
    a0c15cf View commit details
    Browse the repository at this point in the history

  26. Run & stop workers (ydb-platform#2860)

    @CyberROFL
    CyberROFL committed Jun 10, 2024
    Configuration menu
    Copy the full SHA
    a5c5c40 View commit details
    Browse the repository at this point in the history

  27. Special base event class for sensitive data (ydb-platform#2961)

    @CyberROFL
    CyberROFL committed Jun 10, 2024
    Configuration menu
    Copy the full SHA
    3b8b627 View commit details
    Browse the repository at this point in the history

  28. Stop YdbDriver last (ydb-platform#2992)

    @CyberROFL
    CyberROFL committed Jun 10, 2024
    Configuration menu
    Copy the full SHA
    77c7f81 View commit details
    Browse the repository at this point in the history

  29. Clear sensitive data in replication's description (ydb-platform#3044)

    @CyberROFL
    CyberROFL committed Jun 10, 2024
    Configuration menu
    Copy the full SHA
    84427d4 View commit details
    Browse the repository at this point in the history

  30. Specify '__async_replication' attr (ydb-platform#3056)

    @CyberROFL
    CyberROFL committed Jun 10, 2024
    Configuration menu
    Copy the full SHA
    a5e8294 View commit details
    Browse the repository at this point in the history

  31. Limit max mem usage by remote topic reader & other little changes (yd… 

    …b-platform#3075)
    @CyberROFL
    CyberROFL committed Jun 10, 2024
    Configuration menu
    Copy the full SHA
    27817db View commit details
    Browse the repository at this point in the history

  32. Additional logging (ydb-platform#3082)

    @CyberROFL
    CyberROFL committed Jun 10, 2024
    Configuration menu
    Copy the full SHA
    84cb8b8 View commit details
    Browse the repository at this point in the history

  33. Persist replication config (ydb-platform#3091)

    @CyberROFL
    CyberROFL committed Jun 10, 2024
    Configuration menu
    Copy the full SHA
    6c00d17 View commit details
    Browse the repository at this point in the history

  34. Close sessions on Cleanup() (ydb-platform#3197)

    @CyberROFL
    CyberROFL committed Jun 10, 2024
    Configuration menu
    Copy the full SHA
    c948d96 View commit details
    Browse the repository at this point in the history

  35. Add 'ALTER ASYNC REPLICATION' (ydb-platform#3742)

    @CyberROFL
    CyberROFL committed Jun 10, 2024
    Configuration menu
    Copy the full SHA
    dce56f7 View commit details
    Browse the repository at this point in the history

  36. Special attribute: __async_replica (ydb-platform#3760)

    @CyberROFL
    CyberROFL committed Jun 10, 2024
    Configuration menu
    Copy the full SHA
    1450daf View commit details
    Browse the repository at this point in the history

  37. ALTER ASYNC REPLICATION: scheme op (ydb-platform#3824)

    @CyberROFL
    CyberROFL committed Jun 10, 2024
    Configuration menu
    Copy the full SHA
    d9b6a83 View commit details
    Browse the repository at this point in the history

  38. {CREATE,ALTER,DROP} ASYNC REPLICATION impl (ydb-platform#3904)

    @CyberROFL
    CyberROFL committed Jun 10, 2024
    Configuration menu
    Copy the full SHA
    59dd1fc View commit details
    Browse the repository at this point in the history

  39. Validate ASYNC REPLICATION settings (ydb-platform#3973)

    @CyberROFL
    CyberROFL committed Jun 10, 2024
    Configuration menu
    Copy the full SHA
    38fa25e View commit details
    Browse the repository at this point in the history

  40. Allow to specify directories in CREATE ASYNC REPLICATION (ydb-platfor… 

    …m#4011)
    @CyberROFL
    CyberROFL committed Jun 10, 2024
    Configuration menu
    Copy the full SHA
    e65cd65 View commit details
    Browse the repository at this point in the history

  41. Drop replication with invalid credentials (ydb-platform#4320)

    @CyberROFL
    CyberROFL committed Jun 10, 2024
    Configuration menu
    Copy the full SHA
    72bf6db View commit details
    Browse the repository at this point in the history

  42. Require credentials & connection_string/endpoint (ydb-platform#4322)

    @CyberROFL
    CyberROFL committed Jun 10, 2024
    Configuration menu
    Copy the full SHA
    8508441 View commit details
    Browse the repository at this point in the history

  43. Alter replication config (ydb-platform#4333)

    @CyberROFL
    CyberROFL committed Jun 10, 2024
    Configuration menu
    Copy the full SHA
    1eb02b6 View commit details
    Browse the repository at this point in the history

  44. Differentiate simple & cascade drop (ydb-platform#4339)

    @CyberROFL
    CyberROFL committed Jun 10, 2024
    Configuration menu
    Copy the full SHA
    fa356e0 View commit details
    Browse the repository at this point in the history

  45. Special message for OAuth token (ydb-platform#4374)

    @CyberROFL
    CyberROFL committed Jun 10, 2024
    Configuration menu
    Copy the full SHA
    bf60b31 View commit details
    Browse the repository at this point in the history

  46. Support secrets: core part (ydb-platform#4389)

    @CyberROFL
    CyberROFL committed Jun 10, 2024
    Configuration menu
    Copy the full SHA
    974457d View commit details
    Browse the repository at this point in the history

  47. Support secrets: yql & kqp parts (ydb-platform#4476)

    @CyberROFL
    CyberROFL committed Jun 10, 2024
    Configuration menu
    Copy the full SHA
    2ead32e View commit details
    Browse the repository at this point in the history

  48. Reuse memory pool & pass schema version (ydb-platform#4677)

    @CyberROFL
    CyberROFL committed Jun 10, 2024
    Configuration menu
    Copy the full SHA
    21ce71d View commit details
    Browse the repository at this point in the history

  49. Specify source of changes (ydb-platform#4680)

    @CyberROFL
    CyberROFL committed Jun 10, 2024
    Configuration menu
    Copy the full SHA
    7ea0536 View commit details
    Browse the repository at this point in the history

  50. Print error in target discoverer (ydb-platform#4684)

    @CyberROFL
    CyberROFL committed Jun 10, 2024
    Configuration menu
    Copy the full SHA
    be81bae View commit details
    Browse the repository at this point in the history

  51. (refactoring) Generic base classes for ydb_proxy & scheme results (yd… 

    …b-platform#4687)
    @CyberROFL
    CyberROFL committed Jun 10, 2024
    Configuration menu
    Copy the full SHA
    b28feaf View commit details
    Browse the repository at this point in the history

  52. Alter replication config during replication alter (ydb-platform#4696)

    @CyberROFL
    CyberROFL committed Jun 10, 2024
    Configuration menu
    Copy the full SHA
    816240e View commit details
    Browse the repository at this point in the history

  53. Introduce DescribeReplication (ydb-platform#4904)

    @CyberROFL
    CyberROFL committed Jun 10, 2024
    Configuration menu
    Copy the full SHA
    4848b75 View commit details
    Browse the repository at this point in the history

  54. (refactoring) Common description printer (ydb-platform#4929)

    @CyberROFL
    CyberROFL committed Jun 10, 2024
    Configuration menu
    Copy the full SHA
    552da22 View commit details
    Browse the repository at this point in the history

  55. Fix clang14 build (ydb-platform#4933)

    @CyberROFL
    CyberROFL committed Jun 10, 2024
    Configuration menu
    Copy the full SHA
    9538537 View commit details
    Browse the repository at this point in the history

  56. Add source_changefeed_name to DescribeReplicationResult (ydb-platform… 

    …#4974)
    @CyberROFL
    CyberROFL committed Jun 10, 2024
    Configuration menu
    Copy the full SHA
    b1c8afc View commit details
    Browse the repository at this point in the history

  57. Create replicated tables with the same owner as the replication itself ( 

    ydb-platform#4983)
    @CyberROFL
    CyberROFL committed Jun 10, 2024
    Configuration menu
    Copy the full SHA
    3aa8d3d View commit details
    Browse the repository at this point in the history

  58. Get rid of deprecated 'Syncing' state (ydb-platform#5017)

    @CyberROFL
    CyberROFL committed Jun 10, 2024
    Configuration menu
    Copy the full SHA
    8371741 View commit details
    Browse the repository at this point in the history

  59. Switch replication to 'Done' state (ydb-platform#5028)

    @CyberROFL
    CyberROFL committed Jun 10, 2024
    Configuration menu
    Copy the full SHA
    dbe5fd3 View commit details
    Browse the repository at this point in the history

  60. Stop replication workers (ydb-platform#5126)

    @CyberROFL
    CyberROFL committed Jun 10, 2024
    Configuration menu
    Copy the full SHA
    df0ce0f View commit details
    Browse the repository at this point in the history

  61. Re-run workers (ydb-platform#5163)

    @CyberROFL
    CyberROFL committed Jun 10, 2024
    Configuration menu
    Copy the full SHA
    35dd6e3 View commit details
    Browse the repository at this point in the history

  62. Fix indirect leaks (ydb-platform#5188)

    @CyberROFL
    CyberROFL committed Jun 10, 2024
    Configuration menu
    Copy the full SHA
    d801fdc View commit details
    Browse the repository at this point in the history

  63. Handle worker error (ydb-platform#5217)

    @CyberROFL
    CyberROFL committed Jun 10, 2024
    Configuration menu
    Copy the full SHA
    e27ec33 View commit details
    Browse the repository at this point in the history

  64. Propagate error (ydb-platform#5240)

    @CyberROFL
    CyberROFL committed Jun 10, 2024
    Configuration menu
    Copy the full SHA
    36bfe84 View commit details
    Browse the repository at this point in the history

  65. Drop replication with unknown secret (ydb-platform#5248)

    @CyberROFL
    CyberROFL committed Jun 10, 2024
    Configuration menu
    Copy the full SHA
    8464b3f View commit details
    Browse the repository at this point in the history