Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Two internal topics are not cleaned up after terminating query for FK join #8456

Closed
SamiShaikh opened this issue Dec 6, 2021 · 0 comments · Fixed by #8520
Closed

Two internal topics are not cleaned up after terminating query for FK join #8456

SamiShaikh opened this issue Dec 6, 2021 · 0 comments · Fixed by #8520
Assignees
Labels
blocker bug streaming-engine Tickets owned by the ksqlDB Streaming Team

Comments

@SamiShaikh
Copy link

Describe the bug
Two internal topics(KTABLE-FK-JOIN-SUBSCRIPTION-RESPONSE and KTABLE-FK-JOIN-SUBSCRIPTION-REGISTRATION) don't get deleted after terminating query for FK join.

To Reproduce
Version 0.21.0 (CP 7.0.0)

  1. Create a FK join between tables
create table T1_LHS(id struct<id1 varchar, code varchar> primary key, fk1 varchar, desc varchar) with(kafka_topic='T1_LHS_topic',partitions=3,key_format='json',value_format='json');
create table T1_RHS(id struct<id1 varchar> primary key, desc varchar) with(kafka_topic='T1_RHS_topic',partitions=3,key_format='json',value_format='json');
create table T1_JOIN as select T1_RHS.id FK_ID,T1_RHS.desc DESC_RHS,T1_LHS.id LHS_ID, T1_LHS.desc LHS_DESC from T1_LHS INNER JOIN T1_RHS ON STRUCT(ID1 := T1_LHS.FK1) = T1_RHS.ID;
  1. Check internal topics
 _confluent-ksql-default_query_CTAS_T1_JOIN_97-KTABLE-FK-JOIN-SUBSCRIPTION-REGISTRATION-0000000012-topic    | 3          | 1                  
 _confluent-ksql-default_query_CTAS_T1_JOIN_97-KTABLE-FK-JOIN-SUBSCRIPTION-RESPONSE-0000000020-topic        | 3          | 1                  
 _confluent-ksql-default_query_CTAS_T1_JOIN_97-KTABLE-FK-JOIN-SUBSCRIPTION-STATE-STORE-0000000016-changelog | 3          | 1                  
 _confluent-ksql-default_query_CTAS_T1_JOIN_97-KafkaTopic_Left-Reduce-changelog                             | 3          | 1                  
 _confluent-ksql-default_query_CTAS_T1_JOIN_97-KafkaTopic_Right-Reduce-changelog                            | 3          | 1                  
 _confluent-ksql-default_query_CTAS_T1_JOIN_97-Project-Last-changelog                                       | 3          | 1 

3.Terminate the query

Expected behavior
All internal topics are deleted

Actual behaviour
Two internal topics are not deleted

- [ ]  _confluent-ksql-default_query_CTAS_T1_JOIN_97-KTABLE-FK-JOIN-SUBSCRIPTION-REGISTRATION-0000000012-topic | 3          | 1                  
- [ ]  _confluent-ksql-default_query_CTAS_T1_JOIN_97-KTABLE-FK-JOIN-SUBSCRIPTION-RESPONSE-0000000020-topic     | 3          | 1  
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
blocker bug streaming-engine Tickets owned by the ksqlDB Streaming Team
Projects
None yet
Development

Successfully merging a pull request may close this issue.

4 participants