Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Cannot pick KEY from nested Avro field #1975

Closed
SamirHafez opened this issue Oct 2, 2018 · 2 comments
Closed

Cannot pick KEY from nested Avro field #1975

SamirHafez opened this issue Oct 2, 2018 · 2 comments

Comments

@SamirHafez
Copy link
Contributor

SamirHafez commented Oct 2, 2018

KSQL introduced the ability to handle nested structures for Avro records. The problem in when creating a TABLE, the KEY field provided in the WITH clause doesn't support nested fields.

Having the structure (pseudo-avro):

{"name": "hello!",
 "inner": {"id", "12345"}}

It's not possible to do:
CREATE TABLE <X> WITH (..., KEY='inner.id')

To get around this atm, it would be required to create a STREAM from the topic, then another STREAM which surfaces the required field to the root of the structure. Then it would be possible to simply use it for creating a TABLE;

@miguno
Copy link
Contributor

miguno commented Oct 2, 2018

And to add to this: It's not just Avro, it's also a problem for JSON afaict.

@rmoff
Copy link
Contributor

rmoff commented Feb 8, 2019

This should be addressed in the wider issue here #824

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

3 participants