-
Notifications
You must be signed in to change notification settings - Fork 35
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Fix table parse bugs #27
Conversation
So this work may be in conflict with the work @cgivre is doing to try to propagate the full schemas into super set with dots in it. It looks like the work is using extensions only, but with drill, you can select from a directory of csv, json, tsv, etc files and have it work, so relying only the extension may be problematic. @cgivre, what are your thoughts here? |
@JohnOmernik , I have added test cases for the each of the cases you mentioned above.Also , I tested the following scenarios in my personal EC2 cluster
Also , this change would be more on a query side to populate the data. Also , this change would fix the issue in SQL lab and chart building UIs. @JohnOmernik , @cgivre , Let me know what you think . If you think this change will be conflicting, then I can go ahead make changes to better integrate the changes |
So, I want @cgirve to look at things for sure. The sadrill.py removal of I think would hurt what he's trying to do with better Superset integration. So let's wait for his comment. Another test to add that I know works in Drill is select * from namespace.schema.folder/*.extension |
@JohnOmernik |
@JohnOmernik , I will try to test select * from namespace.schema.folder/*.extension and update here |
Added unit tests to handle wildcard query use case
9148397
to
9a36709
Compare
I added a test case for the query you mentioned @JohnOmernik . |
Hello Guys, do you think I need to make further changes to the PR or is it okay to merge ? |
I just merged @cgivre latest. Do we still have issues or are we safe now with the updates in Superset? |
Superset is working very well with the dialect and the REST interface. I've not tested it extensively with JDBC, but I will do so this week, so look for some additional updates.
Once JDBC is sorted out, I'd like to push this whoe thing to Pypi/Conda for ease of installation.
…-- C
On Sep 3, 2019, at 10:36 AM, John Omernik ***@***.***> wrote:
I just merged @cgivre <https://github.com/cgivre> latest. Do we still have issues or are we safe now with the updates in Superset?
—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHub <#27?email_source=notifications&email_token=ABKB7PS7NQNX3AOZUHREUSLQHZY6BA5CNFSM4HMUF3B2YY3PNVWWK3TUL52HS4DFVREXG43VMVBW63LNMVXHJKTDN5WW2ZLOORPWSZGOD5YNB6Y#issuecomment-527487227>, or mute the thread <https://github.com/notifications/unsubscribe-auth/ABKB7PRFFLBHBCW5SVD534TQHZY6BANCNFSM4HMUF3BQ>.
|
So you guys think that this PR is no longer needed ? |
Is this PR still needed? I just pushed a change that fixes view handling. IMHO, this dialect is pretty solid. |
No I think we can safely close this PR now that the issue is fixed on the Superset side |
Do you want to close this PR? Not sure that it is relevant anymore. |
Closing the PR. I guess its not needed anymore |
The current table + schema parse bug fails as per the issue raised here.
This PR aims to fix those bugs and help users use SQLAlchemy layer on drill more effectively.
Also , I have tested these changes on my local machine / EC2 with superset queries