Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add support to add and show (create table) extra hive table properties #1176

Closed

Conversation

ankitdixit
Copy link
Member

@ankitdixit ankitdixit commented Jul 25, 2019

Fixes #954

Need help in ShowQueriesRewrite, please help me converting a map to an expression

@cla-bot cla-bot bot added the cla-signed label Jul 25, 2019
@ankitdixit ankitdixit changed the title [WIP] intial commit [WIP] Add support to add and show (create table) extra hive table properties issue 954 Jul 25, 2019
@ankitdixit
Copy link
Member Author

#954

@ankitdixit
Copy link
Member Author

Working on adding and showing properties via showCreateTable, will add merge validation post that

@dain dain assigned dain and unassigned dain Jul 27, 2019
Copy link
Member

@dain dain left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Oops, I reviewed this like a week ago and forgot to post the answer to the above question. Sorry.

When this is ready for a final review, remove the WIP label and assign it back to me.

@dain dain added the WIP label Aug 1, 2019
@findepi findepi changed the title [WIP] Add support to add and show (create table) extra hive table properties issue 954 [WIP] Add support to add and show (create table) extra hive table properties Oct 8, 2019
@findepi
Copy link
Member

findepi commented Apr 30, 2020

@ankitdixit can you please update & rebase?

this relates to #3583
cc @larandvit

@ankitdixit
Copy link
Member Author

@ankitdixit can you please update & rebase?

this relates to #3583
cc @larandvit

I somehow missed this. updating now

@ankitdixit ankitdixit force-pushed the arbitraryPropertySupport branch from ecc3267 to e7c38f3 Compare May 1, 2020 11:45
@cla-bot
Copy link

cla-bot bot commented May 1, 2020

Thank you for your pull request and welcome to our community. We could not parse the GitHub identity of the following contributors: Ankit Dixit.
This is most likely caused by a git client misconfiguration; please make sure to:

  1. check if your git client is configured with an email to sign commits git config --list | grep email
  2. If not, set it up using git config --global user.email [email protected]
  3. Make sure that the git commit email is configured in your GitHub account settings, see https://github.com/settings/emails

@cla-bot cla-bot bot removed the cla-signed label May 1, 2020
@cla-bot
Copy link

cla-bot bot commented May 2, 2020

Thank you for your pull request and welcome to our community. We could not parse the GitHub identity of the following contributors: Ankit Dixit.
This is most likely caused by a git client misconfiguration; please make sure to:

  1. check if your git client is configured with an email to sign commits git config --list | grep email
  2. If not, set it up using git config --global user.email [email protected]
  3. Make sure that the git commit email is configured in your GitHub account settings, see https://github.com/settings/emails

@aakashnand
Copy link
Member

@ankitdixit Is this only for hive connector or we can add these properties to any table? I understand that currently TBLPROPERTIES is only supported in hive but can we extend this to all connectors?

@cla-bot
Copy link

cla-bot bot commented May 4, 2020

Thank you for your pull request and welcome to our community. We could not parse the GitHub identity of the following contributors: Ankit Dixit.
This is most likely caused by a git client misconfiguration; please make sure to:

  1. check if your git client is configured with an email to sign commits git config --list | grep email
  2. If not, set it up using git config --global user.email [email protected]
  3. Make sure that the git commit email is configured in your GitHub account settings, see https://github.com/settings/emails

@ankitdixit ankitdixit force-pushed the arbitraryPropertySupport branch from fce1491 to b6f8c7d Compare May 4, 2020 11:45
@cla-bot cla-bot bot added the cla-signed label May 4, 2020
@ankitdixit
Copy link
Member Author

After this change, every show create table seems to have an extra line and a few tests are failing like:
java.lang.AssertionError: expected [CREATE TABLE hive.tpch.test_comment_table ( c1 bigint ) WITH ( format = 'RCBINARY' )] but found [CREATE TABLE hive.tpch.test_comment_table ( c1 bigint ) WITH ( extra_properties = map_from_entries(ARRAY[]), format = 'RCBINARY' )]
Should I change the tests or is there a way to not show extra properties line when they are empty

@findepi
Copy link
Member

findepi commented Jul 22, 2020

@ankitdixit we should avoid changes in the SHOW CREATE TABLE.
Did you try making extra_properties default to NULL instead?

@ankitdixit ankitdixit force-pushed the arbitraryPropertySupport branch from b6f8c7d to fce1491 Compare August 13, 2020 04:56
@cla-bot
Copy link

cla-bot bot commented Aug 13, 2020

Thank you for your pull request and welcome to our community. We could not parse the GitHub identity of the following contributors: Ankit Dixit.
This is most likely caused by a git client misconfiguration; please make sure to:

  1. check if your git client is configured with an email to sign commits git config --list | grep email
  2. If not, set it up using git config --global user.email [email protected]
  3. Make sure that the git commit email is configured in your GitHub account settings, see https://github.com/settings/emails

@cla-bot cla-bot bot removed the cla-signed label Aug 13, 2020
@ankitdixit ankitdixit force-pushed the arbitraryPropertySupport branch from fce1491 to 11fb320 Compare August 13, 2020 09:07
@cla-bot cla-bot bot added the cla-signed label Aug 13, 2020
@ankitdixit ankitdixit changed the title [WIP] Add support to add and show (create table) extra hive table properties Add support to add and show (create table) extra hive table properties Aug 13, 2020
@dain dain self-requested a review August 14, 2020 19:30
@findepi findepi marked this pull request as draft April 27, 2022 12:44
@findepi findepi removed the WIP label Apr 27, 2022
@colebow
Copy link
Member

colebow commented Oct 6, 2022

👋 @ankitdixit - this PR is inactive and doesn't seem to be under development, and it might already be implemented. If you'd like to continue work on this at any point in the future, feel free to re-open.

@colebow colebow closed this Oct 6, 2022
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Development

Successfully merging this pull request may close these issues.

Add Hive table property to for arbitrary properties
5 participants