-
Notifications
You must be signed in to change notification settings - Fork 300
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
[ISSUE 21] Adding timezone support #130
Conversation
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
in a follow-up PR, we should create the associated extractors/fieldwriters/holders to make TIMESTAMPMILLI work with the extractor framework (and update the example connector to test it).
...-dynamodb/src/main/java/com/amazonaws/athena/connectors/dynamodb/util/DDBRecordMetadata.java
Show resolved
Hide resolved
...-dynamodb/src/main/java/com/amazonaws/athena/connectors/dynamodb/util/DDBRecordMetadata.java
Show resolved
Hide resolved
athena-dynamodb/src/main/java/com/amazonaws/athena/connectors/dynamodb/util/DDBTypeUtils.java
Show resolved
Hide resolved
athena-dynamodb/src/main/java/com/amazonaws/athena/connectors/dynamodb/util/DDBTypeUtils.java
Show resolved
Hide resolved
* Class for representing timezone to be used in encoding datetime value and timezone value to a single long | ||
* a copy from Presto TimeZoneKey | ||
*/ | ||
public final class TimeZoneKey |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
is it possible to unpack/pack only on the Athena side? We may be leaking too much Athena-specific nuance here.
...on-sdk/src/main/java/com/amazonaws/athena/connector/lambda/handlers/GlueMetadataHandler.java
Show resolved
Hide resolved
...n-sdk/src/main/java/com/amazonaws/athena/connector/lambda/metadata/glue/DefaultGlueType.java
Show resolved
Hide resolved
athena-federation-sdk/src/main/java/com/amazonaws/athena/connector/lambda/data/BlockUtils.java
Show resolved
Hide resolved
athena-federation-sdk/src/main/java/com/amazonaws/athena/connector/lambda/data/BlockUtils.java
Show resolved
Hide resolved
...-federation-sdk/src/main/java/com/amazonaws/athena/connector/lambda/data/SupportedTypes.java
Show resolved
Hide resolved
|
||
/** | ||
* Class for representing timezone to be used in encoding datetime value and timezone value to a single long | ||
* a copy from Presto TimeZoneKey |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
if this is an exact copy you might need to copy attribution too. Do we really need it to be an exact copy?
Also, we need to be careful about what apache arrow type we are using for this. If a customer actually wants to use TIMESTAMPMILLI that seems to no longer be possible because we are now defining timestampmilli as something else.
...on-sdk/src/main/java/com/amazonaws/athena/connector/lambda/handlers/GlueMetadataHandler.java
Show resolved
Hide resolved
...n-sdk/src/main/java/com/amazonaws/athena/connector/lambda/metadata/glue/DefaultGlueType.java
Show resolved
Hide resolved
# DO NOT REMOVE OR MODIFY EXISTING ENTRIES | ||
# | ||
# This file contain the fixed numeric id of every supported time zone id. | ||
# Every zone id in this file must be supported by java.util.TimeZone and the | ||
# Joda time library. This is because Presto uses both java.util.TimeZone and | ||
# the Joda time## for during execution. | ||
# | ||
# suppress inspection "UnusedProperty" for whole file |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
This file makes me super nervous. Can't we get this from Java runtime somehow? what happens if we country changes its offset?
|
||
/** | ||
* Class for testing timezone to be used in encoding datetime value and timezone value to a single long | ||
* a copy from Presto TimeZoneKeyTest |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
please ensure we are putting proper attribution to presto for any code that we reuse.
Issue #, if available:
#21
Description of changes:
SDK side of changes to support timezone