Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

what data types does the "pegasus2avro" supports? #1963

Closed
HondaHsu2020 opened this issue Oct 27, 2020 · 4 comments
Closed

what data types does the "pegasus2avro" supports? #1963

HondaHsu2020 opened this issue Oct 27, 2020 · 4 comments
Labels
question Question

Comments

@HondaHsu2020
Copy link

in bootstrap_mce.dat :
"type": {
"type": {
"com.linkedin.pegasus2avro.schema.StringType": {}
}

the "varchar" type in mysql map the "String" type of pegasus2avro,so, I want to know what data types does the "pegasus2avro" supports?

@HondaHsu2020 HondaHsu2020 added the question Question label Oct 27, 2020
@mars-lan
Copy link
Contributor

@jplaisted
Copy link
Contributor

jplaisted commented Oct 27, 2020

Better yet, use the Java version of the CLI (under metadata-ingestion-examples/mce-cli), which consumes a json file rather than avro. Much easier to use.

I should've moved the old python version to contrib as part of #1871, not sure why I didn't. Let me move it.

@jjoyce0510
Copy link
Collaborator

@HondaHsu2020 Hopefully the responses above helped to answer your questions.

cc. @shirshanka to close the ticket

@shirshanka
Copy link
Contributor

@HondaHsu2020 : we've overhauled and simplified the metadata ingestion story. Check out the documentation here: https://datahubproject.io/docs/metadata-ingestion/ and the example MCE files here: https://github.com/linkedin/datahub/tree/master/metadata-ingestion/examples/mce_files

Closing this.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
question Question
Projects
None yet
Development

No branches or pull requests

5 participants