Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

feat: Zenseact Open Dataset (zod) support #23

Merged
merged 1 commit into from
Nov 18, 2024
Merged

feat: Zenseact Open Dataset (zod) support #23

merged 1 commit into from
Nov 18, 2024

Conversation

egorchakov
Copy link
Contributor

@egorchakov egorchakov commented Nov 8, 2024

  • add zod (https://zod.zenseact.com/)
  • refactor TableAligner
  • flatten batch structure
  • more generic table processing: mapping -> pytree
  • group sources/readers by filetype
  • remove scripts/build_table.py + configs

@egorchakov egorchakov force-pushed the feat/zod branch 2 times, most recently from 34f22d4 to d6d7f76 Compare November 8, 2024 13:28
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Need to check if we have permissions for this

Copy link
Contributor

@sandhawalia sandhawalia left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Nothing glaring that stood out expcept.

  • Gonna check on ZOD license we can add them to a public repo
  • Some clarification around Source vs Reader suffix

@egorchakov egorchakov force-pushed the feat/zod branch 2 times, most recently from 32145eb to 1957ce6 Compare November 18, 2024 12:39
- add zod (https://zod.zenseact.com/)
- refactor TableAligner
- flatten batch structure
- more generic table processing: mapping -> pytree
- group sources/readers by filetype
- remove scripts/build_table.py + configs
- test data fixes
@egorchakov egorchakov merged commit 15f45bf into main Nov 18, 2024
1 check passed
@egorchakov egorchakov deleted the feat/zod branch November 18, 2024 13:33
egorchakov added a commit that referenced this pull request Nov 20, 2024
- add zod (https://zod.zenseact.com/)
- refactor TableAligner
- flatten batch structure
- more generic table processing: mapping -> pytree
- group sources/readers by filetype
- remove `scripts/build_table.py` + configs
- test data fixes
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants