Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[NEW FEATURE] - Data Importer #6

Open
JfrAziz opened this issue May 6, 2024 · 1 comment
Open

[NEW FEATURE] - Data Importer #6

JfrAziz opened this issue May 6, 2024 · 1 comment
Labels
good first issue Good for newcomers help wanted Extra attention is needed

Comments

@JfrAziz
Copy link
Member

JfrAziz commented May 6, 2024

we want to develop new feature to import raw data, like excel, csv, or maybe parquet to postgresql. and here the design that I think match to this project (if you have another approach, let me know).

  1. first we need multi data source importer, this will import any data source like csv, excel, or another format to javascript object, the data and the column information. we can add more source as long we can import it to same format.
  2. then with that data and column information, we can build simple DDL and DML to create query to create the table also insert all rows to new table.
  3. run query

Design

this just simple design, in the UI we can add features like raw data viewer, query and column editor before import the data.

reference

@JfrAziz JfrAziz added good first issue Good for newcomers help wanted Extra attention is needed labels May 6, 2024
@JfrAziz JfrAziz mentioned this issue May 6, 2024
Closed
@aadrian
Copy link

aadrian commented Jun 6, 2024

@JfrAziz by just using https://www.papaparse.com/ , the first two steps are already solved ("raw data importer", and "data/json + column identification" ) - see the examples there.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
good first issue Good for newcomers help wanted Extra attention is needed
Projects
None yet
Development

No branches or pull requests

2 participants