Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Build a dashboard using StreamSets to demo how one can visualize Flink output. #31

Closed
j3-signalroom opened this issue Aug 12, 2024 · 1 comment · Fixed by #363 or #375
Closed

Build a dashboard using StreamSets to demo how one can visualize Flink output. #31

j3-signalroom opened this issue Aug 12, 2024 · 1 comment · Fixed by #363 or #375
Assignees
@j3-signalroom
Labels
enhancement New feature or request
Milestone
Provide the abili...

Comments

@j3-signalroom
Copy link
Owner

No description provided.

@j3-signalroom j3-signalroom added the enhancement New feature or request label Aug 12, 2024
@j3-signalroom j3-signalroom self-assigned this Aug 12, 2024
j3-signalroom added a commit that referenced this issue Oct 15, 2024
@j3-signalroom
See #31. Code complete.
c93a7f7
j3-signalroom added a commit that referenced this issue Oct 16, 2024
@j3-signalroom
See #31. Ensured the bucket_name is following the standard S3 naming …
2184486 
…convention for bucket names.
j3-signalroom added a commit that referenced this issue Oct 16, 2024
@j3-signalroom
See #31. This set of code used an in-memory Iceberg catalog for Flink.
fde3b1b
j3-signalroom added a commit that referenced this issue Oct 17, 2024
@j3-signalroom
See #31. Removed deprecated registerCatalog method.
4653acd
j3-signalroom added a commit that referenced this issue Oct 17, 2024
@j3-signalroom
See #31. Getting closer.
9a4a47d
j3-signalroom added a commit that referenced this issue Oct 17, 2024
@j3-signalroom
See #31. Getting closer.
38b2989
j3-signalroom added a commit that referenced this issue Oct 17, 2024
@j3-signalroom
See #31 and #362. Refactored.
e814144
j3-signalroom added a commit that referenced this issue Oct 17, 2024
@j3-signalroom
See #31 and #362. Refactored.
c472992
j3-signalroom added a commit that referenced this issue Oct 17, 2024
@j3-signalroom
See #31 and #362. Add the AWS Region argument flag.
4bd67d9
@j3-signalroom j3-signalroom linked a pull request Oct 17, 2024 that will close this issue
GitHub issue 31 #363
Merged
@j3-signalroom
Copy link
Owner Author

The code had to switch out the in-memory Catalog for the DataGeneratorApp, FlightImporterApp, and FlyerStatsApp Flink Apps to use the AWS Glue data catalog instead. This allows the ability to read the Iceberg metadata/data in a Streamlit application.

@j3-signalroom j3-signalroom moved this from Todo to In Progress in J3 Public Projects Oct 18, 2024
j3-signalroom added a commit that referenced this issue Oct 18, 2024
@j3-signalroom
See #31. Expose Streamlit port 8501 to host.
0ea0f0e
j3-signalroom added a commit that referenced this issue Oct 18, 2024
@j3-signalroom
See #31. Initial code complete.
6805202
j3-signalroom added a commit that referenced this issue Oct 18, 2024
@j3-signalroom
See #31. Add comments.
567e1a9
j3-signalroom added a commit that referenced this issue Oct 19, 2024
@j3-signalroom
See #31. Refactored.
0c85f43
j3-signalroom added a commit that referenced this issue Oct 19, 2024
@j3-signalroom
See #31. Work in progress.
a8b53b0
@j3-signalroom j3-signalroom linked a pull request Oct 19, 2024 that will close this issue
GitHub issue 31 a #375
Merged
@github-project-automation github-project-automation bot moved this from In Progress to Done in J3 Public Projects Oct 19, 2024
@j3-signalroom j3-signalroom moved this from Done to In Progress in J3 Public Projects Oct 19, 2024
@j3-signalroom j3-signalroom reopened this Oct 19, 2024
@github-project-automation github-project-automation bot moved this from In Progress to Done in J3 Public Projects Oct 19, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@j3-signalroom j3-signalroom

Labels
enhancement New feature or request
Projects
J3 Public Projects
Status: Done
Milestone
Provide the ability to sink the resul...
1 participant
@j3-signalroom