Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Dnm migration test #31027

Closed
wants to merge 39 commits into from
Closed
Changes from 1 commit
Commits
Show all changes
39 commits
Select commit Hold shift + click to select a range
31e2578
Opt-in catalog migration for converting subsources to source tables
rjobanp Sep 16, 2024
92f0687
Add migration logic for source statements
rjobanp Oct 23, 2024
ed158a3
Rename the feature flag
rjobanp Oct 23, 2024
79822aa
Add new table to audit log
rjobanp Oct 23, 2024
2b4597b
Add platform check scenario to test migration
rjobanp Oct 23, 2024
c2c2152
Switch to using system vars instead of flags to allow console access …
rjobanp Oct 24, 2024
2ffc909
Fixes to migration based on testing
rjobanp Oct 24, 2024
173e52a
Also test the migration in the legacy upgrade tests
rjobanp Oct 24, 2024
f6b16a6
platform checks: unique source name
nrainer-materialize Oct 25, 2024
0ea4262
Migration structure cleanup from feedback
rjobanp Oct 25, 2024
e6c5718
Address more feedback; ensure new source name is unique
rjobanp Oct 25, 2024
ac32650
Fix legacy-upgrade checks
rjobanp Oct 25, 2024
b314264
Fixes caused by rebase on main
rjobanp Oct 25, 2024
7e03826
ci: print source table migration issues
nrainer-materialize Oct 28, 2024
99ab1dc
migration tests: pg-cdc-old-syntax
nrainer-materialize Oct 25, 2024
c8b0cd0
migration tests: extract logic
nrainer-materialize Oct 28, 2024
5758961
migration tests: improve verification
nrainer-materialize Oct 28, 2024
419b7a9
migration tests: mysql-cdc-old-syntax
nrainer-materialize Oct 28, 2024
5264bec
migration tests: testdrive-old-kafka-syntax
nrainer-materialize Oct 28, 2024
46efd89
migration tests: improve output
nrainer-materialize Oct 29, 2024
24d1732
migration tests: fixes
nrainer-materialize Oct 29, 2024
083d0c6
migration tests: fixes
nrainer-materialize Oct 29, 2024
c594b46
Fix for mysql source being restarted after new table added
rjobanp Oct 29, 2024
e811b51
Avoid needing to rewrite ids of dependent statements by changing the …
rjobanp Oct 29, 2024
237daea
Fix merge skew
jkosh44 Nov 14, 2024
28693ca
Fix dependency tracking
jkosh44 Nov 14, 2024
550d308
Fix lint
jkosh44 Nov 14, 2024
3d9cf21
Fix some issues
jkosh44 Nov 14, 2024
e1d396d
Fix dependency tracking
jkosh44 Nov 14, 2024
347f3c1
Fix merge skew
jkosh44 Nov 15, 2024
2feae7f
Update test versions
jkosh44 Nov 15, 2024
f303d3f
More merge skew fixes
jkosh44 Dec 12, 2024
dfa0bea
Update item sorting to only sort within item groups
jkosh44 Dec 16, 2024
9e25b94
Experiment for migrate
jkosh44 Dec 17, 2024
6fd6002
Fix migration idempotency
jkosh44 Dec 18, 2024
3535208
Fixup
jkosh44 Dec 18, 2024
b2ace5d
resolve merge conflicts
jkosh44 Jan 2, 2025
1f72b35
Update versions
jkosh44 Jan 14, 2025
70981c0
storage: Export primary ingestion collection
jkosh44 Jan 9, 2025
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Prev Previous commit
Next Next commit
ci: print source table migration issues
nrainer-materialize authored and jkosh44 committed Jan 14, 2025
commit 7e038264bd51ecc1bd406f1a0fb3154e88d475df
2 changes: 2 additions & 0 deletions misc/python/materialize/cli/ci_annotate_errors.py
Original file line number Diff line number Diff line change
@@ -101,6 +101,8 @@
| (FAIL|TIMEOUT)\s+\[\s*\d+\.\d+s\]
# parallel-workload
| worker_.*\ still\ running: [\s\S]* Threads\ have\ not\ stopped\ within\ 5\ minutes,\ exiting\ hard
# source-table migration
| source-table-migration\ issue
)
.* $
""",