[pull] main from datafuselabs:main #45
Merged
Conversation
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
![pull[bot]](https://avatars.githubusercontent.com/in/12910?s=60&v=4){kind=small}
Add short sleep to avoid starving sled IO. This commit is meant to address the issue when building a snapshot, other IO such as appending log to sled db is delay significantly. Remove several unnecessary INFO level log.
* chore: adjust log level * refactor: Define TenantOwnershiptObject with TIdent
* feat: Introduce enterprise storage quota feature Signed-off-by: Xuanwo <[email protected]> * format taplo Signed-off-by: Xuanwo <[email protected]> * Save work Signed-off-by: Xuanwo <[email protected]> * refactor Signed-off-by: Xuanwo <[email protected]> --------- Signed-off-by: Xuanwo <[email protected]>
* chore(planner): support fast return for hash join spill * chore: check spilled_partition_set * chore: refine sqllogictest * chore: make lint
…15360) fix check all partitions for ParquetPart::ParquetFiles instead of the last only.
* refactor: session_ctx.client_ip refactor to Option<String> * fix clippy err * fix clippy err
…ntain phrase terms (#15362) * feat(query): inverted index use empty position data when query not contain phrase terms * score as optional * fix * fix * check need position in pruner * fix * fix tests * fix tests
* impl ST_DIMENSION Signed-off-by: Fan Yang <[email protected]> * impl ST_DIMENSION Signed-off-by: Fan Yang <[email protected]> --------- Signed-off-by: Fan Yang <[email protected]>
* ST_ENDPOINT Signed-off-by: Fan Yang <[email protected]> * Update geometry.rs * Update geometry.rs Signed-off-by: Fan Yang <[email protected]> --------- Signed-off-by: Fan Yang <[email protected]>
|
At least one test kind must be checked in the PR description. |
|
At least one type of change must be checked in the PR description. |
|
Pull request description must contain CLA like the following: |
|
This pull request's title is not fulfill the requirements. @pull[bot] please update it 🙏. Valid format: Valid types:
|
* purge inverted index * purge inverted index info files * add code comments * add ee sql logic test * revert default query node config * chore: cleanup * resolve merge conflicts * evict inverted index cache
ST_POINTN Signed-off-by: Fan Yang <[email protected]>
* feat(query): support explain insert with insert source * fix explain delete err * refactor explain_insert into plan/insert.rs explain * fix clippy err
* chore: enable js Date Intrinsic * chore: enable js Date Intrinsic * chore(query): reuse the script runtime during pipeline builder * chore(query): reuse the script runtime during pipeline builder
ST_SRID Signed-off-by: Fan Yang <[email protected]>
fix: adjust row count assertion in table compaction Correct the assertion to check that the row count remains unchanged during table compaction, instead of comparing it(new snapshot) to the pre-compaction snapshot. This change accounts for scenarios where the new snapshot results from a combination of compaction and insertion, potentially increasing the total number of rows.
* refactor: remove stage use stream to avoid oom. * refactor: change REMOVE_BATCH to 1000. * ci: fix flaky test.
* chore: fix snapshot-v2 versions * refactor: Minimize lock duration during raft-log export Optimize the locking mechanism in the raft-log export process. Previously, the lock was held until the export was fully completed. With this refactor: - For raft-log exports: Release the lock immediately after transferring logs to memory. - For snapshot exports: Release the lock once the snapshot file is opened. This change reduces the time the lock is held, potentially improving performance and concurrency.
…ion count in new agg singleton (#15418) * fix new agg bucket error in singleton * fix --------- Co-authored-by: jw <[email protected]>
* chore: Vendor parquet2 instead Signed-off-by: Xuanwo <[email protected]> * Add files Signed-off-by: Xuanwo <[email protected]> * Fix license Signed-off-by: Xuanwo <[email protected]> * ignore typos from upstream Signed-off-by: Xuanwo <[email protected]> * Format toml Signed-off-by: Xuanwo <[email protected]> * Format arrow Signed-off-by: Xuanwo <[email protected]> * Remove tests Signed-off-by: Xuanwo <[email protected]> * Fix test fail under all features Signed-off-by: Xuanwo <[email protected]> --------- Signed-off-by: Xuanwo <[email protected]>
* chore(query): refactor metrics * chore(query): refactor metrics * chore(query): fix VACUUM TEMPORARY FILES
* refactor: set enable_experimental_rbac_check default 1 * forbiden drop user stage in binder * fix clippy
* fix: ExistsTable should has_result_set. * ci: fix exists_tables.test * refactor: let has_result_set = schema.is_empty().
* allow append when change tracking was enabled * chore: more code comments & minor refactoring --------- Co-authored-by: dantengsky <[email protected]>
* refactor(query): enable little vacuum after query finish * refactor(query): enable little vacuum after query finish * refactor(query): enable little vacuum after query finish * refactor(query): enable little vacuum after query finish * refactor(query): enable little vacuum after query finish * refactor(query): enable little vacuum after query finish * refactor(query): enable little vacuum after query finish * refactor(query): enable little vacuum after query finish * refactor(query): enable little vacuum after query finish * refactor(query): enable little vacuum after query finish * refactor(query): enable little vacuum after query finish * refactor(query): enable little vacuum after query finish * refactor(query): enable little vacuum after query finish
refactor: remove MergeIntoSource operator
* map_size * test
refactor: ScalarVisitor refactor replace_predicate_x
* fix(functions): improve array_prepend and array_append * fix * fix * fix * fix
* Implement map_cat function Signed-off-by: shamb0 <[email protected]> * Implement map_cat function Signed-off-by: shamb0 <[email protected]> * Implement map_cat function Signed-off-by: shamb0 <[email protected]> * feat: implement map functions using MapType * merge to upstream main updates * Refactor map.rs function module based on code review feedback Signed-off-by: shamb0 <[email protected]> * Refactor map.rs function module based on code review feedback Signed-off-by: shamb0 <[email protected]> * Refactor map.rs function module based on code review feedback Signed-off-by: shamb0 <[email protected]> * Refactor map.rs function module based on code review feedback Signed-off-by: shamb0 <[email protected]> * Refactor map.rs function module based on code review feedback Signed-off-by: shamb0 <[email protected]> * Refactor map.rs function module based on code review feedback Signed-off-by: shamb0 <[email protected]> * Refactor map.rs function module based on code review feedback Signed-off-by: shamb0 <[email protected]> * Make CI HappyOF Signed-off-by: shamb0 <[email protected]> * Refactor map.rs function module based on code review feedback Signed-off-by: shamb0 <[email protected]> * Refactor map.rs function module based on code review feedback Signed-off-by: shamb0 <[email protected]> * Refactor map.rs function module based on code review feedback Signed-off-by: shamb0 <[email protected]> * Refactor map.rs function module based on code review feedback Signed-off-by: shamb0 <[email protected]> --------- Signed-off-by: shamb0 <[email protected]>
Signed-off-by: Xuanwo <[email protected]>
* ci: Bump version to 2024-02-08 (the same commit with 1.78) Signed-off-by: Xuanwo <[email protected]> * chore: Bump to rust 2024-02-08 (also 1.78) Signed-off-by: Xuanwo <[email protected]> --------- Signed-off-by: Xuanwo <[email protected]>
* fix recluster * chore: ignore stream column compare in block compact mutator * fix test
…e kill test assertion (#15443) * fix(executor): fix queries executor cluster cannot kill problem and reactivate kill test assert Signed-off-by: Liuqing Yue <[email protected]> * fix: add finish notify in graph Signed-off-by: Liuqing Yue <[email protected]> * disable queries executor, ensure not affect Signed-off-by: Liuqing Yue <[email protected]> --------- Signed-off-by: Liuqing Yue <[email protected]>
* feat: support adjust query's priority Signed-off-by: Liuqing Yue <[email protected]> * chore: refine some comments Signed-off-by: Liuqing Yue <[email protected]> * enable queries executor Signed-off-by: Liuqing Yue <[email protected]> * fix: max points should load from atomic Signed-off-by: Liuqing Yue <[email protected]> * chore: make clippy happy Signed-off-by: Liuqing Yue <[email protected]> * update and refine comments Signed-off-by: Liuqing Yue <[email protected]> * fix unit test Signed-off-by: Liuqing Yue <[email protected]> fix: license header Signed-off-by: Liuqing Yue <[email protected]> fix: license header Signed-off-by: Liuqing Yue <[email protected]> * fix: fix scheduling Signed-off-by: Liuqing Yue <[email protected]> * fix: fix scheduling Signed-off-by: Liuqing Yue <[email protected]> * fixup stateful test Signed-off-by: Liuqing Yue <[email protected]> fixup stateful test Signed-off-by: Liuqing Yue <[email protected]> fix: ci test suits permission dennie Signed-off-by: Liuqing Yue <[email protected]> * feat: add cluster mode support for set priority Signed-off-by: Liuqing Yue <[email protected]> save Signed-off-by: Liuqing Yue <[email protected]> fixup Signed-off-by: Liuqing Yue <[email protected]> * fixup Signed-off-by: Liuqing Yue <[email protected]> * disable queries executor, ensure not affect Signed-off-by: Liuqing Yue <[email protected]> * disable test Signed-off-by: Liuqing Yue <[email protected]> --------- Signed-off-by: Liuqing Yue <[email protected]>
* chore: add query_id in log. * chore: polish log for copy.
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
See Commits and Changes for more details.
Created by
pull[bot]
Can you help keep this open source service alive? 💖 Please sponsor : )