Skip to content

3.3.6

Latest
Latest
Compare
Choose a tag to compare
@wangsimo0 wangsimo0 released this 20 Nov 06:38
· 2690 commits to main since this release
3.3.6
8f01cfa
This commit was created on GitHub.com and signed with GitHub’s verified signature.
GPG key ID: B5690EEEBB952194
Learn about vigilant mode.

3.3.6

Release date: November 18, 2024

Improvements

  • Optimized internal repair logic for Primary Key tables. #52707
  • Optimized the internal implementation of histograms of statistics. #52400
  • Supports adjusting log level via the FE configuration item sys_log_warn_modules to reduce Hudi Catalog logging. #52709
  • Supports constant folding in the yearweek function. #52714
  • Avoided push-down for Lambda functions. #52655
  • Divided the Query Error metric into three: Internal Error Rate, Analysis Error Rate, and Timeout Rate. #52646
  • Avoided constant expressions being extracted as common expressions within array_map. #52541
  • Optimized the Text-based Rewrite of materialized views. #52498

Bug Fixes

Fixed the following issues:

  • The unique_constraints and foreign_constraints parameters were incomplete in SHOW CREATE TABLE for cloud-native tables in shared-data clusters. #52804
  • Some materialized views were activated even when enable_mv_automatic_active_check was set to false. #52799
  • Memory usage is not reducing after stale memory flush. #52613
  • Resource leak caused by Hudi file-system views. #52738
  • Concurrent Publish and Update operations on Primary Key tables may cause issues. #52687
  • Failures to terminate queries on clients. #52185
  • Multi-column List partitions cannot be pushed down. #51036
  • Incorrect result due to the lack of hasnull property in ORC files. #52555
  • An issue caused by using uppercase column names in ORDER BY during table creation. #52513
  • An error was returned after running ALTER TABLE PARTITION (*) SET ("storage_cooldown_ttl" = "xxx"). #52482

Behavior Changes

  • In earlier versions, scale-in operations would fail if there were insufficient replicas for views in the _statistics_ database. Starting from v3.3.6, if nodes are scaled in to 3 or more, view replicas are set to 3; if there is only 1 node after the scale-in, view replicas are set to 1, allowing for successful scale-in. #51799

    Affected views include:

    • column_statistics
    • histogram_statistics
    • table_statistic_v1
    • external_column_statistics
    • external_histogram_statistics
    • pipe_file_list
    • loads_history
    • task_run_history

  • New Primary Key tables no longer allow __op as a column name, even if allow_system_reserved_names is set to true. Existing tables are unaffected. #52621

  • Expression-partitioned tables cannot have partition names modified. #52557

  • Deprecated FE parameters heartbeat_mgr_blocking_queue_size and profile_process_threads_num. #52236

  • Enabled persistent index on object storage by default for Primary Key tables in shared-data clusters. #52209

  • Disallowed manual changes to bucketing methods for tables with the random bucketing method. #52120

  • Backup and Restore-related parameter changes: #52111

    • make_snapshot_worker_count supports dynamic configuration.
    • release_snapshot_worker_count supports dynamic configuration.
    • upload_worker_count supports dynamic configuration. Its default value is changed from 1 to the number of CPU cores on the machine where the BE resides.
    • download_worker_count supports dynamic configuration. Its default value is changed from 1 to the number of CPU cores on the machine where the BE resides.

  • The return type of SELECT @@autocommit has changed from BOOLEAN to BIGINT. #51946

  • Added a new FE configuration item, max_bucket_number_per_partition, to control the maximum number of buckets per partition. #47852

  • Enabled memory usage checks by default for Primary Key tables. #52393

Assets 2
Loading