Apache Doris creates dynamic partitions

Dynamic partition usage scenario

In some usage scenarios , Users will partition the table according to days , Perform routine tasks regularly every day , At this time, the user needs to manually manage the partition , Otherwise, the data import may fail because the user does not create a partition , This brings additional maintenance costs to the user .

Through the dynamic partition function , Users can set dynamic partition rules when creating tables .FE A background thread will be started , Create or delete partitions according to user specified rules . Users can also make changes to existing rules at run time .

Dynamic partitioning is in Doris 0.12 New features introduced in the release . Designed to implement lifecycle management for table level partitions (TTL), Reduce the burden of users .

The function of adding and deleting dynamic partitions is realized .

Dynamic partition only supports Range Partition .

Usage mode

Dynamic partition rules can be specified when creating tables , Or modify it at run time . Currently, only dynamic partition rules can be set for partition tables with single partition columns .

• When creating a table, specify ：

  CREATE TABLE tbl1
  (...)
  PROPERTIES
  (
      "dynamic_partition.prop1" = "value1",
      "dynamic_partition.prop2" = "value2",
      ...
  )
  

• Runtime modification

  ALTER TABLE tbl1 SET
  (
      "dynamic_partition.prop1" = "value1",
      "dynamic_partition.prop2" = "value2",
      ...