How does thanos configure different data retention durations for different tenants

In previous practice, we have achieved prometheus Multi tenant read write ：Prometheus and Thanos Receiver Of “ Write multi tenant ” Realization _ A sunny afternoon blog -CSDN Blog

The new requirement is to configure different data retention periods for different tenants . at present compactor Components naturally do not have the ability of multi tenancy , But it has one parameter

--selector.relabel-config=<content>
                                Alternative to 'selector.relabel-config-file'
                                flag (mutually exclusive). Content of YAML file
                                that contains relabeling configuration that
                                allows selecting blocks. It follows native
                                Prometheus relabel-config syntax. See format
                                details:
                                   https://prometheus.io/docs/prometheus/latest/configuration/configuration/#

It can make compactor In the synchronization object store block Filter according to the defined rules , Take advantage of this feature , We can implement the concept of multi tenancy .

By configuring hashring, Different tenants are in different receive Will form different block flow （ It can be downloaded from compactor Component or bucketweb Component's UI Interface view ）, these block The stream has tags similar to the following ：

replica: thanos-prod-receive-1
tenant_id: tenant-a

So we can create one for each tenant compactor, adopt selector.relabel-config Specify the compactor Process only for this tenant block flow ：

#  Tenant tenant-a Of compactor To configure 
- |
  --selector.relabel-config=
    - action: keep
      source_labels: ["tenant_id"]
      regex: "tenant-a"
- --retention.resolution-raw=180d
- --retention.resolution-5m=180d
- --retention.resolution-1h=180d
 
 
#  Tenant tenant-b Of compactor To configure 
- |
  --selector.relabel-config=
    - action: keep
      source_labels: ["tenant_id"]
      regex: "tenant-b"
- --retention.resolution-raw=60d
- --retention.resolution-5m=60d
- --retention.resolution-1h=60d

The above configuration can realize tenant-a Data retention 180d,tenant-b Data retention 60d.

compactor Still abide by the principle of singleton , Only one can be configured for each tenant compactor.