当前位置：网站首页>Flink real-time data warehouse project - Design and implementation of DWS layer

Flink real-time data warehouse project - Design and implementation of DWS layer

2022-04-23 02:05:00 【Self taught chicken with big data】

Flink Real time data warehouse project —DWS Layer design and implementation

Preface
One 、 Demand sorting
- 1. Demand sorting
- 2.DWS Layer positioning
Two 、DWS layer — Implementation of visitor theme wide table
3、 ... and 、DWS layer — Implementation of commodity theme wide table

Preface

In the front, by using shunting and other methods , Split the data into independent Kafka Topic, Next, we will work out which index items to calculate according to the demand . We output the indicators in the form of topic wide table, that is DWS What to do .