当前位置:网站首页>Explanation of input components in Chapter 16
Explanation of input components in Chapter 16
2022-04-23 13:24:00 【Feige big data】
introduction
In the last article , We introduced :XML input stream (StAX) Various detailed settings of components , Finally, the actual combat demonstrates how to operate it to read the data on the disk xml file 、 And the operation of cleaning data .
In this article , Let's go on to introduce :kettle Input components in , Previously, we introduced some common input components . This article expands to explain some uncommon components , These components are very simple to operate , So I'll just show you how to operate , I won't explain the options in detail as before , You can see how to use .
transformation
transformation (transaformation) yes ETL The main part of the solution , It handles extraction 、 transformation 、 Loading various operations on data lines .
Create transformations
What we have to do ETL operation , It's all designed in transformation , So we need to create a transformation first .
Save conversion
Give you a new conversion , Name it , And save
Generate records
brief introduction
You need to turn part of the text data into data lines , Each field acts as a column of a data row , Then you can use this component
Preview the record
Generate random number
brief introduction
In the use of Kettle During data warehousing , It often involves for ID Field generates a unique identifier , and UUID It's usually our choice to generate a unique representation , This is the time to use “ Generate random number ” Functional operators , adopt “ Generate random number ” Can generate UIID.
On a daily basis , Sometimes I just want to test with some data , But I don't want to get it from the database or Excel Input , Then you can generate random numbers .
Preview the record ( Execute many times )
You can see , The result of each run is different , Because every time it's a random number .
Custom constant data
brief introduction
Custom constant data , It's generation key-value Constant data in the form of .
Preview the record
Get system information
brief introduction
System information refers to Kettle Information about the system environment , Include the date of the computer system , Time type information such as week , Computer name 、IP Address 、 Start and end time of conversion or job ( Used for incremental data processing )、 Information about the completion of the previous job and command line parameters, etc .
By obtaining system information components , We can get these data .
choice Type of system information
List Kettle All types of information are supported
Customize several system changes
Preview the record
Conclusion
This article mainly explains : Generate record component 、 Generate random number components 、 Custom constant data component 、 Get system information components .
As of this article ,kettle Input components for , All the commonly used basics are introduced . The main explanation in the follow-up is :kettle The output components of .
brother , In fact, there is a distance between thinking and acting , If you think about it, it's gone , But you're doing it , It landed .
Don't say anything , Brothers, follow me and it's over , We still break up the way of kneading to say . The following content is more wonderful , Coming soon , Thank you for your attention !!
版权声明
本文为[Feige big data]所创,转载请带上原文链接,感谢
https://yzsam.com/2022/04/202204231151524383.html
边栏推荐
- Interface idempotency problem
- Hbuilderx + uniapp packaging IPA submission app store stepping on the pit
- mui 关闭其他页面,只保留首页面
- 2021年6月程序员工资统计,平均15052元,你拖后腿了吗?
- Request和Response及其ServletContext总结
- Solve the problem of Oracle Chinese garbled code
- [point cloud series] pointfilter: point cloud filtering via encoder decoder modeling
- [notes de marche]
- 【行走的笔记】
- 在 pytorch 中加载和使用图像分类数据集 Fashion-MNIST
猜你喜欢
[dynamic programming] 221 Largest Square
面试官给我挖坑:单台服务器并发TCP连接数到底可以有多少 ?
./gradlew: Permission denied
Isparta is a tool that generates webp, GIF and apng from PNG and supports the transformation of webp, GIF and apng
Mui + hbuilder + h5api simulate pop-up payment style
According to the salary statistics of programmers in June 2021, the average salary is 15052 yuan. Are you holding back?
mui + hbuilder + h5api模拟弹出支付样式
2021年6月程序员工资统计,平均15052元,你拖后腿了吗?
浅谈js正则之test方法bug篇
Short name of common UI control
随机推荐
Isparta is a tool that generates webp, GIF and apng from PNG and supports the transformation of webp, GIF and apng
Common interview questions and detailed analysis of the latest Android developers in 2020
The filter() traverses the array, which is extremely friendly
AUTOSAR from introduction to mastery lecture 100 (84) - Summary of UDS time parameters
torch. Where can transfer gradient
9419 page analysis of the latest first-line Internet Android interview questions
2021年6月程序员工资统计,平均15052元,你拖后腿了吗?
Playwright contrôle l'ouverture de la navigation Google locale et télécharge des fichiers
Data warehouse - what is OLAP
What do the raddr and rport in webrtc ice candidate mean?
[walking notes]
Migrating your native/mobile application to Unified Plan/WebRTC 1.0 API
Feature Engineering of interview summary
100 lectures on practical application cases of Excel (VIII) - report connection function of Excel
[point cloud series] relationship based point cloud completion
UEFI learning 01-arm aarch64 compilation, armplatformpripeicore (SEC)
Processbuilder tool class
[multi screen interaction] realize dual multi screen display II: startactivity mode
ECDSA signature verification principle and C language implementation
Common commands of ADB shell