WenetSpeech
A 10000+ Hours Multi-domain Chinese Corpus for Speech Recognition
Download
Please visit the official website, read the license, and follow the instruction to download the data.
Benchmark
| Toolkit | Model | test_net | test_meeting |
|---|---|---|---|
| Kaldi | Chain Model | ||
| ESPnet | Joint CTC/Conformer | ||
| WeNet | Joint CTC/Conformer |
Description
Creation
First, we collect all the data from YouTube and Podcast; Then, OCR is used to label YouTube data, auto trancrition is used to label Podcast data; Finally, a novel end-to-end label error detection method is used to further validate and filter the data.
Categories
In summary, WenetSpeech groups all data into 3 categories, as the following table shows:
| Set | Hours | Confidence | Usage |
|---|---|---|---|
| High Label | 10005 | >=0.95 | Supervised Training |
| Weak Label | 2478 | [0.6, 0.95] | Semi-supervised or noise training |
| Unlabel | 9952 | / | Unsupervised training or Pre-training |
| In Total | 22435 | / | All above |
High Label Data
All of the data is from Youtube and Podcast, and we tag all the data with its source and domain. We classify the data into 10 groups according to its domain,speaking style, or scenarios.
| Domain | Youtube | Podcast | Total |
|---|---|---|---|
| audiobook | 0 | 250.9 | 250.9 |
| commentary | 112.6 | 135.7 | 248.3 |
| documentary | 386.7 | 90.5 | 477.2 |
| drama | 4338.2 | 0 | 4338.2 |
| interview | 324.2 | 614 | 938.2 |
| news | 0 | 868 | 868 |
| reading | 0 | 1110.2 | 1110.2 |
| talk | 204 | 90.7 | 294.7 |
| variety | 603.3 | 224.5 | 827.8 |
| others | 144 | 507.5 | 651.5 |
| Total | 6113 | 3892 | 10005 |
We provide 3 training subsets, namely S, M and L. Subsets S, M are sampled from all the high label data which has the oracle confidence 1.0
| Training Subsets | Confidence | Hours |
|---|---|---|
| L | [0.95, 1.0] | 10005 |
| M | 1.0 | 1000 |
| S | 1.0 | 100 |
Evaluation Sets
| Evaluation Sets | Hours | Source | Description |
|---|---|---|---|
| DEV | 20 | Internet | Specially designed for some speech tools which require cross-validation set in training |
| TEST_NET | 23 | Internet | Match test |
| TEST_MEETING | 15 | Real meeting | Mismatch test which is far-field, conversational, and spontaneous meeting speech |
Contributors
 |
 |
 |
|---|
ACKNOWLEDGEMENTS
- WenetSpeech referred a lot of work of GigaSpeech, including metadata design, license design, data encryption, downloading pipeline, and so on. The authors would like to thank Jiayu Du and Guoguo Chen for their suggestions on this work.
- The authors would like to thank my college Lianhui Zhang, Yu Mao for collecting some of the YouTube data.
9 Jun 24, 2022
15 Dec 15, 2022
11.2k Jan 05, 2023
167 Dec 27, 2022
3 Jan 24, 2022
11 Jul 21, 2022
2 Jun 19, 2022
54 Dec 03, 2022
8 Apr 14, 2022
47 Dec 20, 2022
14 Dec 09, 2022
109 Dec 21, 2022
1 Jul 08, 2022
4 Dec 01, 2021
3.7k Jan 02, 2023
113 Dec 28, 2022
88 Dec 23, 2022
644 Jan 01, 2023
9 Jan 01, 2023
2 Jun 10, 2022