当前位置：网站首页>NLP dataset collation (updating)

NLP dataset collation (updating)

2022-04-22 12:16:00 【Zhang mouwen's blog_ Lambda】

NLP Data set collation

Chinese and English NLP Dataset search platform , Click on Search for

One 、 Sentiment analysis

ID title Updated date Data set provider explain keyword Category remarks
1 weibo_senti_100k nothing nothing Sina Weibo marked with emotion , The positive and negative comments are about 5 Ten thousand Microblogging 、 emotional 2. Classified tasks nothing
2 Weibo Emotion Corpus 2016 The Hong Kong Polytechnic University Microblog corpus , Marking the 7 class emotions: like, disgust, happiness, sadness, anger, surprise, fear. size ： More than 40000 microblogs Microblogging 、 emotional Multi category tasks The origin of the paper
3 title Updated date Data set provider explain keyword Category nothing
4 title Updated date Data set provider explain keyword Category nothing
5 title Updated date Data set provider explain keyword Category nothing
6 title Updated date Data set provider explain keyword Category nothing
7 title Updated date Data set provider explain keyword Category nothing
8 title Updated date Data set provider explain keyword Category nothing
9 title Updated date Data set provider explain keyword Category nothing
10 title Updated date Data set provider explain keyword Category nothing
11 title Updated date Data set provider explain keyword Category nothing

Two 、 Text classification

3、 ... and 、 Text matching

Four 、 Text in this paper,

5、 ... and 、 Machine translation

6、 ... and 、NER

7、 ... and 、QA

8、 ... and 、 Knowledge map

Nine 、 corpus

Ten 、 reading comprehension

Chinese word splitting Dictionary

  1. English can do char embedding, Try Chinese Word splitting dictionary
  2. Or use Bert Pre training model Break down Chinese characters .

Chinese dataset platform

  1. Sogou lab , It provides some high-quality Chinese text data sets , Mostly for 2012 Years ago ： Portal

  2. Zhongke nature language processing and information retrieval sharing platform ： Portal

Small data of Chinese corpus

  1. Including Chinese Named Entity Recognition 、 Chinese relationship recognition 、 Some small amount of data such as Chinese reading comprehension ： Portal

  2. Wikipedia dataset ： Portal

  3. NLP Tools
    （1）THULAC：https://github.com/thunlp/THULAC ： Including Chinese participle 、 Part of speech tagging function .
    （2）HanLP：https://github.com/hankcs/HanLP
    （3） Harbin Institute of technology ：LTP https://github.com/HIT-SCIR/ltp
    （4）NLPIR：https://github.com/NLPIR-team/NLPIR
    （5）jieba：https://github.com/yanyiwu/cppjieba
    （6） Baidu Qianyan data set ：https://github.com/luge-ai/luge-ai

Reference article ： From Jane book

版权声明
本文为[Zhang mouwen's blog_ Lambda]所创，转载请带上原文链接，感谢
https://yzsam.com/2022/04/202204221209542747.html

边栏推荐

猜你喜欢

随机推荐