The aim of this task is to predict someone's English proficiency based on a text input.

Last update: Dec 13, 2021

Overview

English_proficiency_prediction_NLP

The aim of this task is to predict someone's English proficiency based on a text input.

Using the The NICT JLE Corpus available here : https://alaginrc.nict.go.jp/nict_jle/index_E.html

The source of the corpus data is the transcripts of the audio-recorded speech samples of 1,281 participants (1.2 million words, 300 hours in total) of English oral proficiency interview test. Each participant got a SST (Standard Speaking Test) score between 1 (low proficiency) and 9 (high proficiency) based on this test.

The goal is to build a machine learning algorithm for predicting the SST score of each participant based on their transcript.

Steps:

1 - Pre-process the dataset: extract the participant transcript (all tags). Inside participant transcript, you can remove all other tags and extract only English words.

2 - Process the dataset: extract features with the Bag of Word (BoW) technique

3 - Train a classifier to predict the SST score

4 - Compute the accuracy of your system (the number of participant classified correctly) and plot the confusion matrix.

5 - Try to improve your system (for example you can try to use GloVe instead of BoW).

The aim of this task is to predict someone's English proficiency based on a text input.

Related tags

Overview

English_proficiency_prediction_NLP

Owner

Simple text to phones converter for multiple languages

Text Classification Using LSTM

Sapiens is a human antibody language model based on BERT.

Neural-Machine-Translation - Implementation of revolutionary machine translation models

A linter to manage all your python exceptions and try/except blocks (limited only for those who like dinosaurs).

This project aims to conduct a text information retrieval and text mining on medical research publication regarding Covid19 - treatments and vaccinations.

A Domain Specific Language (DSL) for building language patterns. These can be later compiled into spaCy patterns, pure regex, or any other format

An example project using OpenPrompt under pytorch-lightning for prompt-based SST2 sentiment analysis model

Big Bird: Transformers for Longer Sequences

Machine Psychology: Python Generated Art

This code extends the neural style transfer image processing technique to video by generating smooth transitions between several reference style images

Perform sentiment analysis on textual data that people generally post on websites like social networks and movie review sites.

💥 Fast State-of-the-Art Tokenizers optimized for Research and Production

【原神】自动演奏风物之诗琴的程序

Code for CodeT5: a new code-aware pre-trained encoder-decoder model.

Diaformer: Automatic Diagnosis via Symptoms Sequence Generation

Japanese synonym library

Sequence-to-Sequence Framework in PyTorch

A high-level Python library for Quantum Natural Language Processing

One Stop Anomaly Shop: Anomaly detection using two-phase approach: (a) pre-labeling using statistics, Natural Language Processing and static rules; (b) anomaly scoring using supervised and unsupervised machine learning.