Data and code to support "Applied Natural Language Processing" (INFO 256, Fall 2021, UC Berkeley)

Last update: Dec 06, 2022

Related tags

Overview

anlp21

Course materials for "Applied Natural Language Processing" (INFO 256, Fall 2021, UC Berkeley) Syllabus: http://people.ischool.berkeley.edu/~dbamman/info256.html

Notebook	Description
1.words/EvaluateTokenizationForSentiment	The impact of tokenization choices on sentiment classification.
1.words/ExploreTokenization	Different methods for tokenizing texts (whitespace, NLTK, spacy, regex)
1.words/TokenizePrintedBooks	Design a better tokenizer for printed books
1.words/Text_Complexity	Implement type-token ratio and Flesch-Kincaid Grade Level scores for text
2.compare/ChiSquare, Mann-Whitney Tests	Explore two tests for finding distinctive terms
2.compare/Log-odds ratio with priors	Implement the log-odds ratio with an informative (and uninformative) Dirichlet prior
3.dictionaries/DictionaryTimeSeries	Plot sentiment over time using human-defined dictionaries
3.dictionaries/Empath	Explore using Empath dictionaries to characterize texts
4.embeddings/DistributionalSimilarity	Explore distributional hypothesis to build high-dimensional, sparse representations for words
4.embeddings/WordEmbeddings	Explore word embeddings using Gensim
4.embeddings/Semaxis	Implement SemAxis for scoring terms along a user-defined axis (e.g., positive-negative, concrete-abstract, hot-cold),
4.embeddings/BERT	Explore the basics of token representations in BERT and use it to find token nearest neighbors
4.embedings/SequenceEmbeddings	Use sequence embeddings to find TV episode summaries most similar to a short description
5.eda/WordSenseClustering	Inferring distinct word senses using KMeans clustering over BERT representations
5.eda/Haiku KMeans	Explore text representation in clustering by trying to group haiku and non-haiku poems into two distinct clusters

Data and code to support "Applied Natural Language Processing" (INFO 256, Fall 2021, UC Berkeley)

Related tags

Overview

anlp21

Owner

David Bamman

Code for lyric-section-to-comment generation based on huggingface transformers.

Text to speech for Vietnamese, ez to use, ez to update

Simple GUI where you can enter an article and get a crisp summarized version.

This is the Alpha of Nutte language, she is not complete yet / Essa é a Alpha da Nutte language, não está completa ainda

Dope Wars game engine on StarkNet L2 roll-up

GCRC: A Gaokao Chinese Reading Comprehension dataset for interpretable Evaluation

The Internet Archive Research Assistant - Daily search Internet Archive for new items matching your keywords

Silero Models: pre-trained speech-to-text, text-to-speech models and benchmarks made embarrassingly simple

jel - Japanese Entity Linker - is Bi-encoder based entity linker for japanese.

原神抽卡记录数据集-Genshin Impact gacha data

Test finetuning of XLSR (multilingual wav2vec 2.0) for other speech classification tasks

nlabel is a library for generating, storing and retrieving tagging information and embedding vectors from various nlp libraries through a unified interface.

ChessCoach is a neural network-based chess engine capable of natural-language commentary.

A simple word search made in python

Simple Text-To-Speech Bot For Discord

⚡ boost inference speed of T5 models by 5x & reduce the model size by 3x using fastT5.

A natural language modeling framework based on PyTorch

Pytorch-Named-Entity-Recognition-with-BERT

Count the frequency of letters or words in a text file and show a graph.

A Python 3.6+ package to run .many files, where many programs written in many languages may exist in one file.