NLP codes implemented with Pytorch (w/o library such as huggingface)
scripts
├── models: Neural Network models
├── data: codes for dataloader and dataset or pre-processing
├── metrics
├── <[inference_for_each_task].py> ex) chit_chat.py, translate.py and classify_doc.py
└── <train_[task_name].py>... ex) train_summarization.py
└── utils: codes for utility and processing operation such as TF-IDF and crawler
Korean Stereotype Detector Korean stereotype sentence classifier using K-StereoSet with TUNiB-Electra Web demo you can test this model easily in demo
sleepwalk Exploring dimension-reduced embeddings This is the code repository. See here for the Sleepwalk web page. License and disclaimer This program
Ceaser-Cipher The Caesar Cipher technique is one of the earliest and simplest me
CVSS: A Massively Multilingual Speech-to-Speech Translation Corpus CVSS is a massively multilingual-to-English speech-to-speech translation corpus, co
GPT2-Pytorch with Text-Generator Better Language Models and Their Implications Our model, called GPT-2 (a successor to GPT), was trained simply to pre
Text To Handwritten Notes Converts text into a PDF of handwritten notes Explore the docs » · Report Bug · Request Feature · Steps: $ git clone https:/
Machine Psychology: Python Generated Art A limited collection of 64 algorithmically generated artwork. Each unique piece is then given a title by the
Magnitude: a fast, simple vector embedding utility library A feature-packed Python package and vector storage file format for utilizing vector embeddi
Simple Transformer I've written a series of articles on the transformer architecture and language models on Medium. This repository contains an implem
summarizers summarizers is package for controllable summarization based CTRLsum. currently, we only supports English. It doesn't work in other languag
Automatic summarization is the process of shortening a text document with software, in order to create a summary with the major points of the original document. Technologies that can make a coherent
Word Bot for JKLM Bomb Party A bot for Bomb Party on https://www.jklm.fun (Only English) Requirements pynput pyperclip pyautogui Usage: Step 1: Run th
Extracting OpenAI CLIP (Global/Grid) Features from Image and Text This repo aims at providing an easy to use and efficient code for extracting image &
An open-source NLP library: fast text cleaning and preprocessing
NL-Augmenter 🦎 → 🐍 The NL-Augmenter is a collaborative effort intended to add transformations of datasets dealing with natural language. Transformat
Disfl-QA is a targeted dataset for contextual disfluencies in an information seeking setting, namely question answering over Wikipedia passages. Disfl-QA builds upon the SQuAD-v2 (Rajpurkar et al., 2
Harvis Harvis is designed to automate your C2 Infrastructure, currently using Mythic C2. 📌 What is it? Harvis is a python tool to help you create mul
TaCL: Improve BERT Pre-training with Token-aware Contrastive Learning
GPT-3: Language Models are Few-Shot Learners arXiv link Recent work has demonstrated substantial gains on many NLP tasks and benchmarks by pre-trainin
Lingtrain Aligner ML powered library for the accurate texts alignment in different languages. Purpose Main purpose of this alignment tool is to build
11 Feb 18, 2022
91 Nov 29, 2022
2 May 12, 2022
118 Jan 06, 2023
775 Jan 08, 2023
63 Oct 09, 2022
67 Dec 13, 2022
1.5k Jan 02, 2023
4 Jan 20, 2022
72 Dec 07, 2022
1 Oct 18, 2022
7 Oct 30, 2022
13 Jan 06, 2023
21 Mar 18, 2022
684 Jan 09, 2023
99 Oct 06, 2022
26 Oct 17, 2022
12.5k Jan 05, 2023
76 Dec 14, 2022