Code for "Semantic Role Labeling as Dependency Parsing: Exploring Latent Tree Structures Inside Arguments".

Last update: Nov 08, 2022

Overview

crfsrl

Yu Zhang, Qingrong Xia, Shilin Zhou, Yong Jiang, Zhenghua Li, Guohong Fu, Min Zhang. Semantic Role Labeling as Dependency Parsing: Exploring Latent Tree Structures Inside Arguments. 2021. [arxiv]

Setup

The following packages should be installed:

SuPar: == 1.1.3
PyTorch: >= 1.7
Transformers: >= 4.0

Run the following scripts to obtain the training data. Please make sure PTB and OntoNotes are available:

bash scripts/conll05.sh PTB=<path-to-ptb>             SRL=data
bash scripts/conll12.sh ONTONOTES=<path-to-ontonotes> SRL=data

Run

Try the following commands to train first-order CRF and second-order CRF2o models:

# LSTM
# CRF
python -u crf.py   train -b -c configs/conll05.crf.srl.lstm.char-lemma.ini   -d 0 -f char lemma -p exp/conll05.crf.srl.lstm.char-lemma/model
# CRF2o
python -u crf2o.py train -b -c configs/conll05.crf2o.srl.lstm.char-lemma.ini -d 0 -f char lemma -p exp/conll05.crf2o.srl.lstm.char-lemma/model
# BERT finetuning
# CRF
python -u crf.py   train -b -c configs/conll05.crf.srl.bert.ini   -d 0 -p exp/conll05.crf.srl.bert/model   --batch-size=1000 --encoder bert --bert bert-large-cased 
# CRF2o
python -u crf2o.py train -b -c configs/conll05.crf2o.srl.bert.ini -d 0 -p exp/conll05.crf2o.srl.bert/model --batch-size=1000 --encoder bert --bert bert-large-cased

To do evaluation:

# end-to-end
python -u crf.py   evaluate -c configs/conll05.crf.srl.bert.ini  -d 0 -p exp/conll05.crf.srl.bert/model    --data data/conll05/test.conllu
# w/ gold predicates
python -u crf.py   evaluate -c configs/conll05.crf.srl.bert.ini  -d 0 -p exp/conll05.crf.srl.bert/model    --data data/conll05/test.conllu --prd

To make predictions:

python -u crf.py   predict  -c configs/conll05.crf.srl.bert.ini   -d 0 -p exp/conll05.crf.srl.bert/model   --data data/conll05/test.conllu --pred pred.conllu
bash scripts/eval.sh pred=pred.conllu gold=data/conll05/test.conllu

Contact

If you have any questions, feel free to contact me via emails.

Code for "Semantic Role Labeling as Dependency Parsing: Exploring Latent Tree Structures Inside Arguments".

Related tags

Overview

crfsrl

Setup

Run

Contact

Owner

Yu Zhang

This library is testing the ethics of language models by using natural adversarial texts.

CLIPfa: Connecting Farsi Text and Images

Using context-free grammar formalism to parse English sentences to determine their structure to help computer to better understand the meaning of the sentence.

This repository structures data in title, summary, tags, sentiment given a fragment of a conversation

Code for lyric-section-to-comment generation based on huggingface transformers.

Reading Wikipedia to Answer Open-Domain Questions

Transformer-based Text Auto-encoder (T-TA) using TensorFlow 2.

Conversational text Analysis using various NLP techniques

Gold standard corpus annotated with verb-preverb connections for Hungarian.

Some embedding layer implementation using ivy library

A Python script which randomly chooses and prints a file from a directory.

Code for our paper "Mask-Align: Self-Supervised Neural Word Alignment" in ACL 2021

Just a basic Telegram AI chat bot written in Python using Pyrogram.

A collection of Classical Chinese natural language processing models, including Classical Chinese related models and resources on the Internet.

All the code I wrote for Overwatch-related projects that I still own the rights to.

Large-scale open domain KNOwledge grounded conVERsation system based on PaddlePaddle

auto_code_complete is a auto word-completetion program which allows you to customize it on your need

The training code for the 4th place model at MDX 2021 leaderboard A.

This script just scrapes the most recent Nepali news from Kathmandu Post and notifies the user about current events at regular intervals.It sends out the most recent news at random!

Text vectorization tool to outperform TFIDF for classification tasks