The official code of "SCROLLS: Standardized CompaRison Over Long Language Sequences".

Last update: Dec 23, 2022

Overview

SCROLLS

This repository contains the official code of the paper: "SCROLLS: Standardized CompaRison Over Long Language Sequences".

Citation

@misc{shaham2022scrolls,
      title={SCROLLS: Standardized CompaRison Over Long Language Sequences}, 
      author={Uri Shaham and Elad Segal and Maor Ivgi and Avia Efrat and Ori Yoran and Adi Haviv and Ankit Gupta and Wenhan Xiong and Mor Geva and Jonathan Berant and Omer Levy},
      year={2022},
      eprint={2201.03533},
      archivePrefix={arXiv},
      primaryClass={cs.CL}
}

Loading the SCROLLS Benchmark Datasets

via 🤗 Datasets (huggingface/datasets) library (recommended):

Installation

Usage:

from datasets import load_dataset

qasper_dataset = load_dataset("tau/scrolls", "qasper")
"""
Options are: ["gov_report", "summ_screen_fd", "qmsum", "narrative_qa", "qasper", "quality", "contract_nli"]
"""

via ZIP files, where each split is in a JSONL file:
- GovReport
- SummScreenFD
- QMSum
- NarrativeQA
- Qasper
- QuALITY
- ContractNLI

The official code of "SCROLLS: Standardized CompaRison Over Long Language Sequences".

Related tags

Overview

SCROLLS

Links

Citation

Loading the SCROLLS Benchmark Datasets

Owner

TAU NLP Group

LSTM and QRNN Language Model Toolkit for PyTorch

A Robust Non-IoU Alternative to Non-Maxima Suppression in Object Detection

Tgbox-bench - Simple TGBOX upload speed benchmark

This Repo is the official CUDA implementation of ICCV 2019 Oral paper for CARAFE: Content-Aware ReAssembly of FEatures

Official Repository for the paper "Improving Baselines in the Wild".

A faster pytorch implementation of faster r-cnn

Speech Separation Using an Asynchronous Fully Recurrent Convolutional Neural Network

a reccurrent neural netowrk that when trained on a peice of text and fed a starting prompt will write its on 250 character text using LSTM layers

An Extendible (General) Continual Learning Framework based on Pytorch - official codebase of Dark Experience for General Continual Learning

A machine learning malware analysis framework for Android apps.

SysWhispers Shellcode Loader

Code for our ACL 2021 paper "One2Set: Generating Diverse Keyphrases as a Set"

The official repository for our paper "The Devil is in the Detail: Simple Tricks Improve Systematic Generalization of Transformers". We significantly improve the systematic generalization of transformer models on a variety of datasets using simple tricks and careful considerations.

BED: A Real-Time Object Detection System for Edge Devices

Implementation of OmniNet, Omnidirectional Representations from Transformers, in Pytorch

CVPR 2021: "Generating Diverse Structure for Image Inpainting With Hierarchical VQ-VAE"

For visualizing the dair-v2x-i dataset

Implementation of Deep Deterministic Policy Gradiet Algorithm in Tensorflow

disentanglement_lib is an open-source library for research on learning disentangled representations.

基于tensorflow 2.x的图片识别工具集