LPAQA: Language model Prompt And Query Archive

This repository contains data and code for the paper How Can We Know What Language Models Know?

Install

Our repository is based on LAMA. Please download our fork from here and follow the instructions to set up the environment and download pre-trained language models.

# clone LPAQA
git clone https://github.com/jzbjyb/LPAQA.git LPAQA
# clone LAMA
git clone https://github.com/jzbjyb/LAMA.git LAMA
pushd LAMA && git reset --hard b6b1885c64de5981f249a8b65de25cb0802b4bd5 && rm -rf .git && popd
mv LAMA/* LPAQA/ && rm -rf LAMA
# follow the instructions to install
cd LPAQA
./setup.sh

Retrieve factual knowledge from LMs

For example, to query the owner of MSN (Microsoft is the answer), you can either use manually created prompts (x is owned by y):

python lama/eval_generation.py --lm bert --t "MSN is owned by [MASK]."

or use LPAQA that ensembles a diversity of prompts:

# mined prompts
python lama/eval_ensemble.py --lm bert --subject MSN --relation P127 --prompts prompt/mine
# paraphrased prompts
python lama/eval_ensemble.py --lm bert --subject MSN --relation P127 --prompts prompt/paraphrase

Language model Prompt And Query Archive

Related tags

Overview

LPAQA: Language model Prompt And Query Archive

Install

Retrieve factual knowledge from LMs

Owner

Make Watson Assistant send messages to your Discord Server

Image super-resolution through deep learning

Official implementation of "SegFormer: Simple and Efficient Design for Semantic Segmentation with Transformers"

PlenOctree Extraction algorithm

The goal of the exercises below is to evaluate the candidate knowledge and problem solving expertise regarding the main development focuses for the iFood ML Platform team: MLOps and Feature Store development.

A Lightweight Face Recognition and Facial Attribute Analysis (Age, Gender, Emotion and Race) Library for Python

Migration of Edge-based Distributed Federated Learning

Repositorio oficial del curso IIC2233 Programación Avanzada 🚀✨

OpenMMLab Image and Video Editing Toolbox

Stitch it in Time: GAN-Based Facial Editing of Real Videos

Pytorch implementation of One-Shot Affordance Detection

Global Rhythm Style Transfer Without Text Transcriptions

A deep learning library that makes face recognition efficient and effective

UnFlow: Unsupervised Learning of Optical Flow with a Bidirectional Census Loss

CSKG is a commonsense knowledge graph that combines seven popular sources into a consolidated representation

This project aims to explore the deployment of Swin-Transformer based on TensorRT, including the test results of FP16 and INT8.

Machine Learning From Scratch. Bare bones NumPy implementations of machine learning models and algorithms with a focus on accessibility. Aims to cover everything from linear regression to deep learning.

PyTorch framework, for reproducing experiments from the paper Implicit Regularization in Hierarchical Tensor Factorization and Deep Convolutional Neural Networks

McGill Physics Hackathon 2021: Reaction-Diffusion Models for the Generation of Biological Patterns

PyTorch-Geometric Implementation of MarkovGNN: Graph Neural Networks on Markov Diffusion