INSPIRED: A Transparent Dialogue Dataset for Interactive Semantic Parsing

Existing studies on semantic parsing focus primarily on mapping a natural-language utterance to a corresponding logical form in one turn. However, because natural language can contain a great deal of ambiguity and variability, this is a difficult challenge. In this work, we investigate an interactive semantic parsing framework that explains the predicted logical form step by step in natural language and enables the user to make corrections through natural-language feedback for individual steps. We focus on question answering over knowledge bases (KBQA) as an instantiation of our framework, aiming to increase the transparency of the parsing process and help the user appropriately trust the final answer. To do so, we construct INSPIRED, a crowdsourced dialogue dataset derived from the ComplexWebQuestions dataset.

This repository will contain the dataset and code for our paper Towards Transparent Interactive Semantic Parsing via Step-by-Step Correction.

Data

Dataset Download

The dataset can be downloaded under this path: ./data/dataset.jsonl

Data Structure

In the dataset file, each line is a dictionary with several keys:

{
    "id": "ID number",
    "cwq_question": "Original complex question in CWQ dataset",
    "rephrased_question": "Rephrased complex question by workers",
    "rephrased_question_label": " 'Replacement' or 'Alternative' ",
    "question": "If rephrased_question_label is marked as 'Replacement', set the value the same as rephrased_question; Otherwise, set it the same as cwq_question",
    "final_answer": "Final answer for the complex question",
    "gold_parse": "Gold sparql query for complex question",
    "preprocessed_gold_parse": "Preprocessed gold parse with entities and prefix replaced",
    "predicted_parse": "Predicted sparql query by initial semantic parser",
    "gold_sub_lfs": "A list of gold sub-logical forms after decomposition",
    "pred_sub_lfs": "A list of predicted sub-logical forms after decomposition",
    "gold_sub_qs": [
        {
          "sub_id": "ID of sub questions",
          "sub_question": "Rephrased sub question",
          "temp_sub_question": "Templated sub question for gold sub-logical form",
          "answer": "Answer for each sub question",
        }, "..."], 
    "pred_sub_qs": [
        {
          "sub_id": "ID of sub questions",
          "sub_question": "Rephrased sub question",
          "temp_sub_question": "Templated sub question for predicted sub-logical form",
          "answer": "Answer for each sub question",
        }, "..."], 
    "feedback": "A list of human feedback"
    
}

INSPIRED: A Transparent Dialogue Dataset for Interactive Semantic Parsing

Related tags

Overview

INSPIRED: A Transparent Dialogue Dataset for Interactive Semantic Parsing

Data

Dataset Download

Data Structure

Owner

MolRep: A Deep Representation Learning Library for Molecular Property Prediction

Toolbox of models, callbacks, and datasets for AI/ML researchers.

A Large-Scale Dataset for Spinal Vertebrae Segmentation in Computed Tomography

Covid19-Forecasting - An interactive website that tracks, models and predicts COVID-19 Cases

NPBG++: Accelerating Neural Point-Based Graphics

Pytorch implementation of VAEs for heterogeneous likelihoods.

Official implementation of "StyleCariGAN: Caricature Generation via StyleGAN Feature Map Modulation" (SIGGRAPH 2021)

This is the official pytorch implementation of AutoDebias, an automatic debiasing method for recommendation.

This is the official pytorch implementation of the BoxEL for the description logic EL++

Yas CRNN model training - Yet Another Genshin Impact Scanner

Model Serving Made Easy

This repository contains the entire code for our work "Two-Timescale End-to-End Learning for Channel Acquisition and Hybrid Precoding"

Cockpit is a visual and statistical debugger specifically designed for deep learning.

Source code for GNN-LSPE (Graph Neural Networks with Learnable Structural and Positional Representations)

Differentiable Simulation of Soft Multi-body Systems

Code for ECCV 2020 paper "Contacts and Human Dynamics from Monocular Video".

GAN Image Generator and Characterwise Image Recognizer with python

Independent and minimal implementations of some reinforcement learning algorithms using PyTorch (including PPO, A3C, A2C, ...).

Implementation of Kaneko et al.'s MaskCycleGAN-VC model for non-parallel voice conversion.

The codes for the work "Swin-Unet: Unet-like Pure Transformer for Medical Image Segmentation"