LC-QuAD
Largescale Complex Question Answering Dataset

What?

LC-QuAD is a Question Answering dataset with 5000 pairs of question and its corresponding SPARQL query. The target knowledge base is DBpedia, specifically, the April, 2016 version. Please see our paper for details about the dataset creation process and framework.

Leaderboard

Rank System Exact Match F1 Score
- Krantikari QA
University of Bonn
Code | Paper (TBD) | Site (TBD)
TBD TBD
* We're in the process of automating the benchmarking process. In the meantime, please get in touch with us at priyansh.trivedi@uni-bonn.de, and we'll do it manually. Apologies for this inconvenience.

Usage

  • Find the train and test splits here.
  • Use DBpedia v04-16 to benchmark your system on LC-QuAD. Here's a guide on setting up your own endpoint.
  • We're in the process of creating a one-click benchmarking process. For the time being, please contact us to report your results
Every data item in the dataset consists of the following fields:

sparql_template_id: "Every unique SPARQL template has a different ID.",
sparql_query: "Valid SPARQL queries.",
intermediary_question: "The automatically verbalized equivalent of the SPARQL Query.",
corrected_question: "Human corrected version of the verbalized question.",
_id: "Unique ID of the datapoint"
v0.1.3 - 21-06-2018
  • Published train, test splits
  • Updated Webpage
  • Dataset now hosted on Github as opposed to the Fighsare Project
v0.1.2 - 24-01-2018
  • Dataset now available in QALD format
  • Leaderboard underway!
v0.1.1 - 27-10-2017
  • [BUGFIX] Fixed a typo with rdf:type in the SPARQLs
  • Updated Datasets and Templates list.
v0.1.0 - 01-05-2017
  • [RELEASE] First version of the dataset released with 5000 datapoints.
  • lc-quad.sda.tech published
@inproceedings{trivedi2017lc,
title={Lc-quad: A corpus for complex question answering over knowledge graphs},
author={Trivedi, Priyansh and Maheshwari, Gaurav and Dubey, Mohnish and Lehmann, Jens},
booktitle={Proceedings of the 16th International Semantic Web Conference (ISWC)},
pages={210--218},
year={2017},
organization={Springer}
}