{"id":32,"date":"2023-06-21T11:28:06","date_gmt":"2023-06-21T10:28:06","guid":{"rendered":"https:\/\/compling.eecs.qmul.ac.uk\/?page_id=32"},"modified":"2023-06-21T11:28:06","modified_gmt":"2023-06-21T10:28:06","slug":"resources","status":"publish","type":"page","link":"https:\/\/compling.eecs.qmul.ac.uk\/index.php\/resources\/","title":{"rendered":"Resources"},"content":{"rendered":"\n<p class=\"wp-block-paragraph\"><strong>Datasets for evaluating compositional distributional models of meaning<\/strong><\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li>Grefenstette and Sadrzadeh Compositional Distributional Model Evaluation Dataset, EMNLP 2011 (<a href=\"http:\/\/compling.eecs.qmul.ac.uk\/wp-content\/uploads\/2015\/07\/GS2011data.txt\">file<\/a>)<\/li>\n\n\n\n<li>Grefenstette and Sadrzadeh Compositional Distributional Model Evaluation Dataset, adjective-noun based transitive sentences, 2012 (<a href=\"http:\/\/compling.eecs.qmul.ac.uk\/wp-content\/uploads\/2015\/07\/GS2012data.txt\">file<\/a>)<\/li>\n\n\n\n<li>Kartsaklis, Sadrzadeh and&nbsp;Pulman Term-Definition Dataset, COLING 2012 (<a href=\"http:\/\/compling.eecs.qmul.ac.uk\/wp-content\/uploads\/2015\/07\/KS2012.csv\">file<\/a>)<\/li>\n\n\n\n<li>Disambiguation Dataset used in&nbsp;Kartsaklis et al., CoNLL 2013.&nbsp;This previously unpublished dataset was produced by Mehrnoosh Sadrzadeh and Edward Grefenstette (<a href=\"http:\/\/compling.eecs.qmul.ac.uk\/wp-content\/uploads\/2015\/07\/KS2013-CoNLL.txt\">file<\/a>)<\/li>\n\n\n\n<li>Kartsaklis and Sadrzadeh transitive sentence similarity dataset, EMNLP 2013. This dataset extends the verb-object part of the Mitchell and Lapata (2010) dataset by&nbsp;the introduction of&nbsp;appropriate subject nouns. This version uses the original human judgements from the M&amp;L 2010 dataset (<a href=\"http:\/\/compling.eecs.qmul.ac.uk\/wp-content\/uploads\/2015\/07\/KS2013-EMNLP.txt\">file<\/a>)<\/li>\n\n\n\n<li>Kartsaklis and Sadrzadeh transitive sentence similarity dataset, QPL 2014. This is the same dataset as the one used in the EMNLP 2013 paper, but with re-evaluated human scores collected from Amazon Turk (<a href=\"http:\/\/compling.eecs.qmul.ac.uk\/wp-content\/uploads\/2015\/07\/KS2014.txt\">file<\/a>)<\/li>\n\n\n\n<li>Kartsaklis and Sadrzadeh entailment datasets, LACL 2016\/COLING 2016 (<a href=\"http:\/\/compling.eecs.qmul.ac.uk\/wp-content\/uploads\/2014\/12\/KS2016-SV.txt\">subject-verb<\/a>, <a href=\"http:\/\/compling.eecs.qmul.ac.uk\/wp-content\/uploads\/2014\/12\/KS2016-VO.txt\">verb-object<\/a>, and <a href=\"http:\/\/compling.eecs.qmul.ac.uk\/wp-content\/uploads\/2014\/12\/KS2016-SVO.txt\">subject-verb-object<\/a>)<\/li>\n\n\n\n<li>Wijnholds and Sadrzadeh verb disambiguation and sentence similarity datasets involving verb phrase ellipsis, NAACL 2019 (<a href=\"https:\/\/github.com\/gijswijnholds\/compdisteval-ellipsis\/tree\/master\/datasets\">repo<\/a>)<\/li>\n<\/ul>\n\n\n\n<p class=\"wp-block-paragraph\"><strong>Word embeddings<\/strong><\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li>Cheng and Kartsaklis code (in Python\/Theano) and word embeddings, EMNLP 2015 (<a href=\"https:\/\/github.com\/cheng6076\/SAMS-EMNLP-15-\">link<\/a>)<\/li>\n<\/ul>\n\n\n\n<p class=\"wp-block-paragraph\"><strong>Code<\/strong><\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li><a href=\"http:\/\/osf.io\/w4dmz\">Code<\/a> for reproducing the self- and other-repair detection experiments of <a href=\"https:\/\/onlinelibrary.wiley.com\/doi\/full\/10.1111\/tops.12324\">Purver, Hough and Howes (TopiCS 2018)<\/a>.<\/li>\n\n\n\n<li><a href=\"https:\/\/github.com\/dimazest\/fowler.corpora\/\">Code<\/a> and <a href=\"https:\/\/fowlercorpora.readthedocs.org\/en\/latest\/installation.html\">documentation<\/a> for reproducing the categorical compositional models of Grefenstette and Sadrzadeh (EMNLP 2011), Kartsaklis et al. (COLING 2012), and Milajevs et al. (EMNLP 2014).<\/li>\n\n\n\n<li><a href=\"http:\/\/bitbucket.org\/julianhough\/stir\">STIR<\/a> (\u00e2\u20ac\u0153Strictly Incremental Repair Detection\u00e2\u20ac\u009d) \u00e2\u20ac\u201c an open-source set of tools for self-repair detection in dialogue data.<\/li>\n\n\n\n<li><a href=\"http:\/\/sourceforge.net\/projects\/dylan\/\">DyLan<\/a> (\u00e2\u20ac\u0153Dynamics of Language\u00e2\u20ac\u009d) \u00e2\u20ac\u201c an open-source Java implementation of <a href=\"http:\/\/www.eecs.qmul.ac.uk\/~mpurver\/publications-subject.html#ds\">Dynamic Syntax<\/a>, including word-by-word incremental semantic parser and generator, and integration with the <a href=\"http:\/\/www.speech.kth.se\/jindigo\/\">Jindigo<\/a> dialogue system.<\/li>\n\n\n\n<li><a href=\"https:\/\/sourceforge.net\/projects\/diasim\/\">DiaSim<\/a> \u00e2\u20ac\u201c an open-source Java project for calculating lexical, syntactic and semantic similarity in dialogue corpora, including within- and between-speaker similarity and comparison to various randomly re-ordered baselines \u00e2\u20ac\u201c see <a href=\"http:\/\/journals.plos.org\/plosone\/article?id=10.1371\/journal.pone.0098598\">this paper<\/a>.<\/li>\n<\/ul>\n","protected":false},"excerpt":{"rendered":"<p>Datasets for evaluating compositional distributional models of meaning Word embeddings Code<\/p>\n","protected":false},"author":1,"featured_media":0,"parent":0,"menu_order":0,"comment_status":"closed","ping_status":"closed","template":"","meta":{"footnotes":""},"class_list":["post-32","page","type-page","status-publish","hentry"],"_links":{"self":[{"href":"https:\/\/compling.eecs.qmul.ac.uk\/index.php\/wp-json\/wp\/v2\/pages\/32","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/compling.eecs.qmul.ac.uk\/index.php\/wp-json\/wp\/v2\/pages"}],"about":[{"href":"https:\/\/compling.eecs.qmul.ac.uk\/index.php\/wp-json\/wp\/v2\/types\/page"}],"author":[{"embeddable":true,"href":"https:\/\/compling.eecs.qmul.ac.uk\/index.php\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/compling.eecs.qmul.ac.uk\/index.php\/wp-json\/wp\/v2\/comments?post=32"}],"version-history":[{"count":1,"href":"https:\/\/compling.eecs.qmul.ac.uk\/index.php\/wp-json\/wp\/v2\/pages\/32\/revisions"}],"predecessor-version":[{"id":33,"href":"https:\/\/compling.eecs.qmul.ac.uk\/index.php\/wp-json\/wp\/v2\/pages\/32\/revisions\/33"}],"wp:attachment":[{"href":"https:\/\/compling.eecs.qmul.ac.uk\/index.php\/wp-json\/wp\/v2\/media?parent=32"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}