A generative model of words and relationships from multiple sources Conference Paper
| Authors: | Hyland, S. L.; Karaletsos, T.; Rätsch, G. |
| Title: | A generative model of words and relationships from multiple sources |
| Conference Title: | 30th AAAI Conference on Artificial Intelligence (AAAI 2016) |
| Abstract: | Neural language models are a powerful tool to embed words into semantic vector spaces. However, learning such models generally relies on the availability of abundant and diverse training examples. In highly specialised domains this requirement may not be met due to difficulties in obtaining a large corpus, or the limited range of expression in average use. Such domains may encode prior knowledge about entities in a knowledge base or ontology.We propose a generative model which integrates evidence from diverse data sources, enabling the sharing of semantic information. We achieve this by generalising the concept of co-occurrence from distributional semantics to include other relationships between entities or words, which we model as affine transformations on the embedding space. We demonstrate the effectiveness of this approach by outperforming recent models on a link prediction task and demonstrating its ability to profit from partially or fully unobserved data training labels. We further demonstrate the usefulness of learning from different data sources with overlapping vocabularies. © Copyright 2016, Association for the Advancement of Artificial Intelligence (www.aaai.org). All rights reserved. |
| Keywords: | artificial intelligence; knowledge based systems; semantics; training example; affine transformations; distributional semantics; generative model; multiple source; relationships between entities; semantic information; semantic vectors; vector spaces |
| Journal Title | Proceedings of the AAAI Conference on Artificial Intelligence |
| Conference Dates: | 2016 Feb 12-17 |
| Conference Location: | Phoenix, AZ |
| ISBN: | 2159-5399 |
| Publisher: | Aaai Press |
| Location: | Palo Alto, CA |
| Date Published: | 2016-12-01 |
| Start Page: | 2622 |
| End Page: | 2629 |
| Language: | English |
| PROVIDER: | scopus |
| DOI/URL: | |
| Notes: | ISBN: 9781577357605 -- Conference Paper -- Conference code: 124960 -- Export Date: 2 February 2017 -- Artificial Intelligence; Baidu; et al.; IBM; Infosys; NSF -- 12 February 2016 through 17 February 2016 -- Source: Scopus |
MSK Authors
Related MSK Work