Efficient algorithms for exact inference in sequence labeling SVMs Journal Article


Authors: Bauer, A.; Görnitz, N.; Biegler, F.; Muller, K. R.; Kloft, M.
Article Title: Efficient algorithms for exact inference in sequence labeling SVMs
Abstract: The task of structured output prediction deals with learning general functional dependencies between arbitrary input and output spaces. In this context, two loss-sensitive formulations for maximum-margin training have been proposed in the literature, which are referred to as margin and slack rescaling, respectively. The latter is believed to be more accurate and easier to handle. Nevertheless, it is not popular due to the lack of known efficient inference algorithms; therefore, margin rescaling - which requires a similar type of inference as normal structured prediction - is the most often used approach. Focusing on the task of label sequence learning, we here define a general framework that can handle a large class of inference problems based on Hamming-like loss functions and the concept of decomposability for the underlying joint feature map. In particular, we present an efficient generic algorithm that can handle both rescaling approaches and is guaranteed to find an optimal solution in polynomial time. © 2012 IEEE.
Keywords: algorithms; support vector machines; inference; dynamic programming; gene finding; hidden markov svm; label sequence learning; margin rescaling; slack rescaling; structural support vector machines (svms); structured output.; computer programming; polynomial approximation; hidden markov; rescaling; sequence learning; structural support; structured output; inference engines
Journal Title: IEEE Transactions on Neural Networks and Learning Systems
Volume: 25
Issue: 5
ISSN: 2162-237X
Publisher: IEEE  
Date Published: 2014-05-01
Start Page: 870
End Page: 881
Language: English
DOI: 10.1109/tnnls.2013.2281761
PROVIDER: scopus
PUBMED: 24808034
DOI/URL:
Notes: IEEE Trans. Neural Networks Learn. Sys. -- Export Date: 2 June 2014 -- Source: Scopus
Altmetric
Citation Impact
BMJ Impact Analytics
MSK Authors
  1. Marius Micha Kloft
    6 Kloft
Related MSK Work