Publications

2017

  • Automatic Analysis of Facial Actions: A Survey

    M. Valstar, B. Martinez, B. Jiang and M. Pantic

    [pdf] [bibtex]
  • AFEW-VA database for valence and arousal estimation in-the-wild

    J. Kossaifi, G. Tzimiropoulos, S. Todorovic and M. Pantic

    [pdf] [bibtex]
  • A survey of multimodal sentiment analysis

    M. Soleymani, D. Garcia, B. Jou, B. Schuller, S. F. Chang, M. Pantic. Image and Vision Computing, 2017

    [pdf] [bibtex]
  • Deep Structured Ordinal Regression for Facial Action Unit Intensity Estimation

    R. Walecki, O. Rudovic, V. Pavlovic, B. Schueller, M. Pantic. Proceedings of the conference on Computer Vision and Pattern Recognition, July 2017.

    [pdf] [bibtex]
  • Temporal Archetypal Analysis for Action Segmentation

    E. Fotiadou, M. Pantic, Y. Panagakis. Proceedings of the conference on Automatic Face and Gesture Recognition, May 2017.

    [pdf] [bibtex]
  • Audio-Visual Object Localization and Separation using Low-Rank and Sparsity Analysis

    J. Pu, Y. Panagakis, S. Petridis, M. Pantic. Proceedings of ICASSP, March 2017.

    [pdf] [bibtex]
  • End-to-end Visual Speech Recognition With LSTMs

    S. Petridis, Z. Li, M. Pantic. Proceedings of ICASSP, March 2017.

    [pdf] [bibtex]
  • Dynamic behavior analysis via structured rank minimization

    G. Christos, Y. Panagakis, and M. Pantic. International Journal of Computer Vision, pp.1-25.

    [pdf] [bibtex] [endnote]
  • “Non-negative decompositions for analysis of dynamic visual data”

    L. Zafeiriou, Y. Panagakis, S. Zafeiriou & M. Pantic, IEEE Transactions on Image Processing, vol. 26, no. 12, pp. 5603-5617. DOI: 10.1109/TIP.2017.2735186

    [pdf]
  • A Copula Ordinal Regression Framework for Joint Estimation of Facial Action Unit Intensity

    R. Walecki, O. Rudovic, V. Pavlovic & M. Pantic , IEEE Transactions on Affective Computing, accepted for publication. DOI: 10.1109/TAFFC.2017.2728534

  • Gaussian Process Domain Experts for Modelling of Facial Affect

    S. Eleftheriadis, O. Rudovic, M. Deisenroth & M. Pantic , IEEE Transactions on Image Processing, vol. 26, no. 10, pp. 4697-4711. DOI: 10.1109/TIP.2017.2721114

  • FERA 2017 - Addressing Head Pose in the Third Facial Expression Recognition and Analysis Challenge

    M.F. Valstar, E. Sánchez-Lozano, J.F. Cohn, L.A. Jeni, J.M. Girard, Z., IEEE Proceedings Automatic Face and Gesture Recognition 2017 (FG'17) https://arxiv.org/pdf/1702.04174.pdf

  • Multi-instance Dynamic Ordinal Random Fields for Weakly-Supervised Pain Intensity Estimation

    A. Ruiz, O. Rudovic, X. Binefa, M. Pantic , Proceedings Asian Conference on Computer Vision 2017 (ACCV'17) https://arxiv.org/pdf/1609.01465.pdf

  • Variable-state Latent Conditional Random Field models for facial expression analysis

    R. Walecki, O. Rudovic, V. Pavlovic, and M. Pantic Image and Vision Computing Journal, vol. 58, no. C, pp. 25-37. DOI: 10.1016/j.imavis.2016.04.009

  • Behavioural cues help predict impact of advertising on future sales

    Gábor Szirtes, Javier Orozco, István Petrás, Dániel Szolgay, Ákos Utasi, Jeffrey F. Cohn

    [pdf]
  • Prediction-based Learning from Continuous Emotion Recognition in Speech

    J. Han, Z. Zhang, F. Ringeval, and B. Schuller. In Proceedings of ICASSP, New Orleans, LA, March 2017. pp 5005-5009

    [pdf]
  • Reconstruction-error-based Learning for Continuous Emotion Recognition in Speech

    J. Han, Z. Zhang, F. Ringeval, and B. Schuller. In Proceedings of ICASSP, New Orleans, LA, March 2017. pp 2367-2371

    [pdf]
  • Strength Modelling for Real-World Automatic Continuous Affect Recognition from Audiovisual Signals

    J. Han, Z. Zhang, N. Cummins, F. Ringeval, and B. Schuller. Image and Vision Computing, Special Issue on Multimodal Sentiment Analysis and Mining in the Wild, vol. 34, 2016. 12 pages

    [pdf]
  • Enhancing LSTM RNN-based Speech Overlap Detection by Artificially Mixed Data

    G. Hagerer, V. Pandit, F. Eyben, and B. Schuller, In Proceedings AES 56th International Conference on Semantic Audio, Erlangen, Germany, June 2017.

    [pdf]
  • You sound ill, take the day off: Classification of speech affected by Upper Respiratory Tract Infection

    N. Cummins, M. Schmitt, S. Amiriparian, J. Krajewski, and B. Schuller. In Proceedings of the 39th Annual International Conference of the IEEE Engineering in Medicine & Biology Society (EMBC), Jeju, South Korea, July 2017. 4 pages

    [pdf]
  • Spotting Social Signals in Conversational Speech over IP: A Deep Learning Perspective

    R. Brückner, M. Schmitt, M. Pantic, and B. Schuller, In Proceedings INTERSPEECH 2017, 18th Annual Conference of the International Speech Communication Association, Stockholm, Sweden, August 2017.

    [pdf]
  • Recognising Guitar Effects – Which Acoustic Features Really Matter?

    M. Schmitt and B. Schuller, in Proceedings GI Workshop “Musik trifft Informatik”, held in conjunction with INFORMATIK 2017, Chemnitz, Germany, September 2017.

    [pdf]
  • From Hard to Soft: Towards more Human-like Emotion Recognition by Modelling the Perception Uncertainty

    J. Han, Z. Zhang, M. Schmitt, M. Pantic, and B. Schuller, in Proceedings of the 25th ACM International Conference on Multimedia, MM 2017, Mountain View, CA , ACM, October 2017.

    [pdf]

2016

  • The Conflict Escalation Resolution (CONFER) Database

    C. Georgakis, Y. Panagakis, S. Zafeiriou, M. Pantic. Image and Vision Computing, December 2016.

    [pdf] [bibtex] [endnote]
  • TensorLy: Tensor Learning in Python.

    J. Kossaifi, Y. Panagakis, M. Pantic. NIPS Tensor-Learn Workshop, accepted for publication. December 2016.

    [pdf] [bibtex]
  • The University of Passau Open Emotion Recognition System for the Multimodal Emotion Challenge

    J.Deng, N. Cummins, J. Han, X. Xu, Z. Ren, V. Pandit, Z. Zhang, and B. Schuller. In Proceedings of the 7th Chinese Conference on Pattern Recognition System for the Multimodal Emotion Challenge, November 2016.

    [pdf] [bibtex]
  • A Bag-of-Audio-Words Approach for Snore Sounds' Excitation Localisation

    M. Schmitt, C. Janott, V. Pandit, K. Qian, C. Heiser, W. Hemmert and B. Schuller, Proceedings of 14th ITG Conference on Speech Communication, October 2016.

    [pdf] [bibtex]
  • Towards Cross-lingual Automatic Diagnosis of Autism Spectrum Condition in Children’s Voices

    M. Schmitt, E. Marchi, Fabien Ringeval and B. Schuller, Proceedings of 14th ITG Conference on Speech Communication, September 2016.

    [pdf] [bibtex]
  • Facing Realism in Spontaneous Emotion Recognition from Speech: Feature Enhancement by Autoencoder with LSTM Neural Networks

    Z. Zhang, F. Ringeval, J. Han, J. Deng, E. Marchi, and B. Schuller. In Proceedings INTERSPEECH, September 2016

    [pdf] [bibtex]
  • At the Border of Acoustics and Linguistics: Bag-of-Audio-Words for the Recognition of Emotions in Speech

    M. Schmitt, F. Ringeval and B. Schuller. Proceedings of 17th Annual Conference of the International Speech Communication Association (INTERSPEECH), September 2016.

    [pdf] [bibtex]
  • Robust Correlated and Individual Component Analysis

    Y. Panagakis, M. A. Nicolaou, S. Zafeiriou and M. Pantic. IEEE Transactions on Pattern Analysis and Machine Intelligence, August 2016

    [pdf] [bibtex]
  • Discriminatively trained recurrent neural networks for continuous dimensional emotion recognition from audio

    F. Weninger, F. Ringeval, E. Marchi, and B. Schuller. In Proceedings of the 25th International Joint Conference on Artificial Intelligence, July 2016.

    [pdf] [bibtex]
  • 7 Essential Principles to Make Multimodal Sentiment Analysis Work in the Wild

    B. Schuller. In Proceedings of the 4th Workshop on Sentiment Analysis where AI meets Psychology, July 2016.

    [pdf] [bibtex]
  • Copula Ordinal Regression for Joint Estimation of Facial Action Unit Intensity

    R. Walecki, O. Rudovic, M. Pantic and V. Pavlovic. Proceedings of IEEE International Conference on Computer Vision and Pattern Recognition (CVPRW'16), June 2016.

    [pdf] [bibtex]
  • A Framework for Joint Estimation and Guided Annotation of Facial Action Unit Intensity

    R. Walecki, E. Coutinho, O. Rudovic, M. Pantic, V. Pavlovic. Proceedings of IEEE International Conference on Computer Vision and Pattern Recognition (CVPRW'16), June 2016.

    [pdf] [bibtex]
  • Gaussian Process Domain Experts for Model Adaptation in Facial Behavior Analysis

    S. Eleftheriadis, O. Rudovic, M. P. Deisenroth and M. Pantic. International Conference on Computer Vision and Pattern Recognition (CVPRW’16). 4th Workshop on Context Based Affect Recognition, June 2016

    [pdf] [bibtex]
  • Towards a Common Linked Data Model for Sentiment and Emotion Analysis

    J. Sanchez-Rada, B. Schuller, V. Patti, P. Buitelaar, G. Vulcu, F. Burkhardt, C. Clavel, M. Petychakis, and C. A. Iglesias. In Proceedings of the 6th International Workshop on Emotion and Sentiment Analysis (ESA 2016), May 2016.

    [pdf] [bibtex]
  • Empirical Mode Decomposition: A Data-Enrichment Perspective on Speech Emotion Recognition

    B. Dong, Z. Zhang, and B. Schuller. In Proceedings of the 6th International Workshop on Emotion and Sentiment Analysis, May 2016.

    [pdf] [bibtex]
  • openXBOW – Introducing the Passau Open-Source Crossmodal Bag-of-Words Toolkit

    M. Schmitt and B. Schuller, May 2016.

    [pdf] [bibtex]
  • Probabilistic Slow Features for Behavior Analysis

    L. Zafeiriou, M. A. Nicolaou, S. Zafeiriou, S. Nikitidis, M. Pantic. IEEE Transactions on Neural Networks and Learning Systems, vol. 27, no. 5, pp. 1034-1048, May 2016.

    [pdf]
  • Discriminant Incoherent Component Analysis

    C. Georgakis, Y. Panagakis and M. Pantic. IEEE Transactions on Image Processing, vol. 25, no. 5, pp. 2021-2034, May 2016.

    [pdf] [bibtex]
  • Empirical Mode Decomposition: A Data-Enrichment Perspective on Speech Emotion Recognition

    B. Dong, Z. Zhang, and B. Schuller. In Proceedings of the 6th International Workshop on Emotion and Sentiment Analysis, May 2016.

    [pdf] [bibtex]
  • Multimodal Sentiment Analysis in the Wild: Ethical considerations on Data Collection, Annotation, and Exploitation

    B. Schuller, J. Ganascia, and L. Devillers. In Proceedings of the Workshop on ETHics in Corpus Collection, Annotation, and Application, satellite of the 10th Language Resources and Evaluation Conference, Portoroz, Slovenia, pp. 29-34, May 2016.

    [pdf] [bibtex]
  • Cross Lingual Speech Emotion Recognition Using Canonical Correlation Analysis on Principal Component Subspace

    H. Sagha, J. Deng, M. Gavryukova, J. Han, and B. Schuller. IIn Proceedings 41st IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP), Shanghai, China, pp.5800-5804, March 2016.

    [pdf] [bibtex]
  • Enhanced Semi-supervised Learning for Multimodal Emotion Recognition

    Z. Zhang, F. Ringeval, B. Dong, E. Coutinho, E. Marchi, and B. Schuller. In Proceedings 41st IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP), Shanghai, China, pp. 5185-5189, March 2016.

    [pdf] [bibtex]
  • ADIEU Features? End-to-end Speech Emotion Recognition Using a Deep Convolutional Recurrent Network

    G. Trigeorgis, F. Ringeval, R. Brückner, E. Marchi, M. Nicolaou, B. Schuller, and S. Zafeiriou. In Proceedings 41st IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP), Shanghai, China, pp. 5200-5204, March 2016.

    [pdf] [bibtex]
  • Deep Complementary Bottleneck Features for Visual Speech Recognition

    M. Pantic and S. Petridis. In Proceedings 41st IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP), Shanghai, China, pp. 2304 - 2308, March 2016

    [pdf] [bibtex]
  • Continuous Estimation of Emotions in Speech by Dynamic Cooperative Speaker Models

    A. Mencattini, E. Martinelli, F. Ringeval, B. Schuller, and C. Di Natale. IEEE Transactions on Affective Computing, February 2016.

    [pdf] [bibtex]
  • Prediction based audio-visual fusion for classification of non-linguistic vocalasations

    S. Petridis and M. Pantic. Transactions on Affective Computing, vol. 7, no. 1, pp. 45-58, January 2016

    [pdf]
  • Sociocognitive Language Processing – Emphasising the Soft Factors

    B. Schuller and M. McTear. In Proceedings of the Seventh International Workshop on Spoken Dialogue Systems (IWSDS), Saariselkä, Finland, January 2016.

    [pdf] [bibtex]
  • AVEC 2016-Depression, Mood, and Emotion Recognition Workshop and Challenge

    M. Valstar, J. Gratch, B. Schuller, F. Ringeval, D. Lalanne, M.Torres, S. Scherer, G. Stratou, R. Cowie, and M. Pantic ACM Proceedings Multimedia 2016 (ACM MM'16) https://arxiv.org/pdf/1605.01600.pdf

  • Summary for AVEC 2016: Depression, Mood, and Emotion Recognition Workshop and Challenge

    M. Valstar, J. Gratch, B. Schuller, F. Ringeval, R. Cowie, and M. Pantic, In Proceedings of the 24th ACM International Conference on Multimedia, Amsterdam, Netherlands, October 2016, pp. 1483–1484

    [pdf]
  • AVEC 2016 – Depression, Mood, and Emotion Recognition Workshop and Challenge

    M. Valstar, J. Gratch, B. Schuller, F. Ringeval, D. Lalanne, M. Torres Torres, S. Scherer, G. Stratou, R. Cowie, and M. Pantic, In Proceedings of the 6th International Workshop on Audio/Visual Emotion Challenge, AVEC’16, co-located with the 24th ACM International Conference on Multimedia, Amsterdam, Netherlands, October 2016, pp. 3-10

    [pdf]

2015

  • The First Facial Landmark Tracking in-the-Wild Challenge: Benchmark and Results

    J. Shen, S. Zafeiriou, G. Chrysos, J. Kossaifi, G. Tzimiropoulos and M. Pantic. Proceedings of IEEE International Conference on Computer Vision, 300 Videos in the Wild (300-VW): Facial Landmark Tracking in-the-Wild Challenge & Workshop (ICCVW'15), December 2015

    [pdf] [bibtex]
  • Robust Statistical Face Frontalization

    C. Sagonas, Y. Panagakis, S. Zafeiriou and M. Pantic. Proceedings of IEEE Int’l Conf. on Computer Vision (ICCV 2015), December 2015

    [pdf] [bibtex]
  • Multi-conditional Latent Variable Model for Joint Facial Action Unit Detection

    S. Eleftheriadis, O. Rudovic and M. Pantic. International Conference on Computer Vision (ICCV), December 2015.

    [pdf] [bibtex]
  • Doubly Sparse Relevance Vector Machine for Continuous Facial Behavior Estimation

    S. Kaltwang, S. Todorovic and M. Pantic. IEEE Transactions on Pattern Analysis and Machine Intelligence, November 2015.

    [pdf] [bibtex]
  • AVEC 2015 – The First Affect Recognition Challenge Bridging Across Audio, Video, and Physiological Data

    F. Ringeval, B. Schuller, M. Valstar, S. Jaiswal, E. Marchi, D. Lalanne, R. Cowie, and M. Pantic. In Proceedings of the 5th International Workshop on Audio/Visual Emotion Challenge, AVEC15. ACM MM'15, October 2015.

    [pdf] [bibtex]
  • Variable-state Latent Conditional Random Field Models for Facial Expression Analysis

    R. Walecki, O. Rudovic, V. Pavlovic and M. Pantic. Image and Vision Computing Journal, October 2015.

    [pdf] [bibtex]
  • AVEC 2015 – The 5th International Audio/Visual Emotion Challenge and Workshop

    F. Ringeval, B. Schuller, M. Valstar, R. Cowie, and M. Pantic. In Proceedings of the 23rd ACM International Conference on Multimedia, MM 2015, (Brisbane, Australia), ACM, October 2015.

    [pdf] [bibtex]
  • Discrimination Between Native and Non-Native Speech Using Visual Features Only

    C. Georgakis, S. Petridis and M. Pantic. IEEE Transactions on Cybernetics, October 2015.

    [pdf] [bibtex]
  • The ICL-TUM-PASSAU Approach for the MediaEval 2015 “Affective Impact of Movies” Task

    G. Trgeorgis., E. Coutinho, F. Ringeval, E. Marchi, S. Zafeirou, and B. Schuller. In Proceedings of the MediaEval 2015 Multimedia Benchmark Workshop, satellite of Interspeech 2015, (Wurzen, Germany), CEUR, September 2015

    [pdf] [bibtex]
  • Fast and exact Bi-directional Fitting of Active Appearance Models

    J. Kossaifi, G. Tzimiropoulos and M. Pantic. Proceedings of the IEEE Int’l Conf. on Image Processing (ICIP’15), Proc. ICIP'15, pp. 1135 - 1139, September 2015

    [pdf] [bibtex]
  • Face Reading from Speech – Predicting Facial Action Units from Audio Cues

    F. Ringeval, E. Marchi, M. Mehu, K. Scherer, and B. Schuller. In Proceedings INTERSPEECH 2015, 16th Annual Conference of the International Speech Communication Association, (Dresden, Germany), ISCA, September 2015.

    [pdf] [bibtex]
  • Detection of Negative Emotions in Speech Signals Using Bags-of-Audio-Words

    F. Pokorny, F. Graf, F. Pernkopf and B. Schuller. 1st International Workshop on Automatic Sentiment Analysis in the Wild (WASA’15), ACII'15, September 2015.

    [pdf] [bibtex]
  • Speech Analysis in the Big Data Era

    B. Schuller. In Proceedings of the 18th International Conference on Text, Speech and Dialogue, TSD 2015, Lecture Notes in Artificial Intelligence (LNAI), Springer. Satellite event of INTERSPEECH 2015, September 2015.

    [pdf] [bibtex]
  • Cross-Language Acoustic Emotion Recognition: An Overview and Some Tendencies

    S. Feraru, D. Schuller, and B. Schuller. In Proceedings of 6th biannual Conference on Affective Computing and Intelligent Interaction (ACII 2015), (Xi’an, P. R. China), AAAC, IEEE, September 2015.

    [pdf] [bibtex]
  • Sentiment Apprehension in Human-Robot Interaction with NAO

    J. Shen, O. Rudovic, S. Cheng and M. Pantic. 1st International Workshop on Automatic Sentiment Analysis in the Wild (WASA’15), ACII'15, September 2015.

    [pdf] [bibtex] [endnote]
  • Neural Conditional Ordinal Random Fields for Agreement Level Estimation

    N. Rakicevic, O. Rudovic, S. Petridis and M. Pantic. 1st International Workshop on Automatic Sentiment Analysis in the Wild (WASA'15), September 2015.

    [pdf] [bibtex] [endnote]
  • Latent Trees for Estimating Intensity of Facial Action Units

    S. Kaltwang, S. Todorovic, M. Pantic. IEEE Conf. on Computer Vision and Pattern Recognition (CVPR'15). Boston, MA, USA, June 2015.

    [pdf] [bibtex] [endnote]
  • Active Nonrigid ICP Algorithm

    S. Cheng, I. Marras, S. Zafeiriou and M. Pantic. Automatic Face and Gesture Recognition (FG), 2015 11th IEEE International Conference and Workshops, May 2015.

    [pdf] [bibtex]
  • Variable-state Latent Conditional Random Fields for Facial Expression Recognition and Action Unit Detection

    R. Walecki, O. Rudovic, V. Pavlovic, M. Pantic. Proceedings of IEEE International Conference on Automatic Face and Gesture Recognition (FG'15). Ljubljana, Slovenia, pp. 1 - 8, May 2015.

    [pdf] [bibtex] [endnote]
  • FERA 2015 - Second Facial Expression Recognition and Analysis Challenge

    Michel F. Valstar, Timur Almaev, Jeffrey M. Girard, Gary McKeown, Marc Mehu, Lijun Yin, Maja Pantic and Jeffrey F. Cohn. IEEE International Conference on Automatic Face and Gesture Recognition (FG'15). Ljubljana, Slovenia, pp. 1 - 8, May 2015

    [pdf] [bibtex]
  • Sparkle: Adaptive Sample Based Scheduling for Cluster Computing

    C. Hao, J. Shen, H. Zhang, X. Zhang, Y. Wu, M. Li. Proceedings of the 5th International Workshop on Cloud Data and Platforms (CloudDP 2015), EuroSys 2015, April 2015.

    [pdf]
  • Modelling User Affect and Sentiment in Intelligent User Interfaces

    B. Schuller. In Proceedings of the 20th ACM International Conference on Intelligent User Interfaces, IUI 2015, (Atlanta, GA), March 2015.

    [pdf] [bibtex]
  • AVEC 2015 – The 5th International Audio/Visual Emotion Challenge and Workshop

    F. Ringeval, B. Schuller, M. Valstar, R. Cowie, and M. Pantic ACM Proceedings Multimedia 2015 (ACM MM'15)