Emotion-LLaMA: Multimodal Emotion Recognition and Reasoning with Instruction Tuning

💻 🤖 A summary on our attempts at using Deep Learning approaches for Emotional Text to Speech 🔈

Official implementation of the paper "Estimation of continuous valence and arousal levels from faces in naturalistic conditions", Antoine Toisoul, Jean Kossaifi, Adrian Bulat, Georgios Tzimiropoulos and Maja Pantic, Nature Machine Intelligence, 2021

Learning to ground explanations of affect for visual art.

Video2Music: Suitable Music Generation from Videos using an Affective Multimodal Transformer model

A curated list of awesome affective computing 🤖❤️ papers, software, open-source projects, and resources

This is my reading list for my PhD in AI, NLP, Deep Learning and more.

A machine learning application for emotion recognition from speech

[TAFFC 2024] The official implementation of paper: From Static to Dynamic: Adapting Landmark-Aware Image Models for Facial Expression Recognition in Videos

🚀 Pre-process, annotate, evaluate, and train your Affect Computing (e.g., Multimodal Emotion Recognition, Sentiment Analysis) datasets ALL within MER-Factory! (LangGraph Based Agent Workflow)

This repository contains the source code for our paper: "Husformer: A Multi-Modal Transformer for Multi-Modal Human State Recognition". For more details, please refer to our paper at https://arxiv.org/abs/2209.15182.

😎 Awesome lists about Speech Emotion Recognition

From Pixels to Sentiment: Fine-tuning CNNs for Visual Sentiment Prediction

Spatial Temporal Graph Convolutional Networks for Emotion Perception from Gaits

[TAFFC 2025] The offical implementation of paper: Static for Dynamic: Towards a Deeper Understanding of Dynamic Facial Expressions Using Static Expression Data

A sovereign cognitive architecture with IIT 4.0 integrated information, residual-stream affective steering (CAA), Global Workspace Theory, active inference, and 72 consciousness modules — running locally on Apple Silicon.

Toolbox for Emotion Analysis using Physiological signals

This is the official implementation of the paper "Speech2AffectiveGestures: Synthesizing Co-Speech Gestures with Generative Adversarial Affective Expression Learning".

EMO-SUPERB: a reproducible speech emotion recognition benchmark with leakage-free splits for 6 datasets and 15 speech SSL models (IEEE SLT 2024)

ABAW3 (CVPRW): A Joint Cross-Attention Model for Audio-Visual Fusion in Dimensional Emotion Recognition