{"id":131,"date":"2023-03-11T17:10:55","date_gmt":"2023-03-11T17:10:55","guid":{"rendered":"http:\/\/ii.tudelft.nl\/ease\/?page_id=131"},"modified":"2024-09-14T08:51:47","modified_gmt":"2024-09-14T08:51:47","slug":"ease","status":"publish","type":"page","link":"https:\/\/ease.ewi.tudelft.nl\/","title":{"rendered":"EASE@ACII2024"},"content":{"rendered":"\n<figure class=\"wp-block-image size-full\"><img loading=\"lazy\" decoding=\"async\" width=\"6908\" height=\"2583\" src=\"http:\/\/ease.ewi.tudelft.nl\/wp-content\/uploads\/2024\/07\/EASE_ACII2024_banner.png\" alt=\"\" class=\"wp-image-337\" srcset=\"https:\/\/ease.ewi.tudelft.nl\/wp-content\/uploads\/2024\/07\/EASE_ACII2024_banner.png 6908w, https:\/\/ease.ewi.tudelft.nl\/wp-content\/uploads\/2024\/07\/EASE_ACII2024_banner-300x112.png 300w, https:\/\/ease.ewi.tudelft.nl\/wp-content\/uploads\/2024\/07\/EASE_ACII2024_banner-1024x383.png 1024w, https:\/\/ease.ewi.tudelft.nl\/wp-content\/uploads\/2024\/07\/EASE_ACII2024_banner-768x287.png 768w, https:\/\/ease.ewi.tudelft.nl\/wp-content\/uploads\/2024\/07\/EASE_ACII2024_banner-1536x574.png 1536w, https:\/\/ease.ewi.tudelft.nl\/wp-content\/uploads\/2024\/07\/EASE_ACII2024_banner-2048x766.png 2048w\" sizes=\"auto, (max-width: 6908px) 100vw, 6908px\" \/><\/figure>\n\n\n\n<div class=\"wp-block-group has-nv-site-bg-background-color has-background\" style=\"padding-top:var(--wp--preset--spacing--40);padding-right:var(--wp--preset--spacing--40);padding-bottom:var(--wp--preset--spacing--40);padding-left:var(--wp--preset--spacing--40)\"><div class=\"wp-block-group__inner-container is-layout-constrained wp-container-core-group-is-layout-af10a197 wp-block-group-is-layout-constrained\">\n<h2 class=\"wp-block-heading has-neve-link-hover-color-color has-text-color has-link-color wp-elements-803948b1918f742be0731cc8635ebe24\" id=\"about\" style=\"padding-top:0;padding-right:0;padding-bottom:0;padding-left:0\">About<\/h2>\n\n\n\n<p>Emotion research and affective computing involve tasks like describing, predicting, and explaining emotional reactions to stimuli such as text, images, and audio. A prevalent assumption in this field is that emotional reactions can be adequately represented by a single numerical value or label. However, we contend that variability is common in this domain due to the &#8220;subjectivity&#8221; (individuals can have vastly different responses to the same stimulus) and &#8220;ambiguity&#8221; (the same response could be described in multiple, equally valid ways) inherent in emotional processes. These properties make assumptions of a singular true description for responses highly problematic for research and applications, such as emotion recognition, affective content analysis, or generating affective behavior in robots or virtual agents. Consequently, we are convinced that considering subjectivity and ambiguity is crucial and that doing so adequately will require a deeper understanding of these phenomena and the development of alternative practices (e.g., modeling responses as distributions over several viable outcomes, or using contextual variables for disambiguation). <\/p>\n\n\n\n<p>This workshop aims to increase awareness of and appreciation for the importance of ambiguity and subjectivity in the affective computing community. In particular, we hope to facilitate focused discussions on relevant issues and support future research on these important concepts by providing a multi-disciplinary forum for interested researchers and practitioners.<\/p>\n\n\n\n<h3 class=\"wp-block-heading has-neve-link-hover-color-color has-text-color has-medium-font-size\"><mark>Topics of interest for the workshop are position papers touching on one of the following KEY THEMES:<\/mark><\/h3>\n\n\n\n<ul class=\"wp-block-list\">\n<li><strong>Theoretical Foundations:<\/strong> Discussions and refinement of terminology related to ambiguity and subjectivity, as well as integrations of relevant perspectives from areas like psychology, statistics, and philosophy.<\/li>\n\n\n\n<li><strong>Database and Annotation Design:<\/strong> Proposals, discussions, or comparisons of different approaches to data collection and annotation to facilitate the study of ambiguity and subjectivity, e.g., stimulus types, measurement instruments, annotation software, and emotion representations.<\/li>\n\n\n\n<li><strong>Modeling and Evaluation Approaches:<\/strong> Proposals, discussions, or comparisons of different approaches to modeling and model evaluation that consider ambiguity or subjectivity.<\/li>\n\n\n\n<li><strong>Future Challenges and Opportunities:<\/strong> Discussions of questions, directions, and applications for future research on ambiguity and subjectivity to explore.<\/li>\n<\/ul>\n<\/div><\/div>\n\n\n\n<div class=\"wp-block-group has-nv-c-2-color has-text-color has-link-color wp-elements-620e9caacd6942ecce340435fcd1aad8\" style=\"border-style:none;border-width:0px;padding-top:var(--wp--preset--spacing--40);padding-right:var(--wp--preset--spacing--40);padding-bottom:var(--wp--preset--spacing--40);padding-left:var(--wp--preset--spacing--40)\"><div class=\"wp-block-group__inner-container is-layout-constrained wp-container-core-group-is-layout-af10a197 wp-block-group-is-layout-constrained\">\n<h2 class=\"wp-block-heading has-neve-link-hover-color-color has-text-color has-link-color wp-elements-b4c437088e10ad44c4201dc4d76a0ce1\" id=\"importantDates\">Important Dates<\/h2>\n\n\n\n<p>All deadlines are at the end of the day in the GMT-12 timezone.<\/p>\n\n\n\n<figure class=\"wp-block-table is-style-regular has-medium-font-size\"><table class=\"has-neve-text-color-color has-text-color has-link-color\" style=\"border-style:dashed;border-width:1px\"><tbody><tr><td class=\"has-text-align-left\" data-align=\"left\"><strong><mark style=\"background-color:rgba(0, 0, 0, 0)\" class=\"has-inline-color has-neve-link-hover-color-color\">Submission Deadline:<\/mark> <\/strong><\/td><td><s>19 June, 2024 (Extended)<\/s><\/td><\/tr><tr><td class=\"has-text-align-left\" data-align=\"left\"><mark style=\"background-color:rgba(0, 0, 0, 0)\" class=\"has-inline-color has-neve-link-hover-color-color\"><strong>Acceptance Notifications:  <\/strong><\/mark><\/td><td><s>14 July, 2024<\/s><\/td><\/tr><tr><td class=\"has-text-align-left\" data-align=\"left\"><mark style=\"background-color:rgba(0, 0, 0, 0)\" class=\"has-inline-color has-neve-link-hover-color-color\"><strong>Camera-ready Deadline: <\/strong>  <\/mark><\/td><td><s>1 August, 2024<\/s><\/td><\/tr><tr><td class=\"has-text-align-left\" data-align=\"left\"><strong><mark style=\"background-color:rgba(0, 0, 0, 0)\" class=\"has-inline-color has-neve-link-hover-color-color\">Workshop date:   <\/mark> <\/strong>                <\/td><td><strong>15 September, 2024<\/strong><\/td><\/tr><\/tbody><\/table><\/figure>\n\n\n\n<p>The EASE workshop is a satellite event of the <em>13th International Conference on Affective Computing and Intelligent Interaction (ACII 2024) <\/em>on 15 September 2024. For details, see:<a href=\"https:\/\/acii-conf.net\/2024\/\"> https:\/\/acii-conf.net\/2024\/<\/a><\/p>\n<\/div><\/div>\n\n\n\n<div style=\"height:40px\" aria-hidden=\"true\" class=\"wp-block-spacer\"><\/div>\n\n\n\n<div class=\"wp-block-group\" style=\"padding-top:var(--wp--preset--spacing--40);padding-right:var(--wp--preset--spacing--40);padding-bottom:var(--wp--preset--spacing--40);padding-left:var(--wp--preset--spacing--40)\"><div class=\"wp-block-group__inner-container is-layout-constrained wp-container-core-group-is-layout-af10a197 wp-block-group-is-layout-constrained\">\n<h2 class=\"wp-block-heading has-neve-link-hover-color-color has-text-color has-link-color wp-elements-2c84c24d317a586ff19919179feb391d\" id=\"submission\">Submission<\/h2>\n\n\n\n<p>We invite submissions of <mark style=\"background-color:rgba(0, 0, 0, 0)\" class=\"has-inline-color has-neve-link-hover-color-color\">Position Papers<\/mark> (max. 5 pages; 4 pages + 1 page for references) focusing on one of the four key themes mentioned in the introduction, i.e., (1) Theoretical Foundations, (2) Database and Annotation Design, (3) Modeling and Evaluation Approaches, and (4) Future Challenges and Opportunities. <\/p>\n\n\n\n<p><strong>Submissions should be double-blind, i.e., anonymous, follow the <\/strong><a href=\"https:\/\/acii-conf.net\/2024\/authors\/submission-guidelines\/\" target=\"_blank\" rel=\"noreferrer noopener\">official submission guidelines from ACII2024<\/a><strong>,<\/strong> <strong>and clearly state which one of the four key themes they most closely align with. <\/strong>Each paper will be sent to at least two expert reviewers associated with relevant key areas and will have one of the organizers assigned as editor. <\/p>\n\n\n\n<p>Accepted submissions will be published in the workshop proceedings of ACII 2024. At least one author must register for the workshop and one conference day. <\/p>\n\n\n\n<p>Papers can be submitted via ACII\u2019s EasyChair platform (choose track <em>\u201cWorkshop: Embracing Ambiguity and Subjectivity in Emotion Research (EASE)\u201d<\/em>).<\/p>\n\n\n\n<div class=\"wp-block-buttons is-content-justification-left is-layout-flex wp-container-core-buttons-is-layout-fdcfc74e wp-block-buttons-is-layout-flex\">\n<div class=\"wp-block-button has-custom-width wp-block-button__width-25 is-style-primary\"><a class=\"wp-block-button__link has-nv-site-bg-color has-neve-link-color-background-color has-text-color has-background wp-element-button\" href=\"https:\/\/easychair.org\/conferences\/?conf=acii2024\" style=\"border-radius:6px\" target=\"_blank\" rel=\"noreferrer noopener\"><s>Submit <br>[EasyChair]<\/s><\/a><\/div>\n\n\n\n<div class=\"wp-block-button has-custom-width wp-block-button__width-25 is-style-default\"><a class=\"wp-block-button__link has-nv-light-bg-color has-text-color wp-element-button\" style=\"border-radius:6px\"><s>Download <br>[Latex\/Word Templates]<\/s><\/a><\/div>\n<\/div>\n<\/div><\/div>\n\n\n\n<div style=\"height:100px\" aria-hidden=\"true\" class=\"wp-block-spacer\"><\/div>\n\n\n\n<div class=\"wp-block-group\"><div class=\"wp-block-group__inner-container is-layout-constrained wp-block-group-is-layout-constrained\">\n<h2 class=\"wp-block-heading has-neve-link-hover-color-color has-text-color has-link-color wp-elements-c444b7ad3443de00987bd15c44b63bbd\" id=\"program\">Program<\/h2>\n\n\n\n<h6 class=\"wp-block-heading\" id=\"program\">Time slots will correspond to the local time in Glasgow, UK.<\/h6>\n\n\n\n<p><strong>Location:<\/strong> Room <a href=\"https:\/\/www.gla.ac.uk\/research\/arc\/\" data-type=\"link\" data-id=\"https:\/\/www.gla.ac.uk\/research\/arc\/\">ARC<\/a>-237C<strong>, <\/strong>The Mazumdar-Shaw Advanced Research Centre, 11 Chapel Lane, University of Glasgow, G11 6EW<\/p>\n\n\n\n<div class=\"wp-block-group\"><div class=\"wp-block-group__inner-container is-layout-constrained wp-block-group-is-layout-constrained\">\n<div class=\"wp-block-columns is-layout-flex wp-container-core-columns-is-layout-9d6595d7 wp-block-columns-is-layout-flex\">\n<div class=\"wp-block-column is-layout-flow wp-block-column-is-layout-flow\" style=\"flex-basis:100%\">\n<div class=\"wp-block-columns is-layout-flex wp-container-core-columns-is-layout-9d6595d7 wp-block-columns-is-layout-flex\">\n<div class=\"wp-block-column is-vertically-aligned-center is-layout-flow wp-block-column-is-layout-flow\" style=\"flex-basis:100%\">\n<div class=\"wp-block-group\"><div class=\"wp-block-group__inner-container is-layout-constrained wp-block-group-is-layout-constrained\">\n<figure class=\"wp-block-table is-style-regular\"><table class=\"has-nv-site-bg-background-color has-background\" style=\"border-style:dashed;border-width:1px\"><tbody><tr><td><\/td><td><strong><strong>THEORETICAL FOUNDATIONS<\/strong><\/strong><\/td><\/tr><tr><td><strong><mark style=\"background-color:rgba(0, 0, 0, 0)\" class=\"has-inline-color has-neve-link-hover-color-color\">09:00 &#8211; 10:00<\/mark><\/strong><br><\/td><td>Invited Talk and Q&amp;A<br><strong>Jeffrey Girard<\/strong><\/td><\/tr><tr><td><strong><mark style=\"background-color:rgba(0, 0, 0, 0)\" class=\"has-inline-color has-neve-link-hover-color-color\">10:00 &#8211; 10:30<\/mark><\/strong><\/td><td>Paper Presentation and Q&amp;A<br><strong>Indeterminacy in Affective Computing: Considering Meaning and Context in Data Collection Practices<\/strong><br><em><sub>Bernd Dudzik, Tiffany Matej Hrkalovic, Chenxu Hao, Chirag Raman and Masha Tsfasman.<\/sub><\/em><\/td><\/tr><tr><td colspan=\"2\"><\/td><\/tr><tr><td><strong><mark style=\"background-color:rgba(0, 0, 0, 0)\" class=\"has-inline-color has-neve-link-hover-color-color\">10:30 &#8211; 11:00<\/mark><\/strong><\/td><td><strong><strong>COFFEE BREAK<\/strong><\/strong><\/td><\/tr><tr><td colspan=\"2\"><\/td><\/tr><tr><td><\/td><td><strong><strong>MODELING AND EVALUATION APPROACHES<!--<\/strong--><\/strong><\/strong><\/td><\/tr><tr><td><strong><mark style=\"background-color:rgba(0, 0, 0, 0)\" class=\"has-inline-color has-neve-link-hover-color-color\">11:00 &#8211; 12:00<\/mark><\/strong><\/td><td>Invited Talk and Q&amp;A<br><strong>Phil Woodland<\/strong><\/td><\/tr><tr><td><strong><mark style=\"background-color:rgba(0, 0, 0, 0)\" class=\"has-inline-color has-neve-link-hover-color-color\">12:00 &#8211; 12:30<\/mark><\/strong><\/td><td>Paper Presentation and Q&amp;A<br><strong>Emotion Recognition Systems Must Embrace Ambiguity<br><\/strong><em><sub>Jingyao Wu, Ting Dang, Vidhyasaharan Sethu and Eliathamby Ambikairajah<\/sub><\/em><\/td><\/tr><tr><td colspan=\"2\"><\/td><\/tr><tr><td><br><strong><mark style=\"background-color:rgba(0, 0, 0, 0)\" class=\"has-inline-color has-neve-link-hover-color-color\">12:30 &#8211; 13:30 <\/mark><\/strong><br><\/td><td><strong><strong>LUNCH BREAK<\/strong><\/strong><\/td><\/tr><tr><td colspan=\"2\"><\/td><\/tr><tr><td><\/td><td><strong><strong>DATABASE AND ANNOTATION DESIGN<\/strong><\/strong><\/td><\/tr><tr><td><strong><mark style=\"background-color:rgba(0, 0, 0, 0)\" class=\"has-inline-color has-neve-link-hover-color-color\">13:30 &#8211; 14:30<\/mark><\/strong><\/td><td>Invited Talk and Q&amp;A<br><strong>Georgios N. Yannakakis<\/strong> <strong>&#8212; Embracing Human Feedback via Games<\/strong><\/td><\/tr><tr><td><strong><mark style=\"background-color:rgba(0, 0, 0, 0)\" class=\"has-inline-color has-neve-link-hover-color-color\">14:30 &#8211; 15:00<\/mark><\/strong><\/td><td>Paper Presentation and Q&amp;A<br><strong>Embracing Subjectivity in Affective Research: Naturalistic and Controlled Settings<\/strong><br><em><sub>Dominika Kunc, Joanna Komoszy\u0144ska, Stanis\u0142aw Saganowski, Przemys\u0142aw Kazienko, Karen S. Quigley and Lisa Feldman Barrett<\/sub><\/em><\/td><\/tr><tr><td><strong><mark style=\"background-color:rgba(0, 0, 0, 0)\" class=\"has-inline-color has-neve-link-hover-color-color\">15:00 &#8211; 15:30<\/mark><\/strong><\/td><td>Paper Presentation and Q&amp;A<br><strong>Recommendations for Managing Ambiguities in Emotion Annotations<\/strong><br><em>Anargh Viswanath, Jelena Mallick, Teena Hassan and Hendrik Buschmeier<\/em><\/td><\/tr><tr><td><\/td><td><\/td><\/tr><tr><td><strong><mark style=\"background-color:rgba(0, 0, 0, 0)\" class=\"has-inline-color has-neve-link-hover-color-color\">15:30 &#8211; 16:00<\/mark><\/strong><\/td><td><strong><strong>COFFEE BREAK<\/strong><\/strong><\/td><\/tr><tr><td colspan=\"2\"><\/td><\/tr><tr><td><\/td><td><strong><strong>FUTURE CHALLENGES AND OPPORTUNITIES<\/strong><\/strong><\/td><\/tr><tr><td><strong><mark style=\"background-color:rgba(0, 0, 0, 0)\" class=\"has-inline-color has-neve-link-hover-color-color\">16:00 &#8211; 16:30<\/mark><\/strong><\/td><td><strong>Plenary Discussion<\/strong><\/td><\/tr><tr><td><strong><mark style=\"background-color:rgba(0, 0, 0, 0)\" class=\"has-inline-color has-neve-link-hover-color-color\">16:30 &#8211; 17:00<\/mark><\/strong><\/td><td><strong>Closing and Future Planning<\/strong><\/td><\/tr><\/tbody><\/table><\/figure>\n<\/div><\/div>\n<\/div>\n<\/div>\n<\/div>\n<\/div>\n<\/div><\/div>\n<\/div><\/div>\n\n\n\n<div style=\"height:40px\" aria-hidden=\"true\" class=\"wp-block-spacer\"><\/div>\n\n\n\n<div class=\"wp-block-group\" style=\"padding-top:var(--wp--preset--spacing--40);padding-right:var(--wp--preset--spacing--40);padding-bottom:var(--wp--preset--spacing--40);padding-left:var(--wp--preset--spacing--40)\"><div class=\"wp-block-group__inner-container is-layout-constrained wp-container-core-group-is-layout-af10a197 wp-block-group-is-layout-constrained\">\n<h2 class=\"wp-block-heading has-neve-link-hover-color-color has-text-color has-link-color wp-elements-3678fdbb4661e206c0c0f4e74daf5055\" id=\"invitedSpeakers\">Invited Speakers<\/h2>\n\n\n\n<div class=\"wp-block-columns is-layout-flex wp-container-core-columns-is-layout-9d6595d7 wp-block-columns-is-layout-flex\">\n<div class=\"wp-block-column is-layout-flow wp-block-column-is-layout-flow\" style=\"flex-basis:320px\">\n<figure class=\"wp-block-gallery has-nested-images columns-default is-cropped wp-block-gallery-1 is-layout-flex wp-block-gallery-is-layout-flex\" style=\"padding-top:0;padding-bottom:0\">\n<figure class=\"wp-block-image size-full has-custom-border is-style-rounded\"><img loading=\"lazy\" decoding=\"async\" width=\"300\" height=\"300\" data-id=\"305\" src=\"http:\/\/ease.ewi.tudelft.nl\/wp-content\/uploads\/2024\/03\/Girard_300x300_bw.jpg\" alt=\"\" class=\"wp-image-305\" style=\"border-style:none;border-width:0px;border-radius:0px\" srcset=\"https:\/\/ease.ewi.tudelft.nl\/wp-content\/uploads\/2024\/03\/Girard_300x300_bw.jpg 300w, https:\/\/ease.ewi.tudelft.nl\/wp-content\/uploads\/2024\/03\/Girard_300x300_bw-150x150.jpg 150w\" sizes=\"auto, (max-width: 300px) 100vw, 300px\" \/><\/figure>\n<\/figure>\n<\/div>\n\n\n\n<div class=\"wp-block-column is-layout-flow wp-block-column-is-layout-flow\">\n<h2 class=\"wp-block-heading has-text-align-left has-neve-link-color-color has-text-color\"><mark style=\"background-color:rgba(0, 0, 0, 0)\" class=\"has-inline-color has-neve-link-hover-color-color\">Jeffrey M. Girard <\/mark><\/h2>\n\n\n\n<p class=\"has-text-align-left has-neve-link-color-color has-text-color\">University of Kansas<\/p>\n\n\n\n<p><strong>Talk title:<\/strong> TBA<\/p>\n\n\n\n<p><strong>Talk abstract:<\/strong> TBA<\/p>\n\n\n\n<p><strong>Bio:<\/strong> Dr. Girard studies how emotions are expressed through verbal and nonverbal behavior, as well as how interpersonal communication is influenced by individual differences (e.g., personality and mental health) and social factors (e.g., culture and context). This work is deeply interdisciplinary and draws insights and tools from various areas of social science, computer science, statistics, and medicine.<\/p>\n<\/div>\n<\/div>\n\n\n\n<div class=\"wp-block-columns is-layout-flex wp-container-core-columns-is-layout-9d6595d7 wp-block-columns-is-layout-flex\">\n<div class=\"wp-block-column is-layout-flow wp-block-column-is-layout-flow\" style=\"flex-basis:320px\">\n<figure class=\"wp-block-image size-full wp-duotone-grayscale\"><img loading=\"lazy\" decoding=\"async\" width=\"1277\" height=\"1277\" src=\"http:\/\/ease.ewi.tudelft.nl\/wp-content\/uploads\/2024\/09\/Georgio-N.-Yannakakis_congresoFuturo1-edited.jpg\" alt=\"\" class=\"wp-image-413\" style=\"aspect-ratio:1;object-fit:cover\" srcset=\"https:\/\/ease.ewi.tudelft.nl\/wp-content\/uploads\/2024\/09\/Georgio-N.-Yannakakis_congresoFuturo1-edited.jpg 1277w, https:\/\/ease.ewi.tudelft.nl\/wp-content\/uploads\/2024\/09\/Georgio-N.-Yannakakis_congresoFuturo1-edited-300x300.jpg 300w, https:\/\/ease.ewi.tudelft.nl\/wp-content\/uploads\/2024\/09\/Georgio-N.-Yannakakis_congresoFuturo1-edited-1024x1024.jpg 1024w, https:\/\/ease.ewi.tudelft.nl\/wp-content\/uploads\/2024\/09\/Georgio-N.-Yannakakis_congresoFuturo1-edited-150x150.jpg 150w, https:\/\/ease.ewi.tudelft.nl\/wp-content\/uploads\/2024\/09\/Georgio-N.-Yannakakis_congresoFuturo1-edited-768x768.jpg 768w\" sizes=\"auto, (max-width: 1277px) 100vw, 1277px\" \/><\/figure>\n<\/div>\n\n\n\n<div class=\"wp-block-column is-layout-flow wp-block-column-is-layout-flow\">\n<h2 class=\"wp-block-heading has-text-align-left has-neve-link-color-color has-text-color has-link-color wp-elements-1a666717dd3fb8ef3508e02b3d477479\"><mark style=\"background-color:rgba(0, 0, 0, 0)\" class=\"has-inline-color has-neve-link-hover-color-color\">Georgios N. Yannakakis <\/mark><\/h2>\n\n\n\n<p class=\"has-text-align-left has-neve-link-color-color has-text-color\">University of Malta<\/p>\n\n\n\n<p><strong>Talk title:<\/strong> Embracing&nbsp;Human&nbsp;Feedback&nbsp;via Games<\/p>\n\n\n\n<p><strong>Talk abstract:<\/strong> Why is subjective and ambiguous&nbsp;human&nbsp;feedback&nbsp;such a critical element of every aspect of AI nowadays? What are the opportunities video games offer for the reliable collection of subjective human feedback and eventually the modeling of ambiguous phenomena such as affect? How can human feedback help us test games, represent the games we play, design creative AI algorithms, offer agency to AI, and ultimately understand player experience? In this talk, I will attempt to address these questions through a series of research studies that have led to a number of methods,&nbsp;tools and protocols for the reliable&nbsp;annotation and modeling of human feedback, in games and beyond.&nbsp;<\/p>\n\n\n\n<p><strong>Bio:<\/strong> Georgios N. Yannakakis is a Professor at the Institute of Digital Games, University of Malta, and a co-founder and research director of&nbsp;<a href=\"https:\/\/eur03.safelinks.protection.outlook.com\/?url=http%3A%2F%2Fmodl.ai%2F&amp;data=05%7C02%7CB.J.W.Dudzik%40tudelft.nl%7C1466ed2371564126635d08dcccf071e9%7C096e524d692940308cd38ab42de0887b%7C0%7C0%7C638610580371614188%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C0%7C%7C%7C&amp;sdata=5nhET%2FH1K3u79irWuqwT6ipbLi0LjnJXVdJlrTFqOzk%3D&amp;reserved=0\" target=\"_blank\" rel=\"noreferrer noopener\">modl.ai<\/a>&nbsp;(Malta). He is a leading expert of the game artificial intelligence research field with core contributions in machine learning, evolutionary computation, affective computing and player modelling, computational creativity and procedural content generation. He has published over 350 journal and conference papers in the aforementioned fields and his work has received&nbsp;several awards from top-tier academic conferences&nbsp;and journals. His research has been supported by numerous European grants and has appeared in&nbsp;<em>Science Magazine<\/em>&nbsp;and the&nbsp;<em>New Scientist<\/em>&nbsp;among other venues. Georgios has been involved in a number of journal editorial boards and he is currently the Editor in Chief of the&nbsp;<a href=\"https:\/\/eur03.safelinks.protection.outlook.com\/?url=https%3A%2F%2Ftransactions.games%2F&amp;data=05%7C02%7CB.J.W.Dudzik%40tudelft.nl%7C1466ed2371564126635d08dcccf071e9%7C096e524d692940308cd38ab42de0887b%7C0%7C0%7C638610580375453018%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C0%7C%7C%7C&amp;sdata=b60nb75bzZ7fLObcuS%2FD1WE5WgaX7%2Fie7MFQSOZbUqA%3D&amp;reserved=0\" target=\"_blank\" rel=\"noreferrer noopener\">IEEE Transactions on Games<\/a>&nbsp;and an Associate Editor of the IEEE Transactions on Evolutionary Computation. He is the co-author of the Artificial Intelligence and Games textbook and the co-organiser of the&nbsp;<a href=\"https:\/\/eur03.safelinks.protection.outlook.com\/?url=https%3A%2F%2Fschool.gameaibook.org%2F&amp;data=05%7C02%7CB.J.W.Dudzik%40tudelft.nl%7C1466ed2371564126635d08dcccf071e9%7C096e524d692940308cd38ab42de0887b%7C0%7C0%7C638610580375463214%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C0%7C%7C%7C&amp;sdata=aLT10bRQuR3%2BKZRJwoFrekOkjC%2BGQLyLCYlMgs3wSc4%3D&amp;reserved=0\" target=\"_blank\" rel=\"noreferrer noopener\">Artificial Intelligence and Games<\/a>&nbsp;summer school series. Georgios is an IEEE Fellow.<\/p>\n<\/div>\n<\/div>\n\n\n\n<div class=\"wp-block-columns is-layout-flex wp-container-core-columns-is-layout-9d6595d7 wp-block-columns-is-layout-flex\">\n<div class=\"wp-block-column is-layout-flow wp-block-column-is-layout-flow\" style=\"flex-basis:320px\">\n<figure class=\"wp-block-image size-full is-resized wp-duotone-grayscale\"><img loading=\"lazy\" decoding=\"async\" width=\"263\" height=\"277\" src=\"http:\/\/ease.ewi.tudelft.nl\/wp-content\/uploads\/2024\/09\/PhilWoodland.png\" alt=\"\" class=\"wp-image-456\" style=\"object-fit:cover;width:300px;height:300px\"\/><\/figure>\n<\/div>\n\n\n\n<div class=\"wp-block-column is-layout-flow wp-block-column-is-layout-flow\">\n<h2 class=\"wp-block-heading has-text-align-left\"><mark style=\"background-color:rgba(0, 0, 0, 0)\" class=\"has-inline-color has-neve-link-hover-color-color\">Phil Woodland <\/mark><mark style=\"background-color:rgba(0, 0, 0, 0)\" class=\"has-inline-color has-neve-link-hover-color-color\"> <\/mark><\/h2>\n\n\n\n<p class=\"has-text-align-left has-neve-link-color-color has-text-color\">University of Cambridge<\/p>\n\n\n\n<p><strong>Talk title:<\/strong> Modelling Annotation Ambiguity in Spoken Emotion Data<\/p>\n\n\n\n<p><strong>Talk abstract:<\/strong> Different speakers and contexts (linguistic, social, dialogue) can cause large differences in emotion expression. Furthermore, different listeners perceive certain emotions again based on differing contexts, and hence, there is inherent variability in the annotation labels of spoken emotion data. Often, data that doesn\u2019t have a majority-agreed label is ignored in class-based spoken emotion recognition, even though this data can be valuable. This talk first describes some techniques to model and evaluate the handling of nonmajority agreed data via extra classes, the use of evidential deep learning (EDL) to quantify uncertainty, and also extending EDL to model emotion distributions. An EDL-based approach is also developed and applied for attribute-based emotion annotations. An alternative approach of variability aware human annotator simulation is then discussed based on conditional softmax flow (for classes) and conditional integer flow (for attributes). It is demonstrated that the approaches discussed can both yield excellent classification accuracy\/mean prediction as well as matching the distribution of human annotators. The talk concludes with conclusions and outlook.<\/p>\n\n\n\n<p><strong>Bio:<\/strong> Prof. Woodland\u2019s research is in the area on speech and language technology with a major focus on developing all aspects of speech recognition systems. After working with British Telecom Research Labs for three years, he returned to a Lectureship at the University of Cambridge in 1989 and became a Reader in 1999 and a (full) Professor in 2002. He has authored or couthored more than 250 papers in the area of speech and language technology with a main focus on speech recognition systems. He was the recipient of number of Best Paper awards including for work on speaker adaptation and discriminative training. He is one of the original coauthors of the HTK toolkit and has continued to play a major role in its development. He was a Member of the Editorial Board of Computer Speech and Language (1994\u20132009) and is currently a Member of the Editorial Board Member of Speech Communication. He is a Fellow of the International Speech Communication Association, the IEEE and the Royal Academy of Engineering. His group has developed a number of techniques that have been widely used in large vocabulary systems including standard methods for transform-based adaptation and discriminative sequence training. He has worked on the use of deep neural networks for both acoustic models and language models. His current work has a focus on the use and development of end-to-end trainable neural network systems. <\/p>\n<\/div>\n<\/div>\n<\/div><\/div>\n\n\n\n<div style=\"height:40px\" aria-hidden=\"true\" class=\"wp-block-spacer\"><\/div>\n\n\n\n<div class=\"wp-block-group\" style=\"padding-top:var(--wp--preset--spacing--40);padding-right:var(--wp--preset--spacing--40);padding-bottom:var(--wp--preset--spacing--40);padding-left:var(--wp--preset--spacing--40)\"><div class=\"wp-block-group__inner-container is-layout-constrained wp-container-core-group-is-layout-af10a197 wp-block-group-is-layout-constrained\">\n<h2 class=\"wp-block-heading has-neve-link-hover-color-color has-text-color has-link-color wp-elements-35dc06795aa3c708c8310f2b024c7439\" id=\"organizingCommittee\">Organizing Committee<\/h2>\n\n\n\n<div class=\"wp-block-columns is-layout-flex wp-container-core-columns-is-layout-9d6595d7 wp-block-columns-is-layout-flex\">\n<div class=\"wp-block-column is-vertically-aligned-top is-layout-flow wp-block-column-is-layout-flow\" style=\"flex-basis:320px\"><div class=\"wp-block-image is-style-rounded\">\n<figure class=\"aligncenter size-full is-resized\"><img loading=\"lazy\" decoding=\"async\" width=\"300\" height=\"300\" src=\"http:\/\/ii.tudelft.nl\/ease\/wp-content\/uploads\/2024\/03\/Girard_300x300_bw.jpg\" alt=\"\" class=\"wp-image-305\" style=\"width:200px\" srcset=\"https:\/\/ease.ewi.tudelft.nl\/wp-content\/uploads\/2024\/03\/Girard_300x300_bw.jpg 300w, https:\/\/ease.ewi.tudelft.nl\/wp-content\/uploads\/2024\/03\/Girard_300x300_bw-150x150.jpg 150w\" sizes=\"auto, (max-width: 300px) 100vw, 300px\" \/><\/figure>\n<\/div>\n\n\n<p class=\"has-text-align-center\"><mark style=\"background-color:rgba(0, 0, 0, 0)\" class=\"has-inline-color has-neve-link-hover-color-color\"><strong><a href=\"https:\/\/affcom.ku.edu\/girard\" data-type=\"link\" data-id=\"https:\/\/affcom.ku.edu\/girard\">Jeffrey M. Girard<\/a> <\/strong><\/mark><br><strong>jmgirard@ku.edu<\/strong><br>(University of Kansas)<\/p>\n<\/div>\n\n\n\n<div class=\"wp-block-column is-layout-flow wp-block-column-is-layout-flow\" style=\"flex-basis:320px\"><div class=\"wp-block-image is-style-rounded\">\n<figure class=\"aligncenter size-full is-resized\"><img loading=\"lazy\" decoding=\"async\" width=\"300\" height=\"300\" src=\"http:\/\/ii.tudelft.nl\/ease\/wp-content\/uploads\/2024\/03\/VidhyaSethu-1.jpg\" alt=\"\" class=\"wp-image-310\" style=\"width:200px\" srcset=\"https:\/\/ease.ewi.tudelft.nl\/wp-content\/uploads\/2024\/03\/VidhyaSethu-1.jpg 300w, https:\/\/ease.ewi.tudelft.nl\/wp-content\/uploads\/2024\/03\/VidhyaSethu-1-150x150.jpg 150w\" sizes=\"auto, (max-width: 300px) 100vw, 300px\" \/><\/figure>\n<\/div>\n\n\n<p class=\"has-text-align-center\"><mark style=\"background-color:rgba(0, 0, 0, 0)\" class=\"has-inline-color has-neve-link-hover-color-color\"><strong><a href=\"https:\/\/www.unsw.edu.au\/staff\/vidhyasaharan-sethu\" data-type=\"link\" data-id=\"https:\/\/www.unsw.edu.au\/staff\/vidhyasaharan-sethu\">Vidhyasaharan Sethu<\/a><\/strong><\/mark><br><strong>v.sethu@unsw.edu.au<\/strong><br>(University of New South Wales)<\/p>\n<\/div>\n\n\n\n<div class=\"wp-block-column is-layout-flow wp-block-column-is-layout-flow\" style=\"flex-basis:320px\"><div class=\"wp-block-image is-style-rounded\">\n<figure class=\"aligncenter size-full is-resized\"><img loading=\"lazy\" decoding=\"async\" width=\"300\" height=\"300\" src=\"http:\/\/ii.tudelft.nl\/ease\/wp-content\/uploads\/2023\/03\/BerndDudzik-Edited.png\" alt=\"\" class=\"wp-image-70\" style=\"width:200px\" srcset=\"https:\/\/ease.ewi.tudelft.nl\/wp-content\/uploads\/2023\/03\/BerndDudzik-Edited.png 300w, https:\/\/ease.ewi.tudelft.nl\/wp-content\/uploads\/2023\/03\/BerndDudzik-Edited-150x150.png 150w\" sizes=\"auto, (max-width: 300px) 100vw, 300px\" \/><\/figure>\n<\/div>\n\n\n<p class=\"has-text-align-center\"><mark style=\"background-color:rgba(0, 0, 0, 0)\" class=\"has-inline-color has-neve-link-hover-color-color\"><strong><a href=\"https:\/\/www.tudelft.nl\/ewi\/over-de-faculteit\/afdelingen\/intelligent-systems\/pattern-recognition-bioinformatics\/socially-perceptive-computing-lab\/people\/bernd-dudzik\" data-type=\"link\" data-id=\"https:\/\/www.tudelft.nl\/ewi\/over-de-faculteit\/afdelingen\/intelligent-systems\/pattern-recognition-bioinformatics\/socially-perceptive-computing-lab\/people\/bernd-dudzik\">Bernd Dudzik<\/a><\/strong><\/mark><br><strong>b.j.w.dudzik@tudelft.nl<\/strong><br>(Delft University of Technology)<\/p>\n<\/div>\n<\/div>\n\n\n\n<div class=\"wp-block-columns is-layout-flex wp-container-core-columns-is-layout-9d6595d7 wp-block-columns-is-layout-flex\">\n<div class=\"wp-block-column is-layout-flow wp-block-column-is-layout-flow\" style=\"flex-basis:320px\"><div class=\"wp-block-image is-style-rounded\">\n<figure class=\"aligncenter size-full is-resized\"><img loading=\"lazy\" decoding=\"async\" width=\"300\" height=\"300\" src=\"http:\/\/ii.tudelft.nl\/ease\/wp-content\/uploads\/2024\/03\/CarlosBusso.jpg\" alt=\"\" class=\"wp-image-318\" style=\"width:200px\" srcset=\"https:\/\/ease.ewi.tudelft.nl\/wp-content\/uploads\/2024\/03\/CarlosBusso.jpg 300w, https:\/\/ease.ewi.tudelft.nl\/wp-content\/uploads\/2024\/03\/CarlosBusso-150x150.jpg 150w\" sizes=\"auto, (max-width: 300px) 100vw, 300px\" \/><\/figure>\n<\/div>\n\n\n<p class=\"has-text-align-center\"><mark style=\"background-color:rgba(0, 0, 0, 0)\" class=\"has-inline-color has-neve-link-hover-color-color\"><strong><a href=\"https:\/\/personal.utdallas.edu\/~busso\/\">Carlos Busso<\/a><\/strong><\/mark><br><strong>busso@utdallas.edu<\/strong><br>(University of Texas at Dallas)<\/p>\n<\/div>\n\n\n\n<div class=\"wp-block-column is-layout-flow wp-block-column-is-layout-flow\" style=\"flex-basis:320px\"><div class=\"wp-block-image is-style-rounded\">\n<figure class=\"aligncenter size-full is-resized\"><img loading=\"lazy\" decoding=\"async\" width=\"300\" height=\"300\" src=\"http:\/\/ii.tudelft.nl\/ease\/wp-content\/uploads\/2024\/03\/EmilyMowerProvost.png\" alt=\"\" class=\"wp-image-288\" style=\"width:200px\" srcset=\"https:\/\/ease.ewi.tudelft.nl\/wp-content\/uploads\/2024\/03\/EmilyMowerProvost.png 300w, https:\/\/ease.ewi.tudelft.nl\/wp-content\/uploads\/2024\/03\/EmilyMowerProvost-150x150.png 150w\" sizes=\"auto, (max-width: 300px) 100vw, 300px\" \/><\/figure>\n<\/div>\n\n\n<p class=\"has-text-align-center\"><mark style=\"background-color:rgba(0, 0, 0, 0)\" class=\"has-inline-color has-neve-link-hover-color-color\"><strong><a href=\"https:\/\/emp.engin.umich.edu\" data-type=\"link\" data-id=\"https:\/\/emp.engin.umich.edu\">Emily Mower Provost<\/a><\/strong><\/mark><br><strong>emilykmp@umich.edu<\/strong><br>(University of Michigan)<br><\/p>\n<\/div>\n\n\n\n<div class=\"wp-block-column is-layout-flow wp-block-column-is-layout-flow\" style=\"flex-basis:320px\">\n<div class=\"wp-block-columns is-layout-flex wp-container-core-columns-is-layout-9d6595d7 wp-block-columns-is-layout-flex\">\n<div class=\"wp-block-column is-vertically-aligned-center is-layout-flow wp-block-column-is-layout-flow\" style=\"flex-basis:100%\"><div class=\"wp-block-image is-style-rounded\">\n<figure class=\"aligncenter size-full is-resized\"><img loading=\"lazy\" decoding=\"async\" width=\"300\" height=\"300\" src=\"http:\/\/ii.tudelft.nl\/ease\/wp-content\/uploads\/2024\/03\/ShriNarayanan.jpg\" alt=\"\" class=\"wp-image-290\" style=\"width:200px\" srcset=\"https:\/\/ease.ewi.tudelft.nl\/wp-content\/uploads\/2024\/03\/ShriNarayanan.jpg 300w, https:\/\/ease.ewi.tudelft.nl\/wp-content\/uploads\/2024\/03\/ShriNarayanan-150x150.jpg 150w\" sizes=\"auto, (max-width: 300px) 100vw, 300px\" \/><\/figure>\n<\/div>\n\n\n<p class=\"has-text-align-center\"><mark style=\"background-color:rgba(0, 0, 0, 0)\" class=\"has-inline-color has-neve-link-hover-color-color\"><strong><a href=\"https:\/\/sail.usc.edu\/people\/shri.html\">Shrikanth Narayanan<\/a><\/strong><\/mark><br><strong>shri@usc.edu<\/strong><br>(University of Southern California)<\/p>\n<\/div>\n<\/div>\n<\/div>\n<\/div>\n<\/div><\/div>\n\n\n\n<div style=\"height:40px\" aria-hidden=\"true\" class=\"wp-block-spacer\"><\/div>\n\n\n\n<div class=\"wp-block-group\" style=\"padding-top:var(--wp--preset--spacing--40);padding-right:var(--wp--preset--spacing--40);padding-bottom:var(--wp--preset--spacing--40);padding-left:var(--wp--preset--spacing--40)\"><div class=\"wp-block-group__inner-container is-layout-constrained wp-container-core-group-is-layout-af10a197 wp-block-group-is-layout-constrained\">\n<h2 class=\"wp-block-heading has-neve-link-hover-color-color has-text-color has-link-color wp-elements-ace3f3b966a24442a9b2e0c27bdde996\" id=\"programCommittee\">Program Committee<\/h2>\n\n\n\n<ul class=\"wp-block-list has-medium-font-size\">\n<li>Agata Lapedriza (Universitat Oberta de Catalunya)<\/li>\n\n\n\n<li>Chi-Chun Lee (National Tsing Hua University)<\/li>\n\n\n\n<li>Chenxu Hao (Delft University of Technology)<\/li>\n\n\n\n<li>Dennis K\u00fcster (Bremen University)<\/li>\n\n\n\n<li>Einat Liebenthal (Harvard Medical School)<\/li>\n\n\n\n<li>Ting Dang (University of Melbourne)<\/li>\n<\/ul>\n\n\n\n<div style=\"height:100px\" aria-hidden=\"true\" class=\"wp-block-spacer\"><\/div>\n<\/div><\/div>\n","protected":false},"excerpt":{"rendered":"<p>About Emotion research and affective computing involve tasks like describing, predicting, and explaining emotional reactions to stimuli such as text, images, and audio. A prevalent assumption in this field is that emotional reactions can be adequately represented by a single numerical value or label. However, we contend that variability is common in this domain due&hellip;&nbsp;<a href=\"https:\/\/ease.ewi.tudelft.nl\/\" class=\"\" rel=\"bookmark\">Read More &raquo;<span class=\"screen-reader-text\">EASE@ACII2024<\/span><\/a><\/p>\n","protected":false},"author":1,"featured_media":0,"parent":0,"menu_order":-1,"comment_status":"closed","ping_status":"closed","template":"","meta":{"neve_meta_sidebar":"","neve_meta_container":"","neve_meta_enable_content_width":"","neve_meta_content_width":0,"neve_meta_title_alignment":"","neve_meta_author_avatar":"","neve_post_elements_order":"","neve_meta_disable_header":"off","neve_meta_disable_footer":"","neve_meta_disable_title":"","footnotes":""},"class_list":["post-131","page","type-page","status-publish","hentry"],"_links":{"self":[{"href":"https:\/\/ease.ewi.tudelft.nl\/index.php\/wp-json\/wp\/v2\/pages\/131","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/ease.ewi.tudelft.nl\/index.php\/wp-json\/wp\/v2\/pages"}],"about":[{"href":"https:\/\/ease.ewi.tudelft.nl\/index.php\/wp-json\/wp\/v2\/types\/page"}],"author":[{"embeddable":true,"href":"https:\/\/ease.ewi.tudelft.nl\/index.php\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/ease.ewi.tudelft.nl\/index.php\/wp-json\/wp\/v2\/comments?post=131"}],"version-history":[{"count":132,"href":"https:\/\/ease.ewi.tudelft.nl\/index.php\/wp-json\/wp\/v2\/pages\/131\/revisions"}],"predecessor-version":[{"id":458,"href":"https:\/\/ease.ewi.tudelft.nl\/index.php\/wp-json\/wp\/v2\/pages\/131\/revisions\/458"}],"wp:attachment":[{"href":"https:\/\/ease.ewi.tudelft.nl\/index.php\/wp-json\/wp\/v2\/media?parent=131"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}