Code Monkey home page Code Monkey logo

Comments (2)

FatDs-lrc avatar FatDs-lrc commented on July 29, 2024

作者您好,感谢您的开源!您的代码框架对我深受启发,有以下问题希望解答:

Snipaste_2022-02-28_22-27-03

这里的average列结果和前面6行的平均值不一致,例如:(59+51.6+68.02+65.43+75.14+73.61)/6 = 65.46 请问average是计算的什么统计量呢。
截屏2022-02-28 下午10 29 05

以及上图结果中,这种Figure 2(b的模型已经是IEMOCAP在2021年最好的结果么,非常感谢

感谢您对我们工作的关注!对于您提出的问题:
1)avg列的结果是由6种不同模态缺失状态的数据合并在一起,在包含了6种缺失模态情况的大测试集(大小等于原始测试集的6倍)下计算的总体评测指标。在数值上与6种模态缺失情况应指标的算术平均值是近似的,的确不是等价的。文中表述可能会有些歧义,感谢指出问题!
2)据我们所知,在使用语音、视觉(人脸)、文本三个模态输入并且不使用额外数据的工作中,从结果上看是最好的。但需要注意的是Tabel4中第一行的模型只是一个baseline模型,文本上使用了BERT-Large特征(IEMOCAP上的很多工作使用Glove),可能并不能说明这个模型结构设计在多模态情感识别任务上是SOTA。在本文中,Table4的实验的主要目的是用于说明我们使用的多模态特征编码器网络是一个具有较好多模态表征能力的模型,能够学到足够好的各模态情感表征。
我们近期在ICASSP2022上的工作:https://arxiv.org/abs/2111.00865 上达到了IEMOCAP数据集上多模态情感识别任务的SOTA,希望能对您有所帮助。

from mmin.

Columbine21 avatar Columbine21 commented on July 29, 2024

好的,非常感谢

from mmin.

Related Issues (20)

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.