xlggzzz Goto Github PK

paper-picture-writing-code

Paper Picture Writing Code

pmf

Implementation Code for paper "Efficient Multimodal Fusion via Interactive Prompting" in CVPR2023

prismer

The implementation of "Prismer: A Vision-Language Model with An Ensemble of Experts".

self-mm

Codes for paper "Learning Modality-Specific Representations with Self-Supervised Multi-Task Learning for Multimodal Sentiment Analysis"

self-supervised-embedding-fusion-transformer

The code for our IEEE ACCESS (2020) paper Multimodal Emotion Recognition with Transformer-Based Self Supervised Feature Fusion.

ser-datasets

A collection of datasets for the purpose of emotion recognition/detection in speech.

skeafn

The source code for the paper titled "Sentiment Knowledge Enhanced Attention Fusion Network (SKEAFN)".

skesl

Sentiment Knowledge Enhanced Self-supervised Learning

smil

Pytorch implementation of SMIL: Multimodal Learning with Severely Missing Modality (AAAI 2021)

sp-transformer

sparsett

The official implementation for paper "SparseTT: Visual Tracking with Sparse Transformers"

sugrm

tate

Tag-assisted Multimodal Sentiment Analysis under Uncertain Missing Modalities, in SIGIR2022

tcl-map

TCL-MAP is a powerful method for multimodal intent recognition (AAAI 2024)

team

tfr-net

This repository contains the official implementation code of the paper Transformer-based Feature Reconstruction Network for Robust Multimodal Sentiment Analysis, accepted at ACMMM 2021.

torchscale

Transformers at any scale

transformer-models-for-multimodal-remote-sensing-data

Study of Transformer based models for Multimodal Remote Sensing Image Classification

umt

Preprocessed Datasets for our Multimodal NER paper

unimf

Codes for "UniMF: A Unified Multimodal Framework for Multimodal Sentiment Analysis in Missing Modalities and Unaligned Multimodal Sequences".

vim

[ICML 2024] Vision Mamba: Efficient Visual Representation Learning with Bidirectional State Space Model

vse_2ad

x-clip

An official implementation for "X-CLIP: End-to-End Multi-grained Contrastive Learning for Video-Text Retrieval"