#

multi-modal-fusion

Here are 29 public repositories matching this topic...

zjukg / KG-MM-Survey

Knowledge Graphs Meet Multi-Modal Learning: A Comprehensive Survey

information-extraction survey knowledge-graph awsome image-classification image-generation surveys entity-linking knowledge-graph-embeddings visual-question-answering entity-alignment paper-list awsome-list cross-modal-retrieval multi-modal-learning multi-modal-fusion large-language-models multi-modal-knowledge-graph

Updated Dec 10, 2024

zjukg / MyGO

[Paper][AAAI 2025] MyGO: Discrete Modality Information as Fine-Grained Tokens for Multi-modal Knowledge Graph Completion

knowledge-graph-completion multi-modal tokenization contrastive-learning multi-modal-fusion multi-modal-knowledge-graph mygo

Updated May 28, 2024
Python

GuanRunwei / Achelous

The official repository of Achelous and Achelous++

object-detection object-tracking semantic-segmentation multi-task-learning point-cloud-segmentation multi-modal-learning multi-modal-fusion panoptic-perception 4d-mmwave-radar

Updated Jul 8, 2024
Python

kyegomez / the-compiler

Seed, Code, Harvest: Grow Your Own App with Tree of Thoughts!

reinforcement-learning deep-learning deep-learning-algorithms artficial-intelligence agora multimodal-deep-learning multi-modality multi-modal-fusion prompt-engineering chain-of-thought chatgpt autogpt tree-of-thoughts

Updated Jul 27, 2023
Python

wangxiao5791509 / VisEvent_SOT_Benchmark

[IEEE TCYB 2023] The first large-scale tracking dataset by fusing RGB and Event cameras.

spike event neuromorphic dvs single-object-tracking frame-event-tracking multi-modal-fusion visevent pengchenglab dynamic-vision-sensors neuromorphic-vision

Updated Sep 28, 2024
Python

SMARTlab-Purdue / Husformer

This repository contains the source code for our paper: "Husformer: A Multi-Modal Transformer for Multi-Modal Human State Recognition". For more details, please refer to our paper at https://arxiv.org/abs/2209.15182.

transformer affective-computing multi-modal-fusion human-state-recognition multi-modal-deep-learning

Updated Jul 2, 2023
Python

kyegomez / MoE-Mamba

Implementation of MoE Mamba from the paper: "MoE-Mamba: Efficient Selective State Space Models with Mixture of Experts" in Pytorch and Zeta

ai ml moe swarms multi-modality multi-modal-fusion

Updated Nov 11, 2024
Python

Cimy-wang / AM3Net_Multimodal_Data_Fusion

Code for J. Wang, J. Li, Y. Shi, J. Lai and X. Tan, "AM3Net: Adaptive Mutual-learning-based Multimodal Data Fusion Network," in IEEE TCSVT, 2022. We conducted the experiments on the hyperspectral and lidar dataset(Houston and Trento) and multispectral and synthetic aperture radar data (grss-dfc-2007 datasets).

hyperspectral-image-classification multi-modal-fusion hyperspectral-lidar-fusion hyperspectral-sar-fusion

Updated Mar 27, 2023
Python

chenzpstar / Multi-Modal-Image-Fusion

Training for multi-modal image fusion with PyTorch.

pytorch unsupervised-learning infrared polarization image-fusion multi-modal-fusion

Updated Nov 30, 2023
Python

zjukg / NATIVE

[Paper][SIGIR 2024] NativE: Multi-modal Knowledge Graph Completion in the Wild

knowledge-graph knowledge-graph-completion multi-modal adversarial-learning imbalanced-learning incomplete-data multi-modal-fusion multi-modal-knowledge-graph

Updated Aug 12, 2024
Python

kyegomez / MegaVIT

The open source implementation of the model from "Scaling Vision Transformers to 22 Billion Parameters"

computer-vision artificial-intelligence multi-modal vision-and-language multi-modal-learning vision-transformer gpt4 multi-modal-fusion

Updated Nov 11, 2024
Python

Event-AHU / VTF_PAR

[CVPR-2023 Workshop@NFVLR] Official PyTorch implementation of Learning CLIP Guided Visual-Text Fusion Transformer for Video-based Pedestrian Attribute Recognition

transformer pedestrian-attribute-recognition multi-modal-fusion video-based-attribute-recognition visual-text-fusion

Updated Jun 11, 2024
Python

HackerHyper / ACMVH

Adaptive Confidence Multi-View Hashing

multi-view-learning multi-modal-learning multi-modal-fusion

Updated Dec 13, 2023
Python

tudelft-iv / UniBEV

[IV'24] UniBEV: the official implementation of UniBEV

autonomous-driving robustness 3d-object-detection intelligent-vehicles multi-modal-learning multi-modal-fusion

Updated Jun 26, 2024
Python

zjukg / AdaMF-MAT

[Paper][LREC-COLING 2024] Unleashing the Power of Imbalanced Modality Information for Multi-modal Knowledge Graph Completion

knowledge-graph knowledge-graph-completion multi-modal imbalanced-data adversarial-learning imbalanced-learning negative-sampling multi-modality multi-modal-fusion multi-modal-knowledge-graph

Updated Apr 16, 2024
Python

zjukg / MoMoK

[Paper][Preprint 2024] Mixture of Modality Knowledge Experts for Robust Multi-modal Knowledge Graph Completion

knowledge-graph knowledge-graph-completion mutual-information knowledge-graph-embeddings mixture-of-experts contrastive-learning multi-modal-fusion multi-modal-knowledge-graph

Updated Jul 27, 2024
Python

zylbuaa / TFormer

The official implementation of "TFormer: A throughout fusion transformer for multi-modal skin lesion diagnosis"

transformer medical-image-analysis skin-lesion-classification multi-modal-fusion

Updated Jan 29, 2024
Python

FIVEYOUNGWOO / IEEE-802.11n-CSI-Camera-Synchronization-Toolkit

IEEE 802.11n CSI and camera synchronization toolkit.

wifi-modules 80211 multi-modal-fusion

Updated Nov 1, 2024
C

kdhht2334 / Hidden_Emotion_Detection_using_MM_Signals

[CHI2021] Hidden emotion detection using multi-modal signals

deep-learning pytorch human-computer-interaction eeg-analysis hidden-emotions valence-arousal multi-modal-learning multi-modal-fusion

Updated Sep 30, 2021
Python

gaosaroma / MM-AHGNN

Multi-Modal Attention-based Hierarchical Graph Neural Network for Object Interaction Recommendation in Internet of Things (IoT)

graph-embedding pytorch-geometric multi-modal-fusion object-interaction-recommendation object-social-network hierarchical-graph-neural-network

Updated Dec 15, 2021
Python

Improve this page

Add a description, image, and links to the multi-modal-fusion topic page so that developers can more easily learn about it.

Curate this topic

Add this topic to your repo

To associate your repository with the multi-modal-fusion topic, visit your repo's landing page and select "manage topics."