AUTHOREA
Log in Sign Up Browse Preprints
LOG IN SIGN UP
Tung Son Do
Tung Son Do
Research Assistant in UCLAB, Chung-Ang University
South Korea

Public Documents 1
Lightweight Multiuser Multimodal Semantic Communication System for Multimodal Large L...
Tung Son Do

Tung Son Do

and 4 more

August 27, 2024
Developing multimodal large language models (MLLMs) requires efficient semantic communication systems for diverse data modalities in constrained networks, highlighting the need for lightweight semantic communication models optimized for resource-constrained environments. A Mamba-based multiuser multimodal deep-learning semantic communication (3M-DeepSC) system is developed to serve MLLM communication to address this problem. The proposed framework applies the efficient Mamba architecture to replace traditional Transformerbased designs, improving performance and lowering the latency under diverse channel conditions. Moreover, a new semantic similarity metric is introduced to evaluate the system performance from a semantic perspective. In addition, a two-stage training algorithm is developed that jointly optimizes bit-based metrics and semantic similarity. According to the extensive results, the proposed 3M-DeepSC demonstrates promise as a robust, scalable solution supporting the increasing communication demands of MLLMs in diverse network environments.

| Powered by Authorea.com

  • Home