Multi-modality Fusion

Posted on | In
  1. Concatenation/summation, or weighted (attention mechanism) concatenation/summation.
  2. P(y|x1,x2)=P(y|x1)P(y|x2), with Gaussian distribution assumption [1]

Reference

  1. Huang, Xun, et al. “Multimodal Conditional Image Synthesis with Product-of-Experts GANs.” arXiv preprint arXiv:2112.05130 (2021).