Filters








1 Hit in 1.9 sec

SPMoE: Generate Multiple Pattern-Aware Outputs with Sparse Pattern Mixture of Experts [article]

Shaobo Cui, Xintong Bao, Xuming Lin, Zhongzhou Zhao, Ji Zhang, Wei Zhou, Haiqing Chen
2021 arXiv   pre-print
Each one-to-one mapping is associated with a conditional generation pattern and is modeled with an expert in SPMoE.  ...  Many generation tasks follow a one-to-many mapping relationship: each input could be associated with multiple outputs.  ...  To capture the aforementioned intuition, we propose to model the one-to-many mapping with a model named Sparse Pattern Mixture of Experts (SPMoE). There are multiple expert models in SPMoE.  ... 
arXiv:2108.07535v2 fatcat:rokcng6yx5attclwm56rgavinq