DExperts: On-the-Fly Controlled Text Generation with Experts and Anti-Experts

Posted on Fri, May 14, 2021 NLP 논문리뷰

TL;DR

How DExperts works

DEXPERTS = Decoding Method for controlled text generation based on a product of experts

Dexperts Formalization

P~(Xtx<t)=softmax(zt+α(zt+zt))\tilde{P}(X_t | x _{<t}) = softmax(z_t + \alpha (z_t^+ - z_t^-))