fangleai / transformercvae Goto Github PK

View Code? Open in Web Editor NEW

144.0 144.0 21.0 12.58 MB

Transformer-based Conditional Variational Autoencoder for Controllable Story Generation

Home Page: https://arxiv.org/abs/2101.00828

Python 100.00%

transformercvae's People

Contributors

Stargazers

Watchers

transformercvae's Issues

kl loss explode

Hi, I was trying to employ the same vae way to guide a text generation task, but during my training, the kl loss always exploded and I got a nan Z after several thousands of steps. Could you please share some ideas of how to jointly train a model like this?

About version of transformers

Hi, thank you for your open source! I wonder which version of transformer are you using in this repository?

No module transformers.modeling_gpt2

I'm trying to implement TransformerCVAE but I'm getting No module transformers.modeling_gpt2 error with Transformers version 4.11.3.

no MLP

Could author tell the version of transformers and python?

I try to use your model,but the version wrong confuse me every time

could the author share the used hyperparams?

I'm trying to reproduce the reported results, but only get really poor results by training your model with the default hyperparams. Could you make public the hyperparams for each datasets to reproduce the reported results?

Recommend Projects