Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

TransformerEncoderLayer In Embellish Stage Confusion #3

Open
AndyWeasley2004 opened this issue Jul 1, 2024 · 0 comments
Open

TransformerEncoderLayer In Embellish Stage Confusion #3

AndyWeasley2004 opened this issue Jul 1, 2024 · 0 comments

Comments

@AndyWeasley2004
Copy link

I have read your paper and the embellish stage should use a transformer decoder-based model, right? However, when I read the code, the decoder class actually is constructed from TransformerEncoderLayer in the fast-transformer package, and in the implementation of this package, the encoder layer is still the encoder, not the decoder, so I'm a little confused about this point. Could you kindly explain how it works?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant