New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Support QLayerNorm without weights #341

Merged

dacorvo merged 2 commits into main from LayerNorm_no_weights

Oct 29, 2024

Collaborator

dacorvo commented Oct 29, 2024 •

edited

Loading

What does this PR do?

When elementwise_affine is set to False, the LayerNorm does not have any weight.

This previously led to errors when trying to use the weight dtype or device.

Fixes #335

dacorvo added 2 commits

October 29, 2024 16:22


          test(QLayerNorm): add non-affine configurations

500e77d


          fix(QModule): support modules without weights

97a6266

dacorvo merged commit 7aaf99e into main

16 checks passed

dacorvo deleted the LayerNorm_no_weights branch

October 29, 2024 16:07

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet