Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Adds Distconv support for Layer Normalization layer #2229

Open
wants to merge 7 commits into
base: develop
Choose a base branch
from
Open

Adds Distconv support for Layer Normalization layer #2229

wants to merge 7 commits into from

Conversation

szaman19
Copy link
Collaborator

@szaman19 szaman19 commented Mar 15, 2023 •
edited
Loading

Adds distconv support for layer normalization

  • Add CI test
  • Implement layer_norm_distconv_adapter
  • Move layer norm kernels to shared .cuh file
  • Use existing layer norm kernels to implement distconv layer norm operator

@szaman19 szaman19 marked this pull request as ready for review March 18, 2023 08:31
@szaman19
Copy link
Collaborator Author

szaman19 commented Dec 4, 2023

Tagging @tbennun @benson31 @bvanessen

@tbennun
Copy link
Contributor

tbennun commented Dec 4, 2023

Tagging @tbennun @benson31 @bvanessen

Please fix the conflicts :)

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers
No reviews
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
2 participants
@szaman19 @tbennun