Skip to content

Commit

Permalink
Formatting
Browse files Browse the repository at this point in the history
  • Loading branch information
loadams committed Dec 17, 2024
1 parent 3d58faf commit bb1c3c4
Showing 1 changed file with 1 addition and 0 deletions.
1 change: 1 addition & 0 deletions tests/unit/ops/transformer/inference/test_gelu.py
Original file line number Diff line number Diff line change
Expand Up @@ -28,6 +28,7 @@ def version_appropriate_gelu(activations):
else:
return torch.nn.functional.gelu(activations)


def run_gelu_reference(activations):
# Expected behavior is that of casting to float32 internally and using the tanh approximation
return version_appropriate_gelu(activations.to(torch.float32)).to(activations.dtype)
Expand Down

0 comments on commit bb1c3c4

Please sign in to comment.