Skip to content

Commit

Permalink
upd
Browse files Browse the repository at this point in the history
  • Loading branch information
xslingcn committed Sep 30, 2024
1 parent cfcbd93 commit 976791c
Show file tree
Hide file tree
Showing 2 changed files with 2 additions and 3 deletions.
2 changes: 1 addition & 1 deletion include/flashinfer/group_gemm/wrapper.cuh
Original file line number Diff line number Diff line change
Expand Up @@ -299,7 +299,7 @@ cudaError_t CutlassSegmentGEMMWrapper(CutlassSegmentGEMMHandler* handler, DTypeI
// Initialize the gemm kernel
Gemm gemm;

// Using the arguments, query for extra workspace required for matrix multiplication computation
// Using the arguments, query for extra workspace required for matrix multiplication computation
size_t workspace_size = Gemm::get_workspace_size(arguments);

// Allocate workspace memory
Expand Down
3 changes: 1 addition & 2 deletions python/tests/test_group_gemm.py
Original file line number Diff line number Diff line change
Expand Up @@ -86,8 +86,7 @@ def test_segment_gemm(
.cpu()
.numpy(),
rtol=1e-3,
atol=1e-3,
err_msg="assertion failed at batch {}".format(i),
atol=1e-3
)
else:
torch.testing.assert_close(
Expand Down

0 comments on commit 976791c

Please sign in to comment.