Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[AMP] Turn off accumulation data types for mixed precision pass #8341

Merged
merged 9 commits into from
Jun 29, 2021
Merged

[AMP] Turn off accumulation data types for mixed precision pass #8341

merged 9 commits into from
Jun 29, 2021

Commits on Jun 28, 2021

  1. don't use mixed precision accumulators

    @AndrewZhaoLuo
    AndrewZhaoLuo committed Jun 28, 2021
    Configuration menu
    Copy the full SHA
    6b2d16f View commit details
    Browse the repository at this point in the history

  2. turn off fp32 accumulators for now, adjust passing test cases

    @AndrewZhaoLuo
    AndrewZhaoLuo committed Jun 28, 2021
    Configuration menu
    Copy the full SHA
    d777bc2 View commit details
    Browse the repository at this point in the history

  3. Add TODO on cuda codegen for failures. Make test case pass on cuda fo… 

    …r now

test to mixed precision

more tests

add internal func call

broadcast failures

moreee

add comment and change lstm unit test to pass on cuda
    @AndrewZhaoLuo
    AndrewZhaoLuo committed Jun 28, 2021
    Configuration menu
    Copy the full SHA
    e2493a0 View commit details
    Browse the repository at this point in the history

  4. remove debug statements

    @AndrewZhaoLuo
    AndrewZhaoLuo committed Jun 28, 2021
    Configuration menu
    Copy the full SHA
    a07f37d View commit details
    Browse the repository at this point in the history

  5. to mixed precision

    @AndrewZhaoLuo
    AndrewZhaoLuo committed Jun 28, 2021
    Configuration menu
    Copy the full SHA
    90d763d View commit details
    Browse the repository at this point in the history

  6. rebase main

    @AndrewZhaoLuo
    AndrewZhaoLuo committed Jun 28, 2021
    Configuration menu
    Copy the full SHA
    0bcf899 View commit details
    Browse the repository at this point in the history

  7. rtol and atol adjustments

    @AndrewZhaoLuo
    AndrewZhaoLuo committed Jun 28, 2021
    Configuration menu
    Copy the full SHA
    effd073 View commit details
    Browse the repository at this point in the history

  8. bump up tolerance again

    @AndrewZhaoLuo
    AndrewZhaoLuo committed Jun 28, 2021
    Configuration menu
    Copy the full SHA
    44e15c9 View commit details
    Browse the repository at this point in the history

  9. jostle CI

    @AndrewZhaoLuo
    AndrewZhaoLuo committed Jun 28, 2021
    Configuration menu
    Copy the full SHA
    09c91ba View commit details
    Browse the repository at this point in the history