Add support for forward and reverse high-order automatic differentiation mechanism#41919

Merged

levi131 merged 277 commits intoPaddlePaddle:developfrom 0x45f:science-add-rules-ut

May 18, 2022

+3,803-78

This pull request is big! We're only showing the most recent 250 commits

Commits on Sep 29, 2021

Commits on Oct 11, 2021

Commits on Oct 12, 2021

support multi input in triple gradient checker
JiabinYang
committed

Commits on Oct 15, 2021

Commits on Oct 18, 2021

Change code-format to follow CI std
veyron95
committed

Commits on Oct 19, 2021

Commits on Oct 20, 2021

Commits on Oct 22, 2021

Merge branch 'develop' of github.com:PaddlePaddle/Paddle into develop
levi131
committed

Commits on Nov 13, 2021

Merge remote-tracking branch 'upstream/develop' into develop
levi131
committed

Commits on Nov 30, 2021

Merge remote-tracking branch 'upstream/develop' into develop
levi131
committed

Commits on Dec 8, 2021

Merge remote-tracking branch 'upstream/develop' into develop
levi131
committed

Commits on Dec 16, 2021

Merge remote-tracking branch 'upstream/develop' into develop
levi131
committed

Commits on Dec 27, 2021

Merge remote-tracking branch 'upstream/develop' into develop
levi131
committed

Commits on Jan 25, 2022

Merge remote-tracking branch 'upstream/develop' into develop
levi131
committed

Commits on Feb 8, 2022

Merge remote-tracking branch 'upstream/develop' into develop
levi131
committed

Commits on Mar 3, 2022

Merge remote-tracking branch 'upstream/develop' into develop
levi131
committed
merge upstream
levi131
committed
Merge remote-tracking branch 'upstream/develop' into develop
levi131
committed

Commits on Mar 18, 2022

Merge remote-tracking branch 'upstream/develop' into develop
levi131
committed

Commits on Mar 25, 2022

add priops.py
tongxin
committed

Commits on Mar 28, 2022

Merge remote-tracking branch 'upstream/develop' into develop
levi131
committed

Commits on Mar 30, 2022

Merge branch 'develop' of https://github.com/PaddlePaddle/Paddle into ad
tongxin
committed

Commits on Mar 31, 2022

add_p
levi131
committed
Merge remote-tracking branch 'upstream/develop' into lml/add_prim_ops
levi131
committed
rm useless files
levi131
committed
add sub_p mul_p div_p
levi131
committed
add sqrt_p and tanh_p
levi131
committed
add reshape_p
levi131
committed
add broadcast_p
levi131
committed
Add python primitive wrappers.
tongxin
committed

Commits on Apr 1, 2022

Jvp rules updated.
tongxin
committed

Commits on Apr 2, 2022

Commits on Apr 5, 2022

add broadcast_p fill_constant_p matmul_p reduce_p reshape_p transpose_p
levi131
committed
add split_p and concat_p
levi131
committed
add gather_p and scatter_add_p
levi131
committed
add slice_select_p and slice_assign_p
levi131
committed

Commits on Apr 6, 2022

Commits on Apr 7, 2022

refine slice_assign_p and slice_select_p
levi131
committed
Merge remote-tracking branch 'upstream/develop' into lml/add_prim_ops
levi131
committed
Merge remote-tracking branch 'upstream/develop' into develop
levi131
committed
Merge remote-tracking branch 'tx/ad' into lower2prim
levi131
committed

Commits on Apr 10, 2022

Merge remote-tracking branch 'tx/ad' into lml/lower2prim
levi131
committed
small update
levi131
committed
add rules for orig2prim and prim2orig
levi131
committed
add 9 test for prim ops
levi131
committed
add more test and fix some bug
levi131
committed

Commits on Apr 12, 2022

add shape valid check for broadcast_p op, and add keepdim attr into reduce_p op proto
levi131
committed
support multi input and multi output for split_p and concat_p
levi131
committed
Test updated.
tongxin
committed
Merge commit 'refs/pull/41201/head' of https://github.com/PaddlePaddle/Paddle into ad
tongxin
committed
update
levi131
committed
fix slice bug for slice_select_p and slice_assign_p
levi131
committed
updated.
tongxin
committed
Merge commit 'refs/pull/41201/head' of https://github.com/PaddlePaddle/Paddle into ad
tongxin
committed
Ops updated.
tongxin
committed
Refactor and bug fixes.
tongxin
committed
updated.
tongxin
committed
merge changes form tx:ad
levi131
committed
finish orig2prim and prim2orig rules
levi131
committed
dtype for axis attr should be long int
levi131
committed
update dtype for axis attr int64_t
levi131
committed

Commits on Apr 13, 2022

update for iscan CI
levi131
committed
Merge branch 'lml/add_prim_ops' into lml/lower2prim
levi131
committed
Update primx.
tongxin
committed
Refactor vars in primx.
tongxin
committed
Merge commit 'refs/pull/41201/head' of https://github.com/PaddlePaddle/Paddle into ad
tongxin
committed
update for lower transform
levi131
committed
add more shape and dtype check
levi131
committed
Merge remote-tracking branch 'upstream/develop' into lml/add_prim_ops
levi131
committed
update primx.py
tongxin
committed
change IndexTensor into int32 dtype
levi131
committed
update
levi131
committed
Fix linearize and transpose.
tongxin
committed
Update is_dot
tongxin
committed
Update is_dot
tongxin
committed
Update is_dot
tongxin
committed
add gradient aggregation, fix add_transpose.
tongxin
committed
pass first linearize+transpose test.
tongxin
committed
merge develop
levi131
committed
merge tx/ad
levi131
committed

Commits on Apr 14, 2022

update test
levi131
committed
refactor op registration and primx.
tongxin
committed
update rule for slice_assign
levi131
committed
merge tx/ad
levi131
committed

Commits on Apr 15, 2022

Commits on Apr 16, 2022

Commits on Apr 17, 2022

primx updated.
tongxin
committed
update for matmul_v2 and reshape2 orig2prim
levi131
committed
merge tx/ad
levi131
committed
update for minimize
levi131
committed

Commits on Apr 18, 2022

Refine primrules
0x45f
committed
Remove some code
0x45f
committed
supporting unused and unreachable vars.
tongxin
committed
update for use prim2orig in minimize
levi131
committed
fix gather and scatter_add transpose.
tongxin
committed
merged
tongxin
committed
Add rules UT
0x45f
committed
update scatter_add
levi131
committed
merge tx/ad
levi131
committed
Refine UT code
0x45f
committed
fix nonetype check in topo
levi131
committed
Update gather_p pywrapper.
tongxin
committed
remove useless print
levi131
committed
Merge commit 'refs/pull/41596/head' of https://github.com/PaddlePaddle/Paddle into ad
tongxin
committed
Merge tongxin PR and refine code
0x45f
committed
merge wz/primrules
levi131
committed
readd some test
levi131
committed
rm useless print
levi131
committed
Merge commit 'refs/pull/41596/head' of https://github.com/PaddlePaddle/Paddle into ad
tongxin
committed
polish code.
tongxin
committed
fix bug in minimize
levi131
committed
add get_input_var_list and get_output_var_list and use it in lower
levi131
committed

Commits on Apr 19, 2022

Fix scatter_add_p prim2orig
0x45f
committed
Update code and fix orig2prim/prim2orig UT
0x45f
committed
delete vars after block.desc._remove
tongxin
committed
Merge remote-tracking branch 'tx/ad' into lml/lower2prim
levi131
committed
Improve ops and vars clean up logics.
tongxin
committed
Merge commit 'refs/pull/41596/head' of https://github.com/PaddlePaddle/Paddle into ad
tongxin
committed
fix some bug in linearize and lower
levi131
committed
merge tx/ad
levi131
committed
update tanh transpose.
tongxin
committed
use set instead of list for var2remove
levi131
committed
test updated.
tongxin
committed
Merge commit 'refs/pull/41596/head' of https://github.com/PaddlePaddle/Paddle into ad
tongxin
committed
polish code.
tongxin
committed
fix dot2bar delete.
tongxin
committed
merge tx/ad
levi131
committed
Merge remote-tracking branch 'wz/science-add-rules-ut' into lml/lower2prim
levi131
committed
add indextensor_dot for gather and scatter_add
levi131
committed
add sorted for set
levi131
committed

Commits on Apr 20, 2022

Fix scale_orig2prim params
0x45f
committed
fix some syntax bug
levi131
committed
add golbal_lower_update list
levi131
committed
Better handling of unused vars.
tongxin
committed
update tests.
tongxin
committed

Commits on Apr 21, 2022

merge tx/ad
levi131
committed
Fix elementwise_sub orig2prim
0x45f
committed
merge wz rules
levi131
committed
support none for transpose rule
levi131
committed
Merge branch 'science-new-code' into science-add-rules-ut
0x45f
committed
Merge and add transform UT
0x45f
committed
fix a bug in transpose
levi131
committed

Commits on Apr 22, 2022

Fix transpose and UT
0x45f
committed
a hacky fix for cancat op
levi131
committed
Fix exector place
0x45f
committed
Refine variable name
0x45f
committed

Commits on Apr 24, 2022

Merge branch 'science-new-code' into science-add-rules-ut
0x45f
committed

Commits on Apr 25, 2022

Add elementwise_mul orig2prim and support p_norm when p=1
0x45f
committed
Add sqrt orig2prim rule and UT
0x45f
committed

Commits on Apr 26, 2022

merge wz test
levi131
committed
rename files, add enable_prim, disable_prim, prim_enabled, delete global_lower_update
levi131
committed

Commits on Apr 27, 2022

fix a bug in test_ad_transform_trans
levi131
committed
revert modify in framework.py
levi131
committed
add paddle.fluid.incubate.ad_transform to python/setup.py.in
levi131
committed
Fix remove vars error
0x45f
committed
Fix p_norm_orig2prim
0x45f
committed
Merge remote-tracking branch 'wz/science-add-rules-ut' into lml/lower2prim
levi131
committed
merge wz
levi131
committed

Commits on May 5, 2022

Modify the code directory
0x45f
committed
Merge branch 'develop' into science-add-rules-ut
0x45f
committed
Add utils.py and remove get_input/output_vars functions
0x45f
committed

Commits on May 6, 2022

Update maolin code
0x45f
committed
Rename UT and refine test_ad_transform_primops
0x45f
committed

Commits on May 7, 2022

Fix div_p jvp rule
0x45f
committed
Add higher derivatives UT
0x45f
committed

Commits on May 9, 2022

Remove UT to autograd dir
0x45f
committed

Commits on May 11, 2022

Fix comments
0x45f
committed
import paddle in primops.py
0x45f
committed
Add some error message for assert
0x45f
committed
Refine UT class name and refine some comments in primreg.py
0x45f
committed

Commits on May 14, 2022

Commits on May 15, 2022

Commits on May 16, 2022

Commits on May 17, 2022