feature(wyh): madqn algorithm

[Weiyuhong-1998]

Description

MADQN codes

Related Issue

TODO

Check List

• merge the latest version source branch/repo, and resolve all the conflicts
• pass style check
• pass all the tests

[codecov]

Codecov Report

Merging #540 (2ae1a9d) into main (ce2e0f4) will decrease coverage by 0.46%.
The diff coverage is 86.66%.

@@            Coverage Diff             @@
##             main     #540      +/-   ##
==========================================
- Coverage   85.46%   85.00%   -0.47%     
==========================================
  Files         526      529       +3     
  Lines       43322    43046     -276     
==========================================
- Hits        37027    36593     -434     
- Misses       6295     6453     +158     

Flag	Coverage Δ
unittests	85.00% <86.66%> (-0.47%)	⬇️

Flags with carried forward coverage won't be shown. Click here to find out more.

Impacted Files	Coverage Δ
ding/policy/madqn.py	83.18% <83.18%> (ø)
ding/model/template/madqn.py	94.73% <94.73%> (ø)
ding/model/template/__init__.py	100.00% <100.00%> (ø)
ding/model/template/tests/test_madqn.py	100.00% <100.00%> (ø)
ding/policy/command_mode_policy_instance.py	93.16% <100.00%> (+0.11%)	⬆️
ding/framework/message_queue/tests/test_redis.py	25.49% <0.00%> (-74.51%)	⬇️
ding/framework/message_queue/tests/test_nng.py	40.00% <0.00%> (-60.00%)	⬇️
ding/framework/message_queue/redis.py	32.07% <0.00%> (-50.95%)	⬇️
ding/framework/middleware/functional/evaluator.py	54.23% <0.00%> (-12.15%)	⬇️
ding/entry/tests/test_parallel_entry.py	45.45% <0.00%> (-4.55%)	⬇️
... and 205 more

Help us with your feedback. Take ten seconds to tell us how you rate us. Have a feature suggestion? Share it here.