fix(wzl): fix bugs for dict obs in new pipeline

[zerlinwang]

Description

Related Issue

TODO

Check List

• merge the latest version source branch/repo, and resolve all the conflicts
• pass style check
• pass all the tests

[codecov]

Codecov Report

Merging #541 (a70f1f3) into dev-eval-viz (7f8c53e) will increase coverage by 0.01%.
The diff coverage is 52.63%.

@@               Coverage Diff                @@
##           dev-eval-viz     #541      +/-   ##
================================================
+ Coverage         85.38%   85.39%   +0.01%     
================================================
  Files               526      526              
  Lines             43367    43373       +6     
================================================
+ Hits              37028    37039      +11     
+ Misses             6339     6334       -5     

Flag	Coverage Δ
unittests	85.39% <52.63%> (+0.01%)	⬆️

Flags with carried forward coverage won't be shown. Click here to find out more.

Impacted Files	Coverage Δ
ding/envs/env_manager/subprocess_env_manager.py	76.71% <0.00%> (+0.14%)	⬆️
ding/torch_utils/__init__.py	100.00% <ø> (ø)
ding/torch_utils/data_helper.py	77.35% <33.33%> (-2.38%)	⬇️
ding/framework/middleware/functional/collector.py	97.10% <100.00%> (+0.04%)	⬆️
ding/framework/middleware/functional/evaluator.py	53.97% <100.00%> (+0.26%)	⬆️
ding/entry/serial_entry_onpolicy.py	95.74% <0.00%> (-0.56%)	⬇️
ding/worker/learner/comm/flask_fs_learner.py	90.62% <0.00%> (ø)
ding/framework/message_queue/redis.py	84.90% <0.00%> (+1.88%)	⬆️
ding/framework/tests/test_parallel.py	96.26% <0.00%> (+3.73%)	⬆️
ding/framework/message_queue/tests/test_nng.py	100.00% <0.00%> (+26.92%)	⬆️

Help us with your feedback. Take ten seconds to tell us how you rate us. Have a feature suggestion? Share it here.