Why env.reset() in cmd='step'?

[Captain6606]

Dear Author:
Why reset the environment on line 151?

iPLAN/envs/env_wrappers.py

Lines 139 to 151 in 7e4b79a

	def worker(remote, parent_remote, env_fn_wrapper):
	parent_remote.close()
	env = env_fn_wrapper.x()
	while True:
	cmd, data = remote.recv()
	if cmd == 'step':
	ob, reward, win_tag, done, info = env.step(data)
	if 'bool' in done.__class__.__name__:
	if done:
	ob = env.reset()
	else:
	if np.all(done):
	ob = env.reset()

I look forward to hearing from you.

[wuxiyang1996]

This means that all threads that run a separate env are terminated, in which case the parallel envs will restart.

I was assuming that you are expecting to keep the terminated envs run until time runs out, right?

[Captain6606]

I think that's partly true, when the for loop finishes executing,

iPLAN/runners/ippo_parallel_runner.py

Line 166 in 7e4b79a

for _ in range(self.args.episode_limit):

the statement is executed.
**That's what I asked in problem four (4#issue) 16 initial states but only 8 outputs. **
But why initialize the environment here? I thought it might be a test after training, but I didn't see any test code, and I didn't see any output.
After that, I tried to replace ob = env.reset() with pass.

iPLAN/envs/env_wrappers.py

Line 151 in 7e4b79a

ob = env.reset()

I found that the program still worked, but a funny thing happened: the same data got different results before and after replacement. I was very confused.

[wuxiyang1996]

you may schedule a virtual meeting some time with me, my personal information could be found from my profile:
https://wuxiyang1996.github.io/

For others who encounter this issue later:
I will release the summary of this meeting later.

[Captain6606]

I have sent an email to you, please check it.