运行使用PBT的PPO算法时出现问题

您好，我在通过update_pbt分支使用pbt训练ppo模型时，遇到了如图报错，随后程序终止。我尝试了以下几个不同环境的配置文件，都存在同样的问题：（启动命令`python xt/main.py -f examples/evolution/pbt_cartpole_ppo.yaml`）
[pbt_breakout_ppo.yaml](https://github.com/huawei-noah/xingtian/blob/update_pbt/examples/evolution/pbt_breakout_ppo.yaml)
[pbt_cartpole_ppo.yaml](https://github.com/huawei-noah/xingtian/blob/update_pbt/examples/evolution/pbt_cartpole_ppo.yaml)
[pbt_mspacman_ppo.yaml](https://github.com/huawei-noah/xingtian/blob/update_pbt/examples/evolution/pbt_mspacman_ppo.yaml)
而使用[IMPALA](https://github.com/huawei-noah/xingtian/blob/update_pbt/examples/evolution/pbt_breakout_impala.yaml)及[DQN](https://github.com/huawei-noah/xingtian/blob/update_pbt/examples/evolution/pbt_spaceinvader_dqn.yaml)的配置文件可以正常启动。
详细日志在[附件](https://github.com/huawei-noah/xingtian/files/7738922/train.log)中，谢谢！
![图片](https://user-images.githubusercontent.com/53746620/146633559-423a6784-59aa-4e1b-8e97-b8107c9c01fe.png)



Provide feedback

Saved searches

Use saved searches to filter your results more quickly

运行使用PBT的PPO算法时出现问题 #21

Metadata

Assignees

Labels

Type

Projects

Milestone

Relationships

Development

运行使用PBT的PPO算法时出现问题 #21

Description

Metadata

Metadata

Assignees

Labels

Type

Projects

Milestone

Relationships

Development

Issue actions