Happy to share that @cleanrl_lib now supports Random Network Distillation envpool, it's 3× faster than our first version without envpool and still have comparable performance to the original implementation, say 👋 to the long training time on hard-exploration games!
Details👇