It would be really nice to log videos of agents' behavior during and after training to TensorBoard.
Proposed Solution:
- Add logic to the existing Mava/Tensorboard logger class to handle the collection of RGB frames.
- Call this new video logging function from the logger class during the evaluation phase of the algorithm.