Approach the problem from an information theory angle #10
Description
Attempt an OED approach to sampling/sorting the batches. https://docs.pyro.ai/en/dev/contrib.oed.html#module-pyro.contrib.oed.eig
Either by calculating the estimated information gains, information gains directly or the mutual information between samples to form batches: https://github.com/gtegner/mine-pytorch