Quick and dirty implementation of some of the SOTA deep learing models using Pytorch and Pytorch Lightning.
Sampling method and implementation is heavily influenced by facebook/cpc_audio with modification and simplification (minimum implementation).
300k steps; batch size 8; learning rate 2e-4 (refer to 'Representation learning with Contrastive Predictive Coding')
