Abstract: Overparameterization of pretrained transformers often leads to inefficiencies in diverse Environmental Sound Classification (ESC) tasks, where excessive computation limits deployment in ...