Using Torch Audio instead of Scipy

[h3110Fr13nd]

scipy has only been used once in whole project and can be replaced by torchaudio

[marmikcfc]

Makes sense, could you please send a PR for the same?

[h3110Fr13nd]

I think it should be other way around.

Torch and torch audio are taking up lot of space and should be replaced.

#380 Issue
I'm working on removing/replacing torch and torchaudio.

If that works properly, then this issue is contradictory. And should be closed.

@prateeksachan @marmikcfc

What are your thoughts.