Linear Distillation Learning

Repository contains experiments considering Linear Distillation Learning, concepts of appliying idea of knowledge distillation in linear setup.

Structure

Repository is organized as follows

• data folder serving as default location for datasets
• experiments conducted experiments in a free way
• ldl library with stable scripts and functions
• notebooks in-between jupyter notebooks
• results folder for results dumping in .csv format
• scripts some stable scripts connected with ldl library
• tests minimal tests for scripts

ldl folder contains mini lib required to reproduce stable experiments. To install run

• python setup.py install

Tests

For running tests:

• python -m unittest tests/test_bidir_mnist.py
• python -m unittest tests/test_omd_mnist.py