Knowledge Distillation

A general knowledge distillation pipeline created for the transformers library, which aids in reducing the inference time and size of large deep learning models with minimal loss in accuracy

Mayank Musaddi

1/1/2023 · 0 min read