Distilled BERT

May 21, 2020

https://medium.com/huggingface/distilbert-8cf3380435b5

🏎 Smaller, faster, cheaper, lighter: Introducing DilBERT, a distilled version of BERT

MEDIUM.COM

🏎 Smaller, faster, cheaper, lighter: Introducing DilBERT, a distilled version of BERT

You can find the code to reproduce the training of DilBERT along with pre-trained weights for DilBERT here.

← Back to all articles         Quick Navigation:    Next:[ j ] – Prev:[ k ] – List:[ l ]