Brain Networks Laboratory (Choe Lab)

Convert transformers to RNN to reduce size

Apr 9, 2021

Convert transformers to RNN to make them light.

quote

Raymond de Lacaze shared a link to the group: Montreal.AI.

DeepMind, Microsoft, Allen AI & UW Researchers Convert Pretrained Transformers into RNNs, Lowering Memory Cost While Retaining High Accuracy

“Powerful transfor… See more

MEDIUM.COM

DeepMind, Microsoft, Allen AI & UW Researchers Convert Pretrained Transformers into RNNs, Lowering

https://medium.com/syncedreview/deepmind-microsoft-allen-ai-uw-researchers-convert-pretrained-transformers-into-rnns-lowering-806b94bf0521


← Back to all articles         Quick Navigation:    Next:[ j ] – Prev:[ k ] – List:[ l ]