How RASA DietClassifier is so fast?

As per RASA DietClassifer architecture, it uses transformer before CRF. Also, it optionally can use SpacyNLP. Despite such a complex model with so many layers the execution speed of RASA is very good.

Transformers are known for their heavy weight and slowness. Then how is RASA DietClassifer so fast?

Topic rasa-nlu transformer

Category Data Science

About

Geeks Mental is a community that publishes articles and tutorials about Web, Android, Data Science, new techniques and Linux security.