Is there "Attention Is All You Need" implementation in Keras?
Has anyone seen this model's implementation using Keras?
inb4: tensorflow, pytorch
Topic keras deep-learning machine-translation nlp
Category Data Science
Update for anyone googling this in 2021: Keras has implemented a MultiHead attention layer. If key, query, and value are the same, this is self-attention.
Here is an implementation from PyPI.
One example from Kaggle is available.
About
Geeks Mental is a community that publishes articles and tutorials about Web, Android, Data Science, new techniques and Linux security.