What are the downsides of using TPUs instead of GPUs when performing neural network training or inference?

What are the downsides of using TPUs instead of GPUs when performing neural network training or inference?

From what I read on https://www.predictiveanalyticsworld.com/machinelearningtimes/should-you-choose-a-gpu-or-a-tpu-to-train-your-machine-learning-models/10460/ there are only upsides:

Topic tpu training gpu neural-network

Category Data Science

About

Geeks Mental is a community that publishes articles and tutorials about Web, Android, Data Science, new techniques and Linux security.