Is GEMM used in Tensorflow, Theano, Pytorch

I know that Caffe uses GEneral Matrix to Matrix Multiplication (GEMM) which is part of Basic Linear Algebra Subprograms (BLAS) library for performing convolution operations. Where a convolution is converted to matrix multiplication operation. I have referred below article. https://petewarden.com/2015/04/20/why-gemm-is-at-the-heart-of-deep-learning/

I want to understand how other deep learning frameworks like Theano, Tensorflow, Pytorch perform convolution operations. Do they use similar libraries in the backend. There might be some articles present on this topic. If someone can point me to those or can explain with an answer.

Topic pytorch gpu tensorflow caffe deep-learning

Category Data Science

1
answered at

Those Frameworks are based on Cuda, which is the parallel computing tool for GPUs. Specificaly it is cuDNN that is used by the deep learning framework.

You can find the user guide : https://docs.nvidia.com/deeplearning/sdk/pdf/cuDNN-Developer-Guide.pdf

All off the operations are described and indeed GEMM algorithms are used for convolution operations.

About

Geeks Mental is a community that publishes articles and tutorials about Web, Android, Data Science, new techniques and Linux security.