Requirements for running TensorFlow with GPU from NVIDIA
The GPU-enabled version of TensorFlow has several requirements such as 64-bit Linux, Python 2.7 (or 3.3+ for Python 3), NVIDIA CUDA 7.5 (CUDA 8.0 required for Pascal GPUs) and NVIDIA, cuDNN v4.0 (minimum) or v5.1 (recommended). More specifically, the current development of TensorFlow supports only GPU computing using NVIDIA toolkits and software. Now the following software must be installed on your machine.
Step 1: Install NVIDIA CUDA
To use TensorFlow with NVIDIA GPUs, CUDA Toolkit 8.0 and associated NVIDIA drivers with CUDA Toolkit 8+ need to be installed.
Note
For more details, refer to this NVIDIA's documentationhttps://developer.nvidia.com/cuda-downloads.
Now download and install the required package from https://developer.nvidia.com/cuda-downloads as shown in the following screenshot:

Available CUDA packages based on various platforms
Also, ensure that you have added the Cuda installation path to the LD_LIBRARY_PATH
environment variable...