1/4 Lab Introduction: Distributed Training using GPUs on Cloud AI Platform

This lab provides hands-on practice using Google Cloud’s AI Platform to perform distributed training using the MirroredStrategy found within tf.keras.

This strategy allows the use of the synchronous AllReduce strategy on a virtual machine with multiple GPUs attached.

2/4 Lab Introduction: Distributed Training using GPUs on Cloud AI Platform

  • You’ll start by setting up the environment,

3/4 Lab Introduction: Distributed Training using GPUs on Cloud AI Platform

  • then continue on to create a deep neural network model using the Fashion MNIST dataset,

4/4 Lab Introduction: Distributed Training using GPUs on Cloud AI Platform

  • and then, finally, you’ll train that model using a MultiWorkerMirroredStrategy running on multiple GPUs.