💻

GPU Training Lab

Vertex AI Workbench with NVIDIA T4

Overview

The GPU Training Lab is where you move from CPU-bound ML experiments to real deep learning. Each student gets a dedicated NVIDIA T4 GPU with 16 GB of VRAM — enough to train ResNets, fine-tune BERT-sized models, run object detection pipelines, and experiment with generative models. The T4 is the workhorse GPU of cloud AI: it supports FP16 mixed-precision training, INT8 inference, and is the same hardware used in production at many companies. You'll use this lab for the majority of exercises in intermediate and advanced courses where training speed and GPU memory matter.

What You'll Do in This Lab

  • Train convolutional neural networks (ResNet, EfficientNet, YOLOv8) from scratch
  • Fine-tune pretrained models from Hugging Face for custom tasks
  • Run mixed-precision training with PyTorch AMP for faster iteration
  • Track experiments with Weights & Biases — log metrics, compare runs, visualize training curves
  • Profile GPU utilization with nvidia-smi and PyTorch Profiler
  • Export trained models to ONNX format for deployment

Lab Workflow

1

Launch

Start the lab from your course exercise page. A GPU-enabled Vertex AI Workbench instance spins up in ~90 seconds with CUDA drivers and frameworks pre-configured.

2

Verify GPU

Run the provided verification notebook to confirm GPU availability, CUDA version, and framework installation. See nvidia-smi output directly in Jupyter.

3

Train

Open the exercise notebook, load your dataset from Cloud Storage, configure your model, and start training. Monitor GPU utilization in real-time.

4

Track

Experiments are automatically logged to Weights & Biases. Compare training runs, hyperparameters, and metrics across experiments.

5

Export

Save your trained model checkpoint. Export to ONNX or TorchScript for downstream deployment exercises.

6

Shutdown

GPU labs auto-shutdown after 20 minutes of idle to control costs. Training jobs continue even if your browser disconnects.

Hardware & Environment

Machine Type n1-standard-8 (8 vCPU, 30 GB RAM)
GPU 1x NVIDIA T4 (16 GB VRAM, Turing architecture)
GPU Capabilities FP32, FP16, INT8, Tensor Cores
Storage 200 GB SSD persistent disk
CUDA CUDA 12.x + cuDNN 8.x
Idle Timeout 20 minutes auto-shutdown

Pre-installed Tools

PyTorch 2.x / TensorFlow 2.x CUDA 12.x + cuDNN Hugging Face Transformers OpenCV Weights & Biases

Frequently asked questions about this lab

What is the GPU Training Lab? +
Single-GPU environment for training deep learning models, running computer vision pipelines, and experimenting with neural network architectures. Pre-loaded with PyTorch, TensorFlow, and CUDA toolkit.
Which courses use this lab? +
This lab is included in: Deep Learning Mastery: Neural Architectures to Real-World Applications, NLP & Large Language Model Engineering, Computer Vision & Visual AI, MLOps & AI Infrastructure, AI for Robotics & Edge Computing, AI for Cybersecurity.
What hardware does this lab run on? +
Vertex AI Workbench with NVIDIA T4. Machine Type: n1-standard-8 (8 vCPU, 30 GB RAM); GPU: 1x NVIDIA T4 (16 GB VRAM, Turing architecture); GPU Capabilities: FP32, FP16, INT8, Tensor Cores; Storage: 200 GB SSD persistent disk.
What software comes pre-installed? +
Comes pre-loaded with PyTorch 2.x / TensorFlow 2.x, CUDA 12.x + cuDNN, Hugging Face Transformers, OpenCV, Weights & Biases. No local installs or dependency setup required — open your browser and start working.
What happens when I am idle in the lab? +
20 minutes auto-shutdown. Your files and notebooks persist on disk and will be available the next time you launch the lab.
Can I bring my own datasets and code into this lab? +
Yes. Datasets can be uploaded directly or synced from Google Cloud Storage. Notebooks and source files have built-in Git integration so you can push work to your own GitHub or GitLab repos.
Do I need to enroll in a course to use this lab? +
Yes. Lab environments are provisioned per-student as part of an AI Labs course enrollment. Browse the courses linked above to find programs that include this lab.

Related labs

Other AI Labs environments students typically use alongside this one.

Ready to Try This Lab?

Enroll in a course that uses this lab, or visit our Houston center for a hands-on demo.