Vertex AI Workbench with NVIDIA T4
The GPU Training Lab is where you move from CPU-bound ML experiments to real deep learning. Each student gets a dedicated NVIDIA T4 GPU with 16 GB of VRAM — enough to train ResNets, fine-tune BERT-sized models, run object detection pipelines, and experiment with generative models. The T4 is the workhorse GPU of cloud AI: it supports FP16 mixed-precision training, INT8 inference, and is the same hardware used in production at many companies. You'll use this lab for the majority of exercises in intermediate and advanced courses where training speed and GPU memory matter.
Start the lab from your course exercise page. A GPU-enabled Vertex AI Workbench instance spins up in ~90 seconds with CUDA drivers and frameworks pre-configured.
Run the provided verification notebook to confirm GPU availability, CUDA version, and framework installation. See nvidia-smi output directly in Jupyter.
Open the exercise notebook, load your dataset from Cloud Storage, configure your model, and start training. Monitor GPU utilization in real-time.
Experiments are automatically logged to Weights & Biases. Compare training runs, hyperparameters, and metrics across experiments.
Save your trained model checkpoint. Export to ONNX or TorchScript for downstream deployment exercises.
GPU labs auto-shutdown after 20 minutes of idle to control costs. Training jobs continue even if your browser disconnects.
Other AI Labs environments students typically use alongside this one.
Standard Python development environment for data exploration, visualization, and introductory ML. Pre-configured with Python 3.11, NumPy, Pa…
Explore lab →Environment for deploying, serving, and benchmarking LLM inference. Students learn to optimize serving throughput, configure quantized model…
Explore lab →Pre-configured environment for building retrieval-augmented generation systems. Includes vector databases, embedding model APIs, document pr…
Explore lab →Enroll in a course that uses this lab, or visit our Houston center for a hands-on demo.