View maintenance notifications

A host maintenance event is when Google Cloud has to perform a maintenance or repair activity on your TPU. Google sends notifications for upcoming host maintenance prior to the maintenance being performed. When the maintenance window opens, Google Cloud automatically performs maintenance on your instance. By monitoring your instance's upcoming maintenance windows, you can proactively prepare your workloads to handle upcoming maintenance with minimal disruption.

Cloud TPU lets you view maintenance notifications using the Google Cloud CLI and by querying the metadata server. You can also view upcoming maintenance events in Cloud Logging. For information about viewing maintenance notifications for TPUs in GKE, see Manage GKE node disruption for GPUs and TPUs.

Maintenance notification fields

Maintenance notifications contain the following fields:

  • windowStartTime: The start of the time window in which maintenance will occur
  • windowEndTime: The end of the time window in which maintenance will occur
  • latestWindowStartTime: The latest time that the maintenance window can be moved to
  • maintenanceType: The type of maintenance that will be performed
    • SCHEDULED: Maintenance will get seven days notice
    • UNSCHEDULED: Maintenance represents critical updates for which less notice is given than for scheduled maintenance events
  • canReschedule: Whether you can manually start maintenance during the notification period for this VM.
    • TRUE: You can manually start maintenance during the notification period.
    • FALSE: You can't manually start maintenance on this VM. This is typically observed during the period in which the VM is actively undergoing maintenance.
  • maintenanceStatus: The current maintenance operation's status
    • ONGOING: The maintenance operation is underway
    • PENDING: The maintenance operation has not yet started, but is scheduled

If there is no maintenance notification, the response looks similar to the following: