Google Cloud release notes

The following release notes cover the most recent changes over the last 60 days. For a comprehensive list of product-specific release notes, see the individual product release note pages.

You can also see and filter all release notes in the Google Cloud console or you can programmatically access release notes in BigQuery.

To get the latest product updates delivered to you, add the URL of this page to your feed reader, or add the feed URL directly: https://cloud.google.com/feeds/gcp-release-notes.xml

August 29, 2022

Anthos clusters on Azure

You can now launch clusters with the following Kubernetes versions:

  • 1.21.14-gke.2900
  • 1.22.12-gke.1100
  • 1.23.9-gke.800
BigQuery

A weekly digest of client library updates from across the Cloud SDK.

Go

Changes for bigquery/storage/apiv1beta1

1.39.0 (2022-08-23)

Features
  • bigquery/storage: allow users to set Apache Avro output format options through avro_serialization_options param in TableReadOptions message Through AvroSerializationOptions, users can set enable_display_name_attribute, which populates displayName for every avro field with the original column name Improved documentation for selected_fields, added example for clarity. (41ab4ec)
  • bigquery: add PreserveAsciiControlCharacters support for CSV (#6448) (b7bac2f)
  • bigquery: add preview support for default values (#6464) (edc3be5)

Java

Changes for google-cloud-bigquery

2.14.7 (2022-08-23)

Bug Fixes
  • table-not-found issue with executeSelect while running long queries (#2222) (4876569)

2.15.0 (2022-08-25)

Features

Community contributed UDFs are now generally available in the bigquery-utils GitHub repository and the bigquery-public-data.persistent_udfs public dataset.

Cloud console updates: In the query editor, when you select a function signature from the autocomplete list, you can remove the parameter names quickly by pressing the Backspace or Delete key.

Cloud Logging

A weekly digest of client library updates from across the Cloud SDK.

Java

Changes for google-cloud-logging

3.10.5 (2022-08-25)

Bug Fixes
  • resource detection for 2nd gen of Cloud Functions works incorrectly (#1045) (dda1d0a)
Cloud Monitoring

You can now manage Monitoring-specific roles by using the Cloud Monitoring pages in the Google Cloud console. For more information, see Grant access to Cloud Monitoring.

Filestore

Filestore is now available in Madrid, Spain (europe-southwest1 region).

Filestore is now available in Paris, France (europe-west9 region).

Filestore is now available in Milan, Italy (europe-west8 region).

SAP on Google Cloud

Monitoring agent for SAP HANA version 2.7

Version 2.7 of the monitoring agent for SAP HANA is now available. This version includes bug fixes and supportability improvements.

For more information about the agent, see Monitoring agent for SAP HANA.

Secret Manager

A weekly digest of client library updates from across the Cloud SDK.

Python

Changes for google-cloud-secret-manager

2.12.4 (2022-08-24)

Documentation
  • samples: Added sample for creating Secret with UserManaged replication (#328) (c5fe7ff)

August 26, 2022

Cloud Healthcare API

A release was made. Updates may include general performance improvements, bug fixes, and updates to the API reference documentation.

Cloud SQL for PostgreSQL

The following extensions in Cloud SQL for PostgreSQL are generally available:

  • pgRouting. Enhances geospatial processing, through network routing and analysis, for PostGIS.
  • plv8. Provides a procedural language for enabling the use of JavaScript.
  • amcheck. Enables the use of the pg_amcheck application to check for corruption in PostgreSQL databases.
Google Distributed Cloud Edge

This is a patch release of Google Distributed Cloud Edge (version 1.1.1).

The following changes have been introduced in this release of Google Distributed Cloud Edge:

  • Google Distributed Cloud Edge worker nodes have been updated to Kubernetes 1.22.

The following issues have been resolved in this release of Google Distributed Cloud Edge:

  • The SR-IOV interface no longer fails to start after a Google Distributed Cloud Edge worker node has been rebooted.

August 25, 2022

Access Approval

Access Approval supports Dataproc in the Preview stage.

AlloyDB for PostgreSQL

AlloyDB supports customer-managed encryption keys (CMEK), an alternative to its default Google-managed encryption. CMEK is especially useful for AlloyDB users who need to manage their own data encryption keys in order to satisfy specific compliance or regulatory requirements.

Anthos clusters on AWS (previous generation)

Anthos clusters on AWS (previous generation) aws-1.12.2-gke.1 is now available.

You can now launch clusters with the following Kubernetes versions:

  • 1.21.14-gke.2900
  • 1.22.12-gke.1100
  • 1.23.9-gke.800
Anthos clusters on VMware

Anthos clusters on VMware 1.12.1-gke.57 is now available. To upgrade, see Upgrading Anthos clusters on VMware. Anthos clusters on VMware 1.12.1-gke.57 runs on Kubernetes 1.23.5-gke.1505.

The supported versions offering the latest patches and updates for security vulnerabilities, exposures, and issues impacting Anthos clusters on VMware are 1.12, 1.11, and 1.10.

  • GA: You can now have your GKE clusters in separate vSphere clusters. With this feature, you can deploy the admin cluster in one vSphere cluster, and a user cluster in a different vSphere cluster.
  • Fixed the issue where mounting emptyDir volume with exec option on Container-Optimized OS (COS) nodes fails with permission error.
  • Fixed the issue where enabling and disabling cluster autoscaler sometimes prevents nodepool replicas from being updated.
  • Fixed the manual node repair issue where manually adding the onprem.cluster.gke.io/repair-machine Machine annotation can trigger VM recreation without deleting the Machine object.
  • Switched back to cgroup v1 (hybrid) for Container Optimized OS (COS) nodes because cgroup v2 (unified) could potentially cause instability for your workloads in a COS cluster.
  • Fixed the issue where running gkectl repair admin-master after a failed admin cluster upgrade attempt caused subsequent admin upgrade attempts to fail. A preflight check has been added for gkectl repair admin-master to prevent the process from using a template that doesn't match the admin cluster checkpoint.
  • Fixed the issue where kubectl describe might error or timeout if resource number is too high during a cluster snapshot.
  • Fixed the following vulnerabilities:

Anthos clusters on bare metal

Release 1.12.2

Anthos clusters on bare metal 1.12.2 is now available for download. To upgrade, see Upgrading Anthos on bare metal. Anthos clusters on bare metal 1.12.2 runs on Kubernetes 1.23.

Features:

  • Added –use-disk flag to bmctl backup cluster command to use the disk instead of the in-memory buffer to back up a cluster. Use this option when available RAM is limited on your admin workstation.
  • Added --quiet flag to bmctl check cluster -- snapshot command to suppress logging to the console during the snapshot creation.

Fixes:

  • Added caching for the Cloud Audit Logging feature status to avoid unnecessary checks and improve performance.
  • Increased the etcd default DB size to 6GiB by default to address NO_SPACE_ALARM in high-scale clusters.
  • Fixed a libseccomp package incompatibility issue.
  • Fixed an issue with the machine-reset job getting stuck.
  • Fixed an issue that caused continuous, unneeded cluster reconciliation operations.
  • Fixed an issue that prevented the node problem detector from running after a cluster upgrade.

The following container image security vulnerabilities have been fixed:

Known issues:

For information about the latest known issues, see Anthos on bare metal known issues in the Troubleshooting section.

Artifact Registry

Container Analysis automatic scanning for Java and Go vulnerabilities in container images is now in Preview. If the Container Scanning API is enabled, it scans container images pushed to Artifact Registry for Java and Go vulnerabilities, in addition to operating system vulnerabilities.

Container Analysis returns Java and Go vulnerability results for images that have a supported or unsupported operating system. When you push new versions of images to the registry, you might see more successful vulnerability scans and corresponding charges against images without a supported operating system.

For more information, see the Types of scanning in the Container Analysis documentation.

Cloud Monitoring

There are new filtering capabilities for the projects.uptimeCheckConfig.list API method. For more information, see UptimeCheckConfig.

Compute Engine

Preview: You can double the default size limit for a managed instance group (MIG): Zonal MIGs now support up to 2,000 VMs and regional MIGs support up to 4,000 VMs. For more information, see Increase the group's size limit

Dataflow

Dataflow now uses Regional Managed Instance Groups (MIGs). Previously, Dataflow used zonal MIGs.

If this change causes you to exceed your quota, set your Regional managed instance groups quota to the same limit assigned to your Managed instance groups quota. For more information, see Working with quotas.

Transcoder API

Deinterlace configurations are now supported.

August 24, 2022

AlloyDB for PostgreSQL

You can view which zones host a primary instance's active or standby VMs.

Cloud Storage

The restrict authentication types organization policy constraint is now generally available (GA). This constraint allows you to restrict the authentication types that can be used in requests for Cloud Storage resources.

Dataproc

Announcing the Preview release of Dataproc custom constraints, which can be used to allow or deny specific operations on Dataproc clusters.

Migrate to Virtual Machines

Issue: Linux repositories that use Yum as their package management may have Yum configurations set explicitly to minor versions. For example, a Yum configuration may point to specific repositories holding 7.6 packages. This is not currently supported by Google. Only repositories holding the latest versions are supported. This may cause a failure to install the Google guest environment after the VM is detached.

Workaround: Update your Yum configuration to refer to the available repositories. For RHEL 7.x, verify that the variable $releasever holds the value 7Server, and not a specific release version number (7.6 for example) by running echo 7Server > /etc/yum/vars/releasever.

Resource Manager

Organization Policy custom constraints has launched into public preview. Custom constraints can allow or restrict access to API calls in the same way that predefined constraints do, but allow administrators to configure conditions based on request parameters and other metadata. For more information, see Creating and managing custom constraints.

SAP on Google Cloud

Monitoring agent for SAP HANA version 2.6

Version 2.6 of the monitoring agent for SAP HANA is now available. This version includes bug fixes and supportability improvements.

For more information about the agent, see Monitoring agent for SAP HANA.

Google Cloud monitoring agent for SAP NetWeaver version 2.6

Version 2.6 of the Google Cloud monitoring agent for SAP NetWeaver is now available. This version includes bug fixes and supportability improvements.

For more information about the agent, see Monitoring SAP NetWeaver on Google Cloud.

August 23, 2022

Anthos clusters on bare metal

Release 1.10.8

Anthos clusters on bare metal 1.10.8 is now available for download. To upgrade, see Upgrading Anthos on bare metal. Anthos clusters on bare metal 1.10.8 runs on Kubernetes 1.21.

Fixes

The following container image security vulnerability has been fixed:

Known issues:

For information about the latest known issues, see Anthos on bare metal known issues in the Troubleshooting section.

Anthos VM Runtime

Anthos VM Runtime is Generally Available (GA). Some features and capabilities are available for Preview only, as indicated in the following descriptions:

  • Upgraded Kubevirt to version 0.49.
  • Upgraded Containerized Data Importer (CDI) to version 1.43.0.
  • Added bmctl command to enable or disable Anthos VM Runtime on user clusters.
  • Added automatic upgrade of Anthos VM Runtime when upgrading Anthos clusters on bare metal.
  • Preview: Added ability to configure an eviction policy that controls how VMs automatically migrate to other hosts during maintenance events.
  • Preview: Added non-disruptive upgrading of VM runtime during live migration (that is, when VMs are unobtrusively migrated from one node to another).

VM APIs:

Observability:

Guest OS support:

Added support for the following guest OS versions running on a Virtual Machine:

  • Windows Server 2019
  • Windows Server 2016
  • Windows 10
  • Red Hat Enterprise Linux (RHEL) 8
  • RHEL 7
  • CentOS 8
  • CentOS 7
  • Ubuntu 20.04
  • Ubuntu 18.04

VM networking features:

  • IPAMv4: Static IP Allocation for VM interfaces.
  • IP and MAC Stickiness for VM interfaces.
  • IPAMv4: DHCP for VM interfaces.
  • VLAN tagging support for VM Interfaces.
  • Multi-NIC for VM interfaces through native Dataplane V2 support (macvtap + Dataplane V2).
  • Static routes and DNS configurations at per-network basis.
  • NetworkPolicy enforcement at per-network basis.
  • Validating admission webhooks for Network and NetworkInterface object.
  • Network Mutation, allow the mutations of Gateway, DNS and the customized network routes in the network custom resource. The parent interface for the VM and the VLAN ID are not mutable. VMs that were already running before the network configuration change need to be restarted to pick up the change.
  • Added command to restart all VMs in a network.
  • Graceful IP release for VMs:

    • During VM migration, the IP isn't released.
    • IP addresses are released for VMs that are deleted or stopped.

    For more information on networking, see Create and use virtual networks for Anthos VM Runtime.

VM Runtime issues:

  • When kubevirt is configured, customers should ensure that TOR switches have MAC learning enabled.

  • If you choose to manually run a DHCP ipconfig /renew command in a Windows VM, you should first perform a DHCP release, using theipconfig /release command. In other words, the sequence for manually performing a DHCP renewal in a Windows environment is the following:

    ipconfig /release
    ipconfig /renew
    
Apigee UI

On August 23, 2022, we released an updated version of the Apigee UI

Note: Rollouts of this release will begin today and may take several weeks to be completed across all Google Cloud zones. Your instances may not have the features and fixes available until the rollout is complete.

With this release, the Apigee UI will display the new version of the Proxy Editor by default.

In this release, you can view both the visual editor and the text editor at the same time in the Develop view, without having to manually switch between the two. You can also resize the display area of either editor to view it more easily. See Change the target endpoint for a description of the changes to the editor layout.

Google Kubernetes Engine

CVE-2022-24675 CVE-2022-2068 CVE-2022-28327 have been patched in the PD CSI driver in 1.23 for newly created clusters.

For VPC-native clusters, the user-managed secondary range for Services can now be shared among clusters in the same subnet. The Services range no longer needs to be unique for clusters on the same subnet. Shared Services ranges are backwards-compatible with all GKE versions.

Kf

Added limits to containers.

Fixed set-env slowness.

SAP on Google Cloud

Terraform configurations for SAP deployments on Google Cloud

Terraform configurations to automate the deployment of the following SAP solutions on Google Cloud are now generally available (GA):

  • SAP HANA single-host scale-up or multi-host scale-out
  • SAP HANA scale-out with host auto-failover
  • SAP HANA scale-up in a Linux high-availability cluster
  • SAP NetWeaver on RHEL or SLES
  • SAP NetWeaver high-availability cluster configuration on SLES

For more information, see Automating SAP deployments on Google Cloud with Terraform.

Transcoder API

Audio-only outputs are now supported. For more information, see the Pricing page and the sample configuration.

Labels are now supported. Labels are key-value pairs you can use to organize resources.

August 22, 2022

API Keys API

API Keys API is now available in GA.

Apigee X

On August 22, 2022, we released an updated version of Apigee X (1-8-0-apigee-33).

Bug ID Description
N/A Upgraded infrastructure and libraries
Apigee hybrid

hybrid v1.8.0

On August 22, 2022 we released an updated version of the Apigee hybrid software, v1.8.0.

For information on upgrading, see Upgrading Apigee hybrid to version 1.8.

Apigee Ingress gateway

Starting in version 1.8, Apigee hybrid offers a new feature to manage the ingress gateway for your hybrid installation, Apigee ingress gateway. Anthos Service Mesh is no longer a prerequisite for hybrid installation. With Apigee ingress gateway, Apigee will stop supplying routing configuration to Anthos Service Mesh. See Managing Apigee ingress.

ORG-level UDCA

Apigee hybrid now supports setting UDCA at the org level instead of at the environment level. See orgScopedUDCA in the Configuration property reference.

Support for newer versions of Anthos, Anthos Service Mesh, and Kubernetes

Starting in version 1.8, Apigee hybrid supports Anthos version 1.12, Anthos Service Mesh version 1.13, and Kubernetes version 1.23 on specific platforms. See Apigee hybrid supported platforms and versions for details.

KVM pagination

Apigee hybrid now supports KVM pagination (introduced in Apigee X on March 10, 2022). See REST Resource: organizations.keyvaluemaps and REST Resource: v1.organizations.environments.keyvaluemaps.

apigeectl now supports the --v option to set the log verbosity level

Starting in version 1.8, apigeectl includes a --v option to set log verbosity levels in the format --v=int, for example apigeectl apply --v=5. This option replaces the --verbose option (now deprecated). This is the same as the kubectl --v option. See apigeectl for details.

tools/apigee-pull-push.sh includes a –list option to list all images

Starting in version 1.8, The tools/apigee-pull-push.sh utility has a --list or -l option that will list all images in the gcr repo. See apigee-pull-push.sh for details.

Bug ID Description
239854141 apigee-pull-push.sh now uses gcr source repositories. (Fixed in Apigee hybrid v1.8.0)
238370197 Fixed an issue where the timeTaken variable's value could sometimes be calculated incorrectly. (Fixed in Apigee hybrid v1.7.3)
236399482 Added support for ASM v1.13. (Fixed in Apigee hybrid v1.7.2)
236129944 Fixed the controller crashloopbackoff due to null pointer issue. (Fixed in Apigee hybrid v1.6.9)
236129944 Fixed the controller crashloopbackoff resulting from null pointer. (Fixed in Apigee hybrid v1.7.2)
234620567 Fix logger issue in Anthos BareMetal with CentOS. (Fixed in Apigee hybrid v1.6.9)
234355351 Fixed issue with message processor pods restarting frequently. Added backoff polling task for Cloud KMS key listener. The listener is paused only when the flush policy is met. (Fixed in Apigee X, June 21, 2022)
233349518 Fixed "Invalid Resource" error generated for job/apigee-resources-install. (Fixed in Apigee hybrid v1.7.1)
233094108 Fixed Stacktrace truncation in runtime containers to support proxy diagnosis. (Fixed in Apigee hybrid v1.7.2)
232977937 Fixed an issue where deployment would become stuck on "Applying routing changes on" for multiple ingress gateways. (Fixed in Apigee hybrid v1.7.1)
232529030 Replaced the Logging fluentbit container environment variable http_proxy with HTTP_FORWARD_PROXY to maintain compatibility with fluentbit 1.8. (Fixed in Apigee hybrid v1.7.3)
231313050 Fixed issue causing Apigee logger pod to remain in crashloopbackoff state. (Fixed in Apigee hybrid v1.7.2)
229824389 Fixed an issue in hybrid 1.7.0 where the output apigeectl init could be generated in the wrong order. (Fixed in Apigee hybrid v1.7.1)
229804717 Fixed upgrade envoy to use distroless v1.22.0. (Fixed in Apigee hybrid v1.7.1)
229639530 Fixed an error harmonizing the container process ID to use Apigee ID for Hybrid on OpenShift. (Fixed in Apigee hybrid v1.7.1)
228855520 Upgraded support for ASM version 1.13. (Fixed in Apigee X, May 9, 2022)
227600373 Fixed an installation issue with Cassandra. (Fixed in Apigee hybrid v1.6.7)
227538469 Fixed an issue where configuration actions would write logs to the pod file system. (Fixed in Apigee hybrid v1.7.1)
226964206 MART, runtime and synchronizer would write to the pod file system. (Fixed in Apigee hybrid v1.7.1)
226464960 Apigee hybrid fresh installations on OpenShift 4.6 and 4.8 would fail. (Fixed in Apigee hybrid v1.6.7)
225939342 Fixed an error where deployment status would show as "Applying routing changes on {env}". (Fixed in Apigee hybrid v1.7.1)
225198475 Fixed an issue where resource reference changes could not be detected. (Fixed in Apigee hybrid v1.7.1)
225169066 Cassandra database backup and restore was not working when http_proxy is enabled under certain circumstances. (Fixed in Apigee hybrid v1.5.10)
225081332 Fixed allow privileged pods issue. (Fixed in Apigee hybrid v1.7.1)
224620542 On some Kubernetes platforms, logging would fail without adding an empty directory for the logs. (Fixed in Apigee hybrid v1.6.7)
223081301 Fixed organization-level UDCA incorrect http-proxy secret name. (Fixed in Apigee hybrid v1.6.7)
222649295 Organization-level UDCA would hang. (Fixed in Apigee hybrid v1.6.7)
221885751 Hybrid logging functionality has been reworked. This should resolve issues with excessive log volume generation, frequent logger restarts, and ensure correct logger functionality with both docker and containerd runtimes. (Fixed in Apigee hybrid v1.5.8)
221292104 Fix to address failure to capture requests in Debug sessions involving PostClientFlow ServiceCallouts. (Fixed in Apigee X, May 9, 2022)
221266789 Hybrid logging functionality has been reworked. This should resolve issues with excessive log volume generation, frequent logger restarts, and ensure correct logger functionality with both docker and containerd runtimes. (Fixed in Apigee hybrid v1.6.7)
219622478 Fixed the CPS property token so that when set to true, it will allow the instance to shutdown and reboot when cassandra connection failures occur. (Fixed in Apigee hybrid v1.7.3)
216018530 Fixed an issue where the apigee-logger-apigee-telemetry DaemonSet could still be left running after turning off logger. (Fixed in Apigee hybrid v1.7.1)
213261445 Fixed reliance on keystore generated by cert manager for metrics endpoint and removed the need for a custom generate_cert script. (Fixed in Apigee hybrid v1.6.7)
211716827 Fixed an issue where a non-default gateway could cause routing errors in certain circumstances. (Fixed in Apigee hybrid v1.7.1)
205616792 Fixed core dump on running user schema setup. (Fixed in Apigee hybrid v1.7.1)
202950533 Remove the server header from all responses. This will be consistent with CG SaaS and OPDK. (Fixed in Apigee hybrid v1.8.0)
202403896 Upgrade to Apigee hybrid v1.6 from v1.5 could fail due to annotation size. (Fixed in Apigee hybrid v1.5.8)
Bug ID Description
230369447 Security fix for commons-codec (Fixed in Apigee hybrid v1.8)
230368838 Security fix for CVE-2018-10237, auto-value:guava (Fixed in Apigee hybrid v1.8)
230366823 Security fix for jackson-databind (Fixed in Apigee hybrid v1.8)
230366589 Security fix for CVE-2021-22696-cxf in cxf (Fixed in Apigee hybrid v1.8)
229804717 Security fix for CVE-2021-3711 (Fixed in Apigee hybrid v1.8, v1.7, v1.6)
229804942 Security fix for CVE-2022-0778 (Fixed in Apigee hybrid v1.8)
N/A Miscellaneous Security updates and fixes.

The apigeectl --verbose option has been deprecated. It is replaced with the --v option which lets you specify the log verbosity level in the format --v=int, for example apigeectl apply --v=5. See apigeectl for details.

BigQuery

A weekly digest of client library updates from across the Cloud SDK.

Go

Changes for bigquery/storage/apiv1beta1

1.38.0 (2022-08-12)

Features
  • bigquery/migration: Add MySQL dialect to bigquerymigration v2 client library (370e23e)
  • bigquery/storage/managedwriter: improve error communication (#6360) (b30d89d)
Bug Fixes
  • bigquery/storage/managedwriter: propagate calloptions to append (#6488) (c65f9da)

Python

Changes for google-cloud-bigquery

3.3.2 (2022-08-16)

Bug Fixes
  • deps: require proto-plus >= 1.22.0 (1de7a52)
  • deps: require protobuf >=3.19, < 5.0.0 (#1311) (1de7a52)
Cloud Bigtable

A weekly digest of client library updates from across the Cloud SDK.

Python

Changes for google-cloud-bigtable

2.11.3 (2022-08-17)

Performance Improvements

2.11.2 (2022-08-11)

Bug Fixes
  • Deps: allow protobuf < 5.0.0 (#631) (fd54fc6)
  • Deps: require proto-plus >= 1.22.0 (fd54fc6)
Cloud Logging

A weekly digest of client library updates from across the Cloud SDK.

Java

Changes for google-cloud-logging

3.10.4 (2022-08-19)

Dependencies
  • update dependency com.google.errorprone:error_prone_annotations to v2.15.0 (#1037) (b2731c7)

3.10.3 (2022-08-19)

Bug Fixes
Dependencies
  • update dependency org.junit.vintage:junit-vintage-engine to v5.9.0 (#1016) (e5f0b55)

Python

Changes for google-cloud-logging

3.2.2 (2022-08-12)

Bug Fixes
  • deps: allow protobuf < 5.0.0 (#600) (8495dac)
  • deps: require proto-plus >= 1.22.0 (8495dac)
Cloud SQL for SQL Server

Cloud SQL may set a value for the max server memory (mb) flag on instances, based on Microsoft's recommended values. For information about flags supported by Cloud SQL, see Configure database flags.

Dataflow

A weekly digest of client library updates from across the Cloud SDK.

Python

Changes for google-cloud-dataflow-client

0.5.5 (2022-08-11)

Bug Fixes
  • deps: allow protobuf < 5.0.0 (#126) (16b89c0)
  • deps: require proto-plus >= 1.22.0 (16b89c0)
Dataproc

Announcing Dataproc Serverless for Spark preview runtime version 2.0.0-RC1, which includes the following components:

  • Spark 3.3.0
  • Cloud Storage Connector 2.2.7
  • Java 17
  • Conda 4.13
  • Python 3.10
  • R 4.1
  • Scala 2.13

Dataproc Serverless for Spark now uses runtime version 1.0.16, which upgrades the following components to the following versions:

  • Spark 3.2.2
  • Avro 1.11.1
  • Hadoop 3.3.4
  • Jetty 9.4.48.v20220622
  • ORC 1.7.5
  • RoaringBitmap 0.9.31
  • Scala 2.12.16
Kf

Fixed issue that liveness probe is not set properly.

Pub/Sub

A weekly digest of client library updates from across the Cloud SDK.

Java

Changes for google-cloud-pubsub

1.120.12 (2022-08-18)

Dependencies
  • update dependency com.google.cloud:google-cloud-bigquery to v2.14.4 (#1242) (08cfe80)
  • update dependency com.google.cloud:google-cloud-bigquery to v2.14.6 (#1245) (7f933ee)
  • update dependency com.google.cloud:google-cloud-core to v2.8.9 (#1250) (7c8fd41)
  • update dependency com.google.protobuf:protobuf-java-util to v3.21.5 (#1243) (37eaff8)
Secret Manager

A weekly digest of client library updates from across the Cloud SDK.

Python

Changes for google-cloud-secret-manager

2.12.3 (2022-08-11)

Bug Fixes
  • deps: allow protobuf < 5.0.0 (#335) (34c5858)
  • deps: require proto-plus >= 1.22.0 (34c5858)
Security Command Center

The following attributes were added to the Finding object of the Security Command Center API:

  • Database provides information about access to a database that is related to a finding.
  • serviceAccountKeyName, serviceAccountDelegationInfo, and principalSubject attributes were added to the existing access attribute. These new attributes provide additional context about the principals that are associated with a finding.
  • uris, a new attribute within the indicator attribute, lists any malicious URIs that are associated with a finding.

For more information, see the Security Command Center API documentation for the Finding object.

August 19, 2022

BigQuery

The ALTER TABLE RENAME COLUMN DDL statement, which allows you to rename the columns of a table, is now in preview.

Cloud Bigtable

You can now use tags to allow or deny security policies on a Cloud Bigtable instance. This feature is generally available (GA). To learn more, see Create and manage tags.

Cloud Healthcare API

A release was made. Updates may include general performance improvements, bug fixes, and updates to the API reference documentation.

Cloud Talent Solution Job Search

Extend the functionality for the inferred remote location filter to respect the region code

Config Controller

Config Controller now uses the following versions of its included products:

Google Kubernetes Engine

GKE clusters that run versions 1.22 or later and use Calico Network Policy might experience issues with terminating Pods. The Calico CNI plugin shows error terminating Pods, and eviction takes too long.

Pods that experience this issue display an error message similar to the following:

Warning FailedKillPod 36m (x389 over 121m) kubelet error killing pod: failed to "KillPodSandbox" for "af9ab8f9-d6d6-4828-9b8c-a58441dd1f86" with KillPodSandboxError: "rpc error: code = Unknown desc = networkPlugin cni failed to teardown pod "myclient-pod-6474c76996" network: error getting ClusterInformation: connection is unauthorized: Unauthorized"

To resolve this issue, restart the calico-node pods or restart kubelet.

For more information about this issue, see Calico issue #4710.

Memorystore for Redis

Customer-managed encryption keys are now Generally Available for Memorystore for Redis.

Text-to-Speech

Text-to-Speech has improved the quality of these voices

  1. cloud-pt-br-Standard-A
  2. cloud-pt-br-Standard-B

August 18, 2022

Anthos Config Management

Policy Controller has been updated to include a more recent build of OPA Gatekeeper (hash: 8f1ef8c).

Updated the built-in Open Telemetry image to v0.54.0 to include a bug fix for using ADC with Cloud Spanner receiver.

Fixed the reconciler Pod CrashLoopBackoff issue caused by the git-sync container starting before the gcenode-askpass-sidecar.

Added cluster-autoscaler.kubernetes.io/safe-to-evict: "true" annotation to the reconciler Pod so that it does not block Cluster Autoscaler scale down.

Anthos Service Mesh

1.13.7-asm.0 is now available.

Anthos Service Mesh 1.13.7-asm.0 includes the features of Istio 1.13.7 subject to the list of Anthos Service Mesh supported features.

Apigee Connectors

Support for private connectivity through Private Service Connect (PSC)

On August 18, 2022, we released PSC support for hostname configuration in Apigee Connectors.

For all the connectors that require a hostname and port configuration, you can now see a Destinations section when creating the connector. In this section, you must enter the details of the remote host (backend system) you want to connect. You can now specify the destination details either as a host address or a service attachment.

Chronicle

VirusTotal Context

Chronicle's integration with VirusTotal has been revised and enhanced. This feature enables you to pivot from finding domains linked to an asset in Chronicle to viewing information about that domain from VirusTotal. From a Chronicle event view, such as Asset view, Domain view, or IP Address view, click VT Context to open the VirusTotal Context window. Some of the VirusTotal information is only available to users with a VirusTotal Enterprise account.

Some of the older links in the Chronicle user interface to VirusTotal, for example the option in Asset view to display the first 50 results in VirusTotal Graph and the VirusTotal Insights results panel, have been removed. Clicking VT Context provides access to the same information and VirusTotal functionality, including access to VirusTotal Graph.

Cloud Composer

The apache-airflow-providers-google package was upgraded to 2022.8.16+composer. Changes compared to version 2022.6.22+composer:

  • Fix Vertex AI Custom Job training issue (#25367)
  • New Operators for the Google Cloud Dataform service (#25587)

Cloud Composer uses a custom version of the apache-airflow-providers-google package. This custom version is based on the public version 6.8.0. For information about other changes compared to version 6.8.0, see release notes for the previous versions of this package.

The following packages are now preinstalled in Cloud Composer images with Airflow 2.2.5: google-cloud-firestore, firebase-admin, gcfs, dbt-core, apache-airflow-providers-dbt-cloud.

Cloud Composer 1.19.7 and 2.0.24 images are available:

  • composer-1.19.7-airflow-1.10.15 (default)
  • composer-1.19.7-airflow-2.1.4
  • composer-1.19.7-airflow-2.2.5
  • composer-2.0.24-airflow-2.1.4
  • composer-2.0.24-airflow-2.2.5

Cloud Composer versions 1.16.14 and 1.17.0.preview.10 have reached their end of full support period.

Cloud DNS

Health checks for internal load balancers and automatic failovers in Cloud DNS routing policies are now available in Preview.

Dialogflow

Dialogflow CX and ES have new tutorials that walk through the steps of deploying a Dialogflow agent on Google Cloud, integrating with Cloud Functions, Spanner, and App Engine:

Google Cloud Deploy

Google Cloud Deploy now supports Skaffold version 1.39.1, as the default.

Google Kubernetes Engine

(2022-R20) Version updates

GKE cluster versions have been updated.

New versions available for upgrades and new clusters

The following Kubernetes versions are now available for new clusters and for opt-in control plane upgrades and node upgrades for existing clusters. For more information on versioning and upgrades, see GKE versioning and support and Upgrades.

No channel

  • Version 1.22.11-gke.400 is now the default version.
  • The following control plane and node versions are now available:
  • The following control plane versions are no longer available:
    • 1.20.15-gke.9900
    • 1.21.12-gke.1700
    • 1.22.8-gke.201
    • 1.22.8-gke.202
    • 1.22.8-gke.2200
    • 1.22.9-gke.1300
    • 1.22.9-gke.1500
    • 1.22.9-gke.2000
    • 1.23.5-gke.1503
    • 1.23.5-gke.2400
    • 1.23.6-gke.1500
    • 1.23.6-gke.1501
    • 1.23.6-gke.1700
    • 1.23.6-gke.2200
  • Control planes and nodes with auto-upgrade enabled will be upgraded from version 1.19 to version 1.20.15-gke.11400 with this release.
  • Control planes and nodes with auto-upgrade enabled will be upgraded from version 1.20 to version 1.21.13-gke.900 with this release.
  • Control planes and nodes with auto-upgrade enabled will be upgraded from version 1.21 to version 1.21.13-gke.900 with this release.
  • Control planes and nodes with auto-upgrade enabled will be upgraded from version 1.22 to version 1.22.10-gke.600 with this release.
  • Control planes and nodes with auto-upgrade enabled will be upgraded from version 1.23 to version 1.23.7-gke.1400 with this release.

Stable channel

  • Version 1.21.13-gke.900 is now the default version in the Stable channel.
  • Version 1.20.15-gke.11400 is now available in the Stable channel.
  • Version 1.20.15-gke.9900 is no longer available in the Stable channel.
  • Control planes and nodes with auto-upgrade enabled in the Stable channel will be upgraded from version 1.19 to version 1.20.15-gke.11400 with this release.
  • Control planes and nodes with auto-upgrade enabled in the Stable channel will be upgraded from version 1.20 to version 1.21.13-gke.900 with this release.
  • Control planes and nodes with auto-upgrade enabled in the Stable channel will be upgraded from version 1.21 to version 1.21.13-gke.900 with this release.

Regular channel

  • Version 1.22.11-gke.400 is now the default version in the Regular channel.
  • The following versions are now available in the Regular channel:
  • The following versions are no longer available in the Regular channel:
    • 1.20.15-gke.11400
    • 1.21.13-gke.900
    • 1.22.10-gke.600
  • Control planes and nodes with auto-upgrade enabled in the Regular channel will be upgraded from version 1.19 to version 1.20.15-gke.12800 with this release.
  • Control planes and nodes with auto-upgrade enabled in the Regular channel will be upgraded from version 1.20 to version 1.21.14-gke.700 with this release.
  • Control planes and nodes with auto-upgrade enabled in the Regular channel will be upgraded from version 1.21 to version 1.21.14-gke.700 with this release.
  • Control planes and nodes with auto-upgrade enabled in the Regular channel will be upgraded from version 1.22 to version 1.22.11-gke.400 with this release.
  • Control planes and nodes with auto-upgrade enabled in the Regular channel will be upgraded from version 1.24 to version 1.24.2-gke.1900 with this release.

Rapid channel

  • Version 1.24.2-gke.1900 is now the default version in the Rapid channel.
  • The following versions are now available in the Rapid channel:
  • The following versions are no longer available in the Rapid channel:
    • 1.20.15-gke.13400
    • 1.21.14-gke.2100
    • 1.22.12-gke.300
    • 1.23.8-gke.1900
  • Control planes and nodes with auto-upgrade enabled in the Rapid channel will be upgraded from version 1.19 to version 1.20.15-gke.13700 with this release.
  • Control planes and nodes with auto-upgrade enabled in the Rapid channel will be upgraded from version 1.20 to version 1.21.14-gke.2700 with this release.
  • Control planes and nodes with auto-upgrade enabled in the Rapid channel will be upgraded from version 1.21 to version 1.21.14-gke.2700 with this release.
  • Control planes and nodes with auto-upgrade enabled in the Rapid channel will be upgraded from version 1.22 to version 1.23.9-gke.900 with this release.
  • Control planes and nodes with auto-upgrade enabled in the Rapid channel will be upgraded from version 1.23 to version 1.24.2-gke.1900 with this release.

(2022-R20) Version updates

  • Version 1.21.13-gke.900 is now the default version in the Stable channel.
  • Version 1.20.15-gke.11400 is now available in the Stable channel.
  • Version 1.20.15-gke.9900 is no longer available in the Stable channel.
  • Control planes and nodes with auto-upgrade enabled in the Stable channel will be upgraded from version 1.19 to version 1.20.15-gke.11400 with this release.
  • Control planes and nodes with auto-upgrade enabled in the Stable channel will be upgraded from version 1.20 to version 1.21.13-gke.900 with this release.
  • Control planes and nodes with auto-upgrade enabled in the Stable channel will be upgraded from version 1.21 to version 1.21.13-gke.900 with this release.

(2022-R20) Version updates

  • Version 1.22.11-gke.400 is now the default version.
  • The following control plane and node versions are now available:
  • The following control plane versions are no longer available:
    • 1.20.15-gke.9900
    • 1.21.12-gke.1700
    • 1.22.8-gke.201
    • 1.22.8-gke.202
    • 1.22.8-gke.2200
    • 1.22.9-gke.1300
    • 1.22.9-gke.1500
    • 1.22.9-gke.2000
    • 1.23.5-gke.1503
    • 1.23.5-gke.2400
    • 1.23.6-gke.1500
    • 1.23.6-gke.1501
    • 1.23.6-gke.1700
    • 1.23.6-gke.2200
  • Control planes and nodes with auto-upgrade enabled will be upgraded from version 1.19 to version 1.20.15-gke.11400 with this release.
  • Control planes and nodes with auto-upgrade enabled will be upgraded from version 1.20 to version 1.21.13-gke.900 with this release.
  • Control planes and nodes with auto-upgrade enabled will be upgraded from version 1.21 to version 1.21.13-gke.900 with this release.
  • Control planes and nodes with auto-upgrade enabled will be upgraded from version 1.22 to version 1.22.10-gke.600 with this release.
  • Control planes and nodes with auto-upgrade enabled will be upgraded from version 1.23 to version 1.23.7-gke.1400 with this release.

(2022-R20) Version updates

  • Version 1.22.11-gke.400 is now the default version in the Regular channel.
  • The following versions are now available in the Regular channel:
  • The following versions are no longer available in the Regular channel:
    • 1.20.15-gke.11400
    • 1.21.13-gke.900
    • 1.22.10-gke.600
  • Control planes and nodes with auto-upgrade enabled in the Regular channel will be upgraded from version 1.19 to version 1.20.15-gke.12800 with this release.
  • Control planes and nodes with auto-upgrade enabled in the Regular channel will be upgraded from version 1.20 to version 1.21.14-gke.700 with this release.
  • Control planes and nodes with auto-upgrade enabled in the Regular channel will be upgraded from version 1.21 to version 1.21.14-gke.700 with this release.
  • Control planes and nodes with auto-upgrade enabled in the Regular channel will be upgraded from version 1.22 to version 1.22.11-gke.400 with this release.
  • Control planes and nodes with auto-upgrade enabled in the Regular channel will be upgraded from version 1.24 to version 1.24.2-gke.1900 with this release.

(2022-R20) Version updates

  • Version 1.24.2-gke.1900 is now the default version in the Rapid channel.
  • The following versions are now available in the Rapid channel:
  • The following versions are no longer available in the Rapid channel:
    • 1.20.15-gke.13400
    • 1.21.14-gke.2100
    • 1.22.12-gke.300
    • 1.23.8-gke.1900
  • Control planes and nodes with auto-upgrade enabled in the Rapid channel will be upgraded from version 1.19 to version 1.20.15-gke.13700 with this release.
  • Control planes and nodes with auto-upgrade enabled in the Rapid channel will be upgraded from version 1.20 to version 1.21.14-gke.2700 with this release.
  • Control planes and nodes with auto-upgrade enabled in the Rapid channel will be upgraded from version 1.21 to version 1.21.14-gke.2700 with this release.
  • Control planes and nodes with auto-upgrade enabled in the Rapid channel will be upgraded from version 1.22 to version 1.23.9-gke.900 with this release.
  • Control planes and nodes with auto-upgrade enabled in the Rapid channel will be upgraded from version 1.23 to version 1.24.2-gke.1900 with this release.
Identity and Access Management

Workforce identity federation now lets users from external identity providers sign in to the Google Cloud workforce identity federation console, also known as the console (federated). The console (federated) provides UI access to supported Google Cloud products. This feature is available in Preview.

August 17, 2022

BigQuery

You can now set default values on columns in your BigQuery tables. This feature is now in preview.

Cloud console updates: You can now copy BigQuery metadata to your clipboard by using the following options:

  • In the Schema view, to copy a table's schema, select any fields, and then click Copy.

  • In the Explorer pane, to copy the ID of a resource, click View actions, and then click Copy ID.

Cloud console updates: Improvements include the following:

  • Query results are now displayed in resizable columns.

  • Tab titles now expand when space is available for longer names.

  • Tooltips no longer display text immediately when you hold the pointer over them, avoiding unnecessary distraction.

  • In the Explorer pane, you can now access saved queries by expanding your project. The Saved Queries pane is no longer at the bottom of the console.

  • In the Explorer pane, you can now find a table by searching for mydataset.mytable.

  • In the query editor, you can now press the F1 shortcut key to view more editor shortcuts.

Chronicle

The following supported default parsers have changed. Each is listed by product name and ingestion label, if applicable.

  • Akamai WAF (AKAMAI_WAF)
  • Arista Switch (ARISTA_SWITCH)
  • AWS CloudWatch (AWS_CLOUDWATCH)
  • AWS GuardDuty (GUARDDUTY)
  • AWS Macie (AWS_MACIE)
  • AWS Route 53 DNS (AWS_ROUTE_53)
  • AWS WAF (AWS_WAF)
  • Azure AD (AZURE_AD)
  • Azure AD Organizational Context (AZURE_AD_CONTEXT)
  • Bitdefender (BITDEFENDER)
  • Bluecat DDI (BLUECAT_DDI)
  • Centrify (CENTRIFY_SSO)
  • Check Point (CHECKPOINT_FIREWALL)
  • Cisco Application Centric Infrastructure (CISCO_ACI)
  • Cisco ISE (CISCO_ISE)
  • Custom DNS (CUSTOM_DNS)
  • Cylance Protect (CYLANCE_PROTECT)
  • Elastic Windows Event Log Beats (ELASTIC_WINLOGBEAT)
  • FireEye (FIREEYE_ALERT)
  • Forcepoint Proxy (FORCEPOINT_WEBPROXY)
  • FortiGate (FORTINET_FIREWALL)
  • IBM z/OS (IBM_ZOS)
  • Linux DHCP (LINUX_DHCP)
  • Microsoft AD FS (ADFS)
  • Microsoft Azure Resource (AZURE_RESOURCE_LOGS)
  • Microsoft Defender for Endpoint (MICROSOFT_DEFENDER_ENDPOINT)
  • Microsoft SQL Server (MICROSOFT_SQL)
  • Nasuni File Services Platform (NASUNI_FILE_SERVICES)
  • Palo Alto Prisma Cloud (PAN_PRISMA_CLOUD)
  • Ping Identity (PING)
  • Riverbed Steelhead (STEELHEAD)
  • SiteMinder Web Access Management (CA_SSO_WEB)
  • Snoopy Logger (SNOOPY_LOGGER)
  • Stormshield Firewall (STORMSHIELD_FIREWALL)
  • Symantec Endpoint Protection (SEP)
  • Tanium Stream (TANIUM_TH)
  • VMware ESXi (VMWARE_ESX)
  • VMware Horizon (VMWARE_HORIZON)
  • Windows Event (WINEVTLOG)
  • Windows Sysmon (WINDOWS_SYSMON)

For details about changes in each parser, see Supported default parsers.

Chronicle curated detections provide out-of-the-box threat detection content curated, built, and maintained by Google Cloud Threat Intelligence (GCTI) researchers. This release of curated detections cover the following range of threats:

  • Windows-based threats: Coverage for several classes of threats including infostealers, ransomware, RATs, misused software, and crypto activity.
  • Cloud attacks and cloud misconfigurations: Secure cloud workloads with additional coverage around exfiltration of data, suspicious behavior, and additional vectors.
Cloud Interconnect

Dedicated Interconnect support is available in the following colocation facilities:

  • DATA4 Milan-Cornaredo, Milan
  • Telehouse - Paris 2 (Voltaire - Léon Frot), Paris

For more information, see the Locations table.

Cloud Monitoring

Cloud Monitoring is introducing pricing for uptime checks, effective October 1, 2022. For more information, see Cloud Monitoring pricing summary.

Cloud Spanner

The DISABLE_INLINE hint is now available to use in a Google Standard SQL function call. This allows a function to be computed once instead of each time another part of a query references it.

Cloud Translation

For Cloud Translation - Advanced (v3) glossaries, you can now manage glossary entries. This feature is Generally Available (GA).

Config Connector

Config Connector version 1.92.0 is now available.

Fixed missing Kind field in Go Client ResourceRef struct.

Added support for IAMWorkforcePoolProvider resource.

Added support for "reconcile resource immediately once its dependency is ready" feature for CloudFunctionsFunction, EventarcTrigger, MonitoringUptimeCheckConfig, ServiceDirectoryEndpoint, ServiceDirectoryService

Transfer Appliance

Edge Appliance is now generally available (GA).

Edge Appliance is a Google Cloud-managed, secure, high-performance appliance for edge locations. It provides local storage, ML inference, data transformation, and export.

Learn more or request Edge Appliance now.

Vertex AI Workbench

M95 Release

The M95 release of Vertex AI Workbench managed notebooks includes the following:

  • Fixed a bug where users were regularly getting a 502 error when trying to access JupyterLab.
  • Fixed a bug where opening an instance in Single User mode slowed the start of an instance.
  • Fixed a bug where a managed notebooks instance was not starting after adding a GPU.
  • Fixed bugs on the Serverless Spark form input.
  • Improved the ActivityLog refresh after Serverless Spark creation.
  • Fixed a bug related to the display of materialized views in BigQuery.
  • Refreshed the JupyterLab interface with an improved Google-specific theme.
  • Fixed a bug related to viewing Cloud Storage buckets and folders with large numbers of objects.
  • Regular package refreshment and bug fixes.

Learn more about managed notebooks versions.

August 16, 2022

BigQuery

Workforce identity federation lets you authenticate and authorize users from external identity providers to access supported Google Cloud products, including BigQuery resources. This feature is now in preview.

Chronicle

Feed Management

You can now configure new data feeds for your Chronicle account using Feed Management. This feature makes it possible for you to setup your own data feeds without the assistance of Chronicle support personnel. You can setup new data feeds using either the Feed Management user interface or the Feed Management API. Chronicle returns error messages in the event you have misconfigured a feed and need to make changes.

Cloud DNS

Alias records are available in Preview.

You can now manage an alias record, which maps an alias domain name to a canonical name at the zone apex, by using Cloud DNS.

IoT Core

Cloud IoT Core will be retired on August 16, 2023. After August 15, 2023, the documentation for IoT Core will no longer be available.

SAP on Google Cloud

Monitoring agent for SAP HANA version 2.5

Version 2.5 of the monitoring agent for SAP HANA is now available. This version includes bug fixes and supportability improvements.

For more information about the agent, see Monitoring agent for SAP HANA.

August 15, 2022

Apigee Connectors

Preview release of new Connectors for Apigee

On August 15, 2022, we released the preview version of the Oracle DB connector for Apigee. For more information, see Create a Oracle DB connection.

BigQuery

A weekly digest of client library updates from across the Cloud SDK.

Python

Changes for google-cloud-bigquery

3.3.1 (2022-08-09)

Bug Fixes

An issue was identified in the max_staleness materialized view option. This feature is not available.

BigQuery Omni now supports reservation DDL and access control DCL. This feature is now generally available (GA).

Previously, you could commit up to 100 GB in streaming bytes for every Storage Write API pending mode commit that you triggered in regions other than the US and EU multi-regions. This limit is now 1 TB. For more information, see Storage Write API quotas.

A weekly digest of client library updates from across the Cloud SDK.

Java

Changes for google-cloud-bigquery

2.14.6 (2022-08-12)

Dependencies
  • update dependency com.google.cloud:google-cloud-datacatalog-bom to v1.9.2 (#2221) (3292cdd)

2.14.5 (2022-08-12)

Dependencies
  • update dependency com.google.apis:google-api-services-bigquery to v2-rev20220806-2.0.0 (#2223) (05d1de1)

2.14.4 (2022-08-08)

Dependencies
  • update dependency com.google.cloud:google-cloud-storage to v2.11.3 (#2213) (a293ab5)
Cloud Bigtable

A weekly digest of client library updates from across the Cloud SDK.

Java

Changes for google-cloud-bigtable

2.10.3 (2022-08-08)

Bug Fixes

2.10.2 (2022-08-03)

Bug Fixes
  • Add a ReadFirstRow callable to set future in onComplete (#1326) (cb539b5)
  • The metadata could be returned in trailer or header depends on i… (#1337) (c4b8c03)
Dependencies
  • Update dependency com.google.cloud:google-cloud-shared-dependencies to v3 (#1328) (bee0ca0)
  • Upgrade shared config to 1.5.3, exclude google-http-client and google-http-client-gson from gax in google-cloud-bigtable-stats (#1336) (98b3349)

Python

Changes for google-cloud-bigtable

2.11.1 (2022-08-08)

Bug Fixes
  • Retry the RST Stream error in mutate rows and read rows(#624) (d24574a)
Cloud Data Fusion

Cloud Data Fusion version 6.7.1 is generally available (GA). This release is in parallel with the CDAP 6.7.1 release.

Changes in 6.7.1:

  • Enhanced the Dataproc provisioner to prevent unneeded Compute Engine calls, depending on the configuration settings.

  • For new Dataproc compute profiles, changed the default value of Master Machine Type from n1 to n2.

Fixed in 6.7.1:

  • Fixed an issue that created duplicate entries in the file cache map, which resulted in multiple attempts to delete the same cache file.

  • Fixed an issue where the Log service left empty folders, which made the mounting of Persistent Disk slow. This caused the Log service not to start in a timely manner.

  • Fixed an issue that caused pipelines to take a long time to launch or get stuck. This was linked to I/O throttling that occurred on the underlying Persistent Disk.

  • Fixed an issue that caused pipelines to fail when two or more pipelines were scheduled to start simultaneously on a static Dataproc cluster. This was due to a file upload race condition.

  • Fixed an issue in flow control that caused Appfabric to return a 5xx error code in rare scenarios, instead of 429 (Too Many Requests Error), if the number of concurrently launching or running pipelines was above certain thresholds.

  • Fixed an issue that resulted in an error when a compute profile was exported from the default namespace after switching from a custom namespace.

  • Delete, edit, and export no longer appear as operations for pre-configured connections in Cloud Data Fusion. You can view connection details for those connections.

  • Fixed an issue when you started a pipeline multiple times, and then stopped the pipeline before it completed, which resulted in the following UI error: Program <program name> is not running.

  • Removed verbose logs from the BigQuery client libraries in pipeline logs.

  • Fixed an issue that caused the BigQuery Execute action plugin configured with an Encryption Key Name (CMEK) to fail when the SQL query contained DDL Statements.

  • In the BigQuery Execute action plugin, added the property Store Results in a BigQuery Table to the UI, which hides the destination table related properties by default.

The SAP Ariba Batch Source plugin is available in Preview. You can connect your data pipeline to an SAP Ariba Source and a BigQuery Sink with this plugin in Cloud Data Fusion versions 6.5.1 and later.

Cloud Logging

Bucket-level log-based metrics are now available in Preview. You can now create log-based metrics that are computed from the logs routed to a specific log bucket. For more information, see Log-based metrics on log buckets.

A weekly digest of client library updates from across the Cloud SDK.

Java

Changes for google-cloud-logging

3.10.2 (2022-08-08)

Dependencies
  • update dependency com.google.cloud:google-cloud-shared-dependencies to v3 (#1018) (17efd5c)
  • update dependency org.graalvm.buildtools:junit-platform-native to v0.9.13 (#992) (3856e4f)
  • update dependency org.graalvm.buildtools:native-maven-plugin to v0.9.13 (#993) (a94e428)
Cloud Monitoring

The GKE Clusters List page now includes a new Observability tab that displays Monitoring data. This tab shows infrastructure health metric trends such as CPU, memory, container restarts and control-plane metrics. It also provides visibility into ingestion into Google Cloud Managed Service for Prometheus and Cloud Logging. For more information, see View observability metrics.

Cloud SQL for MySQL

By enabling instance deletion protection, you can prevent the accidental removal of Cloud SQL instances. This functionality is generally available.

For more information, see Prevent deletion of an instance.

Cloud SQL for PostgreSQL

By enabling instance deletion protection, you can prevent the accidental removal of Cloud SQL instances. This functionality is generally available.

For more information, see Prevent deletion of an instance.

Cloud SQL for SQL Server

By enabling instance deletion protection, you can prevent the accidental removal of Cloud SQL instances. This functionality is generally available.

For more information, see Prevent deletion of an instance.

Dataflow

A weekly digest of client library updates from across the Cloud SDK.

Java

Changes for google-cloud-dataflow

0.7.2 (2022-08-09)

Dependencies
  • update dependency com.google.cloud:google-cloud-shared-dependencies to v3 (#202) (161c011)
Firestore in Datastore mode

A weekly digest of client library updates from across the Cloud SDK.

Java

Changes for google-cloud-datastore

2.11.0 (2022-08-04)

Features
Documentation
  • sample: Add a top-level Datastore samples README (#790) (d3884dc)
Dependencies
  • update dependency com.google.cloud:google-cloud-shared-dependencies to v3 (#805) (ad467ef)
  • update dependency com.google.errorprone:error_prone_core to v2.15.0 (#810) (fc8cd15)
  • update dependency org.junit.vintage:junit-vintage-engine to v5.9.0 (#804) (6caafd8)
Google Kubernetes Engine

The GKE Clusters List page now includes a new Observability tab. This tab shows infrastructure health metric trends such as CPU, Memory, container restarts and Control Plane metrics. It also provides visibility into ingestion into Google Cloud Managed Service for Prometheus and Cloud Logging. For more information, see View observability metrics.

Pub/Sub

A weekly digest of client library updates from across the Cloud SDK.

Python

Changes for google-cloud-pubsub

2.13.6 (2022-08-11)

Bug Fixes
  • deps: allow protobuf < 5.0.0 (#762) (260bd18)
  • deps: require proto-plus >= 1.22.0 (260bd18)
  • set stream_ack_deadline to max_duration_per_lease_extension or 60 s, set ack_deadline to min_duration_per_lease_extension or 10 s (#760) (4444129)
  • Update stream_ack_deadline with ack_deadline (#763) (e600ad8)

2.13.5 (2022-08-10)

Documentation
Secret Manager

A weekly digest of client library updates from across the Cloud SDK.

Java

Changes for google-cloud-secretmanager

2.3.1 (2022-08-03)

Bug Fixes
Dependencies
  • update dependency com.google.cloud:google-cloud-shared-dependencies to v3 (#811) (9e84f35)
  • update dependency com.google.protobuf:protobuf-java-util to v3.21.3 (#808) (17cc2d2)
  • update dependency com.google.protobuf:protobuf-java-util to v3.21.4 (#809) (5ae26ff)
  • update dependency org.graalvm.buildtools:junit-platform-native to v0.9.13 (#802) (0749cd2)
  • update dependency org.graalvm.buildtools:native-maven-plugin to v0.9.13 (#803) (e2d693b)
  • update dependency org.junit.vintage:junit-vintage-engine to v5.9.0 (#810) (5c5bfb1)

Python

Changes for google-cloud-secret-manager

2.12.2 (2022-08-08)

Documentation
  • samples: add sample to update secret with alias (#307) (dab8e16)

August 13, 2022

Dataproc

New sub-minor versions of Dataproc images:

1.5.73-debian10, 1.5.73-rocky8, 1.5.73-ubuntu18

2.0.47-debian10, 2.0.47-rocky8, 2.0.47-ubuntu18

Enabled Spark authentication and encryption for Kerberos clusters in 1.5 and 2.0 images.

Dataproc Serverless for Spark now uses runtime version 1.0.15, which upgrades the following Spark dependencies to the following versions:

  • Jackson 2.13.3
  • Jetty 9.4.46.v20220331
  • ORC 1.7.4
  • Parquet 1.12.3
  • Protobuf 3.19.4
  • RoaringBitmap 0.9.28

FallbackHiveAuthorizerFactory is now set by default on newly created 1.5 and 2.0 image clusters that have the any of the following features enabled:

If you encounter a Cannot modify <PARAM> or similar runtime error when running a SET statement in a Hive query, this means the parameter is not in list of allowable runtime parameters. You can allow the parameter using hive.security.authorization.sqlstd.confwhitelist.append as a cluster property when you create a cluster.

Example:

--properties="hive:hive.security.authorization.sqlstd.confwhitelist.append=tez.application.tags,<ADDITIONAL-1>,<ADDITIONAL-2>"

August 12, 2022

Anthos Service Mesh

1.14.3-asm.1 is now available.

This patch release contains a fix for the known issue with the signatures of the revisions released August 11, 2022.

Anthos Service Mesh 1.14.3-asm.1 includes the features of Istio 1.14.3 subject to the list of Anthos Service Mesh supported features.

Anthos clusters on VMware

Anthos clusters on VMware 1.10.6-gke.36 is now available. To upgrade, see Upgrading Anthos clusters on VMware. Anthos clusters on VMware 1.10.6-gke.36 runs on Kubernetes 1.21.14-gke.2100.

The supported versions offering the latest patches and updates for security vulnerabilities, exposures, and issues impacting Anthos clusters on VMware are 1.12, 1.11, and 1.10.

  • Fixed the issue where mounting emptyDir volume with exec option on Container-Optimized OS (COS) nodes fails with permission error.
  • Fixed the issue where enabling and disabling cluster autoscaler sometimes prevents nodepool replicas from being updated.
  • Fixed the following vulnerabilities:

Cloud Asset Inventory

The following resource types are now publicly available through the Analyze Policy APIs (AnalyzeIamPolicy and AnalyzeIamPolicyLongrunning):

  • Dataproc
    • dataproc.googleapis.com/AutoscalingPolicy
    • dataproc.googleapis.com/Batch
    • dataproc.googleapis.com/WorkflowTemplate
Cloud Bigtable

Cloud Bigtable-BigQuery federation is now generally available (GA). You can use BigQuery to query data from Cloud Bigtable and blend it with data from other federated data sources. For more information, see Querying Cloud Bigtable data.

Deep Learning Containers

M95 Release

  • Tensorflow has been updated to 2.9.1, 2.8.1, and 2.6.5 to include upstream changes.
  • Regular package refreshment and bug fixes.
Deep Learning VM Images

M95 Release

  • Tensorflow has been updated to 2.9.1, 2.8.1, and 2.6.5 to include upstream changes.
  • Updated to the latest NVIDIA driver version: 510.47.03.
  • The latest NVIDIA driver version does not support K80 GPUs. To use K80 GPUs, you must use an M94 or earlier environment.
  • Fixed bug in which the user is prompted with the warning JupyterLab build is suggested on startup for TensorFlow Deep Learning VMs.
  • Regular package refreshment and bug fixes.

n1-standard-1 Compute instances that use the tensorflow-gpu family fail to boot if they were created with a single disk and no accelerator.

Please use the tf-latest-cpu image family for instances without accelerators, or increase the machine type to at least n1-standard-2.

Transfer Appliance

You can now place your Transfer Appliance into suspend mode before moving it to a new location. Suspend mode removes access to data on the device and suspends any transfers.

Learn more from the Suspend section of the documentation.

Vertex AI

Vertex Explainable AI

Vertex Explainable AI now offers Preview support for example-based explanations. For more information, see Configure example-based explanations for custom training.

August 11, 2022

Anthos Service Mesh

1.14.3-asm.0 is now available.

Anthos Service Mesh 1.14.3-asm.0 includes the features of Istio 1.14.3 subject to the list of Anthos Service Mesh supported features.

1.12.9-asm.0 is now available.

Anthos Service Mesh 1.12.9-asm.0 includes the features of Istio 1.12.9 subject to the list of Anthos Service Mesh supported features.

Apigee X

On August 11, 2022 we released an updated version of Apigee X.

This release contains the new Abuse page in Advanced API Security, which displays information about bots that have been detected by analysis of your API traffic. The Abuse page displays the IP addresses of detected bots, as well as their locations, the bot rules that led to their detection, and other details.

Cloud Asset Inventory

The following resource types are now publicly available through the Export APIs (ExportAssets and BatchGetAssetsHistory) , Feed API, and Search APIs (SearchAllResources and SearchAllIamPolicies):

  • Cloud IDS (Cloud Intrusion Detection System)

    • ids.googleapis.com/Endpoint
  • Speech-to-Text

    • speech.googleapis.com/CustomClass
    • speech.googleapis.com/PhraseSet
Cloud Bigtable

New tooling is available to help you migrate to Cloud Bigtable from HBase clusters that are hosted on another Google Cloud service. For more information, see Migrate from HBase on Google Cloud.

Cloud Monitoring

You can now prevent Cloud Monitoring from sending notifications or creating incidents during specific time periods. For general information, see Snooze notifications and alerts. For information about how to create, view, and modify a snooze, see Create and manage snoozes.

You can now update older versions of the Ops Agent from the Cloud Monitoring VM Instances page and from the Details panel for a selected Compute Engine instance. The "Install" option for a new agent now also supports "update" for upgrading an older agent.

The Cloud Monitoring Integrations page now provides information about integrations with other Google Cloud services, enhanced filtering, and additional information about available third-party integrations. For more information, see Manage integrations.

August 10, 2022

Apigee Integration

On August 10, 2022 we released an updated version of the Apigee Integration software.

Support for VPC Service Controls (Preview)

VPC Service Controls lets you define a security perimeter around the Apigee Integration Google Cloud service. For more information, see Set up VPC Service Controls for Apigee Integration.

BigQuery

You can now set default configurations at a project or organization level. This feature is now generally available (GA).

Cloud Composer

Starting with Cloud Composer 1.19.6, it is no longer possible to use any operators that call Python 2. In particular, PythonVirtualenvOperator can no longer create virtual environments with Python 2.

Logs that are generated when processing individual DAG files are no longer written to the Airflow scheduler's disk. This change improves the scheduler's disk usage.

Improved DAG UI reliability in Private IP environments.

(Cloud Composer 2) When creating environments with Private Service Connect, Cloud Composer no longer checks for networking range conflicts that are not relevant for this type of connectivity.

Cloud Composer 1.19.6 and 2.0.23 images are available:

  • composer-1.19.6-airflow-1.10.15 (default)
  • composer-1.19.6-airflow-2.1.4
  • composer-1.19.6-airflow-2.2.5
  • composer-2.0.23-airflow-2.1.4
  • composer-2.0.23-airflow-2.2.5

Cloud Composer versions 1.16.12, 1.16.13, 1.17.0.preview.8, and 1.17.0.preview.9 have reached their end of full support period.

Cloud Load Balancing Cloud Monitoring

You can now create uptime checks for Cloud Run public endpoints by using the Monitoring API and specifying the Cloud Run Revision monitored-resource type.

Google Cloud VMware Engine

Removed ability to create stateless firewall rules for new projects and projects that have not yet created stateless rules. Projects containing existing stateless rules can continue to modify those rules. Customers can continue to create a firewall rule set in NSX-T Gateway or NSX-T Distributed Firewall rules.

In March 2023, we plan to remove any remaining stateless rules that have not been transitioned to NSX-T Gateway or NSX-T Distributed Firewall rules. If there are any questions about how to make this transition, contact Cloud Customer Care.

Removed ability to create point-to-site (P2S) VPN gateways for new projects and projects that have not yet created P2S VPN gateways. Projects containing existing gateways can continue to modify those gateways. Customers can continue to use an alternative VPN solution. For details, see Connecting using VPN.

In March 2023, we plan to remove any remaining VPN gateways that have not been transitioned to an alternative VPN solution. If there are any questions about how to make this transition, contact Cloud Customer Care.

Kf

Fix Kf performance issue with high server load.

Storage Transfer Service

Storage Transfer Service now supports transfers from AWS S3 using self-hosted transfer agents. This feature provides a way to configure the data transfer path between AWS and Google Cloud and offers more control over performance.

See the documentation for details.

VPC Service Controls

General availability for the following integration:

August 09, 2022

BigQuery Cloud Domains Cloud Monitoring

The organization of the SLO monitoring Services Overview page has been improved. The new layout provides a better experience when you don't yet have any services. When you have services, the new Supported Services list indicates how many of each type you have. You can also use the list to filter the services table to include all services of a selected type. For more information, see Services Overview dashboard.

August 08, 2022

Anthos clusters on AWS (previous generation)

Anthos clusters on AWS (previous generation) aws-1.12.1-gke.0 is now available.

You can now launch clusters with the following Kubernetes versions:

  • 1.23.8-gke.2000
  • 1.22.12-gke.300
  • 1.21.14-gke.2100
BigQuery

A weekly digest of client library updates from across the Cloud SDK.

Go

Changes for bigquery/storage/apiv1beta1

1.37.0 (2022-08-04)

Features
  • bigquery/connection: Add service_account_id output field to CloudSQL properties (1d6fbcc)
  • bigquery/storage/managedwriter: refactor AppendResponse (#6402) (c07bca2)
  • bigquery: support JSON as a data type (#5986) (835fe4f)
Bug Fixes
  • bigquery: include user_email field when requesting job information (#6256) (da42b4e)
Documentation
  • bigquery/storage: clarify size limitations for AppendRowsRequest chore: add preferred_min_stream_count to CreateReadSessionRequest chore: add write_stream to AppendRowsResponse (1d6fbcc)

A weekly digest of client library updates from across the Cloud SDK.

Java

Changes for google-cloud-bigquery

2.14.3 (2022-08-05)

Dependencies
  • update dependency com.google.apis:google-api-services-bigquery to v2-rev20220730-2.0.0 (#2208) (5165e2b)
  • update dependency com.google.cloud:google-cloud-storage to v2.11.2 (#2207) (da5389d)

2.14.2 (2022-08-04)

Dependencies
  • update arrow.version to v9 (major) (#2201) (3ec5ef9)
  • update dependency com.google.apis:google-api-services-bigquery to v2-rev20220716-2.0.0 (#2202) (c1ca09e)
  • update dependency com.google.cloud:google-cloud-bigquerystorage-bom to 2.18.0 (c1ca09e)
  • update dependency com.google.cloud:google-cloud-datacatalog-bom to 1.9.1 (c1ca09e)
  • update dependency com.google.cloud:google-cloud-shared-dependencies to v3 (c1ca09e)
  • update dependency com.google.cloud:google-cloud-storage to 2.11.0 (c1ca09e)
  • update dependency com.google.cloud:google-cloud-storage to v2.11.1 (#2194) (45be001)
  • update dependency com.google.code.gson:gson to v2.9.1 (#2190) (4bd4539)
  • update dependency org.threeten:threeten-extra to v1.7.1 (c1ca09e)
Documentation
Chronicle

The following changes are available in the Unified Data Model:

  • The File.ashash field was deprecated and replaced with the File.authentihash field.
  • The day_max field was added to the Prevalence type.

Descriptions of the File.FileType Enum values are now available in the Unified Data Model field list document.

For a list of all fields in the Unified Data Model, and their descriptions, see the Unified Data Model field list.

Cloud Bigtable

A weekly digest of client library updates from across the Cloud SDK.

Java

Changes for google-cloud-bigtable

2.10.1 (2022-08-01)

Bug Fixes
Dependencies
  • Update dependency org.junit.vintage:junit-vintage-engine to v5.9.0 (#1323) (7655747)

Python

Changes for google-cloud-bigtable

2.11.0 (2022-08-04)

Features
  • Add audience parameter (a7a7699)
  • Add satisfies_pzs output-only field (#614) (7dc1469)
  • Add storage_utilization_gib_per_node to Autoscaling target (a7a7699)
  • Cloud Bigtable Undelete Table service and message proto files (a7a7699)
Bug Fixes
  • Deps: require google-api-core >=1.32.0 and >=2.8.0 (a7a7699)
  • Require Python 3.7+ (#610) (10d00f5)
Performance Improvements
Cloud Load Balancing

External TCP/UDP network load balancers can now be configured to handle IPv6 traffic from clients. To enable this, you must configure your subnet, backend VMs, and the forwarding rules to handle IPv6 traffic.

This feature is only available for backend service-based network load balancers.

For details, see:

This feature is available in General Availability.

Compute Engine

Generally Available: Internal and external IPv6 addresses for Google Compute Engine instances are available in all regions.

For more information, see Configuring IPv6 for instances and Creating instances with multiple network interfaces.

Google Kubernetes Engine

Newly created GKE Clusters on version 1.24 or later using Services without .spec.ports field defined will cause a crash-loop of the ingress-gce controller (l7lbcontroller pod). This will result in not being able to provide L7 Ingress, L4 Internal LoadBalancer Service with Subsetting turned on, and L4 Network LoadBalancer based on Regional Backend Services in the cluster.

To recover from this situation, delete the Service without a port specified or recreate the cluster without any Service with .spec.ports undefined.

Network Intelligence Center

Connectivity Tests now includes a feature that performs live data plane analysis by testing connectivity between a VM and a Google network edge location. This feature is available for the following traffic flows:

  • Between VM and non-Google Cloud network
  • Between VM and Cloud SQL instances

In the Google Cloud console, you can see the results of this analysis in the column labeled Last live data plane analysis result. In the gcloud command-line and API responses, you can see the results in the probingDetails object.

Pub/Sub

A weekly digest of client library updates from across the Cloud SDK.

Java

Changes for google-cloud-pubsub

1.120.9 (2022-08-03)

Dependencies
  • update dependency com.google.cloud:google-cloud-core to v2.8.7 (#1227) (e967b2c)
  • update dependency com.google.cloud:google-cloud-shared-dependencies to v3.0.1 (#1226) (8fab566)

1.120.8 (2022-08-02)

Dependencies
  • update dependency com.google.cloud:google-cloud-core to v2.8.6 (#1222) (55eebf5)

1.120.7 (2022-08-01)

Bug Fixes
  • Updated log level from WARNING -> INFO for EOD failures (#1218) (8782533)

1.120.6 (2022-08-01)

Dependencies
  • update dependency com.google.cloud:google-cloud-bigquery to v2.14.1 (#1215) (5667492)
  • update dependency com.google.cloud:google-cloud-core to v2.8.5 (#1213) (5db0c2c)
  • update dependency com.google.protobuf:protobuf-java-util to v3.21.4 (#1214) (bfc53d9)
  • update dependency org.apache.avro:avro to v1.11.1 (#1210) (fafcded)

1.120.11 (2022-08-06)

Bug Fixes
  • fix dependency declaration to properly include runtime scope (#1238) (e9a4ce5)
Dependencies
  • update dependency com.google.cloud:google-cloud-bigquery to v2.14.2 (#1235) (e2af6c3)
  • update dependency com.google.cloud:google-cloud-bigquery to v2.14.3 (#1236) (399e8d7)

1.120.10 (2022-08-04)

Dependencies
  • update dependency com.google.cloud:google-cloud-core to v2.8.8 (#1231) (9d13dd8)
Security Command Center

Event Threat Detection, a built-in service of Security Command Center, launched the following rules to Preview.

  • Discovery: Can get sensitive Kubernetes object check
  • Privilege Escalation: Changes to sensitive Kubernetes RBAC objects
  • Privilege Escalation: Create Kubernetes CSR for master cert
  • Privilege Escalation: Creation of sensitive Kubernetes bindings
  • Privilege Escalation: Get Kubernetes CSR with compromised bootstrap credentials
  • Privilege Escalation: Launch of privileged Kubernetes container

These rules detect scenarios where a malicious actor attempted to query for or escalate privileges in Google Kubernetes Engine. For more information, see Event Threat Detection rules.

VPC Service Controls

Beta stage support for the following integration:

Virtual Private Cloud

Internal and external IPv6 addresses are available in all regions in General Availability:

August 05, 2022

Cloud SQL for PostgreSQL

The new Cloud SQL System insights dashboard helps you detect and analyze system performance problems.

Compute Engine

Generally available: You can now use the os-config troubleshoot command to help verify the setup of VM Manager. For more information, see Verifying VM Manager setup.

Network Intelligence Center

You can now schedule a custom cycle to refresh shadowed rule insights in Firewall Insights. For more information, see Schedule a custom refresh cycle.

Firewall Insights now identifies firewall misconfigurations for firewall rules which contain IPv6 IP address ranges. For more information, see Firewall Insights overview.

Text-to-Speech

Text-to-Speech now offers these new voices. See the supported voices page for a complete list of voices and audio samples.

  1. cloud-pt-BR-Standard-C
  2. cloud-pt-BR-Wavenet-C
VPC Service Controls

Beta stage support for the following integration:

Virtual Private Cloud

Network firewall policies and regional firewall policies are now available in General Availability.

Workflows

Added skip_polling so that connectors can execute asynchronously without waiting for the operation to complete.

August 04, 2022

Anthos clusters on AWS

You can now launch clusters with the following Kubernetes versions:

  • 1.23.8-gke.1700
  • 1.22.12-gke.200
  • 1.21.14-gke.2100

This release fixes the following vulnerabilities:

This list has been updated to include CVE-2022-2327.

Anthos clusters on Azure

You can now launch clusters with the following Kubernetes versions:

  • 1.23.8-gke.1700
  • 1.22.12-gke.200
  • 1.21.14-gke.2100

This release fixes the following vulnerabilities:

This list has been updated to include CVE-2022-2327.

Anthos clusters on bare metal

Release 1.11.4

Anthos clusters on bare metal 1.11.4 is now available for download. To upgrade, see Upgrading Anthos on bare metal. Anthos clusters on bare metal 1.11.4 runs on Kubernetes 1.22.

Fixes:

  • Fixed issue in which cluster restores failed when /var/lib/etcd is a mount point.
  • Fixed issue in which attempts to skip minor versions when upgrading weren't blocked. For details about the upgrade policy, see Minor version upgrades.

The following container image security vulnerabilities have been fixed:

Known issues:

For information about the latest known issues, see Anthos on bare metal known issues in the Troubleshooting section.

Cloud Logging

The Logs Explorer query results now show an icon for log entries that are part of error groups. You can click the icon to view details about the error group, exclude or show only log entries from the error group in the query results, or view related documentation. For more information, see Find log entries with error groups.

Compute Engine

Generally available: NVIDIA® T4 GPUs are now available in the following additional regions and zones:

  • Ashburn, Virginia, North America: us-east4-a

For more information about using GPUs on Compute Engine, see GPU platforms.

Config Connector

Config Connector version 1.91.0 is now available.

Fixed issue where if ContainerCluster had the remove-default-node-pool directive set to true and there was a ContainerNodePool associated with it, after deleting the successfully reconciled ContainerNodePool, ContainerCluster would get stuck on the UpdateFailed state.

Fixed issue where SQLInstance could not reference KMSCryptoKey.

Added support for the IAMWorkforcePool resource.

Added spec.configmanagement.policyController.monitoring and spec.configmanagement.policyController.mutationEnabled fields to GKEHubFeatureMembership.

Added support for state-into-spec to StorageBucket.

Fixed all reference docs so that code samples now work when they're copy/pasted.

Google Kubernetes Engine

(2022-R19) Version updates

GKE cluster versions have been updated.

New versions available for upgrades and new clusters

The following Kubernetes versions are now available for new clusters and for opt-in control plane upgrades and node upgrades for existing clusters. For more information on versioning and upgrades, see GKE versioning and support and Upgrades.

No channel

  • The following control plane and node versions are now available:

  • The following control plane versions are no longer available:

    • 1.21.12-gke.1500
    • 1.24.2-gke.300
  • Control planes and nodes with auto-upgrade enabled will be upgraded from version 1.20 to version 1.21.12-gke.2200 with this release.

  • Control planes and nodes with auto-upgrade enabled will be upgraded from version 1.21 to version 1.21.12-gke.2200 with this release.

  • Control planes and nodes with auto-upgrade enabled will be upgraded from version 1.24 to version 1.24.2-gke.1900 with this release.

Stable channel

  • The following versions are now available in the Stable channel:

  • Version 1.21.12-gke.2200 is now the default version in the Stable channel.

  • The following versions are no longer available in the Stable channel:

    • 1.21.12-gke.1700
    • 1.22.8-gke.201
    • 1.22.8-gke.202
  • Control planes and nodes with auto-upgrade enabled in the Stable channel will be upgraded from version 1.20 to version 1.21.12-gke.2200 with this release.

  • Control planes and nodes with auto-upgrade enabled in the Stable channel will be upgraded from version 1.21 to version 1.21.12-gke.2200 with this release.

  • Control planes and nodes with auto-upgrade enabled in the Stable channel will be upgraded from version 1.22 to version 1.22.10-gke.600 with this release.

Regular channel

  • The following versions are now available in the Regular channel:

  • The following versions are no longer available in the Regular channel:

    • 1.20.15-gke.9900
    • 1.21.12-gke.2200
    • 1.22.8-gke.202
    • 1.23.5-gke.1503
  • Control planes and nodes with auto-upgrade enabled in the Regular channel will be upgraded from version 1.19 to version 1.20.15-gke.11400 with this release.

  • Control planes and nodes with auto-upgrade enabled in the Regular channel will be upgraded from version 1.20 to version 1.21.13-gke.900 with this release.

  • Control planes and nodes with auto-upgrade enabled in the Regular channel will be upgraded from version 1.21 to version 1.21.13-gke.900 with this release.

  • Control planes and nodes with auto-upgrade enabled in the Regular channel will be upgraded from version 1.23 to version 1.23.7-gke.1400 with this release.

Rapid channel

  • The following versions are now available in the Rapid channel:

  • Version 1.23.8-gke.1900 is now the default version in the Rapid channel.

  • The following versions are no longer available in the Rapid channel:

    • 1.21.14-gke.700
    • 1.22.10-gke.600
    • 1.22.11-gke.400
    • 1.23.6-gke.2200
    • 1.23.7-gke.1400
    • 1.23.8-gke.400
    • 1.24.2-gke.300
  • Control planes and nodes with auto-upgrade enabled in the Rapid channel will be upgraded from version 1.19 to version 1.20.15-gke.13400 with this release.

  • Control planes and nodes with auto-upgrade enabled in the Rapid channel will be upgraded from version 1.20 to version 1.21.14-gke.2100 with this release.

  • Control planes and nodes with auto-upgrade enabled in the Rapid channel will be upgraded from version 1.21 to version 1.22.12-gke.300 with this release.

  • Control planes and nodes with auto-upgrade enabled in the Rapid channel will be upgraded from version 1.22 to version 1.23.8-gke.1900 with this release.

  • Control planes and nodes with auto-upgrade enabled in the Rapid channel will be upgraded from version 1.23 to version 1.23.8-gke.1900 with this release.

  • Control planes and nodes with auto-upgrade enabled in the Rapid channel will be upgraded from version 1.24 to version 1.24.2-gke.1900 with this release.

(2022-R19) Version updates

  • The following control plane and node versions are now available:

  • The following control plane versions are no longer available:

    • 1.21.12-gke.1500
    • 1.24.2-gke.300
  • Control planes and nodes with auto-upgrade enabled will be upgraded from version 1.20 to version 1.21.12-gke.2200 with this release.

  • Control planes and nodes with auto-upgrade enabled will be upgraded from version 1.21 to version 1.21.12-gke.2200 with this release.

  • Control planes and nodes with auto-upgrade enabled will be upgraded from version 1.24 to version 1.24.2-gke.1900 with this release.

(2022-R19) Version updates

  • The following versions are now available in the Stable channel:

  • Version 1.21.12-gke.2200 is now the default version in the Stable channel.

  • The following versions are no longer available in the Stable channel:

    • 1.21.12-gke.1700
    • 1.22.8-gke.201
    • 1.22.8-gke.202
  • Control planes and nodes with auto-upgrade enabled in the Stable channel will be upgraded from version 1.20 to version 1.21.12-gke.2200 with this release.

  • Control planes and nodes with auto-upgrade enabled in the Stable channel will be upgraded from version 1.21 to version 1.21.12-gke.2200 with this release.

  • Control planes and nodes with auto-upgrade enabled in the Stable channel will be upgraded from version 1.22 to version 1.22.10-gke.600 with this release.

(2022-R19) Version updates

  • The following versions are now available in the Regular channel:

  • The following versions are no longer available in the Regular channel:

    • 1.20.15-gke.9900
    • 1.21.12-gke.2200
    • 1.22.8-gke.202
    • 1.23.5-gke.1503
  • Control planes and nodes with auto-upgrade enabled in the Regular channel will be upgraded from version 1.19 to version 1.20.15-gke.11400 with this release.

  • Control planes and nodes with auto-upgrade enabled in the Regular channel will be upgraded from version 1.20 to version 1.21.13-gke.900 with this release.

  • Control planes and nodes with auto-upgrade enabled in the Regular channel will be upgraded from version 1.21 to version 1.21.13-gke.900 with this release.

  • Control planes and nodes with auto-upgrade enabled in the Regular channel will be upgraded from version 1.23 to version 1.23.7-gke.1400 with this release.

(2022-R19) Version updates

  • The following versions are now available in the Rapid channel:

  • Version 1.23.8-gke.1900 is now the default version in the Rapid channel.

  • The following versions are no longer available in the Rapid channel:

    • 1.21.14-gke.700
    • 1.22.10-gke.600
    • 1.22.11-gke.400
    • 1.23.6-gke.2200
    • 1.23.7-gke.1400
    • 1.23.8-gke.400
    • 1.24.2-gke.300
  • Control planes and nodes with auto-upgrade enabled in the Rapid channel will be upgraded from version 1.19 to version 1.20.15-gke.13400 with this release.

  • Control planes and nodes with auto-upgrade enabled in the Rapid channel will be upgraded from version 1.20 to version 1.21.14-gke.2100 with this release.

  • Control planes and nodes with auto-upgrade enabled in the Rapid channel will be upgraded from version 1.21 to version 1.22.12-gke.300 with this release.

  • Control planes and nodes with auto-upgrade enabled in the Rapid channel will be upgraded from version 1.22 to version 1.23.8-gke.1900 with this release.

  • Control planes and nodes with auto-upgrade enabled in the Rapid channel will be upgraded from version 1.23 to version 1.23.8-gke.1900 with this release.

  • Control planes and nodes with auto-upgrade enabled in the Rapid channel will be upgraded from version 1.24 to version 1.24.2-gke.1900 with this release.

August 03, 2022

Access Approval

Access Approval supports Secret Manager in the Preview stage.

Anthos clusters on bare metal

Release 1.12.1

Anthos clusters on bare metal 1.12.1 is now available for download. To upgrade, see Upgrading Anthos on bare metal. Anthos clusters on bare metal 1.12.1 runs on Kubernetes 1.23.

Functionality changes:

  • Increased default memory limits for coredns, metallb-controller, metallb-speaker, metrics-server, anthos-cluster-operator, and cap-controller-manager.

  • Modified the dashboards Anthos cluster pod status and Anthos cluster node status. Specifically, the following changes were made:

    • Replaced cadvisor resource metrics with summary API resource metrics.
    • Added cpu, memory, and volume utilization metrics.

    If you have already installed these dashboards in a project, you need to download the JSON files Anthos-cluster-pod-status.json and Anthos-cluster-node-status.json from the Dashboards for Anthos GitHub repository. You then need to import these JSON files into Cloud Monitoring. For details, see Install sample dashboards.

Fixes:

  • Fixed issue in which nodes drained or cordoned by kubectl were mistakenly marked as schedulable.
  • Fixed issue in which cluster controller and autoscaler conflicted with each other in the scaling of istiod, coredns, and istio-ingress Pods.
  • Fixed issue in which the wrong data type was used in health check log messages, resulting in panic messages.
  • Fixed issue in which cluster restores failed when /var/lib/etcd is a mount point.
  • Fixed issue in which attempts to skip minor versions when upgrading weren't blocked. For details about the upgrade policy, see Minor version upgrades.
  • Fixed issue in which an external VIP Service of type LoadBalancer would not respond when flat IP mode was enabled.

The following container image security vulnerabilities have been fixed:

Known issues:

For information about the latest known issues, see Anthos on bare metal known issues in the Troubleshooting section.

Release 1.12.1 ships with containerd version 1.5.13, which requires libseccomp version 2.5 or higher. If your system doesn't have libseccomp version 2.5 or higher installed, update it in advance of upgrading existing clusters to version 1.12.1. Otherwise, you may see errors in cplb-update Pods for load balancer nodes such as:

runc did not terminate successfully: runc: symbol lookup error: runc:
undefined symbol: seccomp_notify_respond

To install the latest version of libseccomp in Ubuntu, run the following command:

sudo apt-get install  libseccomp-dev

To install the latest version of libseccomp in CentOS or RHEL, run the following command:

sudo dnf -y install libseccomp-devel
Apigee API hub

On August 3, 2022 Apigee hub released a new version of the software.

Bug ID Description
241241073 Changed API hub UI route prefix from apigee/api-registry to apigee/hub. The previous apigee/api-registry path will still continue to work, but will redirect to apigee/hub automatically.
BigQuery

The max_staleness materialized view option helps you achieve consistently high performance with controlled costs when processing large, frequently changing datasets. This feature is now in preview.

Chronicle

The following supported default parsers have changed. Each is listed by product name and ingestion label, if applicable.

  • AWS Cloudtrail (AWS_CLOUDTRAIL)
  • AWS Route 53 DNS (AWS_ROUTE_53)
  • AWS S3 Server Access (AWS_S3_SERVER_ACCESS)
  • AWS WAF (AWS_WAF)
  • Box (BOX)
  • Cisco Switch (CISCO_SWITCH)
  • Citrix Storefront (CITRIX_STOREFRONT)
  • CrowdStrike Falcon (CS_EDR)
  • Dell OpenManage (DELL_OPENMANAGE)
  • F5 VPN (F5_VPN)
  • Falco IDS (FALCO_IDS)
  • GCP Cloud SQL (GCP_CLOUDSQL)
  • GCP VPC Flow (GCP_VPC_FLOW)
  • Imperva SecureSphere Management (IMPERVA_SECURESPHERE)
  • Linux Auditing System AuditD (AUDITD)
  • McAfee ePolicy Orchestrator (MCAFEE_EPO)
  • Microsoft Defender for Identity (MICROSOFT_DEFENDER_IDENTITY)
  • Netskope (NETSKOPE_ALERT)
  • NIMBLE OS (NIMBLE_OS)
  • Office 365 (OFFICE_365)
  • Oracle (ORACLE_DB)
  • Ping Identity (PING)
  • SentinelOne EDR (SENTINEL_EDR)
  • Snare System Diagnostic Logs (SNARE_SOLUTIONS)
  • Sophos AV (SOPHOS_AV)
  • Suricata EVE (SURICATA_EVE)
  • Symantec Endpoint Protection (SEP)
  • TeamViewer (TEAMVIEWER)
  • Vectra Stream (VECTRA_STREAM)
  • VMware ESXi (VMWARE_ESX)
  • Windows Defender ATP (WINDOWS_DEFENDER_ATP)
  • Windows Event (WINEVTLOG)
  • Workspace Activities (WORKSPACE_ACTIVITY)

For details about changes in each parser, see Supported default parsers.

Cloud Functions

Cloud Functions has released Cloud Functions (2nd gen), available at the General Availability release level. Cloud Functions (2nd gen) is Google Cloud's next-generation Functions-as-a-Service offering. This new version of Cloud Functions comes with an advanced feature set, giving you more powerful infrastructure, advanced control over performance and scalability, more control around the functions runtime, and triggers from over 90 event sources.

See Cloud Functions version comparison for details.

Cloud Healthcare API

A release was made. Updates may include general performance improvements, bug fixes, and updates to the API reference documentation.

Cloud Interconnect

Dedicated Interconnect support is available in the following colocation facilities:

  • NXDATA-1 Bucharest Romania (BU1), Bucharest
  • TIS Lammed, Tel Aviv
  • Bitech SDS, Tel Aviv

For more information, see the Locations table.

Google Kubernetes Engine

GKE total size control is now available in GKE version 1.24 clusters. For autoscaled node pools you can now set the minimum and maximum number of the total number of nodes across all zones, rather than specify a per zone limit. To learn more, see Cluster autoscaler.

The maximum number of Pods that can run on each node has increased from 110 to 256 with GKE version 1.23.5-gke.1300 or later. To learn more, see Optimizing IP address allocation.

Memorystore for Redis

RDB Snapshots are now Generally Available on Memorystore for Redis.

Retail API

Serving controls can now be imported from and exported to files. This allows you to move serving controls between projects and do bulk edits and additions of serving controls within a project. This feature is available in Preview.

See the new documentation:

Service Directory

Configuring an internal TCP/UDP load balancer and network load balancer in Service Directory is available in GA.

August 02, 2022

Anthos clusters on VMware

A new vulnerability CVE-2022-2327 has been discovered in the Linux kernel that can lead to local privilege escalation. This vulnerability allows an unprivileged user to achieve a full container breakout to root on the node.

For more information, see the GCP-2022-018 security bulletin.

Cloud Asset Inventory

The following resource types are now publicly available through the Analyze Policy APIs (AnalyzeIamPolicy and AnalyzeIamPolicyLongrunning):

  • Firebase
    • firebase.googleapis.com/FirebaseProject
    • firebase.googleapis.com/FirebaseAppInfo
Cloud Storage

Customer-managed encryption key (CMEK) organization policy constraints are now generally available (GA).

New commands are now available gcloud alpha storage.

  • Commands include the ability to create buckets, view metadata for buckets and objects, and edit metadata for buckets and objects.
  • Note that all Cloud Storage gcloud commands continue to be in Preview.
Migrate to Virtual Machines

Several updates to Migrate to Virtual Machines:

Resource Manager

Two Organization Policy constraints have launched into general availability to help ensure CMEK usage across an organization. For more information, see CMEK organization policies.

Workflows

Workflows is available in the following additional regions:

  • asia-northeast2 (Osaka, Japan)
  • asia-south2 (Delhi, India)
  • australia-southeast2 (Melbourne, Australia)
  • europe-north1 (Hamina, Finland)
  • europe-west2 (London, England)
  • europe-west3 (Frankfurt, Germany)
  • southamerica-east1 (Osasco, São Paulo, Brazil)
  • us-east4 (Ashburn, Virginia, United States)
  • us-west4 (Las Vegas, Nevada, United States)

August 01, 2022

Anthos Anthos Service Mesh

The Mesh Config API (meshconfig.googleapis.com) now enables the Connect Gateway API (connectgateway.googleapis.com) and the GKE Hub API (gkehub.googleapis.com). This change does not incur any additional cost.

Anthos clusters on AWS

A new vulnerability (CVE-2022-2327) has been discovered in the Linux kernel that can lead to local privilege escalation. This vulnerability allows an unprivileged user to achieve a full container breakout to root on the node.
For more information, see the GCP-2022-018 security bulletin.

Anthos clusters on AWS (previous generation)

A new vulnerability (CVE-2022-2327) has been discovered in the Linux kernel that can lead to local privilege escalation. This vulnerability allows an unprivileged user to achieve a full container breakout to root on the node.
For more information, see the GCP-2022-018 security bulletin.

Anthos clusters on Azure

A new vulnerability (CVE-2022-2327) has been discovered in the Linux kernel that can lead to local privilege escalation. This vulnerability allows an unprivileged user to achieve a full container breakout to root on the node.
For more information, see the GCP-2022-018 security bulletin.

Anthos clusters on bare metal

Release 1.10.7

Anthos clusters on bare metal 1.10.7 is now available for download. To upgrade, see Upgrading Anthos on bare metal. Anthos clusters on bare metal 1.10.7 runs on Kubernetes 1.21.

Known issues:

For information about the latest known issues, see Anthos on bare metal known issues in the Troubleshooting section.

BigQuery

A weekly digest of client library updates from across the Cloud SDK.

Python

Changes for google-cloud-bigquery

3.3.0 (2022-07-25)

Features
  • add destination_expiration_time property to copy job (#1277) (728b07c)
Bug Fixes
Documentation
  • samples: add table snapshot sample (#1274) (e760d1b)
  • samples: explicitly add bq to samples reqs, upgrade grpc to fix bug on m1 (#1290) (9b7e3e4)

The trigonometric SQL function CBRT is now generally available (GA). With this function, you can compute the cube root of a value.

The LOAD DATA statement is now available for Preview in Google Standard SQL for BigQuery. You can use the LOAD DATA statement to load data from one or more files into a table.

A weekly digest of client library updates from across the Cloud SDK.

Java

Changes for google-cloud-bigquery

2.14.1 (2022-07-27)

Dependencies
  • update dependency org.junit.vintage:junit-vintage-engine to v5.9.0 (#2183) (f8325cf)
Cloud Bigtable

A weekly digest of client library updates from across the Cloud SDK.

Java

Changes for google-cloud-bigtable

2.10.0 (2022-07-26)

Features
Bug Fixes
  • Enable integration test for google-cloud-bigtable-stats (#1311) (7c77879)
  • Fix race condition in BuiltinMetricsTracer (#1320) (644454a)
  • Ignore repackaged files to fix clirr (#1300) (99b67ba)
Dependencies
  • Update dependency org.graalvm.buildtools:junit-platform-native to v0.9.13 (#1306) (ddae354)
  • Update dependency org.graalvm.buildtools:native-maven-plugin to v0.9.13 (#1307) (c0740fe)
Cloud Data Fusion

Cloud Data Fusion versions 6.1, 6.2, and 6.3 are no longer supported. You should upgrade your instances to run in a supported version. For instructions, see Upgrading your Cloud Data Fusion environment.

Cloud Data Loss Prevention

Cloud DLP can de-identify sensitive data stored in Cloud Storage. This feature is in generally available. For more information, see De-identification of sensitive data in storage.

Cloud Storage

Bucket tags are now available in Preview. You can apply tags to buckets for fine-grained access control.

Dataproc

New sub-minor versions of Dataproc images:

1.5.72-debian10, 1.5.72-rocky8, 1.5.72-ubuntu18

2.0.46-debian10, 2.0.46-rocky8, 2.0.46-ubuntu18

Upgraded Hadoop to version 3.2.3 in 2.0 images.

Upgraded Hadoop to version 2.10.2 version 2.10.2 in 1.5 images.

Default MySQL instance root password changed to a random value in 1.5 and 2.0 images. New password is now stored in MySQL configuration file accessible only by the OS level root user.

Backported the patch for KNOX-1997 in 2.0 images.

Backported the patch for HIVE-19048 in 2.0 images.

Backported the patches for HIVE-19047 and HIVE-19048 in 1.5 images.

Pub/Sub

A weekly digest of client library updates from across the Cloud SDK.

Java

Changes for google-cloud-pubsub

1.120.5 (2022-07-30)

Dependencies
  • update dependency com.google.cloud:google-cloud-shared-dependencies to v3 (#1207) (d355509)

1.120.4 (2022-07-29)

Bug Fixes
  • updating return types of ack/nack futures to be consistent with publish (#1204) (6e73ab9)

1.120.3 (2022-07-27)

Dependencies
  • update dependency org.junit.vintage:junit-vintage-engine to v5.9.0 (#1201) (f18e562)

1.120.2 (2022-07-25)

Bug Fixes
Dependencies
  • update dependency org.graalvm.buildtools:junit-platform-native to v0.9.13 (#1189) (0d96f8e)
  • update dependency org.graalvm.buildtools:native-maven-plugin to v0.9.13 (#1190) (c604080)
Secret Manager

A weekly digest of client library updates from across the Cloud SDK.

Python

Changes for google-cloud-secret-manager

2.12.1 (2022-07-26)

Bug Fixes
  • wrong package name google-cloud-secretmanager (#325) (1693fd1)
Vertex AI

TensorFlow Profiler integration: Debug model training performance for your custom training jobs. For details, see Profile model training performance using Profiler.

July 29, 2022

Apigee hybrid

hybrid v1.7.3

On July 29, 2022 we released an updated version of the Apigee hybrid software, v1.7.3.

For information on upgrading, see Upgrading Apigee hybrid to version 1.7.

Bug ID Description
219622478 Fixed the CPS property token so that when set to true, it will allow the instance to shutdown and reboot when cassandra connection failures occur.
232529030 Replaced the Logging fluentbit container environment variable http_proxy with HTTP_FORWARD_PROXY to maintain compatibility with fluentbit 1.8.
238370197 Fixed an issue where the timeTaken variable's value could sometimes be calculated incorrectly.
Bug ID Description
N/A Security fix for CVE-2022-22963.
Bare Metal Solution

API for long-running operations:

The API for long-running operations has changed from v1 to v2.

Chronicle

Detection Engine now includes the following new features:

  • You can define an outcome section in single event rules. Previously, the outcome section was supported in multi-event rules only. If you have multi-event rules that use only one event variable, you can refactor them by deleting the match section to make them more performant. For an example rule, see YARA-L 2.0 language overview. For more detailed information about rule syntax, see YARA-L 2.0 language syntax.

  • In the existing condition section, you can now use variables defined in the outcome section. This enables you to filter on aggregates (variables in the outcome section can be defined using aggregate functions) and on the $risk_score outcome variable. For more detailed information about the condition section, see YARA-L 2.0 language syntax.

  • You can assign a placeholder variable to the result of a function call. You can then use the placeholder variable in other sections of the rule, such as the match section, outcome section, or condition section. For information about the syntax for function to placeholder assignments and any restrictions, see the YARA-L 2.0 language syntax.

Cloud Asset Inventory

The following resource types are now publicly available through the Export APIs (ExportAssets and BatchGetAssetsHistory) , Feed API, and Search APIs (SearchAllResources and SearchAllIamPolicies):

  • Backup for GKE
    • gkebackup.googleapis.com/BackupPlan
    • gkebackup.googleapis.com/Backup
    • gkebackup.googleapis.com/VolumeBackup
    • gkebackup.googleapis.com/RestorePlan
    • gkebackup.googleapis.com/Restore
    • gkebackup.googleapis.com/VolumeRestore
Cloud Monitoring

You can now add table widgets to custom dashboards that let you limit the number of table rows, display only those rows with the highest, or lowest values, and that display a visual indicator of the value as compared to the range of possible values. For more information, see Display data in tabular form on a dashboard.

Cloud SQL for PostgreSQL

For PostgreSQL versions 9.6 to 13, the [PostgreSQL version].R20220710.01_00 maintenance version caused a behavior change for configuration parameters: Session-level configuration parameters with dashes (-) cannot be set.

After you check your current maintenance version, you can apply a fix by performing a self-service maintenance update to the latest release.

Please use this table to find the name of the maintenance version to apply, and use that version or the latest version available:

PostgreSQL version Maintenance version
PostgreSQL 9.6 POSTGRES_9_6_24.R20220710.01_02
PostgreSQL 10 POSTGRES_10_21.R20220710.01_02
PostgreSQL 11 POSTGRES_11_16.R20220710.01_02
PostgreSQL 12 POSTGRES_12_11.R20220710.01_02
PostgreSQL 13 POSTGRES_13_7.R20220710.01_02

After you have identified the name of the maintenance version, please upgrade to the target maintenance version, performing the corresponding update of your instances (to the latest maintenance version).

Note that newly created instances automatically use the latest version.

Compute Engine

Generally available: When you autoscale a MIG, you can view the reasons for why the autoscaler adds or removes VMs in your MIG. For more information, see Viewing autoscaler logs.

The quota limits displayed in the Cloud console might be incorrect in the us-east5 region. For more information, see Known issues.

Vertex AI

We now offer Preview support for Custom prediction routines (CPR). CPR lets you easily build custom containers for prediction with pre/post processing support.

July 28, 2022

BigQuery

You can now create BigQuery subscriptions in Pub/Sub to write messages directly to an existing BigQuery table.

Chronicle

The following changes are available in the Unified Data Model:

For a list of all fields in the Unified Data Model, and their descriptions, see the Unified Data Model field list.

Cloud Composer

(Available without upgrading) Fixed a problem where DAG import errors were not displayed on the Environment details page, if the error messages did not have a creation time set.

Cloud Composer 1.19.5 and 2.0.22 images are available:

  • composer-1.19.5-airflow-1.10.15 (default)
  • composer-1.19.5-airflow-2.1.4
  • composer-1.19.5-airflow-2.2.5
  • composer-2.0.22-airflow-2.1.4
  • composer-2.0.22-airflow-2.2.5

Cloud Composer versions 1.16.11 and 1.17.0.preview.7 have reached their end of full support period.

Cloud Monitoring

You can now add user-defined labels to public and private Uptime checks. For more information, see Create public uptime checks.

You can now configure the acceptable response codes for public and private HTTP Uptime checks. For more information, see Create public uptime checks.

Cloud Storage

Configurable dual-region storage is generally available (GA).

Compute Engine

Preview: You can now merge or split your existing hardware resource commitments to create new upsized or downsized commitments. For more information, see Merge and split commitments.

Generally available: Use the Cloud console, the gcloud tool, or the API to configure a VM to shut down when a Cloud KMS key is revoked. For more information, see Configure VM shutdown on Cloud KMS key revocation.

Generally available: When you create VMs in bulk, you can now use the following new values with the TARGET_SHAPE flag:

  • ANY: Use this value to place VMs in zones to maximize unused zonal reservations.
  • BALANCED: Use this value to place VMs uniformly across zones.
Config Controller

Config Controller now uses the following versions of its included products:

July 27, 2022

Anthos clusters on VMware

Anthos clusters on VMware 1.11.2-gke.53 is now available. To upgrade, see Upgrading Anthos clusters on VMware. Anthos clusters on VMware 1.11.2-gke.53 runs on Kubernetes 1.22.8-gke.204.

The supported versions offering the latest patches and updates for security vulnerabilities, exposures, and issues impacting Anthos clusters on VMware are 1.12, 1.11, and 1.10.

  • Fixed a known issue in which the cluster backup feature affected the inclusion of always-on secrets encryption keys in the backup.
  • Fixed a known issue of high-resource usage when AIDE runs as a cron job, by disabling AIDE by default. This fix affects compliance with CIS L1 Server benchmark 1.4.2: Ensure filesystem integrity is regularly checked. Customers can opt in to re-enable the AIDE if needed. To re-enable the AIDE cron job, see Configure AIDE cron job.
  • Fixed a known issue where gke-metrics-agent DaemonSet has frequent CrashLoopBackOff errors by upgrading to gke-metrics-agent v1.1.0-anthos.14.
  • Fixed the following vulnerabilities:

Apigee API hub

On July 27, 2022 Apigee hub released a new version of the software.

Bug ID Description
230374510 Mitigated issue where specs over 900KB (uncompressed) in size caused timeouts when trying to view their contents, and in turn caused instability with future requests for a short period of time. A warning message is now displayed when attempting to view specs that exceed 900KB.
230374510 Fixed issue where viewing spec files that had a file extension of .gz would allow only download of the file and would not display the contents of the file, if supported.
BigQuery

Inverse trigonometric SQL functions are now generally available (GA). These functions include:

  • COT: Compute the cotangent for an angle.
  • COTH: Compute the hyperbolic cotangent for an angle.
  • CSC: Compute the cosecant for an angle.
  • CSCH: Compute the hyperbolic cosecant for an angle.
  • SEC: Compute the secant for an angle.
  • SECH: Compute the hyperbolic secant for an angle.
Cloud Asset Inventory

The following resource types are now publicly available through the Analyze Policy APIs (AnalyzeIamPolicy and AnalyzeIamPolicyLongrunning):

  • Firestore
    • firestore.googleapis.com/Database
Config Connector

Config Connector version 1.90.0 is now available.

Fixed issue where spec.layer7DdosDefenseConfig field in ComputeSecurityPolicy was not being reflected onto underlying resource.

Added support for ServiceDirectoryEndpoint resource.

Added support for the DLPStoredInfoType resource.

Added support for state-into-spec: absent to MonitoringAlertPolicy.

Added spec.iap.oauth2ClientIdRef field to ComputeBackendService.

Added spec.egressPolicies.egressTo.externalResources field to AccessContextManagerServicePerimeters,

Added spec.externalDataConfiguration.connectionId field to BigQueryTable.

Added spec.includeBuildLogs field to CloudBuildTrigger.

Added spec.cacheKeyPolicy.cdnPolicy.includeNamedCookies field to ComputeBackendService.

Added spec.enableUlaInternalIpv6 and spec.internalIpv6Range fields to ComputeNetwork.

Added spec.maxPortsPerVm field to ComputeRouterNats.

Added spec.advancedOptionsConfig field to ComputeSecurityPolicy.

Added spec.sslPolicyRef field to ComputeTargetHTTPSProxy.

Added spec.monitoringConfig.managedPrometheus field to ContainerCluster.

Added spec.sqlServerUserDetails field to SQLUser.

Added spec.schemaSettings field to PubSubTopic.

Added status.pscConnectionId and status.pscConnectionStatus fields to ComputeForwardingRule.

Added status.creationTime and status.managedZoneId fields to DNSManagedZones.

Added support for "reconcile resource immediately once its dependency is ready" feature for ComputeTargetPool, ComputeNetworkEndpointGroup, NetworkServicesGRPCRoute, NetworkServicesTLSRoute.

Document AI

New Release Candidate (RC) versions for PDAI Invoice and Expense processors - July 2022

We have launched new RC versions of Invoice parser and Expense parser on Jul 15, 2022. These can be accessed in the following way:

  • Invoice parser: pretrained-next-uptrainable
  • Expense parser: pretrained-next

Here are the details about the contents of the RC version updates:

Processor New Languages New Entities
Invoice: pretrained-next-uptrainable Italian, Portuguese, Romanian, Swedish N/A
Expense: pretrained-next Japanese Support for hotel and car rental folios

Payment information entities: Last 4 digits of credit card, payment type

The current limit for uptrainable processors is as follows (it is different from the pre-trained version). We are gathering customer feedback to increase the async limit.

Quotas and limits

Maximum pages (online/synchronous requests): 10
Maximum pages (batch/offline/asynchronous requests): 15
Google Cloud Deploy

You can now have Google Cloud Deploy generate a skaffold.yaml configuration file for you when you create a release, based on a single Kubernetes manifest which you provide. This configuration file is suitable for learning and onboarding.

Google Cloud VMware Engine

Resource creation of named objects now enforce naming requirements that match other Google Cloud products like Compute Engine. New resources must use names that are 1-63 characters long, comply with RFC 1035, and consist of lowercase letters, digits, and hyphens. For example, "privatecloud-123".

Google Kubernetes Engine

GKE node system configuration now supports setting the cgroup mode to use the cgroupv2 resource management subsystem.

July 26, 2022

Anthos Service Mesh

Version 1.14 is now available for managed Anthos Service Mesh and is rolling out to the Rapid Release Channel.

The managed Anthos Service Mesh channels are now mapped to the following versions:

  • Rapid Release Channel - Version 1.14
  • Regular Release Channel - Version 1.13
  • Stable Release Channel - Version 1.12

See Select a managed Anthos Service Mesh release channel for more information.

Chronicle

Export filter for GCP logs

Previously, you could export DNS and Cloud Audit logs using the Chronicle panel within the GCP Cloud Console. You can now configure the default export filter to export additional log types. You can not only control the log types, but also the source projects producing these logs. Both inclusion and exclusion of logs are supported as well. In addition, semantic validation of the log filters can catch malformed log filters with invalid log types or identifiers. The filter language is defined by the Google logging query language that is shared with Cloud Logging.

For more information about the Export Log Filter Settings, see Exporting Google Cloud Logs to Chronicle.

Cloud Healthcare API

A release was made. Updates may include general performance improvements, bug fixes, and updates to the API reference documentation.

Cloud Logging

You can now collect Couchbase logs and metrics from the Ops Agent, starting with version 2.18.2. For more information, see Monitoring third-party applications: Couchbase.

Cloud Monitoring

You can now collect Aerospike metrics from the Ops Agent, starting with version 2.18.2. For more information, see Monitoring third-party applications: Aerospike.

You can now collect Couchbase logs and metrics from the Ops Agent, starting with version 2.18.2. For more information, see Monitoring third-party applications: Couchbase.

You can now collect Vault metrics from the Ops Agent, starting with version 2.18.2. For more information, see Monitoring third-party applications: Vault.

Data Catalog

The UI for dataset entry detail pages now includes a section that lets you see what entries are included in that dataset. Look for the new Entry list section when browsing dataset entries in Data Catalog.

Google Kubernetes Engine

(2022-R18) Version updates

GKE cluster versions have been updated.

New versions available for upgrades and new clusters

The following Kubernetes versions are now available for new clusters and for opt-in control plane upgrades and node upgrades for existing clusters. For more information on versioning and upgrades, see GKE versioning and support and Upgrades.

No channel

  • The following control plane and node versions are now available:
  • Version 1.22.10-gke.600 is now the default version
  • The following control plane versions are no longer available:
    • 1.20.15-gke.8700
    • 1.21.11-gke.1100
    • 1.21.11-gke.1900
    • 1.22.8-gke.200
    • 1.23.5-gke.1501
    • 1.24.1-gke.1800
  • Control planes and nodes with auto-upgrade enabled will be upgraded from version 1.19 to version 1.20.15-gke.9900 with this release.
  • Control planes and nodes with auto-upgrade enabled will be upgraded from version 1.20 to version 1.21.12-gke.1700 with this release.
  • Control planes and nodes with auto-upgrade enabled will be upgraded from version 1.21 to version 1.21.12-gke.1700 with this release.
  • Control planes and nodes with auto-upgrade enabled will be upgraded from version 1.24 to version 1.24.2-gke.300 with this release.

Stable channel

  • The following versions are now available in the Stable channel:
  • Version 1.21.12-gke.1700 is now the default version in the Stable channel
  • The following versions are no longer available in the Stable channel:
    • 1.20.15-gke.8700
    • 1.21.12-gke.1500
    • 1.22.8-gke.200
    • 1.23.6-gke.2200
  • Control planes and nodes with auto-upgrade enabled in the Stable channel will be upgraded from version 1.19 to version 1.20.15-gke.9900 with this release.
  • Control planes and nodes with auto-upgrade enabled in the Stable channel will be upgraded from version 1.20 to version 1.21.12-gke.1700 with this release.
  • Control planes and nodes with auto-upgrade enabled in the Stable channel will be upgraded from version 1.21 to version 1.21.12-gke.1700 with this release.
  • Control planes and nodes with auto-upgrade enabled in the Stable channel will be upgraded from version 1.23 to version 1.23.7-gke.1400 with this release.

Regular channel

  • The following versions are now available in the Regular channel:
  • Version 1.22.10-gke.600 is now the default version in the Regular channel
  • The following versions are no longer available in the Regular channel:
    • 1.23.5-gke.1501
  • Control planes and nodes with auto-upgrade enabled in the Regular channel will be upgraded from version 1.19 to version 1.20.15-gke.9900 with this release.
  • Control planes and nodes with auto-upgrade enabled in the Regular channel will be upgraded from version 1.21 to version 1.22.10-gke.600 with this release.
  • Control planes and nodes with auto-upgrade enabled in the Regular channel will be upgraded from version 1.22 to version 1.22.10-gke.600 with this release.

Rapid channel

  • The following versions are now available in the Rapid channel:
  • Version 1.23.8-gke.400 is now the default version in the Rapid channel
  • The following versions are no longer available in the Rapid channel:
    • 1.21.13-gke.900
    • 1.22.9-gke.2000
    • 1.23.6-gke.1700
    • 1.24.1-gke.1800
  • Control planes and nodes with auto-upgrade enabled in the Rapid channel will be upgraded from version 1.19 to version 1.20.15-gke.9900 with this release.
  • Control planes and nodes with auto-upgrade enabled in the Rapid channel will be upgraded from version 1.20 to version 1.21.14-gke.700 with this release.
  • Control planes and nodes with auto-upgrade enabled in the Rapid channel will be upgraded from version 1.21 to version 1.21.14-gke.700 with this release.
  • Control planes and nodes with auto-upgrade enabled in the Rapid channel will be upgraded from version 1.22 to version 1.23.8-gke.400 with this release.
  • Control planes and nodes with auto-upgrade enabled in the Rapid channel will be upgraded from version 1.23 to version 1.23.8-gke.400 with this release.
  • Control planes and nodes with auto-upgrade enabled in the Rapid channel will be upgraded from version 1.24 to version 1.24.2-gke.300 with this release.

(2022-R18) Version updates

  • The following versions are now available in the Regular channel:
  • Version 1.22.10-gke.600 is now the default version in the Regular channel
  • The following versions are no longer available in the Regular channel:
    • 1.23.5-gke.1501
  • Control planes and nodes with auto-upgrade enabled in the Regular channel will be upgraded from version 1.19 to version 1.20.15-gke.9900 with this release.
  • Control planes and nodes with auto-upgrade enabled in the Regular channel will be upgraded from version 1.21 to version 1.22.10-gke.600 with this release.
  • Control planes and nodes with auto-upgrade enabled in the Regular channel will be upgraded from version 1.22 to version 1.22.10-gke.600 with this release.

(2022-R18) Version updates

  • The following versions are now available in the Rapid channel:
  • Version 1.23.8-gke.400 is now the default version in the Rapid channel
  • The following versions are no longer available in the Rapid channel:
    • 1.21.13-gke.900
    • 1.22.9-gke.2000
    • 1.23.6-gke.1700
    • 1.24.1-gke.1800
  • Control planes and nodes with auto-upgrade enabled in the Rapid channel will be upgraded from version 1.19 to version 1.20.15-gke.9900 with this release.
  • Control planes and nodes with auto-upgrade enabled in the Rapid channel will be upgraded from version 1.20 to version 1.21.14-gke.700 with this release.
  • Control planes and nodes with auto-upgrade enabled in the Rapid channel will be upgraded from version 1.21 to version 1.21.14-gke.700 with this release.
  • Control planes and nodes with auto-upgrade enabled in the Rapid channel will be upgraded from version 1.22 to version 1.23.8-gke.400 with this release.
  • Control planes and nodes with auto-upgrade enabled in the Rapid channel will be upgraded from version 1.23 to version 1.23.8-gke.400 with this release.
  • Control planes and nodes with auto-upgrade enabled in the Rapid channel will be upgraded from version 1.24 to version 1.24.2-gke.300 with this release.

(2022-R18) Version updates

  • The following versions are now available in the Stable channel:
  • Version 1.21.12-gke.1700 is now the default version in the Stable channel
  • The following versions are no longer available in the Stable channel:
    • 1.20.15-gke.8700
    • 1.21.12-gke.1500
    • 1.22.8-gke.200
    • 1.23.6-gke.2200
  • Control planes and nodes with auto-upgrade enabled in the Stable channel will be upgraded from version 1.19 to version 1.20.15-gke.9900 with this release.
  • Control planes and nodes with auto-upgrade enabled in the Stable channel will be upgraded from version 1.20 to version 1.21.12-gke.1700 with this release.
  • Control planes and nodes with auto-upgrade enabled in the Stable channel will be upgraded from version 1.21 to version 1.21.12-gke.1700 with this release.
  • Control planes and nodes with auto-upgrade enabled in the Stable channel will be upgraded from version 1.23 to version 1.23.7-gke.1400 with this release.
SAP on Google Cloud

Cloud Storage Backint agent for SAP HANA version 1.0.21

Version 1.0.21 of the Cloud Storage Backint agent for SAP HANA is now available. This version includes enhancements for backup stability and performance.

For more information about the agent, see Cloud Storage Backint agent for SAP HANA overview.

VPC Service Controls

General availability for the following integration:

July 25, 2022

Apigee X

On July 25, 2022, we released an updated version of Apigee X (1-8-0-apigee-23).

Bug ID Description
N/A Upgraded infrastructure and libraries
BigQuery

BigLake is now generally available (GA). You can now create BigQuery ML models using data in Cloud Storage by using BigLake and publish BigLake tables as Analytics Hub listings.

The new Migrate section in the BigQuery documentation helps you migrate to BigQuery. This includes high-level guidance with a migration overview, an introduction to free-to-use tools that help you with each phase of migration, and platform-specific migration guides.

Cloud Load Balancing

Cloud Load Balancing introduces the internal regional TCP proxy load balancer. This is an Envoy proxy-based regional layer 4 load balancer that enables you to run and scale your TCP service traffic behind an internal regional IP address that is accessible only to clients in the same VPC network or clients connected to your VPC network.

The internal regional TCP proxy load balancer distributes TCP traffic to backends hosted on Google Cloud, on-premises, or other cloud environments.

For details, see the following:

Cloud SQL for PostgreSQL

The following PostgreSQL minor versions and extension versions are now available:

  • 14.3 is upgraded to 14.4.
  • 13.6 is upgraded to 13.7.
  • 12.10 is upgraded to 12.11.
  • 11.15 is upgraded to 11.16.
  • 10.20 is upgraded to 10.21.

If you use maintenance windows, then you might not yet have these versions. In this case, you'll see the new versions after your maintenance update occurs. To find your maintenance window or to manage maintenance updates, see Find and set maintenance windows.

Added information about checking the LC_COLLATE value for your databases before performing a major version upgrade of the databases for your Cloud SQL for PostgreSQL instance. For more information, refer to the Cloud SQL documentation.

Cloud Spanner

Query Optimizer version 5 is generally available. Version 4 remains the default optimizer version in production.

Eventarc

Eventarc is available in the following regions:

  • us-east5 (Columbus, Ohio, North America)
  • us-south1 (Dallas, Texas, North America)
Google Cloud Deploy

You can now view and compare Kubernetes and Skaffold confguration files for releases, using Google Cloud Console.

Pub/Sub

You can now create BigQuery subscriptions in Pub/Sub to write messages directly to an existing BigQuery table. The change is being rolled out in a phased manner over the rest of the week.

Secret Manager

A weekly digest of client library updates from across the Cloud SDK.

Python

Changes for google-cloud-secret-manager

2.12.0 (2022-07-16)

Features
Bug Fixes

July 22, 2022

Cloud Billing

Secure the link between a project and its billing account

In the Cloud Billing Console, you can now lock the link between a project and its Cloud Billing account, in order to prevent accidental changes to the billing state, such as disabling billing or moving the project to a different billing account. You can also unlock this protected state if you want to unlink a project from a Cloud Billing account.

Google Cloud projects contain all the resources required for a system to operate. To pay for the usage of the Cloud resources (such as Compute Engine or Storage), each project must be linked to an active Cloud Billing account. If you unlink the project from a billing account, you disable billing on that project. When billing is disabled on a project, all resources contained within the project will shut down, which can cause outages to your normal business operation.

To prevent unintentional outages due to billing issues, lock your valuable projects to their linked billing account. Locking creates a two-step process to change the billing state of a project, improving billing reliability and reducing accidental outages due to billing issues.

Learn how to secure the link between a project and a Cloud Billing account.

Cloud Talent Solution Job Search

Histogram query for city and admin1_country can handle multiple location jobs

Support special characters in companyDisplayNames fuzzy match

Derive annualized compensation info for more employment types

Google Kubernetes Engine

GKE Gateway integration with Cloud Certificate Manager is now available as Public Preview in GKE versions 1.20 and later. Use the new TLS features and high scale offered by Cloud Certificate Manager with GKE Gateway. For more information, see Gateway Security.

Kf

Removed NFS sidecar, built the logics into user-container.

July 21, 2022

Anthos Config Management

The constraint template library includes a new template: K8sRequireCosNodeImage. For reference, see Constraint template library.

Policy Controller has been updated to include a more recent build of OPA Gatekeeper (hash: c370036).

Fixed the resource name length validation issue caused by long RepoSync names or long namespace names. The new maximum length is 253 characters, instead of 63 characters.

Apigee X

On July 21, 2022 we released an updated version of Apigee X.

The Advanced API Security's target assessment, which evaluates the security of target servers in your API, is now available. See Security scores in the Apigee UI to learn more.

Chronicle

The following supported default parsers have changed. Each is listed by product name and ingestion label, if applicable.

  • Avanan Email Security (AVANAN_EMAIL)
  • AWS Cloudtrail (AWS_CLOUDTRAIL)
  • AWS GuardDuty (GUARDDUTY)
  • AWS VPC Flow (AWS_VPC_FLOW)
  • Barracuda Firewall (BARRACUDA_FIREWALL)
  • BeyondTrust Secure Remote Access (BEYONDTRUST_REMOTE_ACCESS)
  • Carbon Black (CB_EDR)
  • Centrify (CENTRIFY_SSO)
  • Cisco Firepower NGFW (CISCO_FIREPOWER_FIREWALL)
  • Cisco ISE (CISCO_ISE)
  • CrowdStrike Falcon (CS_EDR)
  • CrowdStrike Falcon Stream (CS_STREAM)
  • Custom Security Data Analytics (CUSTOM_SECURITY_DATA_ANALYTICS)
  • Dell EMC Data Domain (DELL_EMC_DATA_DOMAIN)
  • Department of Homeland Security (DHS_IOC)
  • Elastic Audit Beats (ELASTIC_AUDITBEAT)
  • F5 VPN (F5_VPN)
  • FortiGate (FORTINET_FIREWALL)
  • Fortinet FortiNAC (FORTINET_FORTINAC)
  • GCP Cloud Run (GCP_RUN)
  • GitHub (GITHUB)
  • Google Chrome Browser Cloud Management
  • HCL BigFix (HCL_BIGFIX)
  • HP Aruba(Clearpass) (CLEARPASS)
  • IBM Guardium (GUARDIUM)
  • Infoblox (INFOBLOX)
  • Infoblox DNS (INFOBLOX_DNS)
  • Kubernetes audit logs (KUBERNETES_AUDIT)
  • Linux Sysmon (LINUX_SYSMON)
  • McAfee ePolicy Orchestrator (MCAFEE_EPO)
  • Medigate IoT (MEDIGATE_IOT)
  • Microsoft AD FS (ADFS)
  • Nasuni File Services Platform (NASUNI_FILE_SERVICES)
  • Office 365 (OFFICE_365)
  • Okta (OKTA)
  • Ping Identity (PING)
  • PostFix Mail (POSTFIX_MAIL)
  • Proofpoint On Demand (PROOFPOINT_ON_DEMAND)
  • Proofpoint Tap Alerts (PROOFPOINT_MAIL)
  • SailPoint IAM (SAILPOINT_IAM)
  • SecureLink (SECURELINK)
  • SentinelOne EDR (SENTINEL_EDR)
  • ServiceNow CMDB (SERVICENOW_CMDB)
  • Suricata EVE (SURICATA_EVE)
  • Suricata IDS (SURICATA_IDS)
  • Symantec Web Isolation (SYMANTEC_WEB_ISOLATION)
  • Thales Luna Hardware Security Module (THALES_LUNA_HSM)
  • Thales MFA (THALES_MFA)
  • Uptycs EDR (UPTYCS_EDR)
  • Windows DNS (WINDOWS_DNS)
  • Windows Event (WINEVTLOG)
  • Workspace Activities (WORKSPACE_ACTIVITY)

For details about changes in each parser, see Supported default parsers.

Compute Engine

Generally available: Compute Engine committed use discounts are now Generally Available for SUSE Linux Enterprise Server (SLES) image licenses. Learn more about discounted SLES image pricing and how to purchase a license commitment.

Google Kubernetes Engine

If you start a credential rotation or an IP address rotation, ensure that you manually complete the rotation. If an operation causes a control plane re-creation while the rotation remains incomplete, your cluster might enter a broken state.

Kubernetes control plane metrics are now Generally Available. You can now configure GKE clusters with control plane version 1.23.6-gke.1500 or later to export to Cloud Monitoring certain metrics emitted by the Kubernetes API server, scheduler, and controller manager.

These metrics are stored in Cloud Monitoring in a Prometheus-compatible format. They can be queried by sending either a PromQL or MQL query to the Cloud Monitoring API. They can also be used anywhere within Cloud Monitoring, including in custom dashboards or alerting rules.

Secret Manager

Secret Manager now supports accessing secret versions using aliases. For information, see Assign an alias to a secret version.

Security Command Center

The container and kubernetes attributes were added to the Finding object.

The container attribute provides information about both Kubernetes and non-Kubernetes containers that are associated with a given finding. The kubernetes attribute provides information about Kubernetes resources that are associated with a given finding.

For more information, see the Security Command Center API documentation for the Finding object.

July 20, 2022

Anthos Service Mesh

1.14.1-asm.3 is now available.

Anthos Service Mesh 1.14 includes the features of Istio 1.14 subject to the list of Anthos Service Mesh supported features.

Anthos Service Mesh allows you to configure the minimum TLS version for your Istio workloads. See Configure minimum TLS version for your workloads for more information.

Managed Anthos Service Mesh isn't rolling out to the rapid release channel at this time. You can periodically check this page for the announcement of the rollout of Managed Anthos Service Mesh to the rapid channel. See Select a managed Anthos Service Mesh release channel for more information.

Anthos Service Mesh 1.11 is no longer supported. For more information, see Supported versions.

1.12.8-asm.2 is now available.

Anthos Service Mesh 1.12 includes the features of Istio 1.12.8 subject to the list of Anthos Service Mesh Supported features.

1.13.5-asm.1 is now available.

Anthos Service Mesh 1.13 includes the features of Istio 1.13.5 subject to the list of Anthos Service Mesh Supported features.

BeyondCorp Enterprise

The BeyondCorp Enterprise app connector is now generally available. The app connector provides low-touch, frictionless, secure connectivity between Google Cloud and customer workloads in other cloud environments.

For more information, see Securing non-Google Cloud applications using the BeyondCorp Enterprise app connector.

BigQuery

Analytics Hub is now available in additional regions across the Americas, Asia Pacific, and Europe. For more information, see Analytics Hub supported regions.

Compute Engine

Generally available: NVIDIA® T4 GPUs are now available in the following additional regions and zones:

  • Montréal, Québec, North America : northamerica-northeast1-c

For more information about using GPUs on Compute Engine, see GPU platforms.

Data Catalog

Data Catalog is now a part of Dataplex to provide a complete data management and governance experience with built-in data intelligence and automation capabilities. See Dataplex product overview.

Dataflow

Dataflow Prime is now in General Availability.

Dataplex

Dataplex is now unified with Data Catalog to provide a complete data management and governance experience with built-in data intelligence and automation capabilities. See Dataplex product overview.

July 19, 2022

Anthos clusters on VMware

Anthos clusters on VMware 1.9.7-gke.8 is now available. To upgrade, see Upgrading Anthos clusters on VMware. Anthos clusters on VMware 1.9.7-gke.8 runs on Kubernetes 1.21.5-gke.1200.

The supported versions offering the latest patches and updates for security vulnerabilities, exposures, and issues impacting Anthos clusters on VMware are 1.12, 1.11, and 1.10.

  • Fixed a known issue in which the cluster backup feature affected the inclusion of always-on secrets encryption keys in the backup.
  • Fixed a known issue of high-resource usage when AIDE runs as a cron job, by disabling AIDE by default. This fix affects compliance with CIS L1 Server benchmark 1.4.2: Ensure filesystem integrity is regularly checked. Customers can opt in to re-enable the AIDE if needed. To re-enable the AIDE cron job, see Configure AIDE cron job.
  • Fixed the following vulnerabilities:

Apigee UI

On July 19, 2022 we released an updated version of the Apigee UI.

The Needs Attention Table in Advanced API Security Scores now use links instead of buttons. This fixes font and alignment issues inside the table rows.

Bug ID Description
238248377 The Needs Attention Table in Advanced API Security Scores was not showing target components. This has been fixed.
Cloud Asset Inventory

The following resource types are now publicly available through the Analyze Policy APIs (AnalyzeIamPolicy and AnalyzeIamPolicyLongrunning):

  • Network Connectivity

    • networkconnectivity.googleapis.com/Hub
    • networkconnectivity.googleapis.com/Spoke
  • Compute

    • compute.googleapis.com/ServiceAttachment
Cloud Data Loss Prevention

A new detection model is available for the PERSON_NAME infoType detector. The new model offers improved detection quality. You can try it out by setting InfoType.version to latest when including the PERSON_NAME infoType in your InspectConfig.

You can still use the old model by setting InfoType.version to stable or leaving it unset when using the PERSON_NAME infoType. In 30 days, the new model will be promoted to stable.

Cloud Monitoring

A new version of Managed Service for Prometheus is now available. Version 0.4.3-gke-0 of managed collection for Kubernetes has been released. Users who deploy managed collection using kubectl should reapply the manifests. Users who deploy the service using gcloud or the GKE UI will be upgraded on a rolling basis over the coming weeks. This release has no impact on users of self-deployed collection.

For details about the changes included, see the release page on GitHub.

Firestore Firestore in Datastore mode Google Kubernetes Engine

(2022-R17) Version updates

GKE cluster versions have been updated.

New versions available for upgrades and new clusters

The following Kubernetes versions are now available for new clusters and for opt-in control plane upgrades and node upgrades for existing clusters. For more information on versioning and upgrades, see GKE versioning and support and Upgrades.

No channel

Stable channel

  • The following versions are now available in the Stable channel:
  • The following versions are no longer available in the Stable channel:
    • 1.20.15-gke.8200
  • Control planes and nodes with auto-upgrade enabled in the Stable channel will be upgraded from version 1.20 to version 1.21.12-gke.1500 with this release.
  • Control planes and nodes with auto-upgrade enabled in the Stable channel will be upgraded from version 1.23 to version 1.23.6-gke.2200 with this release.

Regular channel

  • The following versions are now available in the Regular channel:
  • The following versions are no longer available in the Regular channel:
    • 1.20.15-gke.8700
    • 1.21.12-gke.1700
  • Control planes and nodes with auto-upgrade enabled in the Regular channel will be upgraded from version 1.20 to version 1.21.12-gke.2200 with this release.
  • Control planes and nodes with auto-upgrade enabled in the Regular channel will be upgraded from version 1.21 to version 1.21.12-gke.2200 with this release.

Rapid channel

  • The following versions are now available in the Rapid channel:
  • The following versions are no longer available in the Rapid channel:
    • 1.21.12-gke.2200
    • 1.22.9-gke.1500
    • 1.23.6-gke.1501
    • 1.24.1-gke.1400
  • Control planes and nodes with auto-upgrade enabled in the Rapid channel will be upgraded from version 1.20 to version 1.21.13-gke.900 with this release.
  • Control planes and nodes with auto-upgrade enabled in the Rapid channel will be upgraded from version 1.21 to version 1.21.13-gke.900 with this release.
  • Control planes and nodes with auto-upgrade enabled in the Rapid channel will be upgraded from version 1.24 to version 1.24.1-gke.1800 with this release.

(2022-R17) Version updates

  • The following versions are now available in the Regular channel:
  • The following versions are no longer available in the Regular channel:
    • 1.20.15-gke.8700
    • 1.21.12-gke.1700
  • Control planes and nodes with auto-upgrade enabled in the Regular channel will be upgraded from version 1.20 to version 1.21.12-gke.2200 with this release.
  • Control planes and nodes with auto-upgrade enabled in the Regular channel will be upgraded from version 1.21 to version 1.21.12-gke.2200 with this release.

(2022-R17) Version updates

  • The following versions are now available in the Rapid channel:
  • The following versions are no longer available in the Rapid channel:
    • 1.21.12-gke.2200
    • 1.22.9-gke.1500
    • 1.23.6-gke.1501
    • 1.24.1-gke.1400
  • Control planes and nodes with auto-upgrade enabled in the Rapid channel will be upgraded from version 1.20 to version 1.21.13-gke.900 with this release.
  • Control planes and nodes with auto-upgrade enabled in the Rapid channel will be upgraded from version 1.21 to version 1.21.13-gke.900 with this release.
  • Control planes and nodes with auto-upgrade enabled in the Rapid channel will be upgraded from version 1.24 to version 1.24.1-gke.1800 with this release.

(2022-R17) Version updates

  • The following versions are now available in the Stable channel:
  • The following versions are no longer available in the Stable channel:
    • 1.20.15-gke.8200
  • Control planes and nodes with auto-upgrade enabled in the Stable channel will be upgraded from version 1.20 to version 1.21.12-gke.1500 with this release.
  • Control planes and nodes with auto-upgrade enabled in the Stable channel will be upgraded from version 1.23 to version 1.23.6-gke.2200 with this release.
reCAPTCHA Enterprise

You can now find legacy secret keys for all reCAPTCHA Enterprise keys in the Google Cloud console. These keys can be useful if you are using a third-party plug-in/implementation that does not yet call the reCAPTCHA Enterprise API. For more information, see FAQs.

July 18, 2022

App Engine standard environment Java
  • Updated the Java SDK to version 1.9.98.
  • Updated Jetty web server to version jetty-9.4.46.v20220331.
App Engine standard environment PHP

The App Engine legacy bundled services for PHP 7+ are now available at the General Availability release level. These APIs can be accessed through language-idiomatic libraries. Calls to these API are billed according to the standard rates.

Cloud Composer

(Cloud Composer 2) Fixed a problem where an environment creation in the PSC configuration might fail with the "Composer backend timed out" message.

Cloud Composer 1.19.4 and 2.0.21 images are available:

  • composer-1.19.4-airflow-1.10.15 (default)
  • composer-1.19.4-airflow-2.1.4
  • composer-1.19.4-airflow-2.2.5
  • composer-2.0.21-airflow-2.1.4
  • composer-2.0.21-airflow-2.2.5

Cloud Composer versions 1.16.10 and 1.17.0.preview.6 have reached their end of full support period.

Cloud Logging

A weekly digest of client library updates from across the Cloud SDK.

Java

Changes for google-cloud-logging

3.10.1 (2022-07-13)

Bug Fixes
  • enable longpaths support for windows test (#1485 )(#995) (b2f68cb)
Dependencies
  • update dependency org.graalvm.buildtools:native-maven-plugin to v0.9.12 (#977) (71dc1ee)

Python

Changes for google-cloud-logging

3.2.1 (2022-07-13)

Bug Fixes
  • deps: require google-api-core>=1.32.0,>=2.8.0 (#585) (de35eab)

3.2.0 (2022-07-11)

Features
  • add audience parameter (a2eed8c)
  • Add support for library instrumentation (#551) (8ba0023)
Bug Fixes
  • deps: require google-api-core >= 2.8.0 (#575) (a2eed8c)
  • deps: require google-cloud-core >= 2.0.0 (a2eed8c)
  • require python 3.7+ (#580) (0b3eb52)

You can now search your correlated log entries in the Logs Explorer. For more information, see Correlate log entries.

Cloud Run

Cloud Run now supports container images in the Open Container Initiative (OCI) image format.

Dataproc Metastore

Dataproc Metastore is available in the following regions: us-west2 (Los Angeles), us-west3 (Salt Lake City), europe-west4 (Netherlands), europe-west6 (Zürich), and asia-east1 (Taiwan). For more information, see Dataproc Metastore locations.

Note that these services are immediately available through the gcloud CLI and the REST API. Cloud console availability will vary by region over the next few weeks.

Kf

Fixed the issue that App Pod will keep restarting when the mounted NFS volume is larger than cluster's ephemeral storage.

Fixed the issue that will cause delete-service stuck.

Security Command Center

Virtual Machine Threat Detection, a built-in service of Security Command Center Premium, is generally available (GA). VM Threat Detection detects cryptocurrency mining software, which is among the most common types of software installed in compromised cloud environments.

Storage Transfer Service

Detailed logging for objects copied between AWS S3, Azure Blob Storage, ADLS Gen 2, and Cloud Storage with Storage Transfer Service is now generally available (GA).

With detailed logs of individual objects available in Cloud Logging, you can verify what was transferred and perform additional data integrity checks. This launch simplifies monitoring, reporting, and troubleshooting. Read Cloud Logging for Storage Transfer Service for details.

Vertex AI

NFS support for custom training is GA. For details, see Mount an NFS share for custom training.

July 16, 2022

Compute Engine

Generally available: Internal and external IPv6 addresses for Google Compute Engine instances are available in all regions.

For more information, see Configuring IPv6 for instances and instance templates and Creating instances with multiple network interfaces.

July 15, 2022

Cloud Logging

You can now collect SAP HANA logs and metrics from the Ops Agent, starting with version 2.18.1. For more information, see Monitoring third-party applications: SAP HANA.

You can now collect Vault logs from the Ops Agent, starting with version 2.18.1. For more information, see Monitoring third-party applications: Vault.

Cloud Monitoring

You can now collect Flink metrics from the Ops Agent, starting with version 2.18.1. For more information, see Monitoring third-party applications: Flink.

You can now collect SAP HANA logs and metrics from the Ops Agent, starting with version 2.18.1. For more information, see Monitoring third-party applications: SAP HANA.

Cloud VPN

You can now download third-party peer VPN configuration templates for Cloud VPN from the Google Cloud console. Use these templates to configure HA VPN tunnels on your peer VPN device. Configuration templates are currently available for the following vendor platform and software versions:

  • Cisco Firepower, running ASA 9.13(1)2 or later
  • Fortinet FortiGate 200E, running FortiOS 6.2.3 or later
  • Juniper vSRX, running JunOS 18.4R3-S2 or later

For more information, see Download a peer VPN configuration template.

Google Kubernetes Engine

Clusters that are using custom or manually created EndpointSlices (EPS) can cause Ingresses and NEGs to stop syncing if missing the service label kubernetes.io/service-name: <service-name>. This issue affects clusters running GKE 1.21, 1.22, and 1.23. Users should add the service label to all custom-made EndpointSlices to ensure that their Ingresses and NEGs continue to be synced.

Cluster autoscaler Location Policy is now generally available in GKE version 1.24.1-gke.800. This change allows users to pick one of two different spreading policies. For more information see Location policy.

July 14, 2022

BigQuery

Previously, the Storage Write API had a maximum concurrent connection limit of 100 connections for non-multi-regions such as Montreal (northamerica-northeast1). This limit has now been increased to 1,000 connections across all non-multi-regions. For more information, see Storage Write API quotas and limits.

Cloud Logging

Log-based alerting is now generally available (GA). Log-based alerts match on the content of your logs. When triggered, a log-based alert notifies you that a match has appeared in your logs and opens an incident in Cloud Monitoring. The minimum autoclose duration for incidents is now 30 minutes. For more information, see Monitor your logs and Use log-based alerts.

Cloud Monitoring

Log-based alerting is now generally available (GA). Log-based alerts match on the content of your logs. When triggered, a log-based alert notifies you that a match has appeared in your logs and opens an incident in Cloud Monitoring. The minimum autoclose duration for incidents is now 30 minutes. For more information, see Monitor your logs and Use log-based alerts.

Cloud SQL for MySQL

For enhanced security with built-in authentication, Cloud SQL now lets you set password policies at the instance and user levels.

Cloud Spanner

You can now view aggregated Cloud Spanner statistics related to transactions, reads, queries, and lock contentions in GA in Cloud Monitoring.

Compute Engine

Generally available: You can use the Cloud console to configure autoscaling based on unacknowledged messages in a Pub/Sub subscription. For more information, see Autoscale based on unacknowledged messages in Pub/Sub.

Generally available: NVIDIA® T4 GPUs are now available in the following additional regions and zones:

Ashburn, Virginia, North America : us-east4-c

For more information about using GPUs on Compute Engine, see GPU platforms.

Eventarc

Eventarc support for Customer-Managed Encryption Keys (CMEK) using the Cloud Console is available in Preview.

Google Cloud Marketplace Partners

Manage your private offers, including approving an offer, by using the Private Offers page.

Google Distributed Cloud Edge

This is a minor release of Google Distributed Cloud Edge (version 1.1.0).

The following changes have been introduced in this release of Google Distributed Cloud Edge:

  • The Kubernetes control plane has been updated to version 1.22.

The following issues have been resolved in this release of Distributed Cloud Edge:

  • The Kubernetes control plane no longer becomes intermittently unavailable during Google Distributed Cloud Edge software updates.
  • VPN connectivity between non-Anthos gateway nodes and Google Cloud Platform now works reliably.

This release of Distributed Cloud Edge contains the following known issues:

  • Garbage collection intermittently fails to clean up terminated Pods.
SAP on Google Cloud

Google Cloud monitoring agent for SAP NetWeaver version 2.5

Version 2.5 of the Google Cloud monitoring agent for SAP NetWeaver is now available. This version includes bug fixes and supportability improvements.

For more information about the agent, see Monitoring SAP NetWeaver on Google Cloud.

Vertex AI

The Pipeline Templates feature is available in Preview. For documentation, refer to Create, upload, and use a pipeline template.

The features supported by pipeline templates include the following:

  • Create a template registry using Artifact Registry (AR).
  • Compile and publish a pipeline template.
  • Create a pipeline run using the template and filter the runs.
  • Manage (create, update, or delete) the pipeline template resources.
Virtual Private Cloud

Private Service Connect supports publishing a service that is hosted on the following load balancers:

These features are available in General Availability.

July 13, 2022

Anthos clusters on AWS

You can now launch Kubernetes 1.23 clusters.

Kubernetes 1.23.7-gke.1300 includes the following changes:

  • Disable profiling endpoint (/debug/pprof) by default in kube-scheduler and kube-controller-manager.
  • Update kube-apiserver and kubelet to only use Strong Cryptographic Ciphers.
  • Add an instance metadata server (IMDS) emulator.

In a future release of 1.23 VolumeSnapshot v1beta1 APIs will no longer be served. Please update to VolumeSnapshot v1 APIs as soon as possible.

You can now launch clusters with the following Kubernetes versions:

  • 1.23.7-gke.1300
  • 1.22.10-gke.1500
  • 1.21.11-gke.1900

In Kubernetes 1.23 and higher, cluster Cloud Audit Logs is now available and is enabled by default.

CIS benchmarks are now available for Kubernetes 1.23 clusters.

This release fixes the following vulnerabilities:

Restrictions on IP ranges that can be used for a cluster's Pods and Services are now relaxed. Pod and Service IP ranges can now overlap with VPC's IP ranges, provided they do not intersect the control plane or node pool subnets.

Anthos clusters on Azure

You can now launch clusters with the following Kubernetes versions:

  • 1.23.7-gke.1300
  • 1.22.10-gke.1500
  • 1.21.11-gke.1900

You can now launch Kubernetes 1.23 clusters.

Kubernetes 1.23.7-gke.1300 includes the following changes:

  • Disable profiling endpoint (/debug/pprof) by default in kube-scheduler and kube-controller-manager.
  • Update kube-apiserver and kubelet to only use Strong Cryptographic Ciphers.

In a future release of 1.23 VolumeSnapshot v1beta1 APIs will no longer be served. Please update to VolumeSnapshot v1 APIs as soon as possible.

In Kubernetes 1.23 and higher, cluster Cloud Audit Logs is now available and is enabled by default.

CIS benchmarks are now available for Kubernetes 1.23 clusters.

This release fixes the following vulnerabilities:

Added support for updating Azure control plane and node pool ssh config. For more information, see gcloud container azure clusters update and gcloud container azure node-pools update

Restrictions on IP ranges that can be used for a cluster's Pods and Services are now relaxed. Pod and Service IP ranges can now overlap with VPC's IP ranges, provided they do not intersect the control plane or node pool subnets.

You can no longer create clusters with the following versions:

  • 1.21.11-gke.100
  • 1.21.11-gke.1100
  • 1.22.8-gke.200
  • 1.22.8-gke.1300

These versions have a bug mentioned in a note from June 23, 2022.

Batch

Batch is now available in Preview! For more information about using Batch, see the documentation.

Compute Engine

Generally Available: A version of Rocky Linux is now available that is optimized for running on Compute Engine.

This version of Rocky Linux is configured to use the latest version of the Google virtual network interface (gVNIC) which is specifically designed to support workloads that require higher network bandwidths. For more information, see the Rocky Linux section of the Operating systems details documentation.

Preview: Tau T2A, Google Cloud's first general purpose VM family to run on Arm architecture, is now available. Tau T2A VMs are available in three regions.

For more information, see Arm VMs on Compute Engine.

Google Cloud VMware Engine

VMware Engine nodes are now available in the following additional region:

  • Zurich, Switzerland, Europe (europe-west6)
Google Kubernetes Engine

You can now run Arm-based workloads in Preview in Standard clusters with GKE version 1.24 and later, and in Autopilot clusters with GKE version 1.24.1-gke.1400 and later.

You can now select compute classes to run GKE Autopilot workloads that have specialized hardware requirements, such as Arm architecture. The Scale-Out compute class is available in Preview in Autopilot clusters running GKE version 1.24.1-gke.1400 and later.

Migrate to Containers

Modernize VMs to run Anthos for VMs (A4VM)

Migrate to Containers has added a new modernization feature, which enables traditional VMs to run on Anthos for VMs. Anthos for VMs extends Anthos on bare metal (now known as Google Distributed Cloud Virtual) to let you run and manage containers and VMs on a unified, Google Cloud-connected platform in your data center or at the edge. For more information on this feature, see About Anthos for VMs.

Support for local-ovf sources

Migrate to Containers has added support for creating Anthos VM runtimes from local OVF files. This enables users to modernize VMs to the Anthos VM Runtime by importing their OVF file into their local Anthos bare metal cluster using Migrate to Containers.

List the source inventory for Google Compute Engine, local-vmware, and Migrate for Compute Engine 5.x sources

Migrate to Containers has added support for the inventory listings of VMs in connected sources. Users can list an inventory of the VMs in connected Migrate to Containers sources. The new inventory listings are available for Google Compute Engine, local-vmware, and Migrate for Compute Engine v5.0 sources.

Improved migration flow and task APIs

A new structured method for generalizing the Migrate to Containers containerization process is available. The new structure provides more flexibility and more granular control of the automated containerization process. The new structure enables users to customize the process and enables support for additional software framework modernization. The following containerization tasks elements are available:

  • AppXGenerateArtifactsTask
  • AppXGenerateArtifactsFlow

The following migration types are now deprecated and planned to be removed in version 1.13. The corresponding AppX objects and parameters can be used to perform migration for these workload types:

  • system - Legacy linux migrations
  • iis - Legacy windows IIS migrations

The following APIs (CRDs) have been deprecated since version 1.11 and are planned to be removed in version 1.13:

July 12, 2022

Agent Assist

Agent Assist now offers UI Modules as a public Preview feature. UI Modules are an out-of-the-box option for integrating Agent Assist features into your agent UI system. For more information, see the UI Modules documentation.

AlloyDB for PostgreSQL

When creating a primary or read-pool instance, or scaling either one, you can choose a machine size as small as 2 vCPUs with 16 GB of RAM.

BigQuery

You can now select a job type when assigning a folder, organization, or project to a reservation in the Google Cloud console. This feature is now generally available (GA).

Cloud Asset Inventory

The following resource types are now publicly available through the Export APIs (ExportAssets and BatchGetAssetsHistory) , Feed API, and Search APIs (SearchAllResources and SearchAllIamPolicies):

  • Dataproc
    • dataproc.googleapis.com/AutoscalingPolicy
    • dataproc.googleapis.com/Batch
    • dataproc.googleapis.com/WorkflowTemplate
Cloud Build

The gcr.io/cloud-builders/docker builder has been upgraded to Docker client version 20.10.14. For instructions on using this builder with the Docker client versions, see Interacting with Docker Hub images.

Transfer Appliance

Transfer Appliance is now available in an additional size. The TA7 appliance offers up to 7TB of storage in a smaller form factor than our other appliances. It offers both online and offline transfer modes.

Learn more about the TA7 on the Specifications page, or order an appliance from the Cloud console.

Vertex AI

You can now use a pre-built container to perform custom training with TensorFlow 2.9

July 11, 2022

Anthos BigQuery

The google.cloud.bigquery.reservation.v1beta1.api package is deprecated and will be removed on September 27, 2022. After that date, requests to that package will fail. Data created by using google.cloud.bigquery.reservation.v1beta1.api are accessible by using the google.cloud.bigquery.reservation.v1.api package.

Next steps:

Cloud Bigtable

Cloud Bigtable is available in the us-south1 (Dallas) and europe-southwest1 (Madrid) regions. For more information, see Bigtable locations.

Cloud Composer

DAG UI is now generally available (GA).

(Cloud Composer 2) Improved the reliability of web server proxy connectivity. This change reduces the chance of 504 timeout errors when connecting to an environment's web server.

Set memory and CPU limits for the Composer Agent pod. This change increases this pod's priority and improves the reliability of operations that could fail because of resource starvation.

Environments no longer produce error log messages about the connection timeout when initializing the Airflow database during the environment creation. These messages were not associated with any error.

Source code for the apache-airflow-providers-google package versions 2022.6.22+composer and 2022.5.18+composer is available on GitHub:

Cloud Composer 1.19.3 and 2.0.20 images are available:

  • composer-1.19.3-airflow-1.10.15 (default)
  • composer-1.19.3-airflow-2.1.4
  • composer-1.19.3-airflow-2.2.5
  • composer-2.0.20-airflow-2.1.4
  • composer-2.0.20-airflow-2.2.5

Cloud Composer versions 1.16.8, 1.16.9, 1.17.0.preview.4, and 1.17.0.preview.5 have reached their end of full support period.

Cloud Composer 1.19.2 and 2.0.19 are versions with an extended upgrade timeline.

Cloud Run Cloud SQL for MySQL

You can enable high availability for read replicas. See Disaster recovery for additional information about the use of high-availability replicas in a disaster recovery configuration.

You can create external server replicas with HA enabled.

Cloud SQL for PostgreSQL

You can enable high availability for read replicas. See Disaster recovery for additional information about the use of high-availability replicas in a disaster recovery configuration.

You can create external server replicas with HA enabled.

Cloud SQL for SQL Server

The database major version upgrade feature of Cloud SQL for SQL Server is generally available. For more information, see Upgrade the database major version in-place.

Dataflow

You can use the Apache Beam SDK for Go to create batch and streaming Dataflow pipelines. This feature is now in General Availability.

Google Cloud Deploy

You can now permanently abandon a release using Google Cloud Deploy.

You can now suspend a delivery pipeline using Google Cloud Deploy.

Identity Platform

Activity logging can now be enabled on a a per-tenant basis. The feature is generally available.

Kf

Kf will terminate Istio sidecars on completed tasks and builds freeing up IP addresses and compute resources for clusters running newer versions of Tekton.

Kf will now install with GKE 1.22 clusters.

kf doctor now works with GKE 1.22 clusters.

Builds will now be allowed up to 15 minutes to extract or publish images.

Workflows

Added support to deploy a workflow using a cross-project service account through the Google Cloud CLI.

July 09, 2022

Apigee Integration

On July 09, 2022 we released an updated version of the Apigee Integration software.

Data Mapping task enhancements

The Data Mapping task in Apigee Integrations now provides the following enhancements:

  • Nested function support. You can pass one or more transformation functions as input parameters to another function.
  • New transformation functions. You can use the following new transform functions for array-type variables:

    • FILTER - Filters the array elements that satisfy a given condition.
    • FOR_EACH - Applies one or more transformation functions for each element in an array.
  • Subfield mapping support for JSON variables. You can view and search all the subfields of a JSON variable in the data mapping editor variable list.

For more information, see the Data Mapping task.

July 08, 2022

Apigee hybrid

hybrid v1.6.9

On July 8, 2022 we released an updated version of the Apigee hybrid software, v1.6.9.

For information on upgrading, see Upgrading Apigee hybrid to version 1.6.

Bug ID Description
236129944 Fixed the controller crashloopbackoff due to null pointer issue.
234620567 Fix logger issue in Anthos BareMetal with CentOS.
231313050 Fixed issue causing Apigee logger pod to remain in crashloopbackoff state.
233094108 Fixed Stacktrace truncation in runtime containers to support proxy diagnosis.
Cloud SQL for PostgreSQL

The July maintenance changelog is now available. For more information, use the links at Maintenance changelog.

Cloud SQL for SQL Server

The July maintenance changelog is now available. For more information, use the links at Maintenance changelog.

Policy Intelligence

Recommender now offers role recommendations for Cloud Storage buckets. Role recommendations help you reduce excess permissions by suggesting role changes based on actual permission usage. This feature is available in Preview.

July 07, 2022

Anthos clusters on AWS (previous generation)

Anthos clusters on AWS (previous generation) aws-1.12.0-gke.0 is now available.

This release note has been updated to mark the actual date of release, July 7, 2022. Previously, the release date was mentioned as June 24th.

You can now launch clusters with the following Kubernetes versions:

  • 1.23.7-gke.1500
  • 1.22.10-gke.1500
  • 1.21.13-gke.1600

You can now launch Kubernetes 1.23 clusters.

Kubernetes 1.20 clusters are no longer supported. This version no longer supports creation or maintenance of Kubernetes 1.19 clusters.

This release fixes the following vulnerabilities:

Anthos clusters on VMware

Anthos clusters on VMware v1.12.0-gke.446 is now available. To upgrade, see Upgrading Anthos clusters on VMware. Anthos clusters on VMware v1.12.0-gke.446 runs on Kubernetes v1.23.5-gke.1504.

The supported versions offering the latest patches and updates for security vulnerabilities, exposures, and issues impacting Anthos clusters on VMware are 1.12, 1.11, and 1.10.

Announcements

  • vSphere releases for versions lower than version 7.0 Update 2 are deprecated in Kubernetes 1.24. VMware's General Support for vSphere 6.7 will end on October 15, 2022. Customers are recommended to upgrade vSphere (both ESXi and vCenter) to version 7.0 Update 2 or above. vSphere versions less than version 7.0 Update 2 will no longer be supported in Anthos clusters on VMware in an upcoming version. You must upgrade vSphere to 7.0 Update 2 or above before you can upgrade to Anthos clusters on VMware 1.13.0.

  • Beta versions of VolumeSnapshot CRDs are deprecated in Kubernetes v1.20 and are unsupported in the Kubernetes v1.24 release.
    The upcoming Anthos clusters on VMware version 1.13 release will no longer serve v1beta1 VolumeSnapshot CRDs. Make sure that you migrate manifests and API clients to use snapshot.storage.k8s.io/v1 API version, available since Kubernetes v1.20. All existing persisted objects remain accessible via the new snapshot.storage.k8s.io/v1 APIs.

  • The dockershim component in Kubernetes enables cluster nodes to use the Docker Engine container runtime. However, Kubernetes 1.24 removed the dockershim component. Starting from Anthos clusters on VMware version 1.12.0, you cannot create new clusters that use the Docker Engine container runtime. All new clusters must use the default container runtime Containerd. A cluster update will also be blocked if you want to switch from containerd node pool to docker node pool, or if you add new docker node pools. For existing version 1.11.x clusters with docker node pools, you can continue upgrading it to version 1.12.0, but you must update the node pools to use containerd before you can upgrade to version 1.13.0 in the future.

Breaking changes:

In Kubernetes 1.23, the rbac.authorization.k8s.io/v1alpha1 API version is removed. Instead, use the rbac.authorization.k8s.io/v1 API. See the Kubernetes 1.23.5 release notes.

Platform enhancements:

  • General Availability (GA): Separate vSphere data centers for the admin cluster and the user clusters are supported.
  • GA: Anthos Identity service LDAP authentication is supported.
  • GA: User cluster control-plane node and admin cluster add-on node auto sizing is supported.

Security enhancements:

  • Preview: Preparing credentials for user clusters as Kubernetes secrets before cluster creation.

    • The credential preparation feature prepares the credentials before a user cluster is created. After credential preparation, user cluster credentials are saved as versioned Kubernetes secrets in the admin cluster, and the template which is used for credential preparation can be deleted from the admin workstation. When creating a user cluster, it only needs to configure the namespace and the versions of the prepared secrets in the user cluster config file. Using this feature can help protect user cluster credentials.
  • Preview: The gkectl update credentials command supports rotating the component access SA key for both the admin and the user clusters.

  • The COS node image shipped in version 1.12.0 is qualified with the Center for Internet Security (CIS) L1 Server Benchmark.

  • The gkectl update credentials command supports register service account key rotation.

Cluster lifecycle Improvements:

  • Preview: You can configure the time duration of Pod Disruption Budget (PDB) violation timeout during a node drain. The default behavior is to always block on a PDB violation and to not force-delete pods during node drain, to avoid unexpected data corruption, and this default is unchanged. In certain cases, when users want to unblock the PDB violation deadlock with the bound timeout during cluster upgrade, they can apply the special annotation onprem.cluster.gke.io/pdb-violation-timeout: TIMEOUT on the machine objects.

Simplify day-2 operations

  • Preview: Launched the enablement of Google Cloud Managed Service for Prometheus to track metrics in Anthos on vSphere clusters, and introduced two separate flags to enable logging and monitoring for user applications separately: EnableCloudLoggingForApplications and EnableGMPForApplications. The legacy flag EnableStackdriverForApplications is deprecated, and will be removed in a future release. Customers can monitor and alert on the applications using Prometheus with Google-managed Prometheus without managing and operating Prometheus. Customers can set enableGMPForApplications in the Stackdriver spec to enable Google Managed Prometheus for application metrics without any other manual steps, and the Google Managed Prometheus components are then set up automatically. See Enable Managed Service for Prometheus for user applications for details.

  • All sample dashboards to monitor cluster health are available in Cloud Monitoring sample dashboards. Customers can install the dashboards with one click. See Install sample dashboards.

  • Improvements to cluster diagnosis: The gkectl diagnose cluster command automatically runs when gkectl diagnose snapshot is run, and the output is saved in a new folder in the snapshot called /diagnose-report.

  • The gkectl diagnose cluster command surfaces more detailed information for issues arising from virtual machine creation.

  • A validation check for the existence of an OS image has been added to the gkectl update admin and gkectl diagnose cluster commands.

  • A blocking preflight check has been added. This check validates that the vCenter.datastore specified in the cluster configuration file doesn't belong to a DRS-enabled datastore cluster.

Functionality changes:

  • Upgraded COS from m93 to m97, and containerd to 1.6 on COS.

  • Metrics agent: Upgraded gke-metrics-agent from 1.1.0 to 1.8.3, which fixes some application metrics issues. The offline buffer in the metrics agent can now discard old data based on the age of metrics data, in addition to the total size of buffer. Metrics data is stored in an offline buffer for at most 22 hours in case of a network outage.

  • New metrics: Added 7 resource utilization metrics.

    • k8s_container:
      • container/cpu/request_utilization
      • container/cpu/limit_utilization
      • container/memory/request_utilization
      • container/memory/limit_utilization
    • k8s_node:
      • node/cpu/allocatable_utilization
      • node/memory/allocatable_utilization
    • k8s_pod:
      • pod/volume/utilization

Fixes

Known issues:

  • On the out-of-the-box monitoring dashboards, the GKE on-prem Windows pod status and GKE on-prem Windows node status also show data from Linux clusters.

  • The scheduler metrics, such as scheduler_pod_scheduling_attempts, are not collected in version 1.12.0 due to a configuration issue in the metric collector.

In version 1.12.0, cgroup v2 (unified) is enabled by default for Container Optimized OS (COS) nodes. This could potentially cause instability for your workloads in a COS cluster. We will switch back to cgroup v1 (hybrid) in version 1.12.1. If you are considering using version 1.12 with COS nodes, we suggest that you wait until the 1.12.1 release.

Anthos clusters on bare metal

Release 1.10.6

Anthos clusters on bare metal 1.10.6 is now available for download. To upgrade, see Upgrading Anthos on bare metal. Anthos clusters on bare metal 1.10.6 runs on Kubernetes 1.21.

Known issues:

For information about the latest known issues, see Anthos on bare metal known issues in the Troubleshooting section.

BigQuery

Azure workload identity federation is now available in preview for BigQuery Omni connections. This feature helps you secure data by allowing you to grant Google access to an application you manage in your Azure tenant so that neither you nor Google must manage application client secrets.

Carbon Footprint

Carbon Footprint now reports carbon emissions broken down by scope 1, scope 2, and scope 3 categories, following the Greenhouse Gas (GHG) Protocol carbon reporting standards.

We've renamed the Carbon Footprint export table from carbon_footprint_export to carbon_footprint within the target BigQuery dataset indicated by your data transfer configuration. The renamed table contains an updated schema. Furthermore, the renamed table is now partitioned by month. Each month's data is exported on the 15th day of the following month. Data for previous months is not automatically exported, but you can schedule manual data backfills to export data for previous months. Carbon Footprint will no longer update existing carbon_footprint_export tables.

We've made the following updates to data sources and methodology for Scope 2 location-based emissions:

  • Improved power data measurements.
  • Changed from LCA grid carbon intensity values to scope-2-compliant direct grid emissions.
  • Corrected data that led to changes in internal cost-based reallocation of shared infrastructure energy consumption.
  • Removed VPC Network Logs SKU that caused inaccurate results.
Cloud SQL for MySQL

Cloud SQL for MySQL now supports setting timezone names as values for the time_zone parameter. Refer to the Cloud SQL documentation for a list of supported timezone names.

Dataproc

Dataproc support for the following images has been extended to the following dates:

Identity and Access Management

Workforce identity federation lets you authenticate and authorize users from external identity providers to access supported Google Cloud products. This feature is available in Preview.

SAP on Google Cloud

Cloud Storage Backint agent for SAP HANA version 1.0.20

Version 1.0.20 of the Cloud Storage Backint agent for SAP HANA is now available. This version includes backup stability and logging enhancements.

For more information about the agent, see Cloud Storage Backint agent for SAP HANA overview.

July 06, 2022

Apigee API hub

On July 6, 2022 Apigee hub released a new version of the software.

Bug ID Description
229852942 The error message displayed has been clarified for the case where the uploaded spec file type was not gzip, but the mime type selected was gzip.
BigQuery

The APPENDS change history TVF is now in preview. This table-valued function provides a history of table appends over a window of time.

Chronicle

The following supported default parsers have changed (listed by product name and ingestion label):

  • Azure DevOps Audit (AZURE_DEVOPS)
  • Bitdefender (BITDEFENDER)
  • CA Access Control (CA_ACCESS_CONTROL)
  • Carbon Black App Control (CB_APP_CONTROL)
  • Check Point (CHECKPOINT_FIREWALL)
  • Cisco Firepower NGFW (CISCO_FIREPOWER_FIREWALL)
  • Cisco Router (CISCO_ROUTER)
  • Cloud Passage (CLOUD_PASSAGE)
  • Digital Guardian (DIGITALGUARDIAN_EDR)
  • ExtraHop RevealX (EXTRAHOP)
  • Forcepoint NGFW (FORCEPOINT_FIREWALL)
  • IBM DataPower Gateway (IBM_DATAPOWER)
  • IBM Guardium (GUARDIUM)
  • Imperva (IMPERVA_WAF)
  • Microsoft Azure Resource (AZURE_RESOURCE_LOGS)
  • Microsoft SQL Server (MICROSOFT_SQL)
  • Office 365 (OFFICE_365)
  • pfSense (PFSENSE)
  • Proofpoint On Demand (PROOFPOINT_ON_DEMAND)
  • Proofpoint Tap Alerts (PROOFPOINT_MAIL)
  • SonicWall (SONIC_FIREWALL)
  • Sophos UTM (SOPHOS_UTM)
  • VMware AirWatch (AIRWATCH)
  • VMware ESXi (VMWARE_ESX)
  • Workspace Activities (WORKSPACE_ACTIVITY)

For details about changes in each parser, see Supported default parsers.

The following new fields are available in the Unified Data Model:

  • The new fields prevalence, first_seen_time, and last_seen_time were added to the File object.
  • A new field, bounce_address, was added to the Email object.
  • A new field, artifact, was added to the Noun object. Artifact is a new object.
  • A new field, rolling_max_sub_domains, was added to the Prevalence object.
  • A new field, first_seen_time, was added to the User object.
  • The following new fields were added to the Smtp object:
    • helo
    • mail_from
    • rcpt_to
    • server_response
    • message_path
    • is_webmail
    • is_tls

For a list of all fields in the Unified Data Model, and their descriptions, see the Unified Data Model field list

Cloud Data Loss Prevention

InfoType categories were added to built-in infoTypes.

To get a list of built-in infoTypes, call the infoTypes.list method.

Cloud Functions

Cloud Functions (1st gen) now supports Google-managed Artifact Registry at the General Availability release level.

Cloud Functions now supports the following runtimes at the General Availability release level:

Deep Learning Containers

M94 Release

  • Added support for PyTorch 1.12.
  • Added more system libraries to the R Deep Learning Containers image.
Deep Learning VM Images

M94 Release

  • Added support for PyTorch 1.12.
  • Added more system libraries to the R Deep Learning VM image.
Dialogflow

Dialogflow CX now provides new client libraries for C++, C#, and Go.

Dialogflow ES now provides a new client library for C++.

Google Kubernetes Engine

The blue-green upgrade mechanism is now available to upgrade your GKE node pools, and can be selected per node pool instead of the default surge upgrade mechanism.

Vertex AI

Tabular Workflows is available in Preview. For documentation, refer to Tabular Workflows on Vertex AI.

End-to-End AutoML workflow is available in Public Preview. For documentation, refer to End-to-End AutoML.

July 05, 2022

Migrate to Virtual Machines

Connector renaming

Includes the following updates:

  • Renamed CLI command from m4c to m2vm
  • Renamed product to Migrate to Virtual Machines
  • Bug fixes

July 04, 2022

Secret Manager

A weekly digest of client library updates from across the Cloud SDK.

Java

Changes for google-cloud-secretmanager

2.3.0 (2022-07-01)

Features
  • Enable REST transport for most of Java and Go clients (#790) (d51c8fa)
Documentation
  • sample: clean up README for native image sample (#785) (67260d7)
Dependencies
  • update dependency com.google.cloud:google-cloud-shared-dependencies to v2.13.0 (#789) (71aae1d)
  • update dependency com.google.protobuf:protobuf-java-util to v3.21.0 (#779) (d38f1db)
  • update dependency com.google.protobuf:protobuf-java-util to v3.21.1 (#780) (6c613da)
  • update dependency com.google.protobuf:protobuf-java-util to v3.21.2 (#791) (d7d4ea9)
  • update dependency org.graalvm.buildtools:junit-platform-native to v0.9.12 (#787) (a2e0e97)
  • update dependency org.graalvm.buildtools:native-maven-plugin to v0.9.12 (#788) (8662fe6)

July 02, 2022

Artifact Registry

Artifact Registry is now available in the us-south1 region (Dallas, United States).

July 01, 2022

Apigee UI

On July 1, 2022, we released an updated version of the Apigee UI.

This release contains a new version of the Debug tab in the Apigee Proxy Editor. Following previous releases of new versions of the Overview and Develop tabs, this completes the initial release of the new Proxy Editor.

To view the new Debug tab, see Using Debug.

App Engine standard environment Java App Engine standard environment PHP App Engine standard environment Python BigQuery

An updated version of JDBC driver for BigQuery is now available. This version includes a fix for an issue with connector returning stack overflow in some cases when executing complex long queries.

Cloud Asset Inventory

The following resource types are now publicly available through the Export APIs (ExportAssets and BatchGetAssetsHistory) , Feed API, and Search APIs (SearchAllResources and SearchAllIamPolicies):

  • Google Kubernetes Engine (GKE)

    • batch.k8s.io/Job
    • apps.k8s.io/ReplicaSet
  • Compute

    • compute.googleapis.com/ServiceAttachment
Cloud Functions

Cloud Functions now supports PHP 8.1 at the General Availability release level.

Dataproc

New sub-minor versions of Dataproc images:

1.5.71-debian10, 1.5.71-rocky8, 1.5.71-ubuntu18

2.0.45-debian10, 2.0.45-rocky8, 2.0.45-ubuntu18

For 1.5 images and the 2.0.45-ubuntu18 image, backported the upstream fix for KNOX-1997.

Kf

Removed kf migrate command.

Changed go version to 1.17.

Policy Intelligence

Lateral movement insights, which identify roles that allow a service account in one project to impersonate a service account in another project, are now generally available.

Workflows

To reduce naming conflicts and improve memory usage, local scoping now applies to any variable created inside an except block.

If you are assigning a variable inside an except block and want to access the variable outside of the block, assign the variable before the block to place it in the surrounding scope.