Google Cloud release notes

The following release notes cover the most recent changes over the last 60 days. For a comprehensive list of product-specific release notes, see the individual product release note pages.

You can also see and filter all release notes in the Google Cloud console or you can programmatically access release notes in BigQuery.

To get the latest product updates delivered to you, add the URL of this page to your feed reader, or add the feed URL directly: https://cloud.google.com/feeds/gcp-release-notes.xml

October 18, 2023

Batch

Documentation has been added to explain how to securely reference sensitive data in a job by using Secret Manager secrets for encryption. For example, use secrets to protect sensitive data when defining custom environment variables or protect login credentials when accessing private container images from Docker Registry.

For more information, see Protect sensitive data using Secret Manager with Batch.

BigQuery

The BigQuery migration assessment is now available for Apache Hive in preview. You can use this feature to assess the complexity of migrating data from your Apache Hive data warehouse to BigQuery.

Chronicle

The following supported default parsers have changed. Each is listed by product name and log_type value, if applicable.

  • Azure AD Directory Audit (AZURE_AD_AUDIT)
  • Check Point (CHECKPOINT_FIREWALL)
  • Chronicle SOAR Audit (CHRONICLE_SOAR_AUDIT)
  • Cisco Internetwork Operating System (CISCO_IOS)
  • Cisco Meraki (CISCO_MERAKI)
  • Cisco Web Services Manager (CISCO_WSM)
  • Cloud Audit Logs (N/A)
  • Cloudflare (CLOUDFLARE)
  • CrowdStrike Falcon (CS_EDR)
  • ESET Threat Intelligence (ESET_IOC)
  • GitHub (GITHUB)
  • Gitlab (GITLAB)
  • Infoblox DNS (INFOBLOX_DNS)
  • JumpCloud Directory Insights (JUMPCLOUD_DIRECTORY_INSIGHTS)
  • Kolide Endpoint Security (KOLIDE)
  • McAfee ePolicy Orchestrator (MCAFEE_EPO)
  • Microsoft Azure Activity (AZURE_ACTIVITY)
  • Microsoft Azure Resource (AZURE_RESOURCE_LOGS)
  • Microsoft Defender for Endpoint (MICROSOFT_DEFENDER_ENDPOINT)
  • Microsoft SQL Server (MICROSOFT_SQL)
  • Netskope Web Proxy (NETSKOPE_WEBPROXY)
  • OpenSSH (OPENSSH)
  • Palo Alto Cortex XDR Alerts (CORTEX_XDR)
  • Silverfort Authentication Platform (SILVERFORT)
  • Vectra Stream (VECTRA_STREAM)
  • VMware ESXi (VMWARE_ESX)
  • VMware NSX (VMWARE_NSX)
  • Windows Applocker (WINDOWS_APPLOCKER)
  • Windows Defender ATP (WINDOWS_DEFENDER_ATP)
  • Windows DNS (WINDOWS_DNS)
  • Windows Event (WINEVTLOG)
  • Windows Event (XML) (WINEVTLOG_XML)
  • Windows Hyper-V (WINDOWS_HYPERV)
  • Workspace ChromeOS Devices (WORKSPACE_CHROMEOS)
  • Zscaler (ZSCALER_WEBPROXY)
  • ZScaler DNS (ZSCALER_DNS)

The following log types, without a default parser, were added. Each is listed by product name and log_type value, if applicable.

  • ADVA Fiber Service Platform (ADVA_FSP)
  • Bluecat Address Manager (BLUECAT_AM)
  • Fortinet Switch (FORTINET_SWITCH)
  • GCP Google Kubernetes Engine Context (GCP_KUBERNETES_CONTEXT)
  • Kion (KION)
  • Kiteworks (KITEWORKS)
  • Nokia Router (NOKIA_ROUTER)
  • Ntopng (NTOPNG)
  • Opnsense (OPNSENSE)
  • Oracle HCM Human resources platform solution (ORACLE_HCM)
  • MS Powershell Transcript (POWERSHELL_TRANSCRIPT)
  • RAD ETX (RAD_ETX)
  • Spamhaus (SPAMHAUS)
  • UpGuard (UPGUARD)
  • Vsftpd (VSFTPD)

For a list of supported log types and details about default parser changes, see Supported log types and default parsers.

Cloud Data Fusion

The Cloud Data Fusion SAP SLT No RFC Replication plugin version 0.11.0 is available in the Hub in Cloud Data Fusion enterprise edition versions 6.8.0 and later. It differs from the existing SAP SLT Replication plugin in the following ways:

  • All data and metadata file formats are in JSON.
  • No SAP RFC inbound calls occur in the SAP SLT No RFC Replication plugin. Accessing schemas and data from the SAP system no longer requires an SAP connection. Metadata and data extraction are sourced from the Cloud Storage bucket.
Cloud Tasks

Support for Customer Managed Encryption Keys (CMEK) is now available for Cloud Tasks. To learn more, see the documentation on using CMEK with Cloud Tasks.

Firestore

For documents with many fields that don't require indexing, you can now add collection-level index exemptions on all fields in a collection group. To learn more, see Add a collection-level exemption. This feature is generally available (GA).

SAP on Google Cloud

New SAP NetWeaver certification: C3D series of general-purpose machine types

For use with SAP NetWeaver, SAP has certified the Compute Engine general-purpose machine types c3d-standard and c3d-highmem.

For more information, see Certified C3D machine types for SAP NetWeaver.

Security Command Center

Container Threat Detection, a built-in service of Security Command Center Premium, has launched a new detector, Unexpected Child Shell, in Preview.

The detector monitors all process executions and generates a finding if a process that does not normally invoke shells spawns a shell process.

For more information, see Container Threat Detection detectors.

October 17, 2023

Anthos Service Mesh

Managed Anthos Service Mesh 1.17 is rolling out in the rapid channel.

Additionally, the rollout of managed Anthos Service Mesh version 1.16 to the regular channel has completed.

See Select a managed Anthos Service Mesh release channel for more information.

Apigee hybrid

hybrid v1.10.3-hotfix.3

On October 17, 2023 we released an updated version of the Apigee hybrid software, v1.10.3-hotfix.3.

Bug ID Description
303292806 Restrict connections from the Cassandra backup utility to Cassandra server pods in the apigee namespace.
300542690 Added dedicated service accounts for Apigee Connect, Redis, and UDCA to prevent Kubernetes from automatically injecting credentials for a specified ServiceAccount or the default ServiceAccount.

To use this service account, set the automountServiceAccountToken field in your Pod specification to false.

Cloud Load Balancing

Service Extensions callouts are available for Google Cloud Application Load Balancers, excluding Classic.

By using this feature, you can direct your load balancers to make gRPC calls to user-managed or partner-hosted applications from within the Cloud Load Balancing data processing path. These applications can then apply various policies or functions, such as header or payload manipulation, security screening, or custom logging on the traffic before returning the traffic to the load balancer for further processing.

For details, see the following topics in the Service Extensions documentation:

Service Extensions is in Preview.

Cloud Monitoring

You can now view error groups on your custom dashboards. This feature is GA. For information when using the Cloud Console, see Display logs and errors on a custom dashboard. For information about using the API, see Dashboard with an ErrorReportingPanel widget.

Cloud SQL for MySQL

Cloud SQL supports InnoDB page compression for MySQL 5.7 and MySQL 8.0 and later.

Cloud SQL for SQL Server

You can now import transaction log backups. This can help you reduce downtime when migrating to Cloud SQL using backups.

Cloud Spanner

Query Optimizer version 6 is generally available, and is the default optimizer version.

Compute Engine

Generally available: c3d-standard, c3d-highmem, c3d-highcpu, and c3d-standard-lssd machine types for general-purpose C3D VMs are generally available.

Dataform

ssh_authentication_config and service_account fields are available in the google_dataform_repository Dataform Terraform resource.

Error Reporting

You can now view error groups on your custom dashboards. This feature is GA. For information when using the Cloud Console, see Display logs and errors on a custom dashboard. For information about using the API, see Dashboard with an ErrorReportingPanel widget.

Firestore Service Extensions

Service Extensions callouts are available for Google Cloud Application Load Balancers, excluding Classic.

With the introduction of this feature, users instruct load balancers to forward traffic from within the Cloud Load Balancing data processing path through gRPC to user-managed or partner-hosted applications. These applications can apply various policies or functions, such as header or payload manipulation, security screening, or custom logging on the traffic before returning the traffic to the load balancer for further processing.

For details, see Cloud Load Balancing extensions overview.

Service Health

Personalized Service Health supports AlloyDB for PostgreSQL and Resource Manager API.

Vertex AI

New Vertex AI Vector Search Console

Vector Search has launched a console experience in Google Cloud for creating and deploying indexes, now available in Preview. From the console, you can create indexes, and create public or VPC endpoints for your indexes, and deploy. For more information, see Manage indexes.

Vertex AI Vector Search Improvements

Vector Search has improved the initial index creation process for smaller indexes (<100MB), reducing time to build from about 1 hour to about 5 mins. To get started, see Vector Search quickstart to create an index.

October 16, 2023

App Engine flexible environment Python

Python 3.12 is now available in preview.

App Engine standard environment Python

Python 3.12 is now available in preview.

BigQuery

A weekly digest of client library updates from across the Cloud SDK.

Java

Changes for google-cloud-bigquery

2.33.2 (2023-10-11)

Bug Fixes
Dependencies
  • Update dependency com.google.api.grpc:proto-google-cloud-bigqueryconnection-v1 to v2.29.0 (#2911) (052f5c2)
  • Update dependency com.google.apis:google-api-services-bigquery to v2-rev20230925-2.0.0 (#2921) (f0fb64f)
  • Update dependency com.google.cloud:google-cloud-datacatalog-bom to v1.33.0 (#2912) (e053494)
  • Update dependency com.google.cloud:google-cloud-shared-dependencies to v3.17.0 (#2931) (25a94f1)
  • Update github/codeql-action action to v2.22.0 (#2926) (33ce4ae)
  • Update github/codeql-action action to v2.22.1 (#2934) (7ae7b99)
  • Update ossf/scorecard-action action to v2.3.0 (#2927) (93bfd8e)

You can now use DLP functions to support encryption and decryption between BigQuery and DLP, using AES-SIV. This feature is in preview.

Chronicle

The following changes are available in the Unified Data Model.

  • New enum fields were added: SecurityResult.IoCStatsType and SecurityResult.VerdictType.
  • A new field was added to EntityMetadata: feed.
  • A new field was added to Network: ip_subnet_range.
  • New fields were added to SecurityResult: last_updated_time and verdict_info.
  • A new field was added to Label: rbac_enabled.
  • A new field was added to SecurityResult.Association: region_code.
  • New fields were added to User: last_login_time, last_password_change_time, password_expiration_time, account_expiration_time, account_lockout_time, and last_bad_password_attempt_time.
  • A new value was added to the Network.ApplicationProtocol enum: GRPC.
  • The following new values were added to the Resource.ResourceType enum:

    • POD
    • CONTAINER
    • FUNCTION
    • RUNTIME
    • IP_ADDRESS
    • DISK
    • VOLUME
    • IMAGE
    • SNAPSHOT
    • REPOSITORY
    • CREDENTIAL
    • LOAD_BALANCER
    • GATEWAY
    • SUBNET

For a list of all fields in the Unified Data Model, and their descriptions, see the Unified Data Model field list.

Cloud Bigtable

A weekly digest of client library updates from across the Cloud SDK.

Java

Changes for google-cloud-bigtable

2.28.0 (2023-10-12)

Features
  • Add support for Cloud Bigtable Request Priorities in App Profiles (#1954) (8822571)
  • Add test profile to push metrics to test environment (#1921) (2104315)
Dependencies
Cloud Composer

Cloud Composer 2.4.6 release started on October 17, 2023. Get ready for upcoming changes and features as we roll out the new release to all regions. This release is in progress at the moment. Listed changes and features might not be available in some regions yet.

Airflow 2.6.3 is available in Cloud Composer images.

Airflow 2.6.3 consolidates the logic for handling tasks that are stuck in the queued state:

  • The [kubernetes]worker_pods_pending_timeout, [celery]stalled_task_timeout, and [celery]task_adoption_timeout Airflow configuration options are deprecated and merged into the [scheduler]task_queued_timeout option.
  • In Cloud Composer, the default value of the [scheduler]task_queued_timeout option is set to 40 minutes.
  • If your environment uses a custom value for any of the deprecated Airflow configuration options, please clear the overrides before upgrading. If the values are not cleared, the longest timeout of all deprecated options is selected upon upgrading.
  • If required, you can override the value of the [scheduler]task_queued_timeout option in your environment.
  • For more information about other changes between Airflow versions 2.5.3 and 2.6.3, see Airflow release notes.

Cloud Composer 2.4.6 images are available:

  • composer-2.4.6-airflow-2.6.3
  • composer-2.4.6-airflow-2.5.3 (default)
  • composer-2.4.6-airflow-2.4.3
Cloud Functions

Cloud Functions now supports the Python 3.12 runtime at the Preview release level.

Cloud Logging

You can now create log buckets in the us-west8 region. For a complete list of supported regions, see Supported regions.

A weekly digest of client library updates from across the Cloud SDK.

Java

Changes for google-cloud-logging

3.15.11 (2023-10-10)

Dependencies
  • Update dependency com.google.cloud:google-cloud-shared-dependencies to v3.17.0 (#1444) (748e8a2)
Cloud Storage

Changes to the Autoclass feature that were announced on July 17, 2023 begin taking effect today.

Container Optimized OS

cos-105-17412-226-10

Kernel Docker Containerd GPU Drivers
COS-5.15.133 v23.0.3 v1.7.6 v470.199.02(default),v535.104.05(latest)

Updated app-containers/containerd to v1.7.6.

Synced TCPX changes to commit 90ce0a6aa201.

Updated cos-gpu-installer to v2.1.9.

Upgraded net-misc/curl to v8.4.0. This resolves CVE-2023-38545.

Fixed CVE-2023-38039 in net-misc/curl.

Fixed CVE-2023-4244 in the Linux kernel.

Fixed CVE-2023-5197 in the Linux kernel.

Fixed CVE-2023-42756 in COS kernel.

Fixed CVE-2023-42753 in the Linux kernel.

cos-101-17162-336-7

Kernel Docker Containerd GPU Drivers
COS-5.15.133 v20.10.24 v1.6.21 v470.199.02(default),v535.104.05(latest)

Fixed CVE-2022-48560 in dev-lang/python package.

Upgraded net-misc/curl to v8.4.0. This resolves CVE-2023-38545.

Fixed CVE-2023-38039 in net-misc/curl.

Fixed CVE-2023-5197 in the Linux kernel.

Fixed CVE-2023-42756 in COS kernel.

Fixed CVE-2023-42753 in the Linux Kernel.

Runtime sysctl changes:

  • Changed: fs.file-max: 813043 -> 813032
  • Changed: kernel.threads-max: 63551 -> 63552
  • Changed: net.netfilter.nf_conntrack_sctp_timeout_shutdown_recd: 0 -> 3
  • Changed: net.netfilter.nf_conntrack_sctp_timeout_shutdown_sent: 0 -> 3
  • Changed: user.max_cgroup_namespaces: 31775 -> 31776
  • Changed: user.max_ipc_namespaces: 31775 -> 31776
  • Changed: user.max_mnt_namespaces: 31775 -> 31776
  • Changed: user.max_net_namespaces: 31775 -> 31776
  • Changed: user.max_pid_namespaces: 31775 -> 31776
  • Changed: user.max_time_namespaces: 31775 -> 31776
  • Changed: user.max_user_namespaces: 31775 -> 31776
  • Changed: user.max_uts_namespaces: 31775 -> 31776

cos-97-16919-353-53

Kernel Docker Containerd GPU Drivers
COS-5.10.186 v20.10.24 v1.6.21 v470.199.02(default),v535.104.05(latest)

Updated cos-gpu-installer to v2.1.9.

Fixed CVE-2023-38039 in net-misc/curl.

Fixed CVE-2023-42753 in the Linux Kernel.

cos-93-16623-461-40

Kernel Docker Containerd GPU Drivers
COS-5.10.177 v20.10.24 v1.6.20 v450.248.02(default),v535.104.05(latest),v470.199.02(R470 for compatibility with K80 GPUs)

Upgraded net-misc/curl to v8.4.0. This resolves CVE-2023-38545.

Dataflow

A weekly digest of client library updates from across the Cloud SDK.

Go

Changes for dataflow/apiv1beta3

0.9.2 (2023-10-12)

Bug Fixes
  • dataflow: Update golang.org/x/net to v0.17.0 (174da47)
Dataproc Metastore

Dataproc Metastore now supports multi-regional configurations.

Filestore Firestore in Datastore mode

A weekly digest of client library updates from across the Cloud SDK.

Java

Changes for google-cloud-datastore

2.17.3 (2023-10-10)

Dependencies
  • Update dependency com.google.cloud:google-cloud-shared-dependencies to v3.17.0 (#1206) (2ad068b)
Google Kubernetes Engine

Filestore Enterprise now supports backups on GKE, allowing you to make reliable copies of your data to be stored for later use. To trigger backups on Filestore Enterprise, use Kubernetes volume snapshots. Backups are currently not supported for Filestore Enterprise instances with multishares enabled.

Pub/Sub

A weekly digest of client library updates from across the Cloud SDK.

Java

Changes for google-cloud-pubsub

1.125.6 (2023-10-10)

Dependencies
  • Update dependency com.google.cloud:google-cloud-bigquery to v2.33.1 (#1756) (239f474)
  • Update dependency com.google.cloud:google-cloud-core to v2.25.0 (#1764) (72404ea)
  • Update dependency com.google.cloud:google-cloud-shared-dependencies to v3.17.0 (#1765) (a447292)
  • Update dependency com.google.protobuf:protobuf-java-util to v3.24.4 (#1760) (10a64c6)

Public preview: Pub/Sub BigQuery subscriptions now support BigQuery change data capture.

Secret Manager

A weekly digest of client library updates from across the Cloud SDK.

Go

Changes for secretmanager/apiv1

1.11.2 (2023-10-12)

Bug Fixes
  • secretmanager: Update golang.org/x/net to v0.17.0 (174da47)
Text-to-Speech

The Long Audio Synthesis API now supports the following languages: English, Spanish, French, German, Japanese, Hindi, Italian, Korean, Portuguese, Thai, Vietnamese, Danish, Filipino.

There is no longer billing differentiation for Cloud Text-to-Speech Offline Custom Voice API calls. See the <ReportedUsage> documentation for more details.

October 13, 2023

Apigee X

On October 13, 2023, we released an updated version of Apigee (1-11-0-apigee-6).

Bug ID Description
304681330 Security fix for apigee-ingress.
This addresses the following vulnerability:
CVE-2023-44487
305127632 Security bulletin published.
GCP-2023-032

Description

A Denial-of-Service (DoS) vulnerability was recently discovered in multiple implementations of the HTTP/2 protocol (CVE-2023-44487), including the Apigee Ingress (Anthos Service Mesh) server used by Apigee X. The vulnerability could lead to a DoS of Apigee API management functionality.

Affected Products

Deployments of Apigee X that are accessible through a Google Cloud Network Load Balancer (Layer 4), or a custom layer 4 load balancer, are affected. A hotfix is being applied to all Apigee X instances. Your Apigee X instances will be automatically updated within the next few days.

Unaffected products

Apigee X instances which are accessed only via Google Cloud Application Load Balancers (Layer 7) are not affected. This includes deployments that have HTTP/2 enabled for gRPC proxies.

What Should I Do?

All Apigee X instances will be automatically updated within the next few days. Customers do not need to take any actions.

What Vulnerabilities Are Addressed By These Patches?

The vulnerability, CVE-2023-44487, allows an attacker to execute a denial-of-service attack on Apigee ingresses.

Apigee hybrid

hybrid v1.10.3-hotfix.2

On October 13, 2023 we released an updated version of the Apigee hybrid software, v1.10.3-hotfix.2.

Bug ID Description
304681330 Security fix for apigee-ingress.
This addresses the following vulnerability:
CVE-2023-44487
305127632 Security bulletin published.
GCP-2023-032

hybrid v1.9.4-hotfix.1

On October 13, 2023 we released an updated version of the Apigee hybrid software, v1.9.4-hotfix.1.

Bug ID Description
304681330 Security fix for apigee-ingress.
This addresses the following vulnerability:
CVE-2023-44487
305127632 Security bulletin published.
GCP-2023-032

Description

A Denial-of-Service (DoS) vulnerability was recently discovered in multiple implementations of the HTTP/2 protocol (CVE-2023-44487), including the Apigee Ingress (Anthos Service Mesh) server used by Apigee hybrid. The vulnerability could lead to a DoS of Apigee API management functionality.

Affected Products

Apigee hybrid instances that allow HTTP/2 requests to reach the Apigee Ingress are affected. Customers should verify if the load balancers fronting their Apigee hybrid ingresses allow for HTTP/2 requests to reach the Apigee Ingress service.

What Should I Do?

Apigee hybrid customers will need to upgrade to one of the following patch versions:

What Vulnerabilities Are Addressed By These Patches?

The vulnerability, CVE-2023-44487, allows an attacker to execute a denial-of-service attack on Apigee ingresses.

Compute Engine

Generally available: C3 VMs support Compute Engine flexible committed use discounts (CUDs).

Compute Engine flexible CUDs allow you to commit to a minimum hourly spend amount and use vCPUs and/or memory in any of the projects within your Cloud Billing account, across any region, and belonging to any eligible machine types. Learn more about Compute Engine Flexible CUDs and how to purchase flexible commitments.

If you want to modify a future reservation request using the Compute Engine API, the paths query parameter is deprecated. Instead, use the updateMask query parameter.

For more information, see Modify future reservation requests.

Dataform

Formatting of Dataform core and JavaScript code is available.

Dataproc Google Kubernetes Engine

(2023-R20) Version updates

GKE cluster versions have been updated.

New versions available for upgrades and new clusters

The following Kubernetes versions are now available for new clusters and for opt-in control plane upgrades and node upgrades for existing clusters. For more information on versioning and upgrades, see GKE versioning and support and Upgrades.

No channel

Stable channel

  • There are no new releases in the Stable release channel.

Regular channel

  • There are no new releases in the Regular release channel.

Rapid channel

Containers running in nodes in GKE version 1.28.1-gke.201 or later don't need to have privileged mode enabled to access TPUs. When upgrading a cluster to 1.28.1-gke.201 or later, we recommend removing privileged: true from the securityContext of any TPU workload. To learn more, see Deploy TPU workloads.

Starting in GKE 1.28.1-gke.1066000, two new TPU usage metrics are available: TensorCore utilization and Memory Bandwidth utilization.

(2023-R20) Version updates

(2023-R20) Version updates

Vertex AI Search and Conversation

Vertex AI Search: Customer-managed encryption key integration for the EU

Customer-managed encryption keys (CMEK) is available in the EU as an allowlisted preview feature.

If you store your data in an EU multi-region data store, you can provide your own encryption key to protect your data at rest.

For information, see Customer-managed encryption keys.

October 12, 2023

Access Approval

Access Approval supports Access Context Manager in the GA stage.

Access Transparency

Access Transparency supports Access Context Manager in the GA stage.

Anthos clusters on VMware

Anthos clusters on VMware 1.15.5-gke.41 is now available. To upgrade, see Upgrading Anthos clusters on VMware. Anthos clusters on VMware 1.15.5-gke.41 runs on Kubernetes 1.26.7-gke.2500.

The following issues are fixed in 1.15.5-gke.41:

  • Fixed the issue that server-side preflight checks fail to validate container registry access on clusters with a private network and no private registry.
  • Fixed the known issue where a non-HA Controlplane V2 cluster is stuck at node deletion until it timesout.
  • Fixed the known issue where upgrading or updating an admin cluster with a CA version greater than 1 fails.
  • Fixed the issue where the Controlplane V1 stackdriver operator has --is-kubeception-less=true specified by mistake.
  • Fixed the known issue that causes the secrets encryption key to be regenerated when upgrading the admin cluster from 1.14 to 1.15, resulting in the upgrade being blocked.

The following vulnerabilities are fixed in 1.15.5-gke.41:

BigQuery

The following geography functions are now generally available (GA):

  • ST_LINESUBSTRING: Gets a segment of a single linestring at a specific starting and ending fraction.
  • ST_HAUSDORFFDISTANCE: Gets the discrete Hausdorff distance between two geometries.
Cloud Asset Inventory

New searchable fields are now available.

The following searchable fields are now publicly available through the resource search API (SearchAllResources).

  • effectiveTagKeys
  • effectiveTagValues
  • effectiveTagValueIds

The following search result fields are now publicly available through the resource search API (SearchAllResources).

  • tags
  • effectiveTags
Cloud Logging

You can now configure the format of the timestamp in your query results in the Logs Explorer. For more information, see Logs Explorer overview: Configure the Time column.

Cloud Storage

The Node.js and Python client libraries now have parallelized upload and download options, improving their performance.

Compute Engine

Preview: The following metrics are now available to help you monitor your Persistent Disk and Hyperdisk volume performance:

  • Average I/O latency (compute.googleapis.com/instance/disk/average_io_latency)

  • Average I/O queue depth (compute.googleapis.com/instance/disk/average_io_queue_depth)

To learn more about these metrics and how to view them, see Review disk metrics.

Dialogflow

Dialogflow CX generative feedback now supports more languages.

Dialogflow CX launched generative playbooks with restricted access.

Dialogflow CX spelling correction now supports all regions, but is limited to five languages.

SAP on Google Cloud

Cloud Storage Backint agent for SAP HANA version 1.0.30

Version 1.0.30 of the Cloud Storage Backint agent for SAP HANA is available. This version reverts the google-cloud-storage client library to an earlier version so that API call retries work correctly.

For more information about the agent, see Cloud Storage Backint agent for SAP HANA overview.

Storage Transfer Service

You can now transfer data from Amazon S3 via your CloudFront domain. Learn more.

October 11, 2023

AlloyDB for PostgreSQL

AlloyDB Omni is now generally available (GA).

In AlloyDB Omni version 15.2.1 and earlier, after a failover, when you promote a standby instance, incremental backups from the newly promoted instance might conflict with the existing backup files, and the backups might fail.

As a workaround, move the conflicting files into a separate directory.

Cloud Build

Users can now set an IP range size and starting IP address for private connections in Bitbucket Data Center using the peeredNetworkIpRange. This feature is generally available. To learn more, see Build repositories in Bitbucket Data Center in a private network.

Cloud Functions

Cloud Functions (2nd gen) now supports Shared VPC ingress at the General Availability release level. Shared VPC traffic is now considered "internal" for functions that are connected to the Shared VPC network.

Cloud Run

Shared VPC ingress is now at general availability (GA). Shared VPC traffic is now considered "internal" for Cloud Run services that are connected to the Shared VPC network.

Cloud Spanner

Cloud Spanner has made improvements that provide higher throughput for instances located in select Spanner regional and multi-region instance configurations. These improvements are available without additional cost or any configuration changes. For more information, see Performance improvements.

Colab Enterprise

Colab Enterprise is now generally available (GA). Colab Enterprise combines the popular collaborative features of Colaboratory with the security and compliance capabilities of Google Cloud. Colab Enterprise includes:

  • Sharing and collaborating functionality, with IAM access control.
  • Google-managed compute and runtime provisioning, with configurable runtime templates.
  • Integrations with Vertex AI and BigQuery.
  • Inline code completion with Duet AI (Preview) assistance.
  • End-user credential authentication for running your notebook code.
  • Idle shutdown for runtimes (Experimental).

To get started, see Introduction to Colab Enterprise or create a notebook and start coding.

Compute Engine

Generally available: You can configure stateful IP addresses in a managed instance group. Stateful IP addresses are preserved when VM instances in the group are repaired, updated, and re-created. For more information, see Configuring stateful IP addresses in MIGs.

Container Optimized OS

cos-dev-113-17965-0-0

Kernel Docker Containerd GPU Drivers
COS-6.1.55 v24.0.5 v1.7.6 v535.104.05(default, latest),v470.199.02(R470 for compatibility with K80 GPUs)

Upgraded app-containers/containerd to v1.7.6.

Upgraded cos-gpu-installer to v2.1.9.

Upgraded dev-util/gn to v2121.

Upgraded chromeos-base/google-breakpad to v2023.06.01.191934-r222.

Upgraded chromeos-base/debugd-client to v0.0.1-r2559.

Upgraded chromeos-base/shill-client to v0.0.1-r4030.

Upgraded chromeos-base/chromeos-common-script to v0.0.1-r561.

Upgraded chromeos-base/session_manager-client to v0.0.1-r2649.

Fixed CVE-2023-4911 in sys-libs/glibc.

Fixed CVE-2023-38039 in net-misc/curl.

Fixed CVE-2023-42756 in COS kernel.

Fixed CVE-2023-5345 in COS kernel.

Fixed CVE-2023-5197 in the Linux kernel.

cos-93-16623-461-39

Kernel Docker Containerd GPU Drivers
COS-5.10.177 v20.10.24 v1.6.20 v450.248.02(default),v535.104.05(latest),v470.199.02(R470 for compatibility with K80 GPUs)

Upgraded cos-gpu-installer to v2.1.9.

Fixed CVE-2023-38039 in net-misc/curl.

Fixed CVE-2023-42753 in the Linux Kernel.

cos-97-16919-353-53

Kernel Docker Containerd GPU Drivers
COS-5.10.186 v20.10.24 v1.6.21 v470.199.02(default),v535.104.05(latest)

Upgraded cos-gpu-installer to v2.1.9.

Fixed CVE-2023-38039 in net-misc/curl.

Fixed CVE-2023-42753 in the Linux Kernel.

cos-105-17412-156-69

Kernel Docker Containerd GPU Drivers
COS-5.15.120 v23.0.3 v1.7.2 v470.199.02(default),v535.104.05(latest)

Upgraded cos-gpu-installer to v2.1.9.

Fixed CVE-2023-38039 in net-misc/curl.

Fixed CVE-2023-42753 in the Linux kernel.

cos-109-17800-0-51

Kernel Docker Containerd GPU Drivers
COS-6.1.42 v24.0.5 v1.7.2 v535.104.05(default, latest),v470.199.02(R470 for compatibility with K80 GPUs)

Fixed CVE-2023-38039 in net-misc/curl.

Fixed CVE-2023-5197 in the Linux kernel.

Looker

API 3.0 and API 3.1 have been removed in Looker 23.18.

Clustrix database support has been removed. Any existing connections to a Clustrix database will fail to run in Looker 23.18.

Performance improvements have been made to query preparation time by front-loading LookML model compilation during production deployments.

To prevent confusion with SSO authentication, the SSO embed feature has been renamed Signed embed.

The Get embed URL option from a dashboard, a Look, or an Explore can now generate a signed embed URL.

Embedded Looks now support themes, so the Get embed URL dialog now shows a theme selector for Looks.

The manage_project_connections_restricted permission lets users edit a subset of settings for new and existing connections.

The New Schedules Page Labs feature updates the interface of the Admin settings - Schedules page.

An issue with drilling for transposed tables has been fixed. Drilling for transposed tables now performs as expected.

The Box Shadow theme now performs as expected for static and tile LookML dashboards.

Fixed date field values were not being displayed correctly when referenced by Liquid in the label or html LookML parameter. This feature now performs as expected.

Unreferenced custom fields from drill URL have been removed.

Looker 23.18 includes the following changes, features, and fixes.

Expected Looker (original) deployment start: Monday, October 16, 2023

Expected Looker (original) final deployment and download available: Thursday, October 26, 2023

Expected Looker (Google Cloud core) deployment start: Monday, October 23, 2023

Expected Looker (Google Cloud core) final deployment: Friday, November 3, 2023

Public preview is now available for the Open SQL Interface. The Open SQL Interface allows access to Looker models and Explores for applications (such as Tableau) that use JDBC to connect to data sources. For Looker (original) instances, enable the SQL Interface Experimental Labs feature on the Looker instance. (Only Looker-hosted instances support this Labs feature.) For Looker (Google Cloud core) instances, fill out the Looker SQL Interface Pre-GA Agreement interest form. The Google team will enable your instance for the SQL Interface feature.

IAM permissions have been clarified and made more visible in the Looker (Google Cloud core) documentation.

The in-app support in the Help menu has been updated to integrate with the Google Cloud console. You will see in-app support only if you have purchased at least a Standard Support service with Google Cloud Customer care.

Migrate to Virtual Machines

Preview: Migrate to Virtual Machines now supports migrating VMs to the C3, H3, and M3 machine types. These machine types support non-volatile memory express (NVMe) and Google Virtual NIC (gVNIC). Before you migrate your VMs to any of these machine types, ensure that source VMs support NVMe and gVNIC. For more information on different machine types that support NVMe and gVNIC, go to the Machine series comparison section, click Choose VM properties to compare, and select Disk interface type and Network interfaces.

October 10, 2023

Anthos Service Mesh

1.18.4-asm.0 is now available for in-cluster Anthos Service Mesh.

This patch release contains the fix for the security vulnerability listed in GCP-2023-031 For details on upgrading Anthos Service Mesh, refer to Upgrade Anthos Service Mesh.

1.17.7-asm.0 is now available for in-cluster Anthos Service Mesh.

This patch release contains the fix for the security vulnerability listed in GCP-2023-031 For details on upgrading Anthos Service Mesh, refer to Upgrade Anthos Service Mesh.

1.16.7-asm.10 is now available for in-cluster Anthos Service Mesh.

This patch release contains the fix for the security vulnerability listed in GCP-2023-031 For details on upgrading Anthos Service Mesh, refer to Upgrade Anthos Service Mesh.

Apigee Integration

The following new data transformer functions are available:

  • Manifest XML - Converts the specified input JSON object into an XML string.

  • Parse XML - Parses the specified input XML string into a JSON object.

IAM Conditions for fine-grained access

IAM Conditions lets you define and enforce conditional, attribute-based access control for Google Cloud resources, including Application Integration resources. For more information, see Add IAM conditions.

You can now view the detailed summary of an integration from the Integration designer. For more information, see View integration details.

Application Integration

The following new data transformer functions are available:

  • Manifest XML - Converts the specified input JSON object into an XML string.

  • Parse XML - Parses the specified input XML string into a JSON object.

IAM Conditions for fine-grained access

IAM Conditions lets you define and enforce conditional, attribute-based access control for Google Cloud resources, including Application Integration resources. For more information, see Add IAM conditions.

You can now view the detailed summary of an integration from the Integration designer. For more information, see View integration details.

Support for user-defined service account

You can now configure a service account of your choice for an integration. The option to select a service account is displayed to you during the integration creation step.

Chronicle

While creating a custom parser, you can use the preview option to view the UDM output. In the preview, you can use the statedump filter plugin to validate the internal state of a parser. For more information, see Validate data using statedump plugin.

Cloud Asset Inventory

The following resource types are now publicly available through the analyze policy APIs (AnalyzeIamPolicy and AnalyzeIamPolicyLongrunning).

  • MachineImage for Compute Engine
    • compute.googleapis.com/MachineImage
Cloud Healthcare API

A release was made. Updates may include general performance improvements, bug fixes, and updates to the API reference documentation.

Cloud Interconnect Container Registry

Starting October 10, 2023, mirror.gcr.io is transitioning to being hosted on Artifact Registry. This change is taking place on a region by region basis, and doesn't require you to change your usage of mirror.gcr.io unless you are using it within a VPC service perimeter.

For information on how to use mirror.gcr.io in a VPC service perimeter after the transition to being hosted on Artifact Registry, see Using Artifact Registry with VPC Service Controls.

Deep Learning Containers

M112 release

  • Miscellaneous bug fixes and improvements.
Deep Learning VM Images

M112 release

  • CUDA 12.1 VM images are available with the following image names:
    • common-cu121-debian-11-py310
    • common-cu121-ubuntu-2004-py310
  • Miscellaneous bug fixes and improvements.
Document AI Warehouse

Deletion operation can't be successful when raw document is missing

Google Kubernetes Engine

A Denial-of-Service (DoS) vulnerability was recently discovered in multiple implementations of the HTTP/2 protocol (CVE-2023-44487), including the golang HTTP server used by Kubernetes. The vulnerability could lead to a DoS of the Google Kubernetes Engine (GKE) control plane. GKE clusters with authorized networks configured are protected by limiting network access, but all other clusters are affected. For more information, see the GCP-2023-030 security bulletin.

Migrate to Virtual Machines

Generally Available: Migrate to Virtual Machines from an Azure source lets you migrate VM instances running on Azure to Google Cloud Compute Engine.

Vertex AI Workbench

M112 release

The M112 release of Vertex AI Workbench user-managed notebooks includes the following:

  • Miscellaneous bug fixes and improvements.

October 09, 2023

Batch

Job limits have increased to 100,000 tasks per task group and 5,000 parallel tasks per job. Learn more about Quotas and limits.

BeyondCorp Enterprise

The BeyondCorp Enterprise Policy Remediator is in Preview. You can use the Policy Remediator to provide users with actionable steps that they can take to remediate access denied issues.

For more information, see Remediate denied access with the Policy Remediator.

BigQuery

A weekly digest of client library updates from across the Cloud SDK.

Go

Changes for bigquery/storage/apiv1beta1

1.56.0 (2023-10-05)

Features
  • bigquery/analyticshub: Add Subscription resource and RPCs (#8612) (9992249)
  • bigquery: Add external dataset reference (#8545) (1001acf)
  • bigquery: Add media options to LoadConfig (#8640) (62baf56)
Bug Fixes
  • bigquery/storage/managedwriter: Automatic retry for multiplex test (#8601) (6ef1945)
  • bigquery: Dependency detection on proto conversion (#8566) (763ab5d)
Documentation
  • bigquery/datatransfer: Update transferConfig.name description to indicate that it supports both formats (0449518)

Python

Changes for google-cloud-bigquery

3.12.0 (2023-10-02)

Features
  • Add Dataset.storage_billing_model setter, use client.update_dataset(ds, fields=["storage_billing_model"]) to update (#1643) (5deba50)
  • Search statistics (#1616) (b930e46)
  • Widen retry predicate to include ServiceUnavailable (#1641) (3e021a4)
Bug Fixes
  • Allow storage_billing_model to be explicitly set to None to use project default value (#1665) (514d3e1)
  • Relax timeout expectations (#1645) (1760e94)
  • Use isinstance() per E721, unpin flake8 (#1659) (54a7769)
Documentation

Queries now support additional ways to work with grouping sets, which include:

This feature is in preview.

Adding descriptions to the columns of a view is now generally available (GA). Use the CREATE VIEW or ALTER COLUMN DDL statements to add descriptions.

BigQuery is now available in the Dammam (me-central2) region.

BigQuery ML is now available in the Dammam (me-central2) region.

BigQuery Data Transfer Service is now available in the Dammam (me-central2) region.

Cloud Bigtable

A weekly digest of client library updates from across the Cloud SDK.

Java

Changes for google-cloud-bigtable

2.27.4 (2023-09-29)

Dependencies
  • Update dependency com.google.cloud:gapic-libraries-bom to v1.21.0 (#1942) (f8d533f)
  • Update dependency com.google.cloud:google-cloud-shared-dependencies to v3.16.1 (#1933) (159636a)
Cloud Logging

A weekly digest of client library updates from across the Cloud SDK.

Python

Changes for google-cloud-logging

3.8.0 (2023-10-03)

Features
  • Add cloud_run_job monitored resource type. (#788) (3b310d6)

When you install the Ops Agent on a Compute Engine VM by using the Cloud Monitoring VM Instances dashboard or the Observability tab on a Compute Engine VM details page, the agent is now installed with an Ops Agent OS policy. This installation method replaces the prior set of manual steps. For more information, see Installing the agent by using the Google Cloud console.

Cloud Monitoring

When you install the Ops Agent on a Compute Engine VM by using the Cloud Monitoring VM Instances dashboard or the Observability tab on a Compute Engine VM details page, the agent is now installed with an Ops Agent OS policy. This installation method replaces the prior set of manual steps. For more information, see Installing the agent by using the Google Cloud console.

Cloud SQL for SQL Server

The cross db ownership chaining flag is deprecated for all SQL Server versions.

For cross-database access, use the Microsoft tutorial for signing stored procedures with a certificate.

Cloud Spanner

Cloud Spanner batch write is now available in Preview. You can use Spanner batch write to commit multiple mutations non-atomically in a single request with low latency. For more information, see Modify data using batch write.

Cloud Spanner Vertex AI integration now supports Vertex AI Generative AI text embeddings and the text-bison model. For more information, see Get Vertex AI text embeddings.

Compute Engine

When you install the Ops Agent on a Compute Engine VM by using the Observability tab on a Compute Engine VM details page, the agent is now installed with an Ops Agent OS policy. This installation method replaces the prior set of manual steps. For more information, see Installing the agent by using the Google Cloud console.

Generally available: H3 VMs, designed for compute-intensive high performance computing (HPC) workloads, are now generally available. For more information, see H3 machine series.

Dataproc Firestore in Datastore mode

A weekly digest of client library updates from across the Cloud SDK.

Node.js

Changes for @google-cloud/datastore

8.2.1 (2023-10-03)

Bug Fixes
  • Make aggregation query requests run properly inside a transaction (#1166) (263804b)

8.2.0 (2023-10-02)

Features
  • Support for using multiple databases in datastore (#1090) (10ce563)
Bug Fixes
  • Allow users to set environment variable to connect to emulator running on docker (#1164) (a41741b)
  • Check property existence for exclude from indexes with wildcard (#1114) (e6b8ef7)
  • deps: Update dependency sinon to v16 (#1150) (0d8b715)

Go

Changes for datastore/admin/apiv1

1.15.0 (2023-10-06)

Features
  • datastore: Adding dynamic routing header (#8364) (d235a42)
Bug Fixes
Google Kubernetes Engine

If you are using a third generation machine series (for example, C3), GKE configures Local SSD volumes as the local ephemeral storage by default. You no longer need to specify the --ephemeral-storage-local-ssd flag when provisioning clusters or node pools. When you configure Local SSD volumes as raw block storage with the --local-nvme-ssd-block flag, specifying the count value is now optional.

Security Command Center

Cloud IDS threat detections available in Security Command Center

Threats that are detected by Cloud IDS, a Google Cloud intrusion detection service, are now included in the findings that are issued by the Event Threat Detection service of Security Command Center. This feature is available in Preview.

For more information, see:

Transfer Appliance

'ta mount' and 'ta unmount' are command line tools offering the user the ability to mount their own NFS or CIFS shares onto the appliance.

Learn more about how to mount to an appliance.

Vertex AI Search and Conversation

Vertex AI Search and Conversation: Renamed in the console and documentation

The Google Cloud console and the documentation at cloud.google.com have been updated to show the current product name for Vertex AI Search and Conversation. On the console, look for "Search and Conversation".

You might see the old name (Generative AI App Builder) in some places—for example, in the API reference.

October 06, 2023

Apigee Advanced API Security

On October 6, 2023, we released an updated version of Advanced API Security.

Public Preview of Advanced API Security Actions

Advanced API Security's new Security Actions feature lets you create security actions that define how Apigee handles detected traffic. You can create the following security actions:

  • Deny actions, which deny requests that meet specified conditions, for example, originating at an IP address that has been identified as a source of abuse.

  • Flag actions, which let requests pass through, but add headers to requests to identify them as suspicious.

  • Allow actions, which are used to override deny actions in specific cases when the request is trusted.

Backup and DR

Backup and DR Service 11.0.7.404 is now available to update your backup/recovery appliance. Refer to these instructions to update your appliance.

The new Backup and DR Service update policy requires updating all backup/recovery appliances older than version 11.0.3 to maintain product support and avoid restrictions on enabling backups for new entities. Learn more.

Added support to restore PostgreSQL database backup images to an alternate location. Learn more.

Backup and DR agent is enhanced to support Rocky Linux 8.7 operating system version. See support matrix.

Backup and DR agent now supports Rocky Linux 8.7 on Oracle 19c database. See support matrix.

Backup and DR agent now supports RHEL 8.4 on Oracle 21c database. See support matrix.

Cloud Bigtable

Cloud Bigtable instance, cluster, and table metadata is automatically synced to Data Catalog, a feature of Dataplex, for improved data discovery and governance. This feature is generally available (GA).

Cloud Healthcare API

The Cloud Healthcare API offers multi-region support in the Europe (eu) region.

Compute Engine

Generally available: NVIDIA L4 GPUs are now available in the following additional regions and zones:

  • APAC
    • Seoul, South Korea (asia-northeast3-b)
  • Europe
    • St. Ghislain, Belgium (europe-west1-b)
    • Frankfurt, Germany (europe-west3-b)
  • North America
    • Council Bluffs, Iowa: (us-central1-c)
    • Las Vegas, Nevada (us-west4-a,c)

For more information about using GPUs on Compute Engine, see GPU platforms.

Dataproc

New Dataproc on Compute Engine image version 2.2 is available for preview with upgraded components.

New Dataproc on Compute Engine subminor image versions:

  • 2.0.79-debian10, 2.0.79-rocky8, 2.0.79-ubuntu18
  • 2.1.27-debian11, 2.1.27-rocky8, 2.1.27-ubuntu20, 2.1.27-ubuntu20-arm
  • 2.2.0-RC2-debian11, 2.2.0-RC2-rocky9, 2.2.0-RC2-ubuntu22

Upgraded Hadoop version from 3.3.3 to 3.3.6 in the latest Dataproc on Compute Engine 2.1 image version.

Upgraded the Cloud Storage connector version to 2.2.17 in the latest Dataproc Serverless for Spark runtimes.

Added the gs.http.connect-timeout and gs.http.read-timeout properties in Flink to set the connection timeout and read timeout for java-storage client in the latest Dataproc on Compute Engine 2.1 image version.

Added the gs.filesink.entropy.enabled property in Flink to enable entropy injection in filesink Cloud Storage path in the latest Dataproc on Compute Engine 2.1 image version.

Google Kubernetes Engine

A previously published release note on December 14, 2022 has been updated. Support for migration of GKE Autopilot clusters' datapath provider to Dataplane V2 has been paused. We will update this release note when migration support resumes.

October 05, 2023

Apigee Integrated Portal

On October 5, 2023 we released an updated version of Apigee integrated portal. This release includes general improvements to performance and availability.

Batch

Batch is available in the following regions:

  • australia-southeast2 (Melbourne)
  • europe-west8 (Milan)
  • europe-west12 (Turin)
  • me-west1 (Tel Aviv)
  • northamerica-northeast2 (Toronto)
  • southamerica-east1 (São Paulo)
  • us-east5 (Columbus)

For more information, see Locations.

BigQuery

The BigQuery migration assessment is now available for Snowflake in preview. You can use this feature to assess the complexity of migrating data from your Snowflake data warehouse to BigQuery.

Certificate Authority Service

Certificate Authority Service is now available in the following region:

  • me-central2

For more information, see Certificate Authority Service locations.

Chronicle

The following supported default parsers have changed. Each is listed by product name and log_type value, if applicable.

  • AWS Cloudtrail (AWS_CLOUDTRAIL)
  • Azion (AZION)
  • Azure AD Organizational Context (AZURE_AD_CONTEXT)
  • Blue Coat Proxy (BLUECOAT_WEBPROXY)
  • Cisco ACS (CISCO_ACS)
  • Cisco FireSIGHT Management Center (CISCO_FIRESIGHT)
  • Cisco ISE (CISCO_ISE)
  • Cisco Umbrella DNS (UMBRELLA_DNS)
  • Cloud Intrusion Detection System (GCP_IDS)
  • Cloudflare (CLOUDFLARE)
  • Compute Context (N/A)
  • Corelight (CORELIGHT)
  • Darktrace (DARKTRACE)
  • F5 ASM (F5_ASM)
  • FireEye (FIREEYE_ALERT)
  • HAProxy (HAPROXY)
  • Hashicorp Vault (HASHICORP)
  • HP Procurve Switch (HP_PROCURVE)
  • IBM Security Verify SaaS (IBM_SECURITY_VERIFY_SAAS)
  • Imperva (IMPERVA_WAF)
  • Ionix (IONIX)
  • Microsoft Defender for Endpoint (MICROSOFT_DEFENDER_ENDPOINT)
  • MISP Threat Intelligence (MISP_IOC)
  • Office 365 (OFFICE_365)
  • Oracle Cloud Infrastructure Audit Logs (OCI_AUDIT)
  • Sendmail (SENDMAIL)
  • Tanium Audit (TANIUM_AUDIT)
  • Tanium Stream (TANIUM_TH)
  • Thycotic (THYCOTIC)
  • Unix system (NIX_SYSTEM)
  • VMware ESXi (VMWARE_ESX)
  • VMware NSX (VMWARE_NSX)
  • VMware vCenter (VMWARE_VCENTER)
  • WatchGuard (WATCHGUARD)
  • Windows DNS (WINDOWS_DNS)
  • Windows Event (WINEVTLOG)
  • Workspace Activities (WORKSPACE_ACTIVITY)
  • Workspace Alerts (WORKSPACE_ALERTS)
  • Zeek JSON (BRO_JSON)
  • Zscaler CASB (ZSCALER_CASB)

The following log types, without a default parser, were added. Each is listed by product name and log_type value, if applicable.

  • AWS_EMR (AWS_EMR)
  • Azure Application Gateway (AZURE_GATEWAY)
  • CloudBolt (CLOUDBOLT)
  • DNSFilter (DNSFILTER)
  • GitGuardian Enterprise (GITGUARDIAN_ENTERPRISE)
  • GoAnywhere MFT (GOANYWHERE_MFT)
  • IBM Security Identity Manager (IBM_SIM)
  • Jamf Pro MDM (JAMF_PRO_MDM)
  • MultiPay (MULTIPAY)
  • Palo Alto Networks IoT Security (PAN_IOT)
  • Raritan Dominion SX II (RARITAN_DOMINION)

For a list of supported log types and details about default parser changes, see Supported log types and default parsers.

Cloud Composer

Cloud Composer 2 is now available in Milan (europe-west8), Berlin (europe-west10), and Turin (europe-west12).

Fixed a problem where newly-created Airflow workers ignored the SIGTERM signal, which could lead to task failures.

Cloud Composer 2.4.5 images are available:

  • composer-2.4.5-airflow-2.5.3 (default)
  • composer-2.4.5-airflow-2.4.3
Cloud Monitoring

Ops Agent version 2.42.0 introduces support for Compute Engine Arm VMs that are running Ubuntu 22.04 LTS (Jammy Jellyfish). For more information, see Support for Compute Engine Arm VMs.

Dashboard-wide filters now apply to the Logs Panel widget. For more information, see Filter the log entries.

Cloud Spanner

Cloud Spanner sampled query plans are now available in GA. You can view samples of historic query plans and compare the performance of a query over time. For more information, see Sampled query plans.

Cloud TPU

Cloud TPU now supports TensorFlow 2.13.1. For more information see the TensorFlow 2.13.1 release notes.

Cloud Trace

You can now show logs and events as inline messages when exploring a trace. For more information, see Find and explore traces.

Google Kubernetes Engine

(2023-R19) Version updates

GKE cluster versions have been updated.

New versions available for upgrades and new clusters

The following Kubernetes versions are now available for new clusters and for opt-in control plane upgrades and node upgrades for existing clusters. For more information on versioning and upgrades, see GKE versioning and support and Upgrades.

No channel

Stable channel

  • The following version is no longer available in the Stable channel: 1.26.5-gke.2100

Regular channel

  • There are no new releases in the Regular release channel.

Rapid channel

An issue was previously reported with running certain commands in container images when Image streaming is enabled. See the August 31, 2023 release note for details. This issue is fixed in the following minor versions:

  • 1.25 with the patch versions 1.25.14-gke.1351000 and later.
  • 1.25 with the patch versions 1.26.9-gke.1345000 and later.
  • 1.27 with the patch versions 1.27.6-gke.100 and later.
  • 1.28 with the patch version 1.28.1-gke.1157000 and later.

To receive the fix, upgrade your nodes to an applicable patch version.

(2023-R19) Version updates

(2023-R19) Version updates

  • The following version is no longer available in the Stable channel: 1.26.5-gke.2100

(2023-R19) Version updates

(2023-R19) Version updates

  • There are no new releases in the Regular release channel.
Vertex AI

Ray on Vertex AI is now available in Preview

Ray is an open-source framework for scaling AI and Python applications. Ray provides the infrastructure to perform distributed computing and parallel processing for your machine learning workflow.

You can now create Ray clusters and develop your Ray applications on Vertex AI. This feature is in Preview. For more information, see Ray on Vertex AI overview.

October 04, 2023

BigQuery

You can now copy tables across regions. This feature is now in preview.

Chronicle

Chronicle Curated Detections has been enhanced with new detection content for Google Cloud threats. These new rule sets help identify reconnaissance and exploitation behavior from open source Kubernetes tools.

The submit_parser command now has an option to skip validation if no logs are found. For more information, see the Chronicle CLI user guide.

Cloud Interconnect

Dedicated Cloud Interconnect support is available in the following colocation facilities:

  • CyrusOne Phoenix - Phoenix

For more information, see the Locations table.

Compute Engine

Generally available: NVIDIA L4 GPUs are now available in the following additional regions and zones:

  • Singapore(asia-southeast1-a)

For more information about using GPUs on Compute Engine, see GPU platforms.

Confidential VM

Confidential Space. A new image (confidential-space-230901) is now available. This image provides improved logging capabilities and increases the file descriptor limits. For more information, see the Changelog.

Google Kubernetes Engine

Log rotation is misconfigured on nodes running a COS-based image type (cos_containerd). This affects all COS-based nodes running version 1.28 or higher. As a result of this issue, your logs may fill up the disk and cause your nodes to be marked as 'Not Ready' and to be auto-repaired. As a workaround, use a privileged DaemonSet to change the logrotate path to /usr/bin/ instead of /usr/sbin/ in Systemd unit kube-logrotate.service.

Network Intelligence Center

Network Analyzer now includes an insight that gives a summary of the IP address utilization of all the subnet ranges. This insight is already available in Recommender API and Cloud Logging. For more information, see IP address utilization summary insights.

SAP on Google Cloud

ABAP SDK for Google Cloud, version 1.5 is generally available (GA)

Version 1.5 of the ABAP SDK for Google Cloud is generally available (GA). This version of the SDK offers extended ABAP client libraries to build and deploy ML and AI-driven solutions using a wide range of Google Cloud services.

This SDK also enables use of the OAuth 2.0 framework to authenticate to Google Cloud APIs using OAuth 2.0 client credentials.

For more information, see What's new with the ABAP SDK for Google Cloud.

Vertex AI

Model tuning for the textembedding-gecko model is now available in Preview

You can now use supervised fine-tuning to tune the textembedding-gecko model. This feature is in (Preview). For more information, see Tune text embeddings.

Vertex AI Prediction

You can now use C3 machine types to serve predictions.

October 03, 2023

BigQuery Chronicle

The Chronicle SIEM user interface has a new top-level navigation to help you access the most commonly used Chronicle SIEM features. It works much the same as the navigation for Chronicle Security Operations. The new navigation menu expands from the left side of the screen, replacing the 9-dot icon at the top right. It is designed to make it easier to find information and resources and to help you work more efficiently. The Chronicle homepage can be accessed by clicking the Chronicle logo at the top left of the page. Reference lists can now be found within the Search page or the Rules Editor page.

Chronicle SOAR

Release 6.2.36

GA - 14th October, 2023

Internal security fixes

Cloud Composer

Oozie to Airflow tool version 2.0 is available. The new version of the tool supports Airflow 2.

Oozie to Airflow tool converts Apache Oozie workflows into Apache Airflow DAGs. For more information, see the project's page in PyPI and the oozie-to-airflow repository on GitHub.

Container Optimized OS

cos-dev-113-17935-0-0

Kernel Docker Containerd GPU Drivers
COS-6.1.55 v24.0.5 v1.7.3 v535.104.05(default),v470.199.02(R470)

Upgraded chromeos-base/chromeos-dbus-bindings to v0.0.1-r2787.

Upgraded chromeos-base/chromeos-common-script to v0.0.1-r554.

Fixed CVE-2023-42753 in the Linux kernel.

cos-109-17800-0-47

Kernel Docker Containerd GPU Drivers
COS-6.1.42 v24.0.5 v1.7.2 v535.104.05(default),v470.199.02(R470)

Updated cos-gpu-installer to v2.1.9.

Fixed CVE-2023-42753 in the Linux kernel.

cos-93-16623-461-36

Kernel Docker Containerd GPU Drivers
COS-5.10.177 v20.10.24 v1.6.20 v450.248.02(default),v470.199.02(R470),v535.104.05

Fixes CVE-2023-2163 in the Linux Kernel.

cos-101-17162-279-57

Kernel Docker Containerd GPU Drivers
COS-5.15.120 v20.10.24 v1.6.21 v470.199.02(default),v535.104.05

Updated cos-gpu-installer to v2.1.9.

Dataplex

Dataplex BigLake integration is generally available (GA). Dataplex BigLake integration lets you upgrade a Cloud Storage bucket to managed, creating BigLake tables and Object tables instead of external tables. This allows the application of column-level, row-level, and table-level policies, enabling fine-grained security and dynamic data masking.

Retail API

Retail Search: Facet controls

You can create facet controls that apply to search and browse operations. These help you control facets values without editing your catalog and set the ranking of facet keys.

Numerical facets have been improved: intervals are calculated but they can also be customized.

The facet controls are:

  • Ignore facet values
  • Replace facet values
  • Set numerical intervals
  • Remove facets
  • Force return facets

For more information, see Facets for search.

Vertex AI

TorchServe is used to host PyTorch machine learning models for online prediction. Vertex AI provides pre-built PyTorch model serving containers which depend on TorchServe. Vulnerabilities were recently discovered in TorchServe which would allow an attacker to take control of a TorchServe deployment if its model management API is exposed. Customers with PyTorch models deployed to Vertex AI online prediction are not affected by these vulnerabilities, since Vertex AI does not expose TorchServe's model management API. Customers using TorchServe outside of Vertex AI should take precautions to ensure their deployments are set up securely.

For more information, see the Vertex AI security bulletin.

October 02, 2023

Anthos Attached Clusters

This release includes the following Anthos attached clusters platform versions:

  • 1.25.0-gke.7
  • 1.26.0-gke.5
  • 1.27.0-gke.2

1.25.0-gke.7, 1.26.0-gke.5, and 1.27.0-gke.1

Resolved an issue affecting EKS environments in which Kubernetes resource metrics weren't successfully scraped from the kubelet when a node's name within the cluster didn't match that same node's hostname.

1.25.0-gke.7 and 1.26.0-gke.5

This release fixes the following vulnerabilities:

Anthos clusters on AWS

You can now launch clusters with the following Kubernetes versions. Click on the following links to see the release notes associated with these patches:

Anthos clusters on Azure

You can now launch clusters with the following Kubernetes versions. Click on the following links to see the release notes associated with these patches:

Anthos clusters on VMware

Upgrading an admin cluster with always-on secrets encryption enabled might fail.

An admin cluster upgrade from 1.14.x to 1.15.0 - 1.15.4 with always-on secrets encryption enabled might fail depending on whether the feature was enabled during cluster creation or during cluster update.

We recommend that you don't upgrade your admin cluster until a fix is available in 1.15.5. If you must upgrade to 1.15.0-1.15.4, do the steps in Preventing the upgrade failure before upgrading the cluster.

For information on working around an admin cluster failure because of this issue, see Upgrading an admin cluster with always-on secrets encryption enabled fails. Note that the workaround relies on you having the old encryption key backed up. If the old key is no longer available, you will have to recreate the admin cluster and all user clusters.

Bare Metal Solution

You can now use Bare Metal Solution's self-service functionality to order your resources after executing a one-time Order Form. This feature is generally available (GA). For more information, see Order Bare Metal Solution resources.

BigQuery

A weekly digest of client library updates from across the Cloud SDK.

Node.js

Changes for @google-cloud/bigquery

7.3.0 (2023-09-28)

Features
Bug Fixes
  • Avoid TypeError if resp is undefined (#1273) (ff51c1d)
  • Updated types from API discovery doc (#1284) (1d8a2b7)
  • Updating type for test blocking dependency updates (#1282) (1dbe0fe)

Java

Changes for google-cloud-bigquery

2.33.1 (2023-09-28)

Bug Fixes
  • Dry run NPE when there is no query parameters (#2899) (8f85a4d)

2.33.0 (2023-09-27)

Features
Bug Fixes
  • Update samples snippet to write to BYTES instead of ARRAY<BYTES> (#2876) (7e040e9)
Dependencies
  • Update actions/checkout action (#2893) (e3655af)
  • Update dependency com.google.cloud:google-cloud-shared-dependencies to v3.16.1 (#2892) (e1d9871)
  • Update dependency org.graalvm.buildtools:junit-platform-native to v0.9.27 (#2885) (2237ca2)
  • Update dependency org.graalvm.buildtools:native-maven-plugin to v0.9.27 (#2886) (539b4e6)
  • Update github/codeql-action action to v2.21.4 (#2829) (599e3b3)
  • Update github/codeql-action action to v2.21.8 - abandoned (#2897) (ab4e1d0)
  • Update github/codeql-action action to v2.21.8 (#2889) (b568026)
  • Update github/codeql-action action to v2.21.9 (#2901) (33a729f)

BigQuery native integration in Looker Studio enables monitoring features for Looker Studio queries, improves query performance, and supports many BigQuery features. This feature is in preview.

Cloud Asset Inventory

The following resource types are now publicly available through the analyze policy APIs (AnalyzeIamPolicy and AnalyzeIamPolicyLongrunning).

  • Identity and Access Management
    • iam.googleapis.com/PolicyV2
Cloud Bigtable

A weekly digest of client library updates from across the Cloud SDK.

Java

Changes for google-cloud-bigtable

2.27.3 (2023-09-29)

Bug Fixes
Dependencies
  • Update dependency org.graalvm.buildtools:junit-platform-native to v0.9.27 (#1919) (56d6b40)
  • Update dependency org.graalvm.buildtools:native-maven-plugin to v0.9.27 (#1920) (ca1dd5b)
  • Update gapic-generator-java to 2.26.0 (#1936) (15cd486)
Cloud Healthcare API

A release was made. Updates may include general performance improvements, bug fixes, and updates to the API reference documentation.

Cloud Logging

A weekly digest of client library updates from across the Cloud SDK.

Java

Changes for google-cloud-logging

3.15.10 (2023-09-27)

Dependencies
  • Update dependency com.google.cloud:google-cloud-shared-dependencies to v3.16.1 (#1434) (e9e9835)
  • Update dependency org.graalvm.buildtools:junit-platform-native to v0.9.27 (#1430) (9e750a3)
  • Update dependency org.graalvm.buildtools:native-maven-plugin to v0.9.27 (#1431) (7c2aa2c)

Python

Changes for google-cloud-logging

3.7.0 (2023-09-25)

Features
  • Add ConfigServiceV2.CreateBucketAsync method for creating Log Buckets asynchronously (30f24a8)
  • Add ConfigServiceV2.CreateLink method for creating linked datasets for Log Analytics Buckets (30f24a8)
  • Add ConfigServiceV2.DeleteLink method for deleting linked datasets (30f24a8)
  • Add ConfigServiceV2.GetLink methods for describing linked datasets (30f24a8)
  • Add ConfigServiceV2.ListLinks method for listing linked datasets (30f24a8)
  • Add ConfigServiceV2.UpdateBucketAsync method for creating Log Buckets asynchronously (30f24a8)
  • Add LogBucket.analytics_enabled field that specifies whether Log Bucket's Analytics features are enabled (30f24a8)
  • Add LogBucket.index_configs field that contains a list of Log Bucket's indexed fields and related configuration data (30f24a8)
  • Log Analytics features of the Cloud Logging API (30f24a8)
Bug Fixes
  • Add async context manager return types (30f24a8)
  • Add severity to structured log write (#783) (31a7f69)
  • Handle exceptions raised when fetching Django request data (#758) (5ecf886)
  • Unintended exception omittion (#736) (022dc54)
Documentation
  • Documentation for the Log Analytics features of the Cloud Logging API (30f24a8)
  • Minor formatting (30f24a8)
Cloud Monitoring

The Metrics management page in Cloud Monitoring now lets you create alerting policies and charts for metrics that have no associated alerting policies or custom dashboards. For more information, see View and manage metric usage.

You can now import your Grafana dashboards into Cloud Monitoring. For more information, see Import Grafana dashboards into Cloud Monitoring.

You can now configure notifications for Google Chat spaces. For more information, see Create and manage notification channels.

Cloud SQL for MySQL

For Cloud SQL Enterprise edition and Cloud SQL Enterprise Plus edition, you can restore backups across instances of different editions.

Cloud SQL for PostgreSQL

For Cloud SQL Enterprise edition and Cloud SQL Enterprise Plus edition, you can restore backups across instances of different editions.

Cloud Workstations

If you use the latest preconfigured base images for JetBrains IDEs, the .vmoptions and .properties files persist across workstations. For more information, see Customize JetBrains IDE vmoptions and properties.

Dialogflow

Dialogflow CX speech adaptation can now be configured manually.

Document AI Warehouse

Support root folder filtering

Filestore Firestore in Datastore mode

A weekly digest of client library updates from across the Cloud SDK.

Python

Changes for google-cloud-ndb

2.2.2 (2023-09-19)

Documentation
  • query: Document deprecation of Query.default_options (#915) (a656719), closes #880
Google Kubernetes Engine

GKE now delivers insights and recommendations if users have installed webhooks that intercept system resources or webhooks that have no available endpoints. To learn more, see Ensure control plane stability when using webhooks.

Pub/Sub

A weekly digest of client library updates from across the Cloud SDK.

Java

Changes for google-cloud-pubsub

1.125.5 (2023-09-28)

Dependencies
  • Update gapic-generator-java to 2.26.0 (935849c)

1.125.4 (2023-09-28)

Dependencies
  • Update dependency com.google.cloud:google-cloud-bigquery to v2.33.0 (#1750) (bcbfcd0)

1.125.3 (2023-09-27)

Dependencies
  • Update dependency com.google.cloud:google-cloud-core to v2.24.1 (#1737) (48a4432)
  • Update dependency com.google.cloud:google-cloud-shared-dependencies to v3.16.1 (#1738) (e2cf7c1)
  • Update dependency org.apache.avro:avro to v1.11.3 (#1740) (971b35f)
  • Update dependency org.xerial.snappy:snappy-java to v1.1.10.4 security (70ba500)
  • Update dependency org.xerial.snappy:snappy-java to v1.1.10.5 (#1746) (a4b1994)
SAP on Google Cloud

Cloud Storage Backint agent for SAP HANA version 1.0.29

Version 1.0.29 of the Cloud Storage Backint agent for SAP HANA is available. This version sets the default value of the HTTP_READ_TIMEOUT parameter to -1; no timeout.

For more information about the agent, see Cloud Storage Backint agent for SAP HANA overview.

Virtual Private Cloud

Private Service Connect service connectivity automation is available in General Availability. Service connectivity automation lets service producers automate deployment and service connectivity to eligible managed services on behalf of consumers.

September 30, 2023

Cloud Firewall

Starting September 30, 2023, you will be charged for the Cloud Firewall Standard feature—fully qualified domain name (FQDN) objects. For more information about billing, see Cloud Firewall pricing.

Google Cloud VMware Engine

VMware Engine nodes are now available in the following additional zone:

  • Tel Aviv (me-west1-b)

September 29, 2023

Access Approval

Access Approval supports Vertex AI Search in the Preview stage.

Access Transparency

Access Transparency supports Vertex AI Search in the Preview stage. For the complete list of services that Access Transparency supports, see Supported services.

Anthos clusters on VMware

Anthos clusters on VMware 1.16.1-gke.45 is now available. To upgrade, see Upgrading Anthos clusters on VMware. Anthos clusters on VMware 1.16.1-gke.44 runs on Kubernetes 1.27.4-gke.1600.

The Prometheus and Grafana add-ons field, loadBalancer.vips.addonsVIP is deprecated in 1.16 and later. This change is because Google Managed Service for Prometheus replaced the Prometheus and Grafana add-ons in 1.16.

The following issues are fixed in 1.16.1-gke.45:

  • Fixed the known issue that gkectl repair admin-master returns kubeconfig unmarshall error.
  • Fixed the known issue that GARP reply sent by Seesaw doesn't set target IP
  • Fixed the known issue that Seesaw VM may be broken due to low disk space
  • Fixed the known issue that false warnings might be generated against persistent volume claims.
  • Fixed the known issue that caused CNS attachvolume tasks to appear every minute for in-tree PVC/PV after upgrading to Anthos 1.15+.

The following vulnerabilities are fixed in 1.16.1-gke.44:

Anthos clusters on VMware 1.14.8-gke.37 is now available. To upgrade, see Upgrading Anthos clusters on VMware. Anthos clusters on VMware 1.14.8-gke.37 runs on Kubernetes 1.25.12-gke.2400.

The following issues are fixed in 1.14.8-gke.37:

  • Fixed the disk full known issue on Seesaw VM due to no log rotation for fluent-bit.

The following vulnerabilities are fixed in 1.14.8-gke.37:

Anthos clusters on bare metal

Release 1.14.9

Anthos clusters on bare metal 1.14.9 is now available for download. To upgrade, see Upgrading Anthos on bare metal. Anthos clusters on bare metal 1.14.9 runs on Kubernetes 1.25.

Fixes:

Fixed an issue to prevent cluster upgrades from starting on a node before either all Pods have been drained or the Pod draining timeout has been reached.

Known issues:

For information about the latest known issues, see Anthos clusters on bare metal known issues in the Troubleshooting section.

Apigee X

On September 29, 2023, we released an updated version of Apigee.

New attributes for Pay-as-you-go pricing are generally available (GA).

Apigee updated its Pay-as-you-go pricing model, making it possible for customers to onboard at a significantly reduced initial cost and right-size their ongoing expenses to usage.

To learn more about the updated Pay-as-you-go pricing experience, see Pay-as-you-go (updated attributes) pricing overview.

Standard and extensible API proxies are generally available (GA).

Standard and extensible API proxies are generally available for use with Apigee organizations.

For more information about standard and extensible API proxies, see API proxy types.

HTTPModifier and ReadPropertySet policies and templating support for message elements are generally available (GA).

The HTTPModifier policy can change an existing request or response message and provides a subset of the functionality already available in the AssignMessage policy. See HTTPModifier policy.

The ReadPropertySet policy reads property sets and populates flow variables with the results. See ReadPropertySet policy.

HTTPModifier and ReadPropertySet are standard policies. Proxies built exclusively with standard policies are called standard proxies and can be deployed to any environment type. See Pay-as-you-go (updated attributes) pricing overview.

With this release, template support for message elements is also generally available. See URL templating.

New environment types are generally available (GA).

With this release, Apigee introduces three distinct environments that have access to varying degrees of Apigee capabilities and costs: Base, Intermediate, and Comprehensive.

For more information, see Apigee Pay-as-you-go environment types.

Apigee API Analytics add-on for Pay-as-you-go organizations is generally available (GA).

With this release, Apigee API Analytics is available as a paid add-on capability for Pay-as-you-go organizations. The add-on can be enabled in any Apigee Intermediate or Comprehensive environment. For more information, see Manage the Apigee API Analytics add-on.

One click provisioning for Apigee Pay-as-you-go organizations is generally available (GA).

Simplify your onboarding experience with one click provisioning for new Pay-as-you-go organizations, using smart default configurations. To learn more, see Provision Apigee with one click.

Updated pricing attributes in Subscription plans are available.

To get started with subscription plans that include new pricing attributes (consistent with Pay-as-you-go pricing), contact your Google Cloud sales specialist.

For more information, see Apigee Subscription 2024 entitlements. Apigee hybrid is not available in the new subscription plan at this time.

BigQuery

As a BigQuery administrator, to monitor your organization's slots utilization and BigQuery jobs' performance over time, use can now use administrative query inspector. This feature is now generally available.

Cloud Composer

Airflow triggerer is now generally available (GA).

The cost of the environments.ExecuteAirflowCommand and environments.StopAirflowCommand operations is reduced from 100 to 25 quota units.

The apache-airflow-providers-google package is upgraded to version 10.9.0 in images with Airflow 2.5.3 and 2.4.3. For more information about changes, see the apache-airflow-providers-google changelog from version 10.7.0 to version 10.9.0.

Cloud Composer 2.4.4 images are available:

  • composer-2.4.4-airflow-2.5.3 (default)
  • composer-2.4.4-airflow-2.4.3

Cloud Composer versions 2.0.28, 2.0.27, 1.19.11, and 1.19.10 have reached their end of full support period.

Cloud Load Balancing

Cloud Load Balancing introduces the global external Proxy Network Load Balancer. The global external Proxy Network Load Balancer is implemented on globally distributed GFEs and supports advanced traffic management capabilities. This load balancer can be configured to handle either TCP or SSL traffic by using either a target TCP proxy or a target SSL proxy respectively. Global external proxy Network Load Balancers support backends such as instance groups, hybrid NEGs, and Private Service Connect NEGs.

Load balancers that are already deployed in the classic mode are renamed as classic Proxy Network Load Balancer in the console.

For details, see the External proxy Network Load Balancer overview.

To set up a global external Proxy Network Load Balancer, see the following pages:

This capability is in Preview.

With the launch of global external Proxy Network Load Balancer, we now support three deployment modes with the external Proxy Network Load Balancer—classic (General Availability), Regional (General Availability) and global (Preview). No changes have been made to the API.

For details, see the External proxy Network Load Balancer overview.

Typically with HTTPS communication, the authentication works only one way: the client verifies the identity of the server. For applications that require the load balancer to authenticate the identity of clients that connect to it, both a global external Application Load Balancer and a global external Application Load Balancer (classic) support mutual TLS (mTLS).

With mTLS, the load balancer requests that the client send a certificate to authenticate itself during the TLS handshake with the load balancer. You can configure a trust store that the load balancer uses to validate the client certificate's chain of trust.

For details, see the following:

This capability is in General Availability.

Cloud Logging

Ops Agent versions 2.39.0 and 2.40.0 crash if you use them on Compute Engine VMs with attached GPUs. Use Ops Agent version 2.38.0, or versions 2.41.0 and newer, on VMs with attached GPUs.

Cloud Monitoring

Ops Agent versions 2.39.0 and 2.40.0 crash if you use them on Compute Engine VMs with attached GPUs. Use Ops Agent version 2.38.0, or versions 2.41.0 and newer, on VMs with attached GPUs.

Config Connector

Config Connector version 1.110.0 is now available.

Added MutatingWebhookConfigurationCustomization and ValidatingWebhookConfigurationCustomization to support the customization on webhook timeouts.

Added value validation for resource requests and limits in the customizable ControllerResource and NamespacedControllerResource CRDs.

Promoted CertificateManagerCertificate, CertificateManagerCertificateMap, CertificateManagerCertificateMapEntry and CertificateManagerDNSAuthorization from v1alpha1 to v1beta1.

Promoted RunService from alpha stability to stable stability.

  • Renamed field spec.template.containerConcurrency to spec.template.maxInstanceRequestConcurrency.
  • Fixed the IAM support by removing the support of "IAM conditions" on this resource.
  • Removed field status.resourceGeneration.

Resource BigQueryTable(v1beta1):

  • Added spec.tableConstraints field.
  • Added spec.materializedView.allowNonIncrementalDefinition field.

Resource ComputeInstance(v1beta1):

  • Added spec.networkInterface.items.internalIpv6PrefixLength field.
  • Added spec.networkInterface.items.ipv6Address field.

Resource ComputeInstanceTemplate(v1beta1):

  • Added spec.networkInterface.items.internalIpv6PrefixLength field.
  • Added spec.networkInterface.items.ipv6Address field.

Resource ContainerCluster(v1beta1):

  • Added spec.enableFqdnNetworkPolicy field.
  • Added spec.nodeConfig.confidentialNodes field.

Resource ContainerNodePool(v1beta1):

  • Added spec.nodeConfig.confidentialNodes field.

Resource DialogflowCXFlow(v1alpha1):

  • Added spec.eventHandlers.items.triggerFulfillment.conditionalCases field.
  • Added spec.eventHandlers.items.triggerFulfillment.setParameterActions field.
  • Added spec.eventHandlers.items.triggerFulfillment.messages.items.channel field.
  • Added spec.eventHandlers.items.triggerFulfillment.messages.items.conversationSuccess field.
  • Added spec.eventHandlers.items.triggerFulfillment.messages.items.liveAgentHandoff field.
  • Added spec.eventHandlers.items.triggerFulfillment.messages.items.outputAudioText field.
  • Added spec.eventHandlers.items.triggerFulfillment.messages.items.payload field.
  • Added spec.eventHandlers.items.triggerFulfillment.messages.items.playAudio field.
  • Added spec.eventHandlers.items.triggerFulfillment.messages.items.telephonyTransferCall field.
  • Added spec.transitionRoutes.items.triggerFulfillment.conditionalCases field.
  • Added spec.transitionRoutes.items.triggerFulfillment.setParameterActions field.
  • Added spec.transitionRoutes.items.triggerFulfillment.messages.items.channel field.
  • Added spec.transitionRoutes.items.triggerFulfillment.messages.items.conversationSuccess field.
  • Added spec.transitionRoutes.items.triggerFulfillment.messages.items.liveAgentHandoff field.
  • Added spec.transitionRoutes.items.triggerFulfillment.messages.items.outputAudioText field.
  • Added spec.transitionRoutes.items.triggerFulfillment.messages.items.payload field.
  • Added spec.transitionRoutes.items.triggerFulfillment.messages.items.playAudio field.
  • Added spec.transitionRoutes.items.triggerFulfillment.messages.items.telephonyTransferCall field.

Resource DialogflowCXPage(v1alpha1):

  • Added spec.entryFulfillment.conditionalCases field.
  • Added spec.entryFulfillment.setParameterActions field.
  • Added spec.entryFulfillment.messages.items.channel field.
  • Added spec.entryFulfillment.messages.items.conversationSuccess field.
  • Added spec.entryFulfillment.messages.items.liveAgentHandoff field.
  • Added spec.entryFulfillment.messages.items.outputAudioText field.
  • Added spec.entryFulfillment.messages.items.payload field.
  • Added spec.entryFulfillment.messages.items.playAudio field.
  • Added spec.entryFulfillment.messages.items.telephonyTransferCall field.
  • Added spec.eventHandlers.items.triggerFulfillment.conditionalCases field.
  • Added spec.eventHandlers.items.triggerFulfillment.setParameterActions field.
  • Added spec.eventHandlers.items.triggerFulfillment.messages.items.channel field.
  • Added spec.eventHandlers.items.triggerFulfillment.messages.items.conversationSuccess field.
  • Added spec.eventHandlers.items.triggerFulfillment.messages.items.liveAgentHandoff field.
  • Added spec.eventHandlers.items.triggerFulfillment.messages.items.outputAudioText field.
  • Added spec.eventHandlers.items.triggerFulfillment.messages.items.payload field.
  • Added spec.eventHandlers.items.triggerFulfillment.messages.items.playAudio field.
  • Added spec.eventHandlers.items.triggerFulfillment.messages.items.telephonyTransferCall field.
  • Added spec.form.parameters.items.defaultValue field.
  • Added spec.form.parameters.items.fillBehavior.repromptEventHandlers field.
  • Added spec.form.parameters.items.fillBehavior.initialPromptFulfillment.conditionalCases field.
  • Added spec.form.parameters.items.fillBehavior.initialPromptFulfillment.setParameterActions field.
  • Added spec.form.parameters.items.fillBehavior.initialPromptFulfillment.messages.items.channel field.
  • Added spec.form.parameters.items.fillBehavior.initialPromptFulfillment.messages.items.conversationSuccess field.
  • Added spec.form.parameters.items.fillBehavior.initialPromptFulfillment.messages.items.liveAgentHandoff field.
  • Added spec.form.parameters.items.fillBehavior.initialPromptFulfillment.messages.items.outputAudioText field.
  • Added spec.form.parameters.items.fillBehavior.initialPromptFulfillment.messages.items.payload field.
  • Added spec.form.parameters.items.fillBehavior.initialPromptFulfillment.messages.items.playAudio field.
  • Added spec.form.parameters.items.fillBehavior.initialPromptFulfillment.messages.items.telephonyTransferCall field.
  • Added spec.transitionRoutes.items.triggerFulfillment.conditionalCases field.
  • Added spec.transitionRoutes.items.triggerFulfillment.setParameterActions field.
  • Added spec.transitionRoutes.items.triggerFulfillment.messages.items.channel field.
  • Added spec.transitionRoutes.items.triggerFulfillment.messages.items.conversationSuccess field.
  • Added spec.transitionRoutes.items.triggerFulfillment.messages.items.liveAgentHandoff field.
  • Added spec.transitionRoutes.items.triggerFulfillment.messages.items.outputAudioText field.
  • Added spec.transitionRoutes.items.triggerFulfillment.messages.items.payload field.
  • Added spec.transitionRoutes.items.triggerFulfillment.messages.items.playAudio field.
  • Added spec.transitionRoutes.items.triggerFulfillment.messages.items.telephonyTransferCall field.

Resource RunJob(v1beta1):

  • spec.template.template.volumes[].secret.items[].mode is now optional.

Resource SecretManagerSecret(v1beta1):

  • Added spec.replication.auto field.

Resource SecretManagerSecretVersion(v1beta1):

  • Added spec.deletionPolicy field.

Resource StorageBucket(v1beta1):

  • spec.autoclass.enabled is now mutable.

Resource VertexAIIndexEndpoint(v1alpha1):

  • Added spec.publicEndpointEnabled field.
  • Added status.publicEndpointDomainName field.
Dataplex

Dataplex is available in the following regions:

  • Delhi (asia-south2)
  • Melbourne (australia-southeast2)
  • Toronto (northamerica-northeast2)

For more information, see Locations and Pricing.

Dialogflow

Dialogflow CX launched two new integrations in preview:

Google Kubernetes Engine

This is a follow-up message to the release note regarding blue-green upgrades from September 18, 2023. You can now resume upgrading clusters with the blue-green upgrade strategy as the issue with rollback functionality has been fixed. GKE is no longer blocking automatic upgrades due to this issue.

Security Command Center

containsOnly() function released to General Availability.

You can now use the containsOnly() function to query findings with an array-type attribute or subfield that only contains values that match the specified filter, and no other values.

For more information, see The containsOnly function.

Vertex AI Search and Conversation

Vertex AI Search (Enterprise Search): Customer-managed encryption key integration

Customer-managed encryption keys (CMEK) is available as an allowlisted preview feature.

If you store your data in a US multi-region data store, you can provide your own encryption key to protect your data at rest.

For information, see Customer-managed encryption keys.

Vertex AI Search (Enterprise Search): Search tuning

Search tuning is available as an allowlisted preview feature. You provide additional training data in the form of query and segment pairs. We use this data to tune the model for your app.

For information, see Improve search results with search tuning.

Vertex AI Search (Enterprise Search): VPC Service Controls are GA

Virtual Private Cloud Service Controls support for Enterprise Search is generally available (GA).

For more information, see Supported products and limitations in the VPC Service Controls documentation. For general information about VPC Service Controls, see Overview of VPC Service Controls.

Vertex AI Search (Enterprise Search): Data location

Vertex AI Search may be configured for data location pursuant to the "Data Location" section of the Service Specific Terms.

For information about data residency in Vertex AI Search, see Enterprise Search locations.

Vertex AI Search (Enterprise Search): Support for Access Transparency

Access Transparency supports Vertex AI Search in preview.

For more information, see Enable Access Transparency in Enterprise Search.

Vertex AI Search (Enterprise Search): Citations for search with follow-ups

Citations indicate from which search results specific sentences in the summary are taken.

For more information, see Configure the summary.

Vertex AI Search (Enterprise Search): Ignore adversarial queries and non-summary seeking queries for search with follow-ups

Ignore adversarial queries can stop generation of summaries that are unsafe or violate policy.

Non-summary seeking queries stop generation of summaries that aren't helpful for some queries.

For more information, see Configure the summary.

Vertex AI Search (Enterprise Search): Additional languages supported

Search, snippets, and other features are now supported in the following languages:

  • Arabic
  • Chinese (Simplified)
  • Greek
  • Hebrew
  • Japanese
  • Korean
  • Polish
  • Russian

See Languages.

Virtual Private Cloud

Private Service Connect backends support using an external regional TCP proxy load balancer or an internal regional TCP proxy load balancer to access published services. These features are available in General Availability.

September 28, 2023

Assured Workloads

The IL2 compliance program is now generally available. For a list of IL2-compliant Google Cloud products, see the Supported products page.

BigQuery

The following BigQuery ML point-in-time lookup functions are now in preview. These functions let you specify a point-in-time cutoff when retrieving features for training a model or running inference, in order to avoid data leakage.

You can now use IAM conditions to control access to BigQuery resources. This feature is in preview.

Certificate Manager

Certificate Manager supports Mutual TLS (mTLS) authentication. This feature is generally available (GA).

Cloud Monitoring

You can now configure your alerting policy documentation with custom subject lines. For more information, see Configure the subject line of notifications.

Cloud SQL for PostgreSQL

The following pg_wait_sampling and rdkit flags are generally available:

pg_wait_sampling flags

  • cloudsql.enable_pg_wait_sampling: enable the pg_wait_sampling extension for Cloud SQL for PostgreSQL instances.
  • pg_wait_sampling.history_size: set the size of the in-memory ring buffer for history sampling, in terms of the number of samples.
  • pg_wait_sampling.history_period: set the time interval for history sampling, in milliseconds.
  • pg_wait_sampling.profile_period: set the time interval for profile sampling for wait events, in milliseconds.
  • pg_wait_sampling.profile_pid: specify whether the wait profile that accumulates samples for each process and waits event is collected for each process or for all processes.
  • pg_wait_sampling.profile_queries: specify whether the wait profile is collected for each query or for all queries.

rdkit flags

  • rdkit.tanimoto_threshold: set the threshold value for the Tanimoto similarity operator.
  • rdkit.dice_threshold: set the threshold value for the Dice similarity operator.
  • rdkit.do_chiral_sss: specify whether stereochemistry is used in substructure matching.
  • rdkit.do_enhanced_stereo_sss: specify whether enhanced stereo is used in substructure matching.
  • rdkit.sss_fp_size: set the size of the fingerprint used for substructure screening, in bits.
  • rdkit.morgan_fp_size: set the size of morgan fingerprints, in bits.
  • rdkit.featmorgan_fp_size: set the size of featmorgan fingerprints, in bits.
  • rdkit.layered_fp_size: set the size of layered fingerprints, in bits.
  • rdkit.rdkit_fp_size: set the size of rdkit fingerprints, in bits.
  • rdkit.hashed_torsion_fp_size: set the size of topological torsion bit vector fingerprints, in bits.
  • rdkit.hashed_atompair_fp_size: set the size of atom pair bit vector fingerprints, in bits.
  • rdkit.reaction_sss_fp_size: set the size of the structural chemical reaction fingerprint, in bits.
  • rdkit.reaction_difference_fp_size: set the size of the difference chemical reaction fingerprint, in bits.
  • rdkit.reaction_sss_fp_type: specify the type of structural chemical reaction fingerprint.
  • rdkit.reaction_difference_fp_type: specify the type of difference chemical reaction fingerprint.
  • rdkit.ignore_reaction_agents: specify whether agents of a chemical reaction are taken into account.
  • rdkit.agent_FP_bit_ratio: specify the weight of the impact of agents contained in a chemical reaction fingerprint.
  • rdkit.move_unmmapped_reactants_to_agents: specify whether unmapped reactant agents of a chemical reaction are taken into account.
  • rdkit.threshold_unmapped_reactant_atoms: set the ratio of allowed unmapped reactant atoms.
  • rdkit.init_reaction: specify whether the reaction is ready for use.
  • rdkit.difference_FP_weight_agents: specify the weight factor for agents compared to reactants and products in reaction difference fingerprints.
  • rdkit.difference_FP_weight_nonagents: specify the weight factor for reactants and products compared to agents in reaction difference fingerprints.
  • rdkit.avalon_fp_size: set the size of avalon fingerprints, in bits.
Cloud Storage

Beginning Oct 30, 2023, Cloud Storage will change how it enforces egress bandwidth quotas.

  • Instead of using the same default value for all projects, egress bandwidth quotas will depend on each project's history, such whether the billing account is in good standing.
  • For most projects, egress bandwidth quotas will either remain unchanged or will increase.
  • Once this change takes effect, you can view your project's egress bandwidth quotas in the Console.
Dataproc

New Dataproc on Compute Engine subminor image versions:

  • 2.0.78-debian10, 2.0.78-rocky8, 2.0.78-ubuntu18
  • 2.1.26-debian11, 2.1.26-rocky8, 2.1.26-ubuntu20, 2.1.26-ubuntu20-arm

Upgraded the Cloud Storage connector version to 2.2.17 in the latest 2.0 and 2.1 Dataproc on Compute Engine image versions.

Upgraded Hive version from 3.1.2 to 3.1.3 in the latest Dataproc on Compute Engine 2.0 image version.

Google Cloud Deploy

When you create a release using the gcloud CLI version 445, 446, or 447, you might encounter an error where gcloud requires the clouddeploy.config.get permission. To fix this issue, upgrade to gcloud CLI version 448 or greater.

Policy Intelligence

After January 15, 2024, some Policy Intelligence features will only be available for customers with organization-level activations of Security Command Center. For more information, see Billing questions.

Using Policy Troubleshooter to troubleshoot deny policies is generally available.

SAP on Google Cloud

SAP HANA Fast Restart enabled using Terraform

SAP HANA Fast Restart is enabled when you deploy SAP HANA on Google Cloud using the sap_hana or sap_hana_ha Terraform module, version 202309280828 or later. The fast restart option is enabled through the enable_fast_restart Terraform argument, which by default is set to true.

For more information, see the deployment guide for your SAP HANA scenario.

VPC Service Controls

Preview stage supported for the following integration:

September 27, 2023

Apigee Advanced API Security

On September 27, 2023, we released an updated version of Advanced API Security.

Public preview of Advanced API Security Alerting

Advanced API Security's new alerting feature lets you create alerts for events related to API security using Google Cloud Monitoring, such as changes to your security scores or incidents involving detected API abuse. You can configure alerts to send you notifications by email or other channels when these events occur, so you can take action to counteract them.

App Engine standard environment Java

If you need to re-enable deployments for Java 8 apps past the legacy runtime end of support date (starting January 30, 2024), you can define a new organization policy with constraints/appengine.runtimeDeploymentExemption. This policy constraint can be used before the end of support date. Learn more about enabling deployments for runtimes reaching end of support.

App Engine standard environment PHP

If you need to re-enable deployments for PHP 5.5 apps during the legacy runtime end of support period (starting January 30, 2024), you can define a new organization policy with constraints/appengine.runtimeDeploymentExemption. This policy constraint can be used before the end of support date. Learn more about enabling deployments for runtimes reaching end of support.

App Engine standard environment Python

If you need to re-enable deployments for Python 2.7 apps during the legacy runtime end of support period (starting January 30, 2024), you can define a new organization policy with constraints/appengine.runtimeDeploymentExemption. This policy constraint can be used before the end of support date. Learn more about enabling deployments for runtimes reaching end of support.

Chronicle SOAR

Release Notes 6.2.35

GA - 8th October

Risk Score and Severity added

Two new information fields have been added to the Alert Details widget which appears in the Alert overview tab. These are Risk score and Severity. These values will only be populated when using the Google Chronicle SIEM connector.

Export/Import for Advanced Reports (using Looker) now supported both in the platform and using new APIs.

This enables customers to create reports on their staging environment and then import the template without the data into their production environment.

In the platform, the import is at the top of the Reports queue while the export icon is inside the actual report itself. The report file is in yaml format.

New APIs are as follows:
/api/external/v1/looker/report/import

/api/external/v1/looker/export/{report_id}

Playbook name drop-down not showing any playbook names in various Playbook actions (ID #00248732)

Placeholders located inside other placeholders not always picked up correctly (ID #00244133)

Case title says unknown (ID #00249611)

GetCaseFullDetails and GetWallActivitiesV2 API endpoints failing to return results (ID # 00243878)

Cloud Firewall

You can use fully qualified domain name (FQDN) objects in firewall policy rules to filter incoming or outgoing traffic from specific domain names. This feature is available in General Availability.

Cloud Interconnect

Dedicated Cloud Interconnect support is available in the following colocation facilities:

  • Cologix MTL10-H - Montréal

For more information, see the Locations table.

Cloud Run

Long running jobs greater than 1 hour are at general availability (GA).

Cloud TPU

Cloud TPU now supports TensorFlow 2.14.0. For more information see the TensorFlow 2.14.0 release notes.

Compute Engine

Creating a reservation or future reservation request by using an instance template that specifies an A2, C3, or G2 machine type causes errors or problems with consumption. For more information, see Known issues.

Container Optimized OS

cos-109-17800-0-45

Kernel Docker Containerd GPU Drivers
COS-6.1.42 v24.0.5 v1.7.2 v535.104.05(default, latest),v470.199.02(R470 for K80 compatibility)

Promoted to stable.

Transfer Appliance

New Appliance setup experience is released. Users can use the Google Cloud console to fully set up permissions for the appliance and receive the credentials.

September 26, 2023

Cloud Load Balancing

Regional external HTTP(S), internal HTTP(S), and the regional internal TCP proxy load balancers now use distributed Envoy health checks instead of Google's centralized health checking mechanism. Envoy health check probes originate from the proxy-only subnet associated with the load balancer.

For more details, see the Hybrid NEG documentation: Distributed Envoy health checks.

This feature is available in General availability.

Cloud SQL for MySQL

Cloud SQL supports the preview version of the enable-high-availability recommender. This service proactively generates recommendations that help you bring your important instances within SLA by providing data redundancy. This might be helpful during a zonal outage or when an instance runs out of memory. For more information, see Improve instance reliability by enabling high availability.

Cloud SQL for PostgreSQL

Cloud SQL supports the preview version of the enable-high-availability recommender. This service proactively generates recommendations that help you bring your important instances within SLA by providing data redundancy. This might be helpful during a zonal outage or when an instance runs out of memory. For more information, see Improve instance reliability by enabling high availability.

Cloud SQL for SQL Server

Cloud SQL supports the preview version of the enable-high-availability recommender. This service proactively generates recommendations that help you bring your important instances within SLA by providing data redundancy. This might be helpful during a zonal outage or when an instance runs out of memory. For more information, see Improve instance reliability by enabling high availability.

Cloud Storage

You can now control the mounting behavior of Cloud Storage FUSE by using a configuration file instead of global options.

Cloud Storage FUSE is now available for use on ARM64-based machines.

Compute Engine

Preview: c3d-standard, c3d-highmem, c3d-highcpu, and c3d-standard-lssd virtual machines are available in the following regions:

  • Council Bluffs, Iowa, North America, us-central1
  • Moncks Corner, South Carolina, North America, us-east1
  • Ashburn, Virginia, North America , us-east4
  • St. Ghislain, Belgium, Europe, europe-west1
  • Eemshaven, Netherlands, Europe, europe-west4
  • Jurong West, Singapore, Asia, asia-southeast1

See the General purpose machines document for details.

Config Controller

Config Controller now uses the following versions of its included products:

Container Optimized OS

cos-101-17162-279-55

Kernel Docker Containerd GPU Drivers
COS-5.15.120 v20.10.24 v1.6.21 v470.199.02(default),v535.104.05

Fixed an issue where IPv6 networking would fail under high CPU load.

Upgraded go from 1.19.13 to 1.20.8. This also required upgrading dev-go/go-tools to 0.3.0. Fixed CVE-2023-39318 and CVE-2023-39319.

Fixed CVE-2023-40217 in the dev-lang/python package.

Fixed CVE-2023-4921 in the Linux kernel.

Fixed CVE-2023-4569 in the Linux kernel

Fixed CVE-2023-4623 in the Linux kernel.

Fixed CVE-2023-4622 in the Linux kernel.

cos-beta-109-17800-0-45

Kernel Docker Containerd GPU Drivers
COS-6.1.42 v24.0.5 v1.7.2 v535.104.05(default),v470.199.02(R470)

Fixed an issue where IPv6 networking would fail under high CPU load.

Fixed CVE-2023-40217 in the dev-lang/python package.

Updated dev-lang/go to 1.21.1. This fixes CVE-2023-39318 and CVE-2023-39319.

Fixed CVE-2023-4921 in the Linux kernel.

Fixed CVE-2023-4569 in the Linux kernel.

cos-dev-113-17927-0-0

Kernel Docker Containerd GPU Drivers
COS-6.1.52 v24.0.5 v1.7.3 v535.104.05(default, latest),v470.199.02(R470 for K80 compatibility)

Fixed CVE-2023-32636, CVE-2023-29499, CVE-2023-32643, CVE-2023-32665, CVE-2023-32611 in glib and glib-utils.

Fixed CVE-2023-40217 in the dev-lang/python package.

Updated dev-lang/go to 1.21.1. This fixes CVE-2023-39318 CVE-2023-39319, CVE-2023-39320, CVE-2023-39321, and CVE-2023-39322.

Fixed CVE-2023-4921 in the Linux Kernel.

cos-105-17412-156-63

Kernel Docker Containerd GPU Drivers
COS-5.15.120 v23.0.3 v1.7.2 v470.199.02(default),v535.104.05

Fixed CVE-2023-40217 in the dev-lang/python package.

Fixed CVE-2023-4921 in the Linux kernel.

Fixed CVE-2023-4569 in the Linux kernel.

Fixed CVE-2023-4623 in the Linux kernel.

cos-93-16623-461-35

Kernel Docker Containerd GPU Drivers
COS-5.10.177 v20.10.24 v1.6.20 v450.248.02(default),v470.199.02(R470),v535.104.05

Fixed CVE-2023-4921 in the Linux kernel.

Fixed CVE-2023-4623 in the Linux kernel.

Fixed CVE-2023-4622 in the Linux kernel.

cos-97-16919-353-50

Kernel Docker Containerd GPU Drivers
COS-5.10.186 v20.10.24 v1.6.21 v470.199.02(default),v535.104.05

Fixed an issue where IPv6 networking would fail under high CPU load.

Fixed CVE-2023-4921 in the Linux kernel.

Fixed CVE-2023-4623 in the Linux kernel.

Migrate to Virtual Machines

Preview: Migrate to Virtual Machines lets you migrate the disks of source virtual machine (VM) instances to Persistent Disk volumes on Google Cloud with the following options:

  • Migrate the Persistent Disk volumes without attaching them to a VM instance
  • Create a new VM instance and attach the migrated Persistent Disk volumes to it

September 25, 2023

Advisory Notifications

Advisory Notifications lets you opt in to or out of optional notification types. For more information, see Opt in to or out of notifications.

Anthos clusters on bare metal

Release 1.15.5

Anthos clusters on bare metal 1.15.5 is now available for download. To upgrade, see Upgrading Anthos on bare metal. Anthos clusters on bare metal 1.15.5 runs on Kubernetes 1.26.

Fixed an issue to prevent cluster upgrades from starting on a node before either all Pods have been drained or the Pod draining timeout has been reached.

The following container image security vulnerabilities have been fixed in 1.15.5:

Known issues:

For information about the latest known issues, see Anthos clusters on bare metal known issues in the Troubleshooting section.

Apigee Advanced API Security

On September 25, 2023 we release an updated version of Advanced API Security.

If a flow hook contains any FlowCallout policies, Advanced API Security scores now processes all policies from the shared flows that the flow callouts are pointing to for scoring. Further callout chaining is not supported.

Bug ID Description
300849647 Fixed a bug in Security scores for proxies that don't contain any policies in the categories authorization, mediation, threat or CORS .
Apigee UI

On September 25, 2023, we released an updated version of the Apigee UI.

This release includes a new Overview page for Apigee API Management in the Google Cloud console.

From the Overview page, you can:

For more information, see UI overview.

BigQuery

Materialized views over BigLake metadata cache-enabled tables can reference structured data stored in Cloud Storage. These materialized views function like materialized views over BigQuery-managed storage tables, including the benefits of automatic refresh and smart tuning. This feature is now generally available (GA).

Authorized stored procedures are now generally available (GA). This feature lets you share stored procedures with users or groups without giving them direct access to the underlying tables.

Support for Google AdWords is now deprecated by the BigQuery Data Transfer Service. For information about transfers from Google Ads, see Google Ads transfers.

Cloud Bigtable

A weekly digest of client library updates from across the Cloud SDK.

Java

Changes for google-cloud-bigtable

2.25.2 (2023-09-18)

Bug Fixes
  • Check that all bulk mutation entries are accounted for (#1907) (#1923) (e4db745)
  • Make sure to propagate the response when throttling is enabled (#1908) (#1922) (7ec5dd5)
Miscellaneous Chores
Cloud SQL for MySQL

All Cloud SQL for MySQL Enterprise Plus edition instances now support up to 35 days of retained transaction logs for point-in-time recovery.

The rollout of the following minor version is currently underway:

MySQL 5.7.42 is upgraded to MySQL 5.7.43. For more information, see MySQL 5.7 Release Notes.

If you use a maintenance window, then the updates to the minor versions happen according to the timeframe that you set in the window. Otherwise, the updates occur within the next few weeks. The new maintenance version is [MySQL version].R20230909.02_00. The details of the security fixes applied as part of this release will be published in the MySQL maintenance changelog.

To learn how to check your maintenance version, see Self-service maintenance. To find your maintenance window or to manage maintenance updates, see Find and set maintenance windows.

Cloud Spanner

A monthly digest of client library updates from across the Cloud SDK.

Java

Changes for google-cloud-spanner

6.46.0 (2023-09-06)

Features
Bug Fixes
Documentation

6.47.0 (2023-09-12)

Features
  • Add devcontainers for enabling github codespaces usage. (#2605) (a7d60f1)
  • Disable dynamic code loading properties by default (#2606) (d855ebb)
Bug Fixes
  • Add reflection configurations for com.google.rpc classes (#2617) (c42460a)
  • Avoid unbalanced session pool creation (#2442) (db751ce)
Dependencies
  • Update dependency com.google.cloud:google-cloud-shared-dependencies to v3.15.0 (#2615) (ac762fb)

Node.js

Changes for @google-cloud/spanner

7.0.0 (2023-08-30)

⚠ BREAKING CHANGES
  • upgrade to Node 14 (#1890)
Bug Fixes
Miscellaneous Chores
Contact Center AI Platform

External Authentication/Single Sign On (SSO) has been removed from the CCAI Platform Portal and are now available in the CCAI Platform Console. For details, see the Create a CCAI Platform instance documentation.

Mobile release 2.2

  • iOS and Android SDK content cards: You can use content cards to deliver specific messages to end-users during virtual agent chats. Content cards have customizable components including titles, text, carousel messages, banners, and much more. You can also embed a link that the end-user accesses when they click on the card. For example, if you have a list of restaurant options, you might create a content card for each one with a deep link that brings the user to the restaurant's website when they click.

  • iOS SDK, improved accessibility: The mobile iOS SDK now fulfills the following Web Content Accessibility Guidelines (WCAG) criteria for improved accessibility:

    • Identify Input Purpose: Ensure that each input field is programmatically determinable, allowing users to autofill inputs.
    • Identify Purpose: Ensure that the purpose of many elements on a page can be programmatically determined, making it easier for agents to extract and present the purpose to users using different modalities.
    • Parsing: Ensure that there are no major code errors that affect accessibility so that agents can accurately interpret and parse content using assistive technologies.
    • Name, Role, Value: Ensure that assistive technologies can gather information about, activate (or set), and keep up to date on the status of user interface controls in the content.
    • Status Messages: Ensure that users of assistive technologies are notified when content is updated dynamically without receiving visual focus.
  • Mobile bug fixes:

    • Fixed an intermittent issue where quick reply buttons could be pressed outside their boundaries.
    • Fixed an issue where a virtual agent's avatar icon sometimes was not displayed alongside their message.

ServiceNow enhanced capabilities: This release brings new capabilities to the ServiceNow integration, including support for:

  • Default User: Reduced admin permission requirements.
  • More flexible field mapping and property assignment configuration options.
  • Support for new CRM features:
    • Surveys
    • Agent Status inheritance
    • Custom Callback number
    • Improved support for OAuth authentication, for example now including admin tokens.

Assign virtual agent transfers to the top-level queue: You can now assign a virtual agent to transfer to a top-level queue. The virtual agent will navigate consumers through any active sub and leaf queue options. If a top-level queue has no available leaf queues or is incorrectly configured, the IVR fallback will redirect the caller to the previous queue (if human agents are available) or provide an error message before disconnecting (if the top-level queue has no available agents).To enable this feature:

  • Enter the top-level queue ID in the Dialogflow destination (you can find parent queue IDs in the Virtual Agent queue menu settings).
  • Ensure all sub and leaf queues are active.

Chat API suite: A new set of APIs are now available that allow you to customize your chat experience. As a part of this feature, webhooks are available for receiving notifications about events that occur during the chat interaction. You can enable and manage them in Developer Settings > Webhooks. The new chat endpoints allow you to:

  • Create a chat, send and receive plain text messages, and end the chat with both agents and virtual agents.
  • Exchange messages with media attachments such as pictures, videos, and documents.

Apps API: Change agent status: Two new endpoints are now available to manage agent statuses:

  • GET /apps/api/v1/agent_statuses: Retrieve current agent statuses.
  • POST /apps/api/v1/agent_statuses: Update/change an agent status.

These endpoints allow you to modify agent statuses. You can change an agent's status from Available to any custom status and vice versa. Attempting to change an agent's status to a system status, such as In-Call, will result in an error. Similarly, attempting to change an agent's status from any system status will prompt an error message. These endpoints support bulk status updates, allowing you to update statuses for an entire team or selected agents simultaneously.

NICE QM integration: CCAI Platform now supports an out-of-the-box data export for NICE QM. You can enable this feature in Developer Settings > Session Data Export > NICE Integration. The following information is required to enable the NICE QM data export:

  • NICE API Endpoint
  • API Authentication credentials

After the integration is enabled, you can enable session data related to IVR call events and agent login/logout events in your NICE integration.

Missed chat / Unresponsive status (while in-chat): Improved handling of agent statuses when a session cast to an agent fails due to network issues.

  • When a chat/call is cast to an agent but fails due to network or permission issues, the agent's next status will be moved to Unresponsive regardless of the status they're currently in.
  • If a call/chat is cast to an agent but the agent fails to pick up, the agent's next status will be moved to Missed Chat status regardless of the status they're currently in.

ANI retention management: You can now enable ANI storage by contacting Support.

Permission for access to call recording/chat transcript files: A new role permission allows you to define whether users can have access to call recordings and/or chat transcripts when they are stored in external storage and without a CRM. When inactive, users won't be able to access these files from either the Completed Calls or Chats monitoring pages or associated downloadable reports. Shared links to these files fall under the same permissions.

Disable Whatsapp for CCAI Platform: The Whatsapp flag for CCAI Platform is disabled until we have OEM compatibility for Whatsapp.

CRM record autoload: A new setting is available to automatically update the CRM when an agent navigates between multiple active chats. This eliminates the need for the agent to manually search and load the corresponding CRM record each time they switch between chats. To enable this setting, go to Settings > Chat > Global Settings > Global Chat Settings and select the following checkbox: Automatically load CRM Record when switching between chat tabs.

POST events, chat message events: Two new events added to the existing agent chat adapter events:

  • Chat Inbound Message: Event indicating that a new consumer message was received; includes the message content.
  • Chat Outbound Message: Event indicating that a new agent message was sent; includes the message content.

Restrict international calling by area code, short code, phone number: The international calling configuration now includes the option to limit calls by area code, short code, and phone number. You can extend this configuration to a specific agent or have it applied as a rule to all agents.

MS Dynamics, object type Contact: You can now populate different fields on a "Case" object, when a "Contact" Object Type is used. The default action within MS Dynamics is to fill in the customer information only when a Case is created. This updated setting allows the contact field to be populated with the customer information from a Contact object at the same time. To enable this feature navigate to Developer Settings to access your MS Dynamics configuration. In the Account Lookup settings, select Contact under Object Type.

Call settings, post-call session transfers: You can now set up a cold transfer to a virtual agent at the end of a call. This configuration allows you to set up an automated workflow, such as a post-call survey. To enable this feature, go to Settings > Call Settings and toggle the Post-call session transfers to ON.

New permissions added to historical reports: You can now limit access to assigned teams only or assigned queues only. For example, if you apply the assigned teams only permission option, only data for agents on that user's team(s) will be downloaded. There is also a new permission that allows Admins to manage who has access to the Session Data report, in addition the assigned team only permission.

Fixed an issue that occasionally caused the Queue Structure Edit page to jump places.

Fixed an issue where a holiday was not respected by queues if it was configured to be observed on the last occurrence of the month.

Dialogflow

Dialogflow CX now provides the call companion feature in preview, which provides a mobile-based user interface that supplements a phone call with an agent.

Document AI

We are launching an RC version of the pretrained-invoice-v1.5-2023-09-15 invoice processor. It includes:

  • Improved base-entity extraction model for documents in English.
  • Line-item grouping quality improvements.
  • Better support for multi-line, multi-segment entities such as addresses and line-item descriptions.
  • Enforcement of occurrence type OPTIONAL_ONCE / REQUIRED_ONCE for properties of nested entities.
  • Updated OCR engine.
Document AI Warehouse

Add the doc_ai_document_type and doc_ai_document_path fields to the Pipeline API Cloud Function request.

Support "store_document_metadata_only" boolean flag in the Pipeline API Cloud Function response.

Firestore Firestore in Datastore mode Google Cloud Marketplace Partners

Your Customer Insights reports contain a new field, transaction_type. For more details, see the field's documentation.

Pub/Sub

A weekly digest of client library updates from across the Cloud SDK.

Node.js

Changes for @google-cloud/pubsub

3.7.5 (2023-09-20)

Bug Fixes

Java

Changes for google-cloud-pubsub

1.125.2 (2023-09-18)

Dependencies
  • Update dependency org.graalvm.buildtools:junit-platform-native to v0.9.27 (#1730) (687a855)
  • Update dependency org.graalvm.buildtools:native-maven-plugin to v0.9.27 (#1731) (403b7e7)
Vertex AI Workbench

Vertex AI Workbench instances are now generally available (GA). Vertex AI Workbench instances combine features from managed notebooks and user-managed notebooks to provide a robust data science solution. Supported features include:

  • Idle timeout
  • BigQuery and Cloud Storage integrations
  • End-user and service account authentication
  • VPC Service Controls
  • Customer managed encryption keys (CMEK) and Cloud External Key Manager (Cloud EKM)
  • Health status monitoring
  • Scheduled notebook runs
  • Dataproc integration

To get started, see Introduction to Vertex AI Workbench instances.

September 22, 2023

Apigee Integration

Vertex AI - Predict task

Starting with this release, Apigee Integration provides the Vertex AI - Predict task that lets you perform online predictions on your ML models.

Application Integration

Vertex AI - Predict task

Starting with this release, Application Integration provides the Vertex AI - Predict task that lets you perform online predictions on your ML models.

Assured Workloads

The CJIS compliance program now supports the following products. See Supported products for more information:

  • Cloud Run
  • Cloud Identity
  • Google Workspace Admin Console
Bare Metal Solution

You can now view the pod for your Bare Metal Solution servers, networks, volumes, and NFS Shares. This feature is generally available (GA).

Compute Engine

Preview: Compute Engine API now enforces the Filtered list cost overhead quota, which limits the number of resources to be filtered out from server-side *.list and *.aggregatedList methods.

The quota is charged against the following metrics:

  • Global: compute.googleapis.com/filtered_list_cost_overhead
  • Regional: compute.googleapis.com/filtered_list_cost_overhead_per_region

For more information, see Rate quotas and best practices for list filtering.

Preview: You can now view the organization-wide patch status dashboard and OS policy compliance reports by using VM Manager.

The Google Cloud console labels for OS patch management and OS configuration management on VM Manager pages have been renamed to Patch and OS policies respectively.

Dataproc

New Dataproc on Compute Engine subminor image versions:

  • 2.0.77-debian10, 2.0.77-rocky8, 2.0.77-ubuntu18
  • 2.1.25-debian11, 2.1.25-rocky8, 2.1.25-ubuntu20, 2.1.25-ubuntu20-arm

In the latest Dataproc on Compute Engine 2.0 and 2.1 image versions, unset the CLOUDSDK_PYTHON variable to allow the gcloud command-line tool to use its bundled Python interpreter.

Fixed Jupyter notebooks bug that made Scala compilation errors invisible with the Toree kernel in Dataproc on Compute Engine 2.1 images.

Resource Manager

Tag key and value short names can now have a maximum length of 256 characters. For more information, see Tags overview.

Vertex AI Search and Conversation

Vertex AI Search (Enterprise Search): Third-party data connectors

You can set up your Vertex AI Search data stores to sync with data from Jira, Confluence, or Salesforce.

This feature is in private preview. To try this feature, contact your Google account team to find out if you qualify.

For more about setting up a connection to third-party data, see Create an Enterprise Search data store.

September 21, 2023

AlloyDB for PostgreSQL

AlloyDB now offers basic instances, which are primary instances containing only one node, in one zone. Basic instances provide a lower-cost alternative to highly available instances, and are appropriate for use in non-production environments that don't require high availability.

Database server compatibility with PostgreSQL version 15 is now available in Preview. You can create a cluster with PostgreSQL 15 compatibility.

Anthos Config Management

Supported configuring the period that Config Sync waits before re-pulling the latest chart with the field spec.helm.period in RootSync or RepoSync. The default is 1 hour. For more information, see RootSync and RepoSync fields.

Fixed an issue related to metric labels commit and type that could cause an increase in Google Cloud Monitoring metric write throughput. The issue was resolved by preventing high-cardinality labels commit and type from being sent to Google Cloud Monitoring. The two labels were introduced in Anthos Config Management version 1.15.0. For information on the labels, see Config Sync Metric Labels.

Fixed a repeating error in the otel-collector deployment log that has been occuring since Anthos Config Management version 1.15.0.

The constraint template library's K8sRestrictRbacSubjects template now returns all violation messages for ClusterRoleBinding or RoleBinding with more than one violation. For reference, see Constraint template library.

Anthos clusters on bare metal

Release 1.16.1

Anthos clusters on bare metal 1.16.1 is now available for download. To upgrade, see Upgrading Anthos on bare metal. Anthos clusters on bare metal 1.16 runs on Kubernetes 1.27.

Supported node pool versions:

If you use selective worker node pool upgrades to upgrade a cluster to version 1.16.1, the following versions are supported for the worker node pools:

  • 1.16.1
  • 1.16.0
  • 1.15.4
  • 1.15.3
  • 1.15.2
  • 1.15.1
  • 1.15.0
     

Functionality changes:

  • Added the optional userClaim field to the ClientConfig custom resource definition bundled with Anthos clusters on bare metal. This change improves support for Azure AD integrations with Anthos Identity Service.

  • Updated constraint on NodePool spec.upgradeStrategy.concurrentNodes to be the smaller of either 15 nodes or 50% of the size of the node pool.

Fixes:

  • Fixed an issue where etcd blocked upgrades due to an incorrect initial-cluster-state.

  • Fixed an issue that blocked upgrades to version 1.16 for clusters that have secure computing mode (seccomp) disabled.

  • Fixed an issue to prevent cluster upgrades from starting on a node before either all Pods have been drained or the Pod draining timeout has been reached.

  • Fixed an issue where the memory resource requests value wasn't set properly for etcd-events.

Fixes:

The following container image security vulnerabilities have been fixed in 1.16.1:

Known issues:

For information about the latest known issues, see Anthos clusters on bare metal known issues in the Troubleshooting section.

Blockchain Node Engine

On September 21, 2023 Blockchain Node Engine released a limited preview version of the software. This release adds the Polygon blockchain node option. Access to the user interface and APIs is limited to specific customers until the GA release.

Cloud Run

Cloud Run integrations (Preview) are now available in the following regions:

  • asia-northeast1
  • asia-northeast2
  • asia-south1
  • asia-southeast2
  • australia-southeast1
  • europe-central2
  • europe-north1
  • europe-west2
  • europe-west3
  • northamerica-northeast1
  • southamerica-east1
  • us-east4
  • us-west2
  • us-west3
Cloud SQL for PostgreSQL

The rollout of the oracle_fdw extension, version 1.2 is underway. This extension provides a foreign data wrapper for accessing Oracle databases easily and efficiently. For more information, see Configure PostgreSQL extensions.

The rollout of the following minor versions, extension versions, and plugin versions is underway:

Minor versions

  • 11.19 is upgraded to 11.21.
  • 12.14 is upgraded to 12.16.
  • 13.10 is upgraded to 13.12.
  • 14.7 is upgraded to 14.9.
  • 15.2 is upgraded to 15.4.

Extension and plugin versions

  • orafce is upgraded from 3.24.4 to 3.25.1.
  • pglogical is upgraded from 2.4.2 to 2.4.3.
  • pgvector is upgraded from 0.4.2 to 0.5.0.
  • PostGIS is upgraded from 3.2.3 to 3.2.5.

If you use a maintenance window, then the updates to the minor, extension, and plugin versions happen according to the timeframe that you set in the window. Otherwise, the updates occur within the next few weeks.

The new maintenance version is [PostgreSQL version].R20230830.01_00. To learn how to check your maintenance version, see Self service maintenance. To find your maintenance window or to manage maintenance updates, see Find and set maintenance windows.

Compute Engine

Generally available: Instance templates are available as both regional and global resources. To reduce cross-region dependency or to achieve data residency, use a regional instance template to create virtual machines (VM), managed instance groups (MIG), or reservations. For more information, see Regional and global instance templates.

Generally available: Autohealing in managed instance groups (MIG) supports regional health checks. To reduce cross-region dependency or to achieve data residency, use a regional health check. For more information, see Set up an application health check and autohealing.

Document AI

Launched Document AI Enterprise Document OCR v2.0 and OCR add ons in Preview.

Enterprise Document OCR launched a Release Candidate, pretrained-ocr-v2.0-2023-06-02, which includes:

  • Upgraded OCR model, optimized for various document use cases.
  • Visual-element detector for boxed characters, which can increase quality up to 10% for documents with text boxes.

For more details, see the documentation, including the user guide.

OCR add ons are available from the Enterprise Document OCR processor when using pretrained-ocr-v2.0-2023-06-02. These include:

  • Checkbox extraction: Detects and extracts status (marked/unmarked) in the Enterprise Document OCR response.
  • Math OCR: Identifies, recognizes, and extracts formulas from documents in LaTeX output format.
  • Font-style detection: Identifies word-level font properties, including type, style, handwriting, weight, and color.

For more details, see the documentation.

Google Kubernetes Engine

The Observability dashboards on the GKE Clusters List, Cluster Details, and Workload List pages are now customizable. Additionally, the Cluster Details dashboards can be customized across the entire project, or per-cluster for specific use cases.

When you create a LoadBalancer service in GKE, the Google Cloud controllers automatically create the following firewall rules and apply them to the GKE nodes to allow inbound connections on the Service port:

  • Internal load balancer with GKE subsetting or external load balancer with regional backend services (RBS): k8s2-[cluster-id]-[namespace]-[service-name]-[suffixhash]
  • Internal load balancer without GKE subsetting or external load balancer with target pool: k8s-fw-[loadbalancer-hash]

For clusters running version 1.25 or later, these rules now include the load balancer IP address in the destination ranges field to further control the inbound connections to the nodes. You can use the gcloud compute firewall-rules describe command to check a relevant firewall. The new field in the output is similar to the following:

destinationRanges:
- [LOADBALANCER_VIRTUAL_IP_ADDRESS]

For services that use externalIP, ensure you have firewall rules that allow traffic to the specified IP addresses.

Identity Platform

Time-based one-time password (TOTP) as an additional multi-factor authentication option is generally available (GA).

SAP on Google Cloud

Google Cloud's Agent for SAP version 2.6

Version 2.6 of Google Cloud's Agent for SAP is generally available (GA). This version introduces new options to configure the collection of Process monitoring metrics, and bug fixes for the collection of Workload Manager validation metrics.

For more information, see What's new with Google Cloud's Agent for SAP.

September 20, 2023

Apigee Integration

Application Integration is now available for your Google Cloud project. You can now use both Apigee Integration and Application Integration within the same Google Cloud project. For more information, see Using Application Integration.

BigQuery

The maximum number of rows for results returned in Connected Sheets has increased as follows:

  • Pivot tables increased from 30,000 to 50,000 rows
  • Data extracts increased from 25,000 to 50,000 rows
Chronicle

The following supported default parsers have changed. Each is listed by product name and log_type value, if applicable.

  • Akamai Cloud Monitor (AKAMAI_CLOUD_MONITOR)
  • AWS Cloudtrail (AWS_CLOUDTRAIL)
  • AWS WAF (AWS_WAF)
  • BIND (BIND_DNS)
  • Cisco Email Security (CISCO_EMAIL_SECURITY)
  • Cisco Firepower NGFW (CISCO_FIREPOWER_FIREWALL)
  • Cisco Umbrella Web Proxy (UMBRELLA_WEBPROXY)
  • Cloud DNS (N/A)
  • Cloud SQL (GCP_CLOUDSQL)
  • CSV Custom IOC (CSV_CUSTOM_IOC)
  • Desynova Contido (DESYNOVA_CONTIDO)
  • Elastic Windows Event Log Beats (ELASTIC_WINLOGBEAT)
  • F5 Advanced Firewall Management (F5_AFM)
  • Firewall Rule Logging (N/A)
  • FortiMail Email Security (FORTINET_FORTIMAIL)
  • GCP_KUBERNETES_CONTEXT (GCP_KUBERNETES_CONTEXT)
  • Guardicore Centra (GUARDICORE_CENTRA)
  • IBM Security Access Manager (IBM_SAM)
  • Jamf Protect Telemetry (JAMF_TELEMETRY)
  • Linux Auditing System (AuditD) (AUDITD)
  • Microsoft Azure Activity (AZURE_ACTIVITY)
  • Microsoft Graph API Alerts (MICROSOFT_GRAPH_ALERT)
  • Microsoft Powershell (POWERSHELL)
  • Netskope Web Proxy (NETSKOPE_WEBPROXY)
  • Office 365 (OFFICE_365)
  • Oracle Unified Directory (ORACLE_OUD)
  • Palo Alto Networks Firewall (PAN_FIREWALL)
  • SecureLink (SECURELINK)
  • Signal Sciences WAF (SIGNAL_SCIENCES_WAF)
  • Skybox Firewall Assurance (SKYBOX_FIREWALL_ASSURANCE)
  • SOTI MobiControl (SOTI_MOBICONTROL)
  • Stealthbits PAM (STEALTHBITS_PAM)
  • Thinkst Canary (THINKST_CANARY)
  • Unix system (NIX_SYSTEM)
  • Vectra Stream (VECTRA_STREAM)
  • VMware NSX (VMWARE_NSX)
  • VMware Tanzu Kubernetes Grid (VMWARE_TANZU)
  • Windows Defender ATP (WINDOWS_DEFENDER_ATP)
  • Windows Event (XML) (WINEVTLOG_XML)
  • Workspace Activities (WORKSPACE_ACTIVITY)
  • Zscaler (ZSCALER_WEBPROXY)
  • Zscaler CASB (ZSCALER_CASB)
  • ZScaler NGFW (ZSCALER_FIREWALL)

For details about changes in each parser, see Supported default parsers.

Cloud Healthcare API

A release was made. Updates may include general performance improvements, bug fixes, and updates to the API reference documentation.

Cloud Storage

The gcloud CLI now supports setting a user-defined prefix for naming temporary components of a parallel composite upload.

Container Optimized OS

cos-105-17412-156-59

Kernel Docker Containerd GPU Drivers
COS-5.15.120 v23.0.3 v1.7.2 v470.199.02(default),v535.104.05

Fixed an issue where IPv6 networking would fail under high CPU load.

Secret Manager

Secret Manager is now available in the following region:

  • me-central2

For more information, see Secret Manager locations.

Security Command Center

Attack path simulations support additional resources

The attack path simulation feature that generates attack exposure scores and attack paths for your high-value resources now supports the following additional Google Cloud resources:

  • aiplatform.googleapis.com/Dataset
  • aiplatform.googleapis.com/Featurestore
  • aiplatform.googleapis.com/MetadataStore
  • aiplatform.googleapis.com/Model
  • aiplatform.googleapis.com/TrainingPipeline
  • container.googleapis.com/Cluster

For more information, see Resource types supported in high-value resource sets.

Service Health

Cloud SQL and Cloud Bigtable support Impacted relevance.

Vertex AI Search and Conversation

Manually refresh your web pages

Call the recrawlUris method to manually refresh specific web pages in a data store with Advanced website indexing turned on. You can check the status of the recrawl operation by polling the operations.get method.

See Manually refresh your web pages.

September 19, 2023

Apigee UI

On September 19, 2023, we released an updated version of the Apigee UI.

GA release of the Apigee UI in Cloud console

This is the GA release of the Apigee UI in Cloud console, a new version of the Apigee UI that is integrated with the Google Cloud console. The new UI makes it easier to use Apigee, while also performing related tasks in the Cloud console.

Apigee X

On September 19, 2023, we released an updated version of Apigee X (1-11-0-apigee-5).

Bug ID Description
296296456 Implemented fix to ensure that continueOnError is honored in the SpikeArest policy.
229615887 The flow variable target.scheme is now set consistently with the target server URL.
78106145 Fixed issue in the RegularExpressionProtection policy to ensure that multiple JSONPaths elements in a JSON payload are checked.
294090782 Implemented fix to allow the Apigee runtime to connect to a target server using a wildcard CNAME that references a wildcard A record.
285592278 Fixed issue with deduction of recurring fees from prepaid balances.
N/A Upgraded infrastructure and libraries.
Bug ID Description
296506425, 295936113, 295925991, 295688738, 296110120, 281112632 Security fix for apigee-runtime.
This addresses the following vulnerabilities:
287218068 Fixed security vulnerability to prevent header injection using flow variables.
Artifact Registry

Artifact Registry is now available in the me-central2 region (Dammam, Saudi Arabia).

Batch

Documentation has been updated to reflect new default options for jobs that use GPUs:

  • Defining the machine type of the job's VMs is optional.
  • Jobs that use software from June 3, 2023 and later don't need to mount GPUs to containers.

For more information, see Create and run a job that uses GPUs.

Chronicle

Chronicle feed management contains the following changes for the Google Cloud Storage source type:

  • To create a new Google Cloud Storage feed, you must use the new service account. You are no longer required to use the following Chronicle global service account: 8911409095528497-0-account@partnercontent.gserviceaccount.com. The Chronicle global service account continues to be in use for existing Google Cloud Storage feeds.
  • In the feed management API, the fetchFeedServiceAccount method has been added to get a Chronicle service account, which you must use when you create a new Google Cloud Storage feed.
  • In the feed management UI, the new field Get service account has been added to get a Chronicle service account, which you must use when you create a new Google Cloud Storage feed.

Chronicle recently disclosed a security vulnerability. For more information, see the GCP-2023-028 security bulletin.

Chronicle Security Operations

Welcome to Chronicle Security Operations (SecOps), a Google Cloud service built as a specialized layer on top of Google's core infrastructure, designed for enterprises to privately retain, analyze, and search petabytes of security and network telemetry.

The SecOps platform provides instant context about suspicious and malicious activity. It can be used to detect threats, investigate the scope and cause of those threats, and provide remediation using pre-built integrations with enterprise workflow, response, and orchestration platforms.

The SecOps platform fuses key capabilities of Security Information and Event Management (SIEM), Security Orchestration, Automation, and Response (SOAR) and Threat Intelligence from Google Cloud, VirusTotal, and Mandiant.

The Chronicle SecOps platform enables security analysts to analyze and mitigate a security threat throughout its lifecycle by employing the following capabilities:

Collection: Data is ingested into the platform using software forwarders, parsers, connectors, and webhooks.

Detection: This data is aggregated, normalized using the Universal Data Model (UDM), and linked to detections and threat intelligence.

Investigation: Threats are investigated through case management, search, collaboration, and contextual mapping.

Response: Security analysts can respond quickly and provide resolutions using automated playbooks, incident management, and closed-loop feedback.

Cloud Asset Inventory

The following resource types are now publicly available through the analyze policy APIs (AnalyzeIamPolicy and AnalyzeIamPolicyLongrunning).

  • Cloud Tasks

    • cloudtasks.googleapis.com/Queue
  • Organization Policy

    • orgpolicy.googleapis.com/CustomConstraint
Cloud Bigtable

Cloud Bigtable is available in the me-central2 (Dammam) region. For more information, see Bigtable locations.

Cloud Data Loss Prevention

Sensitive Data Protection is available in me-central2 (Dammam). For more information, see Sensitive Data Protection locations.

Cloud Run

The following new region is now available: me-central2.

Cloud SQL for MySQL

Support for me-central2 (Dammam) region.

Cloud SQL for PostgreSQL

Support for me-central2 (Dammam) region.

Cloud SQL for SQL Server

Support for me-central2 (Dammam) region.

Cloud Spanner

You can create Cloud Spanner regional instances in Dammam, Saudi Arabia (me-central2).

Cloud Storage

Cloud Storage is now available in Dammam, Saudi Arabia (me-central2 region).

Cloud VPN

Cloud VPN is now available in region me-central2 (Dammam, Saudi Arabia).

Pricing is available on the Cloud VPN pricing page.

Compute Engine

Generally available: Dammam, Kingdom of Saudi Arabia, Middle East me-central2-a,b,c has launched with E2, N2, N2D, and T2D VMs in all three zones. See the Dammam region access document to learn more.

Container Optimized OS

cos-105-17412-156-57

Kernel Docker Containerd GPU Drivers
COS-5.15.120 v23.0.3 v1.7.2 v470.199.02(default),v535.104.05

Updated cos-gpu-installer to v2.1.8.

Fixed CVE-2023-4015, CVE-2023-4622 in the linux kernel.

Data Catalog

Data Catalog is available in the me-central2 (Dammam) region.

For more information, see Regions.

Dataflow

Dataflow is now available in Dammam, Saudi Arabia (me-central2).

Dataproc

Dataproc is now available in the me-central2 region (Dammam, Saudi Arabia).

Dialogflow

Dialogflow CX intent import/export and training phrase import/export are now generally available.

Google Cloud Deploy

Cloud Deploy now supports workforce identity federation.

Google Kubernetes Engine

The me-central2 region in Dammam, Saudi Arabia is now available.

Memorystore for Memcached

Added new Memorystore for Memcached region: Dammam (me-central2).

The Version Upgrade feature is now Generally Available on Memorystore for Memcached.

Memorystore for Redis

Added new Memorystore for Redis region: Dammam (me-central2).

Network Connectivity Center

The issue that you cannot get the status of a long-running operation for a spoke without the networkconnectivity.operations.get IAM permission in the spoke project is now resolved.

The new API and gcloud commands are documented on the Review proposed VPC spokes page. The previous API methods and gcloud commands are now deprecated.

Pub/Sub

Pub/Sub is now available in Dammam, Saudi Arabia (me-central2).

A weekly digest of client library updates from across the Cloud SDK.

Node.js

Changes for @google-cloud/pubsub

4.0.6 (2023-09-15)

Bug Fixes
  • Bump the minimum gax up to 4.0.4 to get grpc-js fixes (#1829) (cc86e2b)
  • deps: Update dependency @opentelemetry/semantic-conventions to ~1.17.0 (#1824) (679c6b8)

3.7.4 (2023-09-08)

Bug Fixes
  • Always fill the topic and sub names when creating from a PubSub object (#1816) (ddf8b8a)
  • Make retry policy back off more aggressively for RPCs that retry RESOURCE_EXHAUSTD (#1806) (bfcf523)
  • Set grpc keepalive time|outs by default (#1814) (dedfdea)
  • Simplify logic for HTTP/1.1 REST fallback option (#1809) (ee09b69)

Java

Changes for google-cloud-pubsub

1.125.1 (2023-09-14)

Dependencies
  • Update actions/checkout action to v4 - abandoned (#1719) (b82f15a)
  • Update dependency com.google.cloud:google-cloud-bigquery to v2.32.0 (#1725) (f40f09a)

1.125.0 (2023-09-12)

Features
Bug Fixes
  • Make retry policy back off more aggressively for RPCs that retry RESOURCE_EXHAUSTD (#1704) (f61e7e0)
Dependencies
  • Update actions/checkout action to v4 (#1712) (404c492)
  • Update dependency com.google.cloud:google-cloud-bigquery to v2.31.2 (#1713) (32cb43c)
  • Update dependency com.google.cloud:google-cloud-core to v2.23.0 (#1717) (929f778)
  • Update dependency com.google.cloud:google-cloud-shared-dependencies to v3.15.0 (#1718) (0eeaa19)
  • Update dependency com.google.protobuf:protobuf-java-util to v3.24.3 (#1698) (1157fbf)
  • Update dependency org.easymock:easymock to v5.2.0 (#1711) (313f6dd)
  • Update dependency org.graalvm.buildtools:junit-platform-native to v0.9.25 (#1709) (1cc8a53)
  • Update dependency org.graalvm.buildtools:junit-platform-native to v0.9.26 (#1715) (f2cc75f)
  • Update dependency org.graalvm.buildtools:native-maven-plugin to v0.9.25 (#1710) (9764c3f)
  • Update dependency org.graalvm.buildtools:native-maven-plugin to v0.9.26 (#1716) (6c9e949)

Messages written to a dead letter topic configured for a BigQuery subscription contain an attribute with the reason the message could not be written to BigQuery. For more information, see Handle message failures.

Security Command Center

Vulnerabilities per resource type graphic released to General Availability

The Security Command Center Overview page in the Cloud console now shows a Vulnerabilities per resource type graphic, which replaces the Active vulnerabilities over time by severity graphic. The Vulnerabilities per resource type graphic shows the resources in your organization (for example, Cloud Storage buckets, Compute Engine instances, and firewalls), how many active vulnerabilities exist for each resource, and the severity of those vulnerabilities.

Vertex AI Search and Conversation

Vertex AI Search (Enterprise Search): Turn Enterprise edition on or off

You can turn Enterprise edition features on or off for existing apps.

For more about Enterprise edition, see About advanced features.

Virtual Private Cloud

For auto mode VPC networks, added a new subnet 10.216.0.0/20 for the Dammam me-central2 region. For more information, see Auto mode IP ranges.

Workflows

Workflows is available in the following additional region: me-central2 (Dammam, Saudi Arabia).

September 18, 2023

Access Approval

Access Approval supports Cloud Monitoring in the Preview stage.

Apigee UI

On September 18, 2023, we released an updated version of the Apigee UI.

This release includes improvements to the Create Environment experience in the Apigee UI in the Cloud console.

With this release, users can create a new environment, attach the environment to an Apigee instance, and assign the environment to an environment group within the same creation flow.

In addition, users can edit or remove environment group assignments from the environment detail page in the Apigee UI, simplifying management of their Apigee implementation.

For more information, see Working with environments.

BigQuery

A weekly digest of client library updates from across the Cloud SDK.

Go

Changes for bigquery/storage/apiv1beta1

1.55.0 (2023-09-11)

Features
  • bigquery/datapolicies: Support using custom UDF in the data policy (20725c8)
  • bigquery: Set PreferredMinStreamCount when creating read session (#8476) (22e095a), refs #8432
Bug Fixes
  • bigquery/storage/managedwriter: Address possible deadlocks (#8507) (48b08bf)
  • bigquery: Field descriptor proto name should not be lowercase (#8495) (4287e4b)
  • bigquery: Value for datasetID on foreign keys (#8447) (fa6e827), refs #8442

Java

Changes for google-cloud-bigquery

2.32.0 (2023-09-14)

Features
  • Add support for converting interval fields to threeten PeriodDuration (#2838) (2294c2f)
  • Add support for ExternalDatasetReference (#2871) (bbb86fd)
Dependencies
  • Update actions/checkout action to v4 (#2862) (902e9b9)
  • Update actions/upload-artifact action to v3.1.3 (#2867) (cbbf0fb)
  • Update dependency com.google.api.grpc:proto-google-cloud-bigqueryconnection-v1 to v2.26.0 (#2873) (6196625)
  • Update dependency com.google.cloud:google-cloud-datacatalog-bom to v1.30.0 (#2874) (6cafedf)
  • Update dependency com.google.cloud:google-cloud-shared-dependencies to v3.15.0 (#2870) (f24439b)
  • Update dependency org.graalvm.buildtools:junit-platform-native to v0.9.26 (#2868) (d01031c)
  • Update dependency org.graalvm.buildtools:native-maven-plugin to v0.9.26 (#2869) (edd7141)

The BigQuery Data Transfer Service now supports transfers from Search Ads 360 using the new Search Ads 360 reporting API. This feature is in preview. Customers with existing Search Ads 360 transfers should migrate their workflows to be compatible with the new Search Ads 360. The BigQuery Data Transfer Service will stop its support for the old Search Ads 360 reporting API on May 31st, 2024.

Cloud Bigtable

A weekly digest of client library updates from across the Cloud SDK.

Java

Changes for google-cloud-bigtable

2.27.2 (2023-09-13)

Bug Fixes
  • Check that all bulk mutation entries are accounted for (#1907) (9ad8a00)
  • Set wait timeout on watchdog (#1913) (f8ba6fe)
Dependencies
  • Update dependency org.graalvm.buildtools:junit-platform-native to v0.9.26 (#1896) (dfc4231)
  • Update dependency org.graalvm.buildtools:native-maven-plugin to v0.9.26 (#1897) (d446856)
  • Update shared dependencies (#1901) (96f2690)

2.27.1 (2023-09-12)

Bug Fixes
  • Aggregate batching throttling latency per attempt and reset it between (#1905) (e6cc5f6)
  • Make sure to propagate the response when throttling is enabled (#1908) (f743187)
Dependencies
  • Update the Java code generator (gapic-generator-java) to 2.25.0 (#1902) (f4fe6a0)
Cloud Composer

The apache-airflow-providers-google package is upgraded to version 10.7.0 in images with Airflow 2.5.3 and 2.4.3. For more information about changes, see the apache-airflow-providers-google changelog from version 10.5.0 to version 10.7.0.

Version 10.7.0 includes new Cloud Run, Cloud Batch and Dataplex Data Quality operators:

  • Cloud Run is used to build and deploy scalable containerized apps written in any language (including Go, Python, Java, Node.js, .NET, and Ruby) on a fully managed platform. The newly provided Cloud Run Operators enable creating, executing, updating, deleting and listing Cloud Run Jobs.
  • Cloud Batch is a fully managed batch service to schedule, queue, and execute batch jobs on Google's infrastructure. The provided Cloud Batch Operators enable submitting, listing and deleting batch jobs as well as listing a job's tasks.
  • Dataplex is an intelligent data fabric that provides unified analytics and data management across your data lakes, data warehouses, and data marts. New Dataplex operators handle creating, updating, getting, deleting and running a Data Quality scan, getting a Data Quality Scan job, creating and deleting a zone, as well as creating and deleting an asset.

Cloud Composer 2.4.3 images are available:

  • composer-2.4.3-airflow-2.5.3 (default)
  • composer-2.4.3-airflow-2.4.3

Cloud Composer versions 2.0.26 and 1.19.9 have reached their end of full support period.

Cloud Database Migration Service

Database Migration Service now supports customer-managed encryption keys (CMEK) that are externally managed with Cloud External Key Manager. For more details on CMEK support for each migration scenario, see CMEK integrations.

Cloud Logging

You can now save charts generated from a Log Analytics SQL query to a custom dashboard. For more information, see Save a chart to a custom dashboard.

You can now customize the Logs Dashboard page by using custom dashboards. For more information, see Visualize log severity and error metrics.

You can now use the Log fields pane of the Logs Explorer to filter your Kubernetes Container logs by their service name. The service name is extracted from the value of the pod_name label. For more information, see Logs fields pane.

A weekly digest of client library updates from across the Cloud SDK.

Java

Changes for google-cloud-logging

3.15.9 (2023-09-11)

Dependencies
  • Update dependency com.google.cloud:google-cloud-shared-dependencies to v3.15.0 (#1424) (4f82f33)
  • Update dependency org.easymock:easymock to v5.2.0 (#1421) (f931544)
  • Update dependency org.graalvm.buildtools:junit-platform-native to v0.9.26 (#1420) (ff581a6)
  • Update dependency org.graalvm.buildtools:native-maven-plugin to v0.9.26 (#1412) (bd9be4e)
Cloud Run Compute Engine

Preview: Snapshot settings are centralized configuration parameters for all snapshots in a project. You can use snapshot settings to customize the default storage location for all future snapshots in your project. By enabling you to do this, snapshot settings remove the need for you to manually specify a storage location during each individual snapshot creation.

Learn more about snapshot settings and how to set the default storage location for a project using snapshot settings.

Container Optimized OS

cos-dev-113-17908-0-0

Kernel Docker Containerd GPU Drivers
COS-6.1.52 v24.0.5 v1.7.3 v535.104.05(default),v470.199.02(R470)

Updated cos-gpu-installer to v2.1.8.

Updated dev-libs/nss to v3.79.4.

Updated dev-embedded/libftdi to v1.5-r5.

Fixed an issue where symlinks could not be moved.

Fixed an issue where IPv6 networking would fail under high CPU load.

Upgraded app-misc/jq to v1.7.

Upgraded sys-apps/coreutils to v9.4.

Upgraded sys-process/procps to v4.0.4.

Upgraded app-misc/ca-certificates to v20230311.3.93.

Fixed an issue with NFS reconnects on GKE.

Fixed CVE-2023-4623 in the linux kernel.

cos-beta-109-17800-0-37

Kernel Docker Containerd GPU Drivers
COS-6.1.42 v24.0.5 v1.7.2 v535.104.05(default),v470.199.02(R470)

Updated cos-gpu-installer to v2.1.8.

Fixed an issue where symlinks could not be moved.

Fixed an issue with NFS reconnects on GKE.

Fixed CVE-2023-4015, CVE-2023-4622, CVE-2023-4623 in the kernel.

cos-101-17162-279-47

Kernel Docker Containerd GPU Drivers
COS-5.15.120 v20.10.24 v1.6.21 v470.199.02(default),v535.104.05

Fixed an issue where symlinks could not be moved.

Fixed an issue with NFS reconnects on GKE.

Update dev-lang/go to v1.19.13. This resolves CVE-2023-29409.

cos-97-16919-353-46

Kernel Docker Containerd GPU Drivers
COS-5.10.186 v20.10.24 v1.6.21 v470.199.02(default),v535.104.05

Fixed CVE-2023-4622 in the linux kernel.

Firestore in Datastore mode

A weekly digest of client library updates from across the Cloud SDK.

Node.js

Changes for @google-cloud/datastore

8.1.0 (2023-09-07)

Features
Bug Fixes
  • Simplify logic for HTTP/1.1 REST fallback option (#1138) (4cefaea)

Python

Changes for google-cloud-ndb

2.2.1 (2023-09-15)

Bug Fixes
Documentation
  • Mark database argument for get_by_id and its async counterpart as ignored (#905) (b0f4310)

Java

Changes for google-cloud-datastore

2.17.1 (2023-09-11)

Dependencies
  • Update dependency com.google.cloud:google-cloud-shared-dependencies to v3.15.0 (#1184) (6cbb795)
  • Update dependency org.easymock:easymock to v5.2.0 (#1180) (3e62380)
Documentation
  • Marking AggregationResult#get as Obsolete (#1185) (252f854)
Google Kubernetes Engine

GKE clusters running version 1.28 or later block new bindings of ClusterRole cluster-admin to User system:anonymous, Group system:authenticated, or Group system:unauthenticated due to the security risks of these bindings. GKE does not block existing bindings.

GKE has temporarily paused all automatic node upgrades due to an issue with blue-green upgrades rollback functionality. You can still manually upgrade node pools with the surge upgrade strategy. Do not manually upgrade node pools with blue-green upgrades. GKE is working on a fix for this issue and will post a follow-up note here when the issue is fixed and automatic upgrades resume.

Pub/Sub

The backlog metrics of subscriptions with filtering enabled only include messages that match the filter. The change is being rolled out in a phased manner.

Vertex AI Workbench

Debian 10 and Python 3.7 images have reached their end of patch and support life for Vertex AI Workbench managed notebooks and user-managed notebooks. Debian 11 and Python 3.10 images are available.

September 15, 2023

Access Approval

Access Approval supports Access Context Manager in the Preview stage.

AlloyDB for PostgreSQL

Maintenance operations on highly available primary instances now occur with less than one second of downtime for most workloads.

AlloyDB for PostgreSQL is now available in the following regions:

  • europe-west12 (Turin)
  • me-central1 (Doha)

For more information, see AlloyDB Locations.

Assured Workloads

The ability to analyze a project for compliance before migrating it to an Assured Workloads folder is now generally available. See the Migrate a workload page for more information.

The CJIS compliance program now supports the following products. See Supported products for more information:

  • Cloud Composer
  • Cloud Dataflow
  • Cloud DNS
  • Cloud HSM
  • Cloud Logging
  • Cloud NAT
  • Cloud Router
  • Cloud SQL
  • Network Connectivity Center

The IL5 compliance program now supports the following products. See Supported products for more information:

  • Cloud Logging
  • Dataflow
  • Google Kubernetes Engine
Certificate Authority Service

Certificate Authority Service now supports data residency.

Cloud Interconnect

Dedicated Cloud Interconnect support is available in the following colocation facilities:

  • Quantum Switch DMM A - Dammam

For more information, see the Locations table.

Cloud Key Management Service

Cloud KMS is available in the following region:

  • me-central2

For more information, see Cloud KMS locations.

Cloud Storage

Manifest files are now available in Storage Insights. A manifest file is generated when an inventory report is split into shards. You can use the manifest file to easily locate the shards you want to download.

Compute Engine

Generally available: The Red Hat Knowledgebase provides you with access to articles, solutions, product documentation, and community discussions for Red Hat products.

You can now access the Red Hat Knowledgebase by using single-sign-on (SSO) through the Google Cloud console from your Red Hat Enterprise Linux (RHEL) VMs. For more information, see Access Red Hat Knowledgebase.

Dataproc

New Dataproc on Compute Engine subminor image versions:

  • 2.0.76-debian10, 2.0.76-rocky8, 2.0.76-ubuntu18
  • 2.1.24-debian11, 2.1.24-rocky8, 2.1.24-ubuntu20, 2.1.24-ubuntu20-arm

Scala has been upgraded to version 2.12.18 and Apache Tez has been upgraded to version 0.10.2 in Dataproc on Compute Engine 2.1 images.

Dialogflow

Improvements to Prebuilt Components:

Dialogflow CX has added the FILTER system function.

Dialogflow CX flow export now exports flows recursively.

Identity Platform

Email enumeration protection is enabled by default for all new projects. With email enumeration protection enabled, the Firebase Auth SDK method fetchSignInMethodsForEmail returns null, for added security.

Security Command Center

Event Threat Detection, a built-in service of Security Command Center, released a new rule, Initial Access: Leaked Service Account Key Used, to General Availability.

For more information, see Event Threat Detection rules.

Vertex AI Search and Conversation

Vertex AI Search (Enterprise Search): Languages for summarization

Summarization is supported in the following languages in addition to English:

  • German (de-DE)
  • Spanish (es-ES)
  • Italian (it-IT)
  • French (fr-FR)
  • Dutch (nl-NL)
  • Portuguese (pt-BR)
  • Swedish (sv-SE)

See Languages.

Vertex AI Search (Enterprise Search): Adjacent segments for preview with allowlist

When getting extractive segments, you can also get up to 3 segments from immediately before and after the relevant segment. Adjacent segments can add context and accuracy to the relevant segment. Turning on adjacent segments can increase latency.

Adjacent segments is in preview with allowlist. Contact your Google account team to try out adjacent segments.

See Extractive segments.

Vertex AI Search (Enterprise Search): Customizable summaries for preview with allowlist

When you request summaries, you can customize them by providing natural-language instructions. You can request customizations such as such as the length and level of detail, style of output (such as "simple"), language of output, focus of answer, and format (such as tables, bullets, and XML).

Customizable summaries are in preview with allowlist. Contact your Google account team if you're interested in trying this feature.

See Get customizable summaries.

Vertex AI Search (Enterprise Search): ISO compliance

Vertex AI Search meets ISO 27001, ISO 27017, ISO 27018, and ISO 27701 compliance standards.

See Compliance and security controls.

September 14, 2023

Anthos clusters on VMware

A standalone tool that you run before upgrading an admin or user cluster is now available. The pre-upgrade tool is supported for Anthos clusters on VMware version 1.9 through 1.13. The tool runs the applicable preflight checks for the version that you are upgrading to and also checks for specific known issues. Before upgrading a 1.9 - 1.13 cluster, we recommend that you run the pre-upgrade tool.

For details on running the tool, see the documentation for the version that you are upgrading to:

Apigee hybrid

hybrid 1.10.3-hotfix.1

On September 14, 2023 we released an updated version of the Apigee hybrid software, 1.10.3-hotfix.1.

Bug ID Description
205666368 Fixed issue with default validation of TLS target endpoint certificates.

To enable strict SSL on southbound connections to a proxy target endpoint, add the tag <Enforce>true</Enforce> in the target <SSLInfo> block.

See About setting TLS options in a target endpoint or target server.

See also Known Issue #205666368.

App Engine standard environment Go Bare Metal Solution

You can now view the status of your server activity in the Google Cloud console. it informs you if there's an issue with your Bare Metal Solution infrastructure. This feature is generally available (GA).

Observability for storage volumes is generally available (GA).

Chronicle

You can now change the type of a Chronicle reference list. For more details, see reference lists.

You can now create and manage forwarder configurations using the Chronicle user interface and also through the Chronicle Forwarder Management API.

Chronicle can now directly ingest the following log types from Google Cloud. Each is listed by product name and log_type value:

  • Cloud Intrusion Detection System (GCP_IDS)
  • Cloud Load Balancing (GCP_LOADBALANCING)
  • Cloud SQL (GCP_CLOUDSQL)
  • Windows Event logs (WINEVTLOG)
  • Linux Sysmon (LINUX_SYSMON)
  • Zeek (BRO_JSON)
  • Google Kubernetes Engine (KUBERNETES_NODE)
  • Audit Daemon (auditd) (AUDITD)
  • Apigee (GCP_APIGEE_X)

For more information, see Ingest Google Cloud Data to Chronicle.

Cloud CDN

The Cloud CDN private origin authentication capability for Amazon Simple Storage Service (Amazon S3) and compatible object stores is now Generally Available.

Cloud Composer

(Cloud Composer 2 only) In the next two weeks we plan to introduce a 1 vCPU maximum limit for Airflow Triggerers in Cloud Composer. This change is a part of an upcoming adjustment to our triggerer resource allocation strategy where we want to allow for an increase in the maximum triggerer count.

After this change takes effect, if you configured more than 1 vCPU per triggerer, then the next update operation will generate an error. To address this change, adjust the triggerer configuration to meet the new 1 vCPU limit.

(Available without an upgrade) Fixed the issue with reaching the "Write requests per day" quota limit when executing Airflow CLI commands in Cloud Composer 2.

Cloud Data Loss Prevention

Since August 12, 2023, there has been an increase in latency issues with inspection jobs and data profile generation. These latency issues have been resolved.

Cloud Monitoring

Ops Agent version 2.40.0 introduces support for Compute Engine Arm VMs that are running RHEL 9 or Rocky Linux 9. For more information, see Support for Compute Engine Arm VMs.

Cloud Storage

The following dual-region pairs are now generally available:

  • Montréal and Toronto, Canada
  • Sydney and Melbourne, Australia
Compute Engine

Generally available: You can create C3-standard VMs with Local SSD attached using new machine types, for example c3-standard-44-lssd. For more information, see Choosing a valid number of Local SSDs.

Dataflow

Dataflow now supports the Tau T2A Arm machine series as a worker machine type. This feature is generally available (GA). For more information, see Use Arm VMs on Dataflow.

Deep Learning Containers

M111 release

  • PyTorch 2.0 container images now include PyTorch XLA 2.0.
  • Miscellaneous software updates.
Deep Learning VM Images

M111 release

  • PyTorch 2.0 images now include PyTorch XLA 2.0.
  • Miscellaneous software updates.
Migrate to Virtual Machines

Preview: Migrate to Virtual Machines from an Azure source is now open to all users. Migrate to Virtual Machines from an Azure source lets you migrate Azure VM instances to Compute Engine.

Vertex AI Workbench

M111 release

The M111 release of Vertex AI Workbench instances includes the following:

  • Miscellaneous software updates.

The M111 release of Vertex AI Workbench user-managed notebooks includes the following:

  • PyTorch 2.0 user-managed notebooks instances now include PyTorch XLA 2.0.
  • Miscellaneous software updates.

The M111 release of Vertex AI Workbench managed notebooks includes the following:

  • Miscellaneous software updates.
Virtual Private Cloud

Policy-based routing is available in General Availability. You can select a next hop based on more than a packet's destination IP address. You can match traffic by protocol and source IP address as well.

If you've used Google provider for Terraform versions earlier than 4.76.0 to create Private Service Connect service attachments, do not upgrade to versions 4.76.0 through 4.81.x. When you run terraform apply after the upgrade, Terraform might unintentionally delete and recreate the service attachments and close existing Private Service Connect connections. Recreated service attachments do not automatically re-establish Private Service Connect connections.

Upgrading to version 4.82.0 or later ensures that service attachments are not recreated.

Versions 4.76.0 and later turn on connection reconciliation by default, which might result in different service attachments having different settings for this field, depending on when they were created.

For more information and workarounds, see Disconnections after upgrading the Google provider for Terraform.

September 13, 2023

AlloyDB for PostgreSQL

AlloyDB now lets you use and manage data-encryption keys residing outside of Google Cloud using Cloud External Key Manager.

Artifact Registry

Artifact Registry now supports HTTP access to Apt repositories. For more information, see Configure HTTP access to an Apt repository.

BigQuery

You can now create a federated dataset in BigQuery that federates to an existing database in AWS Glue. This feature is in preview.

Cloud Spanner

You can now create definer's rights views in Cloud Spanner. A definer's rights view adds additional security functionality by providing different privileges on the view and the underlying schema objects. Users with access to a definer's rights view can see and query its contents even if they don't have access to the view's underlying schema objects. For more information, see About views.

Config Controller

Config Controller now uses the following versions of its included products:

Dataproc

Announcing the Private Preview release of the Dataproc on Compute Engine Flink Jobs resource. During Private Preview, you can contact your Google Cloud Sales representative to have your project(s) added to an allowlist to allow you to submit Flink jobs to the Dataproc on Compute Engine service.

Google Cloud VMware Engine

VMware Engine nodes are now available in the following additional zone:

  • Tel Aviv (me-west1-a)
Identity and Access Management

You can now configure IAM workforce identity federation using the Google Cloud console. To learn more, see the configuration guides for Azure AD, Okta, or other OIDC and SAML 2.0 providers. The feature is in Preview.

Looker

Looker 23.16 includes the following changes, features, and fixes.

Expected Looker (original) deployment start: Monday, September 18, 2023

Expected Looker (original) final deployment and download available: Thursday, September 28, 2023

Expected Looker (Google Cloud core) deployment start: Monday, October 2, 2023

Expected Looker (Google Cloud core) final deployment: Thursday, October 12, 2023

The API call to create signed embed URL endpoints has been updated to remove the majority of embed administration configuration changes that need to be made when a signed embed URL is requested using the endpoint. The description of the endpoint is also changed to use a signed embed URL instead of an SSO embed URL to reduce the confusion with standard SSO authentication.

update_embed_config events are now reflected in the System Activity Event Explore.

When a dashboard or an element refresh interval is entered that is higher than the supported maximum value (24.8 days), Looker now returns a validation message.

Personal folders for users who have never logged in will no longer appear in embedded content navigation.

Auto-updates for Looker and third-party applications now display a list of entitlements that may be applied when a Marketplace listing is automatically updated.

The look and feel of the Get LookML dialog on Explore pages has been updated.

The create_dashboard_render_task now takes in an optional theme property to specify the theme to apply to the rendered dashboard.

For SFTP and S3 destinations, the timestamp in the filename of the scheduled delivery will respect the Delivery time zone.

Updates that are sent from inside custom visualizations now perform as expected.

A previous issue would cause Marketplace updates to fail when a user had not entered dev mode since the last update. This issue has been fixed.

A previous issue would cause Session Duration to be wrongly defaulted on the UI when the Inactivity Logout was enabled. This issue has been fixed.

For cell visualizations in columns with large positive and negative values, the negative value text will now appear on a single line instead of wrapping to fit the cell space.

For bar and column charts that use stacked series positioning and stack sorting with a combination of negative and positive values, the values are now rendered and sorted on the correct side of 0.

LookML dashboard descriptions are now correctly localized in folders.

A previous issue would cause scheduled plans for System Activity to fail with an undefined method 'path' for nil:NilClass error. This issue has been fixed.

A previous issue would cause suggestions to not work for fields in views with inter-view references in their sql_table_name parameter. This issue has been fixed.

Intermittent code: 1002 errors returned from Clickhouse connections have been fixed.

The average_distinct field type now supports symmetric aggregates.

A warning message will be returned when a user tries to use a subtotal with a sql_always_having parameter.

yesno filters on filtered measures when BI Engine is enabled now perform as expected.

The following SQL dialects are no longer supported by Looker, and queries against existing connections will return errors: Apache Hive 2, Apache Spark 1.5+, Apache Spark 2.0, and Quobole Presto.

Looker no longer supports connections to the Impala dialect called Cloudera Impala (with no version number and without a native driver). Queries on connections to this release of Cloudera Impala will return an error. Looker is continuing to support Cloudera Impala 3.1+, Cloudera Impala 3.1+ with Native Driver, and Cloudera Impala with Native Driver.

The New LookML Runtime feature now allows a wider variety of strings for Liquid date parsing. Date string formats that were previously accepted in the Legacy LookML Runtime legacy feature but not in the New LookML Runtime feature should now format properly.

The Teradata JDBC driver has been updated to 16.20.00.13.

When the Email Allowlist for Scheduled Content Labs feature is enabled, admin users can use the looker_internal_email_domain_allowlist user attribute to define email allowlist domains at a group level.

When the Advanced Granular Permissions Labs feature is enabled, admin users can use six new permissions to delegate management of user attributes, groups, roles, private labels, themes, and embed settings to non-admin users.

When you set up SAML authentication, merging users from OIDC into SAML is now supported.

The AND/OR Filters in Explores Labs feature is now enabled by default. When this feature is enabled, Looker Explores contain a new experience for creating and editing filters with AND/OR filter logic without the need to create custom filter expressions.

The Table (Legacy) visualization hide_totals option now performs as expected.

Liquid Ruby dependency has been updated to 5.0.0. You can now make a Liquid reference that results in a non-string value in the link parameter using the Legacy LookML Runtime legacy feature by using the {{ value }} Liquid reference syntax.

A new Looker (Google Cloud core) codelab has been published. The Connect Looker Cloud over hybrid networking codelab provides a walkthrough of deploying a public and private IP Looker (Google Cloud core) instance and connecting it to an on-premises database.

Looker (Google Cloud core) instances can now be created by provisioning a Terraform resource. The new Terraform tab on the Create a Looker (Google Cloud core) instance documentation page describes how to provision various editions of a Looker (Google Cloud core) instance.

Translation Hub

Administrators can set a data retention policy (Preview) on a project, on a new portal, or both. For more information, see Configure data retention policy.

VPC Service Controls

Preview stage support for the following integration:

September 12, 2023

BigQuery

The array subscript operator now returns a value in an array directly by index. Previously, only offset and ordinal were available. This feature is generally available (GA).

The struct subscript operator has been added. With this operator, you can access a STRUCT field by index, offset, or ordinal. This feature is generally available (GA).

Chronicle SOAR

Remote Agents 1.4.3.6

Remote agent now supports the same alert and event trimming logic as implemented in the server. New parameters in the database control the size of the alert as well as the size of the fields and events within them. Alerts that are bigger than this size will be automatically trimmed. If the alert is still too big, then the size of the fields and events will be trimmed. The resulting alert ingested into the case might therefore not contain all the original information.

Remote connector logs now display as required in the platform.

Remote agent no longer takes ownership of the entire /var/log directory when using the installer.

Cloud Composer

Cloud Composer 2 is now available in Doha (me-central1).

Cloud Healthcare API

A release was made. Updates may include general performance improvements, bug fixes, and updates to the API reference documentation.

Cloud Logging

Log buckets in the following regions can now be upgraded to use Log Analytics:

  • us-east5
  • us-south1
  • me-central1
  • europe-west12

For more information, see Supported regions.

Compute Engine

You can manage future reservations using the Google Cloud console. Future reservations provide a high level of assurance to obtain important or difficult-to-obtain capacity in advance.

For more information, see the following pages:

Container Optimized OS

cos-105-17412-156-49

Kernel Docker Containerd GPU Drivers
COS-5.15.120 v23.0.3 v1.7.2 v470.199.02(default),v535.104.05

Updated cos-gpu-installer to v2.1.7. Precompiled drivers are now downloaded from COS build artifacts.

Updated latest GPU driver to v535.104.05.

Fixed an issue where symlinks could not be moved.

The get_metadata_value script will now retry if it experiences a connection error.

Fixed an issue with NFS reconnects on GKE.

Updated dev-lang/go to v1.20.8. This resolves CVE-2023-29409.

Fixed the following CVEs in sys-libs/binutils-libs: CVE-2022-47007, CVE-2022-47008, CVE-2022-47010, CVE-2022-47011, CVE-2022-48063, CVE-2022-48064, CVE-2022-48065.

Runtime sysctl changes:

  • Added: net.ipv4.tcp_backlog_ack_defer: 1

Dataproc

The dataproc.diagnostics.enabled property is now avaiable to enable running diagnostics on Dataproc Serverless for Spark. The existing spark.dataproc.diagnostics.enabled property will be deprecated for use with newer runtimes.

Google Kubernetes Engine

You can now use node auto-provisioning for TPU slices. With this feature, Standard clusters with GKE version 1.28 and later provision TPU node pools and multi-host TPU accelerators automatically to ensure the capacity required to schedule AI/ML workloads. To learn more, see Configuring TPU node auto-provisioning.

September 11, 2023

BigQuery

A weekly digest of client library updates from across the Cloud SDK.

Java

Changes for google-cloud-bigquery

2.31.2 (2023-09-05)

Bug Fixes
Cloud Asset Inventory

The following resource types are now publicly available through the Search APIs (SearchAllResources, SearchAllIamPolicies).

  • Financial Services
    • financialservices.googleapis.com/Instance
  • Discovery Engine
    • discoveryengine.googleapis.com/Collection
    • discoveryengine.googleapis.com/DataStore

The following resource types are now publicly available through the analyze policy APIs (AnalyzeIamPolicy and AnalyzeIamPolicyLongrunning).

  • Speaker ID
    • speakerid.googleapis.com/Settings
Cloud Bigtable

You can now choose not to specify the number of nodes when creating a Cloud Bigtable cluster using the gcloud CLI. This configuration lets Bigtable automatically calculate the number of nodes based on your data footprint and optimize for 50% storage utilization. To learn more, see Create an instance. This feature is generally available (GA).

Cloud NAT

In some cases, it is possible to create multiple NAT gateway configurations that include the same subnet. For some of these configurations, VMs that are attached to that subnet are not allocated NAT ports, and therefore can't access resources on the internet.

For more information about this issue and a workaround, see VMs can't reach the internet.

Cloud Spanner

Query Optimizer version 6 is generally available. Version 5 remains the default optimizer version in production.

Cloud Workstations Container Optimized OS

cos-97-16919-353-44

Kernel Docker Containerd GPU Drivers
COS-5.10.186 v20.10.24 v1.6.21 v470.199.02(default),v535.104.05

Updated cos-gpu-installer to v2.1.7. Switched precompiled driver and signature location to COS build artifacts.

Updated latest GPU driver to v535.104.05.

Changed error handling in get_metadata_value script to retry if connection error happens during instance metadata check.

Fixed problem with NFS reconnects when using DPv2 in kube-proxy-free mode.

Fixed the following CVEs in sys-libs/binutils-libs: CVE-2022-47007 CVE-2022-47008, CVE-2022-47010, CVE-2022-47011, CVE-2022-48063, CVE-2022-48064, CVE-2022-48065.

cos-93-16623-461-30

Kernel Docker Containerd GPU Drivers
COS-5.10.177 v20.10.24 v1.6.20 v450.248.02(default),v470.199.02(R470),v535.104.05

Updated cos-gpu-installer to v2.1.7. Switched precompiled driver and signature location to COS build artifacts.

Updated latest GPU driver to v535.104.05.

Changed error handling in get_metadata_value script to retry if connection error happens during instance metadata check.

Fixed the following CVEs in sys-libs/binutils-libs: CVE-2022-47007 CVE-2022-47008, CVE-2022-47010, CVE-2022-47011, CVE-2022-48063, CVE-2022-48064, CVE-2022-48065.

cos-101-17162-279-42

Kernel Docker Containerd GPU Drivers
COS-5.15.120 v20.10.24 v1.6.21 v470.199.02(default),v535.104.05

Updated cos-gpu-installer to v2.1.7. Switched precompiled driver and signature location to COS build artifacts.

Updated latest GPU driver to v535.104.05.

Changed error handling in get_metadata_value script to retry if connection error happens during instance metadata check.

Fixed the following CVEs in sys-libs/binutils-libs: CVE-2022-47007 CVE-2022-47008, CVE-2022-47010, CVE-2022-47011, CVE-2022-48063, CVE-2022-48064, CVE-2022-48065.

cos-dev-113-17877-0-0

Kernel Docker Containerd GPU Drivers
COS-6.1.51 v24.0.5 v1.7.3 v535.104.05(default),v470.199.02(R470)

Updated the Linux kernel to v6.1.51.

Updated latest GPU driver to v535.104.05.

cos-beta-109-17800-0-32

Kernel Docker Containerd GPU Drivers
COS-6.1.42 v24.0.5 v1.7.2 v535.104.05(default),v470.199.02(R470)

Updated latest GPU driver to v535.104.05.

Document AI Warehouse

Validate the resource locations for all Document Warehouse API requests.

Error Reporting

Error Reporting now supports Cloud Run Jobs as a monitored resource type. For more information, see Supported monitored resources.

Firestore

The Google Cloud console now supports a usage dashboard for each database.

Firestore in Datastore mode

A weekly digest of client library updates from across the Cloud SDK.

Python

Changes for google-cloud-datastore

2.18.0 (2023-09-05)

Features
  • Add support for Sum and Avg aggregation query (#437) (e99120d)
Documentation
  • Update property requirement specifications (#470) (795ce81)
Google Kubernetes Engine

Compute Engine persistent disk CSI Drivers deployed on clusters running version 1.26 and later now support filesystem size expansion during restoration from a snapshot or a clone when the PVC data source is larger than the original volume. For more information, see the GitHub pull request.

Pub/Sub

A weekly digest of client library updates from across the Cloud SDK.

Node.js

Changes for @google-cloud/pubsub

4.0.5 (2023-09-07)

Bug Fixes
  • Always fill the topic and sub names when creating from a PubSub object (#1816) (be8ed53)

4.0.4 (2023-09-05)

Bug Fixes

4.0.3 (2023-08-31)

Bug Fixes
  • Simplify logic for HTTP/1.1 REST fallback option (#1809) (f26008d)

A weekly digest of client library updates from across the Cloud SDK.

Python

Changes for google-cloud-pubsub

2.18.4 (2023-09-09)

Documentation
SAP on Google Cloud

New SAP HANA certification: Hyperdisk Extreme usage with N2 machine types

For running SAP HANA on Google Cloud, SAP has certified using Hyperdisk Extreme with N2 machine types that have 80 vCPUs or more.

For more information, see:

New OS certifications for SAP HANA

For use with SAP HANA on Google Cloud, SAP has certified the following operating systems:

  • Red Hat Enterprise Linux (RHEL) 8.8 for SAP
  • SUSE Linux Enterprise Server (SLES) 15 SP5 for SAP

For more information, see Certified operating systems for SAP HANA.

Security Command Center

Security Command Center now supports CIS Google Cloud Computing Foundations Benchmark v2.0.0.

The support for v2.0.0 includes the following new vulnerability detector:

  • Load balancer logging disabled

For more information, see the following:

September 10, 2023

Datastream

Datastream now supports SSL/TLS encryption for Oracle sources. For more information, see the Datastream API reference documentation.

September 08, 2023

Access Approval

Access Approval supports Firebase Security Rules in the Preview stage.

AlloyDB for PostgreSQL

When creating an AlloyDB cluster, you can now specify an IP range for private services access. This is optional; if you do not specify an IP range, then AlloyDB selects one for you.

App Engine flexible environment Go Cloud Composer

Fixed the CVE-2023-29247 vulnerability in Airflow versions 2.4.3 and 2.5.3. To apply the fix, please upgrade your environment to Cloud Composer version 2.4.2 or later. For more information about this vulnerability in relation to Cloud Composer environments, see Known issues.

Cloud Composer now correctly generates an error message when a Cloud Composer 1 environment is created using a version alias in a region where Cloud Composer 1 is not supported.

Cloud Composer now generates a FAILED_PRECONDITION error message when an environment operation fails because the environment's cluster is missing.

Cloud Composer 2.4.2 images are available:

  • composer-2.4.2-airflow-2.5.3 (default)
  • composer-2.4.2-airflow-2.4.3

Cloud Composer versions 2.0.25 and 1.19.8 have reached their end of full support period.

Cloud Firewall

Starting September 8, 2023, you will be charged for the following Cloud Firewall Standard features:

For more information about billing, see Cloud Firewall pricing.

Dataproc

Dataproc Auto zone placement for clusters is now available in the Google Cloud console by selecting the "Any" option for the cluster zone.

New Dataproc on Compute Engine subminor image versions:

  • 2.0.75-debian10, 2.0.75-rocky8, 2.0.75-ubuntu18
  • 2.1.23-debian11, 2.1.23-rocky8, 2.1.23-ubuntu20, 2.1.23-ubuntu20-arm

The Apache Spark version has been upgraded from 3.3.0 to 3.3.2 in Dataproc on Compute Engine 2.1 images.

Vertex AI

Vertex AI Prediction

You can now use A2 Ultra machines to serve predictions in us-central1, us-east4, europe-west4, and asia-southeast1. Each A2 Ultra machine has a fixed number of NVIDIA A100 80GB GPUs attached.

Vertex AI Search and Conversation

Vertex AI Search (Enterprise Search): Image search is GA

Image search is now generally available (GA).

See Search for images using a website search engine.

Vertex AI Search (Enterprise Search): Page numbers for extractive segments

Page numbers can be returned with extractive segments. Page numbers indicate where an answer was extracted from in a document.

For more about extractive segments, see Get snippets and extracted content.

September 07, 2023

Access Transparency

Access Transparency logs are enhanced with an eventID that signifies the incident that resulted in the access by Google personnel. For example, a support case that results in several accesses from the support and engineering teams in order to resolve the case. Accesses related to the same support case share the same eventID in Access Transparency logs.

For more information about this field, see Log field descriptions.

Apigee Integrated Portal

On September 7, 2023 we released an updated version of Apigee integrated portal. This release includes general improvements to performance and availability.

Capacity Planner

Preview: You can view the following when using Capacity Planner:

  • The 50th and 75th percentile usage and forecast of your VMs.

  • The historical usage of your VMs up to 2 years in the past.

  • The usage and forecast of all machine families in a project.

For more information, see About Capacity Planner.

Preview: You can generate gcloud CLI commands to create future reservation requests of Compute Engine zonal resources based on the actual or forecasted usage of your VMs. Future reservations are useful to secure capacity up to 1 year in advance for forecasted spikes.

For more information, see Reserve capacity from actual or forecasted usage.

Cloud Build

Users can now use manual triggers, webhook triggers, and Pub/Sub triggers to build Bitbucket Server and Bitbucket Data Center repositories through Cloud Build repositories (1st gen). This feature is generally available. To learn more, see Build repositories from Bitbucket Server and Build repositories from Bitbucket Data Center.

Cloud Composer

Maintenance windows configuration is now generally available (GA).

Cloud Data Fusion

Cloud Data Fusion version 6.9.2 is generally available (GA). This release is in parallel with the CDAP 6.9.2 release.

Changes in Cloud Data Fusion 6.9.2:

  • Cloud Data Fusion supports setting custom scopes when creating a Dataproc cluster (CDAP-19428).
  • You can set common metadata labels for Dataproc clusters and jobs using the Common Labels property in the Ephemeral Dataproc compute profile (CDAP-20698).
  • You can set labels for the Dataproc jobs using the Common Labels property in the Existing Dataproc compute profile (CDAP-20698).
  • You can set a pipeline runtime argument with the key system.profile.properties.labels and a value representing the labels in the following format: key1|value1;key2|value2. This setting overrides the common labels set in the compute profile for pipeline runs (CDAP-20698).
  • Cloud Data Fusion supports using Dataproc temp buckets in compute profiles (CDAP-20712).

Fixed in Cloud Data Fusion 6.9.2:

  • Added a retry for Pub/Sub snapshot creation and deletion in a real-time pipeline with a Pub/Sub source when a retryable internal error is thrown (PLUGIN-1660).
  • Fixed a bug causing the Dynamic Spark plugins to fail when running on Dataproc 1.5 (CDAP-20674).
  • Fixed a discrepancy in warning and error counts reported between the pipeline summary tab and system logs (CDAP-20680).
  • Fixed a problem when, in rare cases, a cluster couldn't be found with Cluster Reuse (CDAP-20759).
  • Fixed a bug causing the JavaScript transform to fail on Dataproc 2.1 (CDAP-20778).
Cloud Functions

Cloud Functions now supports the Go 1.21 runtime at the General Availability release level.

Cloud Monitoring

Ops Agent version 2.39.0 introduces support for Compute Engine Arm VMs that are running Ubuntu 20.04 LTS (Focal Fossa). For more information, see Support for Compute Engine Arm VMs.

Starting with version 2.39.0, the Ops Agent supports ingesting Prometheus metrics with unknown types. In earlier versions, untyped metrics are treated by the Ops Agent as gauges, but starting with Ops Agent version 2.39.0, untyped metrics are treated as both gauges and counters, and you can apply cumulative operations to the metrics.

If you have charts or alterting policies based on untyped metrics and written with MQL, you must adjust your queries. For more information, see Prometheus untyped metrics change metric type starting with Ops Agent version 2.39.0.

Container Optimized OS

cos-dev-113-17872-0-0

Kernel Docker Containerd GPU Drivers
COS-6.1.49 v24.0.5 v1.7.3 v535.54.03(default),v470.199.02(R470)

Updated dev-go/go-tools to v0.11.1_p20230712.

Updated dev-lang/go to v1.21.0.

Updated the Linux kernel to v6.1.49.

The get_metadata_value script will now retry if it experiences a connection error.

Enabled persistence mode with Nvidia GPU driver installation.

Fixed an issue in ip6tables where the -C option did not work correctly.

Upgraded app-misc/jq to v1.7_rc2.

Upgraded sys-apps/less to v643.

Upgraded app-arch/pigz to v2.8.

Upgraded app-editors/vim to v9.0.1777. Upgraded app-editors/vim-core to v9.0.1777.

Upgraded sys-fs/mdadm to v4.2. This resolves CVE-2023-28938 and CVE-2023-28736.

Fixed CVE-2023-4016 in sys-process/procps.

Runtime sysctl changes:

  • Added: kernel.io_uring_disabled: 0
  • Changed: fs.file-max: 812619 -> 812608
  • Changed: kernel.threads-max: 63519 -> 63520
  • Changed: net.netfilter.nf_conntrack_sctp_timeout_shutdown_recd: 0 -> 3
  • Changed: net.netfilter.nf_conntrack_sctp_timeout_shutdown_sent: 0 -> 3
  • Changed: user.max_cgroup_namespaces: 31759 -> 31760
  • Changed: user.max_ipc_namespaces: 31759 -> 31760
  • Changed: user.max_mnt_namespaces: 31759 -> 31760
  • Changed: user.max_net_namespaces: 31759 -> 31760
  • Changed: user.max_pid_namespaces: 31759 -> 31760
  • Changed: user.max_time_namespaces: 31759 -> 31760
  • Changed: user.max_user_namespaces: 31759 -> 31760
  • Changed: user.max_uts_namespaces: 31759 -> 31760

cos-beta-109-17800-0-31

Kernel Docker Containerd GPU Drivers
COS-6.1.42 v24.0.5 v1.7.2 v535.54.03(default),v470.199.02(R470)

Updated dev-go/go-tools to v0.11.1_p20230712.

Updated dev-lang/go to v1.21.0.

The get_metadata_value script will now retry if it experiences a connection error.

Enabled persistence mode with Nvidia GPU driver installation.

Fixed an issue in ip6tables where the -C option did not work correctly.

Upgraded sys-fs/mdadm to v4.2. This resolves CVE-2023-28938 and CVE-2023-28736.

Fixed CVE-2023-4016 in sys-process/procps.

Fixed CVE-2022-40896 in pygments package.

Fixed CVE-2023-33953 in the Linux kernel.

Runtime sysctl changes:

  • Added: kernel.io_uring_disabled: 0

cos-101-17162-279-34

Kernel Docker Containerd GPU Drivers
COS-5.15.120 v20.10.24 v1.6.21 v470.199.02(default),v525.125.06

Simplified GPU driver installation by remounting driver installation path as executable from cos-extensions.

Enabled trusted IMA certificate loading from /etc/ima/pubkey.x509.

Enable persistence mode with Nvidia GPU driver installation.

Fixed CVE-2018-20852 in the dev-lang/python package.

Updated xz-utils to 5.2.9. This resolves CVE-2020-22916.

Upgraded sys-fs/mdadm to v4.2. This resolves CVE-2023-28938 and CVE-2023-28736.

Upgraded sys-process/procps to 3.3.17. This fixed CVE-2018-1121 and CVE-2023-4016.

Fixed CVE-2023-4128 in the Linux kernel.

Runtime sysctl changes:

  • Added: kernel.io_uring_disabled: 0

cos-97-16919-353-31

Kernel Docker Containerd GPU Drivers
COS-5.10.186 v20.10.24 v1.6.21 v470.199.02(default),v525.125.06

Enabled trusted IMA certificate loading from /etc/ima/pubkey.x509.

Enabled persistence mode with Nvidia GPU driver installation.

Updated xz-utils to 5.2.9. This resolves CVE-2020-22916.

Upgraded sys-process/procps to 3.3.17. This fixed CVE-2018-1121 and CVE-2023-4016.

Upgraded sys-fs/mdadm to v4.2. This resolves CVE-2023-28938 and CVE-2023-28736.

Fixed CVE-2023-4128 in the Linux kernel.

Runtime sysctl changes:

  • Added: kernel.io_uring_disabled: 0

cos-93-16623-461-21

Kernel Docker Containerd GPU Drivers
COS-5.10.177 v20.10.24 v1.6.20 v450.248.02(default),v470.199.02(R470),v525.125.06

Fixed CVE-2018-17846, CVE-2018-17142, CVE-2018-17847, CVE-2018-17143, CVE-2018-17075, CVE-2018-17848 in dev-go/net.

Updated xz-utils to 5.2.9. This resolves CVE-2020-22916.

Upgraded sys-process/procps to 3.3.17. This fixed CVE-2018-1121 and CVE-2023-4016.

Upgraded sys-fs/mdadm to v4.2. This resolves CVE-2023-28938 and CVE-2023-28736.

Fixed CVE-2023-33953 in the Linux kernel.

cos-105-17412-156-34

Kernel Docker Containerd GPU Drivers
COS-5.15.120 v23.0.3 v1.7.2 v470.199.02(default),v525.125.06

Enabled persistence mode with Nvidia GPU driver installation.

Upgraded sys-fs/mdadm to v4.2. This resolves CVE-2023-28938 and CVE-2023-28736.

Fixed CVE-2023-4016 in sys-process/procps.

Dataform

Service account delegation for workflow execution is now available. You can configure service account delegation for whole repositories, or for individual workflow configurations.

Datastream

The Datastream BigQuery Migration Toolkit is now launched. The toolkit is an open-source software that simplifies migrating from the Dataflow Datastream to BigQuery template to the Datastream native BigQuery replication solution. For more information, see the toolkit documentation.

Google Distributed Cloud Edge

This is a minor release of Google Distributed Cloud Edge (version 1.5.0).

The following features have been introduced in this release of Distributed Cloud Edge:

  • Bastion host support. Distributed Cloud Edge now allows you to set up one or more bastion host virtual machines. The bastion host feature allows Google support engineers to connect to your Distributed Cloud Edge deployment and work with you to diagnose and resolve issues. For more information, see Configure a bastion host. This is a preview-level feature.

  • Selectable cluster software versions. You now have the option to create a cluster running a specific version of Distributed Cloud Edge software, starting with version 1.5.0. For more information, see Create and manage clusters. This is a preview-level feature.

  • Container image registry access over secondary networks. Distributed Cloud Edge now allows you to specify the network interface in the spec.containerRuntimeDNSConfig field of the NodeSystemConfigUpdate resource. This allows you to specify a container image registry IP/domain pair for a network interface other than the primary. For more information, see NodeSystemConfigUpdate resource. This is a preview-level feature.

  • CMEK support for local control plane nodes. You can now configure Cloud KMS integration for storage on nodes running local control planes for Distributed Cloud Edge clusters. For more information, see Enable support for customer-managed encryption keys (CMEK) for local storage.

The following changes have been introduced in this release of Distributed Cloud Edge:

  • Survivability mode is now generally available. For more information, see Distributed Cloud Edge survivability mode. After your Distributed Cloud Edge deployment has been upgraded from version 1.4.0 to version 1.5.0, you must manually delete and recreate all local control plane clusters you have created with Distributed Cloud Edge version 1.4.0 or 1.4.1. Otherwise, unexpected behavior and data loss can occur. Clusters configured to use a cloud control plane continue to run normally after upgrading Distributed Cloud Edge to version 1.5.0.

  • Symcloud Storage integration is now generally available. For more information, see Configure Distributed Cloud Edge for Symcloud Storage.

  • Local control plane clusters now support virtual machines and GPU workloads. For more information, see Manage virtual machines and Manage GPU workloads.

  • Loadable SCTP kernel modules. Distributed Cloud Edge now configures the sctp kernel module as loadable. This allows you to load custom networking stacks into the kernel's user space. For more information, see SCTP kernel modules. This is a preview-level feature.

The following issues have been resolved in this release of Distributed Cloud Edge:

  • When creating a Cloud control plane cluster, creating a node pool that includes nodes that were previously part of a local control plane cluster no longer fails.

  • BGP sessions now properly recover when the associated network interface goes down and then comes back up.

This release of Distributed Cloud Edge contains the following known issues:

  • When creating a local control plane cluster, Distributed Cloud Edge instantiates dummy BGPPeer and BGPLoadBalancer resources. You can ignore these resources.

  • Distributed Cloud Edge does not support BGP peering to multiple VLANs within the same virtual router. You must set up a separate virtual router with a unique loopback IP addresses for each affected VLAN to allow concurrent BGP peering sessions.

Google Kubernetes Engine

Three vulnerabilities (CVE-2023-3676, CVE-2023-3955, CVE-2023-3893) have been discovered in Kubernetes where a user that can create Pods on Windows nodes may be able to escalate to admin privileges on those nodes. These vulnerabilities affect the Windows versions of Kubelet and the Kubernetes CSI proxy.

GKE clusters are only affected if they include Windows nodes.

For more information, see the GCP-2023-026 security bulletin.

For GKE clusters using Dataplane V2, upgrades to GKE version 1.26 might cause GKE to temporarily be unable to configure workloads. In some cases, this might cause existing workloads to temporarily lose networking access. This issue does not impact new clusters and GKE clusters not using Dataplane V2. For clusters running version 1.25 with Dataplane V2 enabled, GKE has temporarily disabled auto-upgrades to version 1.26. We recommend that customers not manually upgrade their Dataplane V2-enabled cluster to GKE version 1.26. This is a known issue for GKE version 1.26 and will be fixed in a future patch version of 1.26.

With the recently released version of GKE, version 1.28, you cannot yet use the SidecarContainer feature with alpha clusters. Pods defining restartable Init containers will not start. This is a known issue that will be resolved in a future release.

September 06, 2023

AlloyDB for PostgreSQL

Updated the PostgreSQL-compatible server running on AlloyDB instances to version 14.7.

Updated the following extensions related to the PostGIS extension to version 3.2.3:

  • postgis
  • postgis_raster
  • postgis_sfcgal
  • postgis_tiger_geocoder
  • postgis_topology
  • address_standardizer
  • address_standardizer_data_us

The following extensions are updated:

  • Updated pg_hint_plan to version 1.4.1.
  • Updated pg_repack to version 1.4.8.
  • Updated pg_partman to version 4.7.3.
  • Updated postgresql-hll to version 2.17.
  • Updated pg_cron to version 1.5.
  • Updated pg_hint_plan to version 1.4.1.
  • Updated pg_repack to version 1.4.8.
  • Updated pg_partman to version 4.7.3.
  • Updated postgresql-hll to version 2.17.
  • Updated pg_cron to version 1.5.
Anthos Attached Clusters

This release includes the following Anthos attached clusters platform versions:

  • 1.25.0-gke.6
  • 1.26.0-gke.4
  • 1.27.0-gke.1

1.27.0-gke.1

  • Added Binary Authorization support which is a deploy-time security control that ensures only trusted container images are deployed. With Binary Authorization, you can require images to be signed by trusted authorities during the development process and then enforce signature validation when deploying. By enforcing validation, you can gain tighter control over your container environment by ensuring only verified images are integrated into the build-and-release process. For details about how to enable Binary Authorization on your clusters, see How to enable Binary Authorization.

  • Added the authorization.admin_groups field. This allows users to specify Google groups as cluster-admins through the management plane.

  • Enabled gzip compression for fluent-bit's ingestion of logs into Cloud Logging. This improves the efficiency of log transfer for both the control plane and workloads.

  • Added proxy support for attaching AKS/EKS clusters. For details, see Connect to your EKS cluster and Connect to your AKS cluster.

This release fixes the following vulnerabilities:

Anthos Service Mesh

1.16.7-asm.7 is now available for in-cluster Anthos Service Mesh.

You can now download 1.16.7-asm.7 for in-cluster Anthos Service Mesh. It includes the features of Istio 1.16.7 subject to the list of supported features. Anthos Service Mesh 1.16.7-asm.7 uses Envoy v1.24.9.

1.17.5-asm.9 is now available for in-cluster Anthos Service Mesh.

You can now download 1.17.5-asm.9 for in-cluster Anthos Service Mesh. It includes the features of Istio 1.17.5 subject to the list of supported features. Anthos Service Mesh 1.17.5-asm.9 uses Envoy v1.25.8.

1.18.2-asm.4 is now available for in-cluster Anthos Service Mesh.

You can now download 1.18.2-asm.4 for in-cluster Anthos Service Mesh. It includes the features of Istio 1.18.2 subject to the list of supported features. Anthos Service Mesh 1.18.2-asm.4 uses Envoy v1.26.5.

Anthos clusters on AWS

You can now launch clusters with the following Kubernetes versions:

  • 1.25.8-gke.500
  • 1.26.7-gke.500
  • 1.27.4-gke.1600

1.27

  • Preview: Enabled surge updates. Surge updates allow you to configure the speed and disruption of node pool updates. Please contact your account team to opt into the preview.

  • GA: Added support for AWS spot instance node pools. Creating AWS spot node pools is now GA. Spot instance node pools are pools of Amazon EC2 Spot Instances that are available on AWS at a lower cost.

  • GA: Enabled node auto repair. This feature continuously monitors the health of each node in a node pool.

  • Added Binary Authorization support which is a deploy-time security control that ensures only trusted container images are deployed. With Binary Authorization, you can require images to be signed by trusted authorities during the development process and then enforce signature validation when deploying. By enforcing validation, you can gain tighter control over your container environment by ensuring only verified images are integrated into the build-and-release process. For details about how to enable Binary Authorization on your clusters, see How to enable Binary Authorization.

  • Added support for a new admin-groups flag in the create and update APIs. This flag allows customers to quickly and easily authenticate listed groups as cluster administrators, eliminating the need to manually create and apply RBAC policies.

  • Added an ignore_errors option to the delete API to handle cases where accidentally deleted IAM roles or manual removal of resources prevent the deletion of clusters or node pools. By appending ?ignore_errors=true to the DELETE request URL, users can now forcibly remove clusters or node pools. However, this approach might result in orphaned resources in AWS or Azure, requiring manual cleanup.

  • Upgraded the snapshot-controller and csi-snapshot-validation-webhook to v6.2.2. This new version introduces an important change to the API. Specifically, the VolumeSnapshot, VolumeSnapshotContents, and VolumeSnapshotClass v1beta1 APIs are no longer available.

  • Disabled the unauthenticated kubelet read-only port 10255. Once a node pool is upgraded to version 1.27, workloads running on it will no longer be able to connect to port 10255.

  • Enabled gzip compression for fluent-bit's ingestion of logs into Cloud Logging. This improves the efficiency of log transfer for both the control plane and workloads.

  • Optimized audit-proxy's audit Logging ingestion by enabling gzip compression.

  • Improved security by adding file-integrity checks and fingerprint validation for Google-managed binary artifacts downloaded from Cloud Storage.

  • Added support for automatic periodic defragmentation of etcd and etcd-events on the control plane. This feature reduces unnecessary disk storage and helps to prevent etcd and the control plane from becoming unavailable due to disk storage issues.

  • Changed the metrics names for Kubernetes resource metrics to use a metrics prefix of kubernetes.io/anthos/ rather than kubernetes.io/. For details refer to the metrics reference documentation.

  • Changed default etcd version to v3.4.21 on new clusters for improved stability. Existing clusters upgraded to this version will use etcd v3.5.6.

  • Improved node resource management by reserving resources for the kubelet. While this feature is crucial for preventing Out of Memory (OOM) errors by ensuring system and Kubernetes processes have the resources they need, it may lead to workload disruptions. The reservation of resources for the kubelet may affect the available resources for Pods, potentially affecting the capacity of smaller nodes to handle existing workloads. Customers should verify that smaller nodes can still support their workloads with this new feature activated.

    • The reserved memory percentages are as follows:
      • 255 MiB for machines with less than 1GB of memory
      • 25% of the first 4GB of memory
      • 20% of the next 4GB
      • 10% of the next 8GB
      • 6% of the next 112GB
      • 2% of any memory above 128GB
    • The reserved CPU percentages are as follows:
      • 6% of the first core
      • 1% of the next core
      • 0.5% of the next 2 cores
      • 0.25% of any cores above 4 cores

Enabled the cluster autoscaler to balance nodes across different availability zones. This is achieved using the --balance-similar-node-groups flag.

1.25

Expanded the list of metrics collected from node pools to include gke-metrics-agent, cilium-agent, cilium-operator, coredns, fluentbit-gke, kubelet, and konnectivity-agent.

Anthos clusters on Azure

You can now launch clusters with the following Kubernetes versions:

  • 1.25.8-gke.500
  • 1.26.7-gke.500
  • 1.27.4-gke.1600

1.27

  • GA: Enabled node auto repair. This feature continuously monitors the health of each node in a node pool. Added support for a new admin-groups flag in the create and update APIs. This flag allows customers to quickly and easily authenticate listed groups as cluster administrators, eliminating the need to manually create and apply RBAC policies.

  • Upgraded the snapshot-controller and csi-snapshot-validation-webhook to v6.2.2. This new version introduces an important change to the API. Specifically, the VolumeSnapshot, VolumeSnapshotContents, and VolumeSnapshotClass v1beta1 APIs are no longer available.

  • Disabled the unauthenticated kubelet read-only port 10255. Once a node pool is upgraded to version 1.27, workloads running on it will no longer be able to connect to port 10255.

  • Enabled gzip compression for fluent-bit's ingestion of logs into Cloud Logging. This improves the efficiency of log transfer for both the control plane and workloads.

  • Optimized audit-proxy's audit logging ingestion by enabling gzip compression.

  • Improved security by adding file-integrity checks and fingerprint validation for Google-managed binary artifacts downloaded from Cloud Storage.

  • Added support for automatic periodic defragmentation of etcd and etcd-events on the control plane. This feature reduces unnecessary disk storage and helps to prevent etcd and the control plane from becoming unavailable due to disk storage issues.

  • Changed the metrics names for Kubernetes resource metrics to use a metrics prefix of kubernetes.io/anthos/ rather than kubernetes.io/. For details refer to the metrics reference documentation.

  • Changed default etcd version to v3.4.21 on new clusters for improved stability. Existing clusters upgraded to this version will use etcd v3.5.6.

  • Improved node resource management by reserving resources for the kubelet. While this feature is crucial for preventing Out of Memory (OOM) errors by ensuring system and Kubernetes processes have the resources they need, it may lead to workload disruptions. The reservation of resources for the kubelet may affect the available resources for Pods, potentially affecting the capacity of smaller nodes to handle existing workloads. Customers should verify that smaller nodes can still support their workloads with this new feature activated.

    • The reserved memory percentages are as follows:
      • 255 MiB for machines with less than 1GB of memory
      • 25% of the first 4GB of memory
      • 20% of the next 4GB
      • 10% of the next 8GB
      • 6% of the next 112GB
      • 2% of any memory above 128GB
    • The reserved CPU percentages are as follows:
      • 6% of the first core
      • 1% of the next core
      • 0.5% of the next 2 cores
      • 0.25% of any cores above 4 cores

1.25

Expanded the list of metrics collected from node pools to include gke-metrics-agent, cilium-agent, cilium-operator, coredns, fluentbit-gke, kubelet, and konnectivity-agent.

Application Integration

Application Integration Quick setup (GA)

Application Integration Quick setup is now generally available in all the supported Google Cloud locations.

Quick setup is a single-click operation that automatically provisions Application Integration with the default configurations needed to get you started with the product.

For more information, see Set up Application Integration.

Chronicle

The following supported default parsers have changed. Each is listed by product name and log_type value, if applicable.

  • Akamai Enterprise Application Access (AKAMAI_EAA)
  • AWS Cloudtrail (AWS_CLOUDTRAIL)
  • AWS CloudWatch (AWS_CLOUDWATCH)
  • Chrome Management (N/A)
  • Cisco ASA (CISCO_ASA_FIREWALL)
  • Cisco Email Security (CISCO_EMAIL_SECURITY)
  • Cloud Audit Logs (N/A)
  • Cloudflare WAF (CLOUDFLARE_WAF)
  • Darktrace (DARKTRACE)
  • Desynova Contido (DESYNOVA_CONTIDO)
  • Duo Telephony Logs (DUO_TELEPHONY)
  • Elastic Audit Beats (ELASTIC_AUDITBEAT)
  • F5 BIGIP LTM (F5_BIGIP_LTM)
  • Fidelis Network (FIDELIS_NETWORK)
  • Gitlab (GITLAB)
  • Imperva FlexProtect (IMPERVA_FLEXPROTECT)
  • Island Browser logs (ISLAND_BROWSER)
  • Juniper (JUNIPER_FIREWALL)
  • Microsoft Azure Resource (AZURE_RESOURCE_LOGS)
  • Microsoft Graph API Alerts (MICROSOFT_GRAPH_ALERT)
  • Microsoft Sentinel (MICROSOFT_SENTINEL)
  • Netscout OCI (NETSCOUT_OCI)
  • Netskope Web Proxy (NETSKOPE_WEBPROXY)
  • Office 365 (OFFICE_365)
  • OpenSSH (OPENSSH)
  • Palo Alto Networks Firewall (PAN_FIREWALL)
  • ProofPoint Secure Email Relay (PROOFPOINT_SER)
  • SentinelOne Deep Visibility (SENTINEL_DV)
  • SentinelOne EDR (SENTINEL_EDR)
  • Suricata IDS (SURICATA_IDS)
  • Symantec DLP (SYMANTEC_DLP)
  • Windows Defender ATP (WINDOWS_DEFENDER_ATP)
  • Windows Event (WINEVTLOG)
  • Windows Event (XML) (WINEVTLOG_XML)
  • Workspace Activities (WORKSPACE_ACTIVITY)
  • Workspace Alerts (WORKSPACE_ALERTS)
  • Workspace Users (WORKSPACE_USERS)
  • Zscaler (ZSCALER_WEBPROXY)

For details about changes in each parser, see Supported default parsers.

Cloud Data Fusion

The SAP ODP plugin version 0.7.5 is available in Cloud Data Fusion versions 6.6.0 to 6.8.0. This release includes the following changes:

  • Fixed an issue causing duplicate records or loss of records due to package acknowledgement occurring too early.
  • Filters that you apply are viewable in the logs.
Cloud Load Balancing

Cloud Load Balancing is introducing new advanced cost, latency, and resiliency optimizations for your global external Application Load Balancer. These include the following capabilities:

  • You can use a service load balancing policy to customize the parameters that influence how traffic is distributed within the backends associated with a backend service (for example, load balancing algorithm and auto-capacity draining).
  • You can designate specific backends as preferred backends.

For details, see Advanced load balancing optimizations.

Cloud Spanner

A Cloud Spanner multi-region instance configuration is now available in Asia - asia2 (Mumbai/Delhi/Singapore).

Config Connector

Config Connector version 1.109.0 is now available.

Added name validation for the customizable ControllerResource CRDs.

Field spec.containers is no longer required in the customizable ControllerResource CRDs.

  • Added support for CloudIOTDeviceRegistry (v1alpha1) resource.

Added support for ComputeRegionSSLPolicy (v1alpha1) resource.

Added support for VertexAIIndexEndpoint (v1alpha1) resource.

Resource BigtableGCPolicy(v1beta1):

  • Fixed a bug that generates unexpected diff when mode and gcRules are both specified.
  • Fixed a bug that generates unexpected diff when maxAge in gcRules is specified with units larger than hours.

Resource AlloyDBCluster(v1alpha1):

  • Added spec.continuousBackupConfig field.
  • Added spec.restoreBackupSource field.
  • Added spec.restoreContinuousBackupSource field.
  • Added status.continuousBackupInfo field.

Resource ArtifactRegistryRepository(v1beta1):

  • Added spec.cleanupPolicies field.
  • Added spec.cleanupPolicyDryRun field.

Resource BigQueryTable(v1beta1):

  • Added spec.maxStaleness field.
  • Added spec.externalDataConfiguration.fileSetSpecType field.

Resource CloudBuildTrigger(v1beta1):

  • Added spec.gitFileSource.bitbucketServerConfigRef field.
  • Added spec.sourceToBuild.bitbucketServerConfigRef field.

Resource CloudFunctions2Function(v1alpha1):

  • Added spec.kmsKeyName field.

Resource ComputeAddress(v1beta1):

  • Added spec.ipv6EndpointType field.

Resource ComputeBackendService(v1beta1):

  • Added spec.securityPolicy field.
  • Added spec.connectionTrackingPolicy.enableStrongAffinity field.

Resource ComputeInstance(v1beta1):

  • Added spec.networkInterface.items.ipv6AccessConfig.items.name field.
  • Added spec.scheduling.localSsdRecoveryTimeout field.

Resource ComputeInstanceTemplate(v1beta1):

  • Added spec.disk.items.provisionedIops field.
  • Added spec.networkInterface.items.ipv6AccessConfig.items.name field.
  • Added spec.scheduling.localSsdRecoveryTimeout field.

Resource ComputeSecurityPolicy(v1beta1):

  • Added spec.advancedOptionsConfig.userIpRequestHeaders field.

Resource ComputeTargetInstance(v1beta1):

  • Added spec.securityPolicyRef field.

Resource ComputeTargetPool(v1beta1):

  • Added spec.securityPolicyRef field.

Resource ContainerCluster(v1beta1):

  • Added spec.allowNetAdmin field.
  • Added spec.enableK8sBetaApis field.
  • Added spec.enableMultiNetworking field.
  • Added spec.ipAllocationPolicy.additionalPodRangesConfig field.
  • Added spec.monitoringConfig.advancedDatapathObservabilityConfig field.
  • Added spec.nodeConfig.hostMaintenancePolicy field.

Resource ContainerNodePool(v1beta1):

  • Added spec.networkConfig.additionalNodeNetworkConfigs field.
  • Added spec.networkConfig.additionalPodNetworkConfigs field.
  • Added spec.nodeConfig.hostMaintenancePolicy field.
  • Added spec.placementPolicy.policyNameRef field.

Resource DNSManagedZone(v1beta1):

  • Removed spec.privateVisibilityConfig.required field.

Resource EventarcTrigger(v1beta1):

  • Added spec.eventDataContentType field.

Resource FirebaseAndroidApp(v1alpha1):

  • Added spec.apiKeyId field.

Resource FirebaseWebApp(v1alpha1):

  • Added spec.apiKeyId field.

Resource HealthcareFHIRStore(v1alpha1):

  • Added spec.defaultSearchHandlingStrict field.
  • Added spec.notificationConfigs.items.sendPreviousResourceOnDelete field.
  • Added spec.streamConfigs.items.bigqueryDestination.schemaConfig.lastUpdatedPartitionConfig field.

Resource IAMWorkforcePoolProvider(v1beta1):

  • Added spec.oidc.clientSecret field.
  • Added spec.oidc.jwksJson field.
  • Added spec.oidc.webSsoConfig.additionalScopes field.
  • Added status.oidc field.

Resource MonitoringAlertPolicy(v1beta1):

  • Added spec.conditions.items.conditionPrometheusQueryLanguage field.

Resource PubSubSubscription(v1beta1):

  • Added spec.cloudStorageConfig field.
  • Added spec.pushConfig.noWrapper field.

Resource RunJob(v1beta1):

  • Added status.createTime field.
  • Added status.creator field.
  • Added status.deleteTime field.
  • Added status.expireTime field.
  • Added status.lastModifier field.
  • Added status.updateTime field.

Resource SecretManagerSecret(v1beta1):

  • Added spec.annotations field.
  • Added spec.versionAliases field.

Resource SpannerDatabase(v1beta1):

  • Added spec.enableDropProtection field.

Resource SQLInstance(v1beta1):

  • Added spec.settings.ipConfiguration.pscConfig field.
  • Added status.dnsName field.
  • Added status.pscServiceAttachmentLink field.

Resource WorkstationsWorkstationCluster(v1alpha1):

  • Added spec.privateClusterConfig.allowedProjects field.

Fixed spec.webhookConfig.secretRef field in CloudBuildTrigger.

Data Catalog

Data Catalog is now available in Berlin (europe-west10). For more information on region and feature availability, see regions.

Dataflow

The following Dataflow templates are generally available (GA):

Dataform Looker

Looker (Google Cloud core) now supports the following regions:

  • asia-southeast1 (Singapore)
  • australia-southeast1 (Sydney)
  • europe-west2 (London)
  • europe-west3 (Frankfurt)
  • me-west1 (Tel Aviv)
  • us-east4 (Northern Virginia)

Memorystore for Redis Cluster SAP on Google Cloud

Cloud Storage Backint agent for SAP HANA version 1.0.28

Version 1.0.28 of the Cloud Storage Backint agent for SAP HANA is available. This version includes a new HTTP_READ_TIMEOUT parameter.

For more information about the agent, see Cloud Storage Backint agent for SAP HANA overview.

Vertex AI

Vertex AI Prediction

The following prebuilt containers for prediction have been updated: 

  • tf2-cpu.2-12 
  • tf2-gpu.2-12 
  • tf2-cpu.2-11
  • tf2-gpu.2-11
  • tf2-cpu.2-10
  • tf2-gpu.2-10
  • tf2-cpu.2-9
  • tf2-gpu.2-9
  • tf2-cpu.2-8
  • tf2-gpu.2-8
  • sklearn-cpu.1-2
  • xgboost-cpu.1-7
  • pytorch-cpu.2-0
  • pytorch-gpu.2-0
  • pytorch-cpu.1-13
  • pytorch-gpu.1-13

To update your containers, redeploy your models. To learn more, see Vertex AI framework support policy and Prebuilt containers for prediction.

September 05, 2023

Anthos Service Mesh

Anthos Service Mesh will begin creating Network Endpoint Groups (NEGs) for all services. This rollout will proceed gradually over a period of several months, starting with the rapid channel. You may notice the following annotations on each of your services: cloud.google.com/neg and cloud.google.com/neg-status.

You can view NEGs with the following command: gcloud compute network-endpoint-groups list.

Managed Anthos Service Mesh 1.16 is rolling out in the stable channel. See Managed Anthos Service Mesh release channels for more information.

Batch

Documentation has been added to explain how to automatically retry some or all of the failed tasks for a job. For example, automatic task retries can help prevent job failures from temporary issues like Spot VM preemption, host events, and transient networking errors.

For more information, see Automate task retries.

Cloud Asset Inventory

The following resource types are now publicly available through the Search APIs (SearchAllResources, SearchAllIamPolicies).

  • IAM

    • iam.googleapis.com/PolicyV2
  • Anthos Multi-Cloud (previously GKE Multi-Cloud)

    • gkemulticloud.googleapis.com/AwsCluster
    • gkemulticloud.googleapis.com/AzureCluster
    • gkemulticloud.googleapis.com/AzureClient
    • gkemulticloud.googleapis.com/AwsNodePool
    • gkemulticloud.googleapis.com/AttachedCluster
    • gkemulticloud.googleapis.com/AzureNodePool
Cloud Bigtable

Dataflow templates are available to stream Cloud Bigtable data change records to BigQuery or Pub/Sub. For more information, see Reading a change stream.

Cloud Data Fusion

The SAP SuccessFactors Batch Source plugin version 1.2.1 is available in Cloud Data Fusion. The release includes the following changes:

  • Fixed an issue causing an inaccurate error message when the plugin's Associated Entity Name property is invalid.

  • Fixed an issue causing inaccurate validation errors when the Expand Fields property contains a macro.

Error Reporting Google Kubernetes Engine

1.28 is now available in the Rapid channel

Kubernetes 1.28 is now available in the Rapid channel. For more information about the content of Kubernetes 1.28, read the Kubernetes 1.28 Release Notes.

New APIs

  • The kubectl auth whoami command and the authentication.k8s.io/v1 SelfSubjectReview API enables checking the authenticated user information as seen by the server.

Deprecated API versions

These APIs are still served in version 1.28 but are in a deprecation period:

  • The following Beta versions of graduated APIs will be removed in 1.29 in favor of newer versions:
    • flowcontrol.apiserver.k8s.io/v1beta2 FlowSchema, PriorityLevelConfiguration
      • deprecated since 1.26
      • use flowcontrol.apiserver.k8s.io/v1beta3 instead, available since 1.26.

Deprecated in-tree volume support

  • The Ceph CephFS (kubernetes.io/cephfs) and RBD (kubernetes.io/rbd) volume plugins are deprecated in 1.28 and will be removed in a future release.
  • To determine if you have volumes or Pods using RBD or Ceph volumes, run the following commands. If either of them print output, then you are using a deprecated volume type.
    • kubectl describe pv | egrep -i 'Type: *(RBD|CephFS)'
    • kubectl describe pod -A | egrep -i 'Type: *(RBD|CephFS)'
  • Switch to use an RBD or CephFS CSI driver, such as the drivers provided in the Ceph CSI GitHub repo, or use a Google-managed solution such as Filestore. For more information, refer to the OSS Kubernetes announcement and the Ceph CSI GitHub repo.

(2023-R18) Version updates

GKE cluster versions have been updated.

New versions available for upgrades and new clusters

The following Kubernetes versions are now available for new clusters and for opt-in control plane upgrades and node upgrades for existing clusters. For more information on versioning and upgrades, see GKE versioning and support and Upgrades.

No channel

  • The following control plane and node versions are now available:
  • The following control plane versions are no longer available: 1.23.17-gke.8400, 1.23.17-gke.10000, 1.23.17-gke.10700, 1.24.14-gke.1400, 1.24.14-gke.2100, 1.25.10-gke.2100, 1.26.5-gke.1400

  • Control planes and nodes with auto-upgrade enabled will be upgraded from version 1.23 to version 1.24.14-gke.2700 with this release.

  • Control planes and nodes with auto-upgrade enabled will be upgraded from version 1.24 to version 1.25.10-gke.2700 with this release.

  • Control planes and nodes with auto-upgrade enabled will be upgraded from version 1.25 to version 1.25.10-gke.2700 with this release.

Stable channel

  • The following versions are now available in the Stable channel:
  • The following versions are no longer available in the Stable channel: 1.23.17-gke.8400, 1.24.14-gke.1400, 1.25.10-gke.2100, 1.27.3-gke.1700
  • Control planes and nodes with auto-upgrade enabled in the Stable channel will be upgraded from version 1.23 to version 1.24.14-gke.2700 with this release.
  • Control planes and nodes with auto-upgrade enabled in the Stable channel will be upgraded from version 1.24 to version 1.25.10-gke.2700 with this release.
  • Control planes and nodes with auto-upgrade enabled in the Stable channel will be upgraded from version 1.25 to version 1.25.10-gke.2700 with this release.

Regular channel

  • The following versions are now available in the Regular channel:
  • The following versions are no longer available in the Regular channel: 1.23.17-gke.10000, 1.24.14-gke.2700, 1.25.10-gke.2700, 1.26.5-gke.2700
  • Control planes and nodes with auto-upgrade enabled in the Regular channel will be upgraded from version 1.23 to version 1.24.15-gke.1700 with this release.
  • Control planes and nodes with auto-upgrade enabled in the Regular channel will be upgraded from version 1.24 to version 1.25.11-gke.1700 with this release.
  • Control planes and nodes with auto-upgrade enabled in the Regular channel will be upgraded from version 1.25 to version 1.26.6-gke.1700 with this release.
  • Control planes and nodes with auto-upgrade enabled in the Regular channel will be upgraded from version 1.26 to version 1.26.6-gke.1700 with this release.

Rapid channel

  • Version 1.27.4-gke.900 is now the default version in the Rapid channel.
  • The following versions are now available in the Rapid channel:
  • The following versions are no longer available in the Rapid channel: 1.23.17-gke.10000, 1.23.17-gke.10700, 1.24.16-gke.500, 1.25.11-gke.1700, 1.26.6-gke.1700, 1.27.3-gke.1700
  • Control planes and nodes with auto-upgrade enabled in the Rapid channel will be upgraded from version 1.23 to version 1.24.17-gke.200 with this release.
  • Control planes and nodes with auto-upgrade enabled in the Rapid channel will be upgraded from version 1.24 to version 1.25.12-gke.500 with this release.
  • Control planes and nodes with auto-upgrade enabled in the Rapid channel will be upgraded from version 1.25 to version 1.26.7-gke.500 with this release.
  • Control planes and nodes with auto-upgrade enabled in the Rapid channel will be upgraded from version 1.26 to version 1.27.4-gke.900 with this release.
  • Control planes and nodes with auto-upgrade enabled in the Rapid channel will be upgraded from version 1.27 to version 1.27.4-gke.900 with this release.
  • Control planes and nodes with auto-upgrade enabled in the Rapid channel will be upgraded from version 1.28 to version 1.28.1-gke.200 with this release.

The recently released version of GKE, version 1.28, has a known regression in behavior. After node restart, Pods that have started initialization before the restart will run Init containers in-parallel with regular containers instead of waiting for Init containers to complete.

To deliver a better default price-performance for applications, all GKE Autopilot clusters with control plane version 1.27.5 and later will use an SSD-based persistent disk for ephemeral storage. This change will only affect newly created clusters and new node pools created in clusters upgraded to version 1.27.5 and later.

It is not yet possible to enable Gateway API support in GKE 1.28 (Standard or Autopilot), this will be fixed in an upcoming patch release to GKE 1.28. Clusters that already have Gateway API enabled before upgrading to GKE 1.28 will continue to be supported. This will not affect existing Gateways.

(2023-R18) Version updates

  • The following control plane and node versions are now available:
  • The following control plane versions are no longer available: 1.23.17-gke.8400, 1.23.17-gke.10000, 1.23.17-gke.10700, 1.24.14-gke.1400, 1.24.14-gke.2100, 1.25.10-gke.2100, 1.26.5-gke.1400

  • Control planes and nodes with auto-upgrade enabled will be upgraded from version 1.23 to version 1.24.14-gke.2700 with this release.

  • Control planes and nodes with auto-upgrade enabled will be upgraded from version 1.24 to version 1.25.10-gke.2700 with this release.

  • Control planes and nodes with auto-upgrade enabled will be upgraded from version 1.25 to version 1.25.10-gke.2700 with this release.

(2023-R18) Version updates

  • The following versions are now available in the Stable channel:
  • The following versions are no longer available in the Stable channel: 1.23.17-gke.8400, 1.24.14-gke.1400, 1.25.10-gke.2100, 1.27.3-gke.1700
  • Control planes and nodes with auto-upgrade enabled in the Stable channel will be upgraded from version 1.23 to version 1.24.14-gke.2700 with this release.
  • Control planes and nodes with auto-upgrade enabled in the Stable channel will be upgraded from version 1.24 to version 1.25.10-gke.2700 with this release.
  • Control planes and nodes with auto-upgrade enabled in the Stable channel will be upgraded from version 1.25 to version 1.25.10-gke.2700 with this release.

(2023-R18) Version updates

  • The following versions are now available in the Regular channel:
  • The following versions are no longer available in the Regular channel: 1.23.17-gke.10000, 1.24.14-gke.2700, 1.25.10-gke.2700, 1.26.5-gke.2700
  • Control planes and nodes with auto-upgrade enabled in the Regular channel will be upgraded from version 1.23 to version 1.24.15-gke.1700 with this release.
  • Control planes and nodes with auto-upgrade enabled in the Regular channel will be upgraded from version 1.24 to version 1.25.11-gke.1700 with this release.
  • Control planes and nodes with auto-upgrade enabled in the Regular channel will be upgraded from version 1.25 to version 1.26.6-gke.1700 with this release.
  • Control planes and nodes with auto-upgrade enabled in the Regular channel will be upgraded from version 1.26 to version 1.26.6-gke.1700 with this release.

(2023-R18) Version updates

  • Version 1.27.4-gke.900 is now the default version in the Rapid channel.
  • The following versions are now available in the Rapid channel:
  • The following versions are no longer available in the Rapid channel: 1.23.17-gke.10000, 1.23.17-gke.10700, 1.24.16-gke.500, 1.25.11-gke.1700, 1.26.6-gke.1700, 1.27.3-gke.1700
  • Control planes and nodes with auto-upgrade enabled in the Rapid channel will be upgraded from version 1.23 to version 1.24.17-gke.200 with this release.
  • Control planes and nodes with auto-upgrade enabled in the Rapid channel will be upgraded from version 1.24 to version 1.25.12-gke.500 with this release.
  • Control planes and nodes with auto-upgrade enabled in the Rapid channel will be upgraded from version 1.25 to version 1.26.7-gke.500 with this release.
  • Control planes and nodes with auto-upgrade enabled in the Rapid channel will be upgraded from version 1.26 to version 1.27.4-gke.900 with this release.
  • Control planes and nodes with auto-upgrade enabled in the Rapid channel will be upgraded from version 1.27 to version 1.27.4-gke.900 with this release.
  • Control planes and nodes with auto-upgrade enabled in the Rapid channel will be upgraded from version 1.28 to version 1.28.1-gke.200 with this release.
Virtual Private Cloud

Support for IPv6 static routes with the following next hops is generally available (GA):

  • next-hop-gateway
  • next-hop-instance
Workload Manager

Preview: Workload Manager is now available for SQL Server workloads. For more information, see the Product overview.

September 04, 2023

Cloud Composer

(Cloud Composer 2) An update that enforces VPC Service Controls perimeter settings for accessing Airflow UI and Airflow REST API is rolled out to all regions. As a result of this change, certain users that could previously access the Airflow UI or Airflow REST API might not be able to do it now.

If you experience problems with access to Airflow UI or Airflow REST API, update the perimeter or access level configuration for affected users. For more information on configuring VPC Service Controls see Configure VPC Service Controls.

Dataproc

Announcing the General Availability (GA) release of Data Lineage for Dataproc, which captures data transformations (lineage events) in Dataproc Spark jobs, and publishes them to Dataplex Lineage.

Dataproc Serverless Interactive sessions detail and list pages are now available in the Google Cloud console.

September 01, 2023

Anthos clusters on VMware

Anthos clusters on VMware 1.15.4-gke.37 is now available. To upgrade, see Upgrading Anthos clusters on VMware. Anthos clusters on VMware 1.15.4-gke.37 runs on Kubernetes 1.26.7-gke.2500.

Upgrading an admin cluster with always-on secrets encryption enabled might fail.

An admin cluster upgrade from 1.14.x to 1.15.0 - 1.15.4 with always-on secrets encryption enabled might fail depending on whether the feature was enabled during cluster creation or during cluster update.

We recommend that you don't upgrade your admin cluster until a fix is available in 1.15.5. If you must upgrade to 1.15.0-1.15.4, do the steps in Preventing the upgrade failure before upgrading the cluster.

For information on working around an admin cluster failure because of this issue, see Upgrading an admin cluster with always-on secrets encryption enabled fails. Note that the workaround relies on you having the old encryption key backed up. If the old key is no longer available, you will have to recreate the admin cluster and all user clusters.

The following issues are fixed in 1.15.4-gke.37:

  • Fixed a known issue where incorrect log rotation configuration for fluent-bit caused low disk space on the Seesaw VM.

  • Fixed a known issue that GARP reply sent by Seesaw doesn't set target IP.

  • Fixed an issue where /etc/vsphere/certificate/ca.crt wasn't updated after vsphere CA rotation on the Controlplane v2 user cluster control plane machines.

  • Fixed a known issue where the admin SSH public key has error after admin cluster upgrade or update.

The following vulnerabilities are fixed in 1.15.4-gke.37:

Assured Workloads

The Japan Regions compliance program is now in Preview.

Cloud Build

Cloud Build's free tier now offers the e2-standard-2 machine type as the new default machine type. The free tier now offers 2,500 build-minutes per month to provide you with more flexibility to use free build-minutes however you want throughout the month instead of being limited to a daily allocation. Changes to the Cloud Build free tier are effective as of September 1, 2023. To learn more, see Cloud Build pricing.

Google Kubernetes Engine

Starting on September 1, 2023, a new automation policy is in effect where GKE automatically starts a credential rotation within 30 days of your cluster's certificate authority expiry date to ensure that your cluster doesn't have a complete outage. For example, if your cluster's CA expires on 2024-01-05, an automatic rotation starts on or after 2023-12-06. Automatic credential rotation is a critical update that ignores any configured maintenance windows.

This automatic rotation might cause API clients outside the cluster, such as kubectl in a local environment, to stop working unless you update those clients to use the new credentials.

You should plan for and perform credential rotations well in advance of your cluster CA expiring to ensure a smooth transition to new credentials and minimal workload disruptions. Don't rely on automatic rotation; it is intended to be a last resort to prevent complete outages. To learn more about the stages of credential rotation, see Rotate your cluster's credentials.

Vertex AI

Pricing update

The pricing for text-bison has been reduced to $0.0005 per 1,000 input and output characters. For details, see Vertex AI Pricing.

August 31, 2023

Apigee hybrid

hybrid v1.10.3

On August 31, 2023 we released an updated version of the Apigee hybrid software, v1.10.3.

Bug ID Description
295929616 Installation of Hybrid 1.10.x would fail on OpenShift due to out of memory issues.
292571089 An error with support for CSI backup and restore for Cassandra was fixed.
287321226 Security context has been corrected for apigee-prom-prometheus to avoid privilege escalation.
Bug ID Description
296717665,
296717664,
296717663,
296717662,
296717185,
296716666,
296716649,
296716632,
296716468,
296716467,
296716232,
296715152,
296715151,
296714218
Security fixes for apigee-cassandra-backup-utility.
This addresses the following vulnerabilities:
297938600,
297938559,
297938486,
294892344
Security fixes for apigee-diagnostics-collector.
This addresses the following vulnerabilities:
297938498,
297938487
Security fixes for apigee-fluent-bit.
This addresses the following vulnerabilities:
296719459,
296719400,
296719348,
296719307,
296719306,
296719188,
296719187,
296719186,
296719115,
296719018,
296718937,
296718918,
296718917,
296718916,
296716670,
296716669,
296716472,
296716471,
296715155
Security fixes for apigee-hybrid-cassandra.
This addresses the following vulnerabilities:
296717666,
296717283,
296716668,
296716667,
296716650,
296716635,
296716634,
296716633,
296716470,
296716234,
296715734,
296715733,
296715154,
296715153
Security fixes for apigee-hybrid-cassandra-client.
This addresses the following vulnerabilities:
297286274 Security fixes for apigee-installer.
This addresses the following vulnerabilities:
295936113 Security fixes for apigee-mart-server.
This addresses the following vulnerability:
297938441 Security fixes for apigee-runtime.
This addresses the following vulnerabilities:
294906706 Security fixes for apigee-prom-prometheus.
This addresses the following vulnerabilities:
293925856 Security fixes for apigee-prometheus-adapter.
This addresses the following vulnerabilities:
Cloud Bigtable

You can now use EXPORT DATA statements to directly export BigQuery data to Cloud Bigtable. This feature is in Preview.

Cloud SQL for PostgreSQL

The pgvector extension, version 0.4.2 is generally available. Use this extension to store and search for vector embeddings in PostgreSQL databases.

Cloud Spanner

A monthly digest of client library updates from across the Cloud SDK.

Go

Changes for spanner/admin/database/apiv1

1.48.0 (2023-08-18)

Features
  • spanner/spansql: Add complete set of math functions (#8246) (d7a238e)
  • spanner/spansql: Add support for foreign key actions (#8296) (d78b851)
  • spanner/spansql: Add support for IF NOT EXISTS and IF EXISTS clause (#8245) (96840ab)
  • spanner: Add integration tests for Bit Reversed Sequences (#7924) (9b6e7c6)
Bug Fixes
  • spanner: Reset buffer after abort on first SQL statement (#8440) (d980b42)
  • spanner: REST query UpdateMask bug (df52820)

1.49.0 (2023-08-24)

Features
Bug Fixes
  • spanner: Transaction was started in a different session (#8467) (6c21558)

Java

Changes for google-cloud-spanner

6.45.0 (2023-08-04)

Features
  • Enable leader aware routing by default in Connection API. This enables its use in the JDBC driver and PGAdapter. The update contains performance optimisations that will reduce the latency of read/write transactions that originate from a region other than the default leader region. (2a85446)
  • Enable leader aware routing by default. This update contains performance optimisations that will reduce the latency of read/write transactions that originate from a region other than the default leader region. (441c1b0)
  • Long running transaction clean up background task. Adding configuration options for closing inactive transactions. (#2419) (423e1a4)
  • Support partitioned queries + data boost in Connection API (#2540) (4e31d04)
Bug Fixes
Dependencies
  • Update dependency com.google.cloud:google-cloud-shared-dependencies to v3.14.0 (#2562) (dbd5c75)
  • Update dependency org.openjdk.jmh:jmh-core to v1.37 (#2565) (d5c36bf)
  • Update dependency org.openjdk.jmh:jmh-generator-annprocess to v1.37 (#2566) (73e92d4)

6.45.1 (2023-08-11)

Bug Fixes

6.45.2 (2023-08-14)

Bug Fixes
  • GetColumnCount would fail for empty partititioned result sets (#2588) (9a2f3fc)

6.45.3 (2023-08-17)

Bug Fixes
  • Use streaming read/query settings for stream retry (#2579) (f78b838)

Node.js

Changes for @google-cloud/spanner

6.15.0 (2023-08-04)

Features
  • Enable leader aware routing by default. This update contains performance optimisations that will reduce the latency of read/write transactions that originate from a region other than the default leader region. (6852d99)

6.16.0 (2023-08-07)

Features
Bug Fixes

Python

Changes for google-cloud-spanner

3.39.0 (2023-08-02)

Features
  • Foreign key on delete cascade action testing and samples (#910) (681c8ee)
Documentation

3.40.0 (2023-08-04)

Features
  • Enable leader aware routing by default. This update contains performance optimisations that will reduce the latency of read/write transactions that originate from a region other than the default leader region. (e8dbfe7)

3.40.1 (2023-08-17)

Bug Fixes
  • Fix to reload table when checking if table exists (#1002) (53bda62)
Dataform

Legacy Dataform will be deprecated on February 26, 2024, after which you will not be able to access legacy projects.

We recommend migration to Dataform in Google Cloud Platform.

To learn more about Dataform in Google Cloud Platform, see Overview of Dataform.

To discover how to migrate legacy projects, see Migrate from legacy Dataform.

Dialogflow

Dialogflow CX generative features are now GA and publicly available:

Dialogflow CX answer feedback is now GA, but access is limited and must be requested.

Dialogflow CX Messenger has been redesigned and is now GA. This new version of the integration replaces the old version, which has been renamed Legacy Dialogflow Messenger. The old version is now deprecated, and it is recommended that all users of the old version migrate to the new version.

Eventarc

Eventarc support for creating triggers for direct events from the following sources is generally available (GA):

  • AlloyDB for PostgreSQL
  • API Gateway
  • Apigee Registry
  • Backup for GKE
  • BeyondCorp
  • Certificate Manager
  • Cloud Data Fusion
  • Cloud Dataplex
  • Cloud Functions
  • Cloud Memorystore for Memcached
  • Database Migration
  • Dataflow
  • Dataproc Metastore
  • Datastream
  • Firebase Alerts
  • Firebase Remote Config
  • Firebase Test Lab
  • GKE Hub
  • Google Cloud Memorystore for Redis
  • Network Connectivity
  • Network Management
  • Transcoder
  • User-managed notebooks (Notebooks)
  • Vision AI
  • VM Migration
  • Workflows

Google Kubernetes Engine

For GKE nodes running version 1.25 and later, when Image streaming is enabled, the mv command and renameat2 system call might fail on symlink files in container images with the error message "No such device or address". The issue is caused by a regression on recent Linux kernels. GKE does not currently have a fix for the issue. To learn more, see the troubleshooting section for this issue.

Vertex AI

Experiment management: Google Cloud console now supports visualization of your model's performance changes over steps during training, and shows advanced run comparisons. To learn more, see Compare and analyze runs: Google Cloud console.

reCAPTCHA Enterprise

reCAPTCHA Enterprise for WAF and Google Cloud Armor integration is now available for mobile applications in Public Preview. For more information, see Integrate with Google Cloud Armor for mobile applications.

August 30, 2023

Bare Metal Solution

You can now view and respond to maintenance events through Google Cloud console. This feature is generally available (GA). For more information, see Manage maintenance events.

BigQuery

You can now use EXPORT DATA statements to directly export BigQuery data to Bigtable. This feature is in preview.

Chronicle SOAR

Release Notes 6.2.34

  • Alerts ingested using webhooks are missing details (ID #00249611)
  • Entity Graph widget either not appearing or appearing without information (ID #00246250, #46124390)
  • Entity Graph API call not working
Cloud Database Migration Service

Database Migration Service support for Oracle to Cloud SQL for PostgreSQL migrations is now generally available (GA). For more information, see Database Migration Service for Oracle to PostgreSQL documentation.

Integrated code and schema conversion for Oracle to Cloud SQL for PostgreSQL migrations is now available in Preview. With this feature, Database Migration Service conversion workspaces provide an inline editor to help make your schema conversions simple and seamless.

Compute Engine

Generally available: NVIDIA L4 GPUs are now available in the following additional regions and zones:

  • APAC
    • Taiwan (asia-east1-a,c)
    • Tokyo (asia-northeast1-a,c)
    • Singapore(asia-southeast1-c)
  • Europe
    • Belgium (europe-west1-c)
    • London (europe-west2-a,b)
  • North America
    • Northern virginia (us-east4-c)
    • Dalles (us-west1-c)

For more information about using GPUs on Compute Engine, see GPU platforms.

Google Kubernetes Engine

GKE now supports the ability to create nodes and workloads with multiple network interfaces. You can create new clusters with version 1.27 and later with multi networking enabled. The additional network interfaces on the Pods can be regular interfaces or high performance interfaces where the network interface is directly attached to the Pod. For more information, see Setup multi-network support for Pods.

Your clusters can now perform operations, such as node auto-provisioning or version upgrades, on multiple node pools in parallel. You no longer have to wait for an operation to complete before you initiate another operation. This feature is enabled for all GKE versions. This change provides you with benefits like the following:

  • More efficient scaling, which results in improved savings and faster workload deployment
  • Faster, less disruptive node pool upgrades
  • Fewer "operation already in progress" messages that could delay subsequent planned operations
  • More reliable rollback behavior to fix upgrade-related disruptions in production
  • Automatic control plane resize operations won't block other operations on the cluster

The Google Cloud Platform Terraform provider has also been updated to take advantage of this change.

Virtual Private Cloud

You can add Resource Manager tags to supported VPC resources. For more information, see Create and manage tags for VPC resources.

August 29, 2023

Access Transparency

Access Transparency supports GKE Connect and GKE Hub in the GA stage.

AlloyDB for PostgreSQL

AlloyDB AI, a suite of features for building generative AI applications, is now available with both AlloyDB and AlloyDB Omni. These features include the following:

  • The AlloyDB machine learning (ML) extension introduces an embedding SQL function. It lets you create vector embeddings from text using ML models. You can store these embeddings as vector data, and apply them as input to pgvector functions.

  • AlloyDB support for the pgvector extension brings performance enhancements for vector queries that run up to ten times faster than standard PostgreSQL, including an optimization that lets you create indexes of stored vector data using scalar quantization.

AlloyDB Omni version 15.2.0 is available in Preview. This version includes the following:

A separate Technology Preview edition of AlloyDB Omni is available. It lets you experiment with AlloyDB AI functionality using two included machine learning models trained on Google News text.

In AlloyDB Omni version 15.2.0, using the COPY function with the FREEZE option is disabled, due to a potential performance issue when loading large datasets.

Artifact Registry

Artifact Analysis automatic scanning for Python and Node.js (npm) vulnerabilities in container images is now generally available. If the Container Scanning API is enabled, it scans container images pushed to Artifact Registry for Python and Node.js vulnerabilities, in addition to operating system vulnerabilities.

Artifact Analysis returns Python and Node.js vulnerability results for images that have a supported or unsupported operating system. When you push new versions of images to the registry, you might see more successful vulnerability scans and corresponding charges against images without a supported operating system.

For more information, see Python overview and Node.js overview.

Artifact Analysis now offers support for Vulnerability Exploitability eXchange (VEX). VEX is a type of security advisory that indicates whether a product is affected by a known vulnerability. For every container image pushed to Artifact Registry, Artifact Analysis can store an associated VEX statement.

You can upload VEX files to describe any vulnerabilities discovered in specific artifacts and provide context about their impact. VEX statuses can be used to assist your organization in triaging vulnerabilities.

This feature is in Preview. To learn more, see Upload and view VEX statements.

Artifact Analysis now offers the ability to export a consolidated software bill of materials (SBOM) for scanned containers in Artifact Registry. SBOMs are generated in the Software Package Data Exchange (SPDX) format; however, you can also ingest externally created SBOMs in either SPDX or CycloneDx formats. With this new capability, you can centrally manage SBOMs to gain visibility into key information about your software supply chain.

This feature is in Preview. To learn more about our SBOM capabilities, see SBOM overview.

Batch

Documentation has been added to explain the VM OS environment for Batch. For a job's VMs, you can optionally configure the OS image and/or boot disk properties. Otherwise, a job uses the default configuration.

For more information, see the following pages:

BigQuery

Data clean rooms is now in preview. Data clean rooms provide a secure environment in which multiple parties can share, join, and analyze their data assets without moving or revealing the underlying data. To learn more, see the following topics:

Duet AI in BigQuery, an AI-powered collaborator in Google Cloud, can help you complete, generate, and explain SQL queries. This feature is in preview.

BigQuery Studio is now in preview. BigQuery Studio offers features to make it easier for you to discover, explore, analyze, and run inference on data in BigQuery, including:

  • Python notebooks, powered by Colab Enterprise. Notebooks provide one-click Python development runtimes, and built-in support for BigQuery DataFrames.
  • Asset management and version history for notebooks and saved queries, powered by Dataform.

BigQuery DataFrames is now in preview. BigQuery DataFrames is a Python API that you can use to analyze data and perform machine learning tasks in BigQuery. BigQuery DataFrames consists of the following parts:

  • bigframes.pandas implements a DataFrame API (with partial Pandas compatibility) on top of BigQuery.
  • bigframes.ml implements a Python API for BigQuery ML (with partial scikit-learn compatibility).

Get started with BigQuery DataFrames by using the BigQuery DataFrames quickstart.

The following Generative AI features are now generally available (GA) in BigQuery ML:

Try these features with the Generate text by using a remote model and the ML.GENERATE_TEXT function tutorial.

Cloud Build

You can now configure Cloud Build to generate Google-signed identity tokens for user-specified service accounts during a build. Leveraging identity tokens with Cloud Build, you can:

Identity tokens that you generate with Cloud Build conform to the OpenID Connect (OIDC) specification.

This feature is generally available.

Cloud Firewall

You can use intrusion prevention service to safeguard your workload traffic from threats such as malware, spyware, and command-and-control attacks. This feature is available in Preview.

Cloud Functions

Cloud Functions (2nd gen) is now the default choice in the Google Cloud console user interface.

Cloud Logging Cloud Spanner

Spanner Studio includes Duet AI (in Preview), an AI-powered collaborator in Google Cloud that accelerates SQL development by helping you write SQL statements. For more information, see Write SQL with Duet AI assistance.

Cloud TPU

You can now create Cloud Tensor Processing Unit (TPU) nodes in Google Kubernetes Engine (GKE) to run AI workloads, from training to inference models. GKE manages your cluster by automating TPU resource provisioning, scaling, scheduling, repairing, and upgrading. GKE provides TPU infrastructure metrics in Cloud Monitoring, TPU logs, and error reports for better visibility and monitoring of TPU node pools in GKE clusters. TPUs are available with GKE Standard clusters. GKE supports TPU v4 in version 1.26.1.gke-1500 and later, and supports TPU v5e in version 1.27.2-gke.1500 and later. To learn more, see TPUs in GKE introduction.

Cloud Workstations

Duet AI for Cloud Workstations is available in Preview. Use Duet AI, your AI-powered collaborator, to accomplish tasks more effectively and efficiently. Duet AI provides contextualized responses to your prompts to help guide you on what you're trying to do with your code. It also shares source citations regarding which documentation and code samples the assistant used to generate its responses. You can do this in the Cloud Workstations base editor. For more information, see the Duet AI in Google Cloud overview and Code with Duet AI assistance.

Colab Enterprise

Colab Enterprise is now available in Preview. Colab Enterprise combines the popular collaborative features of Colaboratory with the security and compliance capabilities of Google Cloud. Colab Enterprise includes:

  • Sharing and collaborating functionality, with IAM access control.
  • Google-managed compute and runtime provisioning, with configurable runtime templates.
  • Integrations with Vertex AI and BigQuery.
  • Inline code completion with Duet AI assistance.
  • End-user credential authentication for running your notebook code.

To get started, see Introduction to Colab Enterprise or create a notebook and start coding.

Compute Engine

Preview: You can use future reservations to reserve resources at a specific date and time in the near future.

Future reservations are useful for obtaining capacity for future peak-demand events or highly-demanded resources. For more information, see About future reservation requests.

Dataproc

Announcing the Preview release of Dataproc Serverless for Spark Interactive sessions and the Dataproc Jupyter Plugin.

Google Kubernetes Engine

You can now create Cloud Tensor Processing Unit (TPU) nodes in GKE to run AI workloads, from training to inference models. GKE manages your cluster by automating TPU resource provisioning, scaling, scheduling, repairing, and upgrading. GKE provides TPU infrastructure metrics in Cloud Monitoring, TPU logs, and error reports for better visibility and monitoring of TPU node pools in GKE clusters. TPUs are available with GKE Standard clusters. GKE supports TPU v4 in version 1.26.1.gke-1500 and later, and supports TPU v5e in version 1.27.2-gke.1500 and later. To learn more, see About TPUs in GKE.

You can now sequence the rollout of cluster upgrades across fleets or across scopes. To learn more, see About cluster upgrades with rollout sequencing.

Vertex AI

Imagen on Vertex AI now offers the following Generally Available (GA) features:

* Restricted access feature.

For more information about Imagen or how to get access to restricted GA features, see the Imagen on Vertex AI overview.

Stream responses from Generative AI models

Generative AI model streaming support is now Generally Available (GA). After you send a prompt, the model returns response tokens as they're generated instead of waiting for the entire output to be available.

Supported models are:

  • text-bison
  • chat-bison
  • code-bison
  • codechat-bison

To learn more, see Stream responses from Generative AI models.

New Generative AI support on Vertex AI models and expanded language support

Generative AI support on Vertex AI has been updated to include new language model candidates (latest models), language models that support input and output tokens up to 32k, and more supported languages.

For details, see Available models and Model versions and lifecycle.

Model tuning for the text-bison model is now Generally Available (GA)

Tuning the text-bison model with supervised fine-tuning (SFT) is now Generally Available (GA) . For more information, see Tune text models.

Model tuning for the chat-bison model is now available in Preview

You can now use supervised fine-tuning to tune the chat-bison model. This feature is in (Preview). For more information, see Tune text models.

New embedding model now available in Preview

Generative AI support on Vertex AI users can now create embeddings using a new model trained on a wide range of non-English languages in (Preview).

  • textembedding-gecko-multilingual

To learn more, see Get text embeddings.

Reinforcement learning from human feedback (RLHF) tuning for text-bison The Generative AI text generation foundation model (text-bison) now supports RLHF tuning. The RLHF tuning feature is in (Preview). For more information, see Use RLHF model tuning.

Vertex AI Codey APIs language support

Vertex AI Codey APIs now support additional programming languages. For more information, see Supported coding languages

Vertex AI Codey APIs now support supervised fine-tuning (SFT)

The code chat (codechat-bison) and code generation (code-bison) Vertex AI Codey APIs models now support supervised fine-tuning (SFT). The supervised-fine tuning for Vertex AI Codey APIs models feature is in (Preview). For more information, see Tune code models.

Metrics-based model evaluation

You can evaluate the performance of foundation models and tuned models against an evaluation dataset for classification, summarization, question answering, and general text generation. This feature is available in (Preview).

To learn more, see Evaluate model performance.

Vertex AI Vector Search is the new product name for Vertex AI Matching Engine.

Vertex AI Model Registry Models and Vertex AI Datasets are now synced to Dataplex's Data Catalog. Data Catalog enables organization-wide search and discovery of data artifacts, while still maintaining IAM boundaries. The sync and search of these assets is available in Preview. For more information, see Data Catalog documentation.

CountToken API now available in Preview

The CountToken API is now available in (Preview). You can use this API to get the token count and the number of billable characters for a prompt. To learn more, see Get token count.

The Vertex AI Pipelines Template Gallery is now generally available (GA). The Template Gallery contains Google-authored pipeline and component templates to bootstrap your MLOps practice. Customize and run the templates as-is or embed them into your own pipelines. For more information, see Use a prebuilt template from the Template Gallery.

Vertex AI Search and Conversation

Vertex AI Search and Conversation is the new product name for Generative AI App Builder.

Generative AI App Builder: GA

Gen AI App Builder is publicly and generally available (GA).

Separation of data stores and apps

Data stores and apps are separate entities. In the console, you can see your apps on the Apps page and your data stores on the Data Stores page. You can create a data store and attach it to an app during app creation, or create a new data store during app creation.

Apps and data stores have a one-to-one relationship. Each app is associated with one data store; they can't be disconnected after you attach them. This change does not affect the functionality of your existing apps.

Enterprise Search: Search with follow-ups is GA

Previously, the search with follow-ups feature was called multi-turn search.

Search with follow-ups is now generally available (GA).

Search with follow-ups can be applied to websites if advanced website indexing is enabled and to unstructured data.

In addition, to improve consistency between search with an answer and search with follow-ups, the response from the conversations.converse method v1 provides the summary object and no longer provides the reply and references objects. The response from the v1beta version of the method remains unchanged.

SafeSearch is available with the search with follow-ups feature.

For general information about search with follow-ups, see Search with follow-ups.

Enterprise Search: Improvements to snippets, extractive answers, and extractive segments

  • Snippet status is now returned along with the snippet.

  • Extractive answers include the document page number where the answer was found.

  • Up to 10 extractive segments can be returned for a search result.

See Get snippets and extracted content.

Enterprise Search: Multi-region support for US and EU locations

When you create a data store, you can specify global, the US multi-region, or the EU multi-region.

For more information including limitations associated with multi-region use, see Enterprise Search locations.

Enterprise Search: Languages

More features in more languages are supported for Enterprise Search.

See Languages.

Enterprise Search: Verify website domains

New requirement to verify your domain ownership for any websites in your data stores with advanced website indexing turned on.

See Verify website domains.

Enterprise Search: Confidence scores

Confidence scores for extractive segments are available in preview with allowlist. Scores are based on the similarity of the query to the extracted segment.

See Extractive segments.

Enterprise Search: Serving controls using the API are allowlisted GA

Boost, filter, synonym, and redirect serving controls affect search results returned through API method calls.

For more information, see Configure serving controls.

Enterprise Search: Related questions

Related questions are available as an allowlisted, preview feature for search with follow-ups.

For information, see Related questions.

August 28, 2023

Access Approval

Access Approval supports Anthos Identity Service in the GA stage.

Buildpacks

The support policy and schedule for Google Cloud's buildpacks is now available at https://cloud.google.com/docs/buildpacks/support-policy.

Chronicle

You can now use Cloud Monitoring to customize and receive notifications about ingestion health metrics. For more information, see Ingestion notifications for health metrics.

Cloud Asset Inventory

The following resource types are now publicly available through the ExportAssets, ListAssets, BatchGetAssetsHistory, QueryAssets, and Feed APIs.

  • Financial Services
    • financialservices.googleapis.com/Instance
  • Discovery Engine
    • discoveryengine.googleapis.com/Collection
    • discoveryengine.googleapis.com/DataStore
Cloud Bigtable

Cloud Bigtable is available in the europe-west10 (Berlin) region. For more information, see Bigtable locations.

Cloud Natural Language API

The Natural Language API v2 is now available in Public Preview. This new version of the API supports Sentiment Analysis, Entity Analysis, Text Moderation, and Content Classification. This version has major updates for Sentiment Analysis and Entity Analysis, which include performance upgrades and general improvements. All API calls now return language_code .

Sentiment analysis uses a new PaLM-based model for improved quality. The language field is now called language_code.

Entity analysis uses a new PaLM-based model for improved quality. Please note the following updates:

  • language field is now called "language_code"
  • No salience field.
  • No wikipedia_url as metadata.
  • Parsing improvements for the following entity types: PHONE_NUMBER, ADDRESS, DATE, NUMBER, PRICE
  • New probability score field is returned for all entities where NUMBER, PHONE_NUMBER, ADDRESS, PRICE, DATE will always be 1.0.
Cloud SQL for PostgreSQL

You can now set password policies for local database users of Cloud SQL for PostgreSQL instances.

Firestore in Datastore mode

The sum() and avg() aggregation functions are now available for Firestore in Datastore mode.

A weekly digest of client library updates from across the Cloud SDK.

Go

Changes for datastore/admin/apiv1

1.14.0 (2023-08-22)

Features
  • datastore: SUM and AVG aggregations (#8307) (a9fff18)
  • datastore: Support aggregation query in transaction (#8439) (37681ff)
Bug Fixes
  • datastore: Correcting string representation of Key (#8363) (4cb1211)
  • datastore: Fix NoIndex for array property (#7674) (01951e6)
Documentation
  • datastore/admin: Specify limit for properties in Index message in Datastore Admin API (b890425)

Java

Changes for google-cloud-datastore

2.17.0 (2023-08-22)

Features
  • Publish proto definitions for SUM/AVG in Datastore (#1157) (954320a)
  • Sum and Avg aggregation feature (#1067) (56d1001)
Dependencies
  • Update dependency com.google.errorprone:error_prone_core to v2.21.1 (#1163) (83158b6)
  • Update dependency org.graalvm.buildtools:junit-platform-native to v0.9.24 (#1165) (4094c70)
  • Update dependency org.graalvm.buildtools:native-maven-plugin to v0.9.24 (#1166) (70cc371)
Documentation
  • Update property requirement specifications (#1169) (c908837)
Google Kubernetes Engine

Version 4.80.0 of the Terraform provider for Google Cloud fixes an issue observed when deploying new GKE Autopilot clusters that would destroy and re-create the cluster due to a change in the dns_config state. This version of the provider ensures that customers can deploy GKE Autopilot clusters using Cloud DNS as the default in-cluster DNS provider. For more information, see Terraform plans to re-create Autopilot cluster due to dns_config change.

Pub/Sub

A weekly digest of client library updates from across the Cloud SDK.

Node.js

Changes for @google-cloud/pubsub

4.0.2 (2023-08-24)

Bug Fixes
  • Make retry policy back off more aggressively for RPCs that retry RESOURCE_EXHAUSTD (#1806) (e9969ba)
Vertex AI

Tabular Workflow for Forecasting is available in Preview. For documentation, refer to Tabular Workflow for Forecasting.

August 26, 2023

Cloud Composer

(Cloud Composer versions 1.x.x and 2.0.x): Creating Cloud Composer environments in projects with VPC Service Controls enabled fails if you add Cloud Identity-Aware Proxy API or Identity-Aware Proxy TCP API to the security perimeter.

For more information and possible workarounds, see Environment creation fails in projects with VPC Service Controls enabled.

Cloud Workstations

Posit Workbench (including RStudio Pro) integration is generally available (GA). For more information, see Develop code using Posit Workbench.

August 25, 2023

Access Approval

Access Approval supports Memorystore for Redis in the GA stage.

Anthos clusters on bare metal

Release 1.16.0

Anthos clusters on bare metal 1.16.0 is now available for download. To upgrade, see Upgrading Anthos on bare metal. Anthos clusters on bare metal 1.16.0 runs on Kubernetes 1.27.

Version 1.13 end of life: In accordance with the Anthos Version Support Policy, version 1.13 (all patch releases) of Anthos clusters on bare metal has reached its end of life and is no longer supported.

Red Hat Enterprise Linux (RHEL) 8 minor versions 8.2, 8.3, 8.4, and 8.5 have reached their end of life. Please ensure you're using a supported version of your operating system.

Cluster lifecycle:

  • Upgraded to Kubernetes version 1.27.4.

  • Added support for Red Hat Enterprise Linux (RHEL) version 8.8.

  • GA: Added support for parallel upgrades of worker node pools.

  • GA: Added support to upgrade specific worker node pools separately from the rest of the cluster.

  • GA: Added a separate instance of etcd for the etcd-events object. This new etcd instance is always on and requires ports 2382 and 2383 to be open on control plane nodes for inbound TCP traffic. If these ports aren't opened, cluster creation and cluster upgrades are blocked.

  • GA: Updated preflight checks for cluster installation and upgrades to use changes from the latest Anthos clusters on bare metal patch version to address known issues and provide more useful checks.

  • GA: Support enrolling admin and user clusters in the Anthos On-Prem API automatically to enable cluster lifecycle management from the Google Cloud CLI, the Google Cloud console, and Terraform when the Anthos On-Prem API is enabled. If needed, you have the option to disable enrollment. For more information, see the description for the gkeOnPremAPI field in the cluster configuration file.

  • GA: Added ability to configure kubelet image pull settings for node pools. For more information, see Configure kubelet image pull settings.

  • Added new health check to detect any unsupported drift in the custom resources managed by Anthos clusters on bare metal. Unsupported resource changes can lead to cluster problems.

  • Added a new flag, --target-cluster-name, that is supported by the bmctl register bootstrap command.

Networking:

  • GA: Added support for Services of type LoadBalancer to use externalTrafficPolicy=Local with bundled load balancing with BGP.

  • Preview: Added support for enabling Direct Server Return (DSR) load balancing for clusters configured with flat-mode networking. DSR load balancing is enabled with an annotation, preview.baremetal.cluster.gke.io/dpv2-lbmode-dsr: enable.

  • Preview: Upgraded wherabouts to v0.6.1-gke.1 to support dual-stack networking.

  • Added support for multiple BGP load balancer (BGPLoadBalancer) resources and BGP Community. Multiple BGP load balancer resources provide more flexibility to define which peers advertise specific load balancer nodes and Services. BGP Community support helps you to distinguish routes coming from BGP load balancers from other routes in your network.

Observability:

Security and Identity:

  • GA: Added support for Binary Authorization, a service on Google Cloud that provides software supply-chain security for container-based applications. For more information, see Set up Binary Authorization policy enforcement.

  • GA: Added support for VPC Service Controls, which provides additional security for your clusters to help mitigate the risk of data exfiltration.

  • Preview: Added support for using custom cluster certificate authorities (CAs) to enable secure authentication and encryption between cluster components.

  • Preview: Added support for configuring the Subject Alternative Names (SANs) of the kubeadm generated certificate for the kube-apiserver.

  • Added support to run keepalived as a non-root user.

Supported node pool versions:

If you use selective worker node pool upgrades to upgrade a cluster to version 1.16.0, the following versions are supported for the worker node pools:

  • 1.16.0
  • 1.15.3
  • 1.15.2
  • 1.15.1
  • 1.15.0

For more information about node pool versions, see Node pool version rules.

Functionality changes:

  • Updated constraint on NodePool spec.upgradeStrategy.concurrentNodes to be the smaller of 15 nodes or 50% of the size of the node pool.

  • Replaced legacy method of enabling application logging in the cluster configuration file with two fields, enableCloudLoggingForApplications and enableGMPForApplications, in the stackdriver custom resource.

    The spec.clusterOperations.enableApplication field in the cluster configuration file has no effect on version 1.16.0 and higher clusters. This field populated the enableStackdriverForApplications field in the stackdriver custom resource, which enabled annotation based workload metric collection. I you need this capability, use the annotationBasedApplicationMetrics feature gate in the stackdriver custom resource as shown in the following sample to keep the same behavior:

    kind:stackdriver
    spec:
      enableCloudLoggingForApplications: true
      featureGates:
         annotationBasedApplicationMetrics: true
    
  • Added optional ksmNodePodMetricsOnly feature gate in the stackdriver custom resource to reduce the number of metrics from kube-state-metrics. Reducing the number of metrics makes monitoring pipeline more stable in large scale clusters.

  • Audit logs are compressed on the wire for Cloud Audit Logs consumption, reducing egress bandwidth by approximately 60%.

  • Upgraded local volume provisioner to v2.5.0.

  • Upgraded snapshot controller to v5.0.1.

  • Deprecated v1beta1 volume snapshot custom resources. Anthos clusters on bare metal will stop serving v1beta1 resources in a future release.

  • Removed resource request limits on edge profile workloads.

  • Added preflight check to make sure control plane and load balancer nodes aren't under maintenance before an upgrade.

  • Updated the cluster snapshot capability so that information can be captured for the target cluster even when the cluster custom resource is missing or unavailable.

  • Improved bmctl error reporting for failures during the creation of a bootstrap cluster.

  • Added support for using the baremetal.cluster.gke.io/maintenance-mode-deadline-seconds cluster annotation to specify the maximum node draining duration, in seconds. By default, a 20-minute (1200 seconds) timeout is enforced. When the timeout elapses, all pods are stopped and the node is put into maintenance mode. For example to change the timeout to 10 minutes, add the annotation baremetal.cluster.gke.io/maintenance-mode-deadline-seconds: "600" to your cluster.

  • Updated bmctl check cluster to create a HealthCheck custom resource in the admin cluster if it's healthy.

Fixes:

  • Fixed an issue where the apiserver could become unresponsive during a cluster upgrade for clusters with a single control plane node.

  • Fixed an issue where cluster installations or upgrades fail when the cluster name has more than 45 characters.

  • Fixed an issue where the control plane VIP wasn't reachable during cluster installation on Red Hat Enterprise Linux.

  • Fixed an issue where audit logs were duplicated into the offline buffer even when they are sent to Cloud Audit Logs successfully.

  • Fixed an issue where node-specific labels set on the node pool were sometimes overwritten.

  • Updated avoidBuggyIPs and manualAssign fields in load balancer address pools (spec.loadBalancers.addressPools) to allow changes at any time.

  • Fixed an issue where containerd didn't restart when there was a version mismatch. This issue caused an inconsistent containerd version within the cluster.

  • Fixed an issue that caused the logging agent to use continuously increasing amounts of memory.

  • Fixed preflight check so that it no longer ignores the no_proxy setting.

  • Fixed Anthos Identity Service annotation needed for exporting metrics.

  • Fixed an issue that caused the bmctl restore command to stop responding for clusters with manually configured load balancers.

  • Fixed an issue that prevented Anthos clusters on bare metal from restoring a high-availability quorum for nodes that use /var/lib/etcd as a mountpoint.

  • Fixed an issue that caused health checks to report failure when they find a Pod with a status of TaintToleration even when the replicaset for the Pod has sufficient Pods running.

  • Fixed an issue that caused conflicts with third-party Ansible automation.

  • Fixed a cluster upgrade issue that prevented some control plane nodes from rejoining a cluster configured for high availability.

The following container image security vulnerabilities have been fixed:

Known issues:

For information about the latest known issues, see Anthos clusters on bare metal known issues in the Troubleshooting section.

Apigee Advanced API Security

On August 25, 2023, we released an updated version of Apigee Advanced API Security.

This release includes custom profiles for Advanced API Security scores. Custom profiles let you specify the security categories you want your security scores to be based on. In this release, you must create a security profile in the security scores API. However, you can view scores for the profile in the security scores UI.

Batch

Batch is available in the europe-west10 (Berlin) region.

For more information, see Locations.

Cloud Asset Inventory

The following resource types are now publicly available through the analyze policy APIs (AnalyzeIamPolicy and AnalyzeIamPolicyLongrunning).

Cloud Run

You can now cancel a currently running job execution. (In Preview.)

Compute Engine

Preview: You can reduce network latency between VMs by using compact placement policies to specify the maximum distance between VMs. Use compact placement policies to optimize workloads with frequent communication across VMs—for example, high-performance computing (HPC), machine learning (ML), or database server workloads. You can keep VMs in the same rack, across adjacent racks within the same cluster, or across adjacent clusters.

For more information, see Reduce latency by using compact placement policies.

Dataproc Document AI

Document AI Workbench is now powered by generative AI with two feature launches:

Document AI Workbench Summarizer is in Preview:

  • The Summarizer provides summaries for documents up to 250 pages long.
  • You can customize summaries based on your preferences for length (brief, moderate, comprehensive) and format (paragraph, bullet points).
  • See the user guide for more information.

Document AI Workbench custom extractor is in preview:

  • Custom extractor with generative AI can help extract data from documents with free-form text (e.g., contracts) and complex layouts (e.g., invoices, W2s, bills of lading).
  • The pretrained processor version, which uses generative AI, can be used out of the box without any training. Post a document to the endpoint with a list of fields to get structured data.
  • Customize results by confirming content in about five documents. Workbench leverages the examples to improve accuracy using few-shot prediction.
  • Extract information from documents up to 200 pages long through the asynchronous API.
  • To get started, create or use an existing custom extractor to leverage a processor version.
  • See the how-to guide, labeling best practices, and training use cases.
  • Current limitations of generative AI extraction within the custom extractor:
    • Only the English language is supported.
    • Region availability is currently only in the US.
    • While in preview, we recommend that you only extract up to 50 entities per endpoint with generative AI.
    • When uploading a sample document to define fields and preview results on the Get started page, there can be long latencies. We're working to reduce this latency.

In addition, template-based training is available in GA within the custom extractor:

  • Template-based training provides accurate predictions for documents with no layout variation (such as an application form).
  • Only six labeled documents are needed to train and use a template-based processor version.
  • See the user guide and training use cases.
Firestore

Scheduled backups now available in Preview.

You can now view and list multiple databases using the Google Cloud console. This feature is in Preview.

Firestore in Datastore mode

You can now view and list multiple databases using the Google Cloud console. This feature is in Preview.

Scheduled backups now available in Preview.

Google Kubernetes Engine

GKE now delivers insights and recommendations to ensure your workloads are ready for disruption using features such as Pod Disruption Budgets. To learn more, see Ensure stateful workloads are disruption-ready.

August 24, 2023

BigQuery

The following text embedding features are now available in preview:

For more information, see the tutorial for performing basic semantic search with text embeddings.

The following BigQuery ML inference features are now generally available (GA):

Chronicle

Chronicle has updated the rules engine's YARA-L 2.0 language compiler to report warnings. Warnings flag rules that are syntactically valid but may result in unexpected behavior. You can view and expand warnings in the Rules Editor the same way you view errors. The following warnings are currently supported:

Cloud Spanner Container Optimized OS

cos-105-17412-156-30

Kernel Docker Containerd GPU Drivers
COS-5.15.120 v23.0.3 v1.7.2 v470.199.02(default),v525.125.06

Fixed a kernel crash in device memory TCP behavior.

Fixed CVE-2023-4128 in the Linux kernel.

Runtime sysctl changes:

  • Added: kernel.io_uring_disabled: 0

August 23, 2023

Anthos clusters on VMware

Anthos clusters on VMware 1.16.0-gke.669 is now available. To upgrade, see Upgrading Anthos clusters on VMware. Anthos clusters on VMware 1.16.0-gke.669 runs on Kubernetes 1.27.4-gke.1600.

Version changes:

  • Upgraded VMware vSphere Container Storage Plug-in from 3.0 to 3.0.2.
  • The crictl command-line tool was updated to 1.27.
  • The containerd config was updated to version 2.

Other changes:

  • The output of the gkectl diagnose cluster command has been updated to provide a summary that customers can copy and paste when opening support cases.
  • In-tree GlusterFS is removed from Kuberentes 1.27. Add storage validation to detect in-tree glusterFS volumes.

  • Metrics data are now gzip compressed when sending to Cloud Monitoring.

  • The stackdriver-log-forwarder (fluent-bit) now sends logs to Cloud Logging with gzip compression to reduce egress bandwidth needed.

  • Prometheus and Grafana are no longer bundled for in-cluster monitoring and they are replaced with Google Cloud Managed Service for Prometheus.

  • The following flags in the stackdriver custom resource are deprecated and changes to their values aren't honored:

    • scalableMonitoring
    • enableStackdriverForApplications (replaced by enableGMPForApplications and enableCloudLoggingForApplications)
    • enableCustomMetricsAdapter
  • Deploying the vSphere cloud controller manager in both admin and user clusters, and enabling it for admin and kubeception user clusters is now supported.

  • The audit-proxy now sends audit logs to Cloud Audit Logging with gzip compressed to reduce egress bandwidth needed.

  • Removed accounts.google.com from the internet preflight check requirement.

  • The pre-defined dashboards are automatically present based on the presence of metrics.

  • Enabled auto repair on ReadonlyFilesystem node condition

  • Support the d character when using --log-since flag to take cluster snapshot. For example: gkectl diagnose snapshot --log-since=1d

  • A new CSI Workload preflight check was added to verify that workloads using vSphere PVs can work through CSI.

  • Preflight check failures for gkectl prepare now block install and upgrade operations.

  • The kubelet readonly port is now disabled by default for security enhancement. See Enable kubelet readonly port for instructions if you need to re-enable it for legacy reasons.

  • AIS Pods are now scheduled to run on control plane nodes instead of worker nodes.

The following issues are fixed in 1.16.0-gke.669:

  • Fixed the known issue that caused intermittent ssh errors on non-HA admin master after update or upgrade.
  • Fixed the known issue where upgrading enrolled admin cluster could fail due to membership update failure.
  • Fixed the issue where the CPv1 stackdriver operator had --is-kubeception-less=true specified by mistake.

  • Fixed the issue where clusters used the non-high-availability (HA) Connect Agent after an upgrade to 1.15.

  • Fixed the known issue of Cloud Audit Logging failure due to permission denied.

  • Fixed a known issue where the update operation cannot be fulfilled due to KSA signing key version unmatched.

  • Fixed a known issue where $ in the private registry username caused admin control plane machine startup failure.

  • Fixed a known issue where gkectl diagnose snapshot failed to limit the time window for journalctlcommands running on the cluster nodes when you take a cluster snapshot with the --log-since flag.

  • Fixed a known issue where node ID verification failed to handle hostnames with dots.

  • Fixed continuous increase of logging agent memory.

  • Fixed the issue that caused gcloud to fail to update the platform when the required-platform-version is already the current platform version.

  • Fixed an issue where cluster-api-controllers in a high-availability admin cluster had no Pod anti-affinity. This could allow the three clusterapi-controllers Pods not to be scheduled on different control-plane nodes.

  • Fixed the wrong admin cluster resource link annotation key that can cause the cluster to be enrolled again by mistake.

  • Fixed a known issue where node pool creation failed because of duplicated VM-Host affinity rules.

  • The preflight check for StorageClass parameter validations now throws a warning instead of a failure on ignored parameters after CSI Migration. StorageClass parameter diskformat=thin is now allowed and does not generate a warning.

  • Fixed a false error message for gkectl prepare when using a high-availability admin cluster.

  • Fixed an issue during the migration from the Seesaw load balancer to MetalLB that caused 'DeprecatedKubeception' always shows up in the diff.

  • Fixed a known issue where some cluster nodes couldn't access the HA control plane when the underlying network performs ARP suppression.

  • Removed unused Pod disruption budgets (such as kube-apiserver-pdb, kube-controller-manager-pdb, and kube-etcd-pdb) for Controlplane V2 user clusters

The following vulnerabilities are fixed in 1.16.0-gke.669:

Chronicle

The following supported default parsers have changed. Each is listed by product name and log_type value, if applicable.

  • Apigee (GCP_APIGEE_X)
  • AppOmni (APPOMNI)
  • Attivo Networks (ATTIVO)
  • AWS Cloudtrail (AWS_CLOUDTRAIL)
  • AWS CloudWatch (AWS_CLOUDWATCH)
  • AWS GuardDuty (GUARDDUTY)
  • AWS WAF (AWS_WAF)
  • Blue Coat Proxy (BLUECOAT_WEBPROXY)
  • Cisco Internetwork Operating System (CISCO_IOS)
  • Cisco NX-OS (CISCO_NX_OS)
  • Cisco Umbrella Web Proxy (UMBRELLA_WEBPROXY)
  • CrowdStrike Falcon (CS_EDR)
  • Crowdstrike IOC (CROWDSTRIKE_IOC)
  • CyberArk Endpoint Privilege Manager (EPM) (CYBERARK_EPM)
  • Elastic Windows Event Log Beats (ELASTIC_WINLOGBEAT)
  • F5 Advanced Firewall Management (F5_AFM)
  • GMAIL Logs (GMAIL_LOGS)
  • iBoss Proxy (IBOSS_WEBPROXY)
  • Ipswitch MOVEit Transfer (IPSWITCH_MOVEIT_TRANSFER)
  • Juniper Junos (JUNIPER_JUNOS)
  • Kubernetes Audit (KUBERNETES_AUDIT)
  • Kubernetes Node (KUBERNETES_NODE)
  • Microsoft AD FS (ADFS)
  • Microsoft Defender For Cloud (MICROSOFT_DEFENDER_CLOUD_ALERTS)
  • Microsoft Graph API Alerts (MICROSOFT_GRAPH_ALERT)
  • Microsoft SQL Server (MICROSOFT_SQL)
  • MISP Threat Intelligence (MISP_IOC)
  • Netskope Web Proxy (NETSKOPE_WEBPROXY)
  • Okta User Context (OKTA_USER_CONTEXT)
  • Palo Alto Prisma Cloud Alert payload (PAN_PRISMA_CA)
  • Peplink Firewall (PEPLINK_FW)
  • Pulse Secure (PULSE_SECURE_VPN)
  • Qualys Virtual Scanner (QUALYS_VIRTUAL_SCANNER)
  • SecureLink (SECURELINK)
  • Security Command Center Threat (N/A)
  • Sentinelone Alerts (SENTINELONE_ALERT)
  • Suricata IDS (SURICATA_IDS)
  • Symantec DLP (SYMANTEC_DLP)
  • Unix system (NIX_SYSTEM)
  • Windows DNS (WINDOWS_DNS)
  • Windows Event (WINEVTLOG)
  • Windows Event (XML) (WINEVTLOG_XML)
  • Workspace Activities (WORKSPACE_ACTIVITY)
  • Zimperium (ZIMPERIUM)
  • Zscaler Internet Access Audit Logs (ZSCALER_INTERNET_ACCESS)

For details about changes in each parser, see Supported default parsers.

Cloud Spanner

Cloud Spanner now supports integer sequences and bit reversal.

  • The SEQUENCE DDL statement generates unique, uniformly distributed integers as part of a primary key DEFAULT expression. For more information, see SEQUENCE (GoogleSQL, PostgreSQL).

  • The bit reverse function lets you map existing integer keys using the same logic as a bit-reversed sequence to avoid hotspotting. For more information, see BIT_REVERSE (GoogleSQL, PostgreSQL).

For overview information and scenarios for when to use these features, see Primary key default values management.

Cloud Spanner now supports generating a UUID (v4) as part of a table's primary key DEFAULT expression using the GENERATE_UUID function in GoogleSQL or generate_uuid() in PostgreSQL-dialect databases.

For overview information and scenarios for when to use this feature, see Primary key default values management.

Cloud Storage

The Storage Object User role (roles/storage.objectUser) is now available. This role allows you to create, view, list, update, and delete objects and their metadata, without granting access to the object's ACLs.

Dataproc

Fixed a Dataproc Serverless issue where Spark batches failed with unhelpful error messages.

Google Cloud Deploy

Cloud Deploy support for deploy parameters is now generally available.

August 22, 2023

AlloyDB for PostgreSQL

You can now improve connection security by enforcing applications to connect to AlloyDB instances through AlloyDB connectors, such as the Auth Proxy.

You can now configure SSL enforcement mode to ensure that all database connections to an instance use SSL encryption.

Anthos clusters on bare metal

Release 1.14.8

Anthos clusters on bare metal 1.14.8 is now available for download. To upgrade, see Upgrading Anthos on bare metal. Anthos clusters on bare metal 1.14.8 runs on Kubernetes 1.25.

Fixes:

The following container image security vulnerabilities have been fixed:

Known issues:

For information about the latest known issues, see Anthos clusters on bare metal known issues in the Troubleshooting section.

Artifact Registry

Artifact Registry is now available in the europe-west10 region (Berlin, Germany).

Batch

Batch is available in the following regions:

  • asia-south2 (Delhi)
  • asia-southeast2 (Jakarta)
  • europe-southwest1 (Madrid)
  • me-central1 (Doha)

For more information, see Locations.

BigQuery

BigQuery now allows you to create your own masking routines for your data. You can use the REGEX_REPLACE scalar function to create custom masking rules to obfuscate your sensitive data. This feature is currently in preview.

Cloud Billing

Budgets for project users now available (in preview)

Now project users in Google Cloud can create budgets and stay on top of their cloud spend, without needing additional permissions to access Cloud Billing accounts. Budgets for project users enables engineers to take ownership of their costs, plan for the spend in the projects that they own, and proactively manage cost exceptions.

Project Owners, Project Editors, and Project Viewers can view budgets that are scoped to individual projects. Project Owners and Editors can also create, modify and delete single-project budgets for the projects they have access to.

A new email notification option is available for budgets scoped to a single project: Email alerts to project owners. All other notification options are also available for single-project budgets.

Project users can use the Google Cloud console or the Cloud Billing Budget API to manage budgets for projects.

Cloud Composer

Cloud Composer 2 is now available in Dallas (us-south1), Santiago (southamerica-west1), Melbourne (australia-southeast2), and Madrid (europe-southwest1).

Cloud Healthcare API

A release was made. Updates may include general performance improvements, bug fixes, and updates to the API reference documentation.

Cloud Interconnect

Dedicated Cloud Interconnect support is available in the following colocation facilities:

  • Level(3) Berlin, Berlin
  • NTT Berlin 1 Data Center (BER1), Berlin

For more information, see the Locations table.

Cloud Key Management Service

Cloud KMS is available in the following region:

  • europe-west10

For more information, see Cloud KMS locations.

Cloud NAT

Cloud NAT support for Inter-VPC communications is in Preview.

Cloud Run

The following new region is now available: europe-west10.

Cloud SQL for MySQL

Support for europe-west10 (Berlin) region.

Cloud SQL for PostgreSQL

Support for europe-west10 (Berlin) region.

Cloud SQL for SQL Server

Support for europe-west10 (Berlin) region.

Cloud Spanner

You can create Cloud Spanner regional instances in Berlin, Germany (europe-west10).

Cloud Storage

Cloud Storage is now available in Berlin, Germany (europe-west10 region).

Cloud VPN

Cloud VPN is now available in region europe-west10 (Berlin, Germany).

Pricing is available on the Cloud VPN pricing page.

Compute Engine

Generally available: Berlin, Germany, Europe europe-west10-a,b,c has launched with E2, N2, N2D, and T2D VMs available in all three zones.

Dataflow

Dataflow is available in Berlin (europe-west10).

Dataform

Dataform is compliant with SOC 2 and SOC 3.

For more information, see Dataform compliance.

Dataproc

Dataproc is now available in the europe-west10 region (Berlin).

Google Kubernetes Engine

The europe-west10 region in Berlin, Germany is now available.

Looker Migrate to Containers

On August 22, 2023 we released version 1.3.0 of the Migrate to Containers modernization plugins.

Learn how to Upgrade Migrate to Containers plugins.

The following changes have been made to the IBM WebSphere Application Server migration:

  • Renamed the plugin from websphere-container to websphere-traditional-container. This plugin now supports WebSphere Application Server Traditional as a migration source.

  • Added support for WebSphere Application Server Liberty as a target.

  • The was-home parameter is now mandatory.

The following changes have been made to the discovery parameters for the Tomcat plugin:

  • The java-version parameter is now added as input to Tomcat migrations.
  • The catalina-base parameter can now include multiple directories delimited with colons (:).
  • The java-version, catalina-base and catalina-home parameters are now mandatory.

Linux system service endpoints are no longer automatically discovered and must be manually specified while customizing the Linux migration plan.

Pub/Sub

Pub/Sub is now available in europe-west10 (Berlin, Germany).

Secret Manager

Secret Manager is now available in the following region:

  • europe-west10

For more information, see Secret Manager locations.

Vertex AI

Vertex AI custom training has launched persistent resources in Preview. A persistent resource is a long-running cluster of machines that you can use to run custom training jobs. Once created, the persistent resource remains available for future training jobs, so you don't have to wait for compute resources to be provisioned each time you want to train a model.

Virtual Private Cloud

For auto mode VPC networks, added a new subnet 10.214.0.0/20 for the Berlin europe-west10 region. For more information, see Auto mode IP ranges.

August 21, 2023

Anthos Config Management

The constraint template library's GkeSpotVMTerminationGrace template adds the includePodOnSpotNodes parameter, which requires enabling referential constraints. For reference, see Constraint template library.

The Config Sync feature to sync directly from Helm repositories (including OCI-based ones) is generally available (GA). Google Artifact Registry is the preferred Helm registry. To learn more, see Sync Helm charts from Artifact Registry and Configuration for the Helm repository.

Policy Controller has been updated to include a more recent build of OPA Gatekeeper (hash: 616aa8f).

ExpansionTemplates APIs promoted to v1beta1.

Policy Controller add new bundles: nist-sp-800-190, nist-sp-800-53-r5, and nsa-cisa-k8s-v1.2. For reference, see Policy Controller bundles overview.

Added a new field spec.helm.valuesFileRefs in RootSync and RepoSync to allow specifying Helm values files in ConfigMaps. For reference, see Configuration for the Helm repository.

Added a new configsync.gke.io/deletion-propagation-policy annotation for use on RootSync and RepoSync, for configuring foreground cascading deletion as a preview feature. When set to Foreground, the resource objects managed by it will be deleted when the RootSync or RepoSync is deleted. To learn more, see Bulk delete objects.

The Helm chart version field spec.helm.version in RootSync and RepoSync can now be specified as a range of values from which Config Sync pulls the latest values. For reference see Configuration for the Helm repository.

Added the spec.override.logLevels field to RootSync and RepoSync, for configuring the log level of the containers of reconciler Pods. For more information, see RootSync and RepoSync fields and General best practices.

The constraint template library's K8sRequireDaemonsets template now supports restricting the use of NodeSelector in required Daemonset using the new restrictNodeSelector parameter. For reference, see Constraint template library.

Policy Controller bundles have been updated to the following versions: cis-k8s-v1.5.1: 202307.1, pci-dss-v3.2.1: 202307.0, policy-essentials-v2022: 202307.1, pss-baseline-v2022: 202307.0, pss-restricted-v2022: 202307.0. For reference, see Policy Controller bundles overview.

Upgraded bundled Kustomize version from v5.1.0 to v5.1.1 to pick up vulnerability fixes. To understand the changes in each release, review the changelogs.

Reduced the resource requirements for the reconciler Pod when no Kustomize rendering is needed. For information on resource requirements, see Resource requests.

Increased the default timeout for Kubernetes API requests from 5 seconds to 15 seconds. This allows more requests to succeed with fewer retries when the control plane is under load, and reduces the need to override the timeout with spec.override.apiServerTimeout in RootSync and RepoSync. To learn more, see Configuration for overriding the resource requests and limits of a root or namespace reconciler.

Fixed an issue causing Config Sync to prematurely stop tracking managed resource objects when pruning them before they are deleted from the cluster. Those objects will now appear in the Cloud Console and nomos status until the deletion has reconciled.

Fixed an issue preventing Config Sync from pruning managed resources correctly when the apiGroup of those resources is renamed in the source of truth.

Known Issue for Policy Controller: If you're using ExpansionTemplates and mutators, Policy Controller will not apply the mutators for the generated resources.

There is a memory issue in the reconciler due to the discovery client loading the OpenAPI for schema validations. The issue is only observed on Autopilot clusters with many CRDs installed. You can increase the memory request with the override.resources API. To learn more, see Configuration for overriding the resource requests and limits of a root or namespace reconciler.

Added the spec.configSync.metricsGcpServiceAccountEmail field to the gcloud apply spec fields to remove 2 manual steps required to export Config Sync metrics from a cluster with Workload Identity enabled to Cloud Monitoring. This note was updated on September 7, 2023.

Backup and DR

Backup and DR Service 11.0.6.342 is now available to update your appliance. Refer to the instructions to update your appliance.

Backup and DR Service now supports roll back of hotfix updates. For more information, see Rollback a hotfix update.

Backup and DR Service now supports backup and restore of Compute Engine instances with local SSDs.

Backup and DR Service now supports in-product notifications for important product updates.

Backup and DR Service now supports concurrent database and log backups. For more information, see Manage image expiration.

Pricing model for protecting Google Cloud VMware Engine workloads has been updated to a node based flat rate model. For more information, see pricing change announcement.

BigQuery

You can now scan tables to create data profiles and monitor data quality. These features help you better understand your data and ensure it is accurate and reliable. These features are generally available (GA).

A weekly digest of client library updates from across the Cloud SDK.

Node.js

Changes for @google-cloud/bigquery

7.2.0 (2023-08-17)

Features
Bug Fixes
  • deps: Update dependency @google-cloud/common to v5 (#1253) (0cbfdcd)
  • deps: Update dependency @google-cloud/paginator to v5 (#1254) (658ff1a)
  • deps: Update dependency @google-cloud/precise-date to v4 (#1261) (7f12f7d)
  • deps: Update dependency @google-cloud/promisify to v4 (#1252) (6f04f39)
  • Manual update for renovate-bot google cloud storage v7 (#1262) (b58fc29)

Go

Changes for bigquery/storage/apiv1beta1

1.54.0 (2023-08-17)

Features
  • bigquery/biglake: Start generating apiv1 and apiv1alpha1 (#8433) (916f779)
  • bigquery/datatransfer: Add EncryptionConfiguration to TransferConfig (e3f8c89)
  • bigquery/storage/managedwriter: Refine connection metrics (#8324) (54fcf36)
  • bigquery/storage: Add beta2 deprecation message (b3dbdde)
  • bigquery/storage: Add default_missing_value_interpretation field; indicate KMS_SERVICE_ERROR is retryable (b3dbdde)
  • bigquery: Add ProjectID to JobIDConfig (#8405) (7fafd80)
Bug Fixes
  • bigquery/datapolicies: Sync the new PredefinedEpxression types to the client library (fcb41cc)
  • bigquery: Use JobFromProject for storage iterator (#8372) (bfbf18c)
Documentation
  • bigquery/storage/managedwriter: Augment context usage in package docs (#8334) (b30a7f4)
  • bigquery: Improve RowIterator docs and out of process pagination with Storage API (#8419) (40f8f80)

Analytics Hub now lets you manage subscriptions. The subscription resource stores relevant information about the subscriber and represents the connection between the shared resource and linked dataset. This feature is now in preview.

Cloud Bigtable

A weekly digest of client library updates from across the Cloud SDK.

Java

Changes for google-cloud-bigtable

2.27.0 (2023-08-17)

Features
Cloud Billing

We added a new BigQuery example that helps you join your Price and Detailed Cost Data exports, so that you can compare your costs with detailed information from your Pricing BigQuery export.

View the example query to join prices and costs.

Cloud Load Balancing

Internal passthrough Network Load Balancers can now be configured to handle private IPv6 traffic within your VPC. To enable this, you must configure your dual-stack subnet, backend VMs, health checks, and the forwarding rules to handle IPv6 traffic.

For details, see:

This feature is available in General Availability.

Cloud Logging

You can now view your query results as a chart in the Log Analytics page. For more information, see Chart query results with Log Analytics.

Identity and Access Management (IAM) deny policies can now include Cloud Logging permissions. For a list of Cloud Logging permissions that are supported by deny policies, see Permissions supported in deny policies.

A weekly digest of client library updates from across the Cloud SDK.

Go

Changes for logging/apiv2

1.8.1 (2023-08-14)

Bug Fixes
Cloud Monitoring

You can now add pie charts to your custom dashboards. Support for pie charts is in public preview. For information when using the Cloud Console, see Graph the most recent data with a pie chart. For information about using the API, see Dashboard with a PieChart widget.

Observability for Google Kubernetes Engine: The Observability tab for each of your GKE clusters now includes filters for recommended and configured integrations. To see the recommended integrations for your cluster, select Integrations > Overview. To see the integrations configured for your cluster, select Integrations > Configured.

Cloud SQL for MySQL

Private Service Connect is now GA for Cloud SQL for MySQL. This solution allows you to connect to a Cloud SQL instance from multiple VPC networks that belong to different groups, teams, projects, or organizations.

Cloud SQL for PostgreSQL

Private Service Connect is now GA for Cloud SQL for PostgreSQL. This solution allows you to connect to a Cloud SQL instance from multiple VPC networks that belong to different groups, teams, projects, or organizations.

Cloud Spanner

Spanner Studio enhances the Spanner query editor in the Google Cloud console, with full support for SQL, DML, and DDL operations. The Spanner Studio also features the Explorer (in Preview) which lets you interactively browse, query, and modify your database. For more information, see Manage your data using the Google Cloud console.

Compute Engine

Generally available: When a managed instance group (MIG) repairs a failed or an unhealthy VM, you can apply the latest instance template and per-instance configuration to recreate the VM instead of applying the configuration originally used to create the VM. For more information, see Apply configuration updates during repairs.

Generally available: Hyperdisk Throughput is now available in the following additional regions and zones:

  • Council Bluffs, Iowa: us-central1
  • Moncks Corner, South Carolina: us-east1
  • Ashburn, Virginia: us-east4-b, c
  • Eemshaven, Netherlands: europe-west4-a, c
  • Jurong West, Singapore: asia-southeast1
  • Mumbai, India: asia-south1-a
Config Connector

Config Connector version 1.108.0 is now available.

Added support for customization on cnrm-unmanaged-detector pods resource requests/limits.

Added support for customization on cnrm-controller-manager pods resource requests/limits in namespaced mode.

Added support for BigQueryReservationCapacityCommitment resource(v1alpha1).

Resource BigQueryDataset(v1beta1):

  • Added spec.storageBillingModel field.

Resource BigQueryTable(v1beta1):

  • Added spec.externalDataConfiguration.jsonOptions field.
  • Added spec.externalDataConfiguration.metadataCacheMode field.
  • Added spec.externalDataConfiguration.objectMetadata field.
  • Added spec.externalDataConfiguration.parquetOptions field.

Resource BigtableTable(v1beta1):

  • Added spec.changeStreamRetention field.

Resource CertificateManagerCertificate(v1alpha1):

  • Added spec.managed.issuanceConfig field.

Resource CloudFunctions2Function(v1alpha1):

  • Added status.url field.

Resource ComputeDisk(v1beta1):

  • Added spec.enableConfidentialCompute field.
  • Added spec.provisionedThroughput field.

Resource ComputeExternalVPNGateway(v1beta1):

  • Added status.labelFingerprint field.

Resource ComputeForwardingRule(v1beta1):

  • Added spec.noAutomateDnsZone field.

Resource ComputeInstance(v1beta1):

  • Added spec.params field.
  • Added spec.bootDisk.initializeParams.resourceManagerTags field.

Resource ComputeInstanceTemplate(v1beta1):

  • Added spec.networkInterface.items.networkAttachment field.

Resource ComputeTargetHTTPProxy(v1beta1):

  • Added spec.httpKeepAliveTimeoutSec field.

Resource ComputeTargetHTTPSProxy(v1beta1):

  • Added spec.httpKeepAliveTimeoutSec field.

Resource ComputeURLMap(v1beta1):

  • Added spec.pathMatcher.items.routeRules.items.matchRules.items.pathTemplateMatch field.
  • Added spec.pathMatcher.items.routeRules.items.routeAction.urlRewrite.pathTemplateRewrite field.

Resource ContainerCluster(v1beta1):

  • Added spec.nodeConfig.guestAccelerator.items.gpuDriverInstallationConfig field.
  • Added spec.nodeConfig.soleTenantConfig field.
  • Added spec.securityPostureConfig field.

Resource ContainerNodePool(v1beta1):

  • Added spec.nodeConfig.guestAccelerator.items.gpuDriverInstallationConfig field.
  • Added spec.nodeConfig.soleTenantConfig field.
  • Added spec.placementPolicy.tpuTopology field.

Resource DataformRepository(v1alpha1):

  • Added spec.workspaceCompilationOverrides field.

Resource GKEBackupBackupPlan(v1alpha1):

  • Added status.state field.
  • Added status.stateReason field.

Resource HealthcareFHIRStore(v1alpha1):

  • Added spec.complexDataTypeReferenceParsing field.

Resource RedisInstance(v1beta1):

  • Added status.maintenanceSchedule field.

Resource RunJob(v1beta1):

  • Added spec.annotations field.
  • Added spec.template.annotations field.

Resource SQLInstance(v1beta1):

  • Added spec.settings.dataCacheConfig field.
  • Added spec.settings.edition field.

Resource VertexAIFeaturestoreEntityTypeFeature(v1alpha1):

  • Added status.region field.

Resource VertexAIIndex(v1alpha1):

  • Added spec.metadata.config.shardSize field.
Contact Center AI Platform

UCaaS: MS Teams integration: CCAI Platform now supports UCaaS integration capabilities. This integration allows you to seamlessly configure MS Teams users and teams directly within CCAIP. You can enjoy the advanced routing capabilities of CCAIP while taking calls in MS teams. Typical supported use cases include:

  • The ability to transfer calls between CCAIP and MS Teams agents.
  • Automatically routing calls to MS Teams agents or groups.
  • Assigning any MS Teams users to queues.
  • Ability to assign CCAIP and MS Teams users as part of Cascade groups.

In Add/Edit User menus, you will see an option for enabling UCaaS as well as integration settings in Developer Settings. Enabling this option allows users who only occasionally assist with customer support to take those calls using their principal UCaaS communication platform. For details, see the Microsoft Teams integration guide

Data restriction for historical/downloadable reports: New permission for the Session Data report with the supervisory ability to restrict editing permissions. Also, the permissions for the downloadable reports under Agents & Teams, Calls & Chats, Queues, and Campaigns now have the option to restrict the corresponding data to assigned teams only or assigned queues only.

Session Variable: Enable Agent ID as a dynamic parameter: We have introduced a change to dynamically include the agent ID as a session variable in automated messages and chat shortcuts. This allows an agent to send an outbound SMS to a consumer containing a deep link to a mobile app with our SDK embedded. The deep link contains the agent ID, which will trigger a DAP to a dedicated queue for that agent with a DAP value also reflecting that agent's ID. Scope extends to these channels: SMS messages, Mobile chat, Wed SDK chat, Chat shortcuts.

Headless web SDK: CCAIP Platform now supports a new Headless Web SDK, designed to empower you to build a fully customized and branded web support experience.

The Headless Web SDK comes equipped with a comprehensive API suite, providing you with the tools to leverage familiar Web SDK features and tailor the UI to suit your specific needs. Every detail, from colors and fonts to layouts and interactions, can be tailored to create a cohesive and engaging interface that resonates with your audience. See the Headless web SDK guide for details.

Mobile SDK 2.1: UI customizations: The latest release of our Mobile SDK chat gives you even more customization options to tailor the UI to your specific branding needs. You can take full control of the appearance and style of elements within the chat interface. Some items that can be fully customized:

  • Agent and consumer message bubbles.
  • Menu bar (including the back and end chat buttons).
  • End Chat button.
  • Send button.
  • Message tray.
  • Time stamps.

Depending on the component, you have the flexibility to customize attributes such as the font, background color, icon, (and more!) to create a chat experience tailored to your brand. See the iOS and Android SDK guides for details.

Distinct queue names for the Alvaria data exporter: You now have the ability to repeat names across multiple different queue-paths. Queue will appear in Alvaria as Queue Name - language code - ID, allowing you to easily identify which metrics correspond to what queue.

Fallback IVR: Additional settings for fallback destination: New IVR fallback options for when an end-user fails to select a queue during IVR navigation. New options are available globally as well as at the queue level. Additional options include:

  • Select the last available menu to route consumers to the last queue in the IVR menu.
  • Select a specific menu to route consumers to any queue in the IVR menu.

The configuration options are available at the global level (Call > Call Details > Fallback IVR Navigation). See the documentation for details.

New dynamic parameter support for SIP redirect and Dialogflow: New dynamic parameters to enhance the capabilities of SIP Redirect and Dialogflow. With these additions, you can now leverage valuable real-time information during call routing and Dialogflow sessions. The new dynamic parameters include DNIS / TFN (the number the user dialed), Latest Agent ID, Latest Agent Email, Queue Language, Latest Sentiment Score, and Overall Sentiment Score. See the documentation for details.

Improved Outbound SMS API: Agents can now initiate outbound SMS sessions with number pairs that were previously engaged by other agents. This enhancement allows for seamless continuation with consumers, even if the number pair was recently used by a different agent. Agents can send appointment requests, SMS follow-ups, and other SMS messages without encountering errors. See the documentation for details.

Custom POST events (also known as custom JavaScript events): This feature allows you to listen for events happening within CCAIP and take action accordingly. For example, when a call is transferred you could use your own JavaScript code to listen for a call_transferred event and specify actions based on the provided parameters (such as updating the destination agent's screen). These events give you more control over your workflows and allow for seamless integration with your business processes. With this release we are extending the existing mechanism of transmitting post events with 3 new events:

  • Transfer
  • Add Party
  • Agent connects to session
  • VA session data: We are capturing VA session data in the payload during a consumer interaction. This means alongside the existing event data, you will now have access to virtual agent session specific variables.

In addition, we're including:

  • The agent_custom_id parameter in the Agent_Login event.
  • Custom SIP headers in incoming SIP calls within the POST events.

See the custom CRM documentation for details.

Call Adapter: Improved error codes and messages: We have improved our Call Adapter's error messages with more detailed content, including error codes and explanations.

DAP: Additional format: Previously limited to E164 formatted numbers, we now support the input of SIP phone numbers in the incoming sip address format: sip:[number]@[domain].

Skip Cascade Group Timer: Improved functionality of our call and chat deltacast routing. We have introduced the Skip Cascade Group Timer setting, which allows you to bypass the cascade timer settings and route a call or chat to the next available agent, regardless of the cascade group. The setting is located in Operations Management > Deltacast settings. See the Operations Management documentation for details.

Call Handling: Hold music during connection: CCAI Platform has enhanced the call handling experience for end-users by ensuring a smoother transition when connecting with an agent. Instead of experiencing hold music followed by delays or silence, end-users will now enjoy uninterrupted music until the agent joins the call. Additionally, agents will be notified with a distinct sound when an end-user joins the call.

Call Session Events generator and sender: These applications are deployed when you enable the Call Session Events feature. The operators receive Call Events from ujet-server and process them before sending to your configured endpoints. Ujet-server, Generator and Sender all use RabbitMQ infrastructure to send messages.

NICE QM integration: CCAIP now supports an out-of-the-box data export for NICE QM. You can enable it in Developer Settings > Session Data Export > NICE Integration. You must enter the following information to enable the NICE QM data export:

  • NICE API Endpoint
  • API Authentication credentials

iOS:

  • Fixed an issue where using a DAP to route to a queue that was After Hours could lead to consumers being stuck in a loop.
  • Fixed an intermittent issue where a SmartActions request would cause the app to crash.
  • Fixed an intermittent issue where the SDK credentials would not authenticate.
  • Fixed an issue where the app would crash when hold music was played to the end-user.

Android:

  • Fixed an issue where using a DAP to route to a queue that was After Hours could lead to consumers being stuck in a loop.
  • Fixed an issue where the signed custom payload data was not triggered for calls and chats.

Web SDK:

  • Fixed an issue where the Co-browse session sometimes would not connect due to the end-user having multiple tabs open.
  • Fixed an issue where end-users could sometimes get stuck on the After Hours screen, unable to start a new chat.
  • Fixed an issue where a DAP was sometimes not maintained after the previous chat timed out.

Fixed an issue where if a trailing "/" was added to the folder path for Google Cloud Storage upload settings, the files were written to a folder with no name. A safeguard has been added both in backend and frontend to remove any trailing slashes.

Billing service fixes: Resolved two different incident tickets relating to the billing service; one edge case whereby agents were erroneously being counted as online and other that caused the billing service to temporarily incorrectly aggregate data.

Container Optimized OS

cos-dev-113-17833-0-0

Kernel Docker Containerd GPU Drivers
COS-6.1.43 v24.0.5 v1.7.3 v535.54.03(default),v470.199.02(R470)

Updated app-containers/docker-cli to 24.0.5.

Updated app-containers/docker to 24.0.5.

Update cos-gpu-installer to v2.1.4. This fixes a permissions issue in the GPU driver install directory with OSS drivers.

Upgraded app-editors/vim and app-editors/vim-core to v9.0.1678.

Upgraded net-libs/gnutls to v3.8.1-r1.

Upgraded app-misc/jq to v1.7_rc1.

Upgraded app-arch/xz-utils to v5.4.4.

Updated dev-go/yaml to v3.0.1. This resolves CVE-2022-28948.

Updated dev-libs/openssl to v3.0.10. This resolves CVE-2023-3817.

Fixed CVE-2023-4194 in the Linux kernel.

cos-105-17412-156-23

Kernel Docker Containerd GPU Drivers
COS-5.15.120 v23.0.3 v1.7.2 v470.199.02(default),v525.125.06

Simplified GPU driver installation by remounting the driver installation path as executable from cos-extensions.

Fixed an issue in systemd where a container out-of-memory event caused all processes in the container to be killed.

Updated dev-libs/openssl to v1.1.1v. This resolves CVE-2023-3817.

Upgrade app-misc/jq to v1.7_pre20201109-r1. This fixes CVE-2016-4074.

Fixed CVE-2023-4147 in the Linux kernel.

Fixed CVE-2023-4194 in the Linux kernel.

cos-beta-109-17800-0-13

Kernel Docker Containerd GPU Drivers
COS-6.1.42 v24.0.5 v1.7.2 v535.54.03(default),v470.199.02(R470)

Updated app-containers/docker-cli to 24.0.5.

Updated app-containers/docker to 24.0.5.

Updated dev-go/yaml to v3.0.1. This resolves CVE-2022-28948.

Updated dev-libs/openssl to v3.0.10. This resolves CVE-2023-3817.

Fixed CVE-2023-4147 in the Linux kernel.

Fixed CVE-2023-4194 in the Linux kernel.

cos-93-16623-461-15

Kernel Docker Containerd GPU Drivers
COS-5.10.177 v20.10.24 v1.6.20 v450.248.02(default),v470.199.02(R470),v525.125.06

Simplified GPU driver installation by remounting the driver installation path as executable from cos-extensions.

Updated dev-libs/openssl to v1.1.1v. This resolves CVE-2023-3817.

Upgrade app-misc/jq to v1.7_pre20201109-r1. This fixes CVE-2016-4074.

Fixed CVE-2023-4147 in the Linux kernel.

Fixed CVE-2023-4194 in the Linux kernel.

cos-97-16919-353-23

Kernel Docker Containerd GPU Drivers
COS-5.10.186 v20.10.24 v1.6.21 v470.199.02(default),v525.125.06

Simplified GPU driver installation by remounting the driver installation path as executable from cos-extensions.

Updated dev-libs/openssl to v1.1.1v. This resolves CVE-2023-3817.

Upgrade app-misc/jq to v1.7_pre20201109-r1. This fixes CVE-2016-4074.

Fixed CVE-2023-4147 in the Linux kernel.

Fixed CVE-2023-4194 in the Linux kernel.

cos-101-17162-279-24

Kernel Docker Containerd GPU Drivers
COS-5.15.120 v20.10.24 v1.6.21 v470.199.02(default),v525.125.06

Updated dev-libs/openssl to v1.1.1v. This resolves CVE-2023-3817.

Fixed CVE-2018-14647 in the dev-lang/python package.

Fixed CVE-2018-1000802 in the dev-lang/python package

Upgrade app-misc/jq to v1.7_pre20201109-r1. This fixes CVE-2016-4074.

Fixed CVE-2023-4194 in the Linux kernel.

Dataplex

Dataplex automatic data quality and data profiling are generally available.

  • Data profiling
    • Jump start your data analytics with statistical insights, such as average values, unique values, data bounds, and top-N.
    • Understand drifts and build anomaly models with the generated metadata.
    • Publish data quality and data profiling information in the BigQuery console. Learn more.
    • Profile data in BigQuery tables, views, BigLake, and external tables.
    • Ease deployment through a managed, serverless, and zero-copy execution.
    • Take advantage of advanced features like filtering, sampling, and saving results to a central BigQuery table.
  • Automatic data quality
    • Deliver trusted data by building an end-to-end data quality monitoring pipeline.
    • View rule recommendations, enhance with business rules, monitor on a routine or in a pipeline, generate reports, get alerted on failures, and troubleshoot the issues.
    • View quality information in the BigQuery UI for every table user to see. Learn more.
    • Improve data quality in BigQuery tables, views, BigLake, and external tables.
    • Ease deployment through managed, serverless, and zero-copy execution.
    • Take advantage of advanced features like filtering, sampling, and saving results to a central BigQuery table.
Google Cloud Armor

Adaptive Protection suggested rules can now be deployed automatically in General Availability. For more information, see Automatically deploy Adaptive Protection suggested rules.

Pub/Sub

A weekly digest of client library updates from across the Cloud SDK.

Node.js

Changes for @google-cloud/pubsub

4.0.1 (2023-08-11)

Bug Fixes
  • deps: Update dependency @google-cloud/paginator to v5 (#1799) (3195d21)
  • deps: Update dependency @google-cloud/precise-date to v4 (#1803) (2c22d67)
  • deps: Update dependency @google-cloud/projectify to v4 (#1800) (5787d56)
  • deps: Update dependency @google-cloud/promisify to v4 (#1798) (093c46b)

Python

Changes for google-cloud-pubsub

2.18.3 (2023-08-18)

Bug Fixes
  • Make retry policy back off more aggressively for RPCs that retry RESOURCE_EXHAUSTD (#979) (4073b3d)
Security Command Center

inIpRange() function released to General Availability

You can now specify a range of IP addresses by using the inIpRange() function in query statements to filter findings that contain IPv4 or IPv6 addresses within the specified range.

For more information, see The inIpRange function.