The following release notes cover the most recent changes over the last 60 days. For a comprehensive list of product-specific release notes, see the individual product release note pages.
You can also see and filter all release notes in the Google Cloud console or you can programmatically access release notes in BigQuery.
To get the latest product updates delivered to you, add the URL of this page to your
feed
reader, or add the feed URL directly: https://cloud.google.com/feeds/gcp-release-notes.xml
October 18, 2023
BatchDocumentation has been added to explain how to securely reference sensitive data in a job by using Secret Manager secrets for encryption. For example, use secrets to protect sensitive data when defining custom environment variables or protect login credentials when accessing private container images from Docker Registry.
For more information, see Protect sensitive data using Secret Manager with Batch.
The BigQuery migration assessment is now available for Apache Hive in preview. You can use this feature to assess the complexity of migrating data from your Apache Hive data warehouse to BigQuery.
The following supported default parsers have changed. Each is listed by product name and log_type value, if applicable.
- Azure AD Directory Audit (
AZURE_AD_AUDIT) - Check Point (
CHECKPOINT_FIREWALL) - Chronicle SOAR Audit (
CHRONICLE_SOAR_AUDIT) - Cisco Internetwork Operating System (
CISCO_IOS) - Cisco Meraki (
CISCO_MERAKI) - Cisco Web Services Manager (
CISCO_WSM) - Cloud Audit Logs (
N/A) - Cloudflare (
CLOUDFLARE) - CrowdStrike Falcon (
CS_EDR) - ESET Threat Intelligence (
ESET_IOC) - GitHub (
GITHUB) - Gitlab (
GITLAB) - Infoblox DNS (
INFOBLOX_DNS) - JumpCloud Directory Insights (
JUMPCLOUD_DIRECTORY_INSIGHTS) - Kolide Endpoint Security (
KOLIDE) - McAfee ePolicy Orchestrator (
MCAFEE_EPO) - Microsoft Azure Activity (
AZURE_ACTIVITY) - Microsoft Azure Resource (
AZURE_RESOURCE_LOGS) - Microsoft Defender for Endpoint (
MICROSOFT_DEFENDER_ENDPOINT) - Microsoft SQL Server (
MICROSOFT_SQL) - Netskope Web Proxy (
NETSKOPE_WEBPROXY) - OpenSSH (
OPENSSH) - Palo Alto Cortex XDR Alerts (
CORTEX_XDR) - Silverfort Authentication Platform (
SILVERFORT) - Vectra Stream (
VECTRA_STREAM) - VMware ESXi (
VMWARE_ESX) - VMware NSX (
VMWARE_NSX) - Windows Applocker (
WINDOWS_APPLOCKER) - Windows Defender ATP (
WINDOWS_DEFENDER_ATP) - Windows DNS (
WINDOWS_DNS) - Windows Event (
WINEVTLOG) - Windows Event (XML) (
WINEVTLOG_XML) - Windows Hyper-V (
WINDOWS_HYPERV) - Workspace ChromeOS Devices (
WORKSPACE_CHROMEOS) - Zscaler (
ZSCALER_WEBPROXY) - ZScaler DNS (
ZSCALER_DNS)
The following log types, without a default parser, were added. Each is listed by product name and log_type value, if applicable.
- ADVA Fiber Service Platform (
ADVA_FSP) - Bluecat Address Manager (
BLUECAT_AM) - Fortinet Switch (
FORTINET_SWITCH) - GCP Google Kubernetes Engine Context (
GCP_KUBERNETES_CONTEXT) - Kion (
KION) - Kiteworks (
KITEWORKS) - Nokia Router (
NOKIA_ROUTER) - Ntopng (
NTOPNG) - Opnsense (
OPNSENSE) - Oracle HCM Human resources platform solution (
ORACLE_HCM) - MS Powershell Transcript (
POWERSHELL_TRANSCRIPT) - RAD ETX (
RAD_ETX) - Spamhaus (
SPAMHAUS) - UpGuard (
UPGUARD) - Vsftpd (
VSFTPD)
For a list of supported log types and details about default parser changes, see Supported log types and default parsers.
The Cloud Data Fusion SAP SLT No RFC Replication plugin version 0.11.0 is available in the Hub in Cloud Data Fusion enterprise edition versions 6.8.0 and later. It differs from the existing SAP SLT Replication plugin in the following ways:
- All data and metadata file formats are in JSON.
- No SAP RFC inbound calls occur in the SAP SLT No RFC Replication plugin. Accessing schemas and data from the SAP system no longer requires an SAP connection. Metadata and data extraction are sourced from the Cloud Storage bucket.
Support for Customer Managed Encryption Keys (CMEK) is now available for Cloud Tasks. To learn more, see the documentation on using CMEK with Cloud Tasks.
For documents with many fields that don't require indexing, you can now add collection-level index exemptions on all fields in a collection group. To learn more, see Add a collection-level exemption. This feature is generally available (GA).
New SAP NetWeaver certification: C3D series of general-purpose machine types
For use with SAP NetWeaver, SAP has certified the Compute Engine general-purpose machine types c3d-standard and c3d-highmem.
For more information, see Certified C3D machine types for SAP NetWeaver.
Container Threat Detection, a built-in service of Security Command Center Premium, has launched a new detector, Unexpected Child Shell, in Preview.
The detector monitors all process executions and generates a finding if a process that does not normally invoke shells spawns a shell process.
For more information, see Container Threat Detection detectors.
October 17, 2023
Anthos Service MeshManaged Anthos Service Mesh 1.17 is rolling out in the rapid channel.
Additionally, the rollout of managed Anthos Service Mesh version 1.16 to the regular channel has completed.
See Select a managed Anthos Service Mesh release channel for more information.
hybrid v1.10.3-hotfix.3
On October 17, 2023 we released an updated version of the Apigee hybrid software, v1.10.3-hotfix.3.
- To install the hotfix, follow the instructions in Upgrading Apigee hybrid to version 1.10.
- For information on new installations, see The big picture.
| Bug ID | Description |
|---|---|
| 303292806 | Restrict connections from the Cassandra backup utility to Cassandra server pods in the apigee namespace. |
| 300542690 | Added dedicated service accounts for Apigee Connect, Redis, and UDCA to prevent Kubernetes from automatically injecting credentials for a specified ServiceAccount or the default ServiceAccount. To use this service account, set the |
Service Extensions callouts are available for Google Cloud Application Load Balancers, excluding Classic.
By using this feature, you can direct your load balancers to make gRPC calls to user-managed or partner-hosted applications from within the Cloud Load Balancing data processing path. These applications can then apply various policies or functions, such as header or payload manipulation, security screening, or custom logging on the traffic before returning the traffic to the load balancer for further processing.
For details, see the following topics in the Service Extensions documentation:
Service Extensions is in Preview.
You can now view error groups on your custom dashboards. This feature is GA. For information when using the Cloud Console, see Display logs and errors on a custom dashboard. For information about using the API, see Dashboard with an ErrorReportingPanel widget.
Cloud SQL supports InnoDB page compression for MySQL 5.7 and MySQL 8.0 and later.
You can now import transaction log backups. This can help you reduce downtime when migrating to Cloud SQL using backups.
Query Optimizer version 6 is generally available, and is the default optimizer version.
Generally available: c3d-standard, c3d-highmem, c3d-highcpu, and c3d-standard-lssd machine types for general-purpose C3D VMs are generally available.
ssh_authentication_config and service_account fields are available in the google_dataform_repository Dataform Terraform resource.
You can now view error groups on your custom dashboards. This feature is GA. For information when using the Cloud Console, see Display logs and errors on a custom dashboard. For information about using the API, see Dashboard with an ErrorReportingPanel widget.
The sum() and average() aggregation functions are now available.
Service Extensions callouts are available for Google Cloud Application Load Balancers, excluding Classic.
With the introduction of this feature, users instruct load balancers to forward traffic from within the Cloud Load Balancing data processing path through gRPC to user-managed or partner-hosted applications. These applications can apply various policies or functions, such as header or payload manipulation, security screening, or custom logging on the traffic before returning the traffic to the load balancer for further processing.
For details, see Cloud Load Balancing extensions overview.
Personalized Service Health supports AlloyDB for PostgreSQL and Resource Manager API.
New Vertex AI Vector Search Console
Vector Search has launched a console experience in Google Cloud for creating and deploying indexes, now available in Preview. From the console, you can create indexes, and create public or VPC endpoints for your indexes, and deploy. For more information, see Manage indexes.
Vertex AI Vector Search Improvements
Vector Search has improved the initial index creation process for smaller indexes (<100MB), reducing time to build from about 1 hour to about 5 mins. To get started, see Vector Search quickstart to create an index.
October 16, 2023
App Engine flexible environment PythonPython 3.12 is now available in preview.
Python 3.12 is now available in preview.
A weekly digest of client library updates from across the Cloud SDK.
Java
Changes for google-cloud-bigquery
2.33.2 (2023-10-11)
Bug Fixes
Dependencies
- Update dependency com.google.api.grpc:proto-google-cloud-bigqueryconnection-v1 to v2.29.0 (#2911) (052f5c2)
- Update dependency com.google.apis:google-api-services-bigquery to v2-rev20230925-2.0.0 (#2921) (f0fb64f)
- Update dependency com.google.cloud:google-cloud-datacatalog-bom to v1.33.0 (#2912) (e053494)
- Update dependency com.google.cloud:google-cloud-shared-dependencies to v3.17.0 (#2931) (25a94f1)
- Update github/codeql-action action to v2.22.0 (#2926) (33ce4ae)
- Update github/codeql-action action to v2.22.1 (#2934) (7ae7b99)
- Update ossf/scorecard-action action to v2.3.0 (#2927) (93bfd8e)
You can now use DLP functions to support encryption and decryption between BigQuery and DLP, using AES-SIV. This feature is in preview.
The following changes are available in the Unified Data Model.
- New enum fields were added:
SecurityResult.IoCStatsTypeandSecurityResult.VerdictType. - A new field was added to
EntityMetadata:feed. - A new field was added to
Network:ip_subnet_range. - New fields were added to
SecurityResult:last_updated_timeandverdict_info. - A new field was added to
Label:rbac_enabled. - A new field was added to
SecurityResult.Association:region_code. - New fields were added to
User:last_login_time,last_password_change_time,password_expiration_time,account_expiration_time,account_lockout_time, andlast_bad_password_attempt_time. - A new value was added to the
Network.ApplicationProtocolenum:GRPC. The following new values were added to the
Resource.ResourceTypeenum:PODCONTAINERFUNCTIONRUNTIMEIP_ADDRESSDISKVOLUMEIMAGESNAPSHOTREPOSITORYCREDENTIALLOAD_BALANCERGATEWAYSUBNET
For a list of all fields in the Unified Data Model, and their descriptions, see the Unified Data Model field list.
A weekly digest of client library updates from across the Cloud SDK.
Cloud Composer 2.4.6 release started on October 17, 2023. Get ready for upcoming changes and features as we roll out the new release to all regions. This release is in progress at the moment. Listed changes and features might not be available in some regions yet.
Airflow 2.6.3 is available in Cloud Composer images.
Airflow 2.6.3 consolidates the logic for handling tasks that are stuck in the queued state:
- The
[kubernetes]worker_pods_pending_timeout,[celery]stalled_task_timeout, and[celery]task_adoption_timeoutAirflow configuration options are deprecated and merged into the[scheduler]task_queued_timeoutoption. - In Cloud Composer, the default value of the
[scheduler]task_queued_timeoutoption is set to 40 minutes. - If your environment uses a custom value for any of the deprecated Airflow configuration options, please clear the overrides before upgrading. If the values are not cleared, the longest timeout of all deprecated options is selected upon upgrading.
- If required, you can override the value of the
[scheduler]task_queued_timeoutoption in your environment. - For more information about other changes between Airflow versions 2.5.3 and 2.6.3, see Airflow release notes.
Cloud Composer 2.4.6 images are available:
- composer-2.4.6-airflow-2.6.3
- composer-2.4.6-airflow-2.5.3 (default)
- composer-2.4.6-airflow-2.4.3
Cloud Functions now supports the Python 3.12 runtime at the Preview release level.
You can now create log buckets in the us-west8 region. For a complete list of supported regions, see Supported regions.
A weekly digest of client library updates from across the Cloud SDK.
Java
Changes for google-cloud-logging
3.15.11 (2023-10-10)
Dependencies
Changes to the Autoclass feature that were announced on July 17, 2023 begin taking effect today.
cos-105-17412-226-10
| Kernel | Docker | Containerd | GPU Drivers |
| COS-5.15.133 | v23.0.3 | v1.7.6 | v470.199.02(default),v535.104.05(latest) |
Updated app-containers/containerd to v1.7.6.
Synced TCPX changes to commit 90ce0a6aa201.
Updated cos-gpu-installer to v2.1.9.
Upgraded net-misc/curl to v8.4.0. This resolves CVE-2023-38545.
Fixed CVE-2023-38039 in net-misc/curl.
Fixed CVE-2023-4244 in the Linux kernel.
Fixed CVE-2023-5197 in the Linux kernel.
Fixed CVE-2023-42756 in COS kernel.
Fixed CVE-2023-42753 in the Linux kernel.
cos-101-17162-336-7
| Kernel | Docker | Containerd | GPU Drivers |
| COS-5.15.133 | v20.10.24 | v1.6.21 | v470.199.02(default),v535.104.05(latest) |
Fixed CVE-2022-48560 in dev-lang/python package.
Upgraded net-misc/curl to v8.4.0. This resolves CVE-2023-38545.
Fixed CVE-2023-38039 in net-misc/curl.
Fixed CVE-2023-5197 in the Linux kernel.
Fixed CVE-2023-42756 in COS kernel.
Fixed CVE-2023-42753 in the Linux Kernel.
Runtime sysctl changes:
- Changed: fs.file-max: 813043 -> 813032
- Changed: kernel.threads-max: 63551 -> 63552
- Changed: net.netfilter.nf_conntrack_sctp_timeout_shutdown_recd: 0 -> 3
- Changed: net.netfilter.nf_conntrack_sctp_timeout_shutdown_sent: 0 -> 3
- Changed: user.max_cgroup_namespaces: 31775 -> 31776
- Changed: user.max_ipc_namespaces: 31775 -> 31776
- Changed: user.max_mnt_namespaces: 31775 -> 31776
- Changed: user.max_net_namespaces: 31775 -> 31776
- Changed: user.max_pid_namespaces: 31775 -> 31776
- Changed: user.max_time_namespaces: 31775 -> 31776
- Changed: user.max_user_namespaces: 31775 -> 31776
- Changed: user.max_uts_namespaces: 31775 -> 31776
cos-97-16919-353-53
| Kernel | Docker | Containerd | GPU Drivers |
| COS-5.10.186 | v20.10.24 | v1.6.21 | v470.199.02(default),v535.104.05(latest) |
Updated cos-gpu-installer to v2.1.9.
Fixed CVE-2023-38039 in net-misc/curl.
Fixed CVE-2023-42753 in the Linux Kernel.
cos-93-16623-461-40
| Kernel | Docker | Containerd | GPU Drivers |
| COS-5.10.177 | v20.10.24 | v1.6.20 | v450.248.02(default),v535.104.05(latest),v470.199.02(R470 for compatibility with K80 GPUs) |
Upgraded net-misc/curl to v8.4.0. This resolves CVE-2023-38545.
A weekly digest of client library updates from across the Cloud SDK.
Go
Changes for dataflow/apiv1beta3
0.9.2 (2023-10-12)
Bug Fixes
- dataflow: Update golang.org/x/net to v0.17.0 (174da47)
Dataproc Metastore now supports multi-regional configurations.
A weekly digest of client library updates from across the Cloud SDK.
Java
Changes for google-cloud-datastore
2.17.3 (2023-10-10)
Dependencies
Filestore Enterprise now supports backups on GKE, allowing you to make reliable copies of your data to be stored for later use. To trigger backups on Filestore Enterprise, use Kubernetes volume snapshots. Backups are currently not supported for Filestore Enterprise instances with multishares enabled.
A weekly digest of client library updates from across the Cloud SDK.
Java
Changes for google-cloud-pubsub
1.125.6 (2023-10-10)
Dependencies
- Update dependency com.google.cloud:google-cloud-bigquery to v2.33.1 (#1756) (239f474)
- Update dependency com.google.cloud:google-cloud-core to v2.25.0 (#1764) (72404ea)
- Update dependency com.google.cloud:google-cloud-shared-dependencies to v3.17.0 (#1765) (a447292)
- Update dependency com.google.protobuf:protobuf-java-util to v3.24.4 (#1760) (10a64c6)
Public preview: Pub/Sub BigQuery subscriptions now support BigQuery change data capture.
A weekly digest of client library updates from across the Cloud SDK.
Go
Changes for secretmanager/apiv1
1.11.2 (2023-10-12)
Bug Fixes
- secretmanager: Update golang.org/x/net to v0.17.0 (174da47)
The Long Audio Synthesis API now supports the following languages: English, Spanish, French, German, Japanese, Hindi, Italian, Korean, Portuguese, Thai, Vietnamese, Danish, Filipino.
There is no longer billing differentiation for Cloud Text-to-Speech Offline Custom Voice API calls. See the <ReportedUsage> documentation for more details.
October 13, 2023
Apigee XOn October 13, 2023, we released an updated version of Apigee (1-11-0-apigee-6).
| Bug ID | Description |
|---|---|
| 304681330 | Security fix for apigee-ingress. This addresses the following vulnerability: CVE-2023-44487 |
| 305127632 | Security bulletin published. GCP-2023-032 |
Description
A Denial-of-Service (DoS) vulnerability was recently discovered in multiple implementations of the HTTP/2 protocol (CVE-2023-44487), including the Apigee Ingress (Anthos Service Mesh) server used by Apigee X. The vulnerability could lead to a DoS of Apigee API management functionality.
Affected Products
Deployments of Apigee X that are accessible through a Google Cloud Network Load Balancer (Layer 4), or a custom layer 4 load balancer, are affected. A hotfix is being applied to all Apigee X instances. Your Apigee X instances will be automatically updated within the next few days.
Unaffected products
Apigee X instances which are accessed only via Google Cloud Application Load Balancers (Layer 7) are not affected. This includes deployments that have HTTP/2 enabled for gRPC proxies.
What Should I Do?
All Apigee X instances will be automatically updated within the next few days. Customers do not need to take any actions.
What Vulnerabilities Are Addressed By These Patches?
The vulnerability, CVE-2023-44487, allows an attacker to execute a denial-of-service attack on Apigee ingresses.
hybrid v1.10.3-hotfix.2
On October 13, 2023 we released an updated version of the Apigee hybrid software, v1.10.3-hotfix.2.
- To install the hotfix, follow the instructions in Upgrading Apigee hybrid to version 1.10.
- For information on new installations, see The big picture.
| Bug ID | Description |
|---|---|
| 304681330 | Security fix for apigee-ingress. This addresses the following vulnerability: CVE-2023-44487 |
| 305127632 | Security bulletin published. GCP-2023-032 |
hybrid v1.9.4-hotfix.1
On October 13, 2023 we released an updated version of the Apigee hybrid software, v1.9.4-hotfix.1.
- To install the hotfix, follow the instructions in Upgrading Apigee hybrid to version 1.9.
- For information on new installations, see The big picture.
| Bug ID | Description |
|---|---|
| 304681330 | Security fix for apigee-ingress. This addresses the following vulnerability: CVE-2023-44487 |
| 305127632 | Security bulletin published. GCP-2023-032 |
Description
A Denial-of-Service (DoS) vulnerability was recently discovered in multiple implementations of the HTTP/2 protocol (CVE-2023-44487), including the Apigee Ingress (Anthos Service Mesh) server used by Apigee hybrid. The vulnerability could lead to a DoS of Apigee API management functionality.
Affected Products
Apigee hybrid instances that allow HTTP/2 requests to reach the Apigee Ingress are affected. Customers should verify if the load balancers fronting their Apigee hybrid ingresses allow for HTTP/2 requests to reach the Apigee Ingress service.
What Should I Do?
Apigee hybrid customers will need to upgrade to one of the following patch versions:
- v1.10.3-hotfix.2 which will be released by Friday, October 13, 2023
- v1.9.4-hotfix.1 which will be released by Friday, October 13, 2023
What Vulnerabilities Are Addressed By These Patches?
The vulnerability, CVE-2023-44487, allows an attacker to execute a denial-of-service attack on Apigee ingresses.
Generally available: C3 VMs support Compute Engine flexible committed use discounts (CUDs).
Compute Engine flexible CUDs allow you to commit to a minimum hourly spend amount and use vCPUs and/or memory in any of the projects within your Cloud Billing account, across any region, and belonging to any eligible machine types. Learn more about Compute Engine Flexible CUDs and how to purchase flexible commitments.
If you want to modify a future reservation request using the Compute Engine API, the paths query parameter is deprecated. Instead, use the updateMask query parameter.
For more information, see Modify future reservation requests.
Preview: You can now use workforce identity federation with OS Login.
Formatting of Dataform core and JavaScript code is available.
New Dataproc Serverless for Spark runtime versions:
- 1.1.35
- 2.0.43
- 2.1.22
(2023-R20) Version updates
GKE cluster versions have been updated.
New versions available for upgrades and new clusters
The following Kubernetes versions are now available for new clusters and for opt-in control plane upgrades and node upgrades for existing clusters. For more information on versioning and upgrades, see GKE versioning and support and Upgrades.
No channel
- The following control plane and node versions are now available:
- The following control plane versions are no longer available: 1.24.17-gke.1963000, 1.25.14-gke.1256000, 1.26.9-gke.1256000
Stable channel
- There are no new releases in the Stable release channel.
Regular channel
- There are no new releases in the Regular release channel.
Rapid channel
- The following versions are now available in the Rapid channel:
- The following versions are no longer available in the Rapid channel: 1.24.17-gke.1963000, 1.25.14-gke.1256000, 1.26.9-gke.1256000
Containers running in nodes in GKE version 1.28.1-gke.201 or later don't need to have privileged mode enabled to access TPUs. When upgrading a cluster to 1.28.1-gke.201 or later, we recommend removing privileged: true from the securityContext of any TPU workload. To learn more, see Deploy TPU workloads.
Starting in GKE 1.28.1-gke.1066000, two new TPU usage metrics are available: TensorCore utilization and Memory Bandwidth utilization.
(2023-R20) Version updates
- The following versions are now available in the Rapid channel:
- The following versions are no longer available in the Rapid channel: 1.24.17-gke.1963000, 1.25.14-gke.1256000, 1.26.9-gke.1256000
(2023-R20) Version updates
- The following control plane and node versions are now available:
- The following control plane versions are no longer available: 1.24.17-gke.1963000, 1.25.14-gke.1256000, 1.26.9-gke.1256000
Vertex AI Search: Customer-managed encryption key integration for the EU
Customer-managed encryption keys (CMEK) is available in the EU as an allowlisted preview feature.
If you store your data in an EU multi-region data store, you can provide your own encryption key to protect your data at rest.
For information, see Customer-managed encryption keys.
October 12, 2023
Access ApprovalAccess Approval supports Access Context Manager in the GA stage.
Access Transparency supports Access Context Manager in the GA stage.
Anthos clusters on VMware 1.15.5-gke.41 is now available. To upgrade, see Upgrading Anthos clusters on VMware. Anthos clusters on VMware 1.15.5-gke.41 runs on Kubernetes 1.26.7-gke.2500.
The following issues are fixed in 1.15.5-gke.41:
- Fixed the issue that server-side preflight checks fail to validate container registry access on clusters with a private network and no private registry.
- Fixed the known issue where a non-HA Controlplane V2 cluster is stuck at node deletion until it timesout.
- Fixed the known issue where upgrading or updating an admin cluster with a CA version greater than 1 fails.
- Fixed the issue where the Controlplane V1 stackdriver operator has
--is-kubeception-less=truespecified by mistake. - Fixed the known issue that causes the secrets encryption key to be regenerated when upgrading the admin cluster from 1.14 to 1.15, resulting in the upgrade being blocked.
The following vulnerabilities are fixed in 1.15.5-gke.41:
High-severity container vulnerabilities:
Container-optimized OS vulnerabilities:
Ubuntu vulnerabilities:
The following geography functions are now generally available (GA):
ST_LINESUBSTRING: Gets a segment of a single linestring at a specific starting and ending fraction.ST_HAUSDORFFDISTANCE: Gets the discrete Hausdorff distance between two geometries.
New searchable fields are now available.
The following searchable fields are now publicly available through the resource search API (SearchAllResources).
effectiveTagKeyseffectiveTagValueseffectiveTagValueIds
The following search result fields are now publicly available through the resource search API (SearchAllResources).
tagseffectiveTags
You can now configure the format of the timestamp in your query results in the Logs Explorer. For more information, see Logs Explorer overview: Configure the Time column.
The Node.js and Python client libraries now have parallelized upload and download options, improving their performance.
- Both client libraries have improved bulk uploads, bulk downloads, large object uploads, and large object downloads.
Preview: The following metrics are now available to help you monitor your Persistent Disk and Hyperdisk volume performance:
Average I/O latency (
compute.googleapis.com/instance/disk/average_io_latency)Average I/O queue depth (
compute.googleapis.com/instance/disk/average_io_queue_depth)
To learn more about these metrics and how to view them, see Review disk metrics.
Dialogflow CX generative feedback now supports more languages.
Dialogflow CX launched generative playbooks with restricted access.
Dialogflow CX spelling correction now supports all regions, but is limited to five languages.
Cloud Storage Backint agent for SAP HANA version 1.0.30
Version 1.0.30 of the Cloud Storage Backint agent for SAP HANA is available. This version reverts the google-cloud-storage client library to an earlier version so that API call retries work correctly.
For more information about the agent, see Cloud Storage Backint agent for SAP HANA overview.
You can now transfer data from Amazon S3 via your CloudFront domain. Learn more.
October 11, 2023
AlloyDB for PostgreSQLAlloyDB Omni is now generally available (GA).
In AlloyDB Omni version 15.2.1 and earlier, after a failover, when you promote a standby instance, incremental backups from the newly promoted instance might conflict with the existing backup files, and the backups might fail.
As a workaround, move the conflicting files into a separate directory.
Users can now set an IP range size and starting IP address for private connections in Bitbucket Data Center using the peeredNetworkIpRange. This feature is generally available. To learn more, see Build repositories in Bitbucket Data Center in a private network.
Cloud Functions (2nd gen) now supports Shared VPC ingress at the General Availability release level. Shared VPC traffic is now considered "internal" for functions that are connected to the Shared VPC network.
Shared VPC ingress is now at general availability (GA). Shared VPC traffic is now considered "internal" for Cloud Run services that are connected to the Shared VPC network.
Cloud Spanner has made improvements that provide higher throughput for instances located in select Spanner regional and multi-region instance configurations. These improvements are available without additional cost or any configuration changes. For more information, see Performance improvements.
Colab Enterprise is now generally available (GA). Colab Enterprise combines the popular collaborative features of Colaboratory with the security and compliance capabilities of Google Cloud. Colab Enterprise includes:
- Sharing and collaborating functionality, with IAM access control.
- Google-managed compute and runtime provisioning, with configurable runtime templates.
- Integrations with Vertex AI and BigQuery.
- Inline code completion with Duet AI (Preview) assistance.
- End-user credential authentication for running your notebook code.
- Idle shutdown for runtimes (Experimental).
To get started, see Introduction to Colab Enterprise or create a notebook and start coding.
Generally available: You can configure stateful IP addresses in a managed instance group. Stateful IP addresses are preserved when VM instances in the group are repaired, updated, and re-created. For more information, see Configuring stateful IP addresses in MIGs.
cos-dev-113-17965-0-0
| Kernel | Docker | Containerd | GPU Drivers |
| COS-6.1.55 | v24.0.5 | v1.7.6 | v535.104.05(default, latest),v470.199.02(R470 for compatibility with K80 GPUs) |
Upgraded app-containers/containerd to v1.7.6.
Upgraded cos-gpu-installer to v2.1.9.
Upgraded dev-util/gn to v2121.
Upgraded chromeos-base/google-breakpad to v2023.06.01.191934-r222.
Upgraded chromeos-base/debugd-client to v0.0.1-r2559.
Upgraded chromeos-base/shill-client to v0.0.1-r4030.
Upgraded chromeos-base/chromeos-common-script to v0.0.1-r561.
Upgraded chromeos-base/session_manager-client to v0.0.1-r2649.
Fixed CVE-2023-4911 in sys-libs/glibc.
Fixed CVE-2023-38039 in net-misc/curl.
Fixed CVE-2023-42756 in COS kernel.
Fixed CVE-2023-5345 in COS kernel.
Fixed CVE-2023-5197 in the Linux kernel.
cos-93-16623-461-39
| Kernel | Docker | Containerd | GPU Drivers |
| COS-5.10.177 | v20.10.24 | v1.6.20 | v450.248.02(default),v535.104.05(latest),v470.199.02(R470 for compatibility with K80 GPUs) |
Upgraded cos-gpu-installer to v2.1.9.
Fixed CVE-2023-38039 in net-misc/curl.
Fixed CVE-2023-42753 in the Linux Kernel.
cos-97-16919-353-53
| Kernel | Docker | Containerd | GPU Drivers |
| COS-5.10.186 | v20.10.24 | v1.6.21 | v470.199.02(default),v535.104.05(latest) |
Upgraded cos-gpu-installer to v2.1.9.
Fixed CVE-2023-38039 in net-misc/curl.
Fixed CVE-2023-42753 in the Linux Kernel.
cos-105-17412-156-69
| Kernel | Docker | Containerd | GPU Drivers |
| COS-5.15.120 | v23.0.3 | v1.7.2 | v470.199.02(default),v535.104.05(latest) |
Upgraded cos-gpu-installer to v2.1.9.
Fixed CVE-2023-38039 in net-misc/curl.
Fixed CVE-2023-42753 in the Linux kernel.
cos-109-17800-0-51
| Kernel | Docker | Containerd | GPU Drivers |
| COS-6.1.42 | v24.0.5 | v1.7.2 | v535.104.05(default, latest),v470.199.02(R470 for compatibility with K80 GPUs) |
Fixed CVE-2023-38039 in net-misc/curl.
Fixed CVE-2023-5197 in the Linux kernel.
API 3.0 and API 3.1 have been removed in Looker 23.18.
Clustrix database support has been removed. Any existing connections to a Clustrix database will fail to run in Looker 23.18.
Performance improvements have been made to query preparation time by front-loading LookML model compilation during production deployments.
To prevent confusion with SSO authentication, the SSO embed feature has been renamed Signed embed.
The Get embed URL option from a dashboard, a Look, or an Explore can now generate a signed embed URL.
Embedded Looks now support themes, so the Get embed URL dialog now shows a theme selector for Looks.
The manage_project_connections_restricted permission lets users edit a subset of settings for new and existing connections.
The New Schedules Page Labs feature updates the interface of the Admin settings - Schedules page.
An issue with drilling for transposed tables has been fixed. Drilling for transposed tables now performs as expected.
The Box Shadow theme now performs as expected for static and tile LookML dashboards.
Fixed date field values were not being displayed correctly when referenced by Liquid in the label or html LookML parameter. This feature now performs as expected.
Unreferenced custom fields from drill URL have been removed.
Looker 23.18 includes the following changes, features, and fixes.
Expected Looker (original) deployment start: Monday, October 16, 2023
Expected Looker (original) final deployment and download available: Thursday, October 26, 2023
Expected Looker (Google Cloud core) deployment start: Monday, October 23, 2023
Expected Looker (Google Cloud core) final deployment: Friday, November 3, 2023
Public preview is now available for the Open SQL Interface. The Open SQL Interface allows access to Looker models and Explores for applications (such as Tableau) that use JDBC to connect to data sources. For Looker (original) instances, enable the SQL Interface Experimental Labs feature on the Looker instance. (Only Looker-hosted instances support this Labs feature.) For Looker (Google Cloud core) instances, fill out the Looker SQL Interface Pre-GA Agreement interest form. The Google team will enable your instance for the SQL Interface feature.
IAM permissions have been clarified and made more visible in the Looker (Google Cloud core) documentation.
The in-app support in the Help menu has been updated to integrate with the Google Cloud console. You will see in-app support only if you have purchased at least a Standard Support service with Google Cloud Customer care.
Preview: Migrate to Virtual Machines now supports migrating VMs to the C3, H3, and M3 machine types. These machine types support non-volatile memory express (NVMe) and Google Virtual NIC (gVNIC). Before you migrate your VMs to any of these machine types, ensure that source VMs support NVMe and gVNIC. For more information on different machine types that support NVMe and gVNIC, go to the Machine series comparison section, click Choose VM properties to compare, and select Disk interface type and Network interfaces.
October 10, 2023
Anthos Service Mesh1.18.4-asm.0 is now available for in-cluster Anthos Service Mesh.
This patch release contains the fix for the security vulnerability listed in GCP-2023-031 For details on upgrading Anthos Service Mesh, refer to Upgrade Anthos Service Mesh.
1.17.7-asm.0 is now available for in-cluster Anthos Service Mesh.
This patch release contains the fix for the security vulnerability listed in GCP-2023-031 For details on upgrading Anthos Service Mesh, refer to Upgrade Anthos Service Mesh.
1.16.7-asm.10 is now available for in-cluster Anthos Service Mesh.
This patch release contains the fix for the security vulnerability listed in GCP-2023-031 For details on upgrading Anthos Service Mesh, refer to Upgrade Anthos Service Mesh.
The following new data transformer functions are available:
Manifest XML - Converts the specified input JSON object into an XML string.
Parse XML - Parses the specified input XML string into a JSON object.
IAM Conditions for fine-grained access
IAM Conditions lets you define and enforce conditional, attribute-based access control for Google Cloud resources, including Application Integration resources. For more information, see Add IAM conditions.
You can now view the detailed summary of an integration from the Integration designer. For more information, see View integration details.
The following new data transformer functions are available:
Manifest XML - Converts the specified input JSON object into an XML string.
Parse XML - Parses the specified input XML string into a JSON object.
IAM Conditions for fine-grained access
IAM Conditions lets you define and enforce conditional, attribute-based access control for Google Cloud resources, including Application Integration resources. For more information, see Add IAM conditions.
You can now view the detailed summary of an integration from the Integration designer. For more information, see View integration details.
Support for user-defined service account
You can now configure a service account of your choice for an integration. The option to select a service account is displayed to you during the integration creation step.
While creating a custom parser, you can use the preview option to view the UDM output. In the preview, you can use the statedump filter plugin to validate the internal state of a parser. For more information, see Validate data using statedump plugin.
The following resource types are now publicly available through the analyze policy APIs (AnalyzeIamPolicy and AnalyzeIamPolicyLongrunning).
- MachineImage for Compute Engine
compute.googleapis.com/MachineImage
A release was made. Updates may include general performance improvements, bug fixes, and updates to the API reference documentation.
Starting October 10, 2023, mirror.gcr.io is transitioning to being hosted on Artifact Registry. This change is taking place on a region by region basis, and doesn't require you to change your usage of mirror.gcr.io unless you are using it within a VPC service perimeter.
For information on how to use mirror.gcr.io in a VPC service perimeter after the transition to being hosted on Artifact Registry, see Using Artifact Registry with VPC Service Controls.
M112 release
- Miscellaneous bug fixes and improvements.
M112 release
- CUDA 12.1 VM images are available with the following image names:
common-cu121-debian-11-py310common-cu121-ubuntu-2004-py310- Miscellaneous bug fixes and improvements.
Deletion operation can't be successful when raw document is missing
A Denial-of-Service (DoS) vulnerability was recently discovered in multiple implementations of the HTTP/2 protocol (CVE-2023-44487), including the golang HTTP server used by Kubernetes. The vulnerability could lead to a DoS of the Google Kubernetes Engine (GKE) control plane. GKE clusters with authorized networks configured are protected by limiting network access, but all other clusters are affected. For more information, see the GCP-2023-030 security bulletin.
Generally Available: Migrate to Virtual Machines from an Azure source lets you migrate VM instances running on Azure to Google Cloud Compute Engine.
M112 release
The M112 release of Vertex AI Workbench user-managed notebooks includes the following:
- Miscellaneous bug fixes and improvements.
October 09, 2023
BatchJob limits have increased to 100,000 tasks per task group and 5,000 parallel tasks per job. Learn more about Quotas and limits.
The BeyondCorp Enterprise Policy Remediator is in Preview. You can use the Policy Remediator to provide users with actionable steps that they can take to remediate access denied issues.
For more information, see Remediate denied access with the Policy Remediator.
A weekly digest of client library updates from across the Cloud SDK.
Go
Changes for bigquery/storage/apiv1beta1
1.56.0 (2023-10-05)
Features
- bigquery/analyticshub: Add Subscription resource and RPCs (#8612) (9992249)
- bigquery: Add external dataset reference (#8545) (1001acf)
- bigquery: Add media options to LoadConfig (#8640) (62baf56)
Bug Fixes
- bigquery/storage/managedwriter: Automatic retry for multiplex test (#8601) (6ef1945)
- bigquery: Dependency detection on proto conversion (#8566) (763ab5d)
Documentation
- bigquery/datatransfer: Update transferConfig.name description to indicate that it supports both formats (0449518)
Python
Changes for google-cloud-bigquery
3.12.0 (2023-10-02)
Features
- Add
Dataset.storage_billing_modelsetter, useclient.update_dataset(ds, fields=["storage_billing_model"])to update (#1643) (5deba50) - Search statistics (#1616) (b930e46)
- Widen retry predicate to include ServiceUnavailable (#1641) (3e021a4)
Bug Fixes
- Allow
storage_billing_modelto be explicitly set toNoneto use project default value (#1665) (514d3e1) - Relax timeout expectations (#1645) (1760e94)
- Use isinstance() per E721, unpin flake8 (#1659) (54a7769)
Documentation
Queries now support additional ways to work with grouping sets, which include:
GROUP BY GROUPING SETSclause (new): Produce aggregated data for one or more grouping sets.GROUP BY CUBEclause (new): Produce aggregated data for all grouping set permutations.GROUP BY ROLLUPclause (update): You can now include groupable items sets in this clause.GROUPINGfunction (new): Check if a groupable value in theGROUP BYclause is aggregated.
This feature is in preview.
Adding descriptions to the columns of a view is now generally available (GA). Use the CREATE VIEW or ALTER COLUMN DDL statements to add descriptions.
BigQuery is now available in the Dammam (me-central2) region.
BigQuery ML is now available in the Dammam (me-central2) region.
BigQuery Data Transfer Service is now available in the Dammam (me-central2) region.
A weekly digest of client library updates from across the Cloud SDK.
A weekly digest of client library updates from across the Cloud SDK.
Python
Changes for google-cloud-logging
3.8.0 (2023-10-03)
Features
When you install the Ops Agent on a Compute Engine VM by using the Cloud Monitoring VM Instances dashboard or the Observability tab on a Compute Engine VM details page, the agent is now installed with an Ops Agent OS policy. This installation method replaces the prior set of manual steps. For more information, see Installing the agent by using the Google Cloud console.
When you install the Ops Agent on a Compute Engine VM by using the Cloud Monitoring VM Instances dashboard or the Observability tab on a Compute Engine VM details page, the agent is now installed with an Ops Agent OS policy. This installation method replaces the prior set of manual steps. For more information, see Installing the agent by using the Google Cloud console.
The cross db ownership chaining flag is deprecated for all SQL Server versions.
For cross-database access, use the Microsoft tutorial for signing stored procedures with a certificate.
Cloud Spanner batch write is now available in Preview. You can use Spanner batch write to commit multiple mutations non-atomically in a single request with low latency. For more information, see Modify data using batch write.
Cloud Spanner Vertex AI integration now supports Vertex AI Generative AI text embeddings and the text-bison model. For more information, see Get Vertex AI text embeddings.
When you install the Ops Agent on a Compute Engine VM by using the Observability tab on a Compute Engine VM details page, the agent is now installed with an Ops Agent OS policy. This installation method replaces the prior set of manual steps. For more information, see Installing the agent by using the Google Cloud console.
Generally available: H3 VMs, designed for compute-intensive high performance computing (HPC) workloads, are now generally available. For more information, see H3 machine series.
Announcing the General Availability (GA) release of Dataproc Serverless for Spark Interactive sessions.
A weekly digest of client library updates from across the Cloud SDK.
Node.js
Changes for @google-cloud/datastore
8.2.1 (2023-10-03)
Bug Fixes
8.2.0 (2023-10-02)
Features
Bug Fixes
Go
Changes for datastore/admin/apiv1
1.15.0 (2023-10-06)
Features
Bug Fixes
If you are using a third generation machine series (for example, C3), GKE configures Local SSD volumes as the local ephemeral storage by default. You no longer need to specify the --ephemeral-storage-local-ssd flag when provisioning clusters or node pools. When you configure Local SSD volumes as raw block storage with the --local-nvme-ssd-block flag, specifying the count value is now optional.
Cloud IDS threat detections available in Security Command Center
Threats that are detected by Cloud IDS, a Google Cloud intrusion detection service, are now included in the findings that are issued by the Event Threat Detection service of Security Command Center. This feature is available in Preview.
For more information, see:
- Cloud IDS in Event Threat Detection rules
- Cloud IDS overview
'ta mount' and 'ta unmount' are command line tools offering the user the ability to mount their own NFS or CIFS shares onto the appliance.
Learn more about how to mount to an appliance.
Vertex AI Search and Conversation: Renamed in the console and documentation
The Google Cloud console and the documentation at cloud.google.com have been updated to show the current product name for Vertex AI Search and Conversation. On the console, look for "Search and Conversation".
You might see the old name (Generative AI App Builder) in some places—for example, in the API reference.
October 06, 2023
Apigee Advanced API SecurityOn October 6, 2023, we released an updated version of Advanced API Security.
Public Preview of Advanced API Security Actions
Advanced API Security's new Security Actions feature lets you create security actions that define how Apigee handles detected traffic. You can create the following security actions:
Deny actions, which deny requests that meet specified conditions, for example, originating at an IP address that has been identified as a source of abuse.
Flag actions, which let requests pass through, but add headers to requests to identify them as suspicious.
Allow actions, which are used to override deny actions in specific cases when the request is trusted.
Backup and DR Service 11.0.7.404 is now available to update your backup/recovery appliance. Refer to these instructions to update your appliance.
The new Backup and DR Service update policy requires updating all backup/recovery appliances older than version 11.0.3 to maintain product support and avoid restrictions on enabling backups for new entities. Learn more.
Added support to restore PostgreSQL database backup images to an alternate location. Learn more.
Backup and DR agent is enhanced to support Rocky Linux 8.7 operating system version. See support matrix.
Backup and DR agent now supports Rocky Linux 8.7 on Oracle 19c database. See support matrix.
Backup and DR agent now supports RHEL 8.4 on Oracle 21c database. See support matrix.
Cloud Bigtable instance, cluster, and table metadata is automatically synced to Data Catalog, a feature of Dataplex, for improved data discovery and governance. This feature is generally available (GA).
The Cloud Healthcare API offers multi-region support in the Europe (eu) region.
Generally available: NVIDIA L4 GPUs are now available in the following additional regions and zones:
- APAC
- Seoul, South Korea (
asia-northeast3-b)
- Seoul, South Korea (
- Europe
- St. Ghislain, Belgium (
europe-west1-b) - Frankfurt, Germany (
europe-west3-b)
- St. Ghislain, Belgium (
- North America
- Council Bluffs, Iowa: (
us-central1-c) - Las Vegas, Nevada (
us-west4-a,c)
- Council Bluffs, Iowa: (
For more information about using GPUs on Compute Engine, see GPU platforms.
New Dataproc on Compute Engine image version 2.2 is available for preview with upgraded components.
New Dataproc on Compute Engine subminor image versions:
- 2.0.79-debian10, 2.0.79-rocky8, 2.0.79-ubuntu18
- 2.1.27-debian11, 2.1.27-rocky8, 2.1.27-ubuntu20, 2.1.27-ubuntu20-arm
- 2.2.0-RC2-debian11, 2.2.0-RC2-rocky9, 2.2.0-RC2-ubuntu22
Upgraded Hadoop version from 3.3.3 to 3.3.6 in the latest Dataproc on Compute Engine 2.1 image version.
New Dataproc Serverless for Spark runtime versions:
- 1.1.34
- 2.0.42
- 2.1.21
Upgraded the Cloud Storage connector version to 2.2.17 in the latest Dataproc Serverless for Spark runtimes.
Added the gs.http.connect-timeout and gs.http.read-timeout properties in Flink to
set the connection timeout and read timeout for java-storage client
in the latest Dataproc on Compute Engine 2.1 image version.
Added the gs.filesink.entropy.enabled property in Flink to enable entropy
injection in filesink Cloud Storage path in the latest Dataproc on Compute Engine 2.1 image version.
A previously published release note on December 14, 2022 has been updated. Support for migration of GKE Autopilot clusters' datapath provider to Dataplane V2 has been paused. We will update this release note when migration support resumes.
October 05, 2023
Apigee Integrated PortalOn October 5, 2023 we released an updated version of Apigee integrated portal. This release includes general improvements to performance and availability.
Batch is available in the following regions:
australia-southeast2(Melbourne)europe-west8(Milan)europe-west12(Turin)me-west1(Tel Aviv)northamerica-northeast2(Toronto)southamerica-east1(São Paulo)us-east5(Columbus)
For more information, see Locations.
The BigQuery migration assessment is now available for Snowflake in preview. You can use this feature to assess the complexity of migrating data from your Snowflake data warehouse to BigQuery.
Certificate Authority Service is now available in the following region:
- me-central2
For more information, see Certificate Authority Service locations.
The following supported default parsers have changed. Each is listed by product name and log_type value, if applicable.
- AWS Cloudtrail (
AWS_CLOUDTRAIL) - Azion (
AZION) - Azure AD Organizational Context (
AZURE_AD_CONTEXT) - Blue Coat Proxy (
BLUECOAT_WEBPROXY) - Cisco ACS (
CISCO_ACS) - Cisco FireSIGHT Management Center (
CISCO_FIRESIGHT) - Cisco ISE (
CISCO_ISE) - Cisco Umbrella DNS (
UMBRELLA_DNS) - Cloud Intrusion Detection System (
GCP_IDS) - Cloudflare (
CLOUDFLARE) - Compute Context (
N/A) - Corelight (
CORELIGHT) - Darktrace (
DARKTRACE) - F5 ASM (
F5_ASM) - FireEye (
FIREEYE_ALERT) - HAProxy (
HAPROXY) - Hashicorp Vault (
HASHICORP) - HP Procurve Switch (
HP_PROCURVE) - IBM Security Verify SaaS (
IBM_SECURITY_VERIFY_SAAS) - Imperva (
IMPERVA_WAF) - Ionix (
IONIX) - Microsoft Defender for Endpoint (
MICROSOFT_DEFENDER_ENDPOINT) - MISP Threat Intelligence (
MISP_IOC) - Office 365 (
OFFICE_365) - Oracle Cloud Infrastructure Audit Logs (
OCI_AUDIT) - Sendmail (
SENDMAIL) - Tanium Audit (
TANIUM_AUDIT) - Tanium Stream (
TANIUM_TH) - Thycotic (
THYCOTIC) - Unix system (
NIX_SYSTEM) - VMware ESXi (
VMWARE_ESX) - VMware NSX (
VMWARE_NSX) - VMware vCenter (
VMWARE_VCENTER) - WatchGuard (
WATCHGUARD) - Windows DNS (
WINDOWS_DNS) - Windows Event (
WINEVTLOG) - Workspace Activities (
WORKSPACE_ACTIVITY) - Workspace Alerts (
WORKSPACE_ALERTS) - Zeek JSON (
BRO_JSON) - Zscaler CASB (
ZSCALER_CASB)
The following log types, without a default parser, were added. Each is listed by product name and log_type value, if applicable.
- AWS_EMR (
AWS_EMR) - Azure Application Gateway (
AZURE_GATEWAY) - CloudBolt (
CLOUDBOLT) - DNSFilter (
DNSFILTER) - GitGuardian Enterprise (
GITGUARDIAN_ENTERPRISE) - GoAnywhere MFT (
GOANYWHERE_MFT) - IBM Security Identity Manager (
IBM_SIM) - Jamf Pro MDM (
JAMF_PRO_MDM) - MultiPay (
MULTIPAY) - Palo Alto Networks IoT Security (
PAN_IOT) - Raritan Dominion SX II (
RARITAN_DOMINION)
For a list of supported log types and details about default parser changes, see Supported log types and default parsers.
Cloud Composer 2 is now available in Milan (europe-west8), Berlin (europe-west10), and Turin (europe-west12).
Fixed a problem where newly-created Airflow workers ignored the SIGTERM signal, which could lead to task failures.
Cloud Composer 2.4.5 images are available:
- composer-2.4.5-airflow-2.5.3 (default)
- composer-2.4.5-airflow-2.4.3
Ops Agent version 2.42.0 introduces support for Compute Engine Arm VMs that are running Ubuntu 22.04 LTS (Jammy Jellyfish). For more information, see Support for Compute Engine Arm VMs.
Dashboard-wide filters now apply to the Logs Panel widget. For more information, see Filter the log entries.
Cloud Spanner sampled query plans are now available in GA. You can view samples of historic query plans and compare the performance of a query over time. For more information, see Sampled query plans.
Cloud TPU now supports TensorFlow 2.13.1. For more information see the TensorFlow 2.13.1 release notes.
You can now show logs and events as inline messages when exploring a trace. For more information, see Find and explore traces.
(2023-R19) Version updates
GKE cluster versions have been updated.
New versions available for upgrades and new clusters
The following Kubernetes versions are now available for new clusters and for opt-in control plane upgrades and node upgrades for existing clusters. For more information on versioning and upgrades, see GKE versioning and support and Upgrades.
No channel
- The following control plane and node versions are now available:
Stable channel
- The following version is no longer available in the Stable channel: 1.26.5-gke.2100
Regular channel
- There are no new releases in the Regular release channel.
Rapid channel
- The following versions are now available in the Rapid channel:
An issue was previously reported with running certain commands in container images when Image streaming is enabled. See the August 31, 2023 release note for details. This issue is fixed in the following minor versions:
- 1.25 with the patch versions 1.25.14-gke.1351000 and later.
- 1.25 with the patch versions 1.26.9-gke.1345000 and later.
- 1.27 with the patch versions 1.27.6-gke.100 and later.
- 1.28 with the patch version 1.28.1-gke.1157000 and later.
To receive the fix, upgrade your nodes to an applicable patch version.
(2023-R19) Version updates
- The following control plane and node versions are now available:
(2023-R19) Version updates
- The following version is no longer available in the Stable channel: 1.26.5-gke.2100
(2023-R19) Version updates
- The following versions are now available in the Rapid channel:
(2023-R19) Version updates
- There are no new releases in the Regular release channel.
Ray on Vertex AI is now available in Preview
Ray is an open-source framework for scaling AI and Python applications. Ray provides the infrastructure to perform distributed computing and parallel processing for your machine learning workflow.
You can now create Ray clusters and develop your Ray applications on Vertex AI. This feature is in Preview. For more information, see Ray on Vertex AI overview.
October 04, 2023
BigQueryYou can now copy tables across regions. This feature is now in preview.
Chronicle Curated Detections has been enhanced with new detection content for Google Cloud threats. These new rule sets help identify reconnaissance and exploitation behavior from open source Kubernetes tools.
The submit_parser command now has an option to skip validation if no logs are found. For more information, see the Chronicle CLI user guide.
Dedicated Cloud Interconnect support is available in the following colocation facilities:
- CyrusOne Phoenix - Phoenix
For more information, see the Locations table.
Generally available: NVIDIA L4 GPUs are now available in the following additional regions and zones:
- Singapore(
asia-southeast1-a)
For more information about using GPUs on Compute Engine, see GPU platforms.
Confidential Space. A new image (confidential-space-230901) is now available. This image provides improved logging capabilities and increases the file descriptor limits. For more information, see the Changelog.
Log rotation is misconfigured on nodes running a COS-based image type (cos_containerd). This affects all COS-based nodes running version 1.28 or higher. As a result of this issue, your logs may fill up the disk and cause your nodes to be marked as 'Not Ready' and to be auto-repaired. As a workaround, use a privileged DaemonSet to change the logrotate path to /usr/bin/ instead of /usr/sbin/ in Systemd unit kube-logrotate.service.
Network Analyzer now includes an insight that gives a summary of the IP address utilization of all the subnet ranges. This insight is already available in Recommender API and Cloud Logging. For more information, see IP address utilization summary insights.
ABAP SDK for Google Cloud, version 1.5 is generally available (GA)
Version 1.5 of the ABAP SDK for Google Cloud is generally available (GA). This version of the SDK offers extended ABAP client libraries to build and deploy ML and AI-driven solutions using a wide range of Google Cloud services.
This SDK also enables use of the OAuth 2.0 framework to authenticate to Google Cloud APIs using OAuth 2.0 client credentials.
For more information, see What's new with the ABAP SDK for Google Cloud.
Model tuning for the textembedding-gecko model is now available in Preview
You can now use supervised fine-tuning to tune the textembedding-gecko model. This feature is in (Preview).
For more information, see Tune text embeddings.
Vertex AI Prediction
You can now use C3 machine types to serve predictions.
October 03, 2023
BigQueryThe following Google Cloud Blockchain Analytics datasets are now available in Preview and available through the Public Datasets Program and Analytics Hub:
The Chronicle SIEM user interface has a new top-level navigation to help you access the most commonly used Chronicle SIEM features. It works much the same as the navigation for Chronicle Security Operations. The new navigation menu expands from the left side of the screen, replacing the 9-dot icon at the top right. It is designed to make it easier to find information and resources and to help you work more efficiently. The Chronicle homepage can be accessed by clicking the Chronicle logo at the top left of the page. Reference lists can now be found within the Search page or the Rules Editor page.
Release 6.2.36
GA - 14th October, 2023
Internal security fixes
Oozie to Airflow tool version 2.0 is available. The new version of the tool supports Airflow 2.
Oozie to Airflow tool converts Apache Oozie workflows into Apache Airflow DAGs. For more information, see the project's page in PyPI and the oozie-to-airflow repository on GitHub.
cos-dev-113-17935-0-0
| Kernel | Docker | Containerd | GPU Drivers |
| COS-6.1.55 | v24.0.5 | v1.7.3 | v535.104.05(default),v470.199.02(R470) |
Upgraded chromeos-base/chromeos-dbus-bindings to v0.0.1-r2787.
Upgraded chromeos-base/chromeos-common-script to v0.0.1-r554.
Fixed CVE-2023-42753 in the Linux kernel.
cos-109-17800-0-47
| Kernel | Docker | Containerd | GPU Drivers |
| COS-6.1.42 | v24.0.5 | v1.7.2 | v535.104.05(default),v470.199.02(R470) |
Updated cos-gpu-installer to v2.1.9.
Fixed CVE-2023-42753 in the Linux kernel.
cos-93-16623-461-36
| Kernel | Docker | Containerd | GPU Drivers |
| COS-5.10.177 | v20.10.24 | v1.6.20 | v450.248.02(default),v470.199.02(R470),v535.104.05 |
Fixes CVE-2023-2163 in the Linux Kernel.
cos-101-17162-279-57
| Kernel | Docker | Containerd | GPU Drivers |
| COS-5.15.120 | v20.10.24 | v1.6.21 | v470.199.02(default),v535.104.05 |
Updated cos-gpu-installer to v2.1.9.
Dataplex BigLake integration is generally available (GA). Dataplex BigLake integration lets you upgrade a Cloud Storage bucket to managed, creating BigLake tables and Object tables instead of external tables. This allows the application of column-level, row-level, and table-level policies, enabling fine-grained security and dynamic data masking.
Retail Search: Facet controls
You can create facet controls that apply to search and browse operations. These help you control facets values without editing your catalog and set the ranking of facet keys.
Numerical facets have been improved: intervals are calculated but they can also be customized.
The facet controls are:
- Ignore facet values
- Replace facet values
- Set numerical intervals
- Remove facets
- Force return facets
For more information, see Facets for search.
TorchServe is used to host PyTorch machine learning models for online prediction. Vertex AI provides pre-built PyTorch model serving containers which depend on TorchServe. Vulnerabilities were recently discovered in TorchServe which would allow an attacker to take control of a TorchServe deployment if its model management API is exposed. Customers with PyTorch models deployed to Vertex AI online prediction are not affected by these vulnerabilities, since Vertex AI does not expose TorchServe's model management API. Customers using TorchServe outside of Vertex AI should take precautions to ensure their deployments are set up securely.
For more information, see the Vertex AI security bulletin.
October 02, 2023
Anthos Attached ClustersThis release includes the following Anthos attached clusters platform versions:
- 1.25.0-gke.7
- 1.26.0-gke.5
- 1.27.0-gke.2
1.25.0-gke.7, 1.26.0-gke.5, and 1.27.0-gke.1
Resolved an issue affecting EKS environments in which Kubernetes resource metrics weren't successfully scraped from the kubelet when a node's name within the cluster didn't match that same node's hostname.
1.25.0-gke.7 and 1.26.0-gke.5
This release fixes the following vulnerabilities:
- Fixed CVE-2023-24539
- Fixed CVE-2023-24540
- Fixed CVE-2023-29400
You can now launch clusters with the following Kubernetes versions. Click on the following links to see the release notes associated with these patches:
You can now launch clusters with the following Kubernetes versions. Click on the following links to see the release notes associated with these patches:
Upgrading an admin cluster with always-on secrets encryption enabled might fail.
An admin cluster upgrade from 1.14.x to 1.15.0 - 1.15.4 with always-on secrets encryption enabled might fail depending on whether the feature was enabled during cluster creation or during cluster update.
We recommend that you don't upgrade your admin cluster until a fix is available in 1.15.5. If you must upgrade to 1.15.0-1.15.4, do the steps in Preventing the upgrade failure before upgrading the cluster.
For information on working around an admin cluster failure because of this issue, see Upgrading an admin cluster with always-on secrets encryption enabled fails. Note that the workaround relies on you having the old encryption key backed up. If the old key is no longer available, you will have to recreate the admin cluster and all user clusters.
You can now use Bare Metal Solution's self-service functionality to order your resources after executing a one-time Order Form. This feature is generally available (GA). For more information, see Order Bare Metal Solution resources.
A weekly digest of client library updates from across the Cloud SDK.
Node.js
Changes for @google-cloud/bigquery
7.3.0 (2023-09-28)
Features
Bug Fixes
Java
Changes for google-cloud-bigquery
2.33.1 (2023-09-28)
Bug Fixes
2.33.0 (2023-09-27)
Features
Bug Fixes
Dependencies
- Update actions/checkout action (#2893) (e3655af)
- Update dependency com.google.cloud:google-cloud-shared-dependencies to v3.16.1 (#2892) (e1d9871)
- Update dependency org.graalvm.buildtools:junit-platform-native to v0.9.27 (#2885) (2237ca2)
- Update dependency org.graalvm.buildtools:native-maven-plugin to v0.9.27 (#2886) (539b4e6)
- Update github/codeql-action action to v2.21.4 (#2829) (599e3b3)
- Update github/codeql-action action to v2.21.8 - abandoned (#2897) (ab4e1d0)
- Update github/codeql-action action to v2.21.8 (#2889) (b568026)
- Update github/codeql-action action to v2.21.9 (#2901) (33a729f)
BigQuery native integration in Looker Studio enables monitoring features for Looker Studio queries, improves query performance, and supports many BigQuery features. This feature is in preview.
The following resource types are now publicly available through the analyze policy APIs (AnalyzeIamPolicy and AnalyzeIamPolicyLongrunning).
- Identity and Access Management
iam.googleapis.com/PolicyV2
A weekly digest of client library updates from across the Cloud SDK.
Java
Changes for google-cloud-bigtable
2.27.3 (2023-09-29)
Bug Fixes
Dependencies
A release was made. Updates may include general performance improvements, bug fixes, and updates to the API reference documentation.
A weekly digest of client library updates from across the Cloud SDK.
Java
Changes for google-cloud-logging
3.15.10 (2023-09-27)
Dependencies
Python
Changes for google-cloud-logging
3.7.0 (2023-09-25)
Features
- Add ConfigServiceV2.CreateBucketAsync method for creating Log Buckets asynchronously (30f24a8)
- Add ConfigServiceV2.CreateLink method for creating linked datasets for Log Analytics Buckets (30f24a8)
- Add ConfigServiceV2.DeleteLink method for deleting linked datasets (30f24a8)
- Add ConfigServiceV2.GetLink methods for describing linked datasets (30f24a8)
- Add ConfigServiceV2.ListLinks method for listing linked datasets (30f24a8)
- Add ConfigServiceV2.UpdateBucketAsync method for creating Log Buckets asynchronously (30f24a8)
- Add LogBucket.analytics_enabled field that specifies whether Log Bucket's Analytics features are enabled (30f24a8)
- Add LogBucket.index_configs field that contains a list of Log Bucket's indexed fields and related configuration data (30f24a8)
- Log Analytics features of the Cloud Logging API (30f24a8)
Bug Fixes
- Add async context manager return types (30f24a8)
- Add severity to structured log write (#783) (31a7f69)
- Handle exceptions raised when fetching Django request data (#758) (5ecf886)
- Unintended exception omittion (#736) (022dc54)
Documentation
The Metrics management page in Cloud Monitoring now lets you create alerting policies and charts for metrics that have no associated alerting policies or custom dashboards. For more information, see View and manage metric usage.
You can now import your Grafana dashboards into Cloud Monitoring. For more information, see Import Grafana dashboards into Cloud Monitoring.
You can now configure notifications for Google Chat spaces. For more information, see Create and manage notification channels.
For Cloud SQL Enterprise edition and Cloud SQL Enterprise Plus edition, you can restore backups across instances of different editions.
For Cloud SQL Enterprise edition and Cloud SQL Enterprise Plus edition, you can restore backups across instances of different editions.
If you use the latest preconfigured base images for JetBrains IDEs, the .vmoptions and .properties files persist across workstations. For more information, see Customize JetBrains IDE vmoptions and properties.
Dialogflow CX speech adaptation can now be configured manually.
Support root folder filtering
Filestore enterprise tier backups are now generally available.
A weekly digest of client library updates from across the Cloud SDK.
Python
Changes for google-cloud-ndb
2.2.2 (2023-09-19)
Documentation
GKE now delivers insights and recommendations if users have installed webhooks that intercept system resources or webhooks that have no available endpoints. To learn more, see Ensure control plane stability when using webhooks.
A weekly digest of client library updates from across the Cloud SDK.
Java
Changes for google-cloud-pubsub
1.125.5 (2023-09-28)
Dependencies
- Update gapic-generator-java to 2.26.0 (935849c)
1.125.4 (2023-09-28)
Dependencies
1.125.3 (2023-09-27)
Dependencies
- Update dependency com.google.cloud:google-cloud-core to v2.24.1 (#1737) (48a4432)
- Update dependency com.google.cloud:google-cloud-shared-dependencies to v3.16.1 (#1738) (e2cf7c1)
- Update dependency org.apache.avro:avro to v1.11.3 (#1740) (971b35f)
- Update dependency org.xerial.snappy:snappy-java to v1.1.10.4 security (70ba500)
- Update dependency org.xerial.snappy:snappy-java to v1.1.10.5 (#1746) (a4b1994)
Cloud Storage Backint agent for SAP HANA version 1.0.29
Version 1.0.29 of the Cloud Storage Backint agent for SAP HANA is available. This version sets the default value of the HTTP_READ_TIMEOUT parameter to -1; no timeout.
For more information about the agent, see Cloud Storage Backint agent for SAP HANA overview.
Private Service Connect service connectivity automation is available in General Availability. Service connectivity automation lets service producers automate deployment and service connectivity to eligible managed services on behalf of consumers.
Private Service Connect backends with published service targets can be added to global external TCP proxy Network Load Balancers. This feature is available in Preview.
September 30, 2023
Cloud FirewallStarting September 30, 2023, you will be charged for the Cloud Firewall Standard feature—fully qualified domain name (FQDN) objects. For more information about billing, see Cloud Firewall pricing.
VMware Engine nodes are now available in the following additional zone:
- Tel Aviv (
me-west1-b)
September 29, 2023
Access ApprovalAccess Approval supports Vertex AI Search in the Preview stage.
Access Transparency supports Vertex AI Search in the Preview stage. For the complete list of services that Access Transparency supports, see Supported services.
Anthos clusters on VMware 1.16.1-gke.45 is now available. To upgrade, see Upgrading Anthos clusters on VMware. Anthos clusters on VMware 1.16.1-gke.44 runs on Kubernetes 1.27.4-gke.1600.
The Prometheus and Grafana add-ons field, loadBalancer.vips.addonsVIP is deprecated in 1.16 and later. This change is because
Google Managed Service for Prometheus
replaced the Prometheus and Grafana add-ons in 1.16.
The following issues are fixed in 1.16.1-gke.45:
- Fixed the
known issue
that
gkectl repair admin-masterreturns kubeconfig unmarshall error. - Fixed the known issue that GARP reply sent by Seesaw doesn't set target IP
- Fixed the known issue that Seesaw VM may be broken due to low disk space
- Fixed the known issue that false warnings might be generated against persistent volume claims.
- Fixed the known issue that caused CNS
attachvolumetasks to appear every minute for in-tree PVC/PV after upgrading to Anthos 1.15+.
The following vulnerabilities are fixed in 1.16.1-gke.44:
High-severity container vulnerabilities:
Container-optimized OS vulnerabilities:
Anthos clusters on VMware 1.14.8-gke.37 is now available. To upgrade, see Upgrading Anthos clusters on VMware. Anthos clusters on VMware 1.14.8-gke.37 runs on Kubernetes 1.25.12-gke.2400.
The following issues are fixed in 1.14.8-gke.37:
- Fixed the disk full known issue on Seesaw VM due to no log rotation for fluent-bit.
The following vulnerabilities are fixed in 1.14.8-gke.37:
High-severity container vulnerabilities:
Container-optimized OS vulnerabilities:
Release 1.14.9
Anthos clusters on bare metal 1.14.9 is now available for download. To upgrade, see Upgrading Anthos on bare metal. Anthos clusters on bare metal 1.14.9 runs on Kubernetes 1.25.
Fixes:
Fixed an issue to prevent cluster upgrades from starting on a node before either all Pods have been drained or the Pod draining timeout has been reached.
Fixes:
The following container image security vulnerabilities have been fixed in version 1.14.9:
High-severity container vulnerabilities:
Medium-severity container vulnerabilities:
Low-severity container vulnerabilities:
Known issues:
For information about the latest known issues, see Anthos clusters on bare metal known issues in the Troubleshooting section.
On September 29, 2023, we released an updated version of Apigee.
New attributes for Pay-as-you-go pricing are generally available (GA).
Apigee updated its Pay-as-you-go pricing model, making it possible for customers to onboard at a significantly reduced initial cost and right-size their ongoing expenses to usage.
To learn more about the updated Pay-as-you-go pricing experience, see Pay-as-you-go (updated attributes) pricing overview.
Standard and extensible API proxies are generally available (GA).
Standard and extensible API proxies are generally available for use with Apigee organizations.
For more information about standard and extensible API proxies, see API proxy types.
HTTPModifier and ReadPropertySet policies and templating support for message
The HTTPModifier policy can change an existing request or response message and provides a subset of the functionality already available in the AssignMessage policy. See HTTPModifier policy.
The ReadPropertySet policy reads property sets and populates flow variables with the results. See ReadPropertySet policy.
HTTPModifier and ReadPropertySet are standard policies. Proxies built exclusively with standard policies are called standard proxies and can be deployed to any environment type. See Pay-as-you-go (updated attributes) pricing overview.
With this release, template support for message
New environment types are generally available (GA).
With this release, Apigee introduces three distinct environments that have access to varying degrees of Apigee capabilities and costs: Base, Intermediate, and Comprehensive.
For more information, see Apigee Pay-as-you-go environment types.
Apigee API Analytics add-on for Pay-as-you-go organizations is generally available (GA).
With this release, Apigee API Analytics is available as a paid add-on capability for Pay-as-you-go organizations. The add-on can be enabled in any Apigee Intermediate or Comprehensive environment. For more information, see Manage the Apigee API Analytics add-on.
One click provisioning for Apigee Pay-as-you-go organizations is generally available (GA).
Simplify your onboarding experience with one click provisioning for new Pay-as-you-go organizations, using smart default configurations. To learn more, see Provision Apigee with one click.
Updated pricing attributes in Subscription plans are available.
To get started with subscription plans that include new pricing attributes (consistent with Pay-as-you-go pricing), contact your Google Cloud sales specialist.
For more information, see Apigee Subscription 2024 entitlements. Apigee hybrid is not available in the new subscription plan at this time.
As a BigQuery administrator, to monitor your organization's slots utilization and BigQuery jobs' performance over time, use can now use administrative query inspector. This feature is now generally available.
Airflow triggerer is now generally available (GA).
The cost of the environments.ExecuteAirflowCommand and environments.StopAirflowCommand operations is reduced from 100 to 25 quota units.
The apache-airflow-providers-google package is upgraded to version 10.9.0 in images with Airflow 2.5.3 and 2.4.3. For more information about changes, see the apache-airflow-providers-google changelog from version 10.7.0 to version 10.9.0.
Cloud Composer 2.4.4 images are available:
- composer-2.4.4-airflow-2.5.3 (default)
- composer-2.4.4-airflow-2.4.3
Cloud Composer versions 2.0.28, 2.0.27, 1.19.11, and 1.19.10 have reached their end of full support period.
Cloud Load Balancing introduces the global external Proxy Network Load Balancer. The global external Proxy Network Load Balancer is implemented on globally distributed GFEs and supports advanced traffic management capabilities. This load balancer can be configured to handle either TCP or SSL traffic by using either a target TCP proxy or a target SSL proxy respectively. Global external proxy Network Load Balancers support backends such as instance groups, hybrid NEGs, and Private Service Connect NEGs.
Load balancers that are already deployed in the classic mode are renamed as classic Proxy Network Load Balancer in the console.
For details, see the External proxy Network Load Balancer overview.
To set up a global external Proxy Network Load Balancer, see the following pages:
This capability is in Preview.
With the launch of global external Proxy Network Load Balancer, we now support three deployment modes with the external Proxy Network Load Balancer—classic (General Availability), Regional (General Availability) and global (Preview). No changes have been made to the API.
For details, see the External proxy Network Load Balancer overview.
Typically with HTTPS communication, the authentication works only one way: the client verifies the identity of the server. For applications that require the load balancer to authenticate the identity of clients that connect to it, both a global external Application Load Balancer and a global external Application Load Balancer (classic) support mutual TLS (mTLS).
With mTLS, the load balancer requests that the client send a certificate to authenticate itself during the TLS handshake with the load balancer. You can configure a trust store that the load balancer uses to validate the client certificate's chain of trust.
For details, see the following:
- Mutual TLS authentication
- Set up mutual TLS with signed certificates
- Set up mutual TLS with a private CA
- Set up mutual TLS for a global external Application Load Balancer (classic)
- Set up mutual TLS for a global external Application Load Balancer
This capability is in General Availability.
Ops Agent versions 2.39.0 and 2.40.0 crash if you use them on Compute Engine VMs with attached GPUs. Use Ops Agent version 2.38.0, or versions 2.41.0 and newer, on VMs with attached GPUs.
Ops Agent versions 2.39.0 and 2.40.0 crash if you use them on Compute Engine VMs with attached GPUs. Use Ops Agent version 2.38.0, or versions 2.41.0 and newer, on VMs with attached GPUs.
Config Connector version 1.110.0 is now available.
Added MutatingWebhookConfigurationCustomization and ValidatingWebhookConfigurationCustomization to support the customization on webhook timeouts.
Added value validation for resource requests and limits in the customizable ControllerResource and NamespacedControllerResource CRDs.
Promoted CertificateManagerCertificate, CertificateManagerCertificateMap, CertificateManagerCertificateMapEntry and CertificateManagerDNSAuthorization from v1alpha1 to v1beta1.
Promoted RunService from alpha stability to stable stability.
- Renamed field
spec.template.containerConcurrencytospec.template.maxInstanceRequestConcurrency. - Fixed the IAM support by removing the support of "IAM conditions" on this resource.
- Removed field
status.resourceGeneration.
Resource BigQueryTable(v1beta1):
- Added
spec.tableConstraintsfield. - Added
spec.materializedView.allowNonIncrementalDefinitionfield.
Resource ComputeInstance(v1beta1):
- Added
spec.networkInterface.items.internalIpv6PrefixLengthfield. - Added
spec.networkInterface.items.ipv6Addressfield.
Resource ComputeInstanceTemplate(v1beta1):
- Added
spec.networkInterface.items.internalIpv6PrefixLengthfield. - Added
spec.networkInterface.items.ipv6Addressfield.
Resource ContainerCluster(v1beta1):
- Added
spec.enableFqdnNetworkPolicyfield. - Added
spec.nodeConfig.confidentialNodesfield.
Resource ContainerNodePool(v1beta1):
- Added
spec.nodeConfig.confidentialNodesfield.
Resource DialogflowCXFlow(v1alpha1):
- Added
spec.eventHandlers.items.triggerFulfillment.conditionalCasesfield. - Added
spec.eventHandlers.items.triggerFulfillment.setParameterActionsfield. - Added
spec.eventHandlers.items.triggerFulfillment.messages.items.channelfield. - Added
spec.eventHandlers.items.triggerFulfillment.messages.items.conversationSuccessfield. - Added
spec.eventHandlers.items.triggerFulfillment.messages.items.liveAgentHandofffield. - Added
spec.eventHandlers.items.triggerFulfillment.messages.items.outputAudioTextfield. - Added
spec.eventHandlers.items.triggerFulfillment.messages.items.payloadfield. - Added
spec.eventHandlers.items.triggerFulfillment.messages.items.playAudiofield. - Added
spec.eventHandlers.items.triggerFulfillment.messages.items.telephonyTransferCallfield. - Added
spec.transitionRoutes.items.triggerFulfillment.conditionalCasesfield. - Added
spec.transitionRoutes.items.triggerFulfillment.setParameterActionsfield. - Added
spec.transitionRoutes.items.triggerFulfillment.messages.items.channelfield. - Added
spec.transitionRoutes.items.triggerFulfillment.messages.items.conversationSuccessfield. - Added
spec.transitionRoutes.items.triggerFulfillment.messages.items.liveAgentHandofffield. - Added
spec.transitionRoutes.items.triggerFulfillment.messages.items.outputAudioTextfield. - Added
spec.transitionRoutes.items.triggerFulfillment.messages.items.payloadfield. - Added
spec.transitionRoutes.items.triggerFulfillment.messages.items.playAudiofield. - Added
spec.transitionRoutes.items.triggerFulfillment.messages.items.telephonyTransferCallfield.
Resource DialogflowCXPage(v1alpha1):
- Added
spec.entryFulfillment.conditionalCasesfield. - Added
spec.entryFulfillment.setParameterActionsfield. - Added
spec.entryFulfillment.messages.items.channelfield. - Added
spec.entryFulfillment.messages.items.conversationSuccessfield. - Added
spec.entryFulfillment.messages.items.liveAgentHandofffield. - Added
spec.entryFulfillment.messages.items.outputAudioTextfield. - Added
spec.entryFulfillment.messages.items.payloadfield. - Added
spec.entryFulfillment.messages.items.playAudiofield. - Added
spec.entryFulfillment.messages.items.telephonyTransferCallfield. - Added
spec.eventHandlers.items.triggerFulfillment.conditionalCasesfield. - Added
spec.eventHandlers.items.triggerFulfillment.setParameterActionsfield. - Added
spec.eventHandlers.items.triggerFulfillment.messages.items.channelfield. - Added
spec.eventHandlers.items.triggerFulfillment.messages.items.conversationSuccessfield. - Added
spec.eventHandlers.items.triggerFulfillment.messages.items.liveAgentHandofffield. - Added
spec.eventHandlers.items.triggerFulfillment.messages.items.outputAudioTextfield. - Added
spec.eventHandlers.items.triggerFulfillment.messages.items.payloadfield. - Added
spec.eventHandlers.items.triggerFulfillment.messages.items.playAudiofield. - Added
spec.eventHandlers.items.triggerFulfillment.messages.items.telephonyTransferCallfield. - Added
spec.form.parameters.items.defaultValuefield. - Added
spec.form.parameters.items.fillBehavior.repromptEventHandlersfield. - Added
spec.form.parameters.items.fillBehavior.initialPromptFulfillment.conditionalCasesfield. - Added
spec.form.parameters.items.fillBehavior.initialPromptFulfillment.setParameterActionsfield. - Added
spec.form.parameters.items.fillBehavior.initialPromptFulfillment.messages.items.channelfield. - Added
spec.form.parameters.items.fillBehavior.initialPromptFulfillment.messages.items.conversationSuccessfield. - Added
spec.form.parameters.items.fillBehavior.initialPromptFulfillment.messages.items.liveAgentHandofffield. - Added
spec.form.parameters.items.fillBehavior.initialPromptFulfillment.messages.items.outputAudioTextfield. - Added
spec.form.parameters.items.fillBehavior.initialPromptFulfillment.messages.items.payloadfield. - Added
spec.form.parameters.items.fillBehavior.initialPromptFulfillment.messages.items.playAudiofield. - Added
spec.form.parameters.items.fillBehavior.initialPromptFulfillment.messages.items.telephonyTransferCallfield. - Added
spec.transitionRoutes.items.triggerFulfillment.conditionalCasesfield. - Added
spec.transitionRoutes.items.triggerFulfillment.setParameterActionsfield. - Added
spec.transitionRoutes.items.triggerFulfillment.messages.items.channelfield. - Added
spec.transitionRoutes.items.triggerFulfillment.messages.items.conversationSuccessfield. - Added
spec.transitionRoutes.items.triggerFulfillment.messages.items.liveAgentHandofffield. - Added
spec.transitionRoutes.items.triggerFulfillment.messages.items.outputAudioTextfield. - Added
spec.transitionRoutes.items.triggerFulfillment.messages.items.payloadfield. - Added
spec.transitionRoutes.items.triggerFulfillment.messages.items.playAudiofield. - Added
spec.transitionRoutes.items.triggerFulfillment.messages.items.telephonyTransferCallfield.
Resource RunJob(v1beta1):
spec.template.template.volumes[].secret.items[].modeis now optional.
Resource SecretManagerSecret(v1beta1):
- Added
spec.replication.autofield.
Resource SecretManagerSecretVersion(v1beta1):
- Added
spec.deletionPolicyfield.
Resource StorageBucket(v1beta1):
spec.autoclass.enabledis now mutable.
Resource VertexAIIndexEndpoint(v1alpha1):
- Added
spec.publicEndpointEnabledfield. - Added
status.publicEndpointDomainNamefield.
Dataplex is available in the following regions:
- Delhi (
asia-south2) - Melbourne (
australia-southeast2) - Toronto (
northamerica-northeast2)
Dialogflow CX launched two new integrations in preview:
This is a follow-up message to the release note regarding blue-green upgrades from September 18, 2023. You can now resume upgrading clusters with the blue-green upgrade strategy as the issue with rollback functionality has been fixed. GKE is no longer blocking automatic upgrades due to this issue.
containsOnly() function released to General Availability.
You can now use the containsOnly() function to query findings with an array-type attribute or subfield that only contains values that match the specified filter, and no other values.
For more information, see The containsOnly function.
Vertex AI Search (Enterprise Search): Customer-managed encryption key integration
Customer-managed encryption keys (CMEK) is available as an allowlisted preview feature.
If you store your data in a US multi-region data store, you can provide your own encryption key to protect your data at rest.
For information, see Customer-managed encryption keys.
Vertex AI Search (Enterprise Search): Search tuning
Search tuning is available as an allowlisted preview feature. You provide additional training data in the form of query and segment pairs. We use this data to tune the model for your app.
For information, see Improve search results with search tuning.
Vertex AI Search (Enterprise Search): VPC Service Controls are GA
Virtual Private Cloud Service Controls support for Enterprise Search is generally available (GA).
For more information, see Supported products and limitations in the VPC Service Controls documentation. For general information about VPC Service Controls, see Overview of VPC Service Controls.
Vertex AI Search (Enterprise Search): Data location
Vertex AI Search may be configured for data location pursuant to the "Data Location" section of the Service Specific Terms.
For information about data residency in Vertex AI Search, see Enterprise Search locations.
Vertex AI Search (Enterprise Search): Support for Access Transparency
Access Transparency supports Vertex AI Search in preview.
For more information, see Enable Access Transparency in Enterprise Search.
Vertex AI Search (Enterprise Search): Citations for search with follow-ups
Citations indicate from which search results specific sentences in the summary are taken.
For more information, see Configure the summary.
Vertex AI Search (Enterprise Search): Ignore adversarial queries and non-summary seeking queries for search with follow-ups
Ignore adversarial queries can stop generation of summaries that are unsafe or violate policy.
Non-summary seeking queries stop generation of summaries that aren't helpful for some queries.
For more information, see Configure the summary.
Vertex AI Search (Enterprise Search): Additional languages supported
Search, snippets, and other features are now supported in the following languages:
- Arabic
- Chinese (Simplified)
- Greek
- Hebrew
- Japanese
- Korean
- Polish
- Russian
See Languages.
Private Service Connect backends support using an external regional TCP proxy load balancer or an internal regional TCP proxy load balancer to access published services. These features are available in General Availability.
September 28, 2023
Assured WorkloadsThe IL2 compliance program is now generally available. For a list of IL2-compliant Google Cloud products, see the Supported products page.
The following BigQuery ML point-in-time lookup functions are now in preview. These functions let you specify a point-in-time cutoff when retrieving features for training a model or running inference, in order to avoid data leakage.
- Use the
ML.FEATURES_AT_TIMEfunction to use the same point-in-time cutoff for all entities when retrieving features. - Use the
ML.ENTITY_FEATURES_AT_TIMEfunction to retrieve features from multiple points in time for multiple entities.
You can now use IAM conditions to control access to BigQuery resources. This feature is in preview.
Certificate Manager supports Mutual TLS (mTLS) authentication. This feature is generally available (GA).
You can now configure your alerting policy documentation with custom subject lines. For more information, see Configure the subject line of notifications.
The following pg_wait_sampling and rdkit flags are generally available:
pg_wait_sampling flags
- cloudsql.enable_pg_wait_sampling: enable the
pg_wait_samplingextension for Cloud SQL for PostgreSQL instances. - pg_wait_sampling.history_size: set the size of the in-memory ring buffer for history sampling, in terms of the number of samples.
- pg_wait_sampling.history_period: set the time interval for history sampling, in milliseconds.
- pg_wait_sampling.profile_period: set the time interval for profile sampling for wait events, in milliseconds.
- pg_wait_sampling.profile_pid: specify whether the wait profile that accumulates samples for each process and waits event is collected for each process or for all processes.
- pg_wait_sampling.profile_queries: specify whether the wait profile is collected for each query or for all queries.
rdkit flags
- rdkit.tanimoto_threshold: set the threshold value for the Tanimoto similarity operator.
- rdkit.dice_threshold: set the threshold value for the Dice similarity operator.
- rdkit.do_chiral_sss: specify whether stereochemistry is used in substructure matching.
- rdkit.do_enhanced_stereo_sss: specify whether enhanced stereo is used in substructure matching.
- rdkit.sss_fp_size: set the size of the fingerprint used for substructure screening, in bits.
- rdkit.morgan_fp_size: set the size of morgan fingerprints, in bits.
- rdkit.featmorgan_fp_size: set the size of featmorgan fingerprints, in bits.
- rdkit.layered_fp_size: set the size of layered fingerprints, in bits.
- rdkit.rdkit_fp_size: set the size of rdkit fingerprints, in bits.
- rdkit.hashed_torsion_fp_size: set the size of topological torsion bit vector fingerprints, in bits.
- rdkit.hashed_atompair_fp_size: set the size of atom pair bit vector fingerprints, in bits.
- rdkit.reaction_sss_fp_size: set the size of the structural chemical reaction fingerprint, in bits.
- rdkit.reaction_difference_fp_size: set the size of the difference chemical reaction fingerprint, in bits.
- rdkit.reaction_sss_fp_type: specify the type of structural chemical reaction fingerprint.
- rdkit.reaction_difference_fp_type: specify the type of difference chemical reaction fingerprint.
- rdkit.ignore_reaction_agents: specify whether agents of a chemical reaction are taken into account.
- rdkit.agent_FP_bit_ratio: specify the weight of the impact of agents contained in a chemical reaction fingerprint.
- rdkit.move_unmmapped_reactants_to_agents: specify whether unmapped reactant agents of a chemical reaction are taken into account.
- rdkit.threshold_unmapped_reactant_atoms: set the ratio of allowed unmapped reactant atoms.
- rdkit.init_reaction: specify whether the reaction is ready for use.
- rdkit.difference_FP_weight_agents: specify the weight factor for agents compared to reactants and products in reaction difference fingerprints.
- rdkit.difference_FP_weight_nonagents: specify the weight factor for reactants and products compared to agents in reaction difference fingerprints.
- rdkit.avalon_fp_size: set the size of avalon fingerprints, in bits.
Beginning Oct 30, 2023, Cloud Storage will change how it enforces egress bandwidth quotas.
- Instead of using the same default value for all projects, egress bandwidth quotas will depend on each project's history, such whether the billing account is in good standing.
- For most projects, egress bandwidth quotas will either remain unchanged or will increase.
- Once this change takes effect, you can view your project's egress bandwidth quotas in the Console.
New Dataproc on Compute Engine subminor image versions:
- 2.0.78-debian10, 2.0.78-rocky8, 2.0.78-ubuntu18
- 2.1.26-debian11, 2.1.26-rocky8, 2.1.26-ubuntu20, 2.1.26-ubuntu20-arm
Upgraded the Cloud Storage connector version to 2.2.17 in the latest 2.0 and 2.1 Dataproc on Compute Engine image versions.
Upgraded Hive version from 3.1.2 to 3.1.3 in the latest Dataproc on Compute Engine 2.0 image version.
When you create a release using the gcloud CLI version 445, 446, or 447, you might encounter an error
where gcloud requires the clouddeploy.config.get permission. To fix this issue, upgrade to gcloud CLI version 448 or greater.
After January 15, 2024, some Policy Intelligence features will only be available for customers with organization-level activations of Security Command Center. For more information, see Billing questions.
Using Policy Troubleshooter to troubleshoot deny policies is generally available.
SAP HANA Fast Restart enabled using Terraform
SAP HANA Fast Restart is enabled when you deploy SAP HANA on Google Cloud using the sap_hana or sap_hana_ha Terraform module, version 202309280828 or later. The fast restart option is enabled through the enable_fast_restart Terraform argument, which by default is set to true.
For more information, see the deployment guide for your SAP HANA scenario.
Preview stage supported for the following integration:
September 27, 2023
Apigee Advanced API SecurityOn September 27, 2023, we released an updated version of Advanced API Security.
Public preview of Advanced API Security Alerting
Advanced API Security's new alerting feature lets you create alerts for events related to API security using Google Cloud Monitoring, such as changes to your security scores or incidents involving detected API abuse. You can configure alerts to send you notifications by email or other channels when these events occur, so you can take action to counteract them.
If you need to re-enable deployments for Java 8 apps past the legacy runtime end of support date (starting January 30, 2024), you can define a new organization policy with constraints/appengine.runtimeDeploymentExemption. This policy constraint can be used before the end of support date. Learn more about enabling deployments for runtimes reaching end of support.
If you need to re-enable deployments for PHP 5.5 apps during the legacy runtime end of support period (starting January 30, 2024), you can define a new organization policy with constraints/appengine.runtimeDeploymentExemption. This policy constraint can be used before the end of support date. Learn more about enabling deployments for runtimes reaching end of support.
If you need to re-enable deployments for Python 2.7 apps during the legacy runtime end of support period (starting January 30, 2024), you can define a new organization policy with constraints/appengine.runtimeDeploymentExemption. This policy constraint can be used before the end of support date. Learn more about enabling deployments for runtimes reaching end of support.
Release Notes 6.2.35
GA - 8th October
Risk Score and Severity added
Two new information fields have been added to the Alert Details widget which appears in the Alert overview tab. These are Risk score and Severity. These values will only be populated when using the Google Chronicle SIEM connector.
Export/Import for Advanced Reports (using Looker) now supported both in the platform and using new APIs.
This enables customers to create reports on their staging environment and then import the template without the data into their production environment.
In the platform, the import is at the top of the Reports queue while the export icon is inside the actual report itself. The report file is in yaml format.
New APIs are as follows:
/api/external/v1/looker/report/import
/api/external/v1/looker/export/{report_id}
Playbook name drop-down not showing any playbook names in various Playbook actions (ID #00248732)
Placeholders located inside other placeholders not always picked up correctly (ID #00244133)
Case title says unknown (ID #00249611)
GetCaseFullDetails and GetWallActivitiesV2 API endpoints failing to return results (ID # 00243878)
You can use fully qualified domain name (FQDN) objects in firewall policy rules to filter incoming or outgoing traffic from specific domain names. This feature is available in General Availability.
Dedicated Cloud Interconnect support is available in the following colocation facilities:
- Cologix MTL10-H - Montréal
For more information, see the Locations table.
Long running jobs greater than 1 hour are at general availability (GA).
Cloud TPU now supports TensorFlow 2.14.0. For more information see the TensorFlow 2.14.0 release notes.
Creating a reservation or future reservation request by using an instance template that specifies an A2, C3, or G2 machine type causes errors or problems with consumption. For more information, see Known issues.
cos-109-17800-0-45
| Kernel | Docker | Containerd | GPU Drivers |
| COS-6.1.42 | v24.0.5 | v1.7.2 | v535.104.05(default, latest),v470.199.02(R470 for K80 compatibility) |
Promoted to stable.
New Appliance setup experience is released. Users can use the Google Cloud console to fully set up permissions for the appliance and receive the credentials.
September 26, 2023
Cloud Load BalancingRegional external HTTP(S), internal HTTP(S), and the regional internal TCP proxy load balancers now use distributed Envoy health checks instead of Google's centralized health checking mechanism. Envoy health check probes originate from the proxy-only subnet associated with the load balancer.
For more details, see the Hybrid NEG documentation: Distributed Envoy health checks.
This feature is available in General availability.
Cloud SQL supports the preview version of the enable-high-availability recommender. This service proactively generates recommendations that help you bring your important instances within SLA by providing data redundancy. This might be helpful during a zonal outage or when an instance runs out of memory. For more information, see Improve instance reliability by enabling high availability.
Cloud SQL supports the preview version of the enable-high-availability recommender. This service proactively generates recommendations that help you bring your important instances within SLA by providing data redundancy. This might be helpful during a zonal outage or when an instance runs out of memory. For more information, see Improve instance reliability by enabling high availability.
Cloud SQL supports the preview version of the enable-high-availability recommender. This service proactively generates recommendations that help you bring your important instances within SLA by providing data redundancy. This might be helpful during a zonal outage or when an instance runs out of memory. For more information, see Improve instance reliability by enabling high availability.
You can now control the mounting behavior of Cloud Storage FUSE by using a configuration file instead of global options.
Cloud Storage FUSE is now available for use on ARM64-based machines.
Preview: c3d-standard, c3d-highmem, c3d-highcpu, and c3d-standard-lssd virtual machines are available in the following regions:
- Council Bluffs, Iowa, North America,
us-central1 - Moncks Corner, South Carolina, North America,
us-east1 - Ashburn, Virginia, North America ,
us-east4 - St. Ghislain, Belgium, Europe,
europe-west1 - Eemshaven, Netherlands, Europe,
europe-west4 - Jurong West, Singapore, Asia,
asia-southeast1
See the General purpose machines document for details.
Config Controller now uses the following versions of its included products:
- Config Connector v1.109.0, release notes
cos-101-17162-279-55
| Kernel | Docker | Containerd | GPU Drivers |
| COS-5.15.120 | v20.10.24 | v1.6.21 | v470.199.02(default),v535.104.05 |
Fixed an issue where IPv6 networking would fail under high CPU load.
Upgraded go from 1.19.13 to 1.20.8. This also required upgrading dev-go/go-tools to 0.3.0. Fixed CVE-2023-39318 and CVE-2023-39319.
Fixed CVE-2023-40217 in the dev-lang/python package.
Fixed CVE-2023-4921 in the Linux kernel.
Fixed CVE-2023-4569 in the Linux kernel
Fixed CVE-2023-4623 in the Linux kernel.
Fixed CVE-2023-4622 in the Linux kernel.
cos-beta-109-17800-0-45
| Kernel | Docker | Containerd | GPU Drivers |
| COS-6.1.42 | v24.0.5 | v1.7.2 | v535.104.05(default),v470.199.02(R470) |
Fixed an issue where IPv6 networking would fail under high CPU load.
Fixed CVE-2023-40217 in the dev-lang/python package.
Updated dev-lang/go to 1.21.1. This fixes CVE-2023-39318 and CVE-2023-39319.
Fixed CVE-2023-4921 in the Linux kernel.
Fixed CVE-2023-4569 in the Linux kernel.
cos-dev-113-17927-0-0
| Kernel | Docker | Containerd | GPU Drivers |
| COS-6.1.52 | v24.0.5 | v1.7.3 | v535.104.05(default, latest),v470.199.02(R470 for K80 compatibility) |
Fixed CVE-2023-32636, CVE-2023-29499, CVE-2023-32643, CVE-2023-32665, CVE-2023-32611 in glib and glib-utils.
Fixed CVE-2023-40217 in the dev-lang/python package.
Updated dev-lang/go to 1.21.1. This fixes CVE-2023-39318 CVE-2023-39319, CVE-2023-39320, CVE-2023-39321, and CVE-2023-39322.
Fixed CVE-2023-4921 in the Linux Kernel.
cos-105-17412-156-63
| Kernel | Docker | Containerd | GPU Drivers |
| COS-5.15.120 | v23.0.3 | v1.7.2 | v470.199.02(default),v535.104.05 |
Fixed CVE-2023-40217 in the dev-lang/python package.
Fixed CVE-2023-4921 in the Linux kernel.
Fixed CVE-2023-4569 in the Linux kernel.
Fixed CVE-2023-4623 in the Linux kernel.
cos-93-16623-461-35
| Kernel | Docker | Containerd | GPU Drivers |
| COS-5.10.177 | v20.10.24 | v1.6.20 | v450.248.02(default),v470.199.02(R470),v535.104.05 |
Fixed CVE-2023-4921 in the Linux kernel.
Fixed CVE-2023-4623 in the Linux kernel.
Fixed CVE-2023-4622 in the Linux kernel.
cos-97-16919-353-50
| Kernel | Docker | Containerd | GPU Drivers |
| COS-5.10.186 | v20.10.24 | v1.6.21 | v470.199.02(default),v535.104.05 |
Fixed an issue where IPv6 networking would fail under high CPU load.
Fixed CVE-2023-4921 in the Linux kernel.
Fixed CVE-2023-4623 in the Linux kernel.
Preview: Migrate to Virtual Machines lets you migrate the disks of source virtual machine (VM) instances to Persistent Disk volumes on Google Cloud with the following options:
- Migrate the Persistent Disk volumes without attaching them to a VM instance
- Create a new VM instance and attach the migrated Persistent Disk volumes to it
September 25, 2023
Advisory NotificationsAdvisory Notifications lets you opt in to or out of optional notification types. For more information, see Opt in to or out of notifications.
Release 1.15.5
Anthos clusters on bare metal 1.15.5 is now available for download. To upgrade, see Upgrading Anthos on bare metal. Anthos clusters on bare metal 1.15.5 runs on Kubernetes 1.26.
Fixed an issue to prevent cluster upgrades from starting on a node before either all Pods have been drained or the Pod draining timeout has been reached.
The following container image security vulnerabilities have been fixed in 1.15.5:
High-severity container vulnerabilities:
Medium-severity container vulnerabilities:
Known issues:
For information about the latest known issues, see Anthos clusters on bare metal known issues in the Troubleshooting section.
On September 25, 2023 we release an updated version of Advanced API Security.
If a flow hook contains any FlowCallout policies, Advanced API Security scores now processes all policies from the shared flows that the flow callouts are pointing to for scoring. Further callout chaining is not supported.
| Bug ID | Description |
|---|---|
| 300849647 | Fixed a bug in Security scores for proxies that don't contain any policies in the categories authorization, mediation, threat or CORS . |
On September 25, 2023, we released an updated version of the Apigee UI.
This release includes a new Overview page for Apigee API Management in the Google Cloud console.
From the Overview page, you can:
- Get started as a new Apigee user
- Test your Apigee runtime
- View key resource usage metrics
- Explore Apigee API management features
For more information, see UI overview.
Materialized views over BigLake metadata cache-enabled tables can reference structured data stored in Cloud Storage. These materialized views function like materialized views over BigQuery-managed storage tables, including the benefits of automatic refresh and smart tuning. This feature is now generally available (GA).
Authorized stored procedures are now generally available (GA). This feature lets you share stored procedures with users or groups without giving them direct access to the underlying tables.
Support for Google AdWords is now deprecated by the BigQuery Data Transfer Service. For information about transfers from Google Ads, see Google Ads transfers.
A weekly digest of client library updates from across the Cloud SDK.
All Cloud SQL for MySQL Enterprise Plus edition instances now support up to 35 days of retained transaction logs for point-in-time recovery.
The rollout of the following minor version is currently underway:
MySQL 5.7.42 is upgraded to MySQL 5.7.43. For more information, see MySQL 5.7 Release Notes.
If you use a maintenance window, then the updates to the minor versions happen according to the timeframe that you set in the window. Otherwise, the updates occur within the next few weeks.
The new maintenance version is [MySQL version].R20230909.02_00. The details of the security fixes applied as part of this release will be published in the MySQL maintenance changelog.
To learn how to check your maintenance version, see Self-service maintenance. To find your maintenance window or to manage maintenance updates, see Find and set maintenance windows.
A monthly digest of client library updates from across the Cloud SDK.
Java
Changes for google-cloud-spanner
6.46.0 (2023-09-06)
Features
- Add support for databoost (#2505) (dd3e9a0)
- Support PostgreSQL for autoConfigEmulator (#2601) (fbf1df9)
Bug Fixes
Documentation
6.47.0 (2023-09-12)
Features
- Add devcontainers for enabling github codespaces usage. (#2605) (a7d60f1)
- Disable dynamic code loading properties by default (#2606) (d855ebb)
Bug Fixes
- Add reflection configurations for com.google.rpc classes (#2617) (c42460a)
- Avoid unbalanced session pool creation (#2442) (db751ce)
Dependencies
Node.js
Changes for @google-cloud/spanner
7.0.0 (2023-08-30)
⚠ BREAKING CHANGES
- upgrade to Node 14 (#1890)
Bug Fixes
Miscellaneous Chores
External Authentication/Single Sign On (SSO) has been removed from the CCAI Platform Portal and are now available in the CCAI Platform Console. For details, see the Create a CCAI Platform instance documentation.
Mobile release 2.2
iOS and Android SDK content cards: You can use content cards to deliver specific messages to end-users during virtual agent chats. Content cards have customizable components including titles, text, carousel messages, banners, and much more. You can also embed a link that the end-user accesses when they click on the card. For example, if you have a list of restaurant options, you might create a content card for each one with a deep link that brings the user to the restaurant's website when they click.
iOS SDK, improved accessibility: The mobile iOS SDK now fulfills the following Web Content Accessibility Guidelines (WCAG) criteria for improved accessibility:
- Identify Input Purpose: Ensure that each input field is programmatically determinable, allowing users to autofill inputs.
- Identify Purpose: Ensure that the purpose of many elements on a page can be programmatically determined, making it easier for agents to extract and present the purpose to users using different modalities.
- Parsing: Ensure that there are no major code errors that affect accessibility so that agents can accurately interpret and parse content using assistive technologies.
- Name, Role, Value: Ensure that assistive technologies can gather information about, activate (or set), and keep up to date on the status of user interface controls in the content.
- Status Messages: Ensure that users of assistive technologies are notified when content is updated dynamically without receiving visual focus.
Mobile bug fixes:
- Fixed an intermittent issue where quick reply buttons could be pressed outside their boundaries.
- Fixed an issue where a virtual agent's avatar icon sometimes was not displayed alongside their message.
ServiceNow enhanced capabilities: This release brings new capabilities to the ServiceNow integration, including support for:
- Default User: Reduced admin permission requirements.
- More flexible field mapping and property assignment configuration options.
- Support for new CRM features:
- Surveys
- Agent Status inheritance
- Custom Callback number
- Improved support for OAuth authentication, for example now including admin tokens.
Assign virtual agent transfers to the top-level queue: You can now assign a virtual agent to transfer to a top-level queue. The virtual agent will navigate consumers through any active sub and leaf queue options. If a top-level queue has no available leaf queues or is incorrectly configured, the IVR fallback will redirect the caller to the previous queue (if human agents are available) or provide an error message before disconnecting (if the top-level queue has no available agents).To enable this feature:
- Enter the top-level queue ID in the Dialogflow destination (you can find parent queue IDs in the Virtual Agent queue menu settings).
- Ensure all sub and leaf queues are active.
Chat API suite: A new set of APIs are now available that allow you to customize your chat experience. As a part of this feature, webhooks are available for receiving notifications about events that occur during the chat interaction. You can enable and manage them in Developer Settings > Webhooks. The new chat endpoints allow you to:
- Create a chat, send and receive plain text messages, and end the chat with both agents and virtual agents.
- Exchange messages with media attachments such as pictures, videos, and documents.
Apps API: Change agent status: Two new endpoints are now available to manage agent statuses:
GET /apps/api/v1/agent_statuses: Retrieve current agent statuses.POST /apps/api/v1/agent_statuses: Update/change an agent status.
These endpoints allow you to modify agent statuses. You can change an agent's status from Available to any custom status and vice versa. Attempting to change an agent's status to a system status, such as In-Call, will result in an error. Similarly, attempting to change an agent's status from any system status will prompt an error message.
These endpoints support bulk status updates, allowing you to update statuses for an entire team or selected agents simultaneously.
NICE QM integration: CCAI Platform now supports an out-of-the-box data export for NICE QM. You can enable this feature in Developer Settings > Session Data Export > NICE Integration. The following information is required to enable the NICE QM data export:
- NICE API Endpoint
- API Authentication credentials
After the integration is enabled, you can enable session data related to IVR call events and agent login/logout events in your NICE integration.
Missed chat / Unresponsive status (while in-chat): Improved handling of agent statuses when a session cast to an agent fails due to network issues.
- When a chat/call is cast to an agent but fails due to network or permission issues, the agent's next status will be moved to
Unresponsiveregardless of the status they're currently in. - If a call/chat is cast to an agent but the agent fails to pick up, the agent's next status will be moved to
Missed Chatstatus regardless of the status they're currently in.
ANI retention management: You can now enable ANI storage by contacting Support.
Permission for access to call recording/chat transcript files: A new role permission allows you to define whether users can have access to call recordings and/or chat transcripts when they are stored in external storage and without a CRM. When inactive, users won't be able to access these files from either the Completed Calls or Chats monitoring pages or associated downloadable reports. Shared links to these files fall under the same permissions.
Disable Whatsapp for CCAI Platform: The Whatsapp flag for CCAI Platform is disabled until we have OEM compatibility for Whatsapp.
CRM record autoload: A new setting is available to automatically update the CRM when an agent navigates between multiple active chats. This eliminates the need for the agent to manually search and load the corresponding CRM record each time they switch between chats. To enable this setting, go to Settings > Chat > Global Settings > Global Chat Settings and select the following checkbox: Automatically load CRM Record when switching between chat tabs.
POST events, chat message events: Two new events added to the existing agent chat adapter events:
- Chat Inbound Message: Event indicating that a new consumer message was received; includes the message content.
- Chat Outbound Message: Event indicating that a new agent message was sent; includes the message content.
Restrict international calling by area code, short code, phone number: The international calling configuration now includes the option to limit calls by area code, short code, and phone number. You can extend this configuration to a specific agent or have it applied as a rule to all agents.
MS Dynamics, object type Contact: You can now populate different fields on a "Case" object, when a "Contact" Object Type is used. The default action within MS Dynamics is to fill in the customer information only when a Case is created. This updated setting allows the contact field to be populated with the customer information from a Contact object at the same time. To enable this feature navigate to Developer Settings to access your MS Dynamics configuration. In the Account Lookup settings, select Contact under Object Type.
Call settings, post-call session transfers: You can now set up a cold transfer to a virtual agent at the end of a call. This configuration allows you to set up an automated workflow, such as a post-call survey. To enable this feature, go to Settings > Call Settings and toggle the Post-call session transfers to ON.
New permissions added to historical reports: You can now limit access to assigned teams only or assigned queues only. For example, if you apply the assigned teams only permission option, only data for agents on that user's team(s) will be downloaded. There is also a new permission that allows Admins to manage who has access to the Session Data report, in addition the assigned team only permission.
Fixed an issue that occasionally caused the Queue Structure Edit page to jump places.
Fixed an issue where a holiday was not respected by queues if it was configured to be observed on the last occurrence of the month.
Dialogflow CX now provides the call companion feature in preview, which provides a mobile-based user interface that supplements a phone call with an agent.
We are launching an RC version of the pretrained-invoice-v1.5-2023-09-15 invoice processor. It includes:
- Improved base-entity extraction model for documents in English.
- Line-item grouping quality improvements.
- Better support for multi-line, multi-segment entities such as addresses and line-item descriptions.
- Enforcement of occurrence type
OPTIONAL_ONCE/REQUIRED_ONCEfor properties of nested entities. - Updated OCR engine.
Add the doc_ai_document_type and doc_ai_document_path fields to the Pipeline API Cloud Function request.
Support "store_document_metadata_only" boolean flag in the Pipeline API Cloud Function response.
Your Customer Insights reports contain a new field, transaction_type. For more details, see the field's documentation.
A weekly digest of client library updates from across the Cloud SDK.
Node.js
Changes for @google-cloud/pubsub
3.7.5 (2023-09-20)
Bug Fixes
Java
Changes for google-cloud-pubsub
1.125.2 (2023-09-18)
Dependencies
Vertex AI Workbench instances are now generally available (GA). Vertex AI Workbench instances combine features from managed notebooks and user-managed notebooks to provide a robust data science solution. Supported features include:
- Idle timeout
- BigQuery and Cloud Storage integrations
- End-user and service account authentication
- VPC Service Controls
- Customer managed encryption keys (CMEK) and Cloud External Key Manager (Cloud EKM)
- Health status monitoring
- Scheduled notebook runs
- Dataproc integration
To get started, see Introduction to Vertex AI Workbench instances.
September 22, 2023
Apigee IntegrationVertex AI - Predict task
Starting with this release, Apigee Integration provides the Vertex AI - Predict task that lets you perform online predictions on your ML models.
Vertex AI - Predict task
Starting with this release, Application Integration provides the Vertex AI - Predict task that lets you perform online predictions on your ML models.
The CJIS compliance program now supports the following products. See Supported products for more information:
- Cloud Run
- Cloud Identity
- Google Workspace Admin Console
You can now view the pod for your Bare Metal Solution servers, networks, volumes, and NFS Shares. This feature is generally available (GA).
Preview: Compute Engine API now enforces the Filtered list cost overhead quota, which limits the number of resources to be filtered out from server-side *.list and *.aggregatedList methods.
The quota is charged against the following metrics:
- Global:
compute.googleapis.com/filtered_list_cost_overhead - Regional:
compute.googleapis.com/filtered_list_cost_overhead_per_region
For more information, see Rate quotas and best practices for list filtering.
Preview: You can now view the organization-wide patch status dashboard and OS policy compliance reports by using VM Manager.
The Google Cloud console labels for OS patch management and OS configuration management on VM Manager pages have been renamed to Patch and OS policies respectively.
New Dataproc on Compute Engine subminor image versions:
- 2.0.77-debian10, 2.0.77-rocky8, 2.0.77-ubuntu18
- 2.1.25-debian11, 2.1.25-rocky8, 2.1.25-ubuntu20, 2.1.25-ubuntu20-arm
New Dataproc Serverless for Spark runtime versions:
- 1.1.32
- 2.0.40
- 2.1.19
In the latest Dataproc on Compute Engine 2.0 and 2.1 image versions, unset the CLOUDSDK_PYTHON variable to allow the gcloud command-line tool to use its bundled Python interpreter.
Fixed Jupyter notebooks bug that made Scala compilation errors invisible with the Toree kernel in Dataproc on Compute Engine 2.1 images.
Tag key and value short names can now have a maximum length of 256 characters. For more information, see Tags overview.
Vertex AI Search (Enterprise Search): Third-party data connectors
You can set up your Vertex AI Search data stores to sync with data from Jira, Confluence, or Salesforce.
This feature is in private preview. To try this feature, contact your Google account team to find out if you qualify.
For more about setting up a connection to third-party data, see Create an Enterprise Search data store.
September 21, 2023
AlloyDB for PostgreSQLAlloyDB now offers basic instances, which are primary instances containing only one node, in one zone. Basic instances provide a lower-cost alternative to highly available instances, and are appropriate for use in non-production environments that don't require high availability.
Database server compatibility with PostgreSQL version 15 is now available in Preview. You can create a cluster with PostgreSQL 15 compatibility.
Supported configuring the period that Config Sync waits before re-pulling the latest chart with the field spec.helm.period in RootSync or RepoSync. The default is 1 hour. For more information, see RootSync and RepoSync fields.
Fixed an issue related to metric labels commit and type that could cause an increase in Google Cloud Monitoring metric write throughput. The issue was resolved by preventing high-cardinality labels commit and type from being sent to Google Cloud Monitoring. The two labels were introduced in Anthos Config Management version 1.15.0. For information on the labels, see Config Sync Metric Labels.
Fixed a repeating error in the otel-collector deployment log that has been occuring since Anthos Config Management version 1.15.0.
The constraint template library's K8sRestrictRbacSubjects template now returns all violation messages for ClusterRoleBinding or RoleBinding with more than one violation. For reference, see Constraint template library.
Release 1.16.1
Anthos clusters on bare metal 1.16.1 is now available for download. To upgrade, see Upgrading Anthos on bare metal. Anthos clusters on bare metal 1.16 runs on Kubernetes 1.27.
Supported node pool versions:
If you use selective worker node pool upgrades to upgrade a cluster to version 1.16.1, the following versions are supported for the worker node pools:
|
|
Functionality changes:
Added the optional
userClaimfield to the ClientConfig custom resource definition bundled with Anthos clusters on bare metal. This change improves support for Azure AD integrations with Anthos Identity Service.Updated constraint on NodePool
spec.upgradeStrategy.concurrentNodesto be the smaller of either 15 nodes or 50% of the size of the node pool.
Fixes:
Fixed an issue where etcd blocked upgrades due to an incorrect initial-cluster-state.
Fixed an issue that blocked upgrades to version 1.16 for clusters that have secure computing mode (
seccomp) disabled.Fixed an issue to prevent cluster upgrades from starting on a node before either all Pods have been drained or the Pod draining timeout has been reached.
Fixed an issue where the memory resource requests value wasn't set properly for
etcd-events.
Fixes:
The following container image security vulnerabilities have been fixed in 1.16.1:
Critical container vulnerabilities:
High-severity container vulnerabilities:
Medium-severity container vulnerabilities:
Known issues:
For information about the latest known issues, see Anthos clusters on bare metal known issues in the Troubleshooting section.
On September 21, 2023 Blockchain Node Engine released a limited preview version of the software. This release adds the Polygon blockchain node option. Access to the user interface and APIs is limited to specific customers until the GA release.
Cloud Run integrations (Preview) are now available in the following regions:
asia-northeast1asia-northeast2asia-south1asia-southeast2australia-southeast1europe-central2europe-north1europe-west2europe-west3northamerica-northeast1southamerica-east1us-east4us-west2us-west3
The rollout of the oracle_fdw extension, version 1.2 is underway. This extension provides a foreign data wrapper for accessing Oracle databases easily and efficiently. For more information, see Configure PostgreSQL extensions.
The rollout of the following minor versions, extension versions, and plugin versions is underway:
Minor versions
- 11.19 is upgraded to 11.21.
- 12.14 is upgraded to 12.16.
- 13.10 is upgraded to 13.12.
- 14.7 is upgraded to 14.9.
- 15.2 is upgraded to 15.4.
Extension and plugin versions
- orafce is upgraded from 3.24.4 to 3.25.1.
- pglogical is upgraded from 2.4.2 to 2.4.3.
- pgvector is upgraded from 0.4.2 to 0.5.0.
- PostGIS is upgraded from 3.2.3 to 3.2.5.
If you use a maintenance window, then the updates to the minor, extension, and plugin versions happen according to the timeframe that you set in the window. Otherwise, the updates occur within the next few weeks.
The new maintenance version is [PostgreSQL version].R20230830.01_00. To learn how to check your maintenance version, see Self service maintenance. To find your maintenance window or to manage maintenance updates, see Find and set maintenance windows.
Generally available: Instance templates are available as both regional and global resources. To reduce cross-region dependency or to achieve data residency, use a regional instance template to create virtual machines (VM), managed instance groups (MIG), or reservations. For more information, see Regional and global instance templates.
Generally available: Autohealing in managed instance groups (MIG) supports regional health checks. To reduce cross-region dependency or to achieve data residency, use a regional health check. For more information, see Set up an application health check and autohealing.
Launched Document AI Enterprise Document OCR v2.0 and OCR add ons in Preview.
Enterprise Document OCR launched a Release Candidate, pretrained-ocr-v2.0-2023-06-02, which includes:
- Upgraded OCR model, optimized for various document use cases.
- Visual-element detector for boxed characters, which can increase quality up to 10% for documents with text boxes.
For more details, see the documentation, including the user guide.
OCR add ons are available from the Enterprise Document OCR processor when using pretrained-ocr-v2.0-2023-06-02. These include:
- Checkbox extraction: Detects and extracts status (marked/unmarked) in the Enterprise Document OCR response.
- Math OCR: Identifies, recognizes, and extracts formulas from documents in LaTeX output format.
- Font-style detection: Identifies word-level font properties, including type, style, handwriting, weight, and color.
For more details, see the documentation.
The Observability dashboards on the GKE Clusters List, Cluster Details, and Workload List pages are now customizable. Additionally, the Cluster Details dashboards can be customized across the entire project, or per-cluster for specific use cases.
When you create a LoadBalancer service in GKE, the Google Cloud controllers automatically create the following firewall rules and apply them to the GKE nodes to allow inbound connections on the Service port:
- Internal load balancer with GKE subsetting or external load balancer with regional backend services (RBS):
k8s2-[cluster-id]-[namespace]-[service-name]-[suffixhash] - Internal load balancer without GKE subsetting or external load balancer with target pool:
k8s-fw-[loadbalancer-hash]
For clusters running version 1.25 or later, these rules now include the load balancer IP address in the destination ranges field to further control the inbound connections to the nodes. You can use the gcloud compute firewall-rules describe command to check a relevant firewall. The new field in the output is similar to the following:
destinationRanges:
- [LOADBALANCER_VIRTUAL_IP_ADDRESS]
For services that use externalIP, ensure you have firewall rules that allow traffic to the specified IP addresses.
Time-based one-time password (TOTP) as an additional multi-factor authentication option is generally available (GA).
Google Cloud's Agent for SAP version 2.6
Version 2.6 of Google Cloud's Agent for SAP is generally available (GA). This version introduces new options to configure the collection of Process monitoring metrics, and bug fixes for the collection of Workload Manager validation metrics.
For more information, see What's new with Google Cloud's Agent for SAP.
September 20, 2023
Apigee IntegrationApplication Integration is now available for your Google Cloud project. You can now use both Apigee Integration and Application Integration within the same Google Cloud project. For more information, see Using Application Integration.
The maximum number of rows for results returned in Connected Sheets has increased as follows:
- Pivot tables increased from 30,000 to 50,000 rows
- Data extracts increased from 25,000 to 50,000 rows
The following supported default parsers have changed. Each is listed by product name and log_type value, if applicable.
- Akamai Cloud Monitor (
AKAMAI_CLOUD_MONITOR) - AWS Cloudtrail (
AWS_CLOUDTRAIL) - AWS WAF (
AWS_WAF) - BIND (
BIND_DNS) - Cisco Email Security (
CISCO_EMAIL_SECURITY) - Cisco Firepower NGFW (
CISCO_FIREPOWER_FIREWALL) - Cisco Umbrella Web Proxy (
UMBRELLA_WEBPROXY) - Cloud DNS (
N/A) - Cloud SQL (
GCP_CLOUDSQL) - CSV Custom IOC (
CSV_CUSTOM_IOC) - Desynova Contido (
DESYNOVA_CONTIDO) - Elastic Windows Event Log Beats (
ELASTIC_WINLOGBEAT) - F5 Advanced Firewall Management (
F5_AFM) - Firewall Rule Logging (
N/A) - FortiMail Email Security (
FORTINET_FORTIMAIL) - GCP_KUBERNETES_CONTEXT (
GCP_KUBERNETES_CONTEXT) - Guardicore Centra (
GUARDICORE_CENTRA) - IBM Security Access Manager (
IBM_SAM) - Jamf Protect Telemetry (
JAMF_TELEMETRY) - Linux Auditing System (AuditD) (
AUDITD) - Microsoft Azure Activity (
AZURE_ACTIVITY) - Microsoft Graph API Alerts (
MICROSOFT_GRAPH_ALERT) - Microsoft Powershell (
POWERSHELL) - Netskope Web Proxy (
NETSKOPE_WEBPROXY) - Office 365 (
OFFICE_365) - Oracle Unified Directory (
ORACLE_OUD) - Palo Alto Networks Firewall (
PAN_FIREWALL) - SecureLink (
SECURELINK) - Signal Sciences WAF (
SIGNAL_SCIENCES_WAF) - Skybox Firewall Assurance (
SKYBOX_FIREWALL_ASSURANCE) - SOTI MobiControl (
SOTI_MOBICONTROL) - Stealthbits PAM (
STEALTHBITS_PAM) - Thinkst Canary (
THINKST_CANARY) - Unix system (
NIX_SYSTEM) - Vectra Stream (
VECTRA_STREAM) - VMware NSX (
VMWARE_NSX) - VMware Tanzu Kubernetes Grid (
VMWARE_TANZU) - Windows Defender ATP (
WINDOWS_DEFENDER_ATP) - Windows Event (XML) (
WINEVTLOG_XML) - Workspace Activities (
WORKSPACE_ACTIVITY) - Zscaler (
ZSCALER_WEBPROXY) - Zscaler CASB (
ZSCALER_CASB) - ZScaler NGFW (
ZSCALER_FIREWALL)
For details about changes in each parser, see Supported default parsers.
A release was made. Updates may include general performance improvements, bug fixes, and updates to the API reference documentation.
The gcloud CLI now supports setting a user-defined prefix for naming temporary components of a parallel composite upload.
cos-105-17412-156-59
| Kernel | Docker | Containerd | GPU Drivers |
| COS-5.15.120 | v23.0.3 | v1.7.2 | v470.199.02(default),v535.104.05 |
Fixed an issue where IPv6 networking would fail under high CPU load.
Secret Manager is now available in the following region:
- me-central2
For more information, see Secret Manager locations.
Attack path simulations support additional resources
The attack path simulation feature that generates attack exposure scores and attack paths for your high-value resources now supports the following additional Google Cloud resources:
aiplatform.googleapis.com/Datasetaiplatform.googleapis.com/Featurestoreaiplatform.googleapis.com/MetadataStoreaiplatform.googleapis.com/Modelaiplatform.googleapis.com/TrainingPipelinecontainer.googleapis.com/Cluster
For more information, see Resource types supported in high-value resource sets.
Cloud SQL and Cloud Bigtable support Impacted relevance.
Manually refresh your web pages
Call the recrawlUris method to manually refresh specific web pages in a data store with Advanced website indexing turned on. You can check the status of the recrawl operation by polling the operations.get method.
September 19, 2023
Apigee UIOn September 19, 2023, we released an updated version of the Apigee UI.
GA release of the Apigee UI in Cloud console
This is the GA release of the Apigee UI in Cloud console, a new version of the Apigee UI that is integrated with the Google Cloud console. The new UI makes it easier to use Apigee, while also performing related tasks in the Cloud console.
On September 19, 2023, we released an updated version of Apigee X (1-11-0-apigee-5).
| Bug ID | Description |
|---|---|
| 296296456 | Implemented fix to ensure that continueOnError is honored in the SpikeArest policy. |
| 229615887 | The flow variable target.scheme is now set consistently with the target server URL. |
| 78106145 | Fixed issue in the RegularExpressionProtection policy to ensure that multiple JSONPaths elements in a JSON payload are checked. |
| 294090782 | Implemented fix to allow the Apigee runtime to connect to a target server using a wildcard CNAME that references a wildcard A record. |
| 285592278 | Fixed issue with deduction of recurring fees from prepaid balances. |
| N/A | Upgraded infrastructure and libraries. |
| Bug ID | Description |
|---|---|
| 296506425, 295936113, 295925991, 295688738, 296110120, 281112632 | Security fix for apigee-runtime. This addresses the following vulnerabilities: |
| 287218068 | Fixed security vulnerability to prevent header injection using flow variables. |
Artifact Registry is now available in the me-central2 region (Dammam, Saudi Arabia).
Documentation has been updated to reflect new default options for jobs that use GPUs:
- Defining the machine type of the job's VMs is optional.
- Jobs that use software from June 3, 2023 and later don't need to mount GPUs to containers.
For more information, see Create and run a job that uses GPUs.
Chronicle feed management contains the following changes for the Google Cloud Storage source type:
- To create a new Google Cloud Storage feed, you must use the new service account. You are no longer required to use the following Chronicle global service account:
8911409095528497-0-account@partnercontent.gserviceaccount.com. The Chronicle global service account continues to be in use for existing Google Cloud Storage feeds. - In the feed management API, the fetchFeedServiceAccount method has been added to get a Chronicle service account, which you must use when you create a new Google Cloud Storage feed.
- In the feed management UI, the new field Get service account has been added to get a Chronicle service account, which you must use when you create a new Google Cloud Storage feed.
Chronicle recently disclosed a security vulnerability. For more information, see the GCP-2023-028 security bulletin.
Welcome to Chronicle Security Operations (SecOps), a Google Cloud service built as a specialized layer on top of Google's core infrastructure, designed for enterprises to privately retain, analyze, and search petabytes of security and network telemetry.
The SecOps platform provides instant context about suspicious and malicious activity. It can be used to detect threats, investigate the scope and cause of those threats, and provide remediation using pre-built integrations with enterprise workflow, response, and orchestration platforms.
The SecOps platform fuses key capabilities of Security Information and Event Management (SIEM), Security Orchestration, Automation, and Response (SOAR) and Threat Intelligence from Google Cloud, VirusTotal, and Mandiant.
The Chronicle SecOps platform enables security analysts to analyze and mitigate a security threat throughout its lifecycle by employing the following capabilities:
Collection: Data is ingested into the platform using software forwarders, parsers, connectors, and webhooks.
Detection: This data is aggregated, normalized using the Universal Data Model (UDM), and linked to detections and threat intelligence.
Investigation: Threats are investigated through case management, search, collaboration, and contextual mapping.
Response: Security analysts can respond quickly and provide resolutions using automated playbooks, incident management, and closed-loop feedback.
The following resource types are now publicly available through the analyze policy APIs (AnalyzeIamPolicy and AnalyzeIamPolicyLongrunning).
Cloud Tasks
cloudtasks.googleapis.com/Queue
Organization Policy
orgpolicy.googleapis.com/CustomConstraint
Cloud Bigtable is available in the me-central2 (Dammam) region. For more information, see Bigtable locations.
Sensitive Data Protection is available in me-central2 (Dammam). For more information, see Sensitive Data Protection locations.
The following new region is now available: me-central2.
Support for me-central2 (Dammam) region.
Support for me-central2 (Dammam) region.
Support for me-central2 (Dammam) region.
You can create Cloud Spanner regional instances in Dammam, Saudi Arabia (me-central2).
Cloud Storage is now available in Dammam, Saudi Arabia (me-central2 region).
Cloud VPN is now available in region me-central2 (Dammam, Saudi Arabia).
Pricing is available on the Cloud VPN pricing page.
Generally available: Dammam, Kingdom of Saudi Arabia, Middle East me-central2-a,b,c has launched with E2, N2, N2D, and T2D VMs in all three zones. See the Dammam region access document to learn more.
cos-105-17412-156-57
| Kernel | Docker | Containerd | GPU Drivers |
| COS-5.15.120 | v23.0.3 | v1.7.2 | v470.199.02(default),v535.104.05 |
Updated cos-gpu-installer to v2.1.8.
Fixed CVE-2023-4015, CVE-2023-4622 in the linux kernel.
Data Catalog is available in the me-central2 (Dammam) region.
For more information, see Regions.
Dataflow is now available in Dammam, Saudi Arabia (me-central2).
Dataproc is now available in the me-central2 region (Dammam, Saudi Arabia).
Dialogflow CX intent import/export and training phrase import/export are now generally available.
Cloud Deploy now supports workforce identity federation.
The me-central2 region in Dammam, Saudi Arabia is now available.
Added new Memorystore for Memcached region: Dammam (me-central2).
The Version Upgrade feature is now Generally Available on Memorystore for Memcached.
Added new Memorystore for Redis region: Dammam (me-central2).
The issue that you cannot get the status of a long-running operation for a spoke without the networkconnectivity.operations.get IAM permission in the spoke project is now resolved.
The new API and gcloud commands are documented on the Review proposed VPC spokes page. The previous API methods and gcloud commands are now deprecated.
Pub/Sub is now available in Dammam, Saudi Arabia (me-central2).
A weekly digest of client library updates from across the Cloud SDK.
Node.js
Changes for @google-cloud/pubsub
4.0.6 (2023-09-15)
Bug Fixes
- Bump the minimum gax up to 4.0.4 to get grpc-js fixes (#1829) (cc86e2b)
- deps: Update dependency @opentelemetry/semantic-conventions to ~1.17.0 (#1824) (679c6b8)
3.7.4 (2023-09-08)
Bug Fixes
- Always fill the topic and sub names when creating from a PubSub object (#1816) (ddf8b8a)
- Make retry policy back off more aggressively for RPCs that retry RESOURCE_EXHAUSTD (#1806) (bfcf523)
- Set grpc keepalive time|outs by default (#1814) (dedfdea)
- Simplify logic for HTTP/1.1 REST fallback option (#1809) (ee09b69)
Java
Changes for google-cloud-pubsub
1.125.1 (2023-09-14)
Dependencies
- Update actions/checkout action to v4 - abandoned (#1719) (b82f15a)
- Update dependency com.google.cloud:google-cloud-bigquery to v2.32.0 (#1725) (f40f09a)
1.125.0 (2023-09-12)
Features
Bug Fixes
- Make retry policy back off more aggressively for RPCs that retry RESOURCE_EXHAUSTD (#1704) (f61e7e0)
Dependencies
- Update actions/checkout action to v4 (#1712) (404c492)
- Update dependency com.google.cloud:google-cloud-bigquery to v2.31.2 (#1713) (32cb43c)
- Update dependency com.google.cloud:google-cloud-core to v2.23.0 (#1717) (929f778)
- Update dependency com.google.cloud:google-cloud-shared-dependencies to v3.15.0 (#1718) (0eeaa19)
- Update dependency com.google.protobuf:protobuf-java-util to v3.24.3 (#1698) (1157fbf)
- Update dependency org.easymock:easymock to v5.2.0 (#1711) (313f6dd)
- Update dependency org.graalvm.buildtools:junit-platform-native to v0.9.25 (#1709) (1cc8a53)
- Update dependency org.graalvm.buildtools:junit-platform-native to v0.9.26 (#1715) (f2cc75f)
- Update dependency org.graalvm.buildtools:native-maven-plugin to v0.9.25 (#1710) (9764c3f)
- Update dependency org.graalvm.buildtools:native-maven-plugin to v0.9.26 (#1716) (6c9e949)
Messages written to a dead letter topic configured for a BigQuery subscription contain an attribute with the reason the message could not be written to BigQuery. For more information, see Handle message failures.
Vulnerabilities per resource type graphic released to General Availability
The Security Command Center Overview page in the Cloud console now shows a Vulnerabilities per resource type graphic, which replaces the Active vulnerabilities over time by severity graphic. The Vulnerabilities per resource type graphic shows the resources in your organization (for example, Cloud Storage buckets, Compute Engine instances, and firewalls), how many active vulnerabilities exist for each resource, and the severity of those vulnerabilities.
Vertex AI Search (Enterprise Search): Turn Enterprise edition on or off
You can turn Enterprise edition features on or off for existing apps.
For more about Enterprise edition, see About advanced features.
For auto mode VPC networks, added a new subnet 10.216.0.0/20 for the Dammam me-central2 region. For more information, see Auto mode IP ranges.
Workflows is available in the following additional region: me-central2 (Dammam, Saudi Arabia).
September 18, 2023
Access ApprovalAccess Approval supports Cloud Monitoring in the Preview stage.
On September 18, 2023, we released an updated version of the Apigee UI.
This release includes improvements to the Create Environment experience in the Apigee UI in the Cloud console.
With this release, users can create a new environment, attach the environment to an Apigee instance, and assign the environment to an environment group within the same creation flow.
In addition, users can edit or remove environment group assignments from the environment detail page in the Apigee UI, simplifying management of their Apigee implementation.
For more information, see Working with environments.
A weekly digest of client library updates from across the Cloud SDK.
Go
Changes for bigquery/storage/apiv1beta1
1.55.0 (2023-09-11)
Features
- bigquery/datapolicies: Support using custom UDF in the data policy (20725c8)
- bigquery: Set PreferredMinStreamCount when creating read session (#8476) (22e095a), refs #8432
Bug Fixes
Java
Changes for google-cloud-bigquery
2.32.0 (2023-09-14)
Features
- Add support for converting interval fields to threeten PeriodDuration (#2838) (2294c2f)
- Add support for ExternalDatasetReference (#2871) (bbb86fd)
Dependencies
- Update actions/checkout action to v4 (#2862) (902e9b9)
- Update actions/upload-artifact action to v3.1.3 (#2867) (cbbf0fb)
- Update dependency com.google.api.grpc:proto-google-cloud-bigqueryconnection-v1 to v2.26.0 (#2873) (6196625)
- Update dependency com.google.cloud:google-cloud-datacatalog-bom to v1.30.0 (#2874) (6cafedf)
- Update dependency com.google.cloud:google-cloud-shared-dependencies to v3.15.0 (#2870) (f24439b)
- Update dependency org.graalvm.buildtools:junit-platform-native to v0.9.26 (#2868) (d01031c)
- Update dependency org.graalvm.buildtools:native-maven-plugin to v0.9.26 (#2869) (edd7141)
The BigQuery Data Transfer Service now supports transfers from Search Ads 360 using the new Search Ads 360 reporting API. This feature is in preview. Customers with existing Search Ads 360 transfers should migrate their workflows to be compatible with the new Search Ads 360. The BigQuery Data Transfer Service will stop its support for the old Search Ads 360 reporting API on May 31st, 2024.
A weekly digest of client library updates from across the Cloud SDK.
Java
Changes for google-cloud-bigtable
2.27.2 (2023-09-13)
Bug Fixes
- Check that all bulk mutation entries are accounted for (#1907) (9ad8a00)
- Set wait timeout on watchdog (#1913) (f8ba6fe)
Dependencies
- Update dependency org.graalvm.buildtools:junit-platform-native to v0.9.26 (#1896) (dfc4231)
- Update dependency org.graalvm.buildtools:native-maven-plugin to v0.9.26 (#1897) (d446856)
- Update shared dependencies (#1901) (96f2690)
2.27.1 (2023-09-12)
Bug Fixes
- Aggregate batching throttling latency per attempt and reset it between (#1905) (e6cc5f6)
- Make sure to propagate the response when throttling is enabled (#1908) (f743187)
Dependencies
The apache-airflow-providers-google package is upgraded to version 10.7.0 in images with Airflow 2.5.3 and 2.4.3. For more information about changes, see the apache-airflow-providers-google changelog from version 10.5.0 to version 10.7.0.
Version 10.7.0 includes new Cloud Run, Cloud Batch and Dataplex Data Quality operators:
- Cloud Run is used to build and deploy scalable containerized apps written in any language (including Go, Python, Java, Node.js, .NET, and Ruby) on a fully managed platform. The newly provided Cloud Run Operators enable creating, executing, updating, deleting and listing Cloud Run Jobs.
- Cloud Batch is a fully managed batch service to schedule, queue, and execute batch jobs on Google's infrastructure. The provided Cloud Batch Operators enable submitting, listing and deleting batch jobs as well as listing a job's tasks.
- Dataplex is an intelligent data fabric that provides unified analytics and data management across your data lakes, data warehouses, and data marts. New Dataplex operators handle creating, updating, getting, deleting and running a Data Quality scan, getting a Data Quality Scan job, creating and deleting a zone, as well as creating and deleting an asset.
Cloud Composer 2.4.3 images are available:
- composer-2.4.3-airflow-2.5.3 (default)
- composer-2.4.3-airflow-2.4.3
Cloud Composer versions 2.0.26 and 1.19.9 have reached their end of full support period.
Database Migration Service now supports customer-managed encryption keys (CMEK) that are externally managed with Cloud External Key Manager. For more details on CMEK support for each migration scenario, see CMEK integrations.
You can now save charts generated from a Log Analytics SQL query to a custom dashboard. For more information, see Save a chart to a custom dashboard.
You can now customize the Logs Dashboard page by using custom dashboards. For more information, see Visualize log severity and error metrics.
You can now use the Log fields pane of the Logs Explorer to filter your Kubernetes Container logs by their service name. The service name is extracted from the value of the pod_name label. For more information, see
Logs fields pane.
A weekly digest of client library updates from across the Cloud SDK.
Java
Changes for google-cloud-logging
3.15.9 (2023-09-11)
Dependencies
- Update dependency com.google.cloud:google-cloud-shared-dependencies to v3.15.0 (#1424) (4f82f33)
- Update dependency org.easymock:easymock to v5.2.0 (#1421) (f931544)
- Update dependency org.graalvm.buildtools:junit-platform-native to v0.9.26 (#1420) (ff581a6)
- Update dependency org.graalvm.buildtools:native-maven-plugin to v0.9.26 (#1412) (bd9be4e)
Cloud Run Operators are available in Cloud Composer.
Preview: Snapshot settings are centralized configuration parameters for all snapshots in a project. You can use snapshot settings to customize the default storage location for all future snapshots in your project. By enabling you to do this, snapshot settings remove the need for you to manually specify a storage location during each individual snapshot creation.
Learn more about snapshot settings and how to set the default storage location for a project using snapshot settings.
cos-dev-113-17908-0-0
| Kernel | Docker | Containerd | GPU Drivers |
| COS-6.1.52 | v24.0.5 | v1.7.3 | v535.104.05(default),v470.199.02(R470) |
Updated cos-gpu-installer to v2.1.8.
Updated dev-libs/nss to v3.79.4.
Updated dev-embedded/libftdi to v1.5-r5.
Fixed an issue where symlinks could not be moved.
Fixed an issue where IPv6 networking would fail under high CPU load.
Upgraded app-misc/jq to v1.7.
Upgraded sys-apps/coreutils to v9.4.
Upgraded sys-process/procps to v4.0.4.
Upgraded app-misc/ca-certificates to v20230311.3.93.
Fixed an issue with NFS reconnects on GKE.
Fixed CVE-2023-4623 in the linux kernel.
cos-beta-109-17800-0-37
| Kernel | Docker | Containerd | GPU Drivers |
| COS-6.1.42 | v24.0.5 | v1.7.2 | v535.104.05(default),v470.199.02(R470) |
Updated cos-gpu-installer to v2.1.8.
Fixed an issue where symlinks could not be moved.
Fixed an issue with NFS reconnects on GKE.
Fixed CVE-2023-4015, CVE-2023-4622, CVE-2023-4623 in the kernel.
cos-101-17162-279-47
| Kernel | Docker | Containerd | GPU Drivers |
| COS-5.15.120 | v20.10.24 | v1.6.21 | v470.199.02(default),v535.104.05 |
Fixed an issue where symlinks could not be moved.
Fixed an issue with NFS reconnects on GKE.
Update dev-lang/go to v1.19.13. This resolves CVE-2023-29409.
cos-97-16919-353-46
| Kernel | Docker | Containerd | GPU Drivers |
| COS-5.10.186 | v20.10.24 | v1.6.21 | v470.199.02(default),v535.104.05 |
Fixed CVE-2023-4622 in the linux kernel.
A weekly digest of client library updates from across the Cloud SDK.
Node.js
Changes for @google-cloud/datastore
8.1.0 (2023-09-07)
Features
Bug Fixes
Python
Changes for google-cloud-ndb
2.2.1 (2023-09-15)
Bug Fixes
Documentation
Java
Changes for google-cloud-datastore
2.17.1 (2023-09-11)
Dependencies
- Update dependency com.google.cloud:google-cloud-shared-dependencies to v3.15.0 (#1184) (6cbb795)
- Update dependency org.easymock:easymock to v5.2.0 (#1180) (3e62380)
Documentation
GKE clusters running version 1.28 or later block new bindings of ClusterRole cluster-admin to User system:anonymous, Group system:authenticated, or Group system:unauthenticated due to the security risks of these bindings. GKE does not block existing bindings.
GKE has temporarily paused all automatic node upgrades due to an issue with blue-green upgrades rollback functionality. You can still manually upgrade node pools with the surge upgrade strategy. Do not manually upgrade node pools with blue-green upgrades. GKE is working on a fix for this issue and will post a follow-up note here when the issue is fixed and automatic upgrades resume.
The backlog metrics of subscriptions with filtering enabled only include messages that match the filter. The change is being rolled out in a phased manner.
Debian 10 and Python 3.7 images have reached their end of patch and support life for Vertex AI Workbench managed notebooks and user-managed notebooks. Debian 11 and Python 3.10 images are available.
September 15, 2023
Access ApprovalAccess Approval supports Access Context Manager in the Preview stage.
Maintenance operations on highly available primary instances now occur with less than one second of downtime for most workloads.
AlloyDB for PostgreSQL is now available in the following regions:
europe-west12 (Turin)me-central1 (Doha)
For more information, see AlloyDB Locations.
The ability to analyze a project for compliance before migrating it to an Assured Workloads folder is now generally available. See the Migrate a workload page for more information.
The CJIS compliance program now supports the following products. See Supported products for more information:
- Cloud Composer
- Cloud Dataflow
- Cloud DNS
- Cloud HSM
- Cloud Logging
- Cloud NAT
- Cloud Router
- Cloud SQL
- Network Connectivity Center
The IL5 compliance program now supports the following products. See Supported products for more information:
- Cloud Logging
- Dataflow
- Google Kubernetes Engine
Certificate Authority Service now supports data residency.
Dedicated Cloud Interconnect support is available in the following colocation facilities:
- Quantum Switch DMM A - Dammam
For more information, see the Locations table.
Cloud KMS is available in the following region:
me-central2
For more information, see Cloud KMS locations.
Manifest files are now available in Storage Insights. A manifest file is generated when an inventory report is split into shards. You can use the manifest file to easily locate the shards you want to download.
Generally available: The Red Hat Knowledgebase provides you with access to articles, solutions, product documentation, and community discussions for Red Hat products.
You can now access the Red Hat Knowledgebase by using single-sign-on (SSO) through the Google Cloud console from your Red Hat Enterprise Linux (RHEL) VMs. For more information, see Access Red Hat Knowledgebase.
New Dataproc on Compute Engine subminor image versions:
- 2.0.76-debian10, 2.0.76-rocky8, 2.0.76-ubuntu18
- 2.1.24-debian11, 2.1.24-rocky8, 2.1.24-ubuntu20, 2.1.24-ubuntu20-arm
New Dataproc Serverless for Spark runtime versions:
- 1.1.31
- 2.0.39
- 2.1.18
Scala has been upgraded to version 2.12.18 and Apache Tez has been upgraded to version 0.10.2 in Dataproc on Compute Engine 2.1 images.
Improvements to Prebuilt Components:
- Name collection: fixed issue with names containing multiple special characters
- Credit card expiration date collection: updated SSML in agent responses
- Date of birth (DOB) collection: fixed issue with entities for specific pronunciations of months and days
Dialogflow CX has added the FILTER system function.
Dialogflow CX flow export now exports flows recursively.
Email enumeration protection is enabled by default for all new projects. With email enumeration protection enabled, the Firebase Auth SDK method fetchSignInMethodsForEmail returns null, for added security.
Event Threat Detection, a built-in service of Security Command Center, released a new rule, Initial Access: Leaked Service Account Key Used, to General Availability.
For more information, see Event Threat Detection rules.
Vertex AI Search (Enterprise Search): Languages for summarization
Summarization is supported in the following languages in addition to English:
- German (
de-DE) - Spanish (
es-ES) - Italian (
it-IT) - French (
fr-FR) - Dutch (
nl-NL) - Portuguese (
pt-BR) - Swedish (
sv-SE)
See Languages.
Vertex AI Search (Enterprise Search): Adjacent segments for preview with allowlist
When getting extractive segments, you can also get up to 3 segments from immediately before and after the relevant segment. Adjacent segments can add context and accuracy to the relevant segment. Turning on adjacent segments can increase latency.
Adjacent segments is in preview with allowlist. Contact your Google account team to try out adjacent segments.
See Extractive segments.
Vertex AI Search (Enterprise Search): Customizable summaries for preview with allowlist
When you request summaries, you can customize them by providing natural-language instructions. You can request customizations such as such as the length and level of detail, style of output (such as "simple"), language of output, focus of answer, and format (such as tables, bullets, and XML).
Customizable summaries are in preview with allowlist. Contact your Google account team if you're interested in trying this feature.
Vertex AI Search (Enterprise Search): ISO compliance
Vertex AI Search meets ISO 27001, ISO 27017, ISO 27018, and ISO 27701 compliance standards.
September 14, 2023
Anthos clusters on VMwareA standalone tool that you run before upgrading an admin or user cluster is now available. The pre-upgrade tool is supported for Anthos clusters on VMware version 1.9 through 1.13. The tool runs the applicable preflight checks for the version that you are upgrading to and also checks for specific known issues. Before upgrading a 1.9 - 1.13 cluster, we recommend that you run the pre-upgrade tool.
For details on running the tool, see the documentation for the version that you are upgrading to:
hybrid 1.10.3-hotfix.1
On September 14, 2023 we released an updated version of the Apigee hybrid software, 1.10.3-hotfix.1.
- To install the hotfix, follow the instructions in Install 1.10.3-hotfix.1.
- For new installations, see The big picture and then apply the hotfix to the new installation with the instructions in Install 1.10.3-hotfix.1.
| Bug ID | Description |
|---|---|
| 205666368 | Fixed issue with default validation of TLS target endpoint certificates. To enable strict SSL on southbound connections to a proxy target endpoint, add the tag See About setting TLS options in a target endpoint or target server. See also Known Issue #205666368. |
Go 1.21 is now generally available.
You can now view the status of your server activity in the Google Cloud console. it informs you if there's an issue with your Bare Metal Solution infrastructure. This feature is generally available (GA).
Observability for storage volumes is generally available (GA).
You can now change the type of a Chronicle reference list. For more details, see reference lists.
You can now create and manage forwarder configurations using the Chronicle user interface and also through the Chronicle Forwarder Management API.
Chronicle can now directly ingest the following log types from Google Cloud. Each is listed by product name and log_type value:
- Cloud Intrusion Detection System (
GCP_IDS) - Cloud Load Balancing (
GCP_LOADBALANCING) - Cloud SQL (
GCP_CLOUDSQL) - Windows Event logs (
WINEVTLOG) - Linux Sysmon (
LINUX_SYSMON) - Zeek (
BRO_JSON) - Google Kubernetes Engine (
KUBERNETES_NODE) - Audit Daemon (auditd) (
AUDITD) - Apigee (
GCP_APIGEE_X)
For more information, see Ingest Google Cloud Data to Chronicle.
The Cloud CDN private origin authentication capability for Amazon Simple Storage Service (Amazon S3) and compatible object stores is now Generally Available.
(Cloud Composer 2 only) In the next two weeks we plan to introduce a 1 vCPU maximum limit for Airflow Triggerers in Cloud Composer. This change is a part of an upcoming adjustment to our triggerer resource allocation strategy where we want to allow for an increase in the maximum triggerer count.
After this change takes effect, if you configured more than 1 vCPU per triggerer, then the next update operation will generate an error. To address this change, adjust the triggerer configuration to meet the new 1 vCPU limit.
(Available without an upgrade) Fixed the issue with reaching the "Write requests per day" quota limit when executing Airflow CLI commands in Cloud Composer 2.
Since August 12, 2023, there has been an increase in latency issues with inspection jobs and data profile generation. These latency issues have been resolved.
Ops Agent version 2.40.0 introduces support for Compute Engine Arm VMs that are running RHEL 9 or Rocky Linux 9. For more information, see Support for Compute Engine Arm VMs.
The following dual-region pairs are now generally available:
- Montréal and Toronto, Canada
- Sydney and Melbourne, Australia
Generally available: You can create C3-standard VMs with Local SSD attached using new machine types, for example c3-standard-44-lssd. For more information, see Choosing a valid number of Local SSDs.
Dataflow now supports the Tau T2A Arm machine series as a worker machine type. This feature is generally available (GA). For more information, see Use Arm VMs on Dataflow.
M111 release
- PyTorch 2.0 container images now include PyTorch XLA 2.0.
- Miscellaneous software updates.
M111 release
- PyTorch 2.0 images now include PyTorch XLA 2.0.
- Miscellaneous software updates.
Preview: Migrate to Virtual Machines from an Azure source is now open to all users. Migrate to Virtual Machines from an Azure source lets you migrate Azure VM instances to Compute Engine.
M111 release
The M111 release of Vertex AI Workbench instances includes the following:
- Miscellaneous software updates.
The M111 release of Vertex AI Workbench user-managed notebooks includes the following:
- PyTorch 2.0 user-managed notebooks instances now include PyTorch XLA 2.0.
- Miscellaneous software updates.
The M111 release of Vertex AI Workbench managed notebooks includes the following:
- Miscellaneous software updates.
Policy-based routing is available in General Availability. You can select a next hop based on more than a packet's destination IP address. You can match traffic by protocol and source IP address as well.
If you've used Google provider for Terraform versions earlier than 4.76.0 to create Private Service Connect service attachments, do not upgrade to versions 4.76.0 through 4.81.x. When you run terraform apply after the upgrade, Terraform might unintentionally delete and recreate the service attachments and close existing Private Service Connect connections. Recreated service attachments do not automatically re-establish Private Service Connect connections.
Upgrading to version 4.82.0 or later ensures that service attachments are not recreated.
Versions 4.76.0 and later turn on connection reconciliation by default, which might result in different service attachments having different settings for this field, depending on when they were created.
For more information and workarounds, see Disconnections after upgrading the Google provider for Terraform.
September 13, 2023
AlloyDB for PostgreSQLAlloyDB now lets you use and manage data-encryption keys residing outside of Google Cloud using Cloud External Key Manager.
Artifact Registry now supports HTTP access to Apt repositories. For more information, see Configure HTTP access to an Apt repository.
You can now create a federated dataset in BigQuery that federates to an existing database in AWS Glue. This feature is in preview.
You can now create definer's rights views in Cloud Spanner. A definer's rights view adds additional security functionality by providing different privileges on the view and the underlying schema objects. Users with access to a definer's rights view can see and query its contents even if they don't have access to the view's underlying schema objects. For more information, see About views.
Config Controller now uses the following versions of its included products:
- Config Connector v1.108.0, release notes
- Anthos Config Management v1.16.0, release notes
Announcing the Private Preview release of the Dataproc on Compute Engine Flink Jobs resource. During Private Preview, you can contact your Google Cloud Sales representative to have your project(s) added to an allowlist to allow you to submit Flink jobs to the Dataproc on Compute Engine service.
VMware Engine nodes are now available in the following additional zone:
- Tel Aviv (
me-west1-a)
You can now configure IAM workforce identity federation using the Google Cloud console. To learn more, see the configuration guides for Azure AD, Okta, or other OIDC and SAML 2.0 providers. The feature is in Preview.
Looker 23.16 includes the following changes, features, and fixes.
Expected Looker (original) deployment start: Monday, September 18, 2023
Expected Looker (original) final deployment and download available: Thursday, September 28, 2023
Expected Looker (Google Cloud core) deployment start: Monday, October 2, 2023
Expected Looker (Google Cloud core) final deployment: Thursday, October 12, 2023
The API call to create signed embed URL endpoints has been updated to remove the majority of embed administration configuration changes that need to be made when a signed embed URL is requested using the endpoint. The description of the endpoint is also changed to use a signed embed URL instead of an SSO embed URL to reduce the confusion with standard SSO authentication.
update_embed_config events are now reflected in the System Activity Event Explore.
When a dashboard or an element refresh interval is entered that is higher than the supported maximum value (24.8 days), Looker now returns a validation message.
Personal folders for users who have never logged in will no longer appear in embedded content navigation.
Auto-updates for Looker and third-party applications now display a list of entitlements that may be applied when a Marketplace listing is automatically updated.
The look and feel of the Get LookML dialog on Explore pages has been updated.
The create_dashboard_render_task now takes in an optional theme property to specify the theme to apply to the rendered dashboard.
For SFTP and S3 destinations, the timestamp in the filename of the scheduled delivery will respect the Delivery time zone.
Updates that are sent from inside custom visualizations now perform as expected.
A previous issue would cause Marketplace updates to fail when a user had not entered dev mode since the last update. This issue has been fixed.
A previous issue would cause Session Duration to be wrongly defaulted on the UI when the Inactivity Logout was enabled. This issue has been fixed.
For cell visualizations in columns with large positive and negative values, the negative value text will now appear on a single line instead of wrapping to fit the cell space.
For bar and column charts that use stacked series positioning and stack sorting with a combination of negative and positive values, the values are now rendered and sorted on the correct side of 0.
LookML dashboard descriptions are now correctly localized in folders.
A previous issue would cause scheduled plans for System Activity to fail with an undefined method 'path' for nil:NilClass error. This issue has been fixed.
A previous issue would cause suggestions to not work for fields in views with inter-view references in their sql_table_name parameter. This issue has been fixed.
Intermittent code: 1002 errors returned from Clickhouse connections have been fixed.
The average_distinct field type now supports symmetric aggregates.
A warning message will be returned when a user tries to use a subtotal with a sql_always_having parameter.
yesno filters on filtered measures when BI Engine is enabled now perform as expected.
The following SQL dialects are no longer supported by Looker, and queries against existing connections will return errors: Apache Hive 2, Apache Spark 1.5+, Apache Spark 2.0, and Quobole Presto.
Looker no longer supports connections to the Impala dialect called Cloudera Impala (with no version number and without a native driver). Queries on connections to this release of Cloudera Impala will return an error. Looker is continuing to support Cloudera Impala 3.1+, Cloudera Impala 3.1+ with Native Driver, and Cloudera Impala with Native Driver.
The New LookML Runtime feature now allows a wider variety of strings for Liquid date parsing. Date string formats that were previously accepted in the Legacy LookML Runtime legacy feature but not in the New LookML Runtime feature should now format properly.
The Teradata JDBC driver has been updated to 16.20.00.13.
When the Email Allowlist for Scheduled Content Labs feature is enabled, admin users can use the looker_internal_email_domain_allowlist user attribute to define email allowlist domains at a group level.
When the Advanced Granular Permissions Labs feature is enabled, admin users can use six new permissions to delegate management of user attributes, groups, roles, private labels, themes, and embed settings to non-admin users.
When you set up SAML authentication, merging users from OIDC into SAML is now supported.
The AND/OR Filters in Explores Labs feature is now enabled by default. When this feature is enabled, Looker Explores contain a new experience for creating and editing filters with AND/OR filter logic without the need to create custom filter expressions.
The Table (Legacy) visualization hide_totals option now performs as expected.
Liquid Ruby dependency has been updated to 5.0.0. You can now make a Liquid reference that results in a non-string value in the link parameter using the Legacy LookML Runtime legacy feature by using the {{
value }} Liquid reference syntax.
A new Looker (Google Cloud core) codelab has been published. The Connect Looker Cloud over hybrid networking codelab provides a walkthrough of deploying a public and private IP Looker (Google Cloud core) instance and connecting it to an on-premises database.
Looker (Google Cloud core) instances can now be created by provisioning a Terraform resource. The new Terraform tab on the Create a Looker (Google Cloud core) instance documentation page describes how to provision various editions of a Looker (Google Cloud core) instance.
Administrators can set a data retention policy (Preview) on a project, on a new portal, or both. For more information, see Configure data retention policy.
Preview stage support for the following integration:
September 12, 2023
BigQueryThe array subscript operator now returns a value in an array directly by index. Previously, only offset and ordinal were available. This feature is generally available (GA).
The struct subscript operator has been added. With this operator, you can access a STRUCT field by index, offset, or ordinal. This feature is generally available (GA).
Remote Agents 1.4.3.6
Remote agent now supports the same alert and event trimming logic as implemented in the server. New parameters in the database control the size of the alert as well as the size of the fields and events within them. Alerts that are bigger than this size will be automatically trimmed. If the alert is still too big, then the size of the fields and events will be trimmed. The resulting alert ingested into the case might therefore not contain all the original information.
Remote connector logs now display as required in the platform.
Remote agent no longer takes ownership of the entire /var/log directory when using the installer.
Cloud Composer 2 is now available in Doha (me-central1).
A release was made. Updates may include general performance improvements, bug fixes, and updates to the API reference documentation.
Log buckets in the following regions can now be upgraded to use Log Analytics:
- us-east5
- us-south1
- me-central1
- europe-west12
For more information, see Supported regions.
You can manage future reservations using the Google Cloud console. Future reservations provide a high level of assurance to obtain important or difficult-to-obtain capacity in advance.
For more information, see the following pages:
cos-105-17412-156-49
| Kernel | Docker | Containerd | GPU Drivers |
| COS-5.15.120 | v23.0.3 | v1.7.2 | v470.199.02(default),v535.104.05 |
Updated cos-gpu-installer to v2.1.7. Precompiled drivers are now downloaded from COS build artifacts.
Updated latest GPU driver to v535.104.05.
Fixed an issue where symlinks could not be moved.
The get_metadata_value script will now retry if it experiences a connection error.
Fixed an issue with NFS reconnects on GKE.
Updated dev-lang/go to v1.20.8. This resolves CVE-2023-29409.
Fixed the following CVEs in sys-libs/binutils-libs: CVE-2022-47007, CVE-2022-47008, CVE-2022-47010, CVE-2022-47011, CVE-2022-48063, CVE-2022-48064, CVE-2022-48065.
Runtime sysctl changes:
- Added: net.ipv4.tcp_backlog_ack_defer: 1
The dataproc.diagnostics.enabled property is now avaiable to enable running diagnostics on Dataproc Serverless for Spark. The existing spark.dataproc.diagnostics.enabled property will be deprecated for use with newer runtimes.
You can now use node auto-provisioning for TPU slices. With this feature, Standard clusters with GKE version 1.28 and later provision TPU node pools and multi-host TPU accelerators automatically to ensure the capacity required to schedule AI/ML workloads. To learn more, see Configuring TPU node auto-provisioning.
September 11, 2023
BigQueryA weekly digest of client library updates from across the Cloud SDK.
The following resource types are now publicly available through the Search APIs (SearchAllResources, SearchAllIamPolicies).
- Financial Services
financialservices.googleapis.com/Instance
- Discovery Engine
discoveryengine.googleapis.com/Collectiondiscoveryengine.googleapis.com/DataStore
The following resource types are now publicly available through the analyze policy APIs (AnalyzeIamPolicy and AnalyzeIamPolicyLongrunning).
- Speaker ID
speakerid.googleapis.com/Settings
You can now choose not to specify the number of nodes when creating a Cloud Bigtable cluster using the gcloud CLI. This configuration lets Bigtable automatically calculate the number of nodes based on your data footprint and optimize for 50% storage utilization. To learn more, see Create an instance. This feature is generally available (GA).
In some cases, it is possible to create multiple NAT gateway configurations that include the same subnet. For some of these configurations, VMs that are attached to that subnet are not allocated NAT ports, and therefore can't access resources on the internet.
For more information about this issue and a workaround, see VMs can't reach the internet.
Query Optimizer version 6 is generally available. Version 5 remains the default optimizer version in production.
cos-97-16919-353-44
| Kernel | Docker | Containerd | GPU Drivers |
| COS-5.10.186 | v20.10.24 | v1.6.21 | v470.199.02(default),v535.104.05 |
Updated cos-gpu-installer to v2.1.7. Switched precompiled driver and signature location to COS build artifacts.
Updated latest GPU driver to v535.104.05.
Changed error handling in get_metadata_value script to retry if connection error happens during instance metadata check.
Fixed problem with NFS reconnects when using DPv2 in kube-proxy-free mode.
Fixed the following CVEs in sys-libs/binutils-libs: CVE-2022-47007 CVE-2022-47008, CVE-2022-47010, CVE-2022-47011, CVE-2022-48063, CVE-2022-48064, CVE-2022-48065.
cos-93-16623-461-30
| Kernel | Docker | Containerd | GPU Drivers |
| COS-5.10.177 | v20.10.24 | v1.6.20 | v450.248.02(default),v470.199.02(R470),v535.104.05 |
Updated cos-gpu-installer to v2.1.7. Switched precompiled driver and signature location to COS build artifacts.
Updated latest GPU driver to v535.104.05.
Changed error handling in get_metadata_value script to retry if connection error happens during instance metadata check.
Fixed the following CVEs in sys-libs/binutils-libs: CVE-2022-47007 CVE-2022-47008, CVE-2022-47010, CVE-2022-47011, CVE-2022-48063, CVE-2022-48064, CVE-2022-48065.
cos-101-17162-279-42
| Kernel | Docker | Containerd | GPU Drivers |
| COS-5.15.120 | v20.10.24 | v1.6.21 | v470.199.02(default),v535.104.05 |
Updated cos-gpu-installer to v2.1.7. Switched precompiled driver and signature location to COS build artifacts.
Updated latest GPU driver to v535.104.05.
Changed error handling in get_metadata_value script to retry if connection error happens during instance metadata check.
Fixed the following CVEs in sys-libs/binutils-libs: CVE-2022-47007 CVE-2022-47008, CVE-2022-47010, CVE-2022-47011, CVE-2022-48063, CVE-2022-48064, CVE-2022-48065.
cos-dev-113-17877-0-0
| Kernel | Docker | Containerd | GPU Drivers |
| COS-6.1.51 | v24.0.5 | v1.7.3 | v535.104.05(default),v470.199.02(R470) |
Updated the Linux kernel to v6.1.51.
Updated latest GPU driver to v535.104.05.
cos-beta-109-17800-0-32
| Kernel | Docker | Containerd | GPU Drivers |
| COS-6.1.42 | v24.0.5 | v1.7.2 | v535.104.05(default),v470.199.02(R470) |
Updated latest GPU driver to v535.104.05.
Validate the resource locations for all Document Warehouse API requests.
Error Reporting now supports Cloud Run Jobs as a monitored resource type. For more information, see Supported monitored resources.
The Google Cloud console now supports a usage dashboard for each database.
A weekly digest of client library updates from across the Cloud SDK.
Compute Engine persistent disk CSI Drivers deployed on clusters running version 1.26 and later now support filesystem size expansion during restoration from a snapshot or a clone when the PVC data source is larger than the original volume. For more information, see the GitHub pull request.
A weekly digest of client library updates from across the Cloud SDK.
Node.js
Changes for @google-cloud/pubsub
4.0.5 (2023-09-07)
Bug Fixes
4.0.4 (2023-09-05)
Bug Fixes
4.0.3 (2023-08-31)
Bug Fixes
A weekly digest of client library updates from across the Cloud SDK.
Python
Changes for google-cloud-pubsub
2.18.4 (2023-09-09)
Documentation
New SAP HANA certification: Hyperdisk Extreme usage with N2 machine types
For running SAP HANA on Google Cloud, SAP has certified using Hyperdisk Extreme with N2 machine types that have 80 vCPUs or more.
For more information, see:
- Certified Compute Engine VMs for SAP HANA
- The Hyperdisk Extreme sizes tab in Minimum sizes for SSD-based persistent disks and Hyperdisks
New OS certifications for SAP HANA
For use with SAP HANA on Google Cloud, SAP has certified the following operating systems:
- Red Hat Enterprise Linux (RHEL) 8.8 for SAP
- SUSE Linux Enterprise Server (SLES) 15 SP5 for SAP
For more information, see Certified operating systems for SAP HANA.
Security Command Center now supports CIS Google Cloud Computing Foundations Benchmark v2.0.0.
The support for v2.0.0 includes the following new vulnerability detector:
Load balancer logging disabled
For more information, see the following:
September 10, 2023
DatastreamDatastream now supports SSL/TLS encryption for Oracle sources. For more information, see the Datastream API reference documentation.
September 08, 2023
Access ApprovalAccess Approval supports Firebase Security Rules in the Preview stage.
When creating an AlloyDB cluster, you can now specify an IP range for private services access. This is optional; if you do not specify an IP range, then AlloyDB selects one for you.
Go 1.21 is now generally available.
Fixed the CVE-2023-29247 vulnerability in Airflow versions 2.4.3 and 2.5.3. To apply the fix, please upgrade your environment to Cloud Composer version 2.4.2 or later. For more information about this vulnerability in relation to Cloud Composer environments, see Known issues.
Cloud Composer now correctly generates an error message when a Cloud Composer 1 environment is created using a version alias in a region where Cloud Composer 1 is not supported.
Cloud Composer now generates a FAILED_PRECONDITION error message when an environment operation fails because the environment's cluster is missing.
Cloud Composer 2.4.2 images are available:
- composer-2.4.2-airflow-2.5.3 (default)
- composer-2.4.2-airflow-2.4.3
Cloud Composer versions 2.0.25 and 1.19.8 have reached their end of full support period.
Starting September 8, 2023, you will be charged for the following Cloud Firewall Standard features:
For more information about billing, see Cloud Firewall pricing.
Dataproc Auto zone placement for clusters is now available in the Google Cloud console by selecting the "Any" option for the cluster zone.
New Dataproc Serverless for Spark runtime versions:
- 1.1.30
- 2.0.38
- 2.1.17
New Dataproc on Compute Engine subminor image versions:
- 2.0.75-debian10, 2.0.75-rocky8, 2.0.75-ubuntu18
- 2.1.23-debian11, 2.1.23-rocky8, 2.1.23-ubuntu20, 2.1.23-ubuntu20-arm
The Apache Spark version has been upgraded from 3.3.0 to 3.3.2 in Dataproc on Compute Engine 2.1 images.
Vertex AI Prediction
You can now use A2 Ultra machines to serve predictions in us-central1, us-east4, europe-west4, and asia-southeast1. Each A2 Ultra machine has a fixed number of NVIDIA A100 80GB GPUs attached.
Vertex AI Search (Enterprise Search): Image search is GA
Image search is now generally available (GA).
Vertex AI Search (Enterprise Search): Page numbers for extractive segments
Page numbers can be returned with extractive segments. Page numbers indicate where an answer was extracted from in a document.
For more about extractive segments, see Get snippets and extracted content.
September 07, 2023
Access TransparencyAccess Transparency logs are enhanced with an eventID that signifies the incident that resulted in the access by Google personnel. For example, a support case that results in several accesses from the support and engineering teams in order to resolve the case. Accesses related to the same support case share the same eventID in Access Transparency logs.
For more information about this field, see Log field descriptions.
On September 7, 2023 we released an updated version of Apigee integrated portal. This release includes general improvements to performance and availability.
Preview: You can view the following when using Capacity Planner:
The 50th and 75th percentile usage and forecast of your VMs.
The historical usage of your VMs up to 2 years in the past.
The usage and forecast of all machine families in a project.
For more information, see About Capacity Planner.
Preview: You can generate gcloud CLI commands to create future reservation requests of Compute Engine zonal resources based on the actual or forecasted usage of your VMs. Future reservations are useful to secure capacity up to 1 year in advance for forecasted spikes.
For more information, see Reserve capacity from actual or forecasted usage.
Users can now use manual triggers, webhook triggers, and Pub/Sub triggers to build Bitbucket Server and Bitbucket Data Center repositories through Cloud Build repositories (1st gen). This feature is generally available. To learn more, see Build repositories from Bitbucket Server and Build repositories from Bitbucket Data Center.
Maintenance windows configuration is now generally available (GA).
Cloud Data Fusion version 6.9.2 is generally available (GA). This release is in parallel with the CDAP 6.9.2 release.
Features in Cloud Data Fusion 6.9.2:
- Editing deployed batch pipelines is generally available (GA).
- Using Pub/Sub sources in streaming data pipelines is GA.
- Wrangler Filter Pushdown is GA.
- Pushdown for window aggregations is GA.
Changes in Cloud Data Fusion 6.9.2:
- Cloud Data Fusion supports setting custom scopes when creating a Dataproc cluster (CDAP-19428).
- You can set common metadata labels for Dataproc clusters and jobs using the Common Labels property in the Ephemeral Dataproc compute profile (CDAP-20698).
- You can set labels for the Dataproc jobs using the Common Labels property in the Existing Dataproc compute profile (CDAP-20698).
- You can set a pipeline runtime argument with the key
system.profile.properties.labelsand a value representing the labels in the following format:key1|value1;key2|value2. This setting overrides the common labels set in the compute profile for pipeline runs (CDAP-20698). - Cloud Data Fusion supports using Dataproc temp buckets in compute profiles (CDAP-20712).
Fixed in Cloud Data Fusion 6.9.2:
- Added a retry for Pub/Sub snapshot creation and deletion in a real-time pipeline with a Pub/Sub source when a retryable internal error is thrown (PLUGIN-1660).
- Fixed a bug causing the Dynamic Spark plugins to fail when running on Dataproc 1.5 (CDAP-20674).
- Fixed a discrepancy in warning and error counts reported between the pipeline summary tab and system logs (CDAP-20680).
- Fixed a problem when, in rare cases, a cluster couldn't be found with Cluster Reuse (CDAP-20759).
- Fixed a bug causing the JavaScript transform to fail on Dataproc 2.1 (CDAP-20778).
Cloud Functions now supports the Go 1.21 runtime at the General Availability release level.
Ops Agent version 2.39.0 introduces support for Compute Engine Arm VMs that are running Ubuntu 20.04 LTS (Focal Fossa). For more information, see Support for Compute Engine Arm VMs.
Starting with version 2.39.0, the Ops Agent supports ingesting Prometheus metrics with unknown types. In earlier versions, untyped metrics are treated by the Ops Agent as gauges, but starting with Ops Agent version 2.39.0, untyped metrics are treated as both gauges and counters, and you can apply cumulative operations to the metrics.
If you have charts or alterting policies based on untyped metrics and written with MQL, you must adjust your queries. For more information, see Prometheus untyped metrics change metric type starting with Ops Agent version 2.39.0.
cos-dev-113-17872-0-0
| Kernel | Docker | Containerd | GPU Drivers |
| COS-6.1.49 | v24.0.5 | v1.7.3 | v535.54.03(default),v470.199.02(R470) |
Updated dev-go/go-tools to v0.11.1_p20230712.
Updated dev-lang/go to v1.21.0.
Updated the Linux kernel to v6.1.49.
The get_metadata_value script will now retry if it experiences a connection error.
Enabled persistence mode with Nvidia GPU driver installation.
Fixed an issue in ip6tables where the -C option did not
work correctly.
Upgraded app-misc/jq to v1.7_rc2.
Upgraded sys-apps/less to v643.
Upgraded app-arch/pigz to v2.8.
Upgraded app-editors/vim to v9.0.1777. Upgraded app-editors/vim-core to v9.0.1777.
Upgraded sys-fs/mdadm to v4.2. This resolves CVE-2023-28938 and CVE-2023-28736.
Fixed CVE-2023-4016 in sys-process/procps.
Runtime sysctl changes:
- Added: kernel.io_uring_disabled: 0
- Changed: fs.file-max: 812619 -> 812608
- Changed: kernel.threads-max: 63519 -> 63520
- Changed: net.netfilter.nf_conntrack_sctp_timeout_shutdown_recd: 0 -> 3
- Changed: net.netfilter.nf_conntrack_sctp_timeout_shutdown_sent: 0 -> 3
- Changed: user.max_cgroup_namespaces: 31759 -> 31760
- Changed: user.max_ipc_namespaces: 31759 -> 31760
- Changed: user.max_mnt_namespaces: 31759 -> 31760
- Changed: user.max_net_namespaces: 31759 -> 31760
- Changed: user.max_pid_namespaces: 31759 -> 31760
- Changed: user.max_time_namespaces: 31759 -> 31760
- Changed: user.max_user_namespaces: 31759 -> 31760
- Changed: user.max_uts_namespaces: 31759 -> 31760
cos-beta-109-17800-0-31
| Kernel | Docker | Containerd | GPU Drivers |
| COS-6.1.42 | v24.0.5 | v1.7.2 | v535.54.03(default),v470.199.02(R470) |
Updated dev-go/go-tools to v0.11.1_p20230712.
Updated dev-lang/go to v1.21.0.
The get_metadata_value script will now retry if it experiences a connection error.
Enabled persistence mode with Nvidia GPU driver installation.
Fixed an issue in ip6tables where the -C option did not
work correctly.
Upgraded sys-fs/mdadm to v4.2. This resolves CVE-2023-28938 and CVE-2023-28736.
Fixed CVE-2023-4016 in sys-process/procps.
Fixed CVE-2022-40896 in pygments package.
Fixed CVE-2023-33953 in the Linux kernel.
Runtime sysctl changes:
- Added: kernel.io_uring_disabled: 0
cos-101-17162-279-34
| Kernel | Docker | Containerd | GPU Drivers |
| COS-5.15.120 | v20.10.24 | v1.6.21 | v470.199.02(default),v525.125.06 |
Simplified GPU driver installation by remounting driver installation path as executable from cos-extensions.
Enabled trusted IMA certificate loading from /etc/ima/pubkey.x509.
Enable persistence mode with Nvidia GPU driver installation.
Fixed CVE-2018-20852 in the dev-lang/python package.
Updated xz-utils to 5.2.9. This resolves CVE-2020-22916.
Upgraded sys-fs/mdadm to v4.2. This resolves CVE-2023-28938 and CVE-2023-28736.
Upgraded sys-process/procps to 3.3.17. This fixed CVE-2018-1121 and CVE-2023-4016.
Fixed CVE-2023-4128 in the Linux kernel.
Runtime sysctl changes:
- Added: kernel.io_uring_disabled: 0
cos-97-16919-353-31
| Kernel | Docker | Containerd | GPU Drivers |
| COS-5.10.186 | v20.10.24 | v1.6.21 | v470.199.02(default),v525.125.06 |
Enabled trusted IMA certificate loading from /etc/ima/pubkey.x509.
Enabled persistence mode with Nvidia GPU driver installation.
Updated xz-utils to 5.2.9. This resolves CVE-2020-22916.
Upgraded sys-process/procps to 3.3.17. This fixed CVE-2018-1121 and CVE-2023-4016.
Upgraded sys-fs/mdadm to v4.2. This resolves CVE-2023-28938 and CVE-2023-28736.
Fixed CVE-2023-4128 in the Linux kernel.
Runtime sysctl changes:
- Added: kernel.io_uring_disabled: 0
cos-93-16623-461-21
| Kernel | Docker | Containerd | GPU Drivers |
| COS-5.10.177 | v20.10.24 | v1.6.20 | v450.248.02(default),v470.199.02(R470),v525.125.06 |
Fixed CVE-2018-17846, CVE-2018-17142, CVE-2018-17847, CVE-2018-17143, CVE-2018-17075, CVE-2018-17848 in dev-go/net.
Updated xz-utils to 5.2.9. This resolves CVE-2020-22916.
Upgraded sys-process/procps to 3.3.17. This fixed CVE-2018-1121 and CVE-2023-4016.
Upgraded sys-fs/mdadm to v4.2. This resolves CVE-2023-28938 and CVE-2023-28736.
Fixed CVE-2023-33953 in the Linux kernel.
cos-105-17412-156-34
| Kernel | Docker | Containerd | GPU Drivers |
| COS-5.15.120 | v23.0.3 | v1.7.2 | v470.199.02(default),v525.125.06 |
Enabled persistence mode with Nvidia GPU driver installation.
Upgraded sys-fs/mdadm to v4.2. This resolves CVE-2023-28938 and CVE-2023-28736.
Fixed CVE-2023-4016 in sys-process/procps.
Service account delegation for workflow execution is now available. You can configure service account delegation for whole repositories, or for individual workflow configurations.
The Datastream BigQuery Migration Toolkit is now launched. The toolkit is an open-source software that simplifies migrating from the Dataflow Datastream to BigQuery template to the Datastream native BigQuery replication solution. For more information, see the toolkit documentation.
This is a minor release of Google Distributed Cloud Edge (version 1.5.0).
The following features have been introduced in this release of Distributed Cloud Edge:
Bastion host support. Distributed Cloud Edge now allows you to set up one or more bastion host virtual machines. The bastion host feature allows Google support engineers to connect to your Distributed Cloud Edge deployment and work with you to diagnose and resolve issues. For more information, see Configure a bastion host. This is a preview-level feature.
Selectable cluster software versions. You now have the option to create a cluster running a specific version of Distributed Cloud Edge software, starting with version 1.5.0. For more information, see Create and manage clusters. This is a preview-level feature.
Container image registry access over secondary networks. Distributed Cloud Edge now allows you to specify the network interface in the
spec.containerRuntimeDNSConfigfield of theNodeSystemConfigUpdateresource. This allows you to specify a container image registry IP/domain pair for a network interface other than the primary. For more information, seeNodeSystemConfigUpdateresource. This is a preview-level feature.CMEK support for local control plane nodes. You can now configure Cloud KMS integration for storage on nodes running local control planes for Distributed Cloud Edge clusters. For more information, see Enable support for customer-managed encryption keys (CMEK) for local storage.
The following changes have been introduced in this release of Distributed Cloud Edge:
Survivability mode is now generally available. For more information, see Distributed Cloud Edge survivability mode. After your Distributed Cloud Edge deployment has been upgraded from version 1.4.0 to version 1.5.0, you must manually delete and recreate all local control plane clusters you have created with Distributed Cloud Edge version 1.4.0 or 1.4.1. Otherwise, unexpected behavior and data loss can occur. Clusters configured to use a cloud control plane continue to run normally after upgrading Distributed Cloud Edge to version 1.5.0.
Symcloud Storage integration is now generally available. For more information, see Configure Distributed Cloud Edge for Symcloud Storage.
Local control plane clusters now support virtual machines and GPU workloads. For more information, see Manage virtual machines and Manage GPU workloads.
Loadable SCTP kernel modules. Distributed Cloud Edge now configures the sctp kernel module as loadable. This allows you to load custom networking stacks into the kernel's user space. For more information, see SCTP kernel modules. This is a preview-level feature.
The following issues have been resolved in this release of Distributed Cloud Edge:
When creating a Cloud control plane cluster, creating a node pool that includes nodes that were previously part of a local control plane cluster no longer fails.
BGP sessions now properly recover when the associated network interface goes down and then comes back up.
This release of Distributed Cloud Edge contains the following known issues:
When creating a local control plane cluster, Distributed Cloud Edge instantiates dummy
BGPPeerandBGPLoadBalancerresources. You can ignore these resources.Distributed Cloud Edge does not support BGP peering to multiple VLANs within the same virtual router. You must set up a separate virtual router with a unique loopback IP addresses for each affected VLAN to allow concurrent BGP peering sessions.
Three vulnerabilities (CVE-2023-3676, CVE-2023-3955, CVE-2023-3893) have been discovered in Kubernetes where a user that can create Pods on Windows nodes may be able to escalate to admin privileges on those nodes. These vulnerabilities affect the Windows versions of Kubelet and the Kubernetes CSI proxy.
GKE clusters are only affected if they include Windows nodes.
For more information, see the GCP-2023-026 security bulletin.
For GKE clusters using Dataplane V2, upgrades to GKE version 1.26 might cause GKE to temporarily be unable to configure workloads. In some cases, this might cause existing workloads to temporarily lose networking access. This issue does not impact new clusters and GKE clusters not using Dataplane V2. For clusters running version 1.25 with Dataplane V2 enabled, GKE has temporarily disabled auto-upgrades to version 1.26. We recommend that customers not manually upgrade their Dataplane V2-enabled cluster to GKE version 1.26. This is a known issue for GKE version 1.26 and will be fixed in a future patch version of 1.26.
With the recently released version of GKE, version 1.28, you cannot yet use the SidecarContainer feature with alpha clusters. Pods defining restartable Init containers will not start. This is a known issue that will be resolved in a future release.
September 06, 2023
AlloyDB for PostgreSQLUpdated the PostgreSQL-compatible server running on AlloyDB instances to version 14.7.
Updated the following extensions related to the PostGIS extension to version 3.2.3:
postgispostgis_rasterpostgis_sfcgalpostgis_tiger_geocoderpostgis_topologyaddress_standardizeraddress_standardizer_data_us
The following extensions are updated:
- Updated
pg_hint_planto version 1.4.1. - Updated
pg_repackto version 1.4.8. - Updated
pg_partmanto version 4.7.3. - Updated
postgresql-hllto version 2.17. - Updated
pg_cronto version 1.5. - Updated
pg_hint_planto version 1.4.1. - Updated
pg_repackto version 1.4.8. - Updated
pg_partmanto version 4.7.3. - Updated
postgresql-hllto version 2.17. - Updated
pg_cronto version 1.5.
This release includes the following Anthos attached clusters platform versions:
- 1.25.0-gke.6
- 1.26.0-gke.4
- 1.27.0-gke.1
1.27.0-gke.1
Added Binary Authorization support which is a deploy-time security control that ensures only trusted container images are deployed. With Binary Authorization, you can require images to be signed by trusted authorities during the development process and then enforce signature validation when deploying. By enforcing validation, you can gain tighter control over your container environment by ensuring only verified images are integrated into the build-and-release process. For details about how to enable Binary Authorization on your clusters, see How to enable Binary Authorization.
Added the
authorization.admin_groupsfield. This allows users to specify Google groups ascluster-adminsthrough the management plane.Enabled
gzipcompression forfluent-bit's ingestion of logs into Cloud Logging. This improves the efficiency of log transfer for both the control plane and workloads.Added proxy support for attaching AKS/EKS clusters. For details, see Connect to your EKS cluster and Connect to your AKS cluster.
This release fixes the following vulnerabilities:
- Fixed CVE-2021-43565
- Fixed CVE-2022-21698
- Fixed CVE-2023-0464
- Fixed CVE-2023-0465
- Fixed CVE-2023-0466
- Fixed CVE-2023-2454
- Fixed CVE-2023-2455
- Fixed CVE-2023-2650
- Fixed CVE-2023-24539
- Fixed CVE-2023-24540
- Fixed CVE-2023-29400
1.16.7-asm.7 is now available for in-cluster Anthos Service Mesh.
You can now download 1.16.7-asm.7 for in-cluster Anthos Service Mesh. It includes the features of Istio 1.16.7 subject to the list of supported features. Anthos Service Mesh 1.16.7-asm.7 uses Envoy v1.24.9.
1.17.5-asm.9 is now available for in-cluster Anthos Service Mesh.
You can now download 1.17.5-asm.9 for in-cluster Anthos Service Mesh. It includes the features of Istio 1.17.5 subject to the list of supported features. Anthos Service Mesh 1.17.5-asm.9 uses Envoy v1.25.8.
1.18.2-asm.4 is now available for in-cluster Anthos Service Mesh.
You can now download 1.18.2-asm.4 for in-cluster Anthos Service Mesh. It includes the features of Istio 1.18.2 subject to the list of supported features. Anthos Service Mesh 1.18.2-asm.4 uses Envoy v1.26.5.
You can now launch clusters with the following Kubernetes versions:
- 1.25.8-gke.500
- 1.26.7-gke.500
- 1.27.4-gke.1600
1.27
Preview: Enabled surge updates. Surge updates allow you to configure the speed and disruption of node pool updates. Please contact your account team to opt into the preview.
GA: Added support for AWS spot instance node pools. Creating AWS spot node pools is now GA. Spot instance node pools are pools of Amazon EC2 Spot Instances that are available on AWS at a lower cost.
GA: Enabled node auto repair. This feature continuously monitors the health of each node in a node pool.
Added Binary Authorization support which is a deploy-time security control that ensures only trusted container images are deployed. With Binary Authorization, you can require images to be signed by trusted authorities during the development process and then enforce signature validation when deploying. By enforcing validation, you can gain tighter control over your container environment by ensuring only verified images are integrated into the build-and-release process. For details about how to enable Binary Authorization on your clusters, see How to enable Binary Authorization.
Added support for a new
admin-groupsflag in the create and update APIs. This flag allows customers to quickly and easily authenticate listed groups as cluster administrators, eliminating the need to manually create and apply RBAC policies.Added an
ignore_errorsoption to the delete API to handle cases where accidentally deleted IAM roles or manual removal of resources prevent the deletion of clusters or node pools. By appending?ignore_errors=trueto theDELETErequest URL, users can now forcibly remove clusters or node pools. However, this approach might result in orphaned resources in AWS or Azure, requiring manual cleanup.Upgraded the
snapshot-controllerandcsi-snapshot-validation-webhookto v6.2.2. This new version introduces an important change to the API. Specifically, theVolumeSnapshot,VolumeSnapshotContents, andVolumeSnapshotClassv1beta1 APIs are no longer available.Disabled the unauthenticated
kubeletread-only port 10255. Once a node pool is upgraded to version 1.27, workloads running on it will no longer be able to connect to port 10255.Enabled gzip compression for
fluent-bit's ingestion of logs into Cloud Logging. This improves the efficiency of log transfer for both the control plane and workloads.Optimized
audit-proxy's audit Logging ingestion by enabling gzip compression.Improved security by adding file-integrity checks and fingerprint validation for Google-managed binary artifacts downloaded from Cloud Storage.
Added support for automatic periodic defragmentation of
etcdandetcd-eventson the control plane. This feature reduces unnecessary disk storage and helps to preventetcdand the control plane from becoming unavailable due to disk storage issues.Changed the metrics names for Kubernetes resource metrics to use a metrics prefix of
kubernetes.io/anthos/rather thankubernetes.io/. For details refer to the metrics reference documentation.Changed default
etcdversion to v3.4.21 on new clusters for improved stability. Existing clusters upgraded to this version will useetcdv3.5.6.Improved node resource management by reserving resources for the kubelet. While this feature is crucial for preventing Out of Memory (OOM) errors by ensuring system and Kubernetes processes have the resources they need, it may lead to workload disruptions. The reservation of resources for the kubelet may affect the available resources for Pods, potentially affecting the capacity of smaller nodes to handle existing workloads. Customers should verify that smaller nodes can still support their workloads with this new feature activated.
- The reserved memory percentages are as follows:
- 255 MiB for machines with less than 1GB of memory
- 25% of the first 4GB of memory
- 20% of the next 4GB
- 10% of the next 8GB
- 6% of the next 112GB
- 2% of any memory above 128GB
- The reserved CPU percentages are as follows:
- 6% of the first core
- 1% of the next core
- 0.5% of the next 2 cores
- 0.25% of any cores above 4 cores
- The reserved memory percentages are as follows:
Enabled the cluster autoscaler to balance nodes across different availability zones. This is achieved using the --balance-similar-node-groups flag.
1.25
Expanded the list of metrics collected from node pools to include gke-metrics-agent, cilium-agent, cilium-operator, coredns, fluentbit-gke, kubelet, and konnectivity-agent.
This release fixes the following vulnerabilities:
You can now launch clusters with the following Kubernetes versions:
- 1.25.8-gke.500
- 1.26.7-gke.500
- 1.27.4-gke.1600
1.27
GA: Enabled node auto repair. This feature continuously monitors the health of each node in a node pool. Added support for a new
admin-groupsflag in the create and update APIs. This flag allows customers to quickly and easily authenticate listed groups as cluster administrators, eliminating the need to manually create and apply RBAC policies.Upgraded the
snapshot-controllerandcsi-snapshot-validation-webhookto v6.2.2. This new version introduces an important change to the API. Specifically, theVolumeSnapshot,VolumeSnapshotContents, andVolumeSnapshotClassv1beta1 APIs are no longer available.Disabled the unauthenticated
kubeletread-only port 10255. Once a node pool is upgraded to version 1.27, workloads running on it will no longer be able to connect to port 10255.Enabled gzip compression for
fluent-bit's ingestion of logs into Cloud Logging. This improves the efficiency of log transfer for both the control plane and workloads.Optimized
audit-proxy's audit logging ingestion by enablinggzipcompression.Improved security by adding file-integrity checks and fingerprint validation for Google-managed binary artifacts downloaded from Cloud Storage.
Added support for automatic periodic defragmentation of
etcdandetcd-eventson the control plane. This feature reduces unnecessary disk storage and helps to preventetcdand the control plane from becoming unavailable due to disk storage issues.Changed the metrics names for Kubernetes resource metrics to use a metrics prefix of
kubernetes.io/anthos/rather thankubernetes.io/. For details refer to the metrics reference documentation.Changed default
etcdversion to v3.4.21 on new clusters for improved stability. Existing clusters upgraded to this version will useetcdv3.5.6.Improved node resource management by reserving resources for the kubelet. While this feature is crucial for preventing Out of Memory (OOM) errors by ensuring system and Kubernetes processes have the resources they need, it may lead to workload disruptions. The reservation of resources for the kubelet may affect the available resources for Pods, potentially affecting the capacity of smaller nodes to handle existing workloads. Customers should verify that smaller nodes can still support their workloads with this new feature activated.
- The reserved memory percentages are as follows:
- 255 MiB for machines with less than 1GB of memory
- 25% of the first 4GB of memory
- 20% of the next 4GB
- 10% of the next 8GB
- 6% of the next 112GB
- 2% of any memory above 128GB
- The reserved CPU percentages are as follows:
- 6% of the first core
- 1% of the next core
- 0.5% of the next 2 cores
- 0.25% of any cores above 4 cores
- The reserved memory percentages are as follows:
1.25
Expanded the list of metrics collected from node pools to include gke-metrics-agent, cilium-agent, cilium-operator, coredns, fluentbit-gke, kubelet, and konnectivity-agent.
This release fixes the following vulnerabilities:
Application Integration Quick setup (GA)
Application Integration Quick setup is now generally available in all the supported Google Cloud locations.
Quick setup is a single-click operation that automatically provisions Application Integration with the default configurations needed to get you started with the product.
For more information, see Set up Application Integration.
The following supported default parsers have changed. Each is listed by product name and log_type value, if applicable.
- Akamai Enterprise Application Access (
AKAMAI_EAA) - AWS Cloudtrail (
AWS_CLOUDTRAIL) - AWS CloudWatch (
AWS_CLOUDWATCH) - Chrome Management (
N/A) - Cisco ASA (
CISCO_ASA_FIREWALL) - Cisco Email Security (
CISCO_EMAIL_SECURITY) - Cloud Audit Logs (
N/A) - Cloudflare WAF (
CLOUDFLARE_WAF) - Darktrace (
DARKTRACE) - Desynova Contido (
DESYNOVA_CONTIDO) - Duo Telephony Logs (
DUO_TELEPHONY) - Elastic Audit Beats (
ELASTIC_AUDITBEAT) - F5 BIGIP LTM (
F5_BIGIP_LTM) - Fidelis Network (
FIDELIS_NETWORK) - Gitlab (
GITLAB) - Imperva FlexProtect (
IMPERVA_FLEXPROTECT) - Island Browser logs (
ISLAND_BROWSER) - Juniper (
JUNIPER_FIREWALL) - Microsoft Azure Resource (
AZURE_RESOURCE_LOGS) - Microsoft Graph API Alerts (
MICROSOFT_GRAPH_ALERT) - Microsoft Sentinel (
MICROSOFT_SENTINEL) - Netscout OCI (
NETSCOUT_OCI) - Netskope Web Proxy (
NETSKOPE_WEBPROXY) - Office 365 (
OFFICE_365) - OpenSSH (
OPENSSH) - Palo Alto Networks Firewall (
PAN_FIREWALL) - ProofPoint Secure Email Relay (
PROOFPOINT_SER) - SentinelOne Deep Visibility (
SENTINEL_DV) - SentinelOne EDR (
SENTINEL_EDR) - Suricata IDS (
SURICATA_IDS) - Symantec DLP (
SYMANTEC_DLP) - Windows Defender ATP (
WINDOWS_DEFENDER_ATP) - Windows Event (
WINEVTLOG) - Windows Event (XML) (
WINEVTLOG_XML) - Workspace Activities (
WORKSPACE_ACTIVITY) - Workspace Alerts (
WORKSPACE_ALERTS) - Workspace Users (
WORKSPACE_USERS) - Zscaler (
ZSCALER_WEBPROXY)
For details about changes in each parser, see Supported default parsers.
The SAP ODP plugin version 0.7.5 is available in Cloud Data Fusion versions 6.6.0 to 6.8.0. This release includes the following changes:
- Fixed an issue causing duplicate records or loss of records due to package acknowledgement occurring too early.
- Filters that you apply are viewable in the logs.
Cloud Load Balancing is introducing new advanced cost, latency, and resiliency optimizations for your global external Application Load Balancer. These include the following capabilities:
- You can use a service load balancing policy to customize the parameters that influence how traffic is distributed within the backends associated with a backend service (for example, load balancing algorithm and auto-capacity draining).
- You can designate specific backends as preferred backends.
For details, see Advanced load balancing optimizations.
A Cloud Spanner multi-region instance configuration is now available in Asia - asia2 (Mumbai/Delhi/Singapore).
Config Connector version 1.109.0 is now available.
Added name validation for the customizable ControllerResource CRDs.
Field spec.containers is no longer required in the customizable ControllerResource CRDs.
- Added support for
CloudIOTDeviceRegistry(v1alpha1) resource.
Added support for ComputeRegionSSLPolicy (v1alpha1) resource.
Added support for VertexAIIndexEndpoint (v1alpha1) resource.
Resource BigtableGCPolicy(v1beta1):
- Fixed a bug that generates unexpected diff when
modeandgcRulesare both specified. - Fixed a bug that generates unexpected diff when
maxAgeingcRulesis specified with units larger than hours.
Resource AlloyDBCluster(v1alpha1):
- Added
spec.continuousBackupConfigfield. - Added
spec.restoreBackupSourcefield. - Added
spec.restoreContinuousBackupSourcefield. - Added
status.continuousBackupInfofield.
Resource ArtifactRegistryRepository(v1beta1):
- Added
spec.cleanupPoliciesfield. - Added
spec.cleanupPolicyDryRunfield.
Resource BigQueryTable(v1beta1):
- Added
spec.maxStalenessfield. - Added
spec.externalDataConfiguration.fileSetSpecTypefield.
Resource CloudBuildTrigger(v1beta1):
- Added
spec.gitFileSource.bitbucketServerConfigReffield. - Added
spec.sourceToBuild.bitbucketServerConfigReffield.
Resource CloudFunctions2Function(v1alpha1):
- Added
spec.kmsKeyNamefield.
Resource ComputeAddress(v1beta1):
- Added
spec.ipv6EndpointTypefield.
Resource ComputeBackendService(v1beta1):
- Added
spec.securityPolicyfield. - Added
spec.connectionTrackingPolicy.enableStrongAffinityfield.
Resource ComputeInstance(v1beta1):
- Added
spec.networkInterface.items.ipv6AccessConfig.items.namefield. - Added
spec.scheduling.localSsdRecoveryTimeoutfield.
Resource ComputeInstanceTemplate(v1beta1):
- Added
spec.disk.items.provisionedIopsfield. - Added
spec.networkInterface.items.ipv6AccessConfig.items.namefield. - Added
spec.scheduling.localSsdRecoveryTimeoutfield.
Resource ComputeSecurityPolicy(v1beta1):
- Added
spec.advancedOptionsConfig.userIpRequestHeadersfield.
Resource ComputeTargetInstance(v1beta1):
- Added
spec.securityPolicyReffield.
Resource ComputeTargetPool(v1beta1):
- Added
spec.securityPolicyReffield.
Resource ContainerCluster(v1beta1):
- Added
spec.allowNetAdminfield. - Added
spec.enableK8sBetaApisfield. - Added
spec.enableMultiNetworkingfield. - Added
spec.ipAllocationPolicy.additionalPodRangesConfigfield. - Added
spec.monitoringConfig.advancedDatapathObservabilityConfigfield. - Added
spec.nodeConfig.hostMaintenancePolicyfield.
Resource ContainerNodePool(v1beta1):
- Added
spec.networkConfig.additionalNodeNetworkConfigsfield. - Added
spec.networkConfig.additionalPodNetworkConfigsfield. - Added
spec.nodeConfig.hostMaintenancePolicyfield. - Added
spec.placementPolicy.policyNameReffield.
Resource DNSManagedZone(v1beta1):
- Removed
spec.privateVisibilityConfig.requiredfield.
Resource EventarcTrigger(v1beta1):
- Added
spec.eventDataContentTypefield.
Resource FirebaseAndroidApp(v1alpha1):
- Added
spec.apiKeyIdfield.
Resource FirebaseWebApp(v1alpha1):
- Added
spec.apiKeyIdfield.
Resource HealthcareFHIRStore(v1alpha1):
- Added
spec.defaultSearchHandlingStrictfield. - Added
spec.notificationConfigs.items.sendPreviousResourceOnDeletefield. - Added
spec.streamConfigs.items.bigqueryDestination.schemaConfig.lastUpdatedPartitionConfigfield.
Resource IAMWorkforcePoolProvider(v1beta1):
- Added
spec.oidc.clientSecretfield. - Added
spec.oidc.jwksJsonfield. - Added
spec.oidc.webSsoConfig.additionalScopesfield. - Added
status.oidcfield.
Resource MonitoringAlertPolicy(v1beta1):
- Added
spec.conditions.items.conditionPrometheusQueryLanguagefield.
Resource PubSubSubscription(v1beta1):
- Added
spec.cloudStorageConfigfield. - Added
spec.pushConfig.noWrapperfield.
Resource RunJob(v1beta1):
- Added
status.createTimefield. - Added
status.creatorfield. - Added
status.deleteTimefield. - Added
status.expireTimefield. - Added
status.lastModifierfield. - Added
status.updateTimefield.
Resource SecretManagerSecret(v1beta1):
- Added
spec.annotationsfield. - Added
spec.versionAliasesfield.
Resource SpannerDatabase(v1beta1):
- Added
spec.enableDropProtectionfield.
Resource SQLInstance(v1beta1):
- Added
spec.settings.ipConfiguration.pscConfigfield. - Added
status.dnsNamefield. - Added
status.pscServiceAttachmentLinkfield.
Resource WorkstationsWorkstationCluster(v1alpha1):
- Added
spec.privateClusterConfig.allowedProjectsfield.
Fixed spec.webhookConfig.secretRef field in CloudBuildTrigger.
Data Catalog is now available in Berlin (europe-west10). For more information on region and feature availability, see regions.
The following Dataflow templates are generally available (GA):
Looker (Google Cloud core) now supports the following regions:
- asia-southeast1 (Singapore)
- australia-southeast1 (Sydney)
- europe-west2 (London)
- europe-west3 (Frankfurt)
- me-west1 (Tel Aviv)
- us-east4 (Northern Virginia)
The Terraform provider for Memorystore for Redis Cluster is now available for use.
Cloud Storage Backint agent for SAP HANA version 1.0.28
Version 1.0.28 of the Cloud Storage Backint agent for SAP HANA is available. This version includes a new HTTP_READ_TIMEOUT parameter.
For more information about the agent, see Cloud Storage Backint agent for SAP HANA overview.
Vertex AI Prediction
The following prebuilt containers for prediction have been updated:
- tf2-cpu.2-12
- tf2-gpu.2-12
- tf2-cpu.2-11
- tf2-gpu.2-11
- tf2-cpu.2-10
- tf2-gpu.2-10
- tf2-cpu.2-9
- tf2-gpu.2-9
- tf2-cpu.2-8
- tf2-gpu.2-8
- sklearn-cpu.1-2
- xgboost-cpu.1-7
- pytorch-cpu.2-0
- pytorch-gpu.2-0
- pytorch-cpu.1-13
- pytorch-gpu.1-13
To update your containers, redeploy your models. To learn more, see Vertex AI framework support policy and Prebuilt containers for prediction.
September 05, 2023
Anthos Service MeshAnthos Service Mesh will begin creating Network Endpoint Groups (NEGs) for all services. This rollout will proceed gradually over a period of several months, starting with the rapid channel. You may notice the following annotations on each of your services: cloud.google.com/neg and cloud.google.com/neg-status.
You can view NEGs with the following command:
gcloud compute network-endpoint-groups list.
Managed Anthos Service Mesh 1.16 is rolling out in the stable channel. See Managed Anthos Service Mesh release channels for more information.
Documentation has been added to explain how to automatically retry some or all of the failed tasks for a job. For example, automatic task retries can help prevent job failures from temporary issues like Spot VM preemption, host events, and transient networking errors.
For more information, see Automate task retries.
The following resource types are now publicly available through the Search APIs (SearchAllResources, SearchAllIamPolicies).
IAM
iam.googleapis.com/PolicyV2
Anthos Multi-Cloud (previously GKE Multi-Cloud)
gkemulticloud.googleapis.com/AwsClustergkemulticloud.googleapis.com/AzureClustergkemulticloud.googleapis.com/AzureClientgkemulticloud.googleapis.com/AwsNodePoolgkemulticloud.googleapis.com/AttachedClustergkemulticloud.googleapis.com/AzureNodePool
Dataflow templates are available to stream Cloud Bigtable data change records to BigQuery or Pub/Sub. For more information, see Reading a change stream.
The SAP SuccessFactors Batch Source plugin version 1.2.1 is available in Cloud Data Fusion. The release includes the following changes:
Fixed an issue causing an inaccurate error message when the plugin's Associated Entity Name property is invalid.
Fixed an issue causing inaccurate validation errors when the Expand Fields property contains a macro.
Troubleshooting errors with Duet AI assistance is now available in Preview.
1.28 is now available in the Rapid channel
Kubernetes 1.28 is now available in the Rapid channel. For more information about the content of Kubernetes 1.28, read the Kubernetes 1.28 Release Notes.
New APIs
- The
kubectl auth whoami commandand theauthentication.k8s.io/v1 SelfSubjectReview APIenables checking the authenticated user information as seen by the server.
Deprecated API versions
These APIs are still served in version 1.28 but are in a deprecation period:
- The following Beta versions of graduated APIs will be removed in 1.29 in favor of newer versions:
flowcontrol.apiserver.k8s.io/v1beta2 FlowSchema, PriorityLevelConfiguration- deprecated since 1.26
- use
flowcontrol.apiserver.k8s.io/v1beta3instead, available since 1.26.
Deprecated in-tree volume support
- The Ceph CephFS (
kubernetes.io/cephfs) and RBD (kubernetes.io/rbd) volume plugins are deprecated in 1.28 and will be removed in a future release. - To determine if you have volumes or Pods using RBD or Ceph volumes, run the following commands. If either of them print output, then you are using a deprecated volume type.
kubectl describe pv | egrep -i 'Type: *(RBD|CephFS)'kubectl describe pod -A | egrep -i 'Type: *(RBD|CephFS)'
- Switch to use an RBD or CephFS CSI driver, such as the drivers provided in the Ceph CSI GitHub repo, or use a Google-managed solution such as Filestore. For more information, refer to the OSS Kubernetes announcement and the Ceph CSI GitHub repo.
(2023-R18) Version updates
GKE cluster versions have been updated.
New versions available for upgrades and new clusters
The following Kubernetes versions are now available for new clusters and for opt-in control plane upgrades and node upgrades for existing clusters. For more information on versioning and upgrades, see GKE versioning and support and Upgrades.
No channel
- The following control plane and node versions are now available:
The following control plane versions are no longer available: 1.23.17-gke.8400, 1.23.17-gke.10000, 1.23.17-gke.10700, 1.24.14-gke.1400, 1.24.14-gke.2100, 1.25.10-gke.2100, 1.26.5-gke.1400
Control planes and nodes with auto-upgrade enabled will be upgraded from version 1.23 to version 1.24.14-gke.2700 with this release.
Control planes and nodes with auto-upgrade enabled will be upgraded from version 1.24 to version 1.25.10-gke.2700 with this release.
Control planes and nodes with auto-upgrade enabled will be upgraded from version 1.25 to version 1.25.10-gke.2700 with this release.
Stable channel
- The following versions are now available in the Stable channel:
- The following versions are no longer available in the Stable channel: 1.23.17-gke.8400, 1.24.14-gke.1400, 1.25.10-gke.2100, 1.27.3-gke.1700
- Control planes and nodes with auto-upgrade enabled in the Stable channel will be upgraded from version 1.23 to version 1.24.14-gke.2700 with this release.
- Control planes and nodes with auto-upgrade enabled in the Stable channel will be upgraded from version 1.24 to version 1.25.10-gke.2700 with this release.
- Control planes and nodes with auto-upgrade enabled in the Stable channel will be upgraded from version 1.25 to version 1.25.10-gke.2700 with this release.
Regular channel
- The following versions are now available in the Regular channel:
- The following versions are no longer available in the Regular channel: 1.23.17-gke.10000, 1.24.14-gke.2700, 1.25.10-gke.2700, 1.26.5-gke.2700
- Control planes and nodes with auto-upgrade enabled in the Regular channel will be upgraded from version 1.23 to version 1.24.15-gke.1700 with this release.
- Control planes and nodes with auto-upgrade enabled in the Regular channel will be upgraded from version 1.24 to version 1.25.11-gke.1700 with this release.
- Control planes and nodes with auto-upgrade enabled in the Regular channel will be upgraded from version 1.25 to version 1.26.6-gke.1700 with this release.
- Control planes and nodes with auto-upgrade enabled in the Regular channel will be upgraded from version 1.26 to version 1.26.6-gke.1700 with this release.
Rapid channel
- Version 1.27.4-gke.900 is now the default version in the Rapid channel.
- The following versions are now available in the Rapid channel:
- The following versions are no longer available in the Rapid channel: 1.23.17-gke.10000, 1.23.17-gke.10700, 1.24.16-gke.500, 1.25.11-gke.1700, 1.26.6-gke.1700, 1.27.3-gke.1700
- Control planes and nodes with auto-upgrade enabled in the Rapid channel will be upgraded from version 1.23 to version 1.24.17-gke.200 with this release.
- Control planes and nodes with auto-upgrade enabled in the Rapid channel will be upgraded from version 1.24 to version 1.25.12-gke.500 with this release.
- Control planes and nodes with auto-upgrade enabled in the Rapid channel will be upgraded from version 1.25 to version 1.26.7-gke.500 with this release.
- Control planes and nodes with auto-upgrade enabled in the Rapid channel will be upgraded from version 1.26 to version 1.27.4-gke.900 with this release.
- Control planes and nodes with auto-upgrade enabled in the Rapid channel will be upgraded from version 1.27 to version 1.27.4-gke.900 with this release.
- Control planes and nodes with auto-upgrade enabled in the Rapid channel will be upgraded from version 1.28 to version 1.28.1-gke.200 with this release.
The recently released version of GKE, version 1.28, has a known regression in behavior. After node restart, Pods that have started initialization before the restart will run Init containers in-parallel with regular containers instead of waiting for Init containers to complete.
To deliver a better default price-performance for applications, all GKE Autopilot clusters with control plane version 1.27.5 and later will use an SSD-based persistent disk for ephemeral storage. This change will only affect newly created clusters and new node pools created in clusters upgraded to version 1.27.5 and later.
It is not yet possible to enable Gateway API support in GKE 1.28 (Standard or Autopilot), this will be fixed in an upcoming patch release to GKE 1.28. Clusters that already have Gateway API enabled before upgrading to GKE 1.28 will continue to be supported. This will not affect existing Gateways.
(2023-R18) Version updates
- The following control plane and node versions are now available:
The following control plane versions are no longer available: 1.23.17-gke.8400, 1.23.17-gke.10000, 1.23.17-gke.10700, 1.24.14-gke.1400, 1.24.14-gke.2100, 1.25.10-gke.2100, 1.26.5-gke.1400
Control planes and nodes with auto-upgrade enabled will be upgraded from version 1.23 to version 1.24.14-gke.2700 with this release.
Control planes and nodes with auto-upgrade enabled will be upgraded from version 1.24 to version 1.25.10-gke.2700 with this release.
Control planes and nodes with auto-upgrade enabled will be upgraded from version 1.25 to version 1.25.10-gke.2700 with this release.
(2023-R18) Version updates
- The following versions are now available in the Stable channel:
- The following versions are no longer available in the Stable channel: 1.23.17-gke.8400, 1.24.14-gke.1400, 1.25.10-gke.2100, 1.27.3-gke.1700
- Control planes and nodes with auto-upgrade enabled in the Stable channel will be upgraded from version 1.23 to version 1.24.14-gke.2700 with this release.
- Control planes and nodes with auto-upgrade enabled in the Stable channel will be upgraded from version 1.24 to version 1.25.10-gke.2700 with this release.
- Control planes and nodes with auto-upgrade enabled in the Stable channel will be upgraded from version 1.25 to version 1.25.10-gke.2700 with this release.
(2023-R18) Version updates
- The following versions are now available in the Regular channel:
- The following versions are no longer available in the Regular channel: 1.23.17-gke.10000, 1.24.14-gke.2700, 1.25.10-gke.2700, 1.26.5-gke.2700
- Control planes and nodes with auto-upgrade enabled in the Regular channel will be upgraded from version 1.23 to version 1.24.15-gke.1700 with this release.
- Control planes and nodes with auto-upgrade enabled in the Regular channel will be upgraded from version 1.24 to version 1.25.11-gke.1700 with this release.
- Control planes and nodes with auto-upgrade enabled in the Regular channel will be upgraded from version 1.25 to version 1.26.6-gke.1700 with this release.
- Control planes and nodes with auto-upgrade enabled in the Regular channel will be upgraded from version 1.26 to version 1.26.6-gke.1700 with this release.
(2023-R18) Version updates
- Version 1.27.4-gke.900 is now the default version in the Rapid channel.
- The following versions are now available in the Rapid channel:
- The following versions are no longer available in the Rapid channel: 1.23.17-gke.10000, 1.23.17-gke.10700, 1.24.16-gke.500, 1.25.11-gke.1700, 1.26.6-gke.1700, 1.27.3-gke.1700
- Control planes and nodes with auto-upgrade enabled in the Rapid channel will be upgraded from version 1.23 to version 1.24.17-gke.200 with this release.
- Control planes and nodes with auto-upgrade enabled in the Rapid channel will be upgraded from version 1.24 to version 1.25.12-gke.500 with this release.
- Control planes and nodes with auto-upgrade enabled in the Rapid channel will be upgraded from version 1.25 to version 1.26.7-gke.500 with this release.
- Control planes and nodes with auto-upgrade enabled in the Rapid channel will be upgraded from version 1.26 to version 1.27.4-gke.900 with this release.
- Control planes and nodes with auto-upgrade enabled in the Rapid channel will be upgraded from version 1.27 to version 1.27.4-gke.900 with this release.
- Control planes and nodes with auto-upgrade enabled in the Rapid channel will be upgraded from version 1.28 to version 1.28.1-gke.200 with this release.
Support for IPv6 static routes with the following next hops is generally available (GA):
next-hop-gatewaynext-hop-instance
Preview: Workload Manager is now available for SQL Server workloads. For more information, see the Product overview.
September 04, 2023
Cloud Composer(Cloud Composer 2) An update that enforces VPC Service Controls perimeter settings for accessing Airflow UI and Airflow REST API is rolled out to all regions. As a result of this change, certain users that could previously access the Airflow UI or Airflow REST API might not be able to do it now.
If you experience problems with access to Airflow UI or Airflow REST API, update the perimeter or access level configuration for affected users. For more information on configuring VPC Service Controls see Configure VPC Service Controls.
Announcing the General Availability (GA) release of Data Lineage for Dataproc, which captures data transformations (lineage events) in Dataproc Spark jobs, and publishes them to Dataplex Lineage.
Dataproc Serverless Interactive sessions detail and list pages are now available in the Google Cloud console.
September 01, 2023
Anthos clusters on VMwareAnthos clusters on VMware 1.15.4-gke.37 is now available. To upgrade, see Upgrading Anthos clusters on VMware. Anthos clusters on VMware 1.15.4-gke.37 runs on Kubernetes 1.26.7-gke.2500.
Upgrading an admin cluster with always-on secrets encryption enabled might fail.
An admin cluster upgrade from 1.14.x to 1.15.0 - 1.15.4 with always-on secrets encryption enabled might fail depending on whether the feature was enabled during cluster creation or during cluster update.
We recommend that you don't upgrade your admin cluster until a fix is available in 1.15.5. If you must upgrade to 1.15.0-1.15.4, do the steps in Preventing the upgrade failure before upgrading the cluster.
For information on working around an admin cluster failure because of this issue, see Upgrading an admin cluster with always-on secrets encryption enabled fails. Note that the workaround relies on you having the old encryption key backed up. If the old key is no longer available, you will have to recreate the admin cluster and all user clusters.
The following issues are fixed in 1.15.4-gke.37:
Fixed a known issue where incorrect log rotation configuration for fluent-bit caused low disk space on the Seesaw VM.
Fixed a known issue that GARP reply sent by Seesaw doesn't set target IP.
Fixed an issue where
/etc/vsphere/certificate/ca.crtwasn't updated after vsphere CA rotation on the Controlplane v2 user cluster control plane machines.Fixed a known issue where the admin SSH public key has error after admin cluster upgrade or update.
The following vulnerabilities are fixed in 1.15.4-gke.37:
High-severity container vulnerabilities:
Container-Optimized OS vulnerabilities:
The Japan Regions compliance program is now in Preview.
Cloud Build's free tier now offers the e2-standard-2 machine type as the new default machine type. The free tier now offers 2,500 build-minutes per month to provide you with more flexibility to use free build-minutes however you want throughout the month instead of being limited to a daily allocation. Changes to the Cloud Build free tier are effective as of September 1, 2023. To learn more, see Cloud Build pricing.
Starting on September 1, 2023, a new automation policy is in effect where GKE automatically starts a credential rotation within 30 days of your cluster's certificate authority expiry date to ensure that your cluster doesn't have a complete outage. For example, if your cluster's CA expires on 2024-01-05, an automatic rotation starts on or after 2023-12-06. Automatic credential rotation is a critical update that ignores any configured maintenance windows.
This automatic rotation might cause API clients outside the cluster, such as kubectl in a local environment, to stop working unless you update those clients to use the new credentials.
You should plan for and perform credential rotations well in advance of your cluster CA expiring to ensure a smooth transition to new credentials and minimal workload disruptions. Don't rely on automatic rotation; it is intended to be a last resort to prevent complete outages. To learn more about the stages of credential rotation, see Rotate your cluster's credentials.
Pricing update
The pricing for text-bison has been reduced to $0.0005 per 1,000 input and output characters. For details, see Vertex AI Pricing.
August 31, 2023
Apigee hybridhybrid v1.10.3
On August 31, 2023 we released an updated version of the Apigee hybrid software, v1.10.3.
- For information on upgrading, see Upgrading Apigee hybrid to version 1.10.
- For information on new installations, see The big picture.
| Bug ID | Description |
|---|---|
| 295929616 | Installation of Hybrid 1.10.x would fail on OpenShift due to out of memory issues. |
| 292571089 | An error with support for CSI backup and restore for Cassandra was fixed. |
| 287321226 | Security context has been corrected for apigee-prom-prometheus to avoid privilege escalation. |
| Bug ID | Description |
|---|---|
| 296717665, 296717664, 296717663, 296717662, 296717185, 296716666, 296716649, 296716632, 296716468, 296716467, 296716232, 296715152, 296715151, 296714218 |
Security fixes for apigee-cassandra-backup-utility. This addresses the following vulnerabilities: |
| 297938600, 297938559, 297938486, 294892344 |
Security fixes for apigee-diagnostics-collector. This addresses the following vulnerabilities: |
| 297938498, 297938487 |
Security fixes for apigee-fluent-bit. This addresses the following vulnerabilities: |
| 296719459, 296719400, 296719348, 296719307, 296719306, 296719188, 296719187, 296719186, 296719115, 296719018, 296718937, 296718918, 296718917, 296718916, 296716670, 296716669, 296716472, 296716471, 296715155 |
Security fixes for apigee-hybrid-cassandra. This addresses the following vulnerabilities: |
| 296717666, 296717283, 296716668, 296716667, 296716650, 296716635, 296716634, 296716633, 296716470, 296716234, 296715734, 296715733, 296715154, 296715153 |
Security fixes for apigee-hybrid-cassandra-client. This addresses the following vulnerabilities: |
| 297286274 | Security fixes for apigee-installer. This addresses the following vulnerabilities: |
| 295936113 | Security fixes for apigee-mart-server. This addresses the following vulnerability: |
| 297938441 | Security fixes for apigee-runtime. This addresses the following vulnerabilities: |
| 294906706 | Security fixes for apigee-prom-prometheus. This addresses the following vulnerabilities:
|
| 293925856 | Security fixes for apigee-prometheus-adapter. This addresses the following vulnerabilities: |
You can now use EXPORT DATA statements to directly export BigQuery data to Cloud Bigtable. This feature is in Preview.
The pgvector extension, version 0.4.2 is generally available. Use this extension to store and search for vector embeddings in PostgreSQL databases.
A monthly digest of client library updates from across the Cloud SDK.
Go
Changes for spanner/admin/database/apiv1
1.48.0 (2023-08-18)
Features
- spanner/spansql: Add complete set of math functions (#8246) (d7a238e)
- spanner/spansql: Add support for foreign key actions (#8296) (d78b851)
- spanner/spansql: Add support for IF NOT EXISTS and IF EXISTS clause (#8245) (96840ab)
- spanner: Add integration tests for Bit Reversed Sequences (#7924) (9b6e7c6)
Bug Fixes
- spanner: Reset buffer after abort on first SQL statement (#8440) (d980b42)
- spanner: REST query UpdateMask bug (df52820)
1.49.0 (2023-08-24)
Features
Bug Fixes
Java
Changes for google-cloud-spanner
6.45.0 (2023-08-04)
Features
- Enable leader aware routing by default in Connection API. This enables its use in the JDBC driver and PGAdapter. The update contains performance optimisations that will reduce the latency of read/write transactions that originate from a region other than the default leader region. (2a85446)
- Enable leader aware routing by default. This update contains performance optimisations that will reduce the latency of read/write transactions that originate from a region other than the default leader region. (441c1b0)
- Long running transaction clean up background task. Adding configuration options for closing inactive transactions. (#2419) (423e1a4)
- Support partitioned queries + data boost in Connection API (#2540) (4e31d04)
Bug Fixes
Dependencies
- Update dependency com.google.cloud:google-cloud-shared-dependencies to v3.14.0 (#2562) (dbd5c75)
- Update dependency org.openjdk.jmh:jmh-core to v1.37 (#2565) (d5c36bf)
- Update dependency org.openjdk.jmh:jmh-generator-annprocess to v1.37 (#2566) (73e92d4)
6.45.1 (2023-08-11)
Bug Fixes
6.45.2 (2023-08-14)
Bug Fixes
6.45.3 (2023-08-17)
Bug Fixes
Node.js
Changes for @google-cloud/spanner
6.15.0 (2023-08-04)
Features
- Enable leader aware routing by default. This update contains performance optimisations that will reduce the latency of read/write transactions that originate from a region other than the default leader region. (6852d99)
6.16.0 (2023-08-07)
Features
Bug Fixes
Python
Changes for google-cloud-spanner
3.39.0 (2023-08-02)
Features
Documentation
3.40.0 (2023-08-04)
Features
- Enable leader aware routing by default. This update contains performance optimisations that will reduce the latency of read/write transactions that originate from a region other than the default leader region. (e8dbfe7)
3.40.1 (2023-08-17)
Bug Fixes
Legacy Dataform will be deprecated on February 26, 2024, after which you will not be able to access legacy projects.
We recommend migration to Dataform in Google Cloud Platform.
To learn more about Dataform in Google Cloud Platform, see Overview of Dataform.
To discover how to migrate legacy projects, see Migrate from legacy Dataform.
Dialogflow CX generative features are now GA and publicly available:
Dialogflow CX answer feedback is now GA, but access is limited and must be requested.
Dialogflow CX Messenger has been redesigned and is now GA. This new version of the integration replaces the old version, which has been renamed Legacy Dialogflow Messenger. The old version is now deprecated, and it is recommended that all users of the old version migrate to the new version.
Eventarc support for creating triggers for direct events from the following sources is generally available (GA):
- AlloyDB for PostgreSQL
- API Gateway
- Apigee Registry
- Backup for GKE
- BeyondCorp
- Certificate Manager
- Cloud Data Fusion
- Cloud Dataplex
- Cloud Functions
- Cloud Memorystore for Memcached
- Database Migration
- Dataflow
- Dataproc Metastore
- Datastream
- Firebase Alerts
- Firebase Remote Config
- Firebase Test Lab
- GKE Hub
- Google Cloud Memorystore for Redis
- Network Connectivity
- Network Management
- Transcoder
- User-managed notebooks (Notebooks)
- Vision AI
- VM Migration
- Workflows
For GKE nodes running version 1.25 and later, when Image streaming is enabled, the mv command and renameat2 system call might fail on symlink files in container images with the error message "No such device or address". The issue is caused by a regression on recent Linux kernels. GKE does not currently have a fix for the issue. To learn more, see the troubleshooting section for this issue.
Experiment management: Google Cloud console now supports visualization of your model's performance changes over steps during training, and shows advanced run comparisons. To learn more, see Compare and analyze runs: Google Cloud console.
reCAPTCHA Enterprise for WAF and Google Cloud Armor integration is now available for mobile applications in Public Preview. For more information, see Integrate with Google Cloud Armor for mobile applications.
August 30, 2023
Bare Metal SolutionYou can now view and respond to maintenance events through Google Cloud console. This feature is generally available (GA). For more information, see Manage maintenance events.
You can now use EXPORT DATA statements to directly export BigQuery data to Bigtable. This feature is in preview.
Release Notes 6.2.34
- Alerts ingested using webhooks are missing details (ID #00249611)
- Entity Graph widget either not appearing or appearing without information (ID #00246250, #46124390)
- Entity Graph API call not working
Database Migration Service support for Oracle to Cloud SQL for PostgreSQL migrations is now generally available (GA). For more information, see Database Migration Service for Oracle to PostgreSQL documentation.
Integrated code and schema conversion for Oracle to Cloud SQL for PostgreSQL migrations is now available in Preview. With this feature, Database Migration Service conversion workspaces provide an inline editor to help make your schema conversions simple and seamless.
Generally available: NVIDIA L4 GPUs are now available in the following additional regions and zones:
- APAC
- Taiwan (
asia-east1-a,c) - Tokyo (
asia-northeast1-a,c) - Singapore(
asia-southeast1-c)
- Taiwan (
- Europe
- Belgium (
europe-west1-c) - London (
europe-west2-a,b)
- Belgium (
- North America
- Northern virginia (
us-east4-c) - Dalles (
us-west1-c)
- Northern virginia (
For more information about using GPUs on Compute Engine, see GPU platforms.
GKE now supports the ability to create nodes and workloads with multiple network interfaces. You can create new clusters with version 1.27 and later with multi networking enabled. The additional network interfaces on the Pods can be regular interfaces or high performance interfaces where the network interface is directly attached to the Pod. For more information, see Setup multi-network support for Pods.
Your clusters can now perform operations, such as node auto-provisioning or version upgrades, on multiple node pools in parallel. You no longer have to wait for an operation to complete before you initiate another operation. This feature is enabled for all GKE versions. This change provides you with benefits like the following:
- More efficient scaling, which results in improved savings and faster workload deployment
- Faster, less disruptive node pool upgrades
- Fewer "operation already in progress" messages that could delay subsequent planned operations
- More reliable rollback behavior to fix upgrade-related disruptions in production
- Automatic control plane resize operations won't block other operations on the cluster
The Google Cloud Platform Terraform provider has also been updated to take advantage of this change.
You can add Resource Manager tags to supported VPC resources. For more information, see Create and manage tags for VPC resources.
August 29, 2023
Access TransparencyAccess Transparency supports GKE Connect and GKE Hub in the GA stage.
AlloyDB AI, a suite of features for building generative AI applications, is now available with both AlloyDB and AlloyDB Omni. These features include the following:
The AlloyDB machine learning (ML) extension introduces an
embeddingSQL function. It lets you create vector embeddings from text using ML models. You can store these embeddings as vector data, and apply them as input topgvectorfunctions.AlloyDB support for the
pgvectorextension brings performance enhancements for vector queries that run up to ten times faster than standard PostgreSQL, including an optimization that lets you create indexes of stored vector data using scalar quantization.
AlloyDB Omni version 15.2.0 is available in Preview. This version includes the following:
- Compatibility with PostgreSQL server version 15
- A command-line interface for easier installation and maintenance of AlloyDB Omni
- Integration with Vertex AI
- Guides for data protection using Barman and pglogical
- Various bug fixes and query performance improvements
A separate Technology Preview edition of AlloyDB Omni is available. It lets you experiment with AlloyDB AI functionality using two included machine learning models trained on Google News text.
In AlloyDB Omni version 15.2.0, using the COPY function with the FREEZE option is disabled, due to a potential performance issue when loading large datasets.
Artifact Analysis automatic scanning for Python and Node.js (npm) vulnerabilities in container images is now generally available. If the Container Scanning API is enabled, it scans container images pushed to Artifact Registry for Python and Node.js vulnerabilities, in addition to operating system vulnerabilities.
Artifact Analysis returns Python and Node.js vulnerability results for images that have a supported or unsupported operating system. When you push new versions of images to the registry, you might see more successful vulnerability scans and corresponding charges against images without a supported operating system.
For more information, see Python overview and Node.js overview.
Artifact Analysis now offers support for Vulnerability Exploitability eXchange (VEX). VEX is a type of security advisory that indicates whether a product is affected by a known vulnerability. For every container image pushed to Artifact Registry, Artifact Analysis can store an associated VEX statement.
You can upload VEX files to describe any vulnerabilities discovered in specific artifacts and provide context about their impact. VEX statuses can be used to assist your organization in triaging vulnerabilities.
This feature is in Preview. To learn more, see Upload and view VEX statements.
Artifact Analysis now offers the ability to export a consolidated software bill of materials (SBOM) for scanned containers in Artifact Registry. SBOMs are generated in the Software Package Data Exchange (SPDX) format; however, you can also ingest externally created SBOMs in either SPDX or CycloneDx formats. With this new capability, you can centrally manage SBOMs to gain visibility into key information about your software supply chain.
This feature is in Preview. To learn more about our SBOM capabilities, see SBOM overview.
Documentation has been added to explain the VM OS environment for Batch. For a job's VMs, you can optionally configure the OS image and/or boot disk properties. Otherwise, a job uses the default configuration.
For more information, see the following pages:
Data clean rooms is now in preview. Data clean rooms provide a secure environment in which multiple parties can share, join, and analyze their data assets without moving or revealing the underlying data. To learn more, see the following topics:
Duet AI in BigQuery, an AI-powered collaborator in Google Cloud, can help you complete, generate, and explain SQL queries. This feature is in preview.
BigQuery Studio is now in preview. BigQuery Studio offers features to make it easier for you to discover, explore, analyze, and run inference on data in BigQuery, including:
- Python notebooks, powered by Colab Enterprise. Notebooks provide one-click Python development runtimes, and built-in support for BigQuery DataFrames.
- Asset management and version history for notebooks and saved queries, powered by Dataform.
BigQuery DataFrames is now in preview. BigQuery DataFrames is a Python API that you can use to analyze data and perform machine learning tasks in BigQuery. BigQuery DataFrames consists of the following parts:
bigframes.pandasimplements a DataFrame API (with partial Pandas compatibility) on top of BigQuery.bigframes.mlimplements a Python API for BigQuery ML (with partial scikit-learn compatibility).
Get started with BigQuery DataFrames by using the BigQuery DataFrames quickstart.
The following Generative AI features are now generally available (GA) in BigQuery ML:
- Creating a remote model based on the Vertex AI large language model (LLM) text-bison.
- Using the
ML.GENERATE_TEXTfunction with an LLM-based remote model to perform generative natural language tasks on text stored in BigQuery tables.
Try these features with the Generate text by using a remote model and the ML.GENERATE_TEXT function tutorial.
You can now configure Cloud Build to generate Google-signed identity tokens for user-specified service accounts during a build. Leveraging identity tokens with Cloud Build, you can:
Identity tokens that you generate with Cloud Build conform to the OpenID Connect (OIDC) specification.
This feature is generally available.
You can use intrusion prevention service to safeguard your workload traffic from threats such as malware, spyware, and command-and-control attacks. This feature is available in Preview.
Cloud Functions (2nd gen) is now the default choice in the Google Cloud console user interface.
Summarizing log entries with Duet AI assistance is now available in Preview.
Spanner Studio includes Duet AI (in Preview), an AI-powered collaborator in Google Cloud that accelerates SQL development by helping you write SQL statements. For more information, see Write SQL with Duet AI assistance.
You can now create Cloud Tensor Processing Unit (TPU) nodes in Google Kubernetes Engine (GKE) to run AI workloads, from training to inference models. GKE manages your cluster by automating TPU resource provisioning, scaling, scheduling, repairing, and upgrading. GKE provides TPU infrastructure metrics in Cloud Monitoring, TPU logs, and error reports for better visibility and monitoring of TPU node pools in GKE clusters. TPUs are available with GKE Standard clusters. GKE supports TPU v4 in version 1.26.1.gke-1500 and later, and supports TPU v5e in version 1.27.2-gke.1500 and later. To learn more, see TPUs in GKE introduction.
Duet AI for Cloud Workstations is available in Preview. Use Duet AI, your AI-powered collaborator, to accomplish tasks more effectively and efficiently. Duet AI provides contextualized responses to your prompts to help guide you on what you're trying to do with your code. It also shares source citations regarding which documentation and code samples the assistant used to generate its responses. You can do this in the Cloud Workstations base editor. For more information, see the Duet AI in Google Cloud overview and Code with Duet AI assistance.
Colab Enterprise is now available in Preview. Colab Enterprise combines the popular collaborative features of Colaboratory with the security and compliance capabilities of Google Cloud. Colab Enterprise includes:
- Sharing and collaborating functionality, with IAM access control.
- Google-managed compute and runtime provisioning, with configurable runtime templates.
- Integrations with Vertex AI and BigQuery.
- Inline code completion with Duet AI assistance.
- End-user credential authentication for running your notebook code.
To get started, see Introduction to Colab Enterprise or create a notebook and start coding.
Preview: You can use future reservations to reserve resources at a specific date and time in the near future.
Future reservations are useful for obtaining capacity for future peak-demand events or highly-demanded resources. For more information, see About future reservation requests.
Announcing the Preview release of Dataproc Serverless for Spark Interactive sessions and the Dataproc Jupyter Plugin.
You can now create Cloud Tensor Processing Unit (TPU) nodes in GKE to run AI workloads, from training to inference models. GKE manages your cluster by automating TPU resource provisioning, scaling, scheduling, repairing, and upgrading. GKE provides TPU infrastructure metrics in Cloud Monitoring, TPU logs, and error reports for better visibility and monitoring of TPU node pools in GKE clusters. TPUs are available with GKE Standard clusters. GKE supports TPU v4 in version 1.26.1.gke-1500 and later, and supports TPU v5e in version 1.27.2-gke.1500 and later. To learn more, see About TPUs in GKE.
You can now sequence the rollout of cluster upgrades across fleets or across scopes. To learn more, see About cluster upgrades with rollout sequencing.
Imagen on Vertex AI now offers the following Generally Available (GA) features:
* Restricted access feature.
For more information about Imagen or how to get access to restricted GA features, see the Imagen on Vertex AI overview.
Stream responses from Generative AI models
Generative AI model streaming support is now Generally Available (GA). After you send a prompt, the model returns response tokens as they're generated instead of waiting for the entire output to be available.
Supported models are:
text-bisonchat-bisoncode-bisoncodechat-bison
To learn more, see Stream responses from Generative AI models.
New Generative AI support on Vertex AI models and expanded language support
Generative AI support on Vertex AI has been updated to include new language model candidates (latest models), language models that support input and output tokens up to 32k, and more supported languages.
For details, see Available models and Model versions and lifecycle.
Model tuning for the text-bison model is now Generally Available (GA)
Tuning the text-bison model with supervised fine-tuning (SFT) is now Generally Available (GA) .
For more information, see Tune text models.
Model tuning for the chat-bison model is now available in Preview
You can now use supervised fine-tuning to tune the chat-bison model. This feature is in (Preview).
For more information, see Tune text models.
New embedding model now available in Preview
Generative AI support on Vertex AI users can now create embeddings using a new model trained on a wide range of non-English languages in (Preview).
textembedding-gecko-multilingual
To learn more, see Get text embeddings.
Reinforcement learning from human feedback (RLHF) tuning for text-bison
The Generative AI text generation foundation model (text-bison) now supports RLHF tuning. The RLHF tuning feature is in (Preview).
For more information, see Use RLHF model tuning.
Vertex AI Codey APIs language support
Vertex AI Codey APIs now support additional programming languages. For more information, see Supported coding languages
Vertex AI Codey APIs now support supervised fine-tuning (SFT)
The code chat (codechat-bison) and code generation (code-bison) Vertex AI Codey APIs models now support supervised fine-tuning (SFT). The supervised-fine tuning for Vertex AI Codey APIs models feature is in (Preview). For more information, see Tune code models.
Metrics-based model evaluation
You can evaluate the performance of foundation models and tuned models against an evaluation dataset for classification, summarization, question answering, and general text generation. This feature is available in (Preview).
To learn more, see Evaluate model performance.
Vertex AI Vector Search is the new product name for Vertex AI Matching Engine.
Vertex AI Model Registry Models and Vertex AI Datasets are now synced to Dataplex's Data Catalog. Data Catalog enables organization-wide search and discovery of data artifacts, while still maintaining IAM boundaries. The sync and search of these assets is available in Preview. For more information, see Data Catalog documentation.
CountToken API now available in Preview
The CountToken API is now available in (Preview). You can use this API to get the token count and the number of billable characters for a prompt. To learn more, see Get token count.
The Vertex AI Pipelines Template Gallery is now generally available (GA). The Template Gallery contains Google-authored pipeline and component templates to bootstrap your MLOps practice. Customize and run the templates as-is or embed them into your own pipelines. For more information, see Use a prebuilt template from the Template Gallery.
Vertex AI Search and Conversation is the new product name for Generative AI App Builder.
Generative AI App Builder: GA
Gen AI App Builder is publicly and generally available (GA).
Separation of data stores and apps
Data stores and apps are separate entities. In the console, you can see your apps on the Apps page and your data stores on the Data Stores page. You can create a data store and attach it to an app during app creation, or create a new data store during app creation.
Apps and data stores have a one-to-one relationship. Each app is associated with one data store; they can't be disconnected after you attach them. This change does not affect the functionality of your existing apps.
Enterprise Search: Search with follow-ups is GA
Previously, the search with follow-ups feature was called multi-turn search.
Search with follow-ups is now generally available (GA).
Search with follow-ups can be applied to websites if advanced website indexing is enabled and to unstructured data.
In addition, to improve consistency between search with an answer and search with follow-ups, the response from the conversations.converse method v1 provides the summary object and no longer provides the reply and references objects. The response from the v1beta version of the method remains unchanged.
SafeSearch is available with the search with follow-ups feature.
For general information about search with follow-ups, see Search with follow-ups.
Enterprise Search: Improvements to snippets, extractive answers, and extractive segments
Snippet status is now returned along with the snippet.
Extractive answers include the document page number where the answer was found.
Up to 10 extractive segments can be returned for a search result.
Enterprise Search: Multi-region support for US and EU locations
When you create a data store, you can specify global, the US multi-region, or the EU multi-region.
For more information including limitations associated with multi-region use, see Enterprise Search locations.
Enterprise Search: Languages
More features in more languages are supported for Enterprise Search.
See Languages.
Enterprise Search: Verify website domains
New requirement to verify your domain ownership for any websites in your data stores with advanced website indexing turned on.
Enterprise Search: Confidence scores
Confidence scores for extractive segments are available in preview with allowlist. Scores are based on the similarity of the query to the extracted segment.
See Extractive segments.
Enterprise Search: Serving controls using the API are allowlisted GA
Boost, filter, synonym, and redirect serving controls affect search results returned through API method calls.
For more information, see Configure serving controls.
Enterprise Search: Related questions
Related questions are available as an allowlisted, preview feature for search with follow-ups.
For information, see Related questions.
August 28, 2023
Access ApprovalAccess Approval supports Anthos Identity Service in the GA stage.
The support policy and schedule for Google Cloud's buildpacks is now available at https://cloud.google.com/docs/buildpacks/support-policy.
You can now use Cloud Monitoring to customize and receive notifications about ingestion health metrics. For more information, see Ingestion notifications for health metrics.
The following resource types are now publicly available through the ExportAssets, ListAssets, BatchGetAssetsHistory, QueryAssets, and Feed APIs.
- Financial Services
financialservices.googleapis.com/Instance
- Discovery Engine
discoveryengine.googleapis.com/Collectiondiscoveryengine.googleapis.com/DataStore
Cloud Bigtable is available in the europe-west10 (Berlin) region. For more information, see Bigtable locations.
The Natural Language API v2 is now available in Public Preview. This new version of the API supports Sentiment Analysis, Entity Analysis, Text Moderation, and Content Classification. This version has major updates for Sentiment Analysis and Entity Analysis, which include performance upgrades and general improvements. All API calls now return language_code .
Sentiment analysis uses a new PaLM-based model for improved quality. The language field is now called language_code.
Entity analysis uses a new PaLM-based model for improved quality. Please note the following updates:
- language field is now called "language_code"
- No salience field.
- No wikipedia_url as metadata.
- Parsing improvements for the following entity types: PHONE_NUMBER, ADDRESS, DATE, NUMBER, PRICE
- New probability score field is returned for all entities where NUMBER, PHONE_NUMBER, ADDRESS, PRICE, DATE will always be 1.0.
You can now set password policies for local database users of Cloud SQL for PostgreSQL instances.
The sum() and avg() aggregation functions are now available for Firestore in Datastore mode.
A weekly digest of client library updates from across the Cloud SDK.
Go
Changes for datastore/admin/apiv1
1.14.0 (2023-08-22)
Features
- datastore: SUM and AVG aggregations (#8307) (a9fff18)
- datastore: Support aggregation query in transaction (#8439) (37681ff)
Bug Fixes
- datastore: Correcting string representation of Key (#8363) (4cb1211)
- datastore: Fix NoIndex for array property (#7674) (01951e6)
Documentation
- datastore/admin: Specify limit for
propertiesinIndexmessage in Datastore Admin API (b890425)
Java
Changes for google-cloud-datastore
2.17.0 (2023-08-22)
Features
- Publish proto definitions for SUM/AVG in Datastore (#1157) (954320a)
- Sum and Avg aggregation feature (#1067) (56d1001)
Dependencies
- Update dependency com.google.errorprone:error_prone_core to v2.21.1 (#1163) (83158b6)
- Update dependency org.graalvm.buildtools:junit-platform-native to v0.9.24 (#1165) (4094c70)
- Update dependency org.graalvm.buildtools:native-maven-plugin to v0.9.24 (#1166) (70cc371)
Documentation
Version 4.80.0 of the Terraform provider for Google Cloud fixes an issue observed when deploying new GKE Autopilot clusters that would destroy and re-create the cluster due to a change in the dns_config state. This version of the provider ensures that customers can deploy GKE Autopilot clusters using Cloud DNS as the default in-cluster DNS provider. For more information, see Terraform plans to re-create Autopilot cluster due to dns_config change.
A weekly digest of client library updates from across the Cloud SDK.
Node.js
Changes for @google-cloud/pubsub
4.0.2 (2023-08-24)
Bug Fixes
Tabular Workflow for Forecasting is available in Preview. For documentation, refer to Tabular Workflow for Forecasting.
August 26, 2023
Cloud Composer(Cloud Composer versions 1.x.x and 2.0.x): Creating Cloud Composer environments in projects with VPC Service Controls enabled fails if you add Cloud Identity-Aware Proxy API or Identity-Aware Proxy TCP API to the security perimeter.
For more information and possible workarounds, see Environment creation fails in projects with VPC Service Controls enabled.
Posit Workbench (including RStudio Pro) integration is generally available (GA). For more information, see Develop code using Posit Workbench.
August 25, 2023
Access ApprovalAccess Approval supports Memorystore for Redis in the GA stage.
Release 1.16.0
Anthos clusters on bare metal 1.16.0 is now available for download. To upgrade, see Upgrading Anthos on bare metal. Anthos clusters on bare metal 1.16.0 runs on Kubernetes 1.27.
Version 1.13 end of life: In accordance with the Anthos Version Support Policy, version 1.13 (all patch releases) of Anthos clusters on bare metal has reached its end of life and is no longer supported.
Red Hat Enterprise Linux (RHEL) 8 minor versions 8.2, 8.3, 8.4, and 8.5 have reached their end of life. Please ensure you're using a supported version of your operating system.
Cluster lifecycle:
Upgraded to Kubernetes version 1.27.4.
Added support for Red Hat Enterprise Linux (RHEL) version 8.8.
GA: Added support for parallel upgrades of worker node pools.
GA: Added support to upgrade specific worker node pools separately from the rest of the cluster.
GA: Added a separate instance of etcd for the
etcd-eventsobject. This new etcd instance is always on and requires ports 2382 and 2383 to be open on control plane nodes for inbound TCP traffic. If these ports aren't opened, cluster creation and cluster upgrades are blocked.GA: Updated preflight checks for cluster installation and upgrades to use changes from the latest Anthos clusters on bare metal patch version to address known issues and provide more useful checks.
GA: Support enrolling admin and user clusters in the Anthos On-Prem API automatically to enable cluster lifecycle management from the Google Cloud CLI, the Google Cloud console, and Terraform when the Anthos On-Prem API is enabled. If needed, you have the option to disable enrollment. For more information, see the description for the
gkeOnPremAPIfield in the cluster configuration file.GA: Added ability to configure kubelet image pull settings for node pools. For more information, see Configure kubelet image pull settings.
Added new health check to detect any unsupported drift in the custom resources managed by Anthos clusters on bare metal. Unsupported resource changes can lead to cluster problems.
Added a new flag,
--target-cluster-name, that is supported by thebmctl register bootstrapcommand.
Networking:
GA: Added support for Services of type LoadBalancer to use
externalTrafficPolicy=Localwith bundled load balancing with BGP.Preview: Added support for enabling Direct Server Return (DSR) load balancing for clusters configured with flat-mode networking. DSR load balancing is enabled with an annotation,
preview.baremetal.cluster.gke.io/dpv2-lbmode-dsr: enable.Preview: Upgraded wherabouts to v0.6.1-gke.1 to support dual-stack networking.
Added support for multiple BGP load balancer (
BGPLoadBalancer) resources and BGP Community. Multiple BGP load balancer resources provide more flexibility to define which peers advertise specific load balancer nodes and Services. BGP Community support helps you to distinguish routes coming from BGP load balancers from other routes in your network.
Observability:
- GA: Added support for system metrics when you use Google Cloud Managed Service for Prometheus.
Security and Identity:
GA: Added support for Binary Authorization, a service on Google Cloud that provides software supply-chain security for container-based applications. For more information, see Set up Binary Authorization policy enforcement.
GA: Added support for VPC Service Controls, which provides additional security for your clusters to help mitigate the risk of data exfiltration.
Preview: Added support for using custom cluster certificate authorities (CAs) to enable secure authentication and encryption between cluster components.
Preview: Added support for configuring the Subject Alternative Names (SANs) of the kubeadm generated certificate for the kube-apiserver.
Added support to run keepalived as a non-root user.
Supported node pool versions:
If you use selective worker node pool upgrades to upgrade a cluster to version 1.16.0, the following versions are supported for the worker node pools:
- 1.16.0
- 1.15.3
- 1.15.2
- 1.15.1
- 1.15.0
For more information about node pool versions, see Node pool version rules.
Functionality changes:
Updated constraint on NodePool
spec.upgradeStrategy.concurrentNodesto be the smaller of 15 nodes or 50% of the size of the node pool.Replaced legacy method of enabling application logging in the cluster configuration file with two fields,
enableCloudLoggingForApplicationsandenableGMPForApplications, in the stackdriver custom resource.The
spec.clusterOperations.enableApplicationfield in the cluster configuration file has no effect on version 1.16.0 and higher clusters. This field populated theenableStackdriverForApplicationsfield in the stackdriver custom resource, which enabled annotation based workload metric collection. I you need this capability, use theannotationBasedApplicationMetricsfeature gate in the stackdriver custom resource as shown in the following sample to keep the same behavior:kind:stackdriver spec: enableCloudLoggingForApplications: true featureGates: annotationBasedApplicationMetrics: trueAdded optional
ksmNodePodMetricsOnlyfeature gate in the stackdriver custom resource to reduce the number of metrics from kube-state-metrics. Reducing the number of metrics makes monitoring pipeline more stable in large scale clusters.Audit logs are compressed on the wire for Cloud Audit Logs consumption, reducing egress bandwidth by approximately 60%.
Upgraded local volume provisioner to v2.5.0.
Upgraded snapshot controller to v5.0.1.
Deprecated v1beta1 volume snapshot custom resources. Anthos clusters on bare metal will stop serving v1beta1 resources in a future release.
Removed resource request limits on edge profile workloads.
Added preflight check to make sure control plane and load balancer nodes aren't under maintenance before an upgrade.
Updated the cluster snapshot capability so that information can be captured for the target cluster even when the cluster custom resource is missing or unavailable.
Improved
bmctlerror reporting for failures during the creation of a bootstrap cluster.Added support for using the
baremetal.cluster.gke.io/maintenance-mode-deadline-secondscluster annotation to specify the maximum node draining duration, in seconds. By default, a 20-minute (1200 seconds) timeout is enforced. When the timeout elapses, all pods are stopped and the node is put into maintenance mode. For example to change the timeout to 10 minutes, add the annotationbaremetal.cluster.gke.io/maintenance-mode-deadline-seconds: "600"to your cluster.Updated
bmctl check clusterto create a HealthCheck custom resource in the admin cluster if it's healthy.
Fixes:
Fixed an issue where the apiserver could become unresponsive during a cluster upgrade for clusters with a single control plane node.
Fixed an issue where cluster installations or upgrades fail when the cluster name has more than 45 characters.
Fixed an issue where the control plane VIP wasn't reachable during cluster installation on Red Hat Enterprise Linux.
Fixed an issue where audit logs were duplicated into the offline buffer even when they are sent to Cloud Audit Logs successfully.
Fixed an issue where node-specific labels set on the node pool were sometimes overwritten.
Updated
avoidBuggyIPsandmanualAssignfields in load balancer address pools (spec.loadBalancers.addressPools) to allow changes at any time.Fixed an issue where containerd didn't restart when there was a version mismatch. This issue caused an inconsistent containerd version within the cluster.
Fixed an issue that caused the logging agent to use continuously increasing amounts of memory.
Fixed preflight check so that it no longer ignores the
no_proxysetting.Fixed Anthos Identity Service annotation needed for exporting metrics.
Fixed an issue that caused the
bmctl restorecommand to stop responding for clusters with manually configured load balancers.Fixed an issue that prevented Anthos clusters on bare metal from restoring a high-availability quorum for nodes that use
/var/lib/etcdas a mountpoint.Fixed an issue that caused health checks to report failure when they find a Pod with a status of
TaintTolerationeven when the replicaset for the Pod has sufficient Pods running.Fixed an issue that caused conflicts with third-party Ansible automation.
Fixed a cluster upgrade issue that prevented some control plane nodes from rejoining a cluster configured for high availability.
The following container image security vulnerabilities have been fixed:
Critical container vulnerabilities:
High-severity container vulnerabilities:
Medium-severity container vulnerabilities:
Low-severity container vulnerabilities:
Known issues:
For information about the latest known issues, see Anthos clusters on bare metal known issues in the Troubleshooting section.
On August 25, 2023, we released an updated version of Apigee Advanced API Security.
This release includes custom profiles for Advanced API Security scores. Custom profiles let you specify the security categories you want your security scores to be based on. In this release, you must create a security profile in the security scores API. However, you can view scores for the profile in the security scores UI.
Batch is available in the europe-west10 (Berlin) region.
For more information, see Locations.
The following resource types are now publicly available through the analyze policy APIs (AnalyzeIamPolicy and AnalyzeIamPolicyLongrunning).
You can now cancel a currently running job execution. (In Preview.)
Preview: You can reduce network latency between VMs by using compact placement policies to specify the maximum distance between VMs. Use compact placement policies to optimize workloads with frequent communication across VMs—for example, high-performance computing (HPC), machine learning (ML), or database server workloads. You can keep VMs in the same rack, across adjacent racks within the same cluster, or across adjacent clusters.
For more information, see Reduce latency by using compact placement policies.
New Dataproc Serverless for Spark runtime versions:
- 1.1.29
- 2.0.37
- 2.1.16
Document AI Workbench is now powered by generative AI with two feature launches:
Document AI Workbench Summarizer is in Preview:
- The Summarizer provides summaries for documents up to 250 pages long.
- You can customize summaries based on your preferences for length (brief, moderate, comprehensive) and format (paragraph, bullet points).
- See the user guide for more information.
Document AI Workbench custom extractor is in preview:
- Custom extractor with generative AI can help extract data from documents with free-form text (e.g., contracts) and complex layouts (e.g., invoices, W2s, bills of lading).
- The pretrained processor version, which uses generative AI, can be used out of the box without any training. Post a document to the endpoint with a list of fields to get structured data.
- Customize results by confirming content in about five documents. Workbench leverages the examples to improve accuracy using few-shot prediction.
- Extract information from documents up to 200 pages long through the asynchronous API.
- To get started, create or use an existing custom extractor to leverage a processor version.
- See the how-to guide, labeling best practices, and training use cases.
- Current limitations of generative AI extraction within the custom extractor:
- Only the English language is supported.
- Region availability is currently only in the US.
- While in preview, we recommend that you only extract up to 50 entities per endpoint with generative AI.
- When uploading a sample document to define fields and preview results on the Get started page, there can be long latencies. We're working to reduce this latency.
In addition, template-based training is available in GA within the custom extractor:
- Template-based training provides accurate predictions for documents with no layout variation (such as an application form).
- Only six labeled documents are needed to train and use a template-based processor version.
- See the user guide and training use cases.
Scheduled backups now available in Preview.
You can now view and list multiple databases using the Google Cloud console. This feature is in Preview.
You can now view and list multiple databases using the Google Cloud console. This feature is in Preview.
Scheduled backups now available in Preview.
GKE now delivers insights and recommendations to ensure your workloads are ready for disruption using features such as Pod Disruption Budgets. To learn more, see Ensure stateful workloads are disruption-ready.
August 24, 2023
BigQueryThe following text embedding features are now available in preview:
- Creating a BigQuery ML remote model that references the Vertex AI PaLM APIs for embeddings (
textembedding-gecko). - Using the
ML.GENERATE_TEXT_EMBEDDINGfunction with the remote embedding model to embed text stored in BigQuery. - Using the
ARRAY<NUMERIC> typeas an input feature type to other models. - Generating text embeddings with the NNLM, SWIVEL, and BERT TensorFlow models.
For more information, see the tutorial for performing basic semantic search with text embeddings.
The following BigQuery ML inference features are now generally available (GA):
- Importing ONNX, XGBoost, and TensorFlow Lite models so that you can run them within the BigQuery ML inference engine.
- Hosting models remotely on Vertex AI Prediction so you can do inference with BigQuery ML, removing the need to build data pipelines manually.
- Using BigQuery ML functions to perform inference on Vertex AI pretrained models so that you can accomplish natural language processing, translation, and computer vision tasks in BigQuery. These functions work with the Cloud Vision, Cloud Natural Language, and Cloud Translation APIs.
Chronicle has updated the rules engine's YARA-L 2.0 language compiler to report warnings. Warnings flag rules that are syntactically valid but may result in unexpected behavior. You can view and expand warnings in the Rules Editor the same way you view errors. The following warnings are currently supported:
Multi-event non-distinct outcome section aggregations. For more information, see YARA-L known issues and limitations
Deprecated UDM fields or enum values
Cloud Spanner has added 13 new PostgreSQL functions and operators:
ARRAY_UPPER(anyarray, dimension)functionQUOTE_IDENT(string)functionSUBSTRING(string, pattern)functionDATE - DATEoperatorDATE - INTEGERoperatorDATE + INTEGERoperatorREGEXP_MATCH(string, pattern [, flags])functionREGEXP_SPLIT_TO_ARRAY(string, pattern [, flags])functionSTRING !~ PATTERNoperatorTO_CHAR(timestamptz, format),TO_CHAR(double, format),TO_CHAR(bigint, format),TO_CHAR(numeric, format)functionTO_NUMBER(string, format)functionTO_DATE(string, format)functionTO_TIMESTAMP(string, format)function
For more information, see Supported PostgreSQL functions.
cos-105-17412-156-30
| Kernel | Docker | Containerd | GPU Drivers |
| COS-5.15.120 | v23.0.3 | v1.7.2 | v470.199.02(default),v525.125.06 |
Fixed a kernel crash in device memory TCP behavior.
Fixed CVE-2023-4128 in the Linux kernel.
Runtime sysctl changes:
- Added: kernel.io_uring_disabled: 0
August 23, 2023
Anthos clusters on VMwareAnthos clusters on VMware 1.16.0-gke.669 is now available. To upgrade, see Upgrading Anthos clusters on VMware. Anthos clusters on VMware 1.16.0-gke.669 runs on Kubernetes 1.27.4-gke.1600.
- Preview: You can migrate from the Seesaw load balancer to MetalLB.
- Preview: Support the direct server return (DSR) load balancing mode for a cluster that has Dataplane V2 enabled.
- Preview: Support user-managed admin workstations.
- Preview: Support preparing credentials as Kubernetes secrets for admin clusters. See also the Secrets configuration file reference.
- GA: Support for vSphere 8.0.
- GA: Support enrolling admin and user clusters in the Anthos On-Prem API automatically to enable cluster lifecycle management from the Google Cloud CLI, the Google Cloud console, and Terraform when the Anthos On-Prem API is enabled. If needed, you have the option to disable enrollment. For more information, see Admin cluster configuration file and User cluster configuration file.
- GA: Logging and monitoring agents on each cluster now include kube-state-metrics and node-exporter.
- GA: Support for high-availability control plane for admin clusters.
- GA: Support for VM-Host affinity for user cluster node pools.
- GA: Support for user cluster storage policy based management (SPBM) .
- GA: Google managed service for Prometheus supports system metrics.
- GA: Support disabling bundled Istio ingress controller in the user cluster configuration.
- GA: Enforce the same project ID and location for new cluster creation.
- GA: Support for using
gkectlto update secret encryption. - GA: Support for enabling or disabling antiAffinityGroups.
Version changes:
- Upgraded VMware vSphere Container Storage Plug-in from 3.0 to 3.0.2.
- The
crictlcommand-line tool was updated to 1.27. - The
containerdconfig was updated to version 2.
Other changes:
- The output of the
gkectl diagnose clustercommand has been updated to provide a summary that customers can copy and paste when opening support cases. In-tree GlusterFS is removed from Kuberentes 1.27. Add storage validation to detect in-tree glusterFS volumes.
Metrics data are now gzip compressed when sending to Cloud Monitoring.
The stackdriver-log-forwarder (fluent-bit) now sends logs to Cloud Logging with gzip compression to reduce egress bandwidth needed.
Prometheus and Grafana are no longer bundled for in-cluster monitoring and they are replaced with Google Cloud Managed Service for Prometheus.
The following flags in the stackdriver custom resource are deprecated and changes to their values aren't honored:
scalableMonitoringenableStackdriverForApplications(replaced byenableGMPForApplicationsandenableCloudLoggingForApplications)enableCustomMetricsAdapter
Deploying the vSphere cloud controller manager in both admin and user clusters, and enabling it for admin and kubeception user clusters is now supported.
The audit-proxy now sends audit logs to Cloud Audit Logging with gzip compressed to reduce egress bandwidth needed.
Removed
accounts.google.comfrom the internet preflight check requirement.The pre-defined dashboards are automatically present based on the presence of metrics.
Enabled auto repair on ReadonlyFilesystem node condition
Support the
dcharacter when using--log-sinceflag to take cluster snapshot. For example:gkectl diagnose snapshot --log-since=1dA new CSI Workload preflight check was added to verify that workloads using vSphere PVs can work through CSI.
Preflight check failures for
gkectl preparenow block install and upgrade operations.The kubelet readonly port is now disabled by default for security enhancement. See Enable kubelet readonly port for instructions if you need to re-enable it for legacy reasons.
AIS Pods are now scheduled to run on control plane nodes instead of worker nodes.
The following issues are fixed in 1.16.0-gke.669:
- Fixed the known issue that caused intermittent ssh errors on non-HA admin master after update or upgrade.
- Fixed the known issue where upgrading enrolled admin cluster could fail due to membership update failure.
Fixed the issue where the CPv1 stackdriver operator had
--is-kubeception-less=truespecified by mistake.Fixed the issue where clusters used the non-high-availability (HA) Connect Agent after an upgrade to 1.15.
Fixed the known issue of Cloud Audit Logging failure due to permission denied.
Fixed a known issue where the update operation cannot be fulfilled due to KSA signing key version unmatched.
Fixed a known issue where $ in the private registry username caused admin control plane machine startup failure.
Fixed a known issue where
gkectl diagnose snapshotfailed to limit the time window forjournalctlcommands running on the cluster nodes when you take a cluster snapshot with the--log-sinceflag.Fixed a known issue where node ID verification failed to handle hostnames with dots.
Fixed continuous increase of logging agent memory.
Fixed the issue that caused
gcloudto fail to update the platform when therequired-platform-versionis already the current platform version.Fixed an issue where
cluster-api-controllersin a high-availability admin cluster had no Pod anti-affinity. This could allow the threeclusterapi-controllersPods not to be scheduled on different control-plane nodes.Fixed the wrong admin cluster resource link annotation key that can cause the cluster to be enrolled again by mistake.
Fixed a known issue where node pool creation failed because of duplicated VM-Host affinity rules.
The preflight check for StorageClass parameter validations now throws a warning instead of a failure on ignored parameters after CSI Migration. StorageClass parameter
diskformat=thinis now allowed and does not generate a warning.Fixed a false error message for
gkectl preparewhen using a high-availability admin cluster.Fixed an issue during the migration from the Seesaw load balancer to MetalLB that caused 'DeprecatedKubeception' always shows up in the diff.
Fixed a known issue where some cluster nodes couldn't access the HA control plane when the underlying network performs ARP suppression.
Removed unused Pod disruption budgets (such as
kube-apiserver-pdb,kube-controller-manager-pdb, andkube-etcd-pdb) for Controlplane V2 user clusters
The following vulnerabilities are fixed in 1.16.0-gke.669:
Critical container vulnerabilities:
High-severity container vulnerabilities:
Container-optimized OS vulnerabilities:
Windows vulnerabilities:
The following supported default parsers have changed. Each is listed by product name and log_type value, if applicable.
- Apigee (
GCP_APIGEE_X) - AppOmni (
APPOMNI) - Attivo Networks (
ATTIVO) - AWS Cloudtrail (
AWS_CLOUDTRAIL) - AWS CloudWatch (
AWS_CLOUDWATCH) - AWS GuardDuty (
GUARDDUTY) - AWS WAF (
AWS_WAF) - Blue Coat Proxy (
BLUECOAT_WEBPROXY) - Cisco Internetwork Operating System (
CISCO_IOS) - Cisco NX-OS (
CISCO_NX_OS) - Cisco Umbrella Web Proxy (
UMBRELLA_WEBPROXY) - CrowdStrike Falcon (
CS_EDR) - Crowdstrike IOC (
CROWDSTRIKE_IOC) - CyberArk Endpoint Privilege Manager (EPM) (
CYBERARK_EPM) - Elastic Windows Event Log Beats (
ELASTIC_WINLOGBEAT) - F5 Advanced Firewall Management (
F5_AFM) - GMAIL Logs (
GMAIL_LOGS) - iBoss Proxy (
IBOSS_WEBPROXY) - Ipswitch MOVEit Transfer (
IPSWITCH_MOVEIT_TRANSFER) - Juniper Junos (
JUNIPER_JUNOS) - Kubernetes Audit (
KUBERNETES_AUDIT) - Kubernetes Node (
KUBERNETES_NODE) - Microsoft AD FS (
ADFS) - Microsoft Defender For Cloud (
MICROSOFT_DEFENDER_CLOUD_ALERTS) - Microsoft Graph API Alerts (
MICROSOFT_GRAPH_ALERT) - Microsoft SQL Server (
MICROSOFT_SQL) - MISP Threat Intelligence (
MISP_IOC) - Netskope Web Proxy (
NETSKOPE_WEBPROXY) - Okta User Context (
OKTA_USER_CONTEXT) - Palo Alto Prisma Cloud Alert payload (
PAN_PRISMA_CA) - Peplink Firewall (
PEPLINK_FW) - Pulse Secure (
PULSE_SECURE_VPN) - Qualys Virtual Scanner (
QUALYS_VIRTUAL_SCANNER) - SecureLink (
SECURELINK) - Security Command Center Threat (
N/A) - Sentinelone Alerts (
SENTINELONE_ALERT) - Suricata IDS (
SURICATA_IDS) - Symantec DLP (
SYMANTEC_DLP) - Unix system (
NIX_SYSTEM) - Windows DNS (
WINDOWS_DNS) - Windows Event (
WINEVTLOG) - Windows Event (XML) (
WINEVTLOG_XML) - Workspace Activities (
WORKSPACE_ACTIVITY) - Zimperium (
ZIMPERIUM) - Zscaler Internet Access Audit Logs (
ZSCALER_INTERNET_ACCESS)
For details about changes in each parser, see Supported default parsers.
Cloud Spanner now supports integer sequences and bit reversal.
The SEQUENCE DDL statement generates unique, uniformly distributed integers as part of a primary key DEFAULT expression. For more information, see SEQUENCE (GoogleSQL, PostgreSQL).
The bit reverse function lets you map existing integer keys using the same logic as a bit-reversed sequence to avoid hotspotting. For more information, see BIT_REVERSE (GoogleSQL, PostgreSQL).
For overview information and scenarios for when to use these features, see Primary key default values management.
Cloud Spanner now supports generating a UUID (v4) as part of a table's primary key DEFAULT expression using the GENERATE_UUID function in GoogleSQL or generate_uuid() in PostgreSQL-dialect databases.
For overview information and scenarios for when to use this feature, see Primary key default values management.
The Storage Object User role (roles/storage.objectUser) is now available. This role allows you to create, view, list, update, and delete objects and their metadata, without granting access to the object's ACLs.
Fixed a Dataproc Serverless issue where Spark batches failed with unhelpful error messages.
Cloud Deploy support for deploy parameters is now generally available.
August 22, 2023
AlloyDB for PostgreSQLYou can now improve connection security by enforcing applications to connect to AlloyDB instances through AlloyDB connectors, such as the Auth Proxy.
You can now configure SSL enforcement mode to ensure that all database connections to an instance use SSL encryption.
Release 1.14.8
Anthos clusters on bare metal 1.14.8 is now available for download. To upgrade, see Upgrading Anthos on bare metal. Anthos clusters on bare metal 1.14.8 runs on Kubernetes 1.25.
Fixes:
The following container image security vulnerabilities have been fixed:
High-severity container vulnerabilities:
Medium-severity container vulnerabilities:
Low-severity container vulnerabilities:
Known issues:
For information about the latest known issues, see Anthos clusters on bare metal known issues in the Troubleshooting section.
Artifact Registry is now available in the europe-west10 region (Berlin, Germany).
Batch is available in the following regions:
asia-south2(Delhi)asia-southeast2(Jakarta)europe-southwest1(Madrid)me-central1(Doha)
For more information, see Locations.
BigQuery now allows you to create your own masking routines for your data. You can use the REGEX_REPLACE scalar function to create custom masking rules to obfuscate your sensitive data. This feature is currently in preview.
Budgets for project users now available (in preview)
Now project users in Google Cloud can create budgets and stay on top of their cloud spend, without needing additional permissions to access Cloud Billing accounts. Budgets for project users enables engineers to take ownership of their costs, plan for the spend in the projects that they own, and proactively manage cost exceptions.
Project Owners, Project Editors, and Project Viewers can view budgets that are scoped to individual projects. Project Owners and Editors can also create, modify and delete single-project budgets for the projects they have access to.
A new email notification option is available for budgets scoped to a single project: Email alerts to project owners. All other notification options are also available for single-project budgets.
Project users can use the Google Cloud console or the Cloud Billing Budget API to manage budgets for projects.
Cloud Composer 2 is now available in Dallas (us-south1), Santiago (southamerica-west1), Melbourne (australia-southeast2), and Madrid (europe-southwest1).
A release was made. Updates may include general performance improvements, bug fixes, and updates to the API reference documentation.
Dedicated Cloud Interconnect support is available in the following colocation facilities:
- Level(3) Berlin, Berlin
- NTT Berlin 1 Data Center (BER1), Berlin
For more information, see the Locations table.
Cloud KMS is available in the following region:
europe-west10
For more information, see Cloud KMS locations.
Cloud NAT support for Inter-VPC communications is in Preview.
The following new region is now available: europe-west10.
Support for europe-west10 (Berlin) region.
Support for europe-west10 (Berlin) region.
Support for europe-west10 (Berlin) region.
You can create Cloud Spanner regional instances in Berlin, Germany (europe-west10).
Cloud Storage is now available in Berlin, Germany (europe-west10 region).
Cloud VPN is now available in region europe-west10 (Berlin, Germany).
Pricing is available on the Cloud VPN pricing page.
Generally available: Berlin, Germany, Europe europe-west10-a,b,c has launched with E2, N2, N2D, and T2D VMs available in all three zones.
Dataflow is available in Berlin (europe-west10).
Dataform is compliant with SOC 2 and SOC 3.
For more information, see Dataform compliance.
Dataproc is now available in the europe-west10 region (Berlin).
The europe-west10 region in Berlin, Germany is now available.
Looker (Google Cloud core) now supports multiple private IP instances in a single Virtual Private Cloud (VPC) network.
On August 22, 2023 we released version 1.3.0 of the Migrate to Containers modernization plugins.
Learn how to Upgrade Migrate to Containers plugins.
The following changes have been made to the IBM WebSphere Application Server migration:
Renamed the plugin from
websphere-containertowebsphere-traditional-container. This plugin now supports WebSphere Application Server Traditional as a migration source.Added support for WebSphere Application Server Liberty as a target.
The
was-homeparameter is now mandatory.
The following changes have been made to the discovery parameters for the Tomcat plugin:
- The
java-versionparameter is now added as input to Tomcat migrations. - The
catalina-baseparameter can now include multiple directories delimited with colons (:). - The
java-version,catalina-baseandcatalina-homeparameters are now mandatory.
Linux system service endpoints are no longer automatically discovered and must be manually specified while customizing the Linux migration plan.
Pub/Sub is now available in europe-west10 (Berlin, Germany).
Secret Manager is now available in the following region:
- europe-west10
For more information, see Secret Manager locations.
Vertex AI custom training has launched persistent resources in Preview. A persistent resource is a long-running cluster of machines that you can use to run custom training jobs. Once created, the persistent resource remains available for future training jobs, so you don't have to wait for compute resources to be provisioned each time you want to train a model.
For auto mode VPC networks, added a new subnet 10.214.0.0/20 for the Berlin europe-west10 region. For more information, see Auto mode IP ranges.
August 21, 2023
Anthos Config ManagementThe constraint template library's GkeSpotVMTerminationGrace template adds the includePodOnSpotNodes parameter, which requires enabling referential constraints. For reference, see Constraint template library.
The Config Sync feature to sync directly from Helm repositories (including OCI-based ones) is generally available (GA). Google Artifact Registry is the preferred Helm registry. To learn more, see Sync Helm charts from Artifact Registry and Configuration for the Helm repository.
Policy Controller has been updated to include a more recent build of OPA Gatekeeper (hash: 616aa8f).
ExpansionTemplates APIs promoted to v1beta1.
Policy Controller add new bundles: nist-sp-800-190, nist-sp-800-53-r5, and nsa-cisa-k8s-v1.2. For reference, see Policy Controller bundles overview.
Added a new field spec.helm.valuesFileRefs in RootSync and RepoSync to allow specifying Helm values files in ConfigMaps. For reference, see Configuration for the Helm repository.
Added a new configsync.gke.io/deletion-propagation-policy annotation for use on RootSync and RepoSync, for configuring foreground cascading deletion as a preview feature. When set to Foreground, the resource objects managed by it will be deleted when the RootSync or RepoSync is deleted. To learn more, see Bulk delete objects.
The Helm chart version field spec.helm.version in RootSync and RepoSync can now be specified as a range of values from which Config Sync pulls the latest values. For reference see Configuration for the Helm repository.
Added the spec.override.logLevels field to RootSync and RepoSync, for configuring the log level of the containers of reconciler Pods. For more information, see RootSync and RepoSync fields and General best practices.
The constraint template library's K8sRequireDaemonsets template now supports restricting the use of NodeSelector in required Daemonset using the new restrictNodeSelector parameter. For reference, see Constraint template library.
Policy Controller bundles have been updated to the following versions: cis-k8s-v1.5.1: 202307.1, pci-dss-v3.2.1: 202307.0, policy-essentials-v2022: 202307.1, pss-baseline-v2022: 202307.0, pss-restricted-v2022: 202307.0. For reference, see Policy Controller bundles overview.
Upgraded bundled Kustomize version from v5.1.0 to v5.1.1 to pick up vulnerability fixes. To understand the changes in each release, review the changelogs.
Reduced the resource requirements for the reconciler Pod when no Kustomize rendering is needed. For information on resource requirements, see Resource requests.
Increased the default timeout for Kubernetes API requests from 5 seconds to 15 seconds. This allows more requests to succeed with fewer retries when the control plane is under load, and reduces the need to override the timeout with spec.override.apiServerTimeout in RootSync and RepoSync. To learn more, see Configuration for overriding the resource requests and limits of a root or namespace reconciler.
Fixed an issue causing Config Sync to prematurely stop tracking managed resource objects when pruning them before they are deleted from the cluster. Those objects will now appear in the Cloud Console and nomos status until the deletion has reconciled.
Fixed an issue preventing Config Sync from pruning managed resources correctly when the apiGroup of those resources is renamed in the source of truth.
Known Issue for Policy Controller: If you're using ExpansionTemplates and mutators, Policy Controller will not apply the mutators for the generated resources.
There is a memory issue in the reconciler due to the discovery client loading the OpenAPI for schema validations. The issue is only observed on Autopilot clusters with many CRDs installed. You can increase the memory request with the override.resources API. To learn more, see Configuration for overriding the resource requests and limits of a root or namespace reconciler.
Added the spec.configSync.metricsGcpServiceAccountEmail field to the gcloud apply spec fields to remove 2 manual steps required to export Config Sync metrics from a cluster with Workload Identity enabled to Cloud Monitoring. This note was updated on September 7, 2023.
Backup and DR Service 11.0.6.342 is now available to update your appliance. Refer to the instructions to update your appliance.
Backup and DR Service now supports roll back of hotfix updates. For more information, see Rollback a hotfix update.
Backup and DR Service now supports in-product notifications for important product updates.
Backup and DR Service now supports concurrent database and log backups. For more information, see Manage image expiration.
Pricing model for protecting Google Cloud VMware Engine workloads has been updated to a node based flat rate model. For more information, see pricing change announcement.
You can now scan tables to create data profiles and monitor data quality. These features help you better understand your data and ensure it is accurate and reliable. These features are generally available (GA).
A weekly digest of client library updates from across the Cloud SDK.
Node.js
Changes for @google-cloud/bigquery
7.2.0 (2023-08-17)
Features
Bug Fixes
- deps: Update dependency @google-cloud/common to v5 (#1253) (0cbfdcd)
- deps: Update dependency @google-cloud/paginator to v5 (#1254) (658ff1a)
- deps: Update dependency @google-cloud/precise-date to v4 (#1261) (7f12f7d)
- deps: Update dependency @google-cloud/promisify to v4 (#1252) (6f04f39)
- Manual update for renovate-bot google cloud storage v7 (#1262) (b58fc29)
Go
Changes for bigquery/storage/apiv1beta1
1.54.0 (2023-08-17)
Features
- bigquery/biglake: Start generating apiv1 and apiv1alpha1 (#8433) (916f779)
- bigquery/datatransfer: Add EncryptionConfiguration to TransferConfig (e3f8c89)
- bigquery/storage/managedwriter: Refine connection metrics (#8324) (54fcf36)
- bigquery/storage: Add beta2 deprecation message (b3dbdde)
- bigquery/storage: Add default_missing_value_interpretation field; indicate KMS_SERVICE_ERROR is retryable (b3dbdde)
- bigquery: Add ProjectID to JobIDConfig (#8405) (7fafd80)
Bug Fixes
- bigquery/datapolicies: Sync the new PredefinedEpxression types to the client library (fcb41cc)
- bigquery: Use JobFromProject for storage iterator (#8372) (bfbf18c)
Documentation
Analytics Hub now lets you manage subscriptions. The subscription resource stores relevant information about the subscriber and represents the connection between the shared resource and linked dataset. This feature is now in preview.
A weekly digest of client library updates from across the Cloud SDK.
We added a new BigQuery example that helps you join your Price and Detailed Cost Data exports, so that you can compare your costs with detailed information from your Pricing BigQuery export.
Internal passthrough Network Load Balancers can now be configured to handle private IPv6 traffic within your VPC. To enable this, you must configure your dual-stack subnet, backend VMs, health checks, and the forwarding rules to handle IPv6 traffic.
For details, see:
This feature is available in General Availability.
You can now view your query results as a chart in the Log Analytics page. For more information, see Chart query results with Log Analytics.
Identity and Access Management (IAM) deny policies can now include Cloud Logging permissions. For a list of Cloud Logging permissions that are supported by deny policies, see Permissions supported in deny policies.
A weekly digest of client library updates from across the Cloud SDK.
Go
Changes for logging/apiv2
1.8.1 (2023-08-14)
Bug Fixes
You can now add pie charts to your custom dashboards. Support for pie charts is in public preview. For information when using the Cloud Console, see Graph the most recent data with a pie chart. For information about using the API, see Dashboard with a PieChart widget.
Observability for Google Kubernetes Engine: The Observability tab for each of your GKE clusters now includes filters for recommended and configured integrations. To see the recommended integrations for your cluster, select Integrations > Overview. To see the integrations configured for your cluster, select Integrations > Configured.
Private Service Connect is now GA for Cloud SQL for MySQL. This solution allows you to connect to a Cloud SQL instance from multiple VPC networks that belong to different groups, teams, projects, or organizations.
Private Service Connect is now GA for Cloud SQL for PostgreSQL. This solution allows you to connect to a Cloud SQL instance from multiple VPC networks that belong to different groups, teams, projects, or organizations.
Spanner Studio enhances the Spanner query editor in the Google Cloud console, with full support for SQL, DML, and DDL operations. The Spanner Studio also features the Explorer (in Preview) which lets you interactively browse, query, and modify your database. For more information, see Manage your data using the Google Cloud console.
Generally available: When a managed instance group (MIG) repairs a failed or an unhealthy VM, you can apply the latest instance template and per-instance configuration to recreate the VM instead of applying the configuration originally used to create the VM. For more information, see Apply configuration updates during repairs.
Generally available: Hyperdisk Throughput is now available in the following additional regions and zones:
- Council Bluffs, Iowa:
us-central1 - Moncks Corner, South Carolina:
us-east1 - Ashburn, Virginia:
us-east4-b, c - Eemshaven, Netherlands:
europe-west4-a, c - Jurong West, Singapore:
asia-southeast1 - Mumbai, India:
asia-south1-a
Config Connector version 1.108.0 is now available.
Added support for customization on cnrm-unmanaged-detector pods resource requests/limits.
Added support for customization on cnrm-controller-manager pods resource requests/limits in namespaced mode.
Added support for BigQueryReservationCapacityCommitment resource(v1alpha1).
Resource BigQueryDataset(v1beta1):
- Added
spec.storageBillingModelfield.
Resource BigQueryTable(v1beta1):
- Added
spec.externalDataConfiguration.jsonOptionsfield. - Added
spec.externalDataConfiguration.metadataCacheModefield. - Added
spec.externalDataConfiguration.objectMetadatafield. - Added
spec.externalDataConfiguration.parquetOptionsfield.
Resource BigtableTable(v1beta1):
- Added
spec.changeStreamRetentionfield.
Resource CertificateManagerCertificate(v1alpha1):
- Added
spec.managed.issuanceConfigfield.
Resource CloudFunctions2Function(v1alpha1):
- Added
status.urlfield.
Resource ComputeDisk(v1beta1):
- Added
spec.enableConfidentialComputefield. - Added
spec.provisionedThroughputfield.
Resource ComputeExternalVPNGateway(v1beta1):
- Added
status.labelFingerprintfield.
Resource ComputeForwardingRule(v1beta1):
- Added
spec.noAutomateDnsZonefield.
Resource ComputeInstance(v1beta1):
- Added
spec.paramsfield. - Added
spec.bootDisk.initializeParams.resourceManagerTagsfield.
Resource ComputeInstanceTemplate(v1beta1):
- Added
spec.networkInterface.items.networkAttachmentfield.
Resource ComputeTargetHTTPProxy(v1beta1):
- Added
spec.httpKeepAliveTimeoutSecfield.
Resource ComputeTargetHTTPSProxy(v1beta1):
- Added
spec.httpKeepAliveTimeoutSecfield.
Resource ComputeURLMap(v1beta1):
- Added
spec.pathMatcher.items.routeRules.items.matchRules.items.pathTemplateMatchfield. - Added
spec.pathMatcher.items.routeRules.items.routeAction.urlRewrite.pathTemplateRewritefield.
Resource ContainerCluster(v1beta1):
- Added
spec.nodeConfig.guestAccelerator.items.gpuDriverInstallationConfigfield. - Added
spec.nodeConfig.soleTenantConfigfield. - Added
spec.securityPostureConfigfield.
Resource ContainerNodePool(v1beta1):
- Added
spec.nodeConfig.guestAccelerator.items.gpuDriverInstallationConfigfield. - Added
spec.nodeConfig.soleTenantConfigfield. - Added
spec.placementPolicy.tpuTopologyfield.
Resource DataformRepository(v1alpha1):
- Added
spec.workspaceCompilationOverridesfield.
Resource GKEBackupBackupPlan(v1alpha1):
- Added
status.statefield. - Added
status.stateReasonfield.
Resource HealthcareFHIRStore(v1alpha1):
- Added
spec.complexDataTypeReferenceParsingfield.
Resource RedisInstance(v1beta1):
- Added
status.maintenanceSchedulefield.
Resource RunJob(v1beta1):
- Added
spec.annotationsfield. - Added
spec.template.annotationsfield.
Resource SQLInstance(v1beta1):
- Added
spec.settings.dataCacheConfigfield. - Added
spec.settings.editionfield.
Resource VertexAIFeaturestoreEntityTypeFeature(v1alpha1):
- Added
status.regionfield.
Resource VertexAIIndex(v1alpha1):
- Added
spec.metadata.config.shardSizefield.
UCaaS: MS Teams integration: CCAI Platform now supports UCaaS integration capabilities. This integration allows you to seamlessly configure MS Teams users and teams directly within CCAIP. You can enjoy the advanced routing capabilities of CCAIP while taking calls in MS teams. Typical supported use cases include:
- The ability to transfer calls between CCAIP and MS Teams agents.
- Automatically routing calls to MS Teams agents or groups.
- Assigning any MS Teams users to queues.
- Ability to assign CCAIP and MS Teams users as part of Cascade groups.
In Add/Edit User menus, you will see an option for enabling UCaaS as well as integration settings in Developer Settings. Enabling this option allows users who only occasionally assist with customer support to take those calls using their principal UCaaS communication platform. For details, see the Microsoft Teams integration guide
Data restriction for historical/downloadable reports: New permission for the Session Data report with the supervisory ability to restrict editing permissions. Also, the permissions for the downloadable reports under Agents & Teams, Calls & Chats, Queues, and Campaigns now have the option to restrict the corresponding data to assigned teams only or assigned queues only.
Session Variable: Enable Agent ID as a dynamic parameter: We have introduced a change to dynamically include the agent ID as a session variable in automated messages and chat shortcuts. This allows an agent to send an outbound SMS to a consumer containing a deep link to a mobile app with our SDK embedded. The deep link contains the agent ID, which will trigger a DAP to a dedicated queue for that agent with a DAP value also reflecting that agent's ID. Scope extends to these channels: SMS messages, Mobile chat, Wed SDK chat, Chat shortcuts.
Headless web SDK: CCAIP Platform now supports a new Headless Web SDK, designed to empower you to build a fully customized and branded web support experience.
The Headless Web SDK comes equipped with a comprehensive API suite, providing you with the tools to leverage familiar Web SDK features and tailor the UI to suit your specific needs. Every detail, from colors and fonts to layouts and interactions, can be tailored to create a cohesive and engaging interface that resonates with your audience. See the Headless web SDK guide for details.
Mobile SDK 2.1: UI customizations: The latest release of our Mobile SDK chat gives you even more customization options to tailor the UI to your specific branding needs. You can take full control of the appearance and style of elements within the chat interface. Some items that can be fully customized:
- Agent and consumer message bubbles.
- Menu bar (including the back and end chat buttons).
- End Chat button.
- Send button.
- Message tray.
- Time stamps.
Depending on the component, you have the flexibility to customize attributes such as the font, background color, icon, (and more!) to create a chat experience tailored to your brand. See the iOS and Android SDK guides for details.
Distinct queue names for the Alvaria data exporter: You now have the ability to repeat names across multiple different queue-paths. Queue will appear in Alvaria as Queue Name - language code - ID, allowing you to easily identify which metrics correspond to what queue.
Fallback IVR: Additional settings for fallback destination: New IVR fallback options for when an end-user fails to select a queue during IVR navigation. New options are available globally as well as at the queue level. Additional options include:
- Select the last available menu to route consumers to the last queue in the IVR menu.
- Select a specific menu to route consumers to any queue in the IVR menu.
The configuration options are available at the global level (Call > Call Details > Fallback IVR Navigation). See the documentation for details.
New dynamic parameter support for SIP redirect and Dialogflow: New dynamic parameters to enhance the capabilities of SIP Redirect and Dialogflow. With these additions, you can now leverage valuable real-time information during call routing and Dialogflow sessions. The new dynamic parameters include DNIS / TFN (the number the user dialed), Latest Agent ID, Latest Agent Email, Queue Language, Latest Sentiment Score, and Overall Sentiment Score. See the documentation for details.
Improved Outbound SMS API: Agents can now initiate outbound SMS sessions with number pairs that were previously engaged by other agents. This enhancement allows for seamless continuation with consumers, even if the number pair was recently used by a different agent. Agents can send appointment requests, SMS follow-ups, and other SMS messages without encountering errors. See the documentation for details.
Custom POST events (also known as custom JavaScript events): This feature allows you to listen for events happening within CCAIP and take action accordingly. For example, when a call is transferred you could use your own JavaScript code to listen for a call_transferred event and specify actions based on the provided parameters (such as updating the destination agent's screen). These events give you more control over your workflows and allow for seamless integration with your business processes. With this release we are extending the existing mechanism of transmitting post events with 3 new events:
- Transfer
- Add Party
- Agent connects to session
- VA session data: We are capturing VA session data in the payload during a consumer interaction. This means alongside the existing event data, you will now have access to virtual agent session specific variables.
In addition, we're including:
- The
agent_custom_idparameter in theAgent_Loginevent. - Custom SIP headers in incoming SIP calls within the POST events.
See the custom CRM documentation for details.
Call Adapter: Improved error codes and messages: We have improved our Call Adapter's error messages with more detailed content, including error codes and explanations.
DAP: Additional format: Previously limited to E164 formatted numbers, we now support the input of SIP phone numbers in the incoming sip address format: sip:[number]@[domain].
Skip Cascade Group Timer: Improved functionality of our call and chat deltacast routing. We have introduced the Skip Cascade Group Timer setting, which allows you to bypass the cascade timer settings and route a call or chat to the next available agent, regardless of the cascade group. The setting is located in Operations Management > Deltacast settings. See the Operations Management documentation for details.
Call Handling: Hold music during connection: CCAI Platform has enhanced the call handling experience for end-users by ensuring a smoother transition when connecting with an agent. Instead of experiencing hold music followed by delays or silence, end-users will now enjoy uninterrupted music until the agent joins the call. Additionally, agents will be notified with a distinct sound when an end-user joins the call.
Call Session Events generator and sender: These applications are deployed when you enable the Call Session Events feature. The operators receive Call Events from ujet-server and process them before sending to your configured endpoints. Ujet-server, Generator and Sender all use RabbitMQ infrastructure to send messages.
NICE QM integration: CCAIP now supports an out-of-the-box data export for NICE QM. You can enable it in Developer Settings > Session Data Export > NICE Integration. You must enter the following information to enable the NICE QM data export:
- NICE API Endpoint
- API Authentication credentials
iOS:
- Fixed an issue where using a DAP to route to a queue that was After Hours could lead to consumers being stuck in a loop.
- Fixed an intermittent issue where a SmartActions request would cause the app to crash.
- Fixed an intermittent issue where the SDK credentials would not authenticate.
- Fixed an issue where the app would crash when hold music was played to the end-user.
Android:
- Fixed an issue where using a DAP to route to a queue that was After Hours could lead to consumers being stuck in a loop.
- Fixed an issue where the signed custom payload data was not triggered for calls and chats.
Web SDK:
- Fixed an issue where the Co-browse session sometimes would not connect due to the end-user having multiple tabs open.
- Fixed an issue where end-users could sometimes get stuck on the After Hours screen, unable to start a new chat.
- Fixed an issue where a DAP was sometimes not maintained after the previous chat timed out.
Fixed an issue where if a trailing "/" was added to the folder path for Google Cloud Storage upload settings, the files were written to a folder with no name. A safeguard has been added both in backend and frontend to remove any trailing slashes.
Billing service fixes: Resolved two different incident tickets relating to the billing service; one edge case whereby agents were erroneously being counted as online and other that caused the billing service to temporarily incorrectly aggregate data.
cos-dev-113-17833-0-0
| Kernel | Docker | Containerd | GPU Drivers |
| COS-6.1.43 | v24.0.5 | v1.7.3 | v535.54.03(default),v470.199.02(R470) |
Updated app-containers/docker-cli to 24.0.5.
Updated app-containers/docker to 24.0.5.
Update cos-gpu-installer to v2.1.4. This fixes a permissions issue in the GPU driver install directory with OSS drivers.
Upgraded app-editors/vim and app-editors/vim-core to v9.0.1678.
Upgraded net-libs/gnutls to v3.8.1-r1.
Upgraded app-misc/jq to v1.7_rc1.
Upgraded app-arch/xz-utils to v5.4.4.
Updated dev-go/yaml to v3.0.1. This resolves CVE-2022-28948.
Updated dev-libs/openssl to v3.0.10. This resolves CVE-2023-3817.
Fixed CVE-2023-4194 in the Linux kernel.
cos-105-17412-156-23
| Kernel | Docker | Containerd | GPU Drivers |
| COS-5.15.120 | v23.0.3 | v1.7.2 | v470.199.02(default),v525.125.06 |
Simplified GPU driver installation by remounting the driver installation path as executable from cos-extensions.
Fixed an issue in systemd where a container out-of-memory event caused all processes in the container to be killed.
Updated dev-libs/openssl to v1.1.1v. This resolves CVE-2023-3817.
Upgrade app-misc/jq to v1.7_pre20201109-r1. This fixes CVE-2016-4074.
Fixed CVE-2023-4147 in the Linux kernel.
Fixed CVE-2023-4194 in the Linux kernel.
cos-beta-109-17800-0-13
| Kernel | Docker | Containerd | GPU Drivers |
| COS-6.1.42 | v24.0.5 | v1.7.2 | v535.54.03(default),v470.199.02(R470) |
Updated app-containers/docker-cli to 24.0.5.
Updated app-containers/docker to 24.0.5.
Updated dev-go/yaml to v3.0.1. This resolves CVE-2022-28948.
Updated dev-libs/openssl to v3.0.10. This resolves CVE-2023-3817.
Fixed CVE-2023-4147 in the Linux kernel.
Fixed CVE-2023-4194 in the Linux kernel.
cos-93-16623-461-15
| Kernel | Docker | Containerd | GPU Drivers |
| COS-5.10.177 | v20.10.24 | v1.6.20 | v450.248.02(default),v470.199.02(R470),v525.125.06 |
Simplified GPU driver installation by remounting the driver installation path as executable from cos-extensions.
Updated dev-libs/openssl to v1.1.1v. This resolves CVE-2023-3817.
Upgrade app-misc/jq to v1.7_pre20201109-r1. This fixes CVE-2016-4074.
Fixed CVE-2023-4147 in the Linux kernel.
Fixed CVE-2023-4194 in the Linux kernel.
cos-97-16919-353-23
| Kernel | Docker | Containerd | GPU Drivers |
| COS-5.10.186 | v20.10.24 | v1.6.21 | v470.199.02(default),v525.125.06 |
Simplified GPU driver installation by remounting the driver installation path as executable from cos-extensions.
Updated dev-libs/openssl to v1.1.1v. This resolves CVE-2023-3817.
Upgrade app-misc/jq to v1.7_pre20201109-r1. This fixes CVE-2016-4074.
Fixed CVE-2023-4147 in the Linux kernel.
Fixed CVE-2023-4194 in the Linux kernel.
cos-101-17162-279-24
| Kernel | Docker | Containerd | GPU Drivers |
| COS-5.15.120 | v20.10.24 | v1.6.21 | v470.199.02(default),v525.125.06 |
Updated dev-libs/openssl to v1.1.1v. This resolves CVE-2023-3817.
Fixed CVE-2018-14647 in the dev-lang/python package.
Fixed CVE-2018-1000802 in the dev-lang/python package
Upgrade app-misc/jq to v1.7_pre20201109-r1. This fixes CVE-2016-4074.
Fixed CVE-2023-4194 in the Linux kernel.
Dataplex automatic data quality and data profiling are generally available.
- Data profiling
- Jump start your data analytics with statistical insights, such as average values, unique values, data bounds, and top-N.
- Understand drifts and build anomaly models with the generated metadata.
- Publish data quality and data profiling information in the BigQuery console. Learn more.
- Profile data in BigQuery tables, views, BigLake, and external tables.
- Ease deployment through a managed, serverless, and zero-copy execution.
- Take advantage of advanced features like filtering, sampling, and saving results to a central BigQuery table.
- Automatic data quality
- Deliver trusted data by building an end-to-end data quality monitoring pipeline.
- View rule recommendations, enhance with business rules, monitor on a routine or in a pipeline, generate reports, get alerted on failures, and troubleshoot the issues.
- View quality information in the BigQuery UI for every table user to see. Learn more.
- Improve data quality in BigQuery tables, views, BigLake, and external tables.
- Ease deployment through managed, serverless, and zero-copy execution.
- Take advantage of advanced features like filtering, sampling, and saving results to a central BigQuery table.
Adaptive Protection suggested rules can now be deployed automatically in General Availability. For more information, see Automatically deploy Adaptive Protection suggested rules.
A weekly digest of client library updates from across the Cloud SDK.
Node.js
Changes for @google-cloud/pubsub
4.0.1 (2023-08-11)
Bug Fixes
Python
Changes for google-cloud-pubsub
2.18.3 (2023-08-18)
Bug Fixes
inIpRange() function released to General Availability
You can now specify a range of IP addresses by using the inIpRange() function in query statements to filter findings that contain IPv4 or IPv6 addresses within the specified range.
For more information, see The inIpRange function.