The following release notes cover the most recent changes over the last 60 days. For a comprehensive list of product-specific release notes, see the individual product release note pages.
You can also see and filter all release notes in the Google Cloud console or you can programmatically access release notes in BigQuery.
To get the latest product updates delivered to you, add the URL of this page to your
feed
reader, or add the feed URL directly: https://cloud.google.com/feeds/gcp-release-notes.xml
October 02, 2023
Anthos Attached ClustersThis release includes the following Anthos attached clusters platform versions:
- 1.25.0-gke.7
- 1.26.0-gke.5
- 1.27.0-gke.2
1.25.0-gke.7, 1.26.0-gke.5, and 1.27.0-gke.1
Resolved an issue affecting EKS environments in which Kubernetes resource metrics weren't successfully scraped from the kubelet when a node's name within the cluster didn't match that same node's hostname.
1.25.0-gke.7 and 1.26.0-gke.5
This release fixes the following vulnerabilities:
- Fixed CVE-2023-24539
- Fixed CVE-2023-24540
- Fixed CVE-2023-29400
You can now launch clusters with the following Kubernetes versions. Click on the following links to see the release notes associated with these patches:
You can now launch clusters with the following Kubernetes versions. Click on the following links to see the release notes associated with these patches:
Upgrading an admin cluster with always-on secrets encryption enabled might fail.
An admin cluster upgrade from 1.14.x to 1.15.0 - 1.15.4 with always-on secrets encryption enabled might fail depending on when you created the admin cluster. The following admin clusters are affected:
Admin clusters created in 1.12 or earlier with always-on secrets encryption enabled at creation time.
Admin clusters created in 1.12 or earlier with always-on secrets encryption disabled, but subsequently the cluster was updated to enable the feature.
Admin clusters created in 1.13 or later with the feature enabled are safe to upgrade.
If you don't know the original version of the admin cluster, don't upgrade the cluster until a fix is available in 1.15.5.
For information on working around an admin cluster failure because of this issue, see Upgrading an admin cluster with always-on secrets encryption enabled fails. Note that the workaround relies on you having the old encryption key backed up. If the old key is no longer available, you will have to recreate the admin cluster and all user clusters.
You can now use Bare Metal Solution's self-service functionality to order your resources after executing a one-time Order Form. This feature is generally available (GA). For more information, see Order Bare Metal Solution resources.
A weekly digest of client library updates from across the Cloud SDK.
Node.js
Changes for @google-cloud/bigquery
7.3.0 (2023-09-28)
Features
Bug Fixes
Java
Changes for google-cloud-bigquery
2.33.1 (2023-09-28)
Bug Fixes
2.33.0 (2023-09-27)
Features
Bug Fixes
Dependencies
- Update actions/checkout action (#2893) (e3655af)
- Update dependency com.google.cloud:google-cloud-shared-dependencies to v3.16.1 (#2892) (e1d9871)
- Update dependency org.graalvm.buildtools:junit-platform-native to v0.9.27 (#2885) (2237ca2)
- Update dependency org.graalvm.buildtools:native-maven-plugin to v0.9.27 (#2886) (539b4e6)
- Update github/codeql-action action to v2.21.4 (#2829) (599e3b3)
- Update github/codeql-action action to v2.21.8 - abandoned (#2897) (ab4e1d0)
- Update github/codeql-action action to v2.21.8 (#2889) (b568026)
- Update github/codeql-action action to v2.21.9 (#2901) (33a729f)
BigQuery native integration in Looker Studio enables monitoring features for Looker Studio queries, improves query performance, and supports many BigQuery features. This feature is in preview.
A release was made. Updates may include general performance improvements, bug fixes, and updates to the API reference documentation.
A weekly digest of client library updates from across the Cloud SDK.
Java
Changes for google-cloud-logging
3.15.10 (2023-09-27)
Dependencies
Python
Changes for google-cloud-logging
3.7.0 (2023-09-25)
Features
- Add ConfigServiceV2.CreateBucketAsync method for creating Log Buckets asynchronously (30f24a8)
- Add ConfigServiceV2.CreateLink method for creating linked datasets for Log Analytics Buckets (30f24a8)
- Add ConfigServiceV2.DeleteLink method for deleting linked datasets (30f24a8)
- Add ConfigServiceV2.GetLink methods for describing linked datasets (30f24a8)
- Add ConfigServiceV2.ListLinks method for listing linked datasets (30f24a8)
- Add ConfigServiceV2.UpdateBucketAsync method for creating Log Buckets asynchronously (30f24a8)
- Add LogBucket.analytics_enabled field that specifies whether Log Bucket's Analytics features are enabled (30f24a8)
- Add LogBucket.index_configs field that contains a list of Log Bucket's indexed fields and related configuration data (30f24a8)
- Log Analytics features of the Cloud Logging API (30f24a8)
Bug Fixes
- Add async context manager return types (30f24a8)
- Add severity to structured log write (#783) (31a7f69)
- Handle exceptions raised when fetching Django request data (#758) (5ecf886)
- Unintended exception omittion (#736) (022dc54)
Documentation
The Metrics management page in Cloud Monitoring now lets you create alerting policies and charts for metrics that have no associated alerting policies or custom dashboards. For more information, see View and manage metric usage.
You can now import your Grafana dashboards into Cloud Monitoring. For more information, see Import Grafana dashboards into Cloud Monitoring.
You can now configure notifications for Google Chat spaces. For more information, see Create and manage notification channels.
For Cloud SQL Enterprise edition and Cloud SQL Enterprise Plus edition, you can restore backups across instances of different editions.
For Cloud SQL Enterprise edition and Cloud SQL Enterprise Plus edition, you can restore backups across instances of different editions.
If you use the latest preconfigured base images for JetBrains IDEs, the .vmoptions and .properties files persist across workstations. For more information, see Customize JetBrains IDE vmoptions and properties.
Dialogflow CX speech adaptation can now be configured manually.
A weekly digest of client library updates from across the Cloud SDK.
Python
Changes for google-cloud-ndb
2.2.2 (2023-09-19)
Documentation
GKE now delivers insights and recommendations if users have installed webhooks that intercept system resources or webhooks that have no available endpoints. To learn more, see Ensure control plane stability when using webhooks.
A weekly digest of client library updates from across the Cloud SDK.
Java
Changes for google-cloud-pubsub
1.125.5 (2023-09-28)
Dependencies
- Update gapic-generator-java to 2.26.0 (935849c)
1.125.4 (2023-09-28)
Dependencies
1.125.3 (2023-09-27)
Dependencies
- Update dependency com.google.cloud:google-cloud-core to v2.24.1 (#1737) (48a4432)
- Update dependency com.google.cloud:google-cloud-shared-dependencies to v3.16.1 (#1738) (e2cf7c1)
- Update dependency org.apache.avro:avro to v1.11.3 (#1740) (971b35f)
- Update dependency org.xerial.snappy:snappy-java to v1.1.10.4 security (70ba500)
- Update dependency org.xerial.snappy:snappy-java to v1.1.10.5 (#1746) (a4b1994)
Cloud Storage Backint agent for SAP HANA version 1.0.29
Version 1.0.29 of the Cloud Storage Backint agent for SAP HANA is available. This version sets the default value of the HTTP_READ_TIMEOUT parameter to -1; no timeout.
For more information about the agent, see Cloud Storage Backint agent for SAP HANA overview.
Private Service Connect service connectivity automation is available in General Availability. Service connectivity automation lets service producers automate deployment and service connectivity to eligible managed services on behalf of consumers.
September 30, 2023
Google Cloud VMware EngineVMware Engine nodes are now available in the following additional region:
- Tel Aviv (
me-west1-b)
September 29, 2023
Anthos clusters on VMwareAnthos clusters on VMware 1.16.1-gke.45 is now available. To upgrade, see Upgrading Anthos clusters on VMware. Anthos clusters on VMware 1.16.1-gke.44 runs on Kubernetes 1.27.4-gke.1600.
The Prometheus and Grafana add-ons field, loadBalancer.vips.addonsVIP is deprecated in 1.16 and later. This change is because
Google Managed Service for Prometheus
replaced the Prometheus and Grafana add-ons in 1.16.
The following issues are fixed in 1.16.1-gke.45:
- Fixed the
known issue
that
gkectl repair admin-masterreturns kubeconfig unmarshall error. - Fixed the known issue that GARP reply sent by Seesaw doesn't set target IP
- Fixed the known issue that Seesaw VM may be broken due to low disk space
- Fixed the known issue that false warnings might be generated against persistent volume claims.
- Fixed the known issue that caused CNS
attachvolumetasks to appear every minute for in-tree PVC/PV after upgrading to Anthos 1.15+.
The following vulnerabilities are fixed in 1.16.1-gke.44:
High-severity container vulnerabilities:
Container-optimized OS vulnerabilities:
Anthos clusters on VMware 1.14.8-gke.37 is now available. To upgrade, see Upgrading Anthos clusters on VMware. Anthos clusters on VMware 1.14.8-gke.37 runs on Kubernetes 1.25.12-gke.2400.
The following issues are fixed in 1.14.8-gke.37:
- Fixed the disk full known issue on Seesaw VM due to no log rotation for fluent-bit.
The following vulnerabilities are fixed in 1.14.8-gke.37:
High-severity container vulnerabilities:
Container-optimized OS vulnerabilities:
Release 1.14.9
Anthos clusters on bare metal 1.14.9 is now available for download. To upgrade, see Upgrading Anthos on bare metal. Anthos clusters on bare metal 1.14.9 runs on Kubernetes 1.25.
Fixes:
Fixed an issue to prevent cluster upgrades from starting on a node before either all Pods have been drained or the Pod draining timeout has been reached.
Fixes:
The following container image security vulnerabilities have been fixed in version 1.14.9:
High-severity container vulnerabilities:
Medium-severity container vulnerabilities:
Low-severity container vulnerabilities:
Known issues:
For information about the latest known issues, see Anthos clusters on bare metal known issues in the Troubleshooting section.
On September 29, 2023, we released an updated version of Apigee.
New attributes for Pay-as-you-go pricing are generally available (GA).
Apigee updated its Pay-as-you-go pricing model, making it possible for customers to onboard at a significantly reduced initial cost and right-size their ongoing expenses to usage.
To learn more about the updated Pay-as-you-go pricing experience, see Pay-as-you-go (updated attributes) pricing overview.
Standard and extensible API proxies are generally available (GA).
Standard and extensible API proxies are generally available for use with Apigee organizations.
For more information about standard and extensible API proxies, see API proxy types.
HTTPModifier and ReadPropertySet policies and templating support for message
The HTTPModifier policy can change an existing request or response message and provides a subset of the functionality already available in the AssignMessage policy. See HTTPModifier policy.
The ReadPropertySet policy reads property sets and populates flow variables with the results. See ReadPropertySet policy.
HTTPModifier and ReadPropertySet are standard policies. Proxies built exclusively with standard policies are called standard proxies and can be deployed to any environment type. See Pay-as-you-go (updated attributes) pricing overview.
With this release, template support for message
New environment types are generally available (GA).
With this release, Apigee introduces three distinct environments that have access to varying degrees of Apigee capabilities and costs: Base, Intermediate, and Comprehensive.
For more information, see Apigee Pay-as-you-go environment types.
Apigee API Analytics add-on for Pay-as-you-go organizations is generally available (GA).
With this release, Apigee API Analytics is available as a paid add-on capability for Pay-as-you-go organizations. The add-on can be enabled in any Apigee Intermediate or Comprehensive environment. For more information, see Manage the Apigee API Analytics add-on.
One click provisioning for Apigee Pay-as-you-go organizations is generally available (GA).
Simplify your onboarding experience with one click provisioning for new Pay-as-you-go organizations, using smart default configurations. To learn more, see Provision Apigee with one click.
Updated pricing attributes in Subscription plans are available.
To get started with subscription plans that include new pricing attributes (consistent with Pay-as-you-go pricing), contact your Google Cloud sales specialist.
For more information, see Apigee Subscription 2024 entitlements. Apigee hybrid is not available in the new subscription plan at this time.
As a BigQuery administrator, to monitor your organization's slots utilization and BigQuery jobs' performance over time, use can now use administrative query inspector. This feature is now generally available.
Cloud Composer 2.4.4 release started on September 29, 2023. Get ready for upcoming changes and features as we roll out the new release to all regions. This release is in progress at the moment. Listed changes and features might not be available in some regions yet.
Airflow triggerer is now generally available (GA).
The cost of the environments.ExecuteAirflowCommand and environments.StopAirflowCommand operations is reduced from 100 to 25 quota units.
The apache-airflow-providers-google package is upgraded to version 10.9.0 in images with Airflow 2.5.3 and 2.4.3. For more information about changes, see the apache-airflow-providers-google changelog from version 10.7.0 to version 10.9.0.
Cloud Composer 2.4.4 images are available:
- composer-2.4.4-airflow-2.5.3 (default)
- composer-2.4.4-airflow-2.4.3
Cloud Composer versions 2.0.28, 2.0.27, 1.19.11, and 1.19.10 have reached their end of full support period.
Cloud Load Balancing introduces the global external Proxy Network Load Balancer. The global external Proxy Network Load Balancer is implemented on globally distributed GFEs and supports advanced traffic management capabilities. This load balancer can be configured to handle either TCP or SSL traffic by using either a target TCP proxy or a target SSL proxy respectively. Global external proxy Network Load Balancers support backends such as instance groups, hybrid NEGs, and Private Service Connect NEGs.
Load balancers that are already deployed in the classic mode are renamed as classic Proxy Network Load Balancer in the console.
For details, see the External proxy Network Load Balancer overview.
To set up a global external Proxy Network Load Balancer, see the following pages:
This capability is in Preview.
With the launch of global external Proxy Network Load Balancer, we now support three deployment modes with the external Proxy Network Load Balancer—classic (General Availability), Regional (General Availability) and global (Preview). No changes have been made to the API.
For details, see the External proxy Network Load Balancer overview.
Typically with HTTPS communication, the authentication works only one way: the client verifies the identity of the server. For applications that require the load balancer to authenticate the identity of clients that connect to it, both a global external Application Load Balancer and a global external Application Load Balancer (classic) support mutual TLS (mTLS).
With mTLS, the load balancer requests that the client send a certificate to authenticate itself during the TLS handshake with the load balancer. You can configure a trust store that the load balancer uses to validate the client certificate's chain of trust.
For details, see the following:
- Mutual TLS authentication
- Set up mutual TLS with signed certificates
- Set up mutual TLS with a private CA
- Set up mutual TLS for a global external Application Load Balancer (classic)
- Set up mutual TLS for a global external Application Load Balancer
This capability is in General Availability.
Ops Agent versions 2.39.0 and 2.40.0 crash if you use them on Compute Engine VMs with attached GPUs. Use Ops Agent version 2.38.0, or versions 2.41.0 and newer, on VMs with attached GPUs.
Ops Agent versions 2.39.0 and 2.40.0 crash if you use them on Compute Engine VMs with attached GPUs. Use Ops Agent version 2.38.0, or versions 2.41.0 and newer, on VMs with attached GPUs.
Config Connector version 1.110.0 is now available.
Added MutatingWebhookConfigurationCustomization and ValidatingWebhookConfigurationCustomization to support the customization on webhook timeouts.
Added value validation for resource requests and limits in the customizable ControllerResource and NamespacedControllerResource CRDs.
Promoted CertificateManagerCertificate, CertificateManagerCertificateMap, CertificateManagerCertificateMapEntry and CertificateManagerDNSAuthorization from v1alpha1 to v1beta1.
Promoted RunService from alpha stability to stable stability.
- Renamed field
spec.template.containerConcurrencytospec.template.maxInstanceRequestConcurrency. - Fixed the IAM support by removing the support of "IAM conditions" on this resource.
- Removed field
status.resourceGeneration.
Resource BigQueryTable(v1beta1):
- Added
spec.tableConstraintsfield. - Added
spec.materializedView.allowNonIncrementalDefinitionfield.
Resource ComputeInstance(v1beta1):
- Added
spec.networkInterface.items.internalIpv6PrefixLengthfield. - Added
spec.networkInterface.items.ipv6Addressfield.
Resource ComputeInstanceTemplate(v1beta1):
- Added
spec.networkInterface.items.internalIpv6PrefixLengthfield. - Added
spec.networkInterface.items.ipv6Addressfield.
Resource ContainerCluster(v1beta1):
- Added
spec.enableFqdnNetworkPolicyfield. - Added
spec.nodeConfig.confidentialNodesfield.
Resource ContainerNodePool(v1beta1):
- Added
spec.nodeConfig.confidentialNodesfield.
Resource DialogflowCXFlow(v1alpha1):
- Added
spec.eventHandlers.items.triggerFulfillment.conditionalCasesfield. - Added
spec.eventHandlers.items.triggerFulfillment.setParameterActionsfield. - Added
spec.eventHandlers.items.triggerFulfillment.messages.items.channelfield. - Added
spec.eventHandlers.items.triggerFulfillment.messages.items.conversationSuccessfield. - Added
spec.eventHandlers.items.triggerFulfillment.messages.items.liveAgentHandofffield. - Added
spec.eventHandlers.items.triggerFulfillment.messages.items.outputAudioTextfield. - Added
spec.eventHandlers.items.triggerFulfillment.messages.items.payloadfield. - Added
spec.eventHandlers.items.triggerFulfillment.messages.items.playAudiofield. - Added
spec.eventHandlers.items.triggerFulfillment.messages.items.telephonyTransferCallfield. - Added
spec.transitionRoutes.items.triggerFulfillment.conditionalCasesfield. - Added
spec.transitionRoutes.items.triggerFulfillment.setParameterActionsfield. - Added
spec.transitionRoutes.items.triggerFulfillment.messages.items.channelfield. - Added
spec.transitionRoutes.items.triggerFulfillment.messages.items.conversationSuccessfield. - Added
spec.transitionRoutes.items.triggerFulfillment.messages.items.liveAgentHandofffield. - Added
spec.transitionRoutes.items.triggerFulfillment.messages.items.outputAudioTextfield. - Added
spec.transitionRoutes.items.triggerFulfillment.messages.items.payloadfield. - Added
spec.transitionRoutes.items.triggerFulfillment.messages.items.playAudiofield. - Added
spec.transitionRoutes.items.triggerFulfillment.messages.items.telephonyTransferCallfield.
Resource DialogflowCXPage(v1alpha1):
- Added
spec.entryFulfillment.conditionalCasesfield. - Added
spec.entryFulfillment.setParameterActionsfield. - Added
spec.entryFulfillment.messages.items.channelfield. - Added
spec.entryFulfillment.messages.items.conversationSuccessfield. - Added
spec.entryFulfillment.messages.items.liveAgentHandofffield. - Added
spec.entryFulfillment.messages.items.outputAudioTextfield. - Added
spec.entryFulfillment.messages.items.payloadfield. - Added
spec.entryFulfillment.messages.items.playAudiofield. - Added
spec.entryFulfillment.messages.items.telephonyTransferCallfield. - Added
spec.eventHandlers.items.triggerFulfillment.conditionalCasesfield. - Added
spec.eventHandlers.items.triggerFulfillment.setParameterActionsfield. - Added
spec.eventHandlers.items.triggerFulfillment.messages.items.channelfield. - Added
spec.eventHandlers.items.triggerFulfillment.messages.items.conversationSuccessfield. - Added
spec.eventHandlers.items.triggerFulfillment.messages.items.liveAgentHandofffield. - Added
spec.eventHandlers.items.triggerFulfillment.messages.items.outputAudioTextfield. - Added
spec.eventHandlers.items.triggerFulfillment.messages.items.payloadfield. - Added
spec.eventHandlers.items.triggerFulfillment.messages.items.playAudiofield. - Added
spec.eventHandlers.items.triggerFulfillment.messages.items.telephonyTransferCallfield. - Added
spec.form.parameters.items.defaultValuefield. - Added
spec.form.parameters.items.fillBehavior.repromptEventHandlersfield. - Added
spec.form.parameters.items.fillBehavior.initialPromptFulfillment.conditionalCasesfield. - Added
spec.form.parameters.items.fillBehavior.initialPromptFulfillment.setParameterActionsfield. - Added
spec.form.parameters.items.fillBehavior.initialPromptFulfillment.messages.items.channelfield. - Added
spec.form.parameters.items.fillBehavior.initialPromptFulfillment.messages.items.conversationSuccessfield. - Added
spec.form.parameters.items.fillBehavior.initialPromptFulfillment.messages.items.liveAgentHandofffield. - Added
spec.form.parameters.items.fillBehavior.initialPromptFulfillment.messages.items.outputAudioTextfield. - Added
spec.form.parameters.items.fillBehavior.initialPromptFulfillment.messages.items.payloadfield. - Added
spec.form.parameters.items.fillBehavior.initialPromptFulfillment.messages.items.playAudiofield. - Added
spec.form.parameters.items.fillBehavior.initialPromptFulfillment.messages.items.telephonyTransferCallfield. - Added
spec.transitionRoutes.items.triggerFulfillment.conditionalCasesfield. - Added
spec.transitionRoutes.items.triggerFulfillment.setParameterActionsfield. - Added
spec.transitionRoutes.items.triggerFulfillment.messages.items.channelfield. - Added
spec.transitionRoutes.items.triggerFulfillment.messages.items.conversationSuccessfield. - Added
spec.transitionRoutes.items.triggerFulfillment.messages.items.liveAgentHandofffield. - Added
spec.transitionRoutes.items.triggerFulfillment.messages.items.outputAudioTextfield. - Added
spec.transitionRoutes.items.triggerFulfillment.messages.items.payloadfield. - Added
spec.transitionRoutes.items.triggerFulfillment.messages.items.playAudiofield. - Added
spec.transitionRoutes.items.triggerFulfillment.messages.items.telephonyTransferCallfield.
Resource RunJob(v1beta1):
spec.template.template.volumes[].secret.items[].modeis now optional.
Resource SecretManagerSecret(v1beta1):
- Added
spec.replication.autofield.
Resource SecretManagerSecretVersion(v1beta1):
- Added
spec.deletionPolicyfield.
Resource StorageBucket(v1beta1):
spec.autoclass.enabledis now mutable.
Resource VertexAIIndexEndpoint(v1alpha1):
- Added
spec.publicEndpointEnabledfield. - Added
status.publicEndpointDomainNamefield.
Dialogflow CX launched two new integrations in preview:
Vertex AI Search (Enterprise Search): Customer-managed encryption key integration
Customer-managed encryption keys (CMEK) is available as an allowlisted preview feature.
If you store your data in a US multi-region data store, you can provide your own encryption key to protect your data at rest.
For information, see Customer-managed encryption keys.
Vertex AI Search (Enterprise Search): Search tuning
Search tuning is available as an allowlisted preview feature. You provide additional training data in the form of query and segment pairs. We use this data to tune the model for your app.
For information, see Improve search results with search tuning.
Vertex AI Search (Enterprise Search): VPC Service Controls are GA
Virtual Private Cloud Service Controls support for Enterprise Search is generally available (GA).
For more information, see Supported products and limitations in the VPC Service Controls documentation. For general information about VPC Service Controls, see Overview of VPC Service Controls.
Vertex AI Search (Enterprise Search): Data location
Vertex AI Search may be configured for data location pursuant to the "Data Location" section of the Service Specific Terms.
For information about data residency in Vertex AI Search, see Enterprise Search locations.
Vertex AI Search (Enterprise Search): Support for Access Transparency
Access Transparency supports Vertex AI Search in preview.
For more information, see Enable Access Transparency in Enterprise Search.
Vertex AI Search (Enterprise Search): Citations for search with follow-ups
Citations indicate from which search results specific sentences in the summary are taken.
For more information, see Configure the summary.
Vertex AI Search (Enterprise Search): Ignore adversarial queries and non-summary seeking queries for search with follow-ups
Ignore adversarial queries can stop generation of summaries that are unsafe or violate policy.
Non-summary seeking queries stop generation of summaries that aren't helpful for some queries.
For more information, see Configure the summary.
Vertex AI Search (Enterprise Search): Additional languages supported
Search, snippets, and other features are now supported in the following languages:
- Arabic
- Chinese (Simplified)
- Greek
- Hebrew
- Japanese
- Korean
- Polish
- Russian
See Languages.
This is a follow-up message to the release note regarding blue-green upgrades from September 18, 2023. You can now resume upgrading clusters with the blue-green upgrade strategy as the issue with rollback functionality has been fixed. GKE is no longer blocking automatic upgrades due to this issue.
containsOnly() function released to General Availability.
You can now use the containsOnly() function to query findings with an array-type attribute or subfield that only contains values that match the specified filter, and no other values.
For more information, see The containsOnly function.
Private Service Connect backends support using an external regional TCP proxy load balancer or an internal regional TCP proxy load balancer to access published services. These features are available in General Availability.
September 28, 2023
Assured WorkloadsThe IL2 compliance program is now generally available. For a list of IL2-compliant Google Cloud products, see the Supported products page.
The following BigQuery ML point-in-time lookup functions are now in preview. These functions let you specify a point-in-time cutoff when retrieving features for training a model or running inference, in order to avoid data leakage.
- Use the
ML.FEATURES_AT_TIMEfunction to use the same point-in-time cutoff for all entities when retrieving features. - Use the
ML.ENTITY_FEATURES_AT_TIMEfunction to retrieve features from multiple points in time for multiple entities.
You can now use IAM conditions to control access to BigQuery resources. This feature is in preview.
Certificate Manager supports Mutual TLS (mTLS) authentication. This feature is generally available (GA).
You can now configure your alerting policy documentation with custom subject lines. For more information, see Configure the subject line of notifications.
The following pg_wait_sampling and rdkit flags are generally available:
pg_wait_sampling flags
- cloudsql.enable_pg_wait_sampling: enable the
pg_wait_samplingextension for Cloud SQL for PostgreSQL instances. - pg_wait_sampling.history_size: set the size of the in-memory ring buffer for history sampling, in terms of the number of samples.
- pg_wait_sampling.history_period: set the time interval for history sampling, in milliseconds.
- pg_wait_sampling.profile_period: set the time interval for profile sampling for wait events, in milliseconds.
- pg_wait_sampling.profile_pid: specify whether the wait profile that accumulates samples for each process and waits event is collected for each process or for all processes.
- pg_wait_sampling.profile_queries: specify whether the wait profile is collected for each query or for all queries.
rdkit flags
- rdkit.tanimoto_threshold: set the threshold value for the Tanimoto similarity operator.
- rdkit.dice_threshold: set the threshold value for the Dice similarity operator.
- rdkit.do_chiral_sss: specify whether stereochemistry is used in substructure matching.
- rdkit.do_enhanced_stereo_sss: specify whether enhanced stereo is used in substructure matching.
- rdkit.sss_fp_size: set the size of the fingerprint used for substructure screening, in bits.
- rdkit.morgan_fp_size: set the size of morgan fingerprints, in bits.
- rdkit.featmorgan_fp_size: set the size of featmorgan fingerprints, in bits.
- rdkit.layered_fp_size: set the size of layered fingerprints, in bits.
- rdkit.rdkit_fp_size: set the size of rdkit fingerprints, in bits.
- rdkit.hashed_torsion_fp_size: set the size of topological torsion bit vector fingerprints, in bits.
- rdkit.hashed_atompair_fp_size: set the size of atom pair bit vector fingerprints, in bits.
- rdkit.reaction_sss_fp_size: set the size of the structural chemical reaction fingerprint, in bits.
- rdkit.reaction_difference_fp_size: set the size of the difference chemical reaction fingerprint, in bits.
- rdkit.reaction_sss_fp_type: specify the type of structural chemical reaction fingerprint.
- rdkit.reaction_difference_fp_type: specify the type of difference chemical reaction fingerprint.
- rdkit.ignore_reaction_agents: specify whether agents of a chemical reaction are taken into account.
- rdkit.agent_FP_bit_ratio: specify the weight of the impact of agents contained in a chemical reaction fingerprint.
- rdkit.move_unmmapped_reactants_to_agents: specify whether unmapped reactant agents of a chemical reaction are taken into account.
- rdkit.threshold_unmapped_reactant_atoms: set the ratio of allowed unmapped reactant atoms.
- rdkit.init_reaction: specify whether the reaction is ready for use.
- rdkit.difference_FP_weight_agents: specify the weight factor for agents compared to reactants and products in reaction difference fingerprints.
- rdkit.difference_FP_weight_nonagents: specify the weight factor for reactants and products compared to agents in reaction difference fingerprints.
- rdkit.avalon_fp_size: set the size of avalon fingerprints, in bits.
Beginning Oct 30, 2023, Cloud Storage will change how it enforces egress bandwidth quotas.
- Instead of using the same default value for all projects, egress bandwidth quotas will depend on each project's history, such whether the billing account is in good standing.
- For most projects, egress bandwidth quotas will either remain unchanged or will increase.
- Once this change takes effect, you can view your project's egress bandwidth quotas in the Console.
New Dataproc on Compute Engine subminor image versions:
- 2.0.78-debian10, 2.0.78-rocky8, 2.0.78-ubuntu18
- 2.1.26-debian11, 2.1.26-rocky8, 2.1.26-ubuntu20, 2.1.26-ubuntu20-arm
Upgraded the Cloud Storage connector version to 2.2.17 in the latest 2.0 and 2.1 Dataproc on Compute Engine image versions.
Upgraded Hive version from 3.1.2 to 3.1.3 in the latest Dataproc on Compute Engine 2.0 image version.
When you create a release using the gcloud CLI version 445, 446, or 447, you might encounter an error
where gcloud requires the clouddeploy.config.get permission. To fix this issue, upgrade to gcloud CLI version 448 or greater.
After January 15, 2024, some Policy Intelligence features will only be available for customers with organization-level activations of Security Command Center. For more information, see Billing questions.
Using Policy Troubleshooter to troubleshoot deny policies is generally available.
SAP HANA Fast Restart enabled using Terraform
SAP HANA Fast Restart is enabled when you deploy SAP HANA on Google Cloud using the sap_hana or sap_hana_ha Terraform module, version 202309280828 or later. The fast restart option is enabled through the enable_fast_restart Terraform argument, which by default is set to true.
For more information, see the deployment guide for your SAP HANA scenario.
Preview stage supported for the following integration:
September 27, 2023
Apigee Advanced API SecurityOn September 27, 2023, we released an updated version of Advanced API Security.
Public preview of Advanced API Security Alerting
Advanced API Security's new alerting feature lets you create alerts for events related to API security using Google Cloud Monitoring, such as changes to your security scores or incidents involving detected API abuse. You can configure alerts to send you notifications by email or other channels when these events occur, so you can take action to counteract them.
If you need to re-enable deployments for Java 8 apps past the legacy runtime end of support date (starting January 30, 2024), you can define a new organization policy with constraints/appengine.runtimeDeploymentExemption. This policy constraint can be used before the end of support date. Learn more about enabling deployments for runtimes reaching end of support.
If you need to re-enable deployments for PHP 5.5 apps during the legacy runtime end of support period (starting January 30, 2024), you can define a new organization policy with constraints/appengine.runtimeDeploymentExemption. This policy constraint can be used before the end of support date. Learn more about enabling deployments for runtimes reaching end of support.
If you need to re-enable deployments for Python 2.7 apps during the legacy runtime end of support period (starting January 30, 2024), you can define a new organization policy with constraints/appengine.runtimeDeploymentExemption. This policy constraint can be used before the end of support date. Learn more about enabling deployments for runtimes reaching end of support.
Release Notes 6.2.35
GA - 8th October
Risk Score and Severity added
Two new information fields have been added to the Alert Details widget which appears in the Alert overview tab. These are Risk score and Severity. These values will only be populated when using the Google Chronicle SIEM connector.
Export/Import for Advanced Reports (using Looker) now supported both in the platform and using new APIs.
This enables customers to create reports on their staging environment and then import the template without the data into their production environment.
In the platform, the import is at the top of the Reports queue while the export icon is inside the actual report itself. The report file is in yaml format.
New APIs are as follows:
/api/external/v1/looker/report/import
/api/external/v1/looker/export/{report_id}
Playbook name drop-down not showing any playbook names in various Playbook actions (ID #00248732)
Placeholders located inside other placeholders not always picked up correctly (ID #00244133)
Case title says unknown (ID #00249611)
GetCaseFullDetails and GetWallActivitiesV2 API endpoints failing to return results (ID # 00243878)
Dedicated Cloud Interconnect support is available in the following colocation facilities:
- Cologix MTL10-H - Montréal
For more information, see the Locations table.
Long running jobs greater than 1 hour are at general availability (GA).
Cloud TPU now supports TensorFlow 2.14.0. For more information see the TensorFlow 2.14.0 release notes.
Creating a reservation or future reservation request by using an instance template that specifies an A2, C3, or G2 machine type causes errors or problems with consumption. For more information, see Known issues.
cos-109-17800-0-45
| Kernel | Docker | Containerd | GPU Drivers |
| COS-6.1.42 | v24.0.5 | v1.7.2 | v535.104.05(default, latest),v470.199.02(R470 for K80 compatibility) |
Promoted to stable.
September 26, 2023
Cloud Load BalancingRegional external HTTP(S), internal HTTP(S), and the regional internal TCP proxy load balancers now use distributed Envoy health checks instead of Google's centralized health checking mechanism. Envoy health check probes originate from the proxy-only subnet associated with the load balancer.
For more details, see the Hybrid NEG documentation: Distributed Envoy health checks.
This feature is available in General availability.
Cloud SQL supports the preview version of the enable-high-availability recommender. This service proactively generates recommendations that help you bring your important instances within SLA by providing data redundancy. This might be helpful during a zonal outage or when an instance runs out of memory. For more information, see Improve instance reliability by enabling high availability.
Cloud SQL supports the preview version of the enable-high-availability recommender. This service proactively generates recommendations that help you bring your important instances within SLA by providing data redundancy. This might be helpful during a zonal outage or when an instance runs out of memory. For more information, see Improve instance reliability by enabling high availability.
Cloud SQL supports the preview version of the enable-high-availability recommender. This service proactively generates recommendations that help you bring your important instances within SLA by providing data redundancy. This might be helpful during a zonal outage or when an instance runs out of memory. For more information, see Improve instance reliability by enabling high availability.
You can now control the mounting behavior of Cloud Storage FUSE by using a configuration file instead of global options.
Cloud Storage FUSE is now available for use on ARM64-based machines.
Preview: c3d-standard, c3d-highmem, c3d-highcpu, and c3d-standard-lssd virtual machines are available in the following regions:
- Council Bluffs, Iowa, North America,
us-central1 - Moncks Corner, South Carolina, North America,
us-east1 - Ashburn, Virginia, North America ,
us-east4 - St. Ghislain, Belgium, Europe,
europe-west1 - Eemshaven, Netherlands, Europe,
europe-west4 - Jurong West, Singapore, Asia,
asia-southeast1
See the General purpose machines document for details.
Config Controller now uses the following versions of its included products:
- Config Connector v1.109.0, release notes
cos-101-17162-279-55
| Kernel | Docker | Containerd | GPU Drivers |
| COS-5.15.120 | v20.10.24 | v1.6.21 | v470.199.02(default),v535.104.05 |
Fixed an issue where IPv6 networking would fail under high CPU load.
Upgraded go from 1.19.13 to 1.20.8. This also required upgrading dev-go/go-tools to 0.3.0. Fixed CVE-2023-39318 and CVE-2023-39319.
Fixed CVE-2023-40217 in the dev-lang/python package.
Fixed CVE-2023-4921 in the Linux kernel.
Fixed CVE-2023-4569 in the Linux kernel
Fixed CVE-2023-4623 in the Linux kernel.
Fixed CVE-2023-4622 in the Linux kernel.
cos-beta-109-17800-0-45
| Kernel | Docker | Containerd | GPU Drivers |
| COS-6.1.42 | v24.0.5 | v1.7.2 | v535.104.05(default),v470.199.02(R470) |
Fixed an issue where IPv6 networking would fail under high CPU load.
Fixed CVE-2023-40217 in the dev-lang/python package.
Updated dev-lang/go to 1.21.1. This fixes CVE-2023-39318 and CVE-2023-39319.
Fixed CVE-2023-4921 in the Linux kernel.
Fixed CVE-2023-4569 in the Linux kernel.
cos-dev-113-17927-0-0
| Kernel | Docker | Containerd | GPU Drivers |
| COS-6.1.52 | v24.0.5 | v1.7.3 | v535.104.05(default, latest),v470.199.02(R470 for K80 compatibility) |
Fixed CVE-2023-32636, CVE-2023-29499, CVE-2023-32643, CVE-2023-32665, CVE-2023-32611 in glib and glib-utils.
Fixed CVE-2023-40217 in the dev-lang/python package.
Updated dev-lang/go to 1.21.1. This fixes CVE-2023-39318 CVE-2023-39319, CVE-2023-39320, CVE-2023-39321, and CVE-2023-39322.
Fixed CVE-2023-4921 in the Linux Kernel.
cos-105-17412-156-63
| Kernel | Docker | Containerd | GPU Drivers |
| COS-5.15.120 | v23.0.3 | v1.7.2 | v470.199.02(default),v535.104.05 |
Fixed CVE-2023-40217 in the dev-lang/python package.
Fixed CVE-2023-4921 in the Linux kernel.
Fixed CVE-2023-4569 in the Linux kernel.
Fixed CVE-2023-4623 in the Linux kernel.
cos-93-16623-461-35
| Kernel | Docker | Containerd | GPU Drivers |
| COS-5.10.177 | v20.10.24 | v1.6.20 | v450.248.02(default),v470.199.02(R470),v535.104.05 |
Fixed CVE-2023-4921 in the Linux kernel.
Fixed CVE-2023-4623 in the Linux kernel.
Fixed CVE-2023-4622 in the Linux kernel.
cos-97-16919-353-50
| Kernel | Docker | Containerd | GPU Drivers |
| COS-5.10.186 | v20.10.24 | v1.6.21 | v470.199.02(default),v535.104.05 |
Fixed an issue where IPv6 networking would fail under high CPU load.
Fixed CVE-2023-4921 in the Linux kernel.
Fixed CVE-2023-4623 in the Linux kernel.
Preview: Migrate to Virtual Machines lets you migrate the disks of source virtual machine (VM) instances to Persistent Disk volumes on Google Cloud with the following options:
- Migrate the Persistent Disk volumes without attaching them to a VM instance
- Create a new VM instance and attach the migrated Persistent Disk volumes to it
September 25, 2023
Advisory NotificationsAdvisory Notifications lets you opt in to or out of optional notification types. For more information, see Opt in to or out of notifications.
Release 1.15.5
Anthos clusters on bare metal 1.15.5 is now available for download. To upgrade, see Upgrading Anthos on bare metal. Anthos clusters on bare metal 1.15.5 runs on Kubernetes 1.26.
Fixed an issue to prevent cluster upgrades from starting on a node before either all Pods have been drained or the Pod draining timeout has been reached.
The following container image security vulnerabilities have been fixed in 1.15.5:
High-severity container vulnerabilities:
Medium-severity container vulnerabilities:
Known issues:
For information about the latest known issues, see Anthos clusters on bare metal known issues in the Troubleshooting section.
On September 25, 2023 we release an updated version of Advanced API Security.
If a flow hook contains any FlowCallout policies, Advanced API Security scores now processes all policies from the shared flows that the flow callouts are pointing to for scoring. Further callout chaining is not supported.
| Bug ID | Description |
|---|---|
| 300849647 | Fixed a bug in Security scores for proxies that don't contain any policies in the categories authorization, mediation, threat or CORS . |
On September 25, 2023, we released an updated version of the Apigee UI.
This release includes a new Overview page for Apigee API Management in the Google Cloud console.
From the Overview page, you can:
- Get started as a new Apigee user
- Test your Apigee runtime
- View key resource usage metrics
- Explore Apigee API management features
For more information, see UI overview.
Materialized views over BigLake metadata cache-enabled tables can reference structured data stored in Cloud Storage. These materialized views function like materialized views over BigQuery-managed storage tables, including the benefits of automatic refresh and smart tuning. This feature is now generally available (GA).
Authorized stored procedures are now generally available (GA). This feature lets you share stored procedures with users or groups without giving them direct access to the underlying tables.
Support for Google AdWords is now deprecated by the BigQuery Data Transfer Service. For information about transfers from Google Ads, see Google Ads transfers.
A weekly digest of client library updates from across the Cloud SDK.
All Cloud SQL for MySQL Enterprise Plus edition instances now support up to 35 days of retained transaction logs for point-in-time recovery.
The rollout of the following minor version is currently underway:
MySQL 5.7.42 is upgraded to MySQL 5.7.43. For more information, see MySQL 5.7 Release Notes.
If you use a maintenance window, then the updates to the minor versions happen according to the timeframe that you set in the window. Otherwise, the updates occur within the next few weeks.
The new maintenance version is [MySQL version].R20230909.02_00. The details of the security fixes applied as part of this release will be published in the MySQL maintenance changelog.
To learn how to check your maintenance version, see Self-service maintenance. To find your maintenance window or to manage maintenance updates, see Find and set maintenance windows.
A monthly digest of client library updates from across the Cloud SDK.
Java
Changes for google-cloud-spanner
6.46.0 (2023-09-06)
Features
- Add support for databoost (#2505) (dd3e9a0)
- Support PostgreSQL for autoConfigEmulator (#2601) (fbf1df9)
Bug Fixes
Documentation
6.47.0 (2023-09-12)
Features
- Add devcontainers for enabling github codespaces usage. (#2605) (a7d60f1)
- Disable dynamic code loading properties by default (#2606) (d855ebb)
Bug Fixes
- Add reflection configurations for com.google.rpc classes (#2617) (c42460a)
- Avoid unbalanced session pool creation (#2442) (db751ce)
Dependencies
Node.js
Changes for @google-cloud/spanner
7.0.0 (2023-08-30)
⚠ BREAKING CHANGES
- upgrade to Node 14 (#1890)
Bug Fixes
Miscellaneous Chores
Mobile release 2.2
iOS and Android SDK content cards: You can use content cards to deliver specific messages to end-users during virtual agent chats. Content cards have customizable components including titles, text, carousel messages, banners, and much more. You can also embed a link that the end-user accesses when they click on the card. For example, if you have a list of restaurant options, you might create a content card for each one with a deep link that brings the user to the restaurant's website when they click.
iOS SDK, improved accessibility: The mobile iOS SDK now fulfills the following Web Content Accessibility Guidelines (WCAG) criteria for improved accessibility:
- Identify Input Purpose: Ensure that each input field is programmatically determinable, allowing users to autofill inputs.
- Identify Purpose: Ensure that the purpose of many elements on a page can be programmatically determined, making it easier for agents to extract and present the purpose to users using different modalities.
- Parsing: Ensure that there are no major code errors that affect accessibility so that agents can accurately interpret and parse content using assistive technologies.
- Name, Role, Value: Ensure that assistive technologies can gather information about, activate (or set), and keep up to date on the status of user interface controls in the content.
- Status Messages: Ensure that users of assistive technologies are notified when content is updated dynamically without receiving visual focus.
Mobile bug fixes:
- Fixed an intermittent issue where quick reply buttons could be pressed outside their boundaries.
- Fixed an issue where a virtual agent's avatar icon sometimes was not displayed alongside their message.
ServiceNow enhanced capabilities: This release brings new capabilities to the ServiceNow integration, including support for:
- Default User: Reduced admin permission requirements.
- More flexible field mapping and property assignment configuration options.
- Support for new CRM features:
- Surveys
- Agent Status inheritance
- Custom Callback number
- Improved support for OAuth authentication, for example now including admin tokens.
Assign virtual agent transfers to the top-level queue: You can now assign a virtual agent to transfer to a top-level queue. The virtual agent will navigate consumers through any active sub and leaf queue options. If a top-level queue has no available leaf queues or is incorrectly configured, the IVR fallback will redirect the caller to the previous queue (if human agents are available) or provide an error message before disconnecting (if the top-level queue has no available agents).To enable this feature:
- Enter the top-level queue ID in the DialogFlow destination (you can find parent queue IDs in the Virtual Agent queue menu settings).
- Ensure all sub and leaf queues are active.
Chat API suite: A new set of APIs are now available that allow you to customize your chat experience. As a part of this feature, webhooks are available for receiving notifications about events that occur during the chat interaction. You can enable and manage them in Developer Settings > Webhooks. The new chat endpoints allow you to:
- Create a chat, send and receive plain text messages, and end the chat with both agents and virtual agents.
- Exchange messages with media attachments such as pictures, videos, and documents.
Apps API: Change agent status: Two new endpoints are now available to manage agent statuses:
GET /apps/api/v1/agent_statuses: Retrieve current agent statuses.POST /apps/api/v1/agent_statuses: Update/change an agent status.
These endpoints allow you to modify agent statuses. You can change an agent's status from Available to any custom status and vice versa. Attempting to change an agent's status to a system status, such as In-Call, will result in an error. Similarly, attempting to change an agent's status from any system status will prompt an error message.
These endpoints support bulk status updates, allowing you to update statuses for an entire team or selected agents simultaneously.
NICE QM integration: CCAI Platform now supports an out-of-the-box data export for NICE QM. You can enable this feature in Developer Settings > Session Data Export > NICE Integration. The following information is required to enable the NICE QM data export:
- NICE API Endpoint
- API Authentication credentials
After the integration is enabled, you can enable session data related to IVR call events and agent login/logout events in your NICE integration.
Missed chat / Unresponsive status (while in-chat): Improved handling of agent statuses when a session cast to an agent fails due to network issues.
- When a chat/call is cast to an agent but fails due to network or permission issues, the agent's next status will be moved to
Unresponsiveregardless of the status they're currently in. - If a call/chat is cast to an agent but the agent fails to pick up, the agent's next status will be moved to
Missed Chatstatus regardless of the status they're currently in.
ANI retention management: You can now use the admin API to turn ANI storage on and off. There is also a new setting for ANI retention period; the default is 120 days.
Permission for access to call recording/chat transcript files: A new role permission allows you to define whether users can have access to call recordings and/or chat transcripts when they are stored in external storage and without a CRM. When inactive, users won't be able to access these files from either the Completed Calls or Chats monitoring pages or associated downloadable reports. Shared links to these files fall under the same permissions.
Disable Whatsapp for CCAI Platform: The Whatsapp flag for CCAI Platform is disabled until we have OEM compatibility for Whatsapp.
CRM record autoload: A new setting is available to automatically update the CRM when an agent navigates between multiple active chats. This eliminates the need for the agent to manually search and load the corresponding CRM record each time they switch between chats. To enable this setting, go to Settings > Chat > Global Settings > Global Chat Settings and select the following checkbox: Automatically load CRM Record when switching between chat tabs.
POST events, chat message events: Two new events added to the existing agent chat adapter events:
- Chat Inbound Message: Event indicating that a new consumer message was received; includes the message content.
- Chat Outbound Message: Event indicating that a new agent message was sent; includes the message content.
Restrict international calling by area code, short code, phone number: The international calling configuration now includes the option to limit calls by area code, short code, and phone number. You can extend this configuration to a specific agent or have it applied as a rule to all agents.
MS Dynamics, object type Contact: You can now populate different fields on a "Case" object, when a "Contact" Object Type is used. The default action within MS Dynamics is to fill in the customer information only when a Case is created. This updated setting allows the contact field to be populated with the customer information from a Contact object at the same time. To enable this feature navigate to Developer Settings to access your MS Dynamics configuration. In the Account Lookup settings, select Contact under Object Type.
Call settings, post-call session transfers: You can now set up a cold transfer to a virtual agent at the end of a call. This configuration allows you to set up an automated workflow, such as a post-call survey. To enable this feature, go to Settings > Call Settings and toggle the Post-call session transfers to ON.
New permissions added to historical reports: You can now limit access to assigned teams only or assigned queues only. For example, if you apply the assigned teams only permission option, only data for agents on that user's team(s) will be downloaded. There is also a new permission that allows Admins to manage who has access to the Session Data report, in addition the assigned team only permission.
Fixed an issue that occasionally caused the Queue Structure Edit page to jump places.
Fixed an issue where a holiday was not respected by queues if it was configured to be observed on the last occurrence of the month.
Dialogflow CX now provides the call companion feature in preview, which provides a mobile-based user interface that supplements a phone call with an agent.
We are launching an RC version of the pretrained-invoice-v1.5-2023-09-15 invoice processor. It includes:
- Improved base-entity extraction model for documents in English.
- Line-item grouping quality improvements.
- Better support for multi-line, multi-segment entities such as addresses and line-item descriptions.
- Enforcement of occurrence type
OPTIONAL_ONCE/REQUIRED_ONCEfor properties of nested entities. - Updated OCR engine.
Add the doc_ai_document_type and doc_ai_document_path fields to the Pipeline API Cloud Function request.
Support "store_document_metadata_only" boolean flag in the Pipeline API Cloud Function response.
Your Customer Insights reports contain a new field, transaction_type. For more details, see the field's documentation.
A weekly digest of client library updates from across the Cloud SDK.
Node.js
Changes for @google-cloud/pubsub
3.7.5 (2023-09-20)
Bug Fixes
Java
Changes for google-cloud-pubsub
1.125.2 (2023-09-18)
Dependencies
Vertex AI Workbench instances are now generally available (GA). Vertex AI Workbench instances combine features from managed notebooks and user-managed notebooks to provide a robust data science solution. Supported features include:
- Idle timeout
- BigQuery and Cloud Storage integrations
- End-user and service account authentication
- VPC Service Controls
- Customer managed encryption keys (CMEK) and Cloud External Key Manager (Cloud EKM)
- Health status monitoring
- Scheduled notebook runs
- Dataproc integration
To get started, see Introduction to Vertex AI Workbench instances.
September 22, 2023
Apigee IntegrationVertex AI - Predict task
Starting with this release, Apigee Integration provides the Vertex AI - Predict task that lets you perform online predictions on your ML models.
Vertex AI - Predict task
Starting with this release, Application Integration provides the Vertex AI - Predict task that lets you perform online predictions on your ML models.
The CJIS compliance program now supports the following products. See Supported products for more information:
- Cloud Run
- Cloud Identity
- Google Workspace Admin Console
You can now view the pod for your Bare Metal Solution servers, networks, volumes, and NFS Shares. This feature is generally available (GA).
Preview: Compute Engine API now enforces the Filtered list cost overhead quota, which limits the number of resources to be filtered out from server-side *.list and *.aggregatedList methods.
The quota is charged against the following metrics:
- Global:
compute.googleapis.com/filtered_list_cost_overhead - Regional:
compute.googleapis.com/filtered_list_cost_overhead_per_region
For more information, see Rate quotas and best practices for list filtering.
Preview: You can now view the organization-wide patch status dashboard and OS policy compliance reports by using VM Manager.
The Google Cloud console labels for OS patch management and OS configuration management on VM Manager pages have been renamed to Patch and OS policies respectively.
New Dataproc on Compute Engine subminor image versions:
- 2.0.77-debian10, 2.0.77-rocky8, 2.0.77-ubuntu18
- 2.1.25-debian11, 2.1.25-rocky8, 2.1.25-ubuntu20, 2.1.25-ubuntu20-arm
New Dataproc Serverless for Spark runtime versions:
- 1.1.32
- 2.0.40
- 2.1.19
In the latest Dataproc on Compute Engine 2.0 and 2.1 image versions, unset the CLOUDSDK_PYTHON variable to allow the gcloud command-line tool to use its bundled Python interpreter.
Fixed Scala compilation errors bug where Jupyter notebooks were not visible with the Toree kernel in Dataproc on Compute Engine 2.1 images.
Vertex AI Search (Enterprise Search): Third-party data connectors
You can set up your Vertex AI Search data stores to sync with data from Jira, Confluence, or Salesforce.
This feature is in private preview. To try this feature, contact your Google account team to find out if you qualify.
For more about setting up a connection to third-party data, see Create an Enterprise Search data store.
Tag key and value short names can now have a maximum length of 256 characters. For more information, see Tags overview.
September 21, 2023
AlloyDB for PostgreSQLAlloyDB now offers basic instances, which are primary instances containing only one node, in one zone. Basic instances provide a lower-cost alternative to highly available instances, and are appropriate for use in non-production environments that don't require high availability.
Database server compatibility with PostgreSQL version 15 is now available in Preview. You can create a cluster with PostgreSQL 15 compatibility.
Supported configuring the period that Config Sync waits before re-pulling the latest chart with the field spec.helm.period in RootSync or RepoSync. The default is 1 hour. For more information, see RootSync and RepoSync fields.
Fixed an issue related to metric labels commit and type that could cause an increase in Google Cloud Monitoring metric write throughput. The issue was resolved by preventing high-cardinality labels commit and type from being sent to Google Cloud Monitoring. The two labels were introduced in Anthos Config Management version 1.15.0. For information on the labels, see Config Sync Metric Labels.
Fixed a repeating error in the otel-collector deployment log that has been occuring since Anthos Config Management version 1.15.0.
The constraint template library's K8sRestrictRbacSubjects template now returns all violation messages for ClusterRoleBinding or RoleBinding with more than one violation. For reference, see Constraint template library.
Release 1.16.1
Anthos clusters on bare metal 1.16.1 is now available for download. To upgrade, see Upgrading Anthos on bare metal. Anthos clusters on bare metal 1.16 runs on Kubernetes 1.27.
Supported node pool versions:
If you use selective worker node pool upgrades to upgrade a cluster to version 1.16.1, the following versions are supported for the worker node pools:
|
|
Functionality changes:
Added the optional
userClaimfield to the ClientConfig custom resource definition bundled with Anthos clusters on bare metal. This change improves support for Azure AD integrations with Anthos Identity Service.Updated constraint on NodePool
spec.upgradeStrategy.concurrentNodesto be the smaller of either 15 nodes or 50% of the size of the node pool.
Fixes:
Fixed an issue where etcd blocked upgrades due to an incorrect initial-cluster-state.
Fixed an issue that blocked upgrades to version 1.16 for clusters that have secure computing mode (
seccomp) disabled.Fixed an issue to prevent cluster upgrades from starting on a node before either all Pods have been drained or the Pod draining timeout has been reached.
Fixed an issue where the memory resource requests value wasn't set properly for
etcd-events.
Fixes:
The following container image security vulnerabilities have been fixed in 1.16.1:
Critical container vulnerabilities:
High-severity container vulnerabilities:
Medium-severity container vulnerabilities:
Known issues:
For information about the latest known issues, see Anthos clusters on bare metal known issues in the Troubleshooting section.
On September 21, 2023 Blockchain Node Engine released a limited preview version of the software. This release adds the Polygon blockchain node option. Access to the user interface and APIs is limited to specific customers until the GA release.
Cloud Run integrations (Preview) are now available in the following regions:
asia-northeast1asia-northeast2asia-south1asia-southeast2australia-southeast1europe-central2europe-north1europe-west2europe-west3northamerica-northeast1southamerica-east1us-east4us-west2us-west3
The oracle_fdw extension, version 1.2 is now available. This extension provides a foreign data wrapper for accessing Oracle databases easily and efficiently. For more information, see Configure PostgreSQL extensions.
The rollout of the following minor versions, extension versions, and plugin versions is currently underway:
Minor versions
- 11.19 is upgraded to 11.21.
- 12.14 is upgraded to 12.16.
- 13.10 is upgraded to 13.12.
- 14.7 is upgraded to 14.9.
- 15.2 is upgraded to 15.4.
Extension and plugin versions
- orafce is upgraded from 3.24.4 to 3.25.1.
- pglogical is upgraded from 2.4.2 to 2.4.3.
- pgvector is upgraded from 0.4.2 to 0.5.0.
- PostGIS is upgraded from 3.2.3 to 3.2.5.
If you use a maintenance window, then the updates to the minor, extension, and plugin versions happen according to the timeframe that you set in the window. Otherwise, the updates occur within the next few weeks.
The new maintenance version is [PostgreSQL version].R20230830.01_00. To learn how to check your maintenance version, see Self service maintenance. To find your maintenance window or to manage maintenance updates, see Find and set maintenance windows.
Generally available: Instance templates are available as both regional and global resources. To reduce cross-region dependency or to achieve data residency, use a regional instance template to create virtual machines (VM), managed instance groups (MIG), or reservations. For more information, see Regional and global instance templates.
Generally available: Autohealing in managed instance groups (MIG) supports regional health checks. To reduce cross-region dependency or to achieve data residency, use a regional health check. For more information, see Set up an application health check and autohealing.
Launched Document AI Enterprise Document OCR v2.0 and OCR add ons in Preview.
Enterprise Document OCR launched a Release Candidate, pretrained-ocr-v2.0-2023-06-02, which includes:
- Upgraded OCR model, optimized for various document use cases.
- Visual-element detector for boxed characters, which can increase quality up to 10% for documents with text boxes.
For more details, see the documentation, including the user guide.
OCR add ons are available from the Enterprise Document OCR processor when using pretrained-ocr-v2.0-2023-06-02. These include:
- Checkbox extraction: Detects and extracts status (marked/unmarked) in the Enterprise Document OCR response.
- Math OCR: Identifies, recognizes, and extracts formulas from documents in LaTeX output format.
- Font-style detection: Identifies word-level font properties, including type, style, handwriting, weight, and color.
For more details, see the documentation.
The Observability dashboards on the GKE Clusters List, Cluster Details, and Workload List pages are now customizable. Additionally, the Cluster Details dashboards can be customized across the entire project, or per-cluster for specific use cases.
When you create a LoadBalancer service in GKE, the Google Cloud controllers automatically create the following firewall rules and apply them to the GKE nodes to allow inbound connections on the Service port:
- Internal load balancer with GKE subsetting or external load balancer with regional backend services (RBS):
k8s2-[cluster-id]-[namespace]-[service-name]-[suffixhash] - Internal load balancer without GKE subsetting or external load balancer with target pool:
k8s-fw-[loadbalancer-hash]
For clusters running version 1.25 or later, these rules now include the load balancer IP address in the destination ranges field to further control the inbound connections to the nodes. You can use the gcloud compute firewall-rules describe command to check a relevant firewall. The new field in the output is similar to the following:
destinationRanges:
- [LOADBALANCER_VIRTUAL_IP_ADDRESS]
For services that use externalIP, ensure you have firewall rules that allow traffic to the specified IP addresses.
Time-based one-time password (TOTP) as an additional multi-factor authentication option is generally available (GA).
Google Cloud's Agent for SAP version 2.6
Version 2.6 of Google Cloud's Agent for SAP is generally available (GA). This version introduces new options to configure the collection of Process monitoring metrics, and bug fixes for the collection of Workload Manager validation metrics.
For more information, see What's new with Google Cloud's Agent for SAP.
September 20, 2023
Apigee IntegrationApplication Integration is now available for your Google Cloud project. You can now use both Apigee Integration and Application Integration within the same Google Cloud project. For more information, see Using Application Integration.
The maximum number of rows for results returned in Connected Sheets has increased as follows:
- Pivot tables increased from 30,000 to 50,000 rows
- Data extracts increased from 25,000 to 50,000 rows
The following supported default parsers have changed. Each is listed by product name and log_type value, if applicable.
- Akamai Cloud Monitor (
AKAMAI_CLOUD_MONITOR) - AWS Cloudtrail (
AWS_CLOUDTRAIL) - AWS WAF (
AWS_WAF) - BIND (
BIND_DNS) - Cisco Email Security (
CISCO_EMAIL_SECURITY) - Cisco Firepower NGFW (
CISCO_FIREPOWER_FIREWALL) - Cisco Umbrella Web Proxy (
UMBRELLA_WEBPROXY) - Cloud DNS (
N/A) - Cloud SQL (
GCP_CLOUDSQL) - CSV Custom IOC (
CSV_CUSTOM_IOC) - Desynova Contido (
DESYNOVA_CONTIDO) - Elastic Windows Event Log Beats (
ELASTIC_WINLOGBEAT) - F5 Advanced Firewall Management (
F5_AFM) - Firewall Rule Logging (
N/A) - FortiMail Email Security (
FORTINET_FORTIMAIL) - GCP_KUBERNETES_CONTEXT (
GCP_KUBERNETES_CONTEXT) - Guardicore Centra (
GUARDICORE_CENTRA) - IBM Security Access Manager (
IBM_SAM) - Jamf Protect Telemetry (
JAMF_TELEMETRY) - Linux Auditing System (AuditD) (
AUDITD) - Microsoft Azure Activity (
AZURE_ACTIVITY) - Microsoft Graph API Alerts (
MICROSOFT_GRAPH_ALERT) - Microsoft Powershell (
POWERSHELL) - Netskope Web Proxy (
NETSKOPE_WEBPROXY) - Office 365 (
OFFICE_365) - Oracle Unified Directory (
ORACLE_OUD) - Palo Alto Networks Firewall (
PAN_FIREWALL) - SecureLink (
SECURELINK) - Signal Sciences WAF (
SIGNAL_SCIENCES_WAF) - Skybox Firewall Assurance (
SKYBOX_FIREWALL_ASSURANCE) - SOTI MobiControl (
SOTI_MOBICONTROL) - Stealthbits PAM (
STEALTHBITS_PAM) - Thinkst Canary (
THINKST_CANARY) - Unix system (
NIX_SYSTEM) - Vectra Stream (
VECTRA_STREAM) - VMware NSX (
VMWARE_NSX) - VMware Tanzu Kubernetes Grid (
VMWARE_TANZU) - Windows Defender ATP (
WINDOWS_DEFENDER_ATP) - Windows Event (XML) (
WINEVTLOG_XML) - Workspace Activities (
WORKSPACE_ACTIVITY) - Zscaler (
ZSCALER_WEBPROXY) - Zscaler CASB (
ZSCALER_CASB) - ZScaler NGFW (
ZSCALER_FIREWALL)
For details about changes in each parser, see Supported default parsers.
A release was made. Updates may include general performance improvements, bug fixes, and updates to the API reference documentation.
The gcloud CLI now supports setting a user-defined prefix for naming temporary components of a parallel composite upload.
cos-105-17412-156-59
| Kernel | Docker | Containerd | GPU Drivers |
| COS-5.15.120 | v23.0.3 | v1.7.2 | v470.199.02(default),v535.104.05 |
Fixed an issue where IPv6 networking would fail under high CPU load.
Manually refresh your web pages
Call the recrawlUris method to manually refresh specific web pages in a data store with Advanced website indexing turned on. You can check the status of the recrawl operation by polling the operations.get method.
Secret Manager is now available in the following region:
- me-central2
For more information, see Secret Manager locations.
Attack path simulations support additional resources
The attack path simulation feature that generates attack exposure scores and attack paths for your high-value resources now supports the following additional Google Cloud resources:
aiplatform.googleapis.com/Datasetaiplatform.googleapis.com/Featurestoreaiplatform.googleapis.com/MetadataStoreaiplatform.googleapis.com/Modelaiplatform.googleapis.com/TrainingPipelinecontainer.googleapis.com/Cluster
For more information, see Resource types supported in high-value resource sets.
Cloud SQL and Cloud Bigtable support Impacted relevance.
September 19, 2023
Apigee UIOn September 19, 2023, we released an updated version of the Apigee UI.
GA release of the Apigee UI in Cloud console
This is the GA release of the Apigee UI in Cloud console, a new version of the Apigee UI that is integrated with the Google Cloud console. The new UI makes it easier to use Apigee, while also performing related tasks in the Cloud console.
On September 19, 2023, we released an updated version of Apigee X (1-11-0-apigee-5).
| Bug ID | Description |
|---|---|
| 296296456 | Implemented fix to ensure that continueOnError is honored in the SpikeArest policy. |
| 229615887 | The flow variable target.scheme is now set consistently with the target server URL. |
| 78106145 | Fixed issue in the RegularExpressionProtection policy to ensure that multiple JSONPaths elements in a JSON payload are checked. |
| 294090782 | Implemented fix to allow the Apigee runtime to connect to a target server using a wildcard CNAME that references a wildcard A record. |
| 285592278 | Fixed issue with deduction of recurring fees from prepaid balances. |
| N/A | Upgraded infrastructure and libraries. |
| Bug ID | Description |
|---|---|
| 296506425, 295936113, 295925991, 295688738, 296110120, 281112632 | Security fix for apigee-runtime. This addresses the following vulnerabilities: |
| 287218068 | Fixed security vulnerability to prevent header injection using flow variables. |
Artifact Registry is now available in the me-central2 region (Dammam, Saudi Arabia).
Documentation has been updated to reflect new default options for jobs that use GPUs:
- Defining the machine type of the job's VMs is optional.
- Jobs that use software from June 3, 2023 and later don't need to mount GPUs to containers.
For more information, see Create and run a job that uses GPUs.
Chronicle feed management contains the following changes for the Google Cloud Storage source type:
- To create a new Google Cloud Storage feed, you must use the new service account. You are no longer required to use the following Chronicle global service account:
8911409095528497-0-account@partnercontent.gserviceaccount.com. The Chronicle global service account continues to be in use for existing Google Cloud Storage feeds. - In the feed management API, the fetchFeedServiceAccount method has been added to get a Chronicle service account, which you must use when you create a new Google Cloud Storage feed.
- In the feed management UI, the new field Get service account has been added to get a Chronicle service account, which you must use when you create a new Google Cloud Storage feed.
Chronicle recently disclosed a security vulnerability. For more information, see the GCP-2023-028 security bulletin.
Welcome to Chronicle Security Operations (SecOps), a Google Cloud service built as a specialized layer on top of Google's core infrastructure, designed for enterprises to privately retain, analyze, and search petabytes of security and network telemetry.
The SecOps platform provides instant context about suspicious and malicious activity. It can be used to detect threats, investigate the scope and cause of those threats, and provide remediation using pre-built integrations with enterprise workflow, response, and orchestration platforms.
The SecOps platform fuses key capabilities of Security Information and Event Management (SIEM), Security Orchestration, Automation, and Response (SOAR) and Threat Intelligence from Google Cloud, VirusTotal, and Mandiant.
The Chronicle SecOps platform enables security analysts to analyze and mitigate a security threat throughout its lifecycle by employing the following capabilities:
Collection: Data is ingested into the platform using software forwarders, parsers, connectors, and webhooks.
Detection: This data is aggregated, normalized using the Universal Data Model (UDM), and linked to detections and threat intelligence.
Investigation: Threats are investigated through case management, search, collaboration, and contextual mapping.
Response: Security analysts can respond quickly and provide resolutions using automated playbooks, incident management, and closed-loop feedback.
The following resource types are now publicly available through the analyze policy APIs (AnalyzeIamPolicy and AnalyzeIamPolicyLongrunning).
Cloud Tasks
cloudtasks.googleapis.com/Queue
Organization Policy
orgpolicy.googleapis.com/CustomConstraint
Cloud Bigtable is available in the me-central2 (Dammam) region. For more information, see Bigtable locations.
Sensitive Data Protection is available in me-central2 (Dammam). For more information, see Sensitive Data Protection locations.
The following new region is now available: me-central2.
Support for me-central2 (Dammam) region.
Support for me-central2 (Dammam) region.
Support for me-central2 (Dammam) region.
You can create Cloud Spanner regional instances in Dammam, Saudi Arabia (me-central2).
Cloud Storage is now available in Dammam, Saudi Arabia (me-central2 region).
Cloud VPN is now available in region me-central2 (Dammam, Saudi Arabia).
Pricing is available on the Cloud VPN pricing page.
Generally available: Dammam, Kingdom of Saudi Arabia, Middle East me-central2-a,b,c has launched with E2, N2, N2D, and T2D VMs in all three zones. See the Dammam region access document to learn more.
cos-105-17412-156-57
| Kernel | Docker | Containerd | GPU Drivers |
| COS-5.15.120 | v23.0.3 | v1.7.2 | v470.199.02(default),v535.104.05 |
Updated cos-gpu-installer to v2.1.8.
Fixed CVE-2023-4015, CVE-2023-4622 in the linux kernel.
Data Catalog is available in the me-central2 (Dammam) region.
For more information, see Regions.
Dataflow is now available in Dammam, Saudi Arabia (me-central2).
Dataproc is now available in the me-central2 region (Dammam, Saudi Arabia).
Dialogflow CX intent import/export and training phrase import/export are now generally available.
Vertex AI Search (Enterprise Search): Turn Enterprise edition on or off
You can turn Enterprise edition features on or off for existing apps.
For more about Enterprise edition, see About advanced features.
Cloud Deploy now supports workforce identity federation.
The me-central2 region in Dammam, Saudi Arabia is now available.
Added new Memorystore for Memcached region: Dammam (me-central2).
The Version Upgrade feature is now Generally Available on Memorystore for Memcached.
Added new Memorystore for Redis region: Dammam (me-central2).
The issue that you cannot get the status of a long-running operation for a spoke without the networkconnectivity.operations.get IAM permission in the spoke project is now resolved.
The new API and gcloud commands are documented on the Review proposed VPC spokes page. The previous API methods and gcloud commands are now deprecated.
Pub/Sub is now available in Dammam, Saudi Arabia (me-central2).
A weekly digest of client library updates from across the Cloud SDK.
Node.js
Changes for @google-cloud/pubsub
4.0.6 (2023-09-15)
Bug Fixes
- Bump the minimum gax up to 4.0.4 to get grpc-js fixes (#1829) (cc86e2b)
- deps: Update dependency @opentelemetry/semantic-conventions to ~1.17.0 (#1824) (679c6b8)
3.7.4 (2023-09-08)
Bug Fixes
- Always fill the topic and sub names when creating from a PubSub object (#1816) (ddf8b8a)
- Make retry policy back off more aggressively for RPCs that retry RESOURCE_EXHAUSTD (#1806) (bfcf523)
- Set grpc keepalive time|outs by default (#1814) (dedfdea)
- Simplify logic for HTTP/1.1 REST fallback option (#1809) (ee09b69)
Java
Changes for google-cloud-pubsub
1.125.1 (2023-09-14)
Dependencies
- Update actions/checkout action to v4 - abandoned (#1719) (b82f15a)
- Update dependency com.google.cloud:google-cloud-bigquery to v2.32.0 (#1725) (f40f09a)
1.125.0 (2023-09-12)
Features
Bug Fixes
- Make retry policy back off more aggressively for RPCs that retry RESOURCE_EXHAUSTD (#1704) (f61e7e0)
Dependencies
- Update actions/checkout action to v4 (#1712) (404c492)
- Update dependency com.google.cloud:google-cloud-bigquery to v2.31.2 (#1713) (32cb43c)
- Update dependency com.google.cloud:google-cloud-core to v2.23.0 (#1717) (929f778)
- Update dependency com.google.cloud:google-cloud-shared-dependencies to v3.15.0 (#1718) (0eeaa19)
- Update dependency com.google.protobuf:protobuf-java-util to v3.24.3 (#1698) (1157fbf)
- Update dependency org.easymock:easymock to v5.2.0 (#1711) (313f6dd)
- Update dependency org.graalvm.buildtools:junit-platform-native to v0.9.25 (#1709) (1cc8a53)
- Update dependency org.graalvm.buildtools:junit-platform-native to v0.9.26 (#1715) (f2cc75f)
- Update dependency org.graalvm.buildtools:native-maven-plugin to v0.9.25 (#1710) (9764c3f)
- Update dependency org.graalvm.buildtools:native-maven-plugin to v0.9.26 (#1716) (6c9e949)
Messages written to a dead letter topic configured for a BigQuery subscription contain an attribute with the reason the message could not be written to BigQuery. For more information, see Handle message failures.
Vulnerabilities per resource type graphic released to General Availability
The Security Command Center Overview page in the Cloud console now shows a Vulnerabilities per resource type graphic, which replaces the Active vulnerabilities over time by severity graphic. The Vulnerabilities per resource type graphic shows the resources in your organization (for example, Cloud Storage buckets, Compute Engine instances, and firewalls), how many active vulnerabilities exist for each resource, and the severity of those vulnerabilities.
For auto mode VPC networks, added a new subnet 10.216.0.0/20 for the Dammam me-central2 region. For more information, see Auto mode IP ranges.
Workflows is available in the following additional region: me-central2 (Dammam, Saudi Arabia).
September 18, 2023
Access ApprovalAccess Approval supports Cloud Monitoring in the Preview stage.
On September 18, 2023, we released an updated version of the Apigee UI.
This release includes improvements to the Create Environment experience in the Apigee UI in the Cloud console.
With this release, users can create a new environment, attach the environment to an Apigee instance, and assign the environment to an environment group within the same creation flow.
In addition, users can edit or remove environment group assignments from the environment detail page in the Apigee UI, simplifying management of their Apigee implementation.
For more information, see Working with environments.
A weekly digest of client library updates from across the Cloud SDK.
Go
Changes for bigquery/storage/apiv1beta1
1.55.0 (2023-09-11)
Features
- bigquery/datapolicies: Support using custom UDF in the data policy (20725c8)
- bigquery: Set PreferredMinStreamCount when creating read session (#8476) (22e095a), refs #8432
Bug Fixes
Java
Changes for google-cloud-bigquery
2.32.0 (2023-09-14)
Features
- Add support for converting interval fields to threeten PeriodDuration (#2838) (2294c2f)
- Add support for ExternalDatasetReference (#2871) (bbb86fd)
Dependencies
- Update actions/checkout action to v4 (#2862) (902e9b9)
- Update actions/upload-artifact action to v3.1.3 (#2867) (cbbf0fb)
- Update dependency com.google.api.grpc:proto-google-cloud-bigqueryconnection-v1 to v2.26.0 (#2873) (6196625)
- Update dependency com.google.cloud:google-cloud-datacatalog-bom to v1.30.0 (#2874) (6cafedf)
- Update dependency com.google.cloud:google-cloud-shared-dependencies to v3.15.0 (#2870) (f24439b)
- Update dependency org.graalvm.buildtools:junit-platform-native to v0.9.26 (#2868) (d01031c)
- Update dependency org.graalvm.buildtools:native-maven-plugin to v0.9.26 (#2869) (edd7141)
The BigQuery Data Transfer Service now supports transfers from Search Ads 360 using the new Search Ads 360 reporting API. This feature is in preview. Customers with existing Search Ads 360 transfers should migrate their workflows to be compatible with the new Search Ads 360. The BigQuery Data Transfer Service will stop its support for the old Search Ads 360 reporting API on May 31st, 2024.
A weekly digest of client library updates from across the Cloud SDK.
Java
Changes for google-cloud-bigtable
2.27.2 (2023-09-13)
Bug Fixes
- Check that all bulk mutation entries are accounted for (#1907) (9ad8a00)
- Set wait timeout on watchdog (#1913) (f8ba6fe)
Dependencies
- Update dependency org.graalvm.buildtools:junit-platform-native to v0.9.26 (#1896) (dfc4231)
- Update dependency org.graalvm.buildtools:native-maven-plugin to v0.9.26 (#1897) (d446856)
- Update shared dependencies (#1901) (96f2690)
2.27.1 (2023-09-12)
Bug Fixes
- Aggregate batching throttling latency per attempt and reset it between (#1905) (e6cc5f6)
- Make sure to propagate the response when throttling is enabled (#1908) (f743187)
Dependencies
The apache-airflow-providers-google package is upgraded to version 10.7.0 in images with Airflow 2.5.3 and 2.4.3. For more information about changes, see the apache-airflow-providers-google changelog from version 10.5.0 to version 10.7.0.
Version 10.7.0 includes new Cloud Run, Cloud Batch and Dataplex Data Quality operators:
- Cloud Run is used to build and deploy scalable containerized apps written in any language (including Go, Python, Java, Node.js, .NET, and Ruby) on a fully managed platform. The newly provided Cloud Run Operators enable creating, executing, updating, deleting and listing Cloud Run Jobs.
- Cloud Batch is a fully managed batch service to schedule, queue, and execute batch jobs on Google's infrastructure. The provided Cloud Batch Operators enable submitting, listing and deleting batch jobs as well as listing a job's tasks.
- Dataplex is an intelligent data fabric that provides unified analytics and data management across your data lakes, data warehouses, and data marts. New Dataplex operators handle creating, updating, getting, deleting and running a Data Quality scan, getting a Data Quality Scan job, creating and deleting a zone, as well as creating and deleting an asset.
Cloud Composer 2.4.3 images are available:
- composer-2.4.3-airflow-2.5.3 (default)
- composer-2.4.3-airflow-2.4.3
Cloud Composer versions 2.0.26 and 1.19.9 have reached their end of full support period.
Database Migration Service now supports customer-managed encryption keys (CMEK) that are externally managed with Cloud External Key Manager. For more details on CMEK support for each migration scenario, see CMEK integrations.
You can now save charts generated from a Log Analytics SQL query to a custom dashboard. For more information, see Save a chart to a custom dashboard.
You can now customize the Logs Dashboard page by using custom dashboards. For more information, see Visualize log severity and error metrics.
You can now use the Log fields pane of the Logs Explorer to filter your Kubernetes Container logs by their service name. The service name is extracted from the value of the pod_name label. For more information, see
Logs fields pane.
A weekly digest of client library updates from across the Cloud SDK.
Java
Changes for google-cloud-logging
3.15.9 (2023-09-11)
Dependencies
- Update dependency com.google.cloud:google-cloud-shared-dependencies to v3.15.0 (#1424) (4f82f33)
- Update dependency org.easymock:easymock to v5.2.0 (#1421) (f931544)
- Update dependency org.graalvm.buildtools:junit-platform-native to v0.9.26 (#1420) (ff581a6)
- Update dependency org.graalvm.buildtools:native-maven-plugin to v0.9.26 (#1412) (bd9be4e)
Cloud Run Operators are available in Cloud Composer.
Preview: Snapshot settings are centralized configuration parameters for all snapshots in a project. You can use snapshot settings to customize the default storage location for all future snapshots in your project. By enabling you to do this, snapshot settings remove the need for you to manually specify a storage location during each individual snapshot creation.
Learn more about snapshot settings and how to set the default storage location for a project using snapshot settings.
cos-dev-113-17908-0-0
| Kernel | Docker | Containerd | GPU Drivers |
| COS-6.1.52 | v24.0.5 | v1.7.3 | v535.104.05(default),v470.199.02(R470) |
Updated cos-gpu-installer to v2.1.8.
Updated dev-libs/nss to v3.79.4.
Updated dev-embedded/libftdi to v1.5-r5.
Fixed an issue where symlinks could not be moved.
Fixed an issue where IPv6 networking would fail under high CPU load.
Upgraded app-misc/jq to v1.7.
Upgraded sys-apps/coreutils to v9.4.
Upgraded sys-process/procps to v4.0.4.
Upgraded app-misc/ca-certificates to v20230311.3.93.
Fixed an issue with NFS reconnects on GKE.
Fixed CVE-2023-4623 in the linux kernel.
cos-beta-109-17800-0-37
| Kernel | Docker | Containerd | GPU Drivers |
| COS-6.1.42 | v24.0.5 | v1.7.2 | v535.104.05(default),v470.199.02(R470) |
Updated cos-gpu-installer to v2.1.8.
Fixed an issue where symlinks could not be moved.
Fixed an issue with NFS reconnects on GKE.
Fixed CVE-2023-4015, CVE-2023-4622, CVE-2023-4623 in the kernel.
cos-101-17162-279-47
| Kernel | Docker | Containerd | GPU Drivers |
| COS-5.15.120 | v20.10.24 | v1.6.21 | v470.199.02(default),v535.104.05 |
Fixed an issue where symlinks could not be moved.
Fixed an issue with NFS reconnects on GKE.
Update dev-lang/go to v1.19.13. This resolves CVE-2023-29409.
cos-97-16919-353-46
| Kernel | Docker | Containerd | GPU Drivers |
| COS-5.10.186 | v20.10.24 | v1.6.21 | v470.199.02(default),v535.104.05 |
Fixed CVE-2023-4622 in the linux kernel.
A weekly digest of client library updates from across the Cloud SDK.
Node.js
Changes for @google-cloud/datastore
8.1.0 (2023-09-07)
Features
Bug Fixes
Python
Changes for google-cloud-ndb
2.2.1 (2023-09-15)
Bug Fixes
Documentation
Java
Changes for google-cloud-datastore
2.17.1 (2023-09-11)
Dependencies
- Update dependency com.google.cloud:google-cloud-shared-dependencies to v3.15.0 (#1184) (6cbb795)
- Update dependency org.easymock:easymock to v5.2.0 (#1180) (3e62380)
Documentation
GKE clusters running version 1.28 or later block new bindings of ClusterRole cluster-admin to User system:anonymous, Group system:authenticated, or Group system:unauthenticated due to the security risks of these bindings. GKE does not block existing bindings.
GKE has temporarily paused all automatic node upgrades due to an issue with blue-green upgrades rollback functionality. You can still manually upgrade node pools with the surge upgrade strategy. Do not manually upgrade node pools with blue-green upgrades. GKE is working on a fix for this issue and will post a follow-up note here when the issue is fixed and automatic upgrades resume.
The backlog metrics of subscriptions with filtering enabled only include messages that match the filter. The change is being rolled out in a phased manner.
Debian 10 and Python 3.7 images have reached their end of patch and support life for Vertex AI Workbench managed notebooks and user-managed notebooks. Debian 11 and Python 3.10 images are available.
September 15, 2023
Access ApprovalAccess Approval supports Access Context Manager in the Preview stage.
Maintenance operations on highly available primary instances now occur with less than one second of downtime for most workloads.
AlloyDB for PostgreSQL is now available in the following regions:
europe-west12 (Turin)me-central1 (Doha)
For more information, see AlloyDB Locations.
The ability to analyze a project for compliance before migrating it to an Assured Workloads folder is now generally available. See the Migrate a workload page for more information.
The CJIS compliance program now supports the following products. See Supported products for more information:
- Cloud Composer
- Cloud Dataflow
- Cloud DNS
- Cloud HSM
- Cloud Logging
- Cloud NAT
- Cloud Router
- Cloud SQL
- Network Connectivity Center
The IL5 compliance program now supports the following products. See Supported products for more information:
- Cloud Logging
- Dataflow
- Google Kubernetes Engine
Certificate Authority Service now supports data residency.
Dedicated Cloud Interconnect support is available in the following colocation facilities:
- Quantum Switch DMM A - Dammam
For more information, see the Locations table.
Cloud KMS is available in the following region:
me-central2
For more information, see Cloud KMS locations.
Manifest files are now available in Storage Insights. A manifest file is generated when an inventory report is split into shards. You can use the manifest file to easily locate the shards you want to download.
Generally available: The Red Hat Knowledgebase provides you with access to articles, solutions, product documentation, and community discussions for Red Hat products.
You can now access the Red Hat Knowledgebase by using single-sign-on (SSO) through the Google Cloud console from your Red Hat Enterprise Linux (RHEL) VMs. For more information, see Access Red Hat Knowledgebase.
New Dataproc on Compute Engine subminor image versions:
- 2.0.76-debian10, 2.0.76-rocky8, 2.0.76-ubuntu18
- 2.1.24-debian11, 2.1.24-rocky8, 2.1.24-ubuntu20, 2.1.24-ubuntu20-arm
New Dataproc Serverless for Spark runtime versions:
- 1.1.31
- 2.0.39
- 2.1.18
Scala has been upgraded to version 2.12.18 and Apache Tez has been upgraded to version 0.10.2 in Dataproc on Compute Engine 2.1 images.
Improvements to Prebuilt Components:
- Name collection: fixed issue with names containing multiple special characters
- Credit card expiration date collection: updated SSML in agent responses
- Date of birth (DOB) collection: fixed issue with entities for specific pronunciations of months and days
Dialogflow CX has added the FILTER system function.
Dialogflow CX flow export now exports flows recursively.
Vertex AI Search (Enterprise Search): Languages for summarization
Summarization is supported in the following languages in addition to English:
- German (
de-DE) - Spanish (
es-ES) - Italian (
it-IT) - French (
fr-FR) - Dutch (
nl-NL) - Portuguese (
pt-BR) - Swedish (
sv-SE)
See Languages.
Vertex AI Search (Enterprise Search): Adjacent segments for preview with allowlist
When getting extractive segments, you can also get up to 3 segments from immediately before and after the relevant segment. Adjacent segments can add context and accuracy to the relevant segment. Turning on adjacent segments can increase latency.
Adjacent segments is in preview with allowlist. Contact your Google account team to try out adjacent segments.
See Extractive segments.
Vertex AI Search (Enterprise Search): Customizable summaries for preview with allowlist
When you request summaries, you can customize them by providing natural-language instructions. You can request customizations such as such as the length and level of detail, style of output (such as "simple"), language of output, focus of answer, and format (such as tables, bullets, and XML).
Customizable summaries are in preview with allowlist. Contact your Google account team if you're interested in trying this feature.
Vertex AI Search (Enterprise Search): ISO compliance
Vertex AI Search meets ISO 27001, ISO 27017, ISO 27018, and ISO 27701 compliance standards.
Email enumeration protection is enabled by default for all new projects. With email enumeration protection enabled, the Firebase Auth SDK method fetchSignInMethodsForEmail returns null, for added security.
Event Threat Detection, a built-in service of Security Command Center, released a new rule, Initial Access: Leaked Service Account Key Used, to General Availability.
For more information, see Event Threat Detection rules.
September 14, 2023
Anthos clusters on VMwareA standalone tool that you run before upgrading an admin or user cluster is now available. The pre-upgrade tool is supported for Anthos clusters on VMware version 1.9 through 1.13. The tool runs the applicable preflight checks for the version that you are upgrading to and also checks for specific known issues. Before upgrading a 1.9 - 1.13 cluster, we recommend that you run the pre-upgrade tool.
For details on running the tool, see the documentation for the version that you are upgrading to:
hybrid 1.10.3-hotfix.1
On September 14, 2023 we released an updated version of the Apigee hybrid software, 1.10.3-hotfix.1.
- To install the hotfix, follow the instructions in Install 1.10.3-hotfix.1.
- For new installations, see The big picture and then apply the hotfix to the new installation with the instructions in Install 1.10.3-hotfix.1.
| Bug ID | Description |
|---|---|
| 205666368 | Fixed issue with default validation of TLS target endpoint certificates. To enable strict SSL on southbound connections to a proxy target endpoint, add the tag See About setting TLS options in a target endpoint or target server. See also Known Issue #205666368. |
Go 1.21 is now generally available.
You can now view the status of your server activity in the Google Cloud console. it informs you if there's an issue with your Bare Metal Solution infrastructure. This feature is generally available (GA).
Observability for storage volumes is generally available (GA).
You can now change the type of a Chronicle reference list. For more details, see reference lists.
You can now create and manage forwarder configurations using the Chronicle user interface and also through the Chronicle Forwarder Management API.
Chronicle can now directly ingest the following log types from Google Cloud. Each is listed by product name and log_type value:
- Cloud Intrusion Detection System (
GCP_IDS) - Cloud Load Balancing (
GCP_LOADBALANCING) - Cloud SQL (
GCP_CLOUDSQL) - Windows Event logs (
WINEVTLOG) - Linux Sysmon (
LINUX_SYSMON) - Zeek (
BRO_JSON) - Google Kubernetes Engine (
KUBERNETES_NODE) - Audit Daemon (auditd) (
AUDITD) - Apigee (
GCP_APIGEE_X)
For more information, see Ingest Google Cloud Data to Chronicle.
The Cloud CDN private origin authentication capability for Amazon Simple Storage Service (Amazon S3) and compatible object stores is now Generally Available.
(Cloud Composer 2 only) In the next two weeks we plan to introduce a 1 vCPU maximum limit for Airflow Triggerers in Cloud Composer. This change is a part of an upcoming adjustment to our triggerer resource allocation strategy where we want to allow for an increase in the maximum triggerer count.
After this change takes effect, if you configured more than 1 vCPU per triggerer, then the next update operation will generate an error. To address this change, adjust the triggerer configuration to meet the new 1 vCPU limit.
(Available without an upgrade) Fixed the issue with reaching the "Write requests per day" quota limit when executing Airflow CLI commands in Cloud Composer 2.
Since August 12, 2023, there has been an increase in latency issues with inspection jobs and data profile generation. These latency issues have been resolved.
Ops Agent version 2.40.0 introduces support for Compute Engine Arm VMs that are running RHEL 9 or Rocky Linux 9. For more information, see Support for Compute Engine Arm VMs.
The following dual-region pairs are now generally available:
- Montréal and Toronto, Canada
- Sydney and Melbourne, Australia
Generally available: You can create C3-standard VMs with Local SSD attached using new machine types, for example c3-standard-44-lssd. For more information, see Choosing a valid number of Local SSDs.
Dataflow now supports the Tau T2A Arm machine series as a worker machine type. This feature is generally available (GA). For more information, see Use Arm VMs on Dataflow.
M111 release
- PyTorch 2.0 container images now include PyTorch XLA 2.0.
- Miscellaneous software updates.
M111 release
- PyTorch 2.0 images now include PyTorch XLA 2.0.
- Miscellaneous software updates.
Preview: Migrate to Virtual Machines from an Azure source is now open to all users. Migrate to Virtual Machines from an Azure source lets you migrate Azure VM instances to Compute Engine.
M111 release
The M111 release of Vertex AI Workbench instances includes the following:
- Miscellaneous software updates.
The M111 release of Vertex AI Workbench user-managed notebooks includes the following:
- PyTorch 2.0 user-managed notebooks instances now include PyTorch XLA 2.0.
- Miscellaneous software updates.
The M111 release of Vertex AI Workbench managed notebooks includes the following:
- Miscellaneous software updates.
Policy-based routing is available in General Availability. You can select a next hop based on more than a packet's destination IP address. You can match traffic by protocol and source IP address as well.
If you've used Google provider for Terraform versions earlier than 4.76.0 to create Private Service Connect service attachments, do not upgrade to versions 4.76.0 through 4.81.x. When you run terraform apply after the upgrade, Terraform might unintentionally delete and recreate the service attachments and close existing Private Service Connect connections. Recreated service attachments do not automatically re-establish Private Service Connect connections.
Upgrading to version 4.82.0 or later ensures that service attachments are not recreated.
Versions 4.76.0 and later turn on connection reconciliation by default, which might result in different service attachments having different settings for this field, depending on when they were created.
For more information and workarounds, see Disconnections after upgrading the Google provider for Terraform.
September 13, 2023
AlloyDB for PostgreSQLAlloyDB now lets you use and manage data-encryption keys residing outside of Google Cloud using Cloud External Key Manager.
Artifact Registry now supports HTTP access to Apt repositories. For more information, see Configure HTTP access to an Apt repository.
You can now create a federated dataset in BigQuery that federates to an existing database in AWS Glue. This feature is in preview.
You can now create definer's rights views in Cloud Spanner. A definer's rights view adds additional security functionality by providing different privileges on the view and the underlying schema objects. Users with access to a definer's rights view can see and query its contents even if they don't have access to the view's underlying schema objects. For more information, see About views.
Config Controller now uses the following versions of its included products:
- Config Connector v1.108.0, release notes
- Anthos Config Management v1.16.0, release notes
Announcing the Private Preview release of the Dataproc on Compute Engine Flink Jobs resource. During Private Preview, you can contact your Google Cloud Sales representative to have your project(s) added to an allowlist to allow you to submit Flink jobs to the Dataproc on Compute Engine service.
VMware Engine nodes are now available in the following additional region:
- Tel Aviv (
me-west1-a)
You can now configure IAM workforce identity federation using the Google Cloud console. To learn more, see the configuration guides for Azure AD, Okta, or other OIDC and SAML 2.0 providers. The feature is in Preview.
Looker 23.16 includes the following changes, features, and fixes.
Expected Looker (original) deployment start: Monday, September 18, 2023
Expected Looker (original) final deployment and download available: Thursday, September 28, 2023
Expected Looker (Google Cloud core) deployment start: Monday, October 2, 2023
Expected Looker (Google Cloud core) final deployment: Thursday, October 12, 2023
The API call to create signed embed URL endpoints has been updated to remove the majority of embed administration configuration changes that need to be made when a signed embed URL is requested using the endpoint. The description of the endpoint is also changed to use a signed embed URL instead of an SSO embed URL to reduce the confusion with standard SSO authentication.
update_embed_config events are now reflected in the System Activity Event Explore.
When a dashboard or an element refresh interval is entered that is higher than the supported maximum value (24.8 days), Looker now returns a validation message.
Personal folders for users who have never logged in will no longer appear in embedded content navigation.
Auto-updates for Looker and third-party applications now display a list of entitlements that may be applied when a Marketplace listing is automatically updated.
The look and feel of the Get LookML dialog on Explore pages has been updated.
The create_dashboard_render_task now takes in an optional theme property to specify the theme to apply to the rendered dashboard.
For SFTP and S3 destinations, the timestamp in the filename of the scheduled delivery will respect the Delivery time zone.
Updates that are sent from inside custom visualizations now perform as expected.
A previous issue would cause Marketplace updates to fail when a user had not entered dev mode since the last update. This issue has been fixed.
A previous issue would cause Session Duration to be wrongly defaulted on the UI when the Inactivity Logout was enabled. This issue has been fixed.
For cell visualizations in columns with large positive and negative values, the negative value text will now appear on a single line instead of wrapping to fit the cell space.
For bar and column charts that use stacked series positioning and stack sorting with a combination of negative and positive values, the values are now rendered and sorted on the correct side of 0.
LookML dashboard descriptions are now correctly localized in folders.
A previous issue would cause scheduled plans for System Activity to fail with an undefined method 'path' for nil:NilClass error. This issue has been fixed.
A previous issue would cause suggestions to not work for fields in views with inter-view references in their sql_table_name parameter. This issue has been fixed.
Intermittent code: 1002 errors returned from Clickhouse connections have been fixed.
The average_distinct field type now supports symmetric aggregates.
A warning message will be returned when a user tries to use a subtotal with a sql_always_having parameter.
yesno filters on filtered measures when BI Engine is enabled now perform as expected.
The following SQL dialects are no longer supported by Looker, and queries against existing connections will return errors: Apache Hive 2, Apache Spark 1.5+, Apache Spark 2.0, and Quobole Presto.
Looker no longer supports connections to the Impala dialect called Cloudera Impala (with no version number and without a native driver). Queries on connections to this release of Cloudera Impala will return an error. Looker is continuing to support Cloudera Impala 3.1+, Cloudera Impala 3.1+ with Native Driver, and Cloudera Impala with Native Driver.
The New LookML Runtime feature now allows a wider variety of strings for Liquid date parsing. Date string formats that were previously accepted in the Legacy LookML Runtime legacy feature but not in the New LookML Runtime feature should now format properly.
The Teradata JDBC driver has been updated to 16.20.00.13.
When the Email Allowlist for Scheduled Content Labs feature is enabled, admin users can use the looker_internal_email_domain_allowlist user attribute to define email allowlist domains at a group level.
When the Advanced Granular Permissions Labs feature is enabled, admin users can use six new permissions to delegate management of user attributes, groups, roles, private labels, themes, and embed settings to non-admin users.
When you set up SAML authentication, merging users from OIDC into SAML is now supported.
The AND/OR Filters in Explores Labs feature is now enabled by default. When this feature is enabled, Looker Explores contain a new experience for creating and editing filters with AND/OR filter logic without the need to create custom filter expressions.
The Table (Legacy) visualization hide_totals option now performs as expected.
Liquid Ruby dependency has been updated to 5.0.0. You can now make a Liquid reference that results in a non-string value in the link parameter using the Legacy LookML Runtime legacy feature by using the {{
value }} Liquid reference syntax.
A new Looker (Google Cloud core) codelab has been published. The Connect Looker Cloud over hybrid networking codelab provides a walkthrough of deploying a public and private IP Looker (Google Cloud core) instance and connecting it to an on-premises database.
Looker (Google Cloud core) instances can now be created by provisioning a Terraform resource. The new Terraform tab on the Create a Looker (Google Cloud core) instance documentation page describes how to provision various editions of a Looker (Google Cloud core) instance.
Administrators can set a data retention policy (Preview) on a project, on a new portal, or both. For more information, see Configure data retention policy.
Preview stage support for the following integration:
September 12, 2023
BigQueryThe array subscript operator now returns a value in an array directly by index. Previously, only offset and ordinal were available. This feature is generally available (GA).
The struct subscript operator has been added. With this operator, you can access a STRUCT field by index, offset, or ordinal. This feature is generally available (GA).
Remote Agents 1.4.3.6
Remote agent now supports the same alert and event trimming logic as implemented in the server. New parameters in the database control the size of the alert as well as the size of the fields and events within them. Alerts that are bigger than this size will be automatically trimmed. If the alert is still too big, then the size of the fields and events will be trimmed. The resulting alert ingested into the case might therefore not contain all the original information.
Remote connector logs now display as required in the platform.
Remote agent no longer takes ownership of the entire /var/log directory when using the installer.
Cloud Composer 2 is now available in Doha (me-central1).
A release was made. Updates may include general performance improvements, bug fixes, and updates to the API reference documentation.
Log buckets in the following regions can now be upgraded to use Log Analytics:
- us-east5
- us-south1
- me-central1
- europe-west12
For more information, see Supported regions.
You can manage future reservations using the Google Cloud console. Future reservations provide a high level of assurance to obtain important or difficult-to-obtain capacity in advance.
For more information, see the following pages:
cos-105-17412-156-49
| Kernel | Docker | Containerd | GPU Drivers |
| COS-5.15.120 | v23.0.3 | v1.7.2 | v470.199.02(default),v535.104.05 |
Updated cos-gpu-installer to v2.1.7. Precompiled drivers are now downloaded from COS build artifacts.
Updated latest GPU driver to v535.104.05.
Fixed an issue where symlinks could not be moved.
The get_metadata_value script will now retry if it experiences a connection error.
Fixed an issue with NFS reconnects on GKE.
Updated dev-lang/go to v1.20.8. This resolves CVE-2023-29409.
Fixed the following CVEs in sys-libs/binutils-libs: CVE-2022-47007, CVE-2022-47008, CVE-2022-47010, CVE-2022-47011, CVE-2022-48063, CVE-2022-48064, CVE-2022-48065.
Runtime sysctl changes:
- Added: net.ipv4.tcp_backlog_ack_defer: 1
The dataproc.diagnostics.enabled property is now avaiable to enable running diagnostics on Dataproc Serverless for Spark. The existing spark.dataproc.diagnostics.enabled property will be deprecated for use with newer runtimes.
You can now use node auto-provisioning for TPU slices. With this feature, Standard clusters with GKE version 1.28 and later provision TPU node pools and multi-host TPU accelerators automatically to ensure the capacity required to schedule AI/ML workloads. To learn more, see Configuring TPU node auto-provisioning.
September 11, 2023
BigQueryA weekly digest of client library updates from across the Cloud SDK.
The following resource types are now publicly available through the Search APIs (SearchAllResources, SearchAllIamPolicies).
- Financial Services
financialservices.googleapis.com/Instance
- Discovery Engine
discoveryengine.googleapis.com/Collectiondiscoveryengine.googleapis.com/DataStore
The following resource types are now publicly available through the analyze policy APIs (AnalyzeIamPolicy and AnalyzeIamPolicyLongrunning).
- Speaker ID
speakerid.googleapis.com/Settings
You can now choose not to specify the number of nodes when creating a Cloud Bigtable cluster using the gcloud CLI. This configuration lets Bigtable automatically calculate the number of nodes based on your data footprint and optimize for 50% storage utilization. To learn more, see Create an instance. This feature is generally available (GA).
In some cases, it is possible to create multiple NAT gateway configurations that include the same subnet. For some of these configurations, VMs that are attached to that subnet are not allocated NAT ports, and therefore can't access resources on the internet.
For more information about this issue and a workaround, see VMs can't reach the internet.
Query Optimizer version 6 is generally available. Version 5 remains the default optimizer version in production.
cos-97-16919-353-44
| Kernel | Docker | Containerd | GPU Drivers |
| COS-5.10.186 | v20.10.24 | v1.6.21 | v470.199.02(default),v535.104.05 |
Updated cos-gpu-installer to v2.1.7. Switched precompiled driver and signature location to COS build artifacts.
Updated latest GPU driver to v535.104.05.
Changed error handling in get_metadata_value script to retry if connection error happens during instance metadata check.
Fixed problem with NFS reconnects when using DPv2 in kube-proxy-free mode.
Fixed the following CVEs in sys-libs/binutils-libs: CVE-2022-47007 CVE-2022-47008, CVE-2022-47010, CVE-2022-47011, CVE-2022-48063, CVE-2022-48064, CVE-2022-48065.
cos-93-16623-461-30
| Kernel | Docker | Containerd | GPU Drivers |
| COS-5.10.177 | v20.10.24 | v1.6.20 | v450.248.02(default),v470.199.02(R470),v535.104.05 |
Updated cos-gpu-installer to v2.1.7. Switched precompiled driver and signature location to COS build artifacts.
Updated latest GPU driver to v535.104.05.
Changed error handling in get_metadata_value script to retry if connection error happens during instance metadata check.
Fixed the following CVEs in sys-libs/binutils-libs: CVE-2022-47007 CVE-2022-47008, CVE-2022-47010, CVE-2022-47011, CVE-2022-48063, CVE-2022-48064, CVE-2022-48065.
cos-101-17162-279-42
| Kernel | Docker | Containerd | GPU Drivers |
| COS-5.15.120 | v20.10.24 | v1.6.21 | v470.199.02(default),v535.104.05 |
Updated cos-gpu-installer to v2.1.7. Switched precompiled driver and signature location to COS build artifacts.
Updated latest GPU driver to v535.104.05.
Changed error handling in get_metadata_value script to retry if connection error happens during instance metadata check.
Fixed the following CVEs in sys-libs/binutils-libs: CVE-2022-47007 CVE-2022-47008, CVE-2022-47010, CVE-2022-47011, CVE-2022-48063, CVE-2022-48064, CVE-2022-48065.
cos-dev-113-17877-0-0
| Kernel | Docker | Containerd | GPU Drivers |
| COS-6.1.51 | v24.0.5 | v1.7.3 | v535.104.05(default),v470.199.02(R470) |
Updated the Linux kernel to v6.1.51.
Updated latest GPU driver to v535.104.05.
cos-beta-109-17800-0-32
| Kernel | Docker | Containerd | GPU Drivers |
| COS-6.1.42 | v24.0.5 | v1.7.2 | v535.104.05(default),v470.199.02(R470) |
Updated latest GPU driver to v535.104.05.
Validate the resource locations for all Document Warehouse API requests.
Error Reporting now supports Cloud Run Jobs as a monitored resource type. For more information, see Supported monitored resources.
The Google Cloud console now supports a usage dashboard for each database.
A weekly digest of client library updates from across the Cloud SDK.
Compute Engine persistent disk CSI Drivers deployed on clusters running version 1.26 and later now support filesystem size expansion during restoration from a snapshot or a clone when the PVC data source is larger than the original volume. For more information, see the GitHub pull request.
A weekly digest of client library updates from across the Cloud SDK.
Node.js
Changes for @google-cloud/pubsub
4.0.5 (2023-09-07)
Bug Fixes
4.0.4 (2023-09-05)
Bug Fixes
4.0.3 (2023-08-31)
Bug Fixes
A weekly digest of client library updates from across the Cloud SDK.
Python
Changes for google-cloud-pubsub
2.18.4 (2023-09-09)
Documentation
New SAP HANA certification: Hyperdisk Extreme usage with N2 machine types
For running SAP HANA on Google Cloud, SAP has certified using Hyperdisk Extreme with N2 machine types that have 80 vCPUs or more.
For more information, see:
- Certified Compute Engine VMs for SAP HANA
- The Hyperdisk Extreme sizes tab in Minimum sizes for SSD-based persistent disks and Hyperdisks
New OS certifications for SAP HANA
For use with SAP HANA on Google Cloud, SAP has certified the following operating systems:
- Red Hat Enterprise Linux (RHEL) 8.8 for SAP
- SUSE Linux Enterprise Server (SLES) 15 SP5 for SAP
For more information, see Certified operating systems for SAP HANA.
Security Command Center now supports CIS Google Cloud Computing Foundations Benchmark v2.0.0.
The support for v2.0.0 includes the following new vulnerability detector:
Load balancer logging disabled
For more information, see the following:
September 10, 2023
DatastreamDatastream now supports SSL/TLS encryption for Oracle sources. For more information, see the Datastream API reference documentation.
September 08, 2023
Access ApprovalAccess Approval supports Firebase Security Rules in the Preview stage.
When creating an AlloyDB cluster, you can now specify an IP range for private services access. This is optional; if you do not specify an IP range, then AlloyDB selects one for you.
Go 1.21 is now generally available.
Fixed the CVE-2023-29247 vulnerability in Airflow versions 2.4.3 and 2.5.3. To apply the fix, please upgrade your environment to Cloud Composer version 2.4.2 or later. For more information about this vulnerability in relation to Cloud Composer environments, see Known issues.
Cloud Composer now correctly generates an error message when a Cloud Composer 1 environment is created using a version alias in a region where Cloud Composer 1 is not supported.
Cloud Composer now generates a FAILED_PRECONDITION error message when an environment operation fails because the environment's cluster is missing.
Cloud Composer 2.4.2 images are available:
- composer-2.4.2-airflow-2.5.3 (default)
- composer-2.4.2-airflow-2.4.3
Cloud Composer versions 2.0.25 and 1.19.8 have reached their end of full support period.
Dataproc Auto zone placement for clusters is now available in the Google Cloud console by selecting the "Any" option for the cluster zone.
New Dataproc Serverless for Spark runtime versions:
- 1.1.30
- 2.0.38
- 2.1.17
New Dataproc on Compute Engine subminor image versions:
- 2.0.75-debian10, 2.0.75-rocky8, 2.0.75-ubuntu18
- 2.1.23-debian11, 2.1.23-rocky8, 2.1.23-ubuntu20, 2.1.23-ubuntu20-arm
The Apache Spark version has been upgraded from 3.3.0 to 3.3.2 in Dataproc on Compute Engine 2.1 images.
Vertex AI Search (Enterprise Search): Image search is GA
Image search is now generally available (GA).
Vertex AI Search (Enterprise Search): Page numbers for extractive segments
Page numbers can be returned with extractive segments. Page numbers indicate where an answer was extracted from in a document.
For more about extractive segments, see Get snippets and extracted content.
Vertex AI Prediction
You can now use A2 Ultra machines to serve predictions in us-central1, us-east4, europe-west4, and asia-southeast1. Each A2 Ultra machine has a fixed number of NVIDIA A100 80GB GPUs attached.
September 07, 2023
Access TransparencyAccess Transparency logs are enhanced with an eventID that signifies the incident that resulted in the access by Google personnel. For example, a support case that results in several accesses from the support and engineering teams in order to resolve the case. Accesses related to the same support case share the same eventID in Access Transparency logs.
For more information about this field, see Log field descriptions.
On September 7, 2023 we released an updated version of Apigee integrated portal. This release includes general improvements to performance and availability.
Preview: You can view the following when using Capacity Planner:
The 50th and 75th percentile usage and forecast of your VMs.
The historical usage of your VMs up to 2 years in the past.
The usage and forecast of all machine families in a project.
For more information, see About Capacity Planner.
Preview: You can generate gcloud CLI commands to create future reservation requests of Compute Engine zonal resources based on the actual or forecasted usage of your VMs. Future reservations are useful to secure capacity up to 1 year in advance for forecasted spikes.
For more information, see Reserve capacity from actual or forecasted usage.
Users can now use manual triggers, webhook triggers, and Pub/Sub triggers to build Bitbucket Server and Bitbucket Data Center repositories through Cloud Build repositories (1st gen). This feature is generally available. To learn more, see Build repositories from Bitbucket Server and Build repositories from Bitbucket Data Center.
Maintenance windows configuration is now generally available (GA).
Cloud Data Fusion version 6.9.2 is generally available (GA). This release is in parallel with the CDAP 6.9.2 release.
Features in Cloud Data Fusion 6.9.2:
- Editing deployed batch pipelines is generally available (GA).
- Using Pub/Sub sources in streaming data pipelines is GA.
- Wrangler Filter Pushdown is GA.
- Pushdown for window aggregations is GA.
Changes in Cloud Data Fusion 6.9.2:
- Cloud Data Fusion supports setting custom scopes when creating a Dataproc cluster (CDAP-19428).
- You can set common metadata labels for Dataproc clusters and jobs using the Common Labels property in the Ephemeral Dataproc compute profile (CDAP-20698).
- You can set labels for the Dataproc jobs using the Common Labels property in the Existing Dataproc compute profile (CDAP-20698).
- You can set a pipeline runtime argument with the key
system.profile.properties.labelsand a value representing the labels in the following format:key1|value1;key2|value2. This setting overrides the common labels set in the compute profile for pipeline runs (CDAP-20698). - Cloud Data Fusion supports using Dataproc temp buckets in compute profiles (CDAP-20712).
Fixed in Cloud Data Fusion 6.9.2:
- Added a retry for Pub/Sub snapshot creation and deletion in a real-time pipeline with a Pub/Sub source when a retryable internal error is thrown (PLUGIN-1660).
- Fixed a bug causing the Dynamic Spark plugins to fail when running on Dataproc 1.5 (CDAP-20674).
- Fixed a discrepancy in warning and error counts reported between the pipeline summary tab and system logs (CDAP-20680).
- Fixed a problem when, in rare cases, a cluster couldn't be found with Cluster Reuse (CDAP-20759).
- Fixed a bug causing the JavaScript transform to fail on Dataproc 2.1 (CDAP-20778).
Cloud Functions now supports the Go 1.21 runtime at the General Availability release level.
Ops Agent version 2.39.0 introduces support for Compute Engine Arm VMs that are running Ubuntu 20.04 LTS (Focal Fossa). For more information, see Support for Compute Engine Arm VMs.
Starting with version 2.39.0, the Ops Agent supports ingesting Prometheus metrics with unknown types. In earlier versions, untyped metrics are treated by the Ops Agent as gauges, but starting with Ops Agent version 2.39.0, untyped metrics are treated as both gauges and counters, and you can apply cumulative operations to the metrics.
If you have charts or alterting policies based on untyped metrics and written with MQL, you must adjust your queries. For more information, see Prometheus untyped metrics change metric type starting with Ops Agent version 2.39.0.
cos-dev-113-17872-0-0
| Kernel | Docker | Containerd | GPU Drivers |
| COS-6.1.49 | v24.0.5 | v1.7.3 | v535.54.03(default),v470.199.02(R470) |
Updated dev-go/go-tools to v0.11.1_p20230712.
Updated dev-lang/go to v1.21.0.
Updated the Linux kernel to v6.1.49.
The get_metadata_value script will now retry if it experiences a connection error.
Enabled persistence mode with Nvidia GPU driver installation.
Fixed an issue in ip6tables where the -C option did not
work correctly.
Upgraded app-misc/jq to v1.7_rc2.
Upgraded sys-apps/less to v643.
Upgraded app-arch/pigz to v2.8.
Upgraded app-editors/vim to v9.0.1777. Upgraded app-editors/vim-core to v9.0.1777.
Upgraded sys-fs/mdadm to v4.2. This resolves CVE-2023-28938 and CVE-2023-28736.
Fixed CVE-2023-4016 in sys-process/procps.
Runtime sysctl changes:
- Added: kernel.io_uring_disabled: 0
- Changed: fs.file-max: 812619 -> 812608
- Changed: kernel.threads-max: 63519 -> 63520
- Changed: net.netfilter.nf_conntrack_sctp_timeout_shutdown_recd: 0 -> 3
- Changed: net.netfilter.nf_conntrack_sctp_timeout_shutdown_sent: 0 -> 3
- Changed: user.max_cgroup_namespaces: 31759 -> 31760
- Changed: user.max_ipc_namespaces: 31759 -> 31760
- Changed: user.max_mnt_namespaces: 31759 -> 31760
- Changed: user.max_net_namespaces: 31759 -> 31760
- Changed: user.max_pid_namespaces: 31759 -> 31760
- Changed: user.max_time_namespaces: 31759 -> 31760
- Changed: user.max_user_namespaces: 31759 -> 31760
- Changed: user.max_uts_namespaces: 31759 -> 31760
cos-beta-109-17800-0-31
| Kernel | Docker | Containerd | GPU Drivers |
| COS-6.1.42 | v24.0.5 | v1.7.2 | v535.54.03(default),v470.199.02(R470) |
Updated dev-go/go-tools to v0.11.1_p20230712.
Updated dev-lang/go to v1.21.0.
The get_metadata_value script will now retry if it experiences a connection error.
Enabled persistence mode with Nvidia GPU driver installation.
Fixed an issue in ip6tables where the -C option did not
work correctly.
Upgraded sys-fs/mdadm to v4.2. This resolves CVE-2023-28938 and CVE-2023-28736.
Fixed CVE-2023-4016 in sys-process/procps.
Fixed CVE-2022-40896 in pygments package.
Fixed CVE-2023-33953 in the Linux kernel.
Runtime sysctl changes:
- Added: kernel.io_uring_disabled: 0
cos-101-17162-279-34
| Kernel | Docker | Containerd | GPU Drivers |
| COS-5.15.120 | v20.10.24 | v1.6.21 | v470.199.02(default),v525.125.06 |
Simplified GPU driver installation by remounting driver installation path as executable from cos-extensions.
Enabled trusted IMA certificate loading from /etc/ima/pubkey.x509.
Enable persistence mode with Nvidia GPU driver installation.
Fixed CVE-2018-20852 in the dev-lang/python package.
Updated xz-utils to 5.2.9. This resolves CVE-2020-22916.
Upgraded sys-fs/mdadm to v4.2. This resolves CVE-2023-28938 and CVE-2023-28736.
Upgraded sys-process/procps to 3.3.17. This fixed CVE-2018-1121 and CVE-2023-4016.
Fixed CVE-2023-4128 in the Linux kernel.
Runtime sysctl changes:
- Added: kernel.io_uring_disabled: 0
cos-97-16919-353-31
| Kernel | Docker | Containerd | GPU Drivers |
| COS-5.10.186 | v20.10.24 | v1.6.21 | v470.199.02(default),v525.125.06 |
Enabled trusted IMA certificate loading from /etc/ima/pubkey.x509.
Enabled persistence mode with Nvidia GPU driver installation.
Updated xz-utils to 5.2.9. This resolves CVE-2020-22916.
Upgraded sys-process/procps to 3.3.17. This fixed CVE-2018-1121 and CVE-2023-4016.
Upgraded sys-fs/mdadm to v4.2. This resolves CVE-2023-28938 and CVE-2023-28736.
Fixed CVE-2023-4128 in the Linux kernel.
Runtime sysctl changes:
- Added: kernel.io_uring_disabled: 0
cos-93-16623-461-21
| Kernel | Docker | Containerd | GPU Drivers |
| COS-5.10.177 | v20.10.24 | v1.6.20 | v450.248.02(default),v470.199.02(R470),v525.125.06 |
Fixed CVE-2018-17846, CVE-2018-17142, CVE-2018-17847, CVE-2018-17143, CVE-2018-17075, CVE-2018-17848 in dev-go/net.
Updated xz-utils to 5.2.9. This resolves CVE-2020-22916.
Upgraded sys-process/procps to 3.3.17. This fixed CVE-2018-1121 and CVE-2023-4016.
Upgraded sys-fs/mdadm to v4.2. This resolves CVE-2023-28938 and CVE-2023-28736.
Fixed CVE-2023-33953 in the Linux kernel.
cos-105-17412-156-34
| Kernel | Docker | Containerd | GPU Drivers |
| COS-5.15.120 | v23.0.3 | v1.7.2 | v470.199.02(default),v525.125.06 |
Enabled persistence mode with Nvidia GPU driver installation.
Upgraded sys-fs/mdadm to v4.2. This resolves CVE-2023-28938 and CVE-2023-28736.
Fixed CVE-2023-4016 in sys-process/procps.
Service account delegation for workflow execution is now available. You can configure service account delegation for whole repositories, or for individual workflow configurations.
The Datastream BigQuery Migration Toolkit is now launched. The toolkit is an open-source software that simplifies migrating from the Dataflow Datastream to BigQuery template to the Datastream native BigQuery replication solution. For more information, see the toolkit documentation.
This is a minor release of Google Distributed Cloud Edge (version 1.5.0).
The following features have been introduced in this release of Distributed Cloud Edge:
Bastion host support. Distributed Cloud Edge now allows you to set up one or more bastion host virtual machines. The bastion host feature allows Google support engineers to connect to your Distributed Cloud Edge deployment and work with you to diagnose and resolve issues. For more information, see Configure a bastion host. This is a preview-level feature.
Selectable cluster software versions. You now have the option to create a cluster running a specific version of Distributed Cloud Edge software, starting with version 1.5.0. For more information, see Create and manage clusters. This is a preview-level feature.
Container image registry access over secondary networks. Distributed Cloud Edge now allows you to specify the network interface in the
spec.containerRuntimeDNSConfigfield of theNodeSystemConfigUpdateresource. This allows you to specify a container image registry IP/domain pair for a network interface other than the primary. For more information, seeNodeSystemConfigUpdateresource. This is a preview-level feature.CMEK support for local control plane nodes. You can now configure Cloud KMS integration for storage on nodes running local control planes for Distributed Cloud Edge clusters. For more information, see Enable support for customer-managed encryption keys (CMEK) for local storage.
The following changes have been introduced in this release of Distributed Cloud Edge:
Survivability mode is now generally available. For more information, see Distributed Cloud Edge survivability mode. After your Distributed Cloud Edge deployment has been upgraded from version 1.4.0 to version 1.5.0, you must manually delete and recreate all local control plane clusters you have created with Distributed Cloud Edge version 1.4.0 or 1.4.1. Otherwise, unexpected behavior and data loss can occur. Clusters configured to use a cloud control plane continue to run normally after upgrading Distributed Cloud Edge to version 1.5.0.
Symcloud Storage integration is now generally available. For more information, see Configure Distributed Cloud Edge for Symcloud Storage.
Local control plane clusters now support virtual machines and GPU workloads. For more information, see Manage virtual machines and Manage GPU workloads.
Loadable SCTP kernel modules. Distributed Cloud Edge now configures the sctp kernel module as loadable. This allows you to load custom networking stacks into the kernel's user space. For more information, see SCTP kernel modules. This is a preview-level feature.
The following issues have been resolved in this release of Distributed Cloud Edge:
When creating a Cloud control plane cluster, creating a node pool that includes nodes that were previously part of a local control plane cluster no longer fails.
BGP sessions now properly recover when the associated network interface goes down and then comes back up.
This release of Distributed Cloud Edge contains the following known issues:
When creating a local control plane cluster, Distributed Cloud Edge instantiates dummy
BGPPeerandBGPLoadBalancerresources. You can ignore these resources.Distributed Cloud Edge does not support BGP peering to multiple VLANs within the same virtual router. You must set up a separate virtual router with a unique loopback IP addresses for each affected VLAN to allow concurrent BGP peering sessions.
Three vulnerabilities (CVE-2023-3676, CVE-2023-3955, CVE-2023-3893) have been discovered in Kubernetes where a user that can create Pods on Windows nodes may be able to escalate to admin privileges on those nodes. These vulnerabilities affect the Windows versions of Kubelet and the Kubernetes CSI proxy.
GKE clusters are only affected if they include Windows nodes.
For more information, see the GCP-2023-026 security bulletin.
For GKE clusters using Dataplane V2, upgrades to GKE version 1.26 might cause GKE to temporarily be unable to configure workloads. In some cases, this might cause existing workloads to temporarily lose networking access. This issue does not impact new clusters and GKE clusters not using Dataplane V2. For clusters running version 1.25 with Dataplane V2 enabled, GKE has temporarily disabled auto-upgrades to version 1.26. We recommend that customers not manually upgrade their Dataplane V2-enabled cluster to GKE version 1.26. This is a known issue for GKE version 1.26 and will be fixed in a future patch version of 1.26.
With the recently released version of GKE, version 1.28, you cannot yet use the SidecarContainer feature with alpha clusters. Pods defining restartable Init containers will not start. This is a known issue that will be resolved in a future release.
September 06, 2023
AlloyDB for PostgreSQLUpdated the PostgreSQL-compatible server running on AlloyDB instances to version 14.7.
Updated the following extensions related to the PostGIS extension to version 3.2.3:
postgispostgis_rasterpostgis_sfcgalpostgis_tiger_geocoderpostgis_topologyaddress_standardizeraddress_standardizer_data_us
The following extensions are updated:
- Updated
pg_hint_planto version 1.4.1. - Updated
pg_repackto version 1.4.8. - Updated
pg_partmanto version 4.7.3. - Updated
postgresql-hllto version 2.17. - Updated
pg_cronto version 1.5. - Updated
pg_hint_planto version 1.4.1. - Updated
pg_repackto version 1.4.8. - Updated
pg_partmanto version 4.7.3. - Updated
postgresql-hllto version 2.17. - Updated
pg_cronto version 1.5.
This release includes the following Anthos attached clusters platform versions:
- 1.25.0-gke.6
- 1.26.0-gke.4
- 1.27.0-gke.1
1.27.0-gke.1
Added Binary Authorization support which is a deploy-time security control that ensures only trusted container images are deployed. With Binary Authorization, you can require images to be signed by trusted authorities during the development process and then enforce signature validation when deploying. By enforcing validation, you can gain tighter control over your container environment by ensuring only verified images are integrated into the build-and-release process. For details about how to enable Binary Authorization on your clusters, see How to enable Binary Authorization.
Added the
authorization.admin_groupsfield. This allows users to specify Google groups ascluster-adminsthrough the management plane.Enabled
gzipcompression forfluent-bit's ingestion of logs into Cloud Logging. This improves the efficiency of log transfer for both the control plane and workloads.Added proxy support for attaching AKS/EKS clusters. For details, see Connect to your EKS cluster and Connect to your AKS cluster.
This release fixes the following vulnerabilities:
- Fixed CVE-2021-43565
- Fixed CVE-2022-21698
- Fixed CVE-2023-0464
- Fixed CVE-2023-0465
- Fixed CVE-2023-0466
- Fixed CVE-2023-2454
- Fixed CVE-2023-2455
- Fixed CVE-2023-2650
- Fixed CVE-2023-24539
- Fixed CVE-2023-24540
- Fixed CVE-2023-29400
1.16.7-asm.7 is now available for in-cluster Anthos Service Mesh.
You can now download 1.16.7-asm.7 for in-cluster Anthos Service Mesh. It includes the features of Istio 1.16.7 subject to the list of supported features. Anthos Service Mesh 1.16.7-asm.7 uses Envoy v1.24.9.
1.17.5-asm.9 is now available for in-cluster Anthos Service Mesh.
You can now download 1.17.5-asm.9 for in-cluster Anthos Service Mesh. It includes the features of Istio 1.17.5 subject to the list of supported features. Anthos Service Mesh 1.17.5-asm.9 uses Envoy v1.25.8.
1.18.2-asm.4 is now available for in-cluster Anthos Service Mesh.
You can now download 1.18.2-asm.4 for in-cluster Anthos Service Mesh. It includes the features of Istio 1.18.2 subject to the list of supported features. Anthos Service Mesh 1.18.2-asm.4 uses Envoy v1.26.5.
You can now launch clusters with the following Kubernetes versions:
- 1.25.8-gke.500
- 1.26.7-gke.500
- 1.27.4-gke.1600
1.27
Preview: Enabled surge updates. Surge updates allow you to configure the speed and disruption of node pool updates. Please contact your account team to opt into the preview.
GA: Added support for AWS spot instance node pools. Creating AWS spot node pools is now GA. Spot instance node pools are pools of Amazon EC2 Spot Instances that are available on AWS at a lower cost.
GA: Enabled node auto repair. This feature continuously monitors the health of each node in a node pool.
Added Binary Authorization support which is a deploy-time security control that ensures only trusted container images are deployed. With Binary Authorization, you can require images to be signed by trusted authorities during the development process and then enforce signature validation when deploying. By enforcing validation, you can gain tighter control over your container environment by ensuring only verified images are integrated into the build-and-release process. For details about how to enable Binary Authorization on your clusters, see How to enable Binary Authorization.
Added support for a new
admin-groupsflag in the create and update APIs. This flag allows customers to quickly and easily authenticate listed groups as cluster administrators, eliminating the need to manually create and apply RBAC policies.Added an
ignore_errorsoption to the delete API to handle cases where accidentally deleted IAM roles or manual removal of resources prevent the deletion of clusters or node pools. By appending?ignore_errors=trueto theDELETErequest URL, users can now forcibly remove clusters or node pools. However, this approach might result in orphaned resources in AWS or Azure, requiring manual cleanup.Upgraded the
snapshot-controllerandcsi-snapshot-validation-webhookto v6.2.2. This new version introduces an important change to the API. Specifically, theVolumeSnapshot,VolumeSnapshotContents, andVolumeSnapshotClassv1beta1 APIs are no longer available.Disabled the unauthenticated
kubeletread-only port 10255. Once a node pool is upgraded to version 1.27, workloads running on it will no longer be able to connect to port 10255.Enabled gzip compression for
fluent-bit's ingestion of logs into Cloud Logging. This improves the efficiency of log transfer for both the control plane and workloads.Optimized
audit-proxy's audit Logging ingestion by enabling gzip compression.Improved security by adding file-integrity checks and fingerprint validation for Google-managed binary artifacts downloaded from Cloud Storage.
Added support for automatic periodic defragmentation of
etcdandetcd-eventson the control plane. This feature reduces unnecessary disk storage and helps to preventetcdand the control plane from becoming unavailable due to disk storage issues.Changed the metrics names for Kubernetes resource metrics to use a metrics prefix of
kubernetes.io/anthos/rather thankubernetes.io/. For details refer to the metrics reference documentation.Changed default
etcdversion to v3.4.21 on new clusters for improved stability. Existing clusters upgraded to this version will useetcdv3.5.6.Improved node resource management by reserving resources for the kubelet. While this feature is crucial for preventing Out of Memory (OOM) errors by ensuring system and Kubernetes processes have the resources they need, it may lead to workload disruptions. The reservation of resources for the kubelet may affect the available resources for Pods, potentially affecting the capacity of smaller nodes to handle existing workloads. Customers should verify that smaller nodes can still support their workloads with this new feature activated.
- The reserved memory percentages are as follows:
- 255 MiB for machines with less than 1GB of memory
- 25% of the first 4GB of memory
- 20% of the next 4GB
- 10% of the next 8GB
- 6% of the next 112GB
- 2% of any memory above 128GB
- The reserved CPU percentages are as follows:
- 6% of the first core
- 1% of the next core
- 0.5% of the next 2 cores
- 0.25% of any cores above 4 cores
- The reserved memory percentages are as follows:
Enabled the cluster autoscaler to balance nodes across different availability zones. This is achieved using the --balance-similar-node-groups flag.
1.25
Expanded the list of metrics collected from node pools to include gke-metrics-agent, cilium-agent, cilium-operator, coredns, fluentbit-gke, kubelet, and konnectivity-agent.
This release fixes the following vulnerabilities:
You can now launch clusters with the following Kubernetes versions:
- 1.25.8-gke.500
- 1.26.7-gke.500
- 1.27.4-gke.1600
1.27
GA: Enabled node auto repair. This feature continuously monitors the health of each node in a node pool. Added support for a new
admin-groupsflag in the create and update APIs. This flag allows customers to quickly and easily authenticate listed groups as cluster administrators, eliminating the need to manually create and apply RBAC policies.Upgraded the
snapshot-controllerandcsi-snapshot-validation-webhookto v6.2.2. This new version introduces an important change to the API. Specifically, theVolumeSnapshot,VolumeSnapshotContents, andVolumeSnapshotClassv1beta1 APIs are no longer available.Disabled the unauthenticated
kubeletread-only port 10255. Once a node pool is upgraded to version 1.27, workloads running on it will no longer be able to connect to port 10255.Enabled gzip compression for
fluent-bit's ingestion of logs into Cloud Logging. This improves the efficiency of log transfer for both the control plane and workloads.Optimized
audit-proxy's audit logging ingestion by enablinggzipcompression.Improved security by adding file-integrity checks and fingerprint validation for Google-managed binary artifacts downloaded from Cloud Storage.
Added support for automatic periodic defragmentation of
etcdandetcd-eventson the control plane. This feature reduces unnecessary disk storage and helps to preventetcdand the control plane from becoming unavailable due to disk storage issues.Changed the metrics names for Kubernetes resource metrics to use a metrics prefix of
kubernetes.io/anthos/rather thankubernetes.io/. For details refer to the metrics reference documentation.Changed default
etcdversion to v3.4.21 on new clusters for improved stability. Existing clusters upgraded to this version will useetcdv3.5.6.Improved node resource management by reserving resources for the kubelet. While this feature is crucial for preventing Out of Memory (OOM) errors by ensuring system and Kubernetes processes have the resources they need, it may lead to workload disruptions. The reservation of resources for the kubelet may affect the available resources for Pods, potentially affecting the capacity of smaller nodes to handle existing workloads. Customers should verify that smaller nodes can still support their workloads with this new feature activated.
- The reserved memory percentages are as follows:
- 255 MiB for machines with less than 1GB of memory
- 25% of the first 4GB of memory
- 20% of the next 4GB
- 10% of the next 8GB
- 6% of the next 112GB
- 2% of any memory above 128GB
- The reserved CPU percentages are as follows:
- 6% of the first core
- 1% of the next core
- 0.5% of the next 2 cores
- 0.25% of any cores above 4 cores
- The reserved memory percentages are as follows:
1.25
Expanded the list of metrics collected from node pools to include gke-metrics-agent, cilium-agent, cilium-operator, coredns, fluentbit-gke, kubelet, and konnectivity-agent.
This release fixes the following vulnerabilities:
Application Integration Quick setup (GA)
Application Integration Quick setup is now generally available in all the supported Google Cloud locations.
Quick setup is a single-click operation that automatically provisions Application Integration with the default configurations needed to get you started with the product.
For more information, see Set up Application Integration.
The following supported default parsers have changed. Each is listed by product name and log_type value, if applicable.
- Akamai Enterprise Application Access (
AKAMAI_EAA) - AWS Cloudtrail (
AWS_CLOUDTRAIL) - AWS CloudWatch (
AWS_CLOUDWATCH) - Chrome Management (
N/A) - Cisco ASA (
CISCO_ASA_FIREWALL) - Cisco Email Security (
CISCO_EMAIL_SECURITY) - Cloud Audit Logs (
N/A) - Cloudflare WAF (
CLOUDFLARE_WAF) - Darktrace (
DARKTRACE) - Desynova Contido (
DESYNOVA_CONTIDO) - Duo Telephony Logs (
DUO_TELEPHONY) - Elastic Audit Beats (
ELASTIC_AUDITBEAT) - F5 BIGIP LTM (
F5_BIGIP_LTM) - Fidelis Network (
FIDELIS_NETWORK) - Gitlab (
GITLAB) - Imperva FlexProtect (
IMPERVA_FLEXPROTECT) - Island Browser logs (
ISLAND_BROWSER) - Juniper (
JUNIPER_FIREWALL) - Microsoft Azure Resource (
AZURE_RESOURCE_LOGS) - Microsoft Graph API Alerts (
MICROSOFT_GRAPH_ALERT) - Microsoft Sentinel (
MICROSOFT_SENTINEL) - Netscout OCI (
NETSCOUT_OCI) - Netskope Web Proxy (
NETSKOPE_WEBPROXY) - Office 365 (
OFFICE_365) - OpenSSH (
OPENSSH) - Palo Alto Networks Firewall (
PAN_FIREWALL) - ProofPoint Secure Email Relay (
PROOFPOINT_SER) - SentinelOne Deep Visibility (
SENTINEL_DV) - SentinelOne EDR (
SENTINEL_EDR) - Suricata IDS (
SURICATA_IDS) - Symantec DLP (
SYMANTEC_DLP) - Windows Defender ATP (
WINDOWS_DEFENDER_ATP) - Windows Event (
WINEVTLOG) - Windows Event (XML) (
WINEVTLOG_XML) - Workspace Activities (
WORKSPACE_ACTIVITY) - Workspace Alerts (
WORKSPACE_ALERTS) - Workspace Users (
WORKSPACE_USERS) - Zscaler (
ZSCALER_WEBPROXY)
For details about changes in each parser, see Supported default parsers.
The SAP ODP plugin version 0.7.5 is available in Cloud Data Fusion versions 6.6.0 to 6.8.0. This release includes the following changes:
- Fixed an issue causing duplicate records or loss of records due to package acknowledgement occurring too early.
- Filters that you apply are viewable in the logs.
Cloud Load Balancing is introducing new advanced cost, latency, and resiliency optimizations for your global external Application Load Balancer. These include the following capabilities:
- You can use a service load balancing policy to customize the parameters that influence how traffic is distributed within the backends associated with a backend service (for example, load balancing algorithm and auto-capacity draining).
- You can designate specific backends as preferred backends.
For details, see Advanced load balancing optimizations.
A Cloud Spanner multi-region instance configuration is now available in Asia - asia2 (Mumbai/Delhi/Singapore).
Config Connector version 1.109.0 is now available.
Added name validation for the customizable ControllerResource CRDs.
Field spec.containers is no longer required in the customizable ControllerResource CRDs.
- Added support for
CloudIOTDeviceRegistry(v1alpha1) resource.
Added support for ComputeRegionSSLPolicy (v1alpha1) resource.
Added support for VertexAIIndexEndpoint (v1alpha1) resource.
Resource BigtableGCPolicy(v1beta1):
- Fixed a bug that generates unexpected diff when
modeandgcRulesare both specified. - Fixed a bug that generates unexpected diff when
maxAgeingcRulesis specified with units larger than hours.
Resource AlloyDBCluster(v1alpha1):
- Added
spec.continuousBackupConfigfield. - Added
spec.restoreBackupSourcefield. - Added
spec.restoreContinuousBackupSourcefield. - Added
status.continuousBackupInfofield.
Resource ArtifactRegistryRepository(v1beta1):
- Added
spec.cleanupPoliciesfield. - Added
spec.cleanupPolicyDryRunfield.
Resource BigQueryTable(v1beta1):
- Added
spec.maxStalenessfield. - Added
spec.externalDataConfiguration.fileSetSpecTypefield.
Resource CloudBuildTrigger(v1beta1):
- Added
spec.gitFileSource.bitbucketServerConfigReffield. - Added
spec.sourceToBuild.bitbucketServerConfigReffield.
Resource CloudFunctions2Function(v1alpha1):
- Added
spec.kmsKeyNamefield.
Resource ComputeAddress(v1beta1):
- Added
spec.ipv6EndpointTypefield.
Resource ComputeBackendService(v1beta1):
- Added
spec.securityPolicyfield. - Added
spec.connectionTrackingPolicy.enableStrongAffinityfield.
Resource ComputeInstance(v1beta1):
- Added
spec.networkInterface.items.ipv6AccessConfig.items.namefield. - Added
spec.scheduling.localSsdRecoveryTimeoutfield.
Resource ComputeInstanceTemplate(v1beta1):
- Added
spec.disk.items.provisionedIopsfield. - Added
spec.networkInterface.items.ipv6AccessConfig.items.namefield. - Added
spec.scheduling.localSsdRecoveryTimeoutfield.
Resource ComputeSecurityPolicy(v1beta1):
- Added
spec.advancedOptionsConfig.userIpRequestHeadersfield.
Resource ComputeTargetInstance(v1beta1):
- Added
spec.securityPolicyReffield.
Resource ComputeTargetPool(v1beta1):
- Added
spec.securityPolicyReffield.
Resource ContainerCluster(v1beta1):
- Added
spec.allowNetAdminfield. - Added
spec.enableK8sBetaApisfield. - Added
spec.enableMultiNetworkingfield. - Added
spec.ipAllocationPolicy.additionalPodRangesConfigfield. - Added
spec.monitoringConfig.advancedDatapathObservabilityConfigfield. - Added
spec.nodeConfig.hostMaintenancePolicyfield.
Resource ContainerNodePool(v1beta1):
- Added
spec.networkConfig.additionalNodeNetworkConfigsfield. - Added
spec.networkConfig.additionalPodNetworkConfigsfield. - Added
spec.nodeConfig.hostMaintenancePolicyfield. - Added
spec.placementPolicy.policyNameReffield.
Resource DNSManagedZone(v1beta1):
- Removed
spec.privateVisibilityConfig.requiredfield.
Resource EventarcTrigger(v1beta1):
- Added
spec.eventDataContentTypefield.
Resource FirebaseAndroidApp(v1alpha1):
- Added
spec.apiKeyIdfield.
Resource FirebaseWebApp(v1alpha1):
- Added
spec.apiKeyIdfield.
Resource HealthcareFHIRStore(v1alpha1):
- Added
spec.defaultSearchHandlingStrictfield. - Added
spec.notificationConfigs.items.sendPreviousResourceOnDeletefield. - Added
spec.streamConfigs.items.bigqueryDestination.schemaConfig.lastUpdatedPartitionConfigfield.
Resource IAMWorkforcePoolProvider(v1beta1):
- Added
spec.oidc.clientSecretfield. - Added
spec.oidc.jwksJsonfield. - Added
spec.oidc.webSsoConfig.additionalScopesfield. - Added
status.oidcfield.
Resource MonitoringAlertPolicy(v1beta1):
- Added
spec.conditions.items.conditionPrometheusQueryLanguagefield.
Resource PubSubSubscription(v1beta1):
- Added
spec.cloudStorageConfigfield. - Added
spec.pushConfig.noWrapperfield.
Resource RunJob(v1beta1):
- Added
status.createTimefield. - Added
status.creatorfield. - Added
status.deleteTimefield. - Added
status.expireTimefield. - Added
status.lastModifierfield. - Added
status.updateTimefield.
Resource SecretManagerSecret(v1beta1):
- Added
spec.annotationsfield. - Added
spec.versionAliasesfield.
Resource SpannerDatabase(v1beta1):
- Added
spec.enableDropProtectionfield.
Resource SQLInstance(v1beta1):
- Added
spec.settings.ipConfiguration.pscConfigfield. - Added
status.dnsNamefield. - Added
status.pscServiceAttachmentLinkfield.
Resource WorkstationsWorkstationCluster(v1alpha1):
- Added
spec.privateClusterConfig.allowedProjectsfield.
Fixed spec.webhookConfig.secretRef field in CloudBuildTrigger.
Data Catalog is now available in Berlin (europe-west10). For more information on region and feature availability, see regions.
The following Dataflow templates are generally available (GA):
Looker (Google Cloud core) now supports the following regions:
- asia-southeast1 (Singapore)
- australia-southeast1 (Sydney)
- europe-west2 (London)
- europe-west3 (Frankfurt)
- me-west1 (Tel Aviv)
- us-east4 (Northern Virginia)
The Terraform provider for Memorystore for Redis Cluster is now available for use.
Cloud Storage Backint agent for SAP HANA version 1.0.28
Version 1.0.28 of the Cloud Storage Backint agent for SAP HANA is available. This version includes a new HTTP_READ_TIMEOUT parameter.
For more information about the agent, see Cloud Storage Backint agent for SAP HANA overview.
Vertex AI Prediction
The following prebuilt containers for prediction have been updated:
- tf2-cpu.2-12
- tf2-gpu.2-12
- tf2-cpu.2-11
- tf2-gpu.2-11
- tf2-cpu.2-10
- tf2-gpu.2-10
- tf2-cpu.2-9
- tf2-gpu.2-9
- tf2-cpu.2-8
- tf2-gpu.2-8
- sklearn-cpu.1-2
- xgboost-cpu.1-7
- pytorch-cpu.2-0
- pytorch-gpu.2-0
- pytorch-cpu.1-13
- pytorch-gpu.1-13
To update your containers, redeploy your models. To learn more, see Vertex AI framework support policy and Prebuilt containers for prediction.
September 05, 2023
Anthos Service MeshAnthos Service Mesh will begin creating Network Endpoint Groups (NEGs) for all services. This rollout will proceed gradually over a period of several months, starting with the rapid channel. You may notice the following annotations on each of your services: cloud.google.com/neg and cloud.google.com/neg-status.
You can view NEGs with the following command:
gcloud compute network-endpoint-groups list.
Managed Anthos Service Mesh 1.16 is rolling out in the stable channel. See Managed Anthos Service Mesh release channels for more information.
Documentation has been added to explain how to automatically retry some or all of the failed tasks for a job. For example, automatic task retries can help prevent job failures from temporary issues like Spot VM preemption, host events, and transient networking errors.
For more information, see Automate task retries.
The following resource types are now publicly available through the Search APIs (SearchAllResources, SearchAllIamPolicies).
IAM
iam.googleapis.com/PolicyV2
Anthos Multi-Cloud (previously GKE Multi-Cloud)
gkemulticloud.googleapis.com/AwsClustergkemulticloud.googleapis.com/AzureClustergkemulticloud.googleapis.com/AzureClientgkemulticloud.googleapis.com/AwsNodePoolgkemulticloud.googleapis.com/AttachedClustergkemulticloud.googleapis.com/AzureNodePool
Dataflow templates are available to stream Cloud Bigtable data change records to BigQuery or Pub/Sub. For more information, see Reading a change stream.
The SAP SuccessFactors Batch Source plugin version 1.2.1 is available in Cloud Data Fusion. The release includes the following changes:
Fixed an issue causing an inaccurate error message when the plugin's Associated Entity Name property is invalid.
Fixed an issue causing inaccurate validation errors when the Expand Fields property contains a macro.
Troubleshooting errors with Duet AI assistance is now available in Preview.
1.28 is now available in the Rapid channel
Kubernetes 1.28 is now available in the Rapid channel. For more information about the content of Kubernetes 1.28, read the Kubernetes 1.28 Release Notes.
New APIs
- The
kubectl auth whoami commandand theauthentication.k8s.io/v1 SelfSubjectReview APIenables checking the authenticated user information as seen by the server.
Deprecated API versions
These APIs are still served in version 1.28 but are in a deprecation period:
- The following Beta versions of graduated APIs will be removed in 1.29 in favor of newer versions:
flowcontrol.apiserver.k8s.io/v1beta2 FlowSchema, PriorityLevelConfiguration- deprecated since 1.26
- use
flowcontrol.apiserver.k8s.io/v1beta3instead, available since 1.26.
Deprecated in-tree volume support
- The Ceph CephFS (
kubernetes.io/cephfs) and RBD (kubernetes.io/rbd) volume plugins are deprecated in 1.28 and will be removed in a future release. - To determine if you have volumes or Pods using RBD or Ceph volumes, run the following commands. If either of them print output, then you are using a deprecated volume type.
kubectl describe pv | egrep -i 'Type: *(RBD|CephFS)'kubectl describe pod -A | egrep -i 'Type: *(RBD|CephFS)'
- Switch to use an RBD or CephFS CSI driver, such as the drivers provided in the Ceph CSI GitHub repo, or use a Google-managed solution such as Filestore. For more information, refer to the OSS Kubernetes announcement and the Ceph CSI GitHub repo.
(2023-R18) Version updates
GKE cluster versions have been updated.
New versions available for upgrades and new clusters
The following Kubernetes versions are now available for new clusters and for opt-in control plane upgrades and node upgrades for existing clusters. For more information on versioning and upgrades, see GKE versioning and support and Upgrades.
No channel
- The following control plane and node versions are now available:
The following control plane versions are no longer available: 1.23.17-gke.8400, 1.23.17-gke.10000, 1.23.17-gke.10700, 1.24.14-gke.1400, 1.24.14-gke.2100, 1.25.10-gke.2100, 1.26.5-gke.1400
Control planes and nodes with auto-upgrade enabled will be upgraded from version 1.23 to version 1.24.14-gke.2700 with this release.
Control planes and nodes with auto-upgrade enabled will be upgraded from version 1.24 to version 1.25.10-gke.2700 with this release.
Control planes and nodes with auto-upgrade enabled will be upgraded from version 1.25 to version 1.25.10-gke.2700 with this release.
Stable channel
- The following versions are now available in the Stable channel:
- The following versions are no longer available in the Stable channel: 1.23.17-gke.8400, 1.24.14-gke.1400, 1.25.10-gke.2100, 1.27.3-gke.1700
- Control planes and nodes with auto-upgrade enabled in the Stable channel will be upgraded from version 1.23 to version 1.24.14-gke.2700 with this release.
- Control planes and nodes with auto-upgrade enabled in the Stable channel will be upgraded from version 1.24 to version 1.25.10-gke.2700 with this release.
- Control planes and nodes with auto-upgrade enabled in the Stable channel will be upgraded from version 1.25 to version 1.25.10-gke.2700 with this release.
Regular channel
- The following versions are now available in the Regular channel:
- The following versions are no longer available in the Regular channel: 1.23.17-gke.10000, 1.24.14-gke.2700, 1.25.10-gke.2700, 1.26.5-gke.2700
- Control planes and nodes with auto-upgrade enabled in the Regular channel will be upgraded from version 1.23 to version 1.24.15-gke.1700 with this release.
- Control planes and nodes with auto-upgrade enabled in the Regular channel will be upgraded from version 1.24 to version 1.25.11-gke.1700 with this release.
- Control planes and nodes with auto-upgrade enabled in the Regular channel will be upgraded from version 1.25 to version 1.26.6-gke.1700 with this release.
- Control planes and nodes with auto-upgrade enabled in the Regular channel will be upgraded from version 1.26 to version 1.26.6-gke.1700 with this release.
Rapid channel
- Version 1.27.4-gke.900 is now the default version in the Rapid channel.
- The following versions are now available in the Rapid channel:
- The following versions are no longer available in the Rapid channel: 1.23.17-gke.10000, 1.23.17-gke.10700, 1.24.16-gke.500, 1.25.11-gke.1700, 1.26.6-gke.1700, 1.27.3-gke.1700
- Control planes and nodes with auto-upgrade enabled in the Rapid channel will be upgraded from version 1.23 to version 1.24.17-gke.200 with this release.
- Control planes and nodes with auto-upgrade enabled in the Rapid channel will be upgraded from version 1.24 to version 1.25.12-gke.500 with this release.
- Control planes and nodes with auto-upgrade enabled in the Rapid channel will be upgraded from version 1.25 to version 1.26.7-gke.500 with this release.
- Control planes and nodes with auto-upgrade enabled in the Rapid channel will be upgraded from version 1.26 to version 1.27.4-gke.900 with this release.
- Control planes and nodes with auto-upgrade enabled in the Rapid channel will be upgraded from version 1.27 to version 1.27.4-gke.900 with this release.
- Control planes and nodes with auto-upgrade enabled in the Rapid channel will be upgraded from version 1.28 to version 1.28.1-gke.200 with this release.
The recently released version of GKE, version 1.28, has a known regression in behavior. After node restart, Pods that have started initialization before the restart will run Init containers in-parallel with regular containers instead of waiting for Init containers to complete.
To deliver a better default price-performance for applications, all GKE Autopilot clusters with control plane version 1.27.5 and later will use an SSD-based persistent disk for ephemeral storage. This change will only affect newly created clusters and new node pools created in clusters upgraded to version 1.27.5 and later.
It is not yet possible to enable Gateway API support in GKE 1.28 (Standard or Autopilot), this will be fixed in an upcoming patch release to GKE 1.28. Clusters that already have Gateway API enabled before upgrading to GKE 1.28 will continue to be supported. This will not affect existing Gateways.
(2023-R18) Version updates
- The following control plane and node versions are now available:
The following control plane versions are no longer available: 1.23.17-gke.8400, 1.23.17-gke.10000, 1.23.17-gke.10700, 1.24.14-gke.1400, 1.24.14-gke.2100, 1.25.10-gke.2100, 1.26.5-gke.1400
Control planes and nodes with auto-upgrade enabled will be upgraded from version 1.23 to version 1.24.14-gke.2700 with this release.
Control planes and nodes with auto-upgrade enabled will be upgraded from version 1.24 to version 1.25.10-gke.2700 with this release.
Control planes and nodes with auto-upgrade enabled will be upgraded from version 1.25 to version 1.25.10-gke.2700 with this release.
(2023-R18) Version updates
- The following versions are now available in the Stable channel:
- The following versions are no longer available in the Stable channel: 1.23.17-gke.8400, 1.24.14-gke.1400, 1.25.10-gke.2100, 1.27.3-gke.1700
- Control planes and nodes with auto-upgrade enabled in the Stable channel will be upgraded from version 1.23 to version 1.24.14-gke.2700 with this release.
- Control planes and nodes with auto-upgrade enabled in the Stable channel will be upgraded from version 1.24 to version 1.25.10-gke.2700 with this release.
- Control planes and nodes with auto-upgrade enabled in the Stable channel will be upgraded from version 1.25 to version 1.25.10-gke.2700 with this release.
(2023-R18) Version updates
- The following versions are now available in the Regular channel:
- The following versions are no longer available in the Regular channel: 1.23.17-gke.10000, 1.24.14-gke.2700, 1.25.10-gke.2700, 1.26.5-gke.2700
- Control planes and nodes with auto-upgrade enabled in the Regular channel will be upgraded from version 1.23 to version 1.24.15-gke.1700 with this release.
- Control planes and nodes with auto-upgrade enabled in the Regular channel will be upgraded from version 1.24 to version 1.25.11-gke.1700 with this release.
- Control planes and nodes with auto-upgrade enabled in the Regular channel will be upgraded from version 1.25 to version 1.26.6-gke.1700 with this release.
- Control planes and nodes with auto-upgrade enabled in the Regular channel will be upgraded from version 1.26 to version 1.26.6-gke.1700 with this release.
(2023-R18) Version updates
- Version 1.27.4-gke.900 is now the default version in the Rapid channel.
- The following versions are now available in the Rapid channel:
- The following versions are no longer available in the Rapid channel: 1.23.17-gke.10000, 1.23.17-gke.10700, 1.24.16-gke.500, 1.25.11-gke.1700, 1.26.6-gke.1700, 1.27.3-gke.1700
- Control planes and nodes with auto-upgrade enabled in the Rapid channel will be upgraded from version 1.23 to version 1.24.17-gke.200 with this release.
- Control planes and nodes with auto-upgrade enabled in the Rapid channel will be upgraded from version 1.24 to version 1.25.12-gke.500 with this release.
- Control planes and nodes with auto-upgrade enabled in the Rapid channel will be upgraded from version 1.25 to version 1.26.7-gke.500 with this release.
- Control planes and nodes with auto-upgrade enabled in the Rapid channel will be upgraded from version 1.26 to version 1.27.4-gke.900 with this release.
- Control planes and nodes with auto-upgrade enabled in the Rapid channel will be upgraded from version 1.27 to version 1.27.4-gke.900 with this release.
- Control planes and nodes with auto-upgrade enabled in the Rapid channel will be upgraded from version 1.28 to version 1.28.1-gke.200 with this release.
Support for IPv6 static routes with the following next hops is generally available (GA):
next-hop-gatewaynext-hop-instance
Preview: Workload Manager is now available for SQL Server workloads. For more information, see the Product overview.
September 04, 2023
Cloud Composer(Cloud Composer 2) An update that enforces VPC Service Controls perimeter settings for accessing Airflow UI and Airflow REST API is rolled out to all regions. As a result of this change, certain users that could previously access the Airflow UI or Airflow REST API might not be able to do it now.
If you experience problems with access to Airflow UI or Airflow REST API, update the perimeter or access level configuration for affected users. For more information on configuring VPC Service Controls see Configure VPC Service Controls.
Announcing the General Availability (GA) release of Data Lineage for Dataproc, which captures data transformations (lineage events) in Dataproc Spark jobs, and publishes them to Dataplex Lineage.
Dataproc Serverless Interactive sessions detail and list pages are now available in the Google Cloud console.
September 01, 2023
Anthos clusters on VMwareAnthos clusters on VMware 1.15.4-gke.37 is now available. To upgrade, see Upgrading Anthos clusters on VMware. Anthos clusters on VMware 1.15.4-gke.37 runs on Kubernetes 1.26.7-gke.2500.
Upgrading an admin cluster with always-on secrets encryption enabled might fail.
An admin cluster upgrade from 1.14.x to 1.15.0 - 1.15.4 with always-on secrets encryption enabled might fail depending on when you created the admin cluster. The following admin clusters are affected:
Admin clusters created in 1.12 or earlier with always-on secrets encryption enabled at creation time.
Admin clusters created in 1.12 or earlier with always-on secrets encryption disabled, but subsequently the cluster was updated to enable the feature.
Admin clusters created in 1.13 or later with the feature enabled are safe to upgrade.
If you don't know the original version of the admin cluster, don't upgrade the cluster until a fix is available in 1.15.5.
For information on working around an admin cluster failure because of this issue, see Upgrading an admin cluster with always-on secrets encryption enabled fails. Note that the workaround relies on you having the old encryption key backed up. If the old key is no longer available, you will have to recreate the admin cluster and all user clusters.
The following issues are fixed in 1.15.4-gke.37:
Fixed a known issue where incorrect log rotation configuration for fluent-bit caused low disk space on the Seesaw VM.
Fixed a known issue that GARP reply sent by Seesaw doesn't set target IP.
Fixed an issue where
/etc/vsphere/certificate/ca.crtwasn't updated after vsphere CA rotation on the Controlplane v2 user cluster control plane machines.Fixed a known issue where the admin SSH public key has error after admin cluster upgrade or update.
The following vulnerabilities are fixed in 1.15.4-gke.37:
High-severity container vulnerabilities:
Container-Optimized OS vulnerabilities:
The Japan Regions compliance program is now in Preview.
Cloud Build's free tier now offers the e2-standard-2 machine type as the new default machine type. The free tier now offers 2,500 build-minutes per month to provide you with more flexibility to use free build-minutes however you want throughout the month instead of being limited to a daily allocation. Changes to the Cloud Build free tier are effective as of September 1, 2023. To learn more, see Cloud Build pricing.
Starting on September 1, 2023, a new automation policy is in effect where GKE automatically starts a credential rotation within 30 days of your cluster's certificate authority expiry date to ensure that your cluster doesn't have a complete outage. For example, if your cluster's CA expires on 2024-01-05, an automatic rotation starts on or after 2023-12-06. Automatic credential rotation is a critical update that ignores any configured maintenance windows.
This automatic rotation might cause API clients outside the cluster, such as kubectl in a local environment, to stop working unless you update those clients to use the new credentials.
You should plan for and perform credential rotations well in advance of your cluster CA expiring to ensure a smooth transition to new credentials and minimal workload disruptions. Don't rely on automatic rotation; it is intended to be a last resort to prevent complete outages. To learn more about the stages of credential rotation, see Rotate your cluster's credentials.
Pricing update
The pricing for text-bison has been reduced to $0.0005 per 1,000 input and output characters. For details, see Vertex AI Pricing.
August 31, 2023
Apigee hybridhybrid v1.10.3
On August 31, 2023 we released an updated version of the Apigee hybrid software, v1.10.3.
- For information on upgrading, see Upgrading Apigee hybrid to version 1.10.
- For information on new installations, see The big picture.
| Bug ID | Description |
|---|---|
| 295929616 | Installation of Hybrid 1.10.x would fail on OpenShift due to out of memory issues. |
| 292571089 | An error with support for CSI backup and restore for Cassandra was fixed. |
| 287321226 | Security context has been corrected for apigee-prom-prometheus to avoid privilege escalation. |
| Bug ID | Description |
|---|---|
| 296717665, 296717664, 296717663, 296717662, 296717185, 296716666, 296716649, 296716632, 296716468, 296716467, 296716232, 296715152, 296715151, 296714218 |
Security fixes for apigee-cassandra-backup-utility. This addresses the following vulnerabilities: |
| 297938600, 297938559, 297938486, 294892344 |
Security fixes for apigee-diagnostics-collector. This addresses the following vulnerabilities: |
| 297938498, 297938487 |
Security fixes for apigee-fluent-bit. This addresses the following vulnerabilities: |
| 296719459, 296719400, 296719348, 296719307, 296719306, 296719188, 296719187, 296719186, 296719115, 296719018, 296718937, 296718918, 296718917, 296718916, 296716670, 296716669, 296716472, 296716471, 296715155 |
Security fixes for apigee-hybrid-cassandra. This addresses the following vulnerabilities: |
| 296717666, 296717283, 296716668, 296716667, 296716650, 296716635, 296716634, 296716633, 296716470, 296716234, 296715734, 296715733, 296715154, 296715153 |
Security fixes for apigee-hybrid-cassandra-client. This addresses the following vulnerabilities: |
| 297286274 | Security fixes for apigee-installer. This addresses the following vulnerabilities: |
| 295936113 | Security fixes for apigee-mart-server. This addresses the following vulnerability: |
| 297938441 | Security fixes for apigee-runtime. This addresses the following vulnerabilities: |
| 294906706 | Security fixes for apigee-prom-prometheus. This addresses the following vulnerabilities:
|
| 293925856 | Security fixes for apigee-prometheus-adapter. This addresses the following vulnerabilities: |
You can now use EXPORT DATA statements to directly export BigQuery data to Cloud Bigtable. This feature is in Preview.
The pgvector extension, version 0.4.2 is generally available. Use this extension to store and search for vector embeddings in PostgreSQL databases.
A monthly digest of client library updates from across the Cloud SDK.
Go
Changes for spanner/admin/database/apiv1
1.48.0 (2023-08-18)
Features
- spanner/spansql: Add complete set of math functions (#8246) (d7a238e)
- spanner/spansql: Add support for foreign key actions (#8296) (d78b851)
- spanner/spansql: Add support for IF NOT EXISTS and IF EXISTS clause (#8245) (96840ab)
- spanner: Add integration tests for Bit Reversed Sequences (#7924) (9b6e7c6)
Bug Fixes
- spanner: Reset buffer after abort on first SQL statement (#8440) (d980b42)
- spanner: REST query UpdateMask bug (df52820)
1.49.0 (2023-08-24)
Features
Bug Fixes
Java
Changes for google-cloud-spanner
6.45.0 (2023-08-04)
Features
- Enable leader aware routing by default in Connection API. This enables its use in the JDBC driver and PGAdapter. The update contains performance optimisations that will reduce the latency of read/write transactions that originate from a region other than the default leader region. (2a85446)
- Enable leader aware routing by default. This update contains performance optimisations that will reduce the latency of read/write transactions that originate from a region other than the default leader region. (441c1b0)
- Long running transaction clean up background task. Adding configuration options for closing inactive transactions. (#2419) (423e1a4)
- Support partitioned queries + data boost in Connection API (#2540) (4e31d04)
Bug Fixes
Dependencies
- Update dependency com.google.cloud:google-cloud-shared-dependencies to v3.14.0 (#2562) (dbd5c75)
- Update dependency org.openjdk.jmh:jmh-core to v1.37 (#2565) (d5c36bf)
- Update dependency org.openjdk.jmh:jmh-generator-annprocess to v1.37 (#2566) (73e92d4)
6.45.1 (2023-08-11)
Bug Fixes
6.45.2 (2023-08-14)
Bug Fixes
6.45.3 (2023-08-17)
Bug Fixes
Node.js
Changes for @google-cloud/spanner
6.15.0 (2023-08-04)
Features
- Enable leader aware routing by default. This update contains performance optimisations that will reduce the latency of read/write transactions that originate from a region other than the default leader region. (6852d99)
6.16.0 (2023-08-07)
Features
Bug Fixes
Python
Changes for google-cloud-spanner
3.39.0 (2023-08-02)
Features
Documentation
3.40.0 (2023-08-04)
Features
- Enable leader aware routing by default. This update contains performance optimisations that will reduce the latency of read/write transactions that originate from a region other than the default leader region. (e8dbfe7)
3.40.1 (2023-08-17)
Bug Fixes
Legacy Dataform will be deprecated on February 26, 2024, after which you will not be able to access legacy projects.
We recommend migration to Dataform in Google Cloud Platform.
To learn more about Dataform in Google Cloud Platform, see Overview of Dataform.
To discover how to migrate legacy projects, see Migrate from legacy Dataform.
Dialogflow CX generative features are now GA and publicly available:
Dialogflow CX answer feedback is now GA, but access is limited and must be requested.
Dialogflow CX Messenger has been redesigned and is now GA. This new version of the integration replaces the old version, which has been renamed Legacy Dialogflow Messenger. The old version is now deprecated, and it is recommended that all users of the old version migrate to the new version.
Eventarc support for creating triggers for direct events from the following sources is generally available (GA):
- AlloyDB for PostgreSQL
- API Gateway
- Apigee Registry
- Backup for GKE
- BeyondCorp
- Certificate Manager
- Cloud Data Fusion
- Cloud Dataplex
- Cloud Functions
- Cloud Memorystore for Memcached
- Database Migration
- Dataflow
- Dataproc Metastore
- Datastream
- Firebase Alerts
- Firebase Remote Config
- Firebase Test Lab
- GKE Hub
- Google Cloud Memorystore for Redis
- Network Connectivity
- Network Management
- Transcoder
- User-managed notebooks (Notebooks)
- Vision AI
- VM Migration
- Workflows
For GKE nodes running version 1.25 and later, when Image streaming is enabled, the mv command and renameat2 system call might fail on symlink files in container images with the error message "No such device or address". The issue is caused by a regression on recent Linux kernels. GKE does not currently have a fix for the issue. To learn more, see the troubleshooting section for this issue.
Experiment management: Google Cloud console now supports visualization of your model's performance changes over steps during training, and shows advanced run comparisons. To learn more, see Compare and analyze runs: Google Cloud console.
reCAPTCHA Enterprise for WAF and Google Cloud Armor integration is now available for mobile applications in Public Preview. For more information, see Integrate with Google Cloud Armor for mobile applications.
August 30, 2023
Bare Metal SolutionYou can now view and respond to maintenance events through Google Cloud console. This feature is generally available (GA). For more information, see Manage maintenance events.
You can now use EXPORT DATA statements to directly export BigQuery data to Bigtable. This feature is in preview.
Release Notes 6.2.34
- Alerts ingested using webhooks are missing details (ID #00249611)
- Entity Graph widget either not appearing or appearing without information (ID #00246250, #46124390)
- Entity Graph API call not working
Database Migration Service support for Oracle to Cloud SQL for PostgreSQL migrations is now generally available (GA). For more information, see Database Migration Service for Oracle to PostgreSQL documentation.
Integrated code and schema conversion for Oracle to Cloud SQL for PostgreSQL migrations is now available in Preview. With this feature, Database Migration Service conversion workspaces provide an inline editor to help make your schema conversions simple and seamless.
Generally available: NVIDIA L4 GPUs are now available in the following additional regions and zones:
- APAC
- Taiwan (
asia-east1-a,c) - Tokyo (
asia-northeast1-a,c) - Singapore(
asia-southeast1-c)
- Taiwan (
- Europe
- Belgium (
europe-west1-c) - London (
europe-west2-a,b)
- Belgium (
- North America
- Northern virginia (
us-east4-c) - Dalles (
us-west1-c)
- Northern virginia (
For more information about using GPUs on Compute Engine, see GPU platforms.
GKE now supports the ability to create nodes and workloads with multiple network interfaces. You can create new clusters with version 1.27 and later with multi networking enabled. The additional network interfaces on the Pods can be regular interfaces or high performance interfaces where the network interface is directly attached to the Pod. For more information, see Setup multi-network support for Pods.
Your clusters can now perform operations, such as node auto-provisioning or version upgrades, on multiple node pools in parallel. You no longer have to wait for an operation to complete before you initiate another operation. This feature is enabled for all GKE versions. This change provides you with benefits like the following:
- More efficient scaling, which results in improved savings and faster workload deployment
- Faster, less disruptive node pool upgrades
- Fewer "operation already in progress" messages that could delay subsequent planned operations
- More reliable rollback behavior to fix upgrade-related disruptions in production
- Automatic control plane resize operations won't block other operations on the cluster
The Google Cloud Platform Terraform provider has also been updated to take advantage of this change.
You can add Resource Manager tags to supported VPC resources. For more information, see Create and manage tags for VPC resources.
August 29, 2023
Access TransparencyAccess Transparency supports GKE Connect and GKE Hub in the GA stage.
AlloyDB Omni version 15.2.0 is available in Preview. This version includes the following:
- Compatibility with PostgreSQL server version 15
- A command-line interface for easier installation and maintenance of AlloyDB Omni
- Integration with Vertex AI
- Guides for data protection using Barman and pglogical
- Various bug fixes and query performance improvements
A separate Technology Preview edition of AlloyDB Omni is available. It lets you experiment with AlloyDB AI functionality using two included machine learning models trained on Google News text.
In AlloyDB Omni version 15.2.0, using the COPY function with the FREEZE option is disabled, due to a potential performance issue when loading large datasets.
Artifact Analysis automatic scanning for Python and Node.js (npm) vulnerabilities in container images is now generally available. If the Container Scanning API is enabled, it scans container images pushed to Artifact Registry for Python and Node.js vulnerabilities, in addition to operating system vulnerabilities.
Artifact Analysis returns Python and Node.js vulnerability results for images that have a supported or unsupported operating system. When you push new versions of images to the registry, you might see more successful vulnerability scans and corresponding charges against images without a supported operating system.
For more information, see Python overview and Node.js overview.
Artifact Analysis now offers support for Vulnerability Exploitability eXchange (VEX). VEX is a type of security advisory that indicates whether a product is affected by a known vulnerability. For every container image pushed to Artifact Registry, Artifact Analysis can store an associated VEX statement.
You can upload VEX files to describe any vulnerabilities discovered in specific artifacts and provide context about their impact. VEX statuses can be used to assist your organization in triaging vulnerabilities.
This feature is in Preview. To learn more, see Upload and view VEX statements.
Artifact Analysis now offers the ability to export a consolidated software bill of materials (SBOM) for scanned containers in Artifact Registry. SBOMs are generated in the Software Package Data Exchange (SPDX) format; however, you can also ingest externally created SBOMs in either SPDX or CycloneDx formats. With this new capability, you can centrally manage SBOMs to gain visibility into key information about your software supply chain.
This feature is in Preview. To learn more about our SBOM capabilities, see SBOM overview.
Documentation has been added to explain the VM OS environment for Batch. For a job's VMs, you can optionally configure the OS image and/or boot disk properties. Otherwise, a job uses the default configuration.
For more information, see the following pages:
Data clean rooms is now in preview. Data clean rooms provide a secure environment in which multiple parties can share, join, and analyze their data assets without moving or revealing the underlying data. To learn more, see the following topics:
Duet AI in BigQuery, an AI-powered collaborator in Google Cloud, can help you complete, generate, and explain SQL queries. This feature is in preview.
BigQuery Studio is now in preview. BigQuery Studio offers features to make it easier for you to discover, explore, analyze, and run inference on data in BigQuery, including:
- Python notebooks, powered by Colab Enterprise. Notebooks provide one-click Python development runtimes, and built-in support for BigQuery DataFrames.
- Asset management and version history for notebooks and saved queries, powered by Dataform.
BigQuery DataFrames is now in preview. BigQuery DataFrames is a Python API that you can use to analyze data and perform machine learning tasks in BigQuery. BigQuery DataFrames consists of the following parts:
bigframes.pandasimplements a DataFrame API (with partial Pandas compatibility) on top of BigQuery.bigframes.mlimplements a Python API for BigQuery ML (with partial scikit-learn compatibility).
Get started with BigQuery DataFrames by using the BigQuery DataFrames quickstart.
The following Generative AI features are now generally available (GA) in BigQuery ML:
- Creating a remote model based on the Vertex AI large language model (LLM) text-bison.
- Using the
ML.GENERATE_TEXTfunction with an LLM-based remote model to perform generative natural language tasks on text stored in BigQuery tables.
Try these features with the Generate text by using a remote model and the ML.GENERATE_TEXT function tutorial.
You can now configure Cloud Build to generate Google-signed identity tokens for user-specified service accounts during a build. Leveraging identity tokens with Cloud Build, you can:
Identity tokens that you generate with Cloud Build conform to the OpenID Connect (OIDC) specification.
This feature is generally available.
You can use intrusion prevention service to safeguard your workload traffic from threats such as malware, spyware, and command-and-control attacks. This feature is available in Preview.
Cloud Functions (2nd gen) is now the default choice in the Google Cloud console user interface.
Summarizing log entries with Duet AI assistance is now available in Preview.
Spanner Studio includes Duet AI (in Preview), an AI-powered collaborator in Google Cloud that accelerates SQL development by helping you write SQL statements. For more information, see Write SQL with Duet AI assistance.
You can now create Cloud Tensor Processing Unit (TPU) nodes in Google Kubernetes Engine (GKE) to run AI workloads, from training to inference models. GKE manages your cluster by automating TPU resource provisioning, scaling, scheduling, repairing, and upgrading. GKE provides TPU infrastructure metrics in Cloud Monitoring, TPU logs, and error reports for better visibility and monitoring of TPU node pools in GKE clusters. TPUs are available with GKE Standard clusters. GKE supports TPU v4 in version 1.26.1.gke-1500 and later, and supports TPU v5e in version 1.27.2-gke.1500 and later. To learn more, see TPUs in GKE introduction.
Duet AI for Cloud Workstations is available in Preview. Use Duet AI, your AI-powered collaborator, to accomplish tasks more effectively and efficiently. Duet AI provides contextualized responses to your prompts to help guide you on what you're trying to do with your code. It also shares source citations regarding which documentation and code samples the assistant used to generate its responses. You can do this in the Cloud Workstations base editor. For more information, see the Duet AI in Google Cloud overview and Code with Duet AI assistance.
Colab Enterprise is now available in Preview. Colab Enterprise combines the popular collaborative features of Colaboratory with the security and compliance capabilities of Google Cloud. Colab Enterprise includes:
- Sharing and collaborating functionality, with IAM access control.
- Google-managed compute and runtime provisioning, with configurable runtime templates.
- Integrations with Vertex AI and BigQuery.
- Inline code completion with Duet AI assistance.
- End-user credential authentication for running your notebook code.
To get started, see Introduction to Colab Enterprise or create a notebook and start coding.
Preview: You can use future reservations to reserve resources at a specific date and time in the near future.
Future reservations are useful for obtaining capacity for future peak-demand events or highly-demanded resources. For more information, see About future reservation requests.
Announcing the Preview release of Dataproc Serverless for Spark Interactive sessions and the Dataproc Jupyter Plugin.
Vertex AI Search and Conversation is the new product name for Generative AI App Builder.
Generative AI App Builder: GA
Gen AI App Builder is publicly and generally available (GA).
Separation of data stores and apps
Data stores and apps are separate entities. In the console, you can see your apps on the Apps page and your data stores on the Data Stores page. You can create a data store and attach it to an app during app creation, or create a new data store during app creation.
Apps and data stores have a one-to-one relationship. Each app is associated with one data store; they can't be disconnected after you attach them. This change does not affect the functionality of your existing apps.
Enterprise Search: Search with follow-ups is GA
Previously, the search with follow-ups feature was called multi-turn search.
Search with follow-ups is now generally available (GA).
Search with follow-ups can be applied to websites if advanced website indexing is enabled and to unstructured data.
In addition, to improve consistency between search with an answer and search with follow-ups, the response from the conversations.converse method v1 provides the summary object and no longer provides the reply and references objects. The response from the v1beta version of the method remains unchanged.
SafeSearch is available with the search with follow-ups feature.
For general information about search with follow-ups, see Search with follow-ups.
Enterprise Search: Improvements to snippets, extractive answers, and extractive segments
Snippet status is now returned along with the snippet.
Extractive answers include the document page number where the answer was found.
Up to 10 extractive segments can be returned for a search result.
Enterprise Search: Multi-region support for US and EU locations
When you create a data store, you can specify global, the US multi-region, or the EU multi-region.
For more information including limitations associated with multi-region use, see Enterprise Search locations.
Enterprise Search: Languages
More features in more languages are supported for Enterprise Search.
See Languages.
Enterprise Search: Verify website domains
New requirement to verify your domain ownership for any websites in your data stores with advanced website indexing turned on.
Enterprise Search: Confidence scores
Confidence scores for extractive segments are available in preview with allowlist. Scores are based on the similarity of the query to the extracted segment.
See Extractive segments.
Enterprise Search: Serving controls using the API are allowlisted GA
Boost, filter, synonym, and redirect serving controls affect search results returned through API method calls.
For more information, see Configure serving controls.
Enterprise Search: Related questions
Related questions are available as an allowlisted, preview feature for search with follow-ups.
For information, see Related questions.
You can now create Cloud Tensor Processing Unit (TPU) nodes in GKE to run AI workloads, from training to inference models. GKE manages your cluster by automating TPU resource provisioning, scaling, scheduling, repairing, and upgrading. GKE provides TPU infrastructure metrics in Cloud Monitoring, TPU logs, and error reports for better visibility and monitoring of TPU node pools in GKE clusters. TPUs are available with GKE Standard clusters. GKE supports TPU v4 in version 1.26.1.gke-1500 and later, and supports TPU v5e in version 1.27.2-gke.1500 and later. To learn more, see About TPUs in GKE.
You can now sequence the rollout of cluster upgrades across fleets or across scopes. To learn more, see About cluster upgrades with rollout sequencing.
Imagen on Vertex AI now offers the following Generally Available (GA) features:
* Restricted access feature.
For more information about Imagen or how to get access to restricted GA features, see the Imagen on Vertex AI overview.
Stream responses from Generative AI models
Generative AI model streaming support is now Generally Available (GA). After you send a prompt, the model returns response tokens as they're generated instead of waiting for the entire output to be available.
Supported models are:
text-bisonchat-bisoncode-bisoncodechat-bison
To learn more, see Stream responses from Generative AI models.
New Generative AI support on Vertex AI models and expanded language support
Generative AI support on Vertex AI has been updated to include new language model candidates (latest models), language models that support input and output tokens up to 32k, and more supported languages.
For details, see Available models and Model versions and lifecycle.
Model tuning for the text-bison model is now Generally Available (GA)
Tuning the text-bison model with supervised fine-tuning (SFT) is now Generally Available (GA) .
For more information, see Tune text models.
Model tuning for the chat-bison model is now available in Preview
You can now use supervised fine-tuning to tune the chat-bison model. This feature is in (Preview).
For more information, see Tune text models.
New embedding model now available in Preview
Generative AI support on Vertex AI users can now create embeddings using a new model trained on a wide range of non-English languages in (Preview).
textembedding-gecko-multilingual
To learn more, see Get text embeddings.
Reinforcement learning from human feedback (RLHF) tuning for text-bison
The Generative AI text generation foundation model (text-bison) now supports RLHF tuning. The RLHF tuning feature is in (Preview).
For more information, see Use RLHF model tuning.
Vertex AI Codey APIs language support
Vertex AI Codey APIs now support additional programming languages. For more information, see Supported coding languages
Vertex AI Codey APIs now support supervised fine-tuning (SFT)
The code chat (codechat-bison) and code generation (code-bison) Vertex AI Codey APIs models now support supervised fine-tuning (SFT). The supervised-fine tuning for Vertex AI Codey APIs models feature is in (Preview). For more information, see Tune code models.
Metrics-based model evaluation
You can evaluate the performance of foundation models and tuned models against an evaluation dataset for classification, summarization, question answering, and general text generation. This feature is available in (Preview).
To learn more, see Evaluate model performance.
Vertex AI Vector Search is the new product name for Vertex AI Matching Engine.
Vertex AI Model Registry Models and Vertex AI Datasets are now synced to Dataplex's Data Catalog. Data Catalog enables organization-wide search and discovery of data artifacts, while still maintaining IAM boundaries. The sync and search of these assets is available in Preview. For more information, see Data Catalog documentation.
CountToken API now available in Preview
The CountToken API is now available in (Preview). You can use this API to get the token count and the number of billable characters for a prompt. To learn more, see Get token count.
The Vertex AI Pipelines Template Gallery is now generally available (GA). The Template Gallery contains Google-authored pipeline and component templates to bootstrap your MLOps practice. Customize and run the templates as-is or embed them into your own pipelines. For more information, see Use a prebuilt template from the Template Gallery.
August 28, 2023
Access ApprovalAccess Approval supports Anthos Identity Service in the GA stage.
The support policy and schedule for Google Cloud's buildpacks is now available at https://cloud.google.com/docs/buildpacks/support-policy.
You can now use Cloud Monitoring to customize and receive notifications about ingestion health metrics. For more information, see Ingestion notifications for health metrics.
The following resource types are now publicly available through the ExportAssets, ListAssets, BatchGetAssetsHistory, QueryAssets, and Feed APIs.
- Financial Services
financialservices.googleapis.com/Instance
- Discovery Engine
discoveryengine.googleapis.com/Collectiondiscoveryengine.googleapis.com/DataStore
Cloud Bigtable is available in the europe-west10 (Berlin) region. For more information, see Bigtable locations.
The Natural Language API v2 is now available in Public Preview. This new version of the API supports Sentiment Analysis, Entity Analysis, Text Moderation, and Content Classification. This version has major updates for Sentiment Analysis and Entity Analysis, which include performance upgrades and general improvements. All API calls now return language_code .
Sentiment analysis uses a new PaLM-based model for improved quality. The language field is now called language_code.
Entity analysis uses a new PaLM-based model for improved quality. Please note the following updates:
- language field is now called "language_code"
- No salience field.
- No wikipedia_url as metadata.
- Parsing improvements for the following entity types: PHONE_NUMBER, ADDRESS, DATE, NUMBER, PRICE
- New probability score field is returned for all entities where NUMBER, PHONE_NUMBER, ADDRESS, PRICE, DATE will always be 1.0.
You can now set password policies for local database users of Cloud SQL for PostgreSQL instances.
The sum() and avg() aggregation functions are now available for Firestore in Datastore mode.
A weekly digest of client library updates from across the Cloud SDK.
Go
Changes for datastore/admin/apiv1
1.14.0 (2023-08-22)
Features
- datastore: SUM and AVG aggregations (#8307) (a9fff18)
- datastore: Support aggregation query in transaction (#8439) (37681ff)
Bug Fixes
- datastore: Correcting string representation of Key (#8363) (4cb1211)
- datastore: Fix NoIndex for array property (#7674) (01951e6)
Documentation
- datastore/admin: Specify limit for
propertiesinIndexmessage in Datastore Admin API (b890425)
Java
Changes for google-cloud-datastore
2.17.0 (2023-08-22)
Features
- Publish proto definitions for SUM/AVG in Datastore (#1157) (954320a)
- Sum and Avg aggregation feature (#1067) (56d1001)
Dependencies
- Update dependency com.google.errorprone:error_prone_core to v2.21.1 (#1163) (83158b6)
- Update dependency org.graalvm.buildtools:junit-platform-native to v0.9.24 (#1165) (4094c70)
- Update dependency org.graalvm.buildtools:native-maven-plugin to v0.9.24 (#1166) (70cc371)
Documentation
Version 4.80.0 of the Terraform provider for Google Cloud fixes an issue observed when deploying new GKE Autopilot clusters that would destroy and re-create the cluster due to a change in the dns_config state. This version of the provider ensures that customers can deploy GKE Autopilot clusters using Cloud DNS as the default in-cluster DNS provider. For more information, see Terraform plans to re-create Autopilot cluster due to dns_config change.
A weekly digest of client library updates from across the Cloud SDK.
Node.js
Changes for @google-cloud/pubsub
4.0.2 (2023-08-24)
Bug Fixes
Tabular Workflow for Forecasting is available in Preview. For documentation, refer to Tabular Workflow for Forecasting.
August 26, 2023
Cloud Composer(Cloud Composer versions 1.x.x and 2.0.x): Creating Cloud Composer environments in projects with VPC Service Controls enabled fails if you add Cloud Identity-Aware Proxy API or Identity-Aware Proxy TCP API to the security perimeter.
For more information and possible workarounds, see Environment creation fails in projects with VPC Service Controls enabled.
Posit Workbench (including RStudio Pro) integration is generally available (GA). For more information, see Develop code using Posit Workbench.
August 25, 2023
Access ApprovalAccess Approval supports Memorystore for Redis in the GA stage.
Release 1.16.0
Anthos clusters on bare metal 1.16.0 is now available for download. To upgrade, see Upgrading Anthos on bare metal. Anthos clusters on bare metal 1.16.0 runs on Kubernetes 1.27.
Version 1.13 end of life: In accordance with the Anthos Version Support Policy, version 1.13 (all patch releases) of Anthos clusters on bare metal has reached its end of life and is no longer supported.
Red Hat Enterprise Linux (RHEL) 8 minor versions 8.2, 8.3, 8.4, and 8.5 have reached their end of life. Please ensure you're using a supported version of your operating system.
Cluster lifecycle:
Upgraded to Kubernetes version 1.27.4.
Added support for Red Hat Enterprise Linux (RHEL) version 8.8.
GA: Added support for parallel upgrades of worker node pools.
GA: Added support to upgrade specific worker node pools separately from the rest of the cluster.
GA: Added a separate instance of etcd for the
etcd-eventsobject. This new etcd instance is always on and requires ports 2382 and 2383 to be open on control plane nodes for inbound TCP traffic. If these ports aren't opened, cluster creation and cluster upgrades are blocked.GA: Updated preflight checks for cluster installation and upgrades to use changes from the latest Anthos clusters on bare metal patch version to address known issues and provide more useful checks.
GA: Support enrolling admin and user clusters in the Anthos On-Prem API automatically to enable cluster lifecycle management from the Google Cloud CLI, the Google Cloud console, and Terraform when the Anthos On-Prem API is enabled. If needed, you have the option to disable enrollment. For more information, see the description for the
gkeOnPremAPIfield in the cluster configuration file.GA: Added ability to configure kubelet image pull settings for node pools. For more information, see Configure kubelet image pull settings.
Added new health check to detect any unsupported drift in the custom resources managed by Anthos clusters on bare metal. Unsupported resource changes can lead to cluster problems.
Added a new flag,
--target-cluster-name, that is supported by thebmctl register bootstrapcommand.
Networking:
GA: Added support for Services of type LoadBalancer to use
externalTrafficPolicy=Localwith bundled load balancing with BGP.Preview: Added support for enabling Direct Server Return (DSR) load balancing for clusters configured with flat-mode networking. DSR load balancing is enabled with an annotation,
preview.baremetal.cluster.gke.io/dpv2-lbmode-dsr: enable.Preview: Upgraded wherabouts to v0.6.1-gke.1 to support dual-stack networking.
Added support for multiple BGP load balancer (
BGPLoadBalancer) resources and BGP Community. Multiple BGP load balancer resources provide more flexibility to define which peers advertise specific load balancer nodes and Services. BGP Community support helps you to distinguish routes coming from BGP load balancers from other routes in your network.
Observability:
- GA: Added support for system metrics when you use Google Cloud Managed Service for Prometheus.
Security and Identity:
GA: Added support for Binary Authorization, a service on Google Cloud that provides software supply-chain security for container-based applications. For more information, see Set up Binary Authorization policy enforcement.
GA: Added support for VPC Service Controls, which provides additional security for your clusters to help mitigate the risk of data exfiltration.
Preview: Added support for using custom cluster certificate authorities (CAs) to enable secure authentication and encryption between cluster components.
Preview: Added support for configuring the Subject Alternative Names (SANs) of the kubeadm generated certificate for the kube-apiserver.
Added support to run keepalived as a non-root user.
Supported node pool versions:
If you use selective worker node pool upgrades to upgrade a cluster to version 1.16.0, the following versions are supported for the worker node pools:
- 1.16.0
- 1.15.3
- 1.15.2
- 1.15.1
- 1.15.0
For more information about node pool versions, see Node pool version rules.
Functionality changes:
Updated constraint on NodePool
spec.upgradeStrategy.concurrentNodesto be the smaller of 15 nodes or 50% of the size of the node pool.Replaced legacy method of enabling application logging in the cluster configuration file with two fields,
enableCloudLoggingForApplicationsandenableGMPForApplications, in the stackdriver custom resource.The
spec.clusterOperations.enableApplicationfield in the cluster configuration file has no effect on version 1.16.0 and higher clusters. This field populated theenableStackdriverForApplicationsfield in the stackdriver custom resource, which enabled annotation based workload metric collection. I you need this capability, use theannotationBasedApplicationMetricsfeature gate in the stackdriver custom resource as shown in the following sample to keep the same behavior:kind:stackdriver spec: enableCloudLoggingForApplications: true featureGates: annotationBasedApplicationMetrics: trueAdded optional
ksmNodePodMetricsOnlyfeature gate in the stackdriver custom resource to reduce the number of metrics from kube-state-metrics. Reducing the number of metrics makes monitoring pipeline more stable in large scale clusters.Audit logs are compressed on the wire for Cloud Audit Logs consumption, reducing egress bandwidth by approximately 60%.
Upgraded local volume provisioner to v2.5.0.
Upgraded snapshot controller to v5.0.1.
Deprecated v1beta1 volume snapshot custom resources. Anthos clusters on bare metal will stop serving v1beta1 resources in a future release.
Removed resource request limits on edge profile workloads.
Added preflight check to make sure control plane and load balancer nodes aren't under maintenance before an upgrade.
Updated the cluster snapshot capability so that information can be captured for the target cluster even when the cluster custom resource is missing or unavailable.
Improved
bmctlerror reporting for failures during the creation of a bootstrap cluster.Added support for using the
baremetal.cluster.gke.io/maintenance-mode-deadline-secondscluster annotation to specify the maximum node draining duration, in seconds. By default, a 20-minute (1200 seconds) timeout is enforced. When the timeout elapses, all pods are stopped and the node is put into maintenance mode. For example to change the timeout to 10 minutes, add the annotationbaremetal.cluster.gke.io/maintenance-mode-deadline-seconds: "600"to your cluster.Updated
bmctl check clusterto create a HealthCheck custom resource in the admin cluster if it's healthy.
Fixes:
Fixed an issue where the apiserver could become unresponsive during a cluster upgrade for clusters with a single control plane node.
Fixed an issue where cluster installations or upgrades fail when the cluster name has more than 45 characters.
Fixed an issue where the control plane VIP wasn't reachable during cluster installation on Red Hat Enterprise Linux.
Fixed an issue where audit logs were duplicated into the offline buffer even when they are sent to Cloud Audit Logs successfully.
Fixed an issue where node-specific labels set on the node pool were sometimes overwritten.
Updated
avoidBuggyIPsandmanualAssignfields in load balancer address pools (spec.loadBalancers.addressPools) to allow changes at any time.Fixed an issue where containerd didn't restart when there was a version mismatch. This issue caused an inconsistent containerd version within the cluster.
Fixed an issue that caused the logging agent to use continuously increasing amounts of memory.
Fixed preflight check so that it no longer ignores the
no_proxysetting.Fixed Anthos Identity Service annotation needed for exporting metrics.
Fixed an issue that caused the
bmctl restorecommand to stop responding for clusters with manually configured load balancers.Fixed an issue that prevented Anthos clusters on bare metal from restoring a high-availability quorum for nodes that use
/var/lib/etcdas a mountpoint.Fixed an issue that caused health checks to report failure when they find a Pod with a status of
TaintTolerationeven when the replicaset for the Pod has sufficient Pods running.Fixed an issue that caused conflicts with third-party Ansible automation.
Fixed a cluster upgrade issue that prevented some control plane nodes from rejoining a cluster configured for high availability.
The following container image security vulnerabilities have been fixed:
Critical container vulnerabilities:
High-severity container vulnerabilities:
Medium-severity container vulnerabilities:
Low-severity container vulnerabilities:
Known issues:
For information about the latest known issues, see Anthos clusters on bare metal known issues in the Troubleshooting section.
On August 25, 2023, we released an updated version of Apigee Advanced API Security.
This release includes custom profiles for Advanced API Security scores. Custom profiles let you specify the security categories you want your security scores to be based on. In this release, you must create a security profile in the security scores API. However, you can view scores for the profile in the security scores UI.
Batch is available in the europe-west10 (Berlin) region.
For more information, see Locations.
The following resource types are now publicly available through the analyze policy APIs (AnalyzeIamPolicy and AnalyzeIamPolicyLongrunning).
You can now cancel a currently running job execution. (In Preview.)
Preview: You can reduce network latency between VMs by using compact placement policies to specify the maximum distance between VMs. Use compact placement policies to optimize workloads with frequent communication across VMs—for example, high-performance computing (HPC), machine learning (ML), or database server workloads. You can keep VMs in the same rack, across adjacent racks within the same cluster, or across adjacent clusters.
For more information, see Reduce latency by using compact placement policies.
New Dataproc Serverless for Spark runtime versions:
- 1.1.29
- 2.0.37
- 2.1.16
Document AI Workbench is now powered by generative AI with two feature launches:
Document AI Workbench Summarizer is in Preview:
- The Summarizer provides summaries for documents up to 250 pages long.
- You can customize summaries based on your preferences for length (brief, moderate, comprehensive) and format (paragraph, bullet points).
- See the user guide for more information.
Document AI Workbench custom extractor is in preview:
- Custom extractor with generative AI can help extract data from documents with free-form text (e.g., contracts) and complex layouts (e.g., invoices, W2s, bills of lading).
- The pretrained processor version, which uses generative AI, can be used out of the box without any training. Post a document to the endpoint with a list of fields to get structured data.
- Customize results by confirming content in about five documents. Workbench leverages the examples to improve accuracy using few-shot prediction.
- Extract information from documents up to 200 pages long through the asynchronous API.
- To get started, create or use an existing custom extractor to leverage a processor version.
- See the how-to guide, labeling best practices, and training use cases.
- Current limitations of generative AI extraction within the custom extractor:
- Only the English language is supported.
- Region availability is currently only in the US.
- While in preview, we recommend that you only extract up to 50 entities per endpoint with generative AI.
- When uploading a sample document to define fields and preview results on the Get started page, there can be long latencies. We're working to reduce this latency.
In addition, template-based training is available in GA within the custom extractor:
- Template-based training provides accurate predictions for documents with no layout variation (such as an application form).
- Only six labeled documents are needed to train and use a template-based processor version.
- See the user guide and training use cases.
Scheduled backups now available in Preview.
You can now view and list multiple databases using the Google Cloud console. This feature is in Preview.
You can now view and list multiple databases using the Google Cloud console. This feature is in Preview.
Scheduled backups now available in Preview.
GKE now delivers insights and recommendations to ensure your workloads are ready for disruption using features such as Pod Disruption Budgets. To learn more, see Ensure stateful workloads are disruption-ready.
August 24, 2023
BigQueryThe following text embedding features are now available in preview:
- Creating a BigQuery ML remote model that references the Vertex AI PaLM APIs for embeddings (
textembedding-gecko). - Using the
ML.GENERATE_TEXT_EMBEDDINGfunction with the remote embedding model to embed text stored in BigQuery. - Using the
ARRAY<NUMERIC> typeas an input feature type to other models. - Generating text embeddings with the NNLM, SWIVEL, and BERT TensorFlow models.
For more information, see the tutorial for performing basic semantic search with text embeddings.
The following BigQuery ML inference features are now generally available (GA):
- Importing ONNX, XGBoost, and TensorFlow Lite models so that you can run them within the BigQuery ML inference engine.
- Hosting models remotely on Vertex AI Prediction so you can do inference with BigQuery ML, removing the need to build data pipelines manually.
- Using BigQuery ML functions to perform inference on Vertex AI pretrained models so that you can accomplish natural language processing, translation, and computer vision tasks in BigQuery. These functions work with the Cloud Vision, Cloud Natural Language, and Cloud Translation APIs.
Chronicle has updated the rules engine's YARA-L 2.0 language compiler to report warnings. Warnings flag rules that are syntactically valid but may result in unexpected behavior. You can view and expand warnings in the Rules Editor the same way you view errors. The following warnings are currently supported:
Multi-event non-distinct outcome section aggregations. For more information, see YARA-L known issues and limitations
Deprecated UDM fields or enum values
Cloud Spanner has added 13 new PostgreSQL functions and operators:
ARRAY_UPPER(anyarray, dimension)functionQUOTE_IDENT(string)functionSUBSTRING(string, pattern)functionDATE - DATEoperatorDATE - INTEGERoperatorDATE + INTEGERoperatorREGEXP_MATCH(string, pattern [, flags])functionREGEXP_SPLIT_TO_ARRAY(string, pattern [, flags])functionSTRING !~ PATTERNoperatorTO_CHAR(timestamptz, format),TO_CHAR(double, format),TO_CHAR(bigint, format),TO_CHAR(numeric, format)functionTO_NUMBER(string, format)functionTO_DATE(string, format)functionTO_TIMESTAMP(string, format)function
For more information, see Supported PostgreSQL functions.
cos-105-17412-156-30
| Kernel | Docker | Containerd | GPU Drivers |
| COS-5.15.120 | v23.0.3 | v1.7.2 | v470.199.02(default),v525.125.06 |
Fixed a kernel crash in device memory TCP behavior.
Fixed CVE-2023-4128 in the Linux kernel.
Runtime sysctl changes:
- Added: kernel.io_uring_disabled: 0
August 23, 2023
Anthos clusters on VMwareAnthos clusters on VMware 1.16.0-gke.669 is now available. To upgrade, see Upgrading Anthos clusters on VMware. Anthos clusters on VMware 1.16.0-gke.669 runs on Kubernetes 1.27.4-gke.1600.
- Preview: You can migrate from the Seesaw load balancer to MetalLB.
- Preview: Support the direct server return (DSR) load balancing mode for a cluster that has Dataplane V2 enabled.
- Preview: Support user-managed admin workstations.
- Preview: Support preparing credentials as Kubernetes secrets for admin clusters. See also the Secrets configuration file reference.
- GA: Support for vSphere 8.0.
- GA: Support enrolling admin and user clusters in the Anthos On-Prem API automatically to enable cluster lifecycle management from the Google Cloud CLI, the Google Cloud console, and Terraform when the Anthos On-Prem API is enabled. If needed, you have the option to disable enrollment. For more information, see Admin cluster configuration file and User cluster configuration file.
- GA: Logging and monitoring agents on each cluster now include kube-state-metrics and node-exporter.
- GA: Support for high-availability control plane for admin clusters.
- GA: Support for VM-Host affinity for user cluster node pools.
- GA: Support for user cluster storage policy based management (SPBM) .
- GA: Google managed service for Prometheus supports system metrics.
- GA: Support disabling bundled Istio ingress controller in the user cluster configuration.
- GA: Enforce the same project ID and location for new cluster creation.
- GA: Support for using
gkectlto update secret encryption. - GA: Support for enabling or disabling antiAffinityGroups.
Version changes:
- Upgraded VMware vSphere Container Storage Plug-in from 3.0 to 3.0.2.
- The
crictlcommand-line tool was updated to 1.27. - The
containerdconfig was updated to version 2.
Other changes:
- The output of the
gkectl diagnose clustercommand has been updated to provide a summary that customers can copy and paste when opening support cases. In-tree GlusterFS is removed from Kuberentes 1.27. Add storage validation to detect in-tree glusterFS volumes.
Metrics data are now gzip compressed when sending to Cloud Monitoring.
The stackdriver-log-forwarder (fluent-bit) now sends logs to Cloud Logging with gzip compression to reduce egress bandwidth needed.
Prometheus and Grafana are no longer bundled for in-cluster monitoring and they are replaced with Google Cloud Managed Service for Prometheus.
The following flags in the stackdriver custom resource are deprecated and changes to their values aren't honored:
scalableMonitoringenableStackdriverForApplications(replaced byenableGMPForApplicationsandenableCloudLoggingForApplications)enableCustomMetricsAdapter
Deploying the vSphere cloud controller manager in both admin and user clusters, and enabling it for admin and kubeception user clusters is now supported.
The audit-proxy now sends audit logs to Cloud Audit Logging with gzip compressed to reduce egress bandwidth needed.
Removed
accounts.google.comfrom the internet preflight check requirement.The pre-defined dashboards are automatically present based on the presence of metrics.
Enabled auto repair on ReadonlyFilesystem node condition
Support the
dcharacter when using--log-sinceflag to take cluster snapshot. For example:gkectl diagnose snapshot --log-since=1dA new CSI Workload preflight check was added to verify that workloads using vSphere PVs can work through CSI.
Preflight check failures for
gkectl preparenow block install and upgrade operations.The kubelet readonly port is now disabled by default for security enhancement. See Enable kubelet readonly port for instructions if you need to re-enable it for legacy reasons.
AIS Pods are now scheduled to run on control plane nodes instead of worker nodes.
The following issues are fixed in 1.16.0-gke.669:
- Fixed the known issue that caused intermittent ssh errors on non-HA admin master after update or upgrade.
- Fixed the known issue where upgrading enrolled admin cluster could fail due to membership update failure.
Fixed the issue where the CPv1 stackdriver operator had
--is-kubeception-less=truespecified by mistake.Fixed the issue where clusters used the non-high-availability (HA) Connect Agent after an upgrade to 1.15.
Fixed the known issue of Cloud Audit Logging failure due to permission denied.
Fixed a known issue where the update operation cannot be fulfilled due to KSA signing key version unmatched.
Fixed a known issue where $ in the private registry username caused admin control plane machine startup failure.
Fixed a known issue where
gkectl diagnose snapshotfailed to limit the time window forjournalctlcommands running on the cluster nodes when you take a cluster snapshot with the--log-sinceflag.Fixed a known issue where node ID verification failed to handle hostnames with dots.
Fixed continuous increase of logging agent memory.
Fixed the issue that caused
gcloudto fail to update the platform when therequired-platform-versionis already the current platform version.Fixed an issue where
cluster-api-controllersin a high-availability admin cluster had no Pod anti-affinity. This could allow the threeclusterapi-controllersPods not to be scheduled on different control-plane nodes.Fixed the wrong admin cluster resource link annotation key that can cause the cluster to be enrolled again by mistake.
Fixed a known issue where node pool creation failed because of duplicated VM-Host affinity rules.
The preflight check for StorageClass parameter validations now throws a warning instead of a failure on ignored parameters after CSI Migration. StorageClass parameter
diskformat=thinis now allowed and does not generate a warning.Fixed a false error message for
gkectl preparewhen using a high-availability admin cluster.Fixed an issue during the migration from the Seesaw load balancer to MetalLB that caused 'DeprecatedKubeception' always shows up in the diff.
Fixed a known issue where some cluster nodes couldn't access the HA control plane when the underlying network performs ARP suppression.
Removed unused Pod disruption budgets (such as
kube-apiserver-pdb,kube-controller-manager-pdb, andkube-etcd-pdb) for Controlplane V2 user clusters
The following vulnerabilities are fixed in 1.16.0-gke.669:
Critical container vulnerabilities:
High-severity container vulnerabilities:
Container-optimized OS vulnerabilities:
Windows vulnerabilities:
The following supported default parsers have changed. Each is listed by product name and log_type value, if applicable.
- Apigee (
GCP_APIGEE_X) - AppOmni (
APPOMNI) - Attivo Networks (
ATTIVO) - AWS Cloudtrail (
AWS_CLOUDTRAIL) - AWS CloudWatch (
AWS_CLOUDWATCH) - AWS GuardDuty (
GUARDDUTY) - AWS WAF (
AWS_WAF) - Blue Coat Proxy (
BLUECOAT_WEBPROXY) - Cisco Internetwork Operating System (
CISCO_IOS) - Cisco NX-OS (
CISCO_NX_OS) - Cisco Umbrella Web Proxy (
UMBRELLA_WEBPROXY) - CrowdStrike Falcon (
CS_EDR) - Crowdstrike IOC (
CROWDSTRIKE_IOC) - CyberArk Endpoint Privilege Manager (EPM) (
CYBERARK_EPM) - Elastic Windows Event Log Beats (
ELASTIC_WINLOGBEAT) - F5 Advanced Firewall Management (
F5_AFM) - GMAIL Logs (
GMAIL_LOGS) - iBoss Proxy (
IBOSS_WEBPROXY) - Ipswitch MOVEit Transfer (
IPSWITCH_MOVEIT_TRANSFER) - Juniper Junos (
JUNIPER_JUNOS) - Kubernetes Audit (
KUBERNETES_AUDIT) - Kubernetes Node (
KUBERNETES_NODE) - Microsoft AD FS (
ADFS) - Microsoft Defender For Cloud (
MICROSOFT_DEFENDER_CLOUD_ALERTS) - Microsoft Graph API Alerts (
MICROSOFT_GRAPH_ALERT) - Microsoft SQL Server (
MICROSOFT_SQL) - MISP Threat Intelligence (
MISP_IOC) - Netskope Web Proxy (
NETSKOPE_WEBPROXY) - Okta User Context (
OKTA_USER_CONTEXT) - Palo Alto Prisma Cloud Alert payload (
PAN_PRISMA_CA) - Peplink Firewall (
PEPLINK_FW) - Pulse Secure (
PULSE_SECURE_VPN) - Qualys Virtual Scanner (
QUALYS_VIRTUAL_SCANNER) - SecureLink (
SECURELINK) - Security Command Center Threat (
N/A) - Sentinelone Alerts (
SENTINELONE_ALERT) - Suricata IDS (
SURICATA_IDS) - Symantec DLP (
SYMANTEC_DLP) - Unix system (
NIX_SYSTEM) - Windows DNS (
WINDOWS_DNS) - Windows Event (
WINEVTLOG) - Windows Event (XML) (
WINEVTLOG_XML) - Workspace Activities (
WORKSPACE_ACTIVITY) - Zimperium (
ZIMPERIUM) - Zscaler Internet Access Audit Logs (
ZSCALER_INTERNET_ACCESS)
For details about changes in each parser, see Supported default parsers.
Cloud Spanner now supports integer sequences and bit reversal.
The SEQUENCE DDL statement generates unique, uniformly distributed integers as part of a primary key DEFAULT expression. For more information, see SEQUENCE (GoogleSQL, PostgreSQL).
The bit reverse function lets you map existing integer keys using the same logic as a bit-reversed sequence to avoid hotspotting. For more information, see BIT_REVERSE (GoogleSQL, PostgreSQL).
For overview information and scenarios for when to use these features, see Primary key default values management.
Cloud Spanner now supports generating a UUID (v4) as part of a table's primary key DEFAULT expression using the GENERATE_UUID function in GoogleSQL or generate_uuid() in PostgreSQL-dialect databases.
For overview information and scenarios for when to use this feature, see Primary key default values management.
The Storage Object User role (roles/storage.objectUser) is now available. This role allows you to create, view, list, update, and delete objects and their metadata, without granting access to the object's ACLs.
Fixed a Dataproc Serverless issue where Spark batches failed with unhelpful error messages.
Cloud Deploy support for deploy parameters is now generally available.
August 22, 2023
AlloyDB for PostgreSQLYou can now improve connection security by enforcing applications to connect to AlloyDB instances through AlloyDB connectors, such as the Auth Proxy.
You can now configure SSL enforcement mode to ensure that all database connections to an instance use SSL encryption.
Release 1.14.8
Anthos clusters on bare metal 1.14.8 is now available for download. To upgrade, see Upgrading Anthos on bare metal. Anthos clusters on bare metal 1.14.8 runs on Kubernetes 1.25.
Fixes:
The following container image security vulnerabilities have been fixed:
High-severity container vulnerabilities:
Medium-severity container vulnerabilities:
Low-severity container vulnerabilities:
Known issues:
For information about the latest known issues, see Anthos clusters on bare metal known issues in the Troubleshooting section.
Artifact Registry is now available in the europe-west10 region (Berlin, Germany).
Batch is available in the following regions:
asia-south2(Delhi)asia-southeast2(Jakarta)europe-southwest1(Madrid)me-central1(Doha)
For more information, see Locations.
BigQuery now allows you to create your own masking routines for your data. You can use the REGEX_REPLACE scalar function to create custom masking rules to obfuscate your sensitive data. This feature is currently in preview.
Budgets for project users now available (in preview)
Now project users in Google Cloud can create budgets and stay on top of their cloud spend, without needing additional permissions to access Cloud Billing accounts. Budgets for project users enables engineers to take ownership of their costs, plan for the spend in the projects that they own, and proactively manage cost exceptions.
Project Owners, Project Editors, and Project Viewers can view budgets that are scoped to individual projects. Project Owners and Editors can also create, modify and delete single-project budgets for the projects they have access to.
A new email notification option is available for budgets scoped to a single project: Email alerts to project owners. All other notification options are also available for single-project budgets.
Project users can use the Google Cloud console or the Cloud Billing Budget API to manage budgets for projects.
Cloud Composer 2 is now available in Dallas (us-south1), Santiago (southamerica-west1), Melbourne (australia-southeast2), and Madrid (europe-southwest1).
A release was made. Updates may include general performance improvements, bug fixes, and updates to the API reference documentation.
Dedicated Cloud Interconnect support is available in the following colocation facilities:
- Level(3) Berlin, Berlin
- NTT Berlin 1 Data Center (BER1), Berlin
For more information, see the Locations table.
Cloud KMS is available in the following region:
europe-west10
For more information, see Cloud KMS locations.
Cloud NAT support for Inter-VPC communications is in Preview.
The following new region is now available: europe-west10.
Support for europe-west10 (Berlin) region.
Support for europe-west10 (Berlin) region.
Support for europe-west10 (Berlin) region.
You can create Cloud Spanner regional instances in Berlin, Germany (europe-west10).
Cloud Storage is now available in Berlin, Germany (europe-west10 region).
Cloud VPN is now available in region europe-west10 (Berlin, Germany).
Pricing is available on the Cloud VPN pricing page.
Generally available: Berlin, Germany, Europe europe-west10-a,b,c has launched with E2, N2, N2D, and T2D VMs available in all three zones.
Dataflow is available in Berlin (europe-west10).
Dataform is compliant with SOC 2 and SOC 3.
For more information, see Dataform compliance.
Dataproc is now available in the europe-west10 region (Berlin).
The europe-west10 region in Berlin, Germany is now available.
Looker (Google Cloud core) now supports multiple private IP instances in a single Virtual Private Cloud (VPC) network.
On August 22, 2023 we released version 1.3.0 of the Migrate to Containers modernization plugins.
Learn how to Upgrade Migrate to Containers plugins.
The following changes have been made to the IBM WebSphere Application Server migration:
Renamed the plugin from
websphere-containertowebsphere-traditional-container. This plugin now supports WebSphere Application Server Traditional as a migration source.Added support for WebSphere Application Server Liberty as a target.
The
was-homeparameter is now mandatory.
The following changes have been made to the discovery parameters for the Tomcat plugin:
- The
java-versionparameter is now added as input to Tomcat migrations. - The
catalina-baseparameter can now include multiple directories delimited with colons (:). - The
java-version,catalina-baseandcatalina-homeparameters are now mandatory.
Linux system service endpoints are no longer automatically discovered and must be manually specified while customizing the Linux migration plan.
Pub/Sub is now available in europe-west10 (Berlin, Germany).
Secret Manager is now available in the following region:
- europe-west10
For more information, see Secret Manager locations.
Vertex AI custom training has launched persistent resources in Preview. A persistent resource is a long-running cluster of machines that you can use to run custom training jobs. Once created, the persistent resource remains available for future training jobs, so you don't have to wait for compute resources to be provisioned each time you want to train a model.
For auto mode VPC networks, added a new subnet 10.214.0.0/20 for the Berlin europe-west10 region. For more information, see Auto mode IP ranges.
August 21, 2023
Anthos Config ManagementThe constraint template library's GkeSpotVMTerminationGrace template adds the includePodOnSpotNodes parameter, which requires enabling referential constraints. For reference, see Constraint template library.
The Config Sync feature to sync directly from Helm repositories (including OCI-based ones) is generally available (GA). Google Artifact Registry is the preferred Helm registry. To learn more, see Sync Helm charts from Artifact Registry and Configuration for the Helm repository.
Policy Controller has been updated to include a more recent build of OPA Gatekeeper (hash: 616aa8f).
ExpansionTemplates APIs promoted to v1beta1.
Policy Controller add new bundles: nist-sp-800-190, nist-sp-800-53-r5, and nsa-cisa-k8s-v1.2. For reference, see Policy Controller bundles overview.
Added a new field spec.helm.valuesFileRefs in RootSync and RepoSync to allow specifying Helm values files in ConfigMaps. For reference, see Configuration for the Helm repository.
Added a new configsync.gke.io/deletion-propagation-policy annotation for use on RootSync and RepoSync, for configuring foreground cascading deletion as a preview feature. When set to Foreground, the resource objects managed by it will be deleted when the RootSync or RepoSync is deleted. To learn more, see Bulk delete objects.
The Helm chart version field spec.helm.version in RootSync and RepoSync can now be specified as a range of values from which Config Sync pulls the latest values. For reference see Configuration for the Helm repository.
Added the spec.override.logLevels field to RootSync and RepoSync, for configuring the log level of the containers of reconciler Pods. For more information, see RootSync and RepoSync fields and General best practices.
The constraint template library's K8sRequireDaemonsets template now supports restricting the use of NodeSelector in required Daemonset using the new restrictNodeSelector parameter. For reference, see Constraint template library.
Policy Controller bundles have been updated to the following versions: cis-k8s-v1.5.1: 202307.1, pci-dss-v3.2.1: 202307.0, policy-essentials-v2022: 202307.1, pss-baseline-v2022: 202307.0, pss-restricted-v2022: 202307.0. For reference, see Policy Controller bundles overview.
Upgraded bundled Kustomize version from v5.1.0 to v5.1.1 to pick up vulnerability fixes. To understand the changes in each release, review the changelogs.
Reduced the resource requirements for the reconciler Pod when no Kustomize rendering is needed. For information on resource requirements, see Resource requests.
Increased the default timeout for Kubernetes API requests from 5 seconds to 15 seconds. This allows more requests to succeed with fewer retries when the control plane is under load, and reduces the need to override the timeout with spec.override.apiServerTimeout in RootSync and RepoSync. To learn more, see Configuration for overriding the resource requests and limits of a root or namespace reconciler.
Fixed an issue causing Config Sync to prematurely stop tracking managed resource objects when pruning them before they are deleted from the cluster. Those objects will now appear in the Cloud Console and nomos status until the deletion has reconciled.
Fixed an issue preventing Config Sync from pruning managed resources correctly when the apiGroup of those resources is renamed in the source of truth.
Known Issue for Policy Controller: If you're using ExpansionTemplates and mutators, Policy Controller will not apply the mutators for the generated resources.
There is a memory issue in the reconciler due to the discovery client loading the OpenAPI for schema validations. The issue is only observed on Autopilot clusters with many CRDs installed. You can increase the memory request with the override.resources API. To learn more, see Configuration for overriding the resource requests and limits of a root or namespace reconciler.
Added the spec.configSync.metricsGcpServiceAccountEmail field to the gcloud apply spec fields to remove 2 manual steps required to export Config Sync metrics from a cluster with Workload Identity enabled to Cloud Monitoring. This note was updated on September 7, 2023.
Backup and DR Service 11.0.6.342 is now available to update your appliance. Refer to the instructions to update your appliance.
Backup and DR Service now supports roll back of hotfix updates. For more information, see Rollback a hotfix update.
Backup and DR Service now supports in-product notifications for important product updates.
Backup and DR Service now supports concurrent database and log backups. For more information, see Manage image expiration.
Pricing model for protecting Google Cloud VMware Engine workloads has been updated to a node based flat rate model. For more information, see pricing change announcement.
You can now scan tables to create data profiles and monitor data quality. These features help you better understand your data and ensure it is accurate and reliable. These features are generally available (GA).
A weekly digest of client library updates from across the Cloud SDK.
Node.js
Changes for @google-cloud/bigquery
7.2.0 (2023-08-17)
Features
Bug Fixes
- deps: Update dependency @google-cloud/common to v5 (#1253) (0cbfdcd)
- deps: Update dependency @google-cloud/paginator to v5 (#1254) (658ff1a)
- deps: Update dependency @google-cloud/precise-date to v4 (#1261) (7f12f7d)
- deps: Update dependency @google-cloud/promisify to v4 (#1252) (6f04f39)
- Manual update for renovate-bot google cloud storage v7 (#1262) (b58fc29)
Go
Changes for bigquery/storage/apiv1beta1
1.54.0 (2023-08-17)
Features
- bigquery/biglake: Start generating apiv1 and apiv1alpha1 (#8433) (916f779)
- bigquery/datatransfer: Add EncryptionConfiguration to TransferConfig (e3f8c89)
- bigquery/storage/managedwriter: Refine connection metrics (#8324) (54fcf36)
- bigquery/storage: Add beta2 deprecation message (b3dbdde)
- bigquery/storage: Add default_missing_value_interpretation field; indicate KMS_SERVICE_ERROR is retryable (b3dbdde)
- bigquery: Add ProjectID to JobIDConfig (#8405) (7fafd80)
Bug Fixes
- bigquery/datapolicies: Sync the new PredefinedEpxression types to the client library (fcb41cc)
- bigquery: Use JobFromProject for storage iterator (#8372) (bfbf18c)
Documentation
Analytics Hub now lets you manage subscriptions. The subscription resource stores relevant information about the subscriber and represents the connection between the shared resource and linked dataset. This feature is now in preview.
A weekly digest of client library updates from across the Cloud SDK.
We added a new BigQuery example that helps you join your Price and Detailed Cost Data exports, so that you can compare your costs with detailed information from your Pricing BigQuery export.
Internal passthrough Network Load Balancers can now be configured to handle private IPv6 traffic within your VPC. To enable this, you must configure your dual-stack subnet, backend VMs, health checks, and the forwarding rules to handle IPv6 traffic.
For details, see:
This feature is available in General Availability.
You can now view your query results as a chart in the Log Analytics page. For more information, see Chart query results with Log Analytics.
Identity and Access Management (IAM) deny policies can now include Cloud Logging permissions. For a list of Cloud Logging permissions that are supported by deny policies, see Permissions supported in deny policies.
A weekly digest of client library updates from across the Cloud SDK.
Go
Changes for logging/apiv2
1.8.1 (2023-08-14)
Bug Fixes
You can now add pie charts to your custom dashboards. Support for pie charts is in public preview. For information when using the Cloud Console, see Graph the most recent data with a pie chart. For information about using the API, see Dashboard with a PieChart widget.
Observability for Google Kubernetes Engine: The Observability tab for each of your GKE clusters now includes filters for recommended and configured integrations. To see the recommended integrations for your cluster, select Integrations > Overview. To see the integrations configured for your cluster, select Integrations > Configured.
Private Service Connect is now GA for Cloud SQL for MySQL. This solution allows you to connect to a Cloud SQL instance from multiple VPC networks that belong to different groups, teams, projects, or organizations.
Private Service Connect is now GA for Cloud SQL for PostgreSQL. This solution allows you to connect to a Cloud SQL instance from multiple VPC networks that belong to different groups, teams, projects, or organizations.
Spanner Studio enhances the Spanner query editor in the Google Cloud console, with full support for SQL, DML, and DDL operations. The Spanner Studio also features the Explorer (in Preview) which lets you interactively browse, query, and modify your database. For more information, see Manage your data using the Google Cloud console.
Generally available: When a managed instance group (MIG) repairs a failed or an unhealthy VM, you can apply the latest instance template and per-instance configuration to recreate the VM instead of applying the configuration originally used to create the VM. For more information, see Apply configuration updates during repairs.
Generally available: Hyperdisk Throughput is now available in the following additional regions and zones:
- Council Bluffs, Iowa:
us-central1 - Moncks Corner, South Carolina:
us-east1 - Ashburn, Virginia:
us-east4-b, c - Eemshaven, Netherlands:
europe-west4-a, c - Jurong West, Singapore:
asia-southeast1 - Mumbai, India:
asia-south1-a
Config Connector version 1.108.0 is now available.
Added support for customization on cnrm-unmanaged-detector pods resource requests/limits.
Added support for customization on cnrm-controller-manager pods resource requests/limits in namespaced mode.
Added support for BigQueryReservationCapacityCommitment resource(v1alpha1).
Resource BigQueryDataset(v1beta1):
- Added
spec.storageBillingModelfield.
Resource BigQueryTable(v1beta1):
- Added
spec.externalDataConfiguration.jsonOptionsfield. - Added
spec.externalDataConfiguration.metadataCacheModefield. - Added
spec.externalDataConfiguration.objectMetadatafield. - Added
spec.externalDataConfiguration.parquetOptionsfield.
Resource BigtableTable(v1beta1):
- Added
spec.changeStreamRetentionfield.
Resource CertificateManagerCertificate(v1alpha1):
- Added
spec.managed.issuanceConfigfield.
Resource CloudFunctions2Function(v1alpha1):
- Added
status.urlfield.
Resource ComputeDisk(v1beta1):
- Added
spec.enableConfidentialComputefield. - Added
spec.provisionedThroughputfield.
Resource ComputeExternalVPNGateway(v1beta1):
- Added
status.labelFingerprintfield.
Resource ComputeForwardingRule(v1beta1):
- Added
spec.noAutomateDnsZonefield.
Resource ComputeInstance(v1beta1):
- Added
spec.paramsfield. - Added
spec.bootDisk.initializeParams.resourceManagerTagsfield.
Resource ComputeInstanceTemplate(v1beta1):
- Added
spec.networkInterface.items.networkAttachmentfield.
Resource ComputeTargetHTTPProxy(v1beta1):
- Added
spec.httpKeepAliveTimeoutSecfield.
Resource ComputeTargetHTTPSProxy(v1beta1):
- Added
spec.httpKeepAliveTimeoutSecfield.
Resource ComputeURLMap(v1beta1):
- Added
spec.pathMatcher.items.routeRules.items.matchRules.items.pathTemplateMatchfield. - Added
spec.pathMatcher.items.routeRules.items.routeAction.urlRewrite.pathTemplateRewritefield.
Resource ContainerCluster(v1beta1):
- Added
spec.nodeConfig.guestAccelerator.items.gpuDriverInstallationConfigfield. - Added
spec.nodeConfig.soleTenantConfigfield. - Added
spec.securityPostureConfigfield.
Resource ContainerNodePool(v1beta1):
- Added
spec.nodeConfig.guestAccelerator.items.gpuDriverInstallationConfigfield. - Added
spec.nodeConfig.soleTenantConfigfield. - Added
spec.placementPolicy.tpuTopologyfield.
Resource DataformRepository(v1alpha1):
- Added
spec.workspaceCompilationOverridesfield.
Resource GKEBackupBackupPlan(v1alpha1):
- Added
status.statefield. - Added
status.stateReasonfield.
Resource HealthcareFHIRStore(v1alpha1):
- Added
spec.complexDataTypeReferenceParsingfield.
Resource RedisInstance(v1beta1):
- Added
status.maintenanceSchedulefield.
Resource RunJob(v1beta1):
- Added
spec.annotationsfield. - Added
spec.template.annotationsfield.
Resource SQLInstance(v1beta1):
- Added
spec.settings.dataCacheConfigfield. - Added
spec.settings.editionfield.
Resource VertexAIFeaturestoreEntityTypeFeature(v1alpha1):
- Added
status.regionfield.
Resource VertexAIIndex(v1alpha1):
- Added
spec.metadata.config.shardSizefield.
UCaaS: MS Teams Integration: CCAI Platform now supports UCaaS integration capabilities. This integration allows you to seamlessly configure MS Teams users and teams directly within CCAIP. You can enjoy the advanced routing capabilities of CCAIP while taking calls in MS teams. Typical supported use cases include:
- The ability to transfer calls between CCAIP and MS Teams agents.
- Automatically routing calls to MS Teams agents or groups.
- Assigning any MS Teams users to queues.
- Ability to assign CCAIP and MS Teams users as part of Cascade groups.
In Add/Edit User menus, you will see an option for enabling UCaaS as well as integration settings in Developer Settings. Enabling this option allows users who only occasionally assist with customer support to take those calls using their principal UCaaS communication platform. For details, see the Microsoft Teams integration guide
Data Restriction for Historical/Downloadable Reports: New permission for the Session Data report with the supervisory ability to restrict editing permissions. Also, the permissions for the downloadable reports under Agents & Teams, Calls & Chats, Queues, and Campaigns now have the option to restrict the corresponding data to assigned teams only or assigned queues only.
Session Variable: Enable Agent ID as a dynamic parameter: We have introduced a change to dynamically include the agent ID as a session variable in automated messages and chat shortcuts. This allows an agent to send an outbound SMS to a consumer containing a deep link to a mobile app with our SDK embedded. The deep link contains the agent ID, which will trigger a DAP to a dedicated queue for that agent with a DAP value also reflecting that agent's ID. Scope extends to these channels: SMS messages, Mobile chat, Wed SDK chat, Chat shortcuts.
Headless web SDK: CCAIP Platform now supports a new Headless Web SDK, designed to empower you to build a fully customized and branded web support experience.
The Headless Web SDK comes equipped with a comprehensive API suite, providing you with the tools to leverage familiar Web SDK features and tailor the UI to suit your specific needs. Every detail, from colors and fonts to layouts and interactions, can be tailored to create a cohesive and engaging interface that resonates with your audience.
Mobile SDK 2.1: UI Customizations: The latest release of our Mobile SDK chat gives you even more customization options to tailor the UI to your specific branding needs. You can take full control of the appearance and style of elements within the chat interface. Some items that can be fully customized:
- Agent and consumer message bubbles.
- Menu bar (including the back and end chat buttons).
- End Chat button.
- Send button.
- Message tray.
- Time stamps.
Depending on the component, you have the flexibility to customize attributes such as the font, background color, icon, (and more!) to create a chat experience tailored to your brand. See the iOS and Android SDK guides for details.
Distinct Queue Names for the Alvaria Data Exporter: You now have the ability to repeat names across multiple different queue-paths. Queue will appear in Alvaria as Queue Name - language code - ID, allowing customers to easily identify which metrics correspond to what queue.
Fallback IVR: Additional Settings for Fallback Destination: New IVR fallback options for when a consumer fails to select a queue during IVR navigation. New options are available globally as well as at the queue level. Additional options include:
- Select the last available menu to route consumers to the last queue in the IVR menu.
- Select a specific menu to route consumers to any queue in the IVR menu.
The configuration options are available at the global level (Call > Call Details > Fallback IVR Navigation).
New dynamic parameter support for SIP redirect and Dialogflow: New dynamic parameters to enhance the capabilities of SIP Redirect and Dialogflow. With these additions, you can now leverage valuable real-time information during call routing and Dialogflow sessions. The new dynamic parameters include DNIS / TFN (the number the user dialed), Latest Agent ID, Latest Agent Email, Queue Language, Latest Sentiment Score, and Overall Sentiment Score.
Improved Outbound SMS API: Agents can now initiate outbound SMS sessions with number pairs that were previously engaged by other agents. This enhancement allows for seamless continuation with consumers, even if the number pair was recently used by a different agent. Agents can send appointment requests, SMS follow-ups, and other SMS messages without encountering errors.
Custom POST Events (also known as custom JavaScript events): This feature allows you to listen for events happening within CCAIP and take action accordingly. For example, when a call is transferred you could use your own JavaScript code to listen for a call_transferred event and specify actions based on the provided parameters (such as updating the destination agent's screen). These events give you more control over your workflows and allow for seamless integration with your business processes. With this release we are extending the existing mechanism of transmitting post events with 3 new events:
- Transfer
- Add Party
- Agent connects to session
- VA session data: We are capturing VA session data in the payload during a consumer interaction. This means alongside the existing event data, you will now have access to virtual agent session specific variables.
In addition, we're including:
- The
agent_custom_idparameter in theAgent_Loginevent. - Custom SIP headers in incoming SIP calls within the POST events.
See the custom CRM documentation for details.
Call Adapter: Improved Error Codes and Messages: We have improved our Call Adapter's error messages with more detailed content, including error codes and explanations.
DAP: Additional Format: Previously limited to E164 formatted numbers, we now support the input of SIP phone numbers in the incoming sip address format: sip:[number]@[domain].
Skip Cascade Group Timer: Improved functionality of our call and chat deltacast routing. We have introduced the Skip Cascade Group Timer setting, which allows you to bypass the cascade timer settings and route a call or chat to the next available agent, regardless of the cascade group. The setting is located in Operations Management > Deltacast settings.
Call Handling: Hold Music During Connection: CCAI Platform has enhanced the call handling experience for end-users by ensuring a smoother transition when connecting with an agent. Instead of experiencing hold music followed by delays or silence, end-users will now enjoy uninterrupted music until the agent joins the call. Additionally, agents will be notified with a distinct sound when an end-user joins the call.
RabbitMQ persistent storage: A new messaging infrastructure to allow applications to communicate with each other and offload job processing. The messaging infrastructure has been architected in a manner so that a wide variety of application use cases can be supported in the future.
Call Session Events Generator and Sender: These applications are deployed when you enable the Call Session Events feature. The operators receive Call Events from ujet-server and process them before sending to your configured endpoints. Ujet-server, Generator and Sender all use RabbitMQ infrastructure to send messages.
NICE QM Integration: CCAIP now supports an out-of-the-box data export for NICE QM. You can enable it in Developer Settings > Session Data Export > NICE Integration. You must enter the following information to enable the NICE QM data export:
- NICE API Endpoint
- API Authentication credentials
iOS:
- Fixed an issue where using a DAP to route to a queue that was After Hours could lead to consumers being stuck in a loop.
- Fixed an intermittent issue where a SmartActions request would cause the app to crash.
- Fixed an intermittent issue where the SDK credentials would not authenticate.
- Fixed an issue where the app would crash when hold music was played to the end-user.
Android:
- Fixed an issue where using a DAP to route to a queue that was After Hours could lead to consumers being stuck in a loop.
- Fixed an issue where the signed custom payload data was not triggered for calls and chats.
Web SDK:
- Fixed an issue where the Co-browse session sometimes would not connect due to the end-user having multiple tabs open.
- Fixed an issue where end-users could sometimes get stuck on the After Hours screen, unable to start a new chat.
- Fixed an issue where a DAP was sometimes not maintained after the previous chat timed out.
Fixed an issue where if a trailing "/" was added to the folder path for Google Cloud Storage upload settings, the files were written to a folder with no name. A safeguard has been added both in backend and frontend to remove any trailing slashes.
Billing Service Fixes: Resolved two different incident tickets relating to the billing service; one edge case whereby agents were erroneously being counted as online and other that caused the billing service to temporarily incorrectly aggregate data.
cos-dev-113-17833-0-0
| Kernel | Docker | Containerd | GPU Drivers |
| COS-6.1.43 | v24.0.5 | v1.7.3 | v535.54.03(default),v470.199.02(R470) |
Updated app-containers/docker-cli to 24.0.5.
Updated app-containers/docker to 24.0.5.
Update cos-gpu-installer to v2.1.4. This fixes a permissions issue in the GPU driver install directory with OSS drivers.
Upgraded app-editors/vim and app-editors/vim-core to v9.0.1678.
Upgraded net-libs/gnutls to v3.8.1-r1.
Upgraded app-misc/jq to v1.7_rc1.
Upgraded app-arch/xz-utils to v5.4.4.
Updated dev-go/yaml to v3.0.1. This resolves CVE-2022-28948.
Updated dev-libs/openssl to v3.0.10. This resolves CVE-2023-3817.
Fixed CVE-2023-4194 in the Linux kernel.
cos-105-17412-156-23
| Kernel | Docker | Containerd | GPU Drivers |
| COS-5.15.120 | v23.0.3 | v1.7.2 | v470.199.02(default),v525.125.06 |
Simplified GPU driver installation by remounting the driver installation path as executable from cos-extensions.
Fixed an issue in systemd where a container out-of-memory event caused all processes in the container to be killed.
Updated dev-libs/openssl to v1.1.1v. This resolves CVE-2023-3817.
Upgrade app-misc/jq to v1.7_pre20201109-r1. This fixes CVE-2016-4074.
Fixed CVE-2023-4147 in the Linux kernel.
Fixed CVE-2023-4194 in the Linux kernel.
cos-beta-109-17800-0-13
| Kernel | Docker | Containerd | GPU Drivers |
| COS-6.1.42 | v24.0.5 | v1.7.2 | v535.54.03(default),v470.199.02(R470) |
Updated app-containers/docker-cli to 24.0.5.
Updated app-containers/docker to 24.0.5.
Updated dev-go/yaml to v3.0.1. This resolves CVE-2022-28948.
Updated dev-libs/openssl to v3.0.10. This resolves CVE-2023-3817.
Fixed CVE-2023-4147 in the Linux kernel.
Fixed CVE-2023-4194 in the Linux kernel.
cos-93-16623-461-15
| Kernel | Docker | Containerd | GPU Drivers |
| COS-5.10.177 | v20.10.24 | v1.6.20 | v450.248.02(default),v470.199.02(R470),v525.125.06 |
Simplified GPU driver installation by remounting the driver installation path as executable from cos-extensions.
Updated dev-libs/openssl to v1.1.1v. This resolves CVE-2023-3817.
Upgrade app-misc/jq to v1.7_pre20201109-r1. This fixes CVE-2016-4074.
Fixed CVE-2023-4147 in the Linux kernel.
Fixed CVE-2023-4194 in the Linux kernel.
cos-97-16919-353-23
| Kernel | Docker | Containerd | GPU Drivers |
| COS-5.10.186 | v20.10.24 | v1.6.21 | v470.199.02(default),v525.125.06 |
Simplified GPU driver installation by remounting the driver installation path as executable from cos-extensions.
Updated dev-libs/openssl to v1.1.1v. This resolves CVE-2023-3817.
Upgrade app-misc/jq to v1.7_pre20201109-r1. This fixes CVE-2016-4074.
Fixed CVE-2023-4147 in the Linux kernel.
Fixed CVE-2023-4194 in the Linux kernel.
cos-101-17162-279-24
| Kernel | Docker | Containerd | GPU Drivers |
| COS-5.15.120 | v20.10.24 | v1.6.21 | v470.199.02(default),v525.125.06 |
Updated dev-libs/openssl to v1.1.1v. This resolves CVE-2023-3817.
Fixed CVE-2018-14647 in the dev-lang/python package.
Fixed CVE-2018-1000802 in the dev-lang/python package
Upgrade app-misc/jq to v1.7_pre20201109-r1. This fixes CVE-2016-4074.
Fixed CVE-2023-4194 in the Linux kernel.
Dataplex automatic data quality and data profiling are generally available.
- Data profiling
- Jump start your data analytics with statistical insights, such as average values, unique values, data bounds, and top-N.
- Understand drifts and build anomaly models with the generated metadata.
- Publish data quality and data profiling information in the BigQuery console. Learn more.
- Profile data in BigQuery tables, views, BigLake, and external tables.
- Ease deployment through a managed, serverless, and zero-copy execution.
- Take advantage of advanced features like filtering, sampling, and saving results to a central BigQuery table.
- Automatic data quality
- Deliver trusted data by building an end-to-end data quality monitoring pipeline.
- View rule recommendations, enhance with business rules, monitor on a routine or in a pipeline, generate reports, get alerted on failures, and troubleshoot the issues.
- View quality information in the BigQuery UI for every table user to see. Learn more.
- Improve data quality in BigQuery tables, views, BigLake, and external tables.
- Ease deployment through managed, serverless, and zero-copy execution.
- Take advantage of advanced features like filtering, sampling, and saving results to a central BigQuery table.
Adaptive Protection suggested rules can now be deployed automatically in General Availability. For more information, see Automatically deploy Adaptive Protection suggested rules.
A weekly digest of client library updates from across the Cloud SDK.
Node.js
Changes for @google-cloud/pubsub
4.0.1 (2023-08-11)
Bug Fixes
Python
Changes for google-cloud-pubsub
2.18.3 (2023-08-18)
Bug Fixes
inIpRange() function released to General Availability
You can now specify a range of IP addresses by using the inIpRange() function in query statements to filter findings that contain IPv4 or IPv6 addresses within the specified range.
For more information, see The inIpRange function.
August 18, 2023
Certificate ManagerCertificate Manager now supports integration with regional external Application Load Balancers and regional internal Application Load Balancers. This is a public preview feature. For more information, see Certificate Manager overview.
The following resource types are now publicly available through the analyze policy APIs (AnalyzeIamPolicy and AnalyzeIamPolicyLongrunning).
Cloud Build now generates provenance attestations that meet Supply-chain Levels for Software Artifacts (SLSA) v1.0 specifications. Build provenance is a verifiable collection of metadata that you can use to audit builds and safeguard deployments.
This feature is in Preview. Builds triggered by repository events such as pushes or pull requests will generate the v1.0 provenance.
Learn how to use build provenance in Cloud Build.
Pub/Sub notifications for DICOM store bulk import is generally available (GA).
Cloud Monitoring is ending support for the ingestion of AWS CloudWatch metrics in AWS connector projects. This is a breaking change. For information about this deprecation, see Deprecations: AWS CloudWatch metrics in Connector projects.
You can continue to collect AWS CloudWatch metrics by using the open source Prometheus CloudWatch exporter and the Ops Agent. For information about migrating to this solution, see Collect AWS CloudWatch metrics by using the Prometheus CloudWatch exporter.
Cloud SQL Enterprise Plus edition now supports four new regions:
- europe-central2 (Warsaw)
- europe-west9 (Paris)
- southamerica-east1 (San Paulo)
- us-west1 (Oregon)
Cloud SQL for MySQL now supports minor version 8.0.34. To upgrade your existing instance to the new version, see Upgrade the database minor version.
Cloud SQL Enterprise Plus edition now supports four new regions:
- europe-central2 (Warsaw)
- europe-west9 (Paris)
- southamerica-east1 (San Paulo)
- us-west1 (Oregon)
VPC Service Controls support for Cloud Scheduler jobs with the following targets is now in GA:
- Cloud Functions
- Cloud Run
- Dataflow API
- Data Pipelines
To learn more, see the documentation on how to secure cron jobs with VPC Service Controls.
Support for Cloud Scheduler to call the following resources internally is in GA:
- Cloud Functions
- Cloud Run
SSH authentication for GitHub, GitLab, and Bitbucket Cloud repositories is supported.
Expense processor
A new RC version pretrained-expense-v1.3.1-2023-08-11 of the Expense processor is now available in the asia-southeast1 region for Expense Parser customers.
This release includes an improved region-based normalization, which results in an average improvement of up to a 15% accuracy on normalized date and currency entities over the current stable version.
Enterprise Search: Multi-turn, conversational search UI
Multi-turn, conversational search from within the Google Cloud console is available in preview.
For information, see Configure search results for unstructured data and Search with multi-turn.
Enterprise Search: Languages
Search results and snippets are supported in:
- Danish (
da-DK) - Dutch (
nl-NL) - Hindi (
hi-IN) - Portuguese (
pt-BR) - Swedish (
sv-SE)
Search results and snippets are also supported in English (en-US), French (fr-FR), Spanish (es-ES), German (de-DE), and Italian (it-IT).
For more information, see Languages.
Looker (Google Cloud core) instances will be receiving Looker 23.12 and Looker 23.14 changes simultaneously, during the Looker 23.14 release. See the Looker (Google Cloud core) and Looker (original) changes section of the 23.14 release notes for deployment dates.
New SAP NetWeaver certification: N1 machine types on the Intel Skylake platform
For use with SAP NetWeaver, SAP has certified the Compute Engine N1 machine types that have 64 vCPUs or lower, with the Intel Skylake CPU platform.
For more information, see N1 general-purpose machine types.
The Vertex AI Matching Engine public endpoint is now generally available (GA). For information about how to get started, see Matching Engine Setup.
August 17, 2023
Anthos clusters on VMwareAnthos clusters on VMware 1.14.7-gke.42 is now available. To upgrade, see Upgrading Anthos clusters on VMware. Anthos clusters on VMware 1.14.7-gke.42 runs on Kubernetes 1.25.10-gke.2100.
Upgraded VMware vSphere Container Storage Plug-in from 2.7.0 to 2.7.2.
The following issues are fixed in 1.14.7-gke.42:
- Fixed a known issue that admin SSH public key has error after admin cluster upgrade or update.
- Fixed a known issue that GARP reply sent by Seesaw doesn't set target IP.
- Fixed an issue that
/etc/vsphere/certificate/ca.crtwas not updated after vsphere CA rotation on the Controlplane v2 user cluster control plane machines. - Fixed an issue that the CPv1 stackdriver operator had
--is-kubeception-less=truespecified by mistake.
The following vulnerabilities are fixed in 1.14.7-gke.42:
High-severity container vulnerabilities:
Container-optimized OS vulnerabilities:
Ubuntu vulnerabilities:
Windows vulnerabilities:
Batch is enforcing a 60-day retention policy for all finished (failed or succeeded) jobs:
Any existing jobs that have finished before August 17, 2023 are automatically deleted 60 days after, on October 16, 2023.
All new and existing jobs that are not yet finished on August 17, 2023 are automatically deleted 60 days after they finish running.
If you need to retain the information for a job for more than 60 days, you can export the job. For more information, see Delete and export jobs.
You can now replicate a dataset from the source region to one or more other regions with cross-region dataset replication. This feature is now in preview.
You can now create a copy of a Cloud Bigtable backup and store it in any project or region where you have a Bigtable instance. This feature is generally available (GA). To learn more, see About Bigtable backups.
The improved dashboard building experience is now GA:
- Improved the performance
- Simplified the layout and expanded the configurable settings
- Improved the widget drag and drop experience
- Enhanced the text widget
- Unified the chart-configuration experience between dashboards and the Metrics Explorer
For more information, see Add charts and tables to a custom dashboard.
Version 2.38.0 of the Ops Agent provides GA support for NVIDIA GPU metrics, including metrics reported from the NVIDIA Management Library (NVML) and the Data Center GPU Manager (DCGM).
NVML metrics are collected automatically if you have installed the NVIDIA Management Library. For more information, see Configure the Ops Agent. DGCM metrics are available as a third-party integration. For information about configuring the integration, see NVIDIA Data Center GPU Manager.
You can now re-encrypt an existing Cloud SQL CMEK-enabled primary instance or replica with a new primary key version.
You can now retain up to 35 days of retention logs for your Cloud SQL for MySQL Enterprise Plus edition instances when using point-in-time recovery.
Cloud SQL for MySQL now supports storage of point-in-time recovery logs in Cloud storage.
You can now re-encrypt an existing Cloud SQL CMEK-enabled primary instance or replica with a new primary key version.
You can now re-encrypt an existing Cloud SQL CMEK-enabled primary instance or replica with a new primary key version.
Cloud Spanner Data Boost is now available in all regions. For information about Data Boost, see Data Boost overview.
Generally available: The Ops Agent (version 2.38.0 and later) now supports the automatic tracking of GPU usage metrics reported from the NVIDIA Management Library (NVML) for Linux virtual machine instances that have attached NVIDIA GPUs.
Through an available integration with NVIDIA's Data Center GPU Manager (DCGM), you can also track metrics such as Streaming Multiprocessor (SM) block utilization, SM occupancy, SM pipe utilization, PCIe traffic rate, and NVLink traffic rate.
For more information, see Monitoring GPU performance on Linux VMs.
New Dataproc on Compute Engine subminor image versions:
- 2.0.74-debian10, 2.0.74-rocky8, 2.0.74-ubuntu18
- 2.1.22-debian11, 2.1.22-rocky8, 2.1.22-ubuntu20, 2.1.22-ubuntu20-arm
New Dataproc Serverless for Spark runtime versions:
- 1.1.28
- 2.0.36
- 2.1.15
Backported the patches for HIVE-20618 in the new Dataproc on Compute Engine 2.0 and 2.1 images.
You can now easily identify clusters that use deprecated Kubernetes APIs removed in versions 1.25, 1.26, and 1.27. Kubernetes deprecation insights are now available for these versions.
Generally available: Workload Manager introduces new rules for SAP workloads that help you evaluate the workload against the security best practices from SAP and Google Cloud. For more information, see Best practices for SAP.
For information about setting up Google Cloud's Agent for SAP to collect security validation metrics, see Enable Workload Manager validation metrics collection.
August 16, 2023
AlloyDB for PostgreSQLInstance machine-type configuration has added an option for 96 vCPUs and 768 GB of RAM per node.
AlloyDB now offers committed use discounts (CUDs) that provide 25% or 52% discount on AlloyDB's compute resources in exchange for your commitment, and you can continuously use them for one- or three-year terms, respectively.
Release 1.15.4
Anthos clusters on bare metal 1.15.4 is now available for download. To upgrade, see Upgrading Anthos on bare metal. Anthos clusters on bare metal 1.15.4 runs on Kubernetes 1.26.
Functionality changes:
Audit logs are compressed on the wire for Cloud Audit Logs consumption, reducing egress bandwidth by approximately 60%.
Upgraded local volume provisioner to v2.5.0.
Upgraded snapshot controller to v5.0.1.
Deprecated v1beta1 volume snapshot custom resources. Anthos clusters on bare metal will stop serving v1beta1 resources in a future release.
Fixes:
- Fixed an issue for clusters configured with manual load balancing where CA rotation reported that there were no (
0) control plane nodes.
Fixes:
The following container image security vulnerabilities have been fixed:
- High-severity container vulnerabilities:
- Medium-severity container vulnerabilities:
- Low-severity container vulnerabilities:
Known issues:
For information about the latest known issues, see Anthos clusters on bare metal known issues in the Troubleshooting section.
Artifact Registry remote repositories for OS packages are now in Preview.
A remote repository stores artifacts from external sources such as Docker Hub, Maven Central, the Python Package Index (PyPI), Debian or CentOS. A remote repository acts as a proxy for the external source to enable more control over external dependencies.
For more information on which public OS package repositories are supported by Artifact Registry remote repositories, see OS packages supported upstreams. To create a remote repository for OS packages, see Create remote repositories.
Chronicle has updated Rules Engine's YARA-L 2.0 language to support float literals. For more information, see Literals.
Enhancements to strings.concat and strings.coalesce
strings.concathas been updated to take an unlimited number of arguments. For more information, see Concatenate strings or numeric types.strings.coalescehas been updated to take an unlimited number of arguments. For more information, see Coalesce string values.
Release Notes 6.2.33
New Case Mentions in Playbook Actions
You can now mention the case assignee directly from a Playbook action
To mention the case assignee:
- Drag the Siemplify Case Comment action into a Playbook step.
- In the Comment field, write a message that you want the case assignee to see.
- Click on the placeholder, drill down to Case > case.mentioncaseassignee and double click it in order for it to appear in the Comment field with the message. Alternatively, write [case.mentioncaseassignee] in the Comment field.
After the Playbook runs, the notification is written to the case wall and depending on your notification settings, sent to the user.
Fixed an issue where changing the environment size didn't modify the Redis component size properly.
Fixed an issue where data lineage for BigQueryInsertJobOperator was reported to the incorrect target object in cases where Airflow tasks were running in parallel.
The apache-airflow-providers-google package is upgraded to version 10.5.0 in images with Airflow 2.5.3 and 2.4.3. For more information about changes, see the apache-airflow-providers-google changelog from version 10.3.0 to version 10.5.0.
Cloud Composer 2.4.1 images are available:
- composer-2.4.1-airflow-2.5.3 (default)
- composer-2.4.1-airflow-2.4.3
Cloud Composer versions 2.0.24, 2.0.23, 1.19.7, and 1.19.6 have reached their end of full support period.
Cloud Functions now supports pre-deployment testing in the Google Cloud console at the Preview release level.
The following changes have been made to the Google Cloud console:
- Firewall rules has moved to Network security > Firewall policies.
- SSL policies has moved to Network services > SSL policies.
The behavior of simple text searches as changed. To improve the performance, the Search function is automatically invoked when you don't wrap the search terms in double quotes.
Observability for Google Kubernetes Engine: You can now enable a curated set of kube state metrics from the Observability tab for your GKE cluster. You can also preview the available charts and metrics before you enable the metrics. For more information, see Package: Kube state metrics.
You can now troubleshoot GKE issues involving CPU and memory utilization by using the new "interactive playbook" dashboards in Cloud Monitoring. You can access these playbook dashboards from the Dashboards list and from the Incident details page associated with alerts you've set up for CPU utilization or memory utilization.
Dialogflow CX now supports past, future, and partial date and time values for ambiguous end-user inputs matched to @sys.date, @sys.date-time, and @sys.time system entities.
Eventarc support for direct events from Cloud IoT is retired from August 16, 2023.
GKE Infrastructure Dashboards and Metrics Packages are now available for both GKE Autopilot and Standard clusters with control plane version 1.27.2-gke.1200 and later. You can now configure Autopilot or Standard clusters to export a predefined list of metrics emitted by GKE managed KSM (kube-state-metrics) for workloads state and Persistent Storage. These metrics are collected by Google Cloud Managed Service for Prometheus and are sent to Cloud Monitoring. You can also view new dashboards (Persistent and Workloads state) rendering those metrics in the Observability tab. For more information, see View observability metrics.
You can now troubleshoot issues with CPU limit utilization and Memory limit utilization of containers running in GKE by using the new "interactive playbook" dashboards in Cloud Monitoring.
Added the following changes and feature support:
- IAM Authentication is supported.
- Added client library code samples.
- Enabled billing. For more details, see pricing.
Preview release of Memorystore for Redis Cluster.
PD Async Replication support
For cross-region active-passive disaster recovery for SAP HANA and SAP NetWeaver, Persistent Disk Asynchronous Replication (PD Async Replication) is supported. You can use PD Async Replication with balanced persistent disks and SSD persistent disks up to a maximum size of 2 TB per volume in supported region pairs.
For more information, see:
- SAP HANA: Persistent disk storage
- SAP NetWeaver: Persistent disk storage
New assets experience released to General Availability
The Security Command Center Assets page in the Cloud console is now powered by Cloud Asset Inventory. The new Assets page provides expanded asset visibility and includes a new asset query feature.
This release is part of the planned deprecation of the Security Command Center Assets API scheduled for on or after June 20, 2024.
For more information, see Assets page.
reCAPTCHA Enterprise Mobile SDK v18.3.0 is now available for Android.
This version is compiled with Kotlin 1.9.0 and contains the bug fix for better regional support of end-users. For information about the issue, see the platform exception error.
reCAPTCHA Enterprise Mobile SDK v18.3.0 is now available for iOS.
This version contains the following changes:
- The SDK is now built with Xcode 14.2. It requires Xcode 14.2 or later.
- Bug fix for better regional support of end-users. For information, see the platform exception error.
- Documentation update of
RecaptchaErrorin the API reference documentation.
August 15, 2023
Apigee XOn August 15, 2023, we released an updated version of Apigee X (1-11-0-apigee-1).
| Bug ID | Description |
|---|---|
| 155498623 | XPaths in maskconfigs now mask values with special characters. |
| 291746838 | Implemented fix to prevents service callouts from overwriting timeouts on clients used by other policies or target endpoints. |
| 274663992 | Fixed issue in AccessControl policy to avoid race condition. |
| 294441215 | Implemented fix to resolve quota count in the Quota policy. |
| 287659763 | Fixed issue resulting causing incorrect target endpoint URLs to display in debug sessions. |
| 283285631 | Fixed issue where base environment debug sessions were not recorded for Pay-as-you-go (updated attributes) organizations. |
| 196216798 | Fixed issue with access to monetization flow variables in the post client flow. |
| N/A | Upgraded infrastructure and libraries. |
| Bug ID | Description |
|---|---|
| 281112632, 294892189 | Security fix for apigee-runtime. This addresses the following vulnerability: |
| 294891556 | Security fix for apigee-emulator, apigee-mock-server, and apigee-runtime. This addresses the following vulnerability: |
| 287207717 | Fixed sandbox bypass vulnerability. |
| 286993631 | Fixed message template injection vulnerability. |
Regional Application Load Balancers and regional proxy Network Load Balancers now support load balancing traffic to external backends outside Google Cloud. To define an external backend for a load balancer, you use a regional internet network endpoint group (NEG).
For details, see the following:
- Internet NEG concepts
- Set up a regional internal Application Load Balancer with an external backend
- Set up a regional internal proxy Network Load Balancer with an external backend
This capability is in Preview.
Cloud Spanner now lets you check the progress on long-running operations, such as backups, restores, and schema updates. This feature is generally available (GA). For more information, see Check the progress of a long-running schema update operation and Check the progress of a long-running backup or restore operation.
The JetBrains PyCharm Professional preconfigured base image uses Python version 3.8 as the default for python, python3, pip, and pip3. However, Python version 3.10 remains available.
You can now update streaming job options without stopping your job. For more information, see In-flight job option update.
Dataflow cost monitoring is generally available (GA).
Added support for RDB Snapshots for the M5 capacity tier.
You can now view allow rules that are less likely to be active based on usage
patterns and adaptive analysis. For more information, see Allow rules that are obsolete based on adaptive analysis.
General availability support for the following integration:
August 14, 2023
Apigee XOn August 14, 2023, we released an updated version of Apigee X.
This release includes a major redesign of the Advanced API Security scores page in the Apigee UI in Cloud console. The Security scores page now:
- Highlights the top recommendations for improving security scores.
- Links directly to the Apigee UI Proxy Editor and Target Server tabs , where you can implement recommended changes to your API proxies and target servers.
Go 1.21 is now available in preview.
A weekly digest of client library updates from across the Cloud SDK.
Java
Changes for google-cloud-bigquery
2.31.1 (2023-08-09)
Dependencies
- Update dependency com.google.api.grpc:proto-google-cloud-bigqueryconnection-v1 to v2.25.0 (#2845) (d940f8d)
- Update dependency com.google.cloud:google-cloud-datacatalog-bom to v1.29.0 (#2846) (87a0a10)
- Update dependency com.google.cloud:google-cloud-shared-dependencies to v3.14.0 (#2834) (79fe14c)
- Update dependency org.graalvm.buildtools:junit-platform-native to v0.9.24 (#2839) (ae752bc)
- Update dependency org.graalvm.buildtools:native-maven-plugin to v0.9.24 (#2840) (1ae6cb9)
- Update github/codeql-action action to v2.21.1 (#2824) (9978971)
- Update jmh.version to v1.37 (#2836) (4b3a3c2)
Starting September 15, 2023, prices will apply for network egress from a BigQuery Google Cloud region to another Google Cloud region on the same continent and between different continents. For more information, see BigQuery Network Egress Traffic Pricing Charges Announcement.
Updated carbon model to version 9.
Customer carbon data for Cloud Functions will see a decrease starting from 2023-07-01 data onward. This decrease is a result of improvements in the apportionment of energy and carbon between Cloud Functions and App Engine. The impact is only seen in Cloud Functions, because App Engine is not yet supported in our covered services. This improvement is part of our efforts to support App Engine in the near future.
Added a new argument get_validation_report to fetch the validation report for a parser or a parser extension. For more information, see Chronicle CLI user guide.
A weekly digest of client library updates from across the Cloud SDK.
Node.js
Changes for @google-cloud/bigtable
5.0.0 (2023-08-10)
⚠ BREAKING CHANGES
- Upgrade to Node 14 (#1311)
Miscellaneous Chores
Java
Changes for google-cloud-bigtable
2.26.0 (2023-08-09)
Features
- Add last_scanned_row_key feature (#1856) (ef30dde)
- Enable last_scanned_row_responses feature flag (#1862) (c2288c9)
- Setup 2.25.x lts branch (#1866) (220cf4b)
Bug Fixes
Dependencies
- Update dependency com.google.cloud:google-cloud-monitoring-bom to v3.24.0 (#1878) (0de458d)
- Update dependency com.google.cloud:google-cloud-shared-dependencies to v3.14.0 (#1873) (bb83064)
- Update dependency org.graalvm.buildtools:junit-platform-native to v0.9.24 (#1876) (d397c33)
- Update dependency org.graalvm.buildtools:native-maven-plugin to v0.9.24 (#1877) (1a8be60)
Python
Changes for google-cloud-bigtable
2.21.0 (2023-08-02)
Features
Documentation
You can now select a cross-region internal Application Load Balancer as a health checked target for DNS routing policies. For more information, see Manage DNS routing policies and health checks.
Cloud Functions now supports the Go 1.21 runtime at the Preview release level.
The following conditional FHIR methods are generally available (GA) using the FHIR identifier search parameter:
- The
fhir.createFHIR standard conditional create fhir.conditionalDeletefhir.conditionalPatchfhir.conditionalUpdate
Dataplane v2 for Cloud Interconnect is fully available for customers using Dedicated Interconnect or Partner Interconnect in the following region:
- europe-north1 (Finland)
With the completion of this region, all regions available to Dedicated Interconnect and Partner Interconnect are now Dataplane v2-enabled. Any new VLAN attachment that you create in a region is automatically provisioned on Dataplane v2.
Any existing VLAN attachments that are still on Dataplane v1 can be migrated to Dataplane v2. You can migrate existing attachments yourself by re-creating the attachments, or you can request and schedule an assisted migration. Contact Google Cloud Support for assistance.
Cloud Load Balancing introduces the cross-region internal Application Load Balancer.
The cross-region internal Application Load Balancer supports backends in multiple regions, provides seamless cross-region failover, and is globally accessible by clients from any Google Cloud region, on premise, or other clouds.
For details, see the Internal Application Load Balancer overview.
To set up a cross-region internal Application Load Balancer, see the following pages:
This capability is in Preview.
With the launch of cross-region internal Application Load Balancer, we now support two deployment modes with the internal Application Load Balancer—regional (General Availability) and cross-region (Preview). In the regional mode, you configure the Internal Application Load Balancer in a specific region, and associate it with backends only in the load balancer's region. Load balancers deployed in the regional mode are renamed as regional internal Application Load Balancer in the console. No changes have been made to the API.
For details, see the Internal Application Load Balancer overview.
Version 2.37.0 of the Ops Agent introduces runtime health checks for errors in the configuration of logging pipelines and in parsing logs. These errors are reported to Cloud Logging. For more information, see Agent health checks.
A weekly digest of client library updates from across the Cloud SDK.
Node.js
Changes for @google-cloud/logging
11.0.0 (2023-08-10)
⚠ BREAKING CHANGES
- migrate to Node 14
Miscellaneous Chores
- Migrate to Node 14 (c294f5d)
Go
Changes for logging/apiv2
1.8.0 (2023-08-09)
Features
- logging: Log Analytics features of the Cloud Logging API feat: Add ConfigServiceV2.CreateBucketAsync method for creating Log Buckets asynchronously feat: Add ConfigServiceV2.UpdateBucketAsync method for creating Log Buckets asynchronously feat: Add ConfigServiceV2.CreateLink method for creating linked datasets for Log Analytics Buckets feat: Add ConfigServiceV2.DeleteLink method for deleting linked datasets feat: Add ConfigServiceV2.ListLinks method for listing linked datasets feat: Add ConfigServiceV2.GetLink methods for describing linked datasets feat: Add LogBucket.analytics_enabled field that specifies whether Log Bucket's Analytics features are enabled feat: Add LogBucket.index_configs field that contains a list of Log Bucket's indexed fields and related configuration data docs: Documentation for the Log Analytics features of the Cloud Logging API (31c3766)
- logging: Update all direct dependencies (b340d03)
Bug Fixes
Java
Changes for google-cloud-logging
3.15.8 (2023-08-08)
Dependencies
Version 2.37.0 of the Ops Agent introduces runtime health checks for errors in the configuration of logging pipelines and in parsing logs. These errors are reported to Cloud Logging. For more information, see Agent health checks.
Version 2.37.0 of the Ops Agent introduces GA support for an OpenTelemetry Protocol (OTLP) receiver. You can use this receiver to collect custom metrics and traces from applications written by using OpenTelemetry SDKs. For more information, see Collect OpenTelemetry protocol (OTLP) metrics and traces.
You can now send traffic directly to a VPC network with no Serverless VPC Access connector required (Preview).
Version 2.37.0 of the Ops Agent introduces GA support for an OpenTelemetry Protocol (OTLP) receiver. You can use this receiver to collect custom traces and metrics from applications written by using OpenTelemetry SDKs. For more information, see Use the Ops Agent and OpenTelemetry Protocol (OTLP).
cos-beta-109-17800-0-8
| Date | Kernel | Docker | Containerd | GPU Drivers |
| Aug 14, 2023 | COS-6.1.42 | v24.0.4 | v1.7.2 | v535.54.03(default),v470.199.02(R470) |
Updates to Major Packages:
Updated cos-gpu-installer to v2.1.4. Some key features of this update include:
- Support for gsp_tu10x.bin and gsp_ad10x.bin gsp firmware files and removes the container dependency on python2.
- Simplifies GPU driver installation by remounting driver installation path as executable from cos-extensions.
- Support for L4 GPU in cos-gpu-installer and fixed cached driver installation for prebuilt driver modules.
- Fallback to installing compatible drivers when installer is invoked for certain GPU devices and incompatible drivers.
- Switch precompiled driver and signature location to COS build artifacts.
-
Added flag
--no-verifyto preload GPU drivers with no GPU attached. - Added support for NVIDIA R535 drivers by preparing gsp_ga10x.bin firmware file.
-
Added flag
--module-argto specify kernel module parameters. -
Switch generic NVIDIA driver installer download url in cos-gpu-installer from us.downloads.nvidia to gs://nvidia-drivers-
-public. - Fix permission issue in GPU driver install directory with OSS drivers.
Updated default and latest drivers to v535.54.03 (NVIDIA LTSB).
This also resolves: CVE-2023-0184, CVE-2023-0189, CVE-2023-0180,
CVE-2023-0183, CVE-2023-0185, CVE-2023-0187, CVE-2023-0198,
CVE-2023-0199, CVE-2023-0188, CVE-2023-0190, CVE-2023-0194,
CVE-2023-0195, CVE-2023-0191. CVE-2023-25515 and
CVE-2023-25516.
Also updated R470 drivers to 470.199.02. This also resolves:
CVE-2023-0184, CVE-2023-0189, CVE-2023-0180, CVE-2023-0185,
CVE-2023-0187, CVE-2023-0198, CVE-2023-0199, CVE-2023-0188,
CVE-2023-0190, CVE-2023-0194, CVE-2023-0195, CVE-2023-0191.
Updated systemd to v253.3.
Updated Docker and docker-cli to v24.0.4.
Updated kubernetes to v1.27.3.
Updated containerd to 1.7.2. This also resolves CVE-2023-25173 and CVE-2023-25153.
Updated runc to 1.1.7. This also resolves CVE-2023-25809 and CVE-2023-27561.
Updated docker-credential-gcr to v2.1.10.
Updated cloud-init to v23.1.2.
Updated oslogin to v20230531.00.
Updated google-osconfig-agent to v20230706.02.
Updated google-guest-agent to v20230628.00.
Updated google-guest-configs to v20230526.00.
Upgraded localtoast from v1.1.5.1 to v1.1.6.
Updated sosreport to v4.5.4.
Updated toolbox to v20230714.
New Features and Changes in the Linux Kernel:
Updated the Linux kernel to v6.1.40.
Disabled CONFIG_DEBUG_CREDENTIALS in the kernel due to its performance impact on some container workloads.
Add MAX_SKB_FRAGS configuration in the Linux kernel.
Updated the gvnic driver in the Linux kernel.
Enabled support for MGLRU in the Linux kernel.
Enabled vrf, ip_gre, and ip6_gre modules.
Enabled TDX Guest support in the Linux Kernel.
Added kernel support for nftables.
Enabled the following kernel configs: CONFIG_AMD_IOMMU,
CONFIG_AMD_IOMMU_V2 and INET_DIAG_DESTROY.
Added kernel modules for SquashFS, RAID1, and DM RAID.
New Features and Changes in the Image:
Installed fluent-bit for stackdriver logging in x86 images. See this page for more details.
Added nvidia-container-toolkit v1.13.5.
Retry starting systemd-networkd permanently in case of failure instead of default limit of 5.
Enabled fluent-bit to use customized configuration.
Enabled KVM-based nested virtualization for the x86 architecture.
Add noexec, nodev, nosuid to /etc/resolv.conf bind mount. Fixes
EPERM errors when running a pod in UserNS in COS.
Increase /dev/stateful wait timeout with protected stateful partition.
Allowed preloading GPU driver dependencies through cos-extensions.
Toolbox is now compatible with both Artifact Registry (AR) and Google Container Registry (GCR).
Use the Fluent-bit logging agent when the google-logging-use-fluentbit
metadata key is true and logging is enabled.
Fixed an issue where chronyd does not restart after failure, resulting in the system time being out of sync.
Fixed an issue where pstore is not cleaned at boot time if COS metrics are disabled.
Fixed containers losing access to GPUs with error "Failed to initialize NVML: Unknown error".
Removed support for Rust symbol demangling in google-breakpad.
CVE/Security Fixes:
Upgraded net-misc/curl to v8.1.2. This resolves CVE-2022-43552.
Upgraded net-misc/openssh package to v9.3. This resolves CVE-2023-28531 and CVE-2023-25136.
Updated dev-libs/openssl to v3.0.9. This resolves CVE-2023-2650, CVE-2022-4450, CVE-2023-0215, CVE-2022-4304, CVE-2023-0286, CVE-2023-0464, CVE-2023-1255, CVE-2023-0465 and CVE-2023-0466.
Fixed CVE-2023-24329, CVE-2015-20107, CVE-2020-10735, CVE-2021-28861, and CVE-2022-45061 in dev-lang/python.
Fixed ncurses upgrade to 6.4p20220423. This resolves CVE-2023-29491.
Updated the dev-libs/libxml2 package to 2.10.4. This resolves CVE-2023-28484.
Updated app-editors/vim, app-editors/vim-core to v9.0.1562. This resolves CVE-2023-2609, CVE-2023-2610, CVE-2023-2426, CVE-2023-0512, CVE-2023-1127, CVE-2023-1175, CVE-2023-1170, CVE-2023-1355 and CVE-2023-1264.
Updated to pick up CVE-2023-0394 patch for ipv6 raw.
Updated to pick up CVE-2023-0386 and CVE-2023-1281 patches for net-sched in the kernel.
Updated to pick up CVE-2023-0179 patch for netfilter in kernel.
Upgraded dev-libs/confuse to v3.3 and fixed CVE-2022-40320.
Upgraded dev-python/cryptography to v39.0.1. This resolves CVE-2023-23931.
Fixed CVE-2022-48303 in app-arch/tar.
Fixed CVE-2022-2928 and CVE-2022-2929 in net-misc/dhcp.
Upgraded sys-fs/cryptsetup from 2.3.4 to 2.4.3. This resolves CVE-2021-4122.
Updated net-fs/cifs-utils to v6.15. This resolves CVE-2022-29869, CVE-2021-20208, and CVE-2022-27239.
Fixed CVE-2021-27291 and CVE-2021-20270 in dev-python/pygments.
Updated binutils-libs to v2.40. This resolves CVE-2022-4285.
Updated dev-lang/go to v1.20.5 and dev-go/net to v0.7.0. This resolves CVE-2023-29403, CVE-2023-29404, CVE-2023-29402, CVE-2023-29405, CVE-2023-24532, CVE-2023-24536, CVE-2023-24537, CVE-2023-24538, CVE-2023-24539, CVE-2023-24540, CVE-2023-29400, CVE-2022-41723 and CVE-2022-41725.
Upgraded sys-apps/less to v633-r1. This resolves CVE-2022-46663.
Update open-vm-tools to v12.2.5. This resolves CVE-2023-20867.
Updated open-iscsi to v2.1.8. This resolves CVE-2020-17437.
Updates for Minor packages:
Upgraded sys-apps/coreutils to v9.3.
Upgraded sys-fs/e2fsprogs to v1.47.0-r2.
Upgraded app-misc/ca-certificates to v20230311.3.90.
Upgraded app-misc/mime-types to v2.1.54.
Upgraded sys-apps/diffutils to v3.10.
Upgraded net-dns/c-ares to v1.19.1.
Upgraded sys-apps/grep to v3.11.
Upgraded sys-apps/ethtool to v6.3.
Upgraded net-misc/wget to v1.21.4.
Upgraded sys-libs/libcap to v2.69.
Upgraded sys-apps/coreutils to v9.3-r1.
Upgraded app-admin/sudo to v1.9.13_p3-r1.
Upgraded app-arch/xz-utils to v5.4.3.
Upgraded sys-apps/acl to v2.3.1-r2.
Updated iproute2 to v6.2.0.
Upgraded app-misc/jq to v1.7_pre20201109-r1.
Upgraded sys-fs/lvm2 to v2-2.03.20.
Upgraded net-libs/libnetfilter_conntrack to v1.0.9-r1.
Upgraded net-firewall/iptables to v1.8.9.
Upgraded sys-apps/dmidecode to v3.5-r2.
Upgraded sys-libs/libcap to v2.68.
Upgraded net-misc/wget to v1.21.3-r1.
Upgraded sys-apps/file to v5.44-r3.
Upgraded sys-fs/xfsprogs to v6.2.0.
Upgraded net-libs/libnfnetlink to v1.0.2.
Upgraded net-misc/rsync to v3.2.7-r2.
Upgraded sys-process/lsof to v4.98.0.
Upgraded sys-libs/libcap-ng to v0.8.3.
Upgraded sys-libs/timezone-data to v2023c.
Upgraded sys-apps/net-tools to v2.10.
Upgraded sys-apps/kexec-tools to v2.0.24.
Upgraded sys-apps/gentoo-functions to v0.19.
Upgraded sys-apps/ethtool to v6.2.
Upgraded sys-apps/attr to v2.5.1-r2.
Upgraded sys-apps/acl to v2.3.1-r1.
Upgraded net-nds/rpcbind to v1.2.6.
Upgraded net-misc/bridge-utils to v1.7.1-r1.
Upgraded net-libs/libnetfilter_queue to v1.0.5.
Upgraded net-libs/libnetfilter_cttimeout to v1.0.1.
Upgraded net-libs/libnetfilter_cthelper to v1.0.1-r1.
Upgraded net-libs/libmnl to v1.0.5.
Upgraded net-libs/gnutls to v3.8.0.
Upgraded net-fs/autofs to v5.1.8-r1.
Upgraded net-dns/libidn2 to v2-2.3.4.
Upgraded net-dns/c-ares to v1.19.0.
Upgraded net-analyzer/netcat to v110.20180111-r2.
Upgraded dev-libs/userspace-rcu to v0.13.2.
Upgraded dev-libs/re2 to v2-0.2022.12.01.
Upgraded dev-libs/popt to v1.19.
Upgraded dev-libs/libzip to v1.9.2.
Upgraded dev-libs/nettle to v3.8.1.
Upgraded dev-libs/nspr to v4.35-r1.
Upgraded dev-libs/libyaml to v0.2.5.
Upgraded dev-libs/libverto to v0.3.2.
Upgraded dev-libs/libpcre2 to v2-10.42-r1.
Upgraded dev-libs/libpcre to v8.45-r1.
Upgraded dev-libs/libgpg-error to v1.46-r1.
Upgraded dev-libs/libgcrypt to v1.10.1-r3.
Upgraded dev-libs/libevent to v2.1.12-r1.
Upgraded dev-libs/gmp to v6.2.1-r5.
Upgraded dev-libs/expat to v2.5.0.
Upgraded dev-libs/elfutils to v0.189.
Upgraded dev-libs/dbus-glib to v0.112.
Upgraded dev-db/sqlite to v3.41.0.
Upgraded app-shells/dash to v0.5.12.
Upgraded app-arch/pigz to v2.7-r1.
Upgraded app-admin/logrotate to v3.21.0.
Updated dev-go/go-sys to v0.5.0.
Updated dev-go/go-tools to 070db2996ebe3aa00667288f8e5749e867deeb39.
Upgraded bind-tools to v9.16.37.
cos-dev-113-17819-0-0
| Kernel | Docker | Containerd | GPU Drivers |
| COS-6.1.43 | v24.0.4 | v1.7.3 | v535.54.03(default),v470.199.02(R470) |
Updated app-emulation/kubernetes to v1.27.4.
Updated app-emulation/cloud-init to v23.2.2.
Updated app-containers/containerd to v1.7.3.
Updated the Linux kernel to v6.1.43.
Upgraded sys-apps/pv to v1.7.24.
cos-93-16623-461-8
| Kernel | Docker | Containerd | GPU Drivers |
| COS-5.10.177 | v20.10.24 | v1.6.20 | v450.248.02(default),v470.199.02(R470),v525.125.06 |
Fixed CVE-2022-28737 in sys-boot/shim.
Fixed CVE-2023-32001 in net-misc/curl.
Fixed CVE-2023-38408 in net-misc/openssh.
Fixed CVE-2022-40896 in dev-python/pygments.
Fixed CVE-2023-4004, CVE-2023-3777, CVE-2023-3776, CVE-2023-1206, CVE-2023-0160 and CVE-2023-3611 in the Linux kernel.
cos-97-16919-353-15
| Kernel | Docker | Containerd | GPU Drivers |
| COS-5.10.186 | v20.10.24 | v1.6.21 | v470.199.02(default),v525.125.06 |
Fixed CVE-2022-28737 in sys-boot/shim.
Fixed CVE-2023-32001 in net-misc/curl.
Fixed CVE-2022-40896 in dev-python/pygments.
Fixed CVE-2023-38408 in net-misc/openssh.
Fixed CVE-2023-4004, CVE-2023-3777, CVE-2023-3776, CVE-2023-1206 and CVE-2023-3611 in the Linux kernel.
cos-105-17412-156-15
| Kernel | Docker | Containerd | GPU Drivers |
| COS-5.15.120 | v23.0.3 | v1.7.2 | v470.199.02(default),v525.125.06 |
Update cos-gpu-installer to v2.1.4. This fixes permission issue in GPU driver install directory with OSS drivers.
Fixed CVE-2023-32001 in net-misc/curl.
Fixed CVE-2022-40896 in dev-python/pygments.
Fixed CVE-2023-4004, CVE-2023-3776, CVE-2023-3777, CVE-2023-1206, and CVE-2023-3611 in the Linux kernel.
cos-101-17162-279-14
| Kernel | Docker | Containerd | GPU Drivers |
| COS-5.15.120 | v20.10.24 | v1.6.21 | v470.199.02(default),v525.125.06 |
Fixed CVE-2023-32001 in net-misc/curl.
Fixed CVE-2023-4004, CVE-2023-3777, CVE-2023-1206, and CVE-2023-3611 in the Linux kernel.
Dialogflow CX route groups can now be flow-level or agent-level.
Error Reporting now reports recent application errors for Google Kubernetes Engine services and clusters on a new App Errors tab.
- To view service errors, go to Kubernetes Engine in the Google Cloud console and select Services & Ingress, then select a specific service and click the App Errors tab.
- To view cluster errors, go to Kubernetes Engine in the Google Cloud console and select Clusters, then select a specific cluster and click the App Errors tab.
A weekly digest of client library updates from across the Cloud SDK.
Node.js
Changes for @google-cloud/datastore
8.0.0 (2023-08-09)
⚠ BREAKING CHANGES
- upgrade to Node 14
Miscellaneous Chores
- Upgrade to Node 14 (b7904f1)
Python
Changes for google-cloud-datastore
2.17.0 (2023-08-09)
Documentation
For Credential Access Boundaries, removed the requirement to enable uniform bucket-level access for your Cloud Storage bucket.
Preview: Migrate to Virtual Machines supports the migration of VMs running Amazon Linux 2 to Google Cloud as part of a preview program. In order to migrate a VM running Amazon Linux 2, Migrate to Virtual Machines first converts Amazon Linux 2 to Rocky Linux 8 and then completes the migration. To participate in the preview, contact us at m2vm-amazon-linux-migration@google.com.
A weekly digest of client library updates from across the Cloud SDK.
Python
Changes for google-cloud-pubsub
2.18.2 (2023-08-07)
Bug Fixes
Google Cloud's Agent for SAP version 2.5
Version 2.5 of Google Cloud's Agent for SAP is generally available (GA). This version introduces the collection of SAP HANA database metrics for Workload Manager validation and includes bug fixes for the collection of Process monitoring metrics.
For more information, see What's new with Google Cloud's Agent for SAP.
Preview stage support for the following integration:
Private Service Connect backends with published service targets can be added to cross-region Application Load Balancers. This feature is available in Preview.
VLAN attachments for Cloud Interconnect that have Dataplane v1 can access Private Service Connect endpoints from hybrid networks. For more information, see access endpoints from hybrid networks.
Private Service Connect endpoints that have global access enabled can access published services that are based on the following load balancer configurations:
- Internal Application Load Balancer with global access enabled
- Regional internal proxy Network Load Balancer with global access enabled
August 11, 2023
Cloud Healthcare APIA release was made. Updates may include general performance improvements, bug fixes, and updates to the API reference documentation.
Cloud SQL Enterprise Plus edition now supports the asia-northeast3 (Seoul) region.
Cloud SQL Enterprise Plus edition now supports the asia-northeast3 (Seoul) region.
Config Controller now uses the following versions of its included products:
- Config Connector v1.107.0, release notes
- Anthos Config Management v1.15.3, release notes
Container Registry storage buckets can no longer be set to public from the Google Cloud Console. To configure public access to images, see Configure public access to images.
New Dataproc on Compute Engine subminor image versions:
- 2.0.73-debian10, 2.0.73-rocky8, 2.0.73-ubuntu18
- 2.1.21-debian11, 2.1.21-rocky8, 2.1.21-ubuntu20, 2.1.21-ubuntu20-arm
New Dataproc Serverless for Spark runtime versions:
- 1.1.27
- 2.0.35
- 2.1.14
Added new Dataproc Serverless Templates for batch workload creation:
- Cloud Spanner to Cloud Storage
- Cloud Storage to JDBC
- Cloud Storage to Cloud Storage
- Hive to BigQuery
- JDBC to Cloud Spanner
- JDBC to JDBC
- Pub/Sub to Cloud Storage
Improved the reliability of Dataproc Serverless compute node initialization with a Premium disk tier option.
Google has open sourced the following Dialogflow CX integrations:
Pipelines support linking documents to a given folder during data ingestion.
Network Topology now shows the infrastructure of your GKE deployments - clusters, namespaces, workloads, and pods, and their associated metrics.
Generative AI on Vertex AI supports CMEK, VPC Service Controls, Data Residency, and Access Transparency. For more information, see Security controls.
August 10, 2023
Anthos clusters on VMwareAnthos clusters on VMware 1.15.3-gke.47 is now available. To upgrade, see Upgrading Anthos clusters on VMware. Anthos clusters on VMware 1.15.3-gke.47 runs on Kubernetes 1.26.5-gke.2100.
Upgrading an admin cluster with always-on secrets encryption enabled might fail.
An admin cluster upgrade from 1.14.x to 1.15.0 - 1.15.4 with always-on secrets encryption enabled might fail depending on when you created the admin cluster. The following admin clusters are affected:
Admin clusters created in 1.12 or earlier with always-on secrets encryption enabled at creation time.
Admin clusters created in 1.12 or earlier with always-on secrets encryption disabled, but subsequently the cluster was updated to enable the feature.
Admin clusters created in 1.13 or later with the feature enabled are safe to upgrade.
If you don't know the original version of the admin cluster, don't upgrade the cluster until a fix is available in 1.15.5.
For information on working around an admin cluster failure because of this issue, see Upgrading an admin cluster with always-on secrets encryption enabled fails. Note that the workaround relies on you having the old encryption key backed up. If the old key is no longer available, you will have to recreate the admin cluster and all user clusters.
Anthos clusters on VMware 1.15.3 supports adding the gkeOnPremAPI section to
your
admin cluster configuration file
and
user cluster configuration file
to enroll the clusters in the Anthos On-Prem API.
Upgraded VMware vSphere Container Storage Plug-in from 3.0 to 3.0.2. For more information, see the Plug-in release notes.
The following issues are fixed in 1.15.3-gke.47:
- Fixed a known issue. that caused upgrading an admin cluster enrolled in the Anthos On-Prem API to fail.
- Fixed an issue where audit logs are duplicated into an offline buffer even when they are successfully sent to Cloud Audit Logging.
The following vulnerabilities are fixed in 1.15.3-gke.47:
High-severity container vulnerabilities:
Container-optimized OS vulnerabilities:
Ubuntu vulnerabilities:
Windows vulnerabilities:
You can now see query performance insights about high cardinality joins. This feature is generally available (GA).
The September 14, 2022 release notes announced that you could configure the connector to authenticate the connection using an external account with workload identity federation for ODBC driver update release 2.5.0 1001, but workload identity federation is not supported. Workforce identity federation is still supported.
You can now use user-defined functions to export BigQuery data as Protocol Buffer (Protobuf) columns. This feature is generally-available.
UDM Search includes a new feature, called UDM Lookup, that enables you to quickly find a UDM field if you do not know which to include in a UDM Search query. You can search for a field that contains a text string in the name or that stores a specific string value. For more information, see Find a UDM field for search query.
When viewing an event using Event Viewer, each UDM field is labeled with an icon (U or E) that identifies whether the field stores enriched or unenriched data. For more information, see View events in the Event Viewer.
UDM Search behavior has been enhanced. When no search results are returned by a query, the page displays empty panels (Events, Quick Filters, Alerts, etc.) with messages indicating that nothing was found.
PromQL alerting for Cloud Monitoring is in Public Preview. You can now use PromQL queries in your alerting policies. You can also migrate your Prometheus alerting rules to Cloud Monitoring alerting rules with a PromQL query, and migrate your Prometheus receivers to Cloud Monitoring notification channels. For more information, see Alerting policies with PromQL.
You can now use point-in-time recovery to recover a Cloud SQL instance that isn't available. If the instance is unavailable, then you can use the API to get the latest recovery time and perform the recovery of the instance to that time.
M110 release
- Added support for TensorFlow 2.13 with Python 3.10 on Debian 11.
- Added support for TensorFlow 2.8 with Python 3.10 on Debian 11.
- Miscellaneous software updates.
TensorFlow 2.9 container images are deprecated.
M110 release
- Added support for TensorFlow 2.13 with Python 3.10 on Debian 11.
- Added support for TensorFlow 2.8 with Python 3.10 on Debian 11.
- Miscellaneous software updates.
TensorFlow 2.9 images are deprecated.
In the Error Reporting page's resource filter, you can now filter GKE resources by location, cluster, namespace, and container or pod. For more information, see Filter errors.
The zonal service tier with options for a higher or lower capacity band is now available in Preview.
Public clusters upgraded to GKE versions 1.24 and later will eventually be migrated to use Private Service Connect (PSC) for private control plane communication. After the control plane has been reconfigured, GKE schedules an update for your cluster's nodes to use the new private IP address to communicate with control plane. Each node pool is marked for recreation. You can use maintenance windows to control when your nodes are recreated. There is no price increase for using GKE public clusters running on PSC. For more information, see Public clusters with Private Service Connect.
M110 release
The M110 release of Vertex AI Workbench user-managed notebooks includes the following:
- Added support for TensorFlow 2.13 with Python 3.10 on Debian 11.
- Added support for TensorFlow 2.8 with Python 3.10 on Debian 11.
- Miscellaneous software updates.
TensorFlow 2.9 user-managed instances are deprecated.
The M110 release of Vertex AI Workbench managed notebooks includes the following:
- Increased shared memory size to available memory capacity.
- Added support for Python 3.10 on Debian 11.
- Added support for PyTorch 2.0 with Python 3.10.
August 09, 2023
Apigee XThe Apigee documentation site navigation has been updated to be more consistent with other Google Cloud product documentation sites. The changes include:
The following supported default parsers have changed. Each is listed by product name and log_type value, if applicable.
- Apache (
APACHE) - AWS Cloudtrail (
AWS_CLOUDTRAIL) - AWS GuardDuty (
GUARDDUTY) - Azure AD Directory Audit (
AZURE_AD_AUDIT) - Cambium Networks (
CAMBIUM_NETWORKS) - Cisco ASA (
CISCO_ASA_FIREWALL) - Cisco Firepower NGFW (
CISCO_FIREPOWER_FIREWALL) - Cisco ISE (
CISCO_ISE) - CrowdStrike Falcon (
CS_EDR) - Department of Homeland Security (
DHS_IOC) - Duo Auth (
DUO_AUTH) - F5 ASM (
F5_ASM) - Fortinet FortiEDR (
FORTINET_FORTIEDR) - GitHub (
GITHUB) - Imperva (
IMPERVA_WAF) - Juniper (
JUNIPER_FIREWALL) - Menlo Security (
MENLO_SECURITY) - Microsoft AD (
WINDOWS_AD) - Microsoft Azure Resource (
AZURE_RESOURCE_LOGS) - Microsoft Defender for Endpoint (
MICROSOFT_DEFENDER_ENDPOINT) - Neosec (
NEOSEC) - Net Suite (
NET_SUITE) - Office 365 (
OFFICE_365) - Oracle Unified Directory (
ORACLE_OUD) - Palo Alto Panorama (
PAN_PANORAMA) - Proofpoint Observeit (
OBSERVEIT) - Qualys Asset Context (
QUALYS_ASSET_CONTEXT) - Qualys Virtual Scanner (
QUALYS_VIRTUAL_SCANNER) - SentinelOne Deep Visibility (
SENTINEL_DV) - Tanium Threat Response (
TANIUM_THREAT_RESPONSE) - Thinkst Canary (
THINKST_CANARY) - TrendMicro Web Proxy (
TRENDMICRO_WEBPROXY) - Vectra Stream (
VECTRA_STREAM) - VMware Workspace ONE (
VMWARE_WORKSPACE_ONE) - Windows Event (
WINEVTLOG) - Workspace Activities (
WORKSPACE_ACTIVITY)
For details about changes in each parser, see Supported default parsers.
In the SAP Table Batch Source plugin version 0.10.0, fixed an issue causing failed data pipeline runs when you clicked the Take a snapshot toggle because the FIELDS parameters weren't exported.
You can now upgrade a Cloud SQL for MySQL instance to Cloud SQL Enterprise Plus edition by using IP allowlists and VPC Peering.
You can now upgrade a Cloud SQL for PostgreSQL instance to Cloud SQL Enterprise Plus edition by using IP allowlists and VPC Peering.
Generally available: You can use Cloud Monitoring to monitor the consumption of your reservations and set custom alerts. For more information, see Monitor consumption of reservations.
Generally available: If a host error occurs on a VM, you can control how much time Compute Engine spends recovering Local SSD data with the Local SSD recovery timeout setting. For more information, see Local SSD data persistence.
Generally available: Use the new distribution shape ANY SINGLE ZONE in a regional Managed Instance Group (MIG) to automatically select a single zone that has available resources within your quota. Recommended for workloads that require low latency, high-bandwidth connections between VMs or when you want to avoid inter-zone network traffic costs.
Enhanced international calling configuration: You can now configure international calling for each phone number at the country code level by using the Phone Number Management settings. After the international calling is configured, you can manage user-level access. An error message will appear in the Agent Adapter if the agent dials a restricted number. For details, see the Phone number management and Add and view users documentation.
Outbound Dialer list management using the API: You can now manage your campaign contact lists within our outbound dialer using your own software application. You can programmatically add, remove, and update contact information in your campaign lists using the List Management API. This feature allows seamless integration between your software and our system, programmatic control using the API, and efficiency by automating list management tasks.
Fixed an issue where some pages were not visible in the collapsed navigation menu.
Fixed an issue where some page category names were displayed to users in the collapsed navigation menu even though they didn't have access to any pages within that category.
Fixed an issue where the Agent_Login message event (supposed to be raised when an agent logs in) was not happening.
Sessionless SMS implementation is now updated to support A2P 10DLC compliance requirements. The update ensures SMS sent via Session SMS APIs will not encounter any unexpected blockage.
Fixed an issue where when a manager/ admin tried to monitor or barge into a call for a second time, they received a 400 error "You are already in this call".
Dataform is compliant with HIPAA, ISO/IEC 27001, and SOC 1.
For more information, see Dataform compliance.
Enterprise Search: Support for VPC Service Controls
VPC Service Controls supports Enterprise Search in preview.
For more information, see Supported products and limitations in the VPC Service Controls documentation. For general information about VPC Service Controls, see Overview of VPC Service Controls.
The Filestore CSI driver now supports smaller share sizes (10Gi) for Filestore multishares for GKE for enterprise instances starting in version 1.27.
CVE-2023-0464, CVE-2023-0465, CVE-2023-0466, and CVE-2023-2650 have been patched in Filestore CSI driver in GKE versions 1.23 and 1.24, for newly created clusters.
Looker 23.14 includes the following changes, features, and fixes.
Expected Looker (original) deployment start: Tuesday, August 15, 2023
Expected Looker (original) final deployment and download available: Thursday, August 24, 2023
Expected Looker (Google Cloud core) deployment start: Monday, September 11, 2023
Expected Looker (Google Cloud core) final deployment: Friday, September 22, 2023
The new LookML runtime now reports errors for multiple primary key declarations during project validation and at query time.
Cookieless embedding no longer requires that the Persistent Sessions setting on the Admin > Authentication > Sessions panel be enabled.
The new LookML runtime now allows a wider variety of strings for Liquid date parsing. Date string formats that were previously accepted in the legacy runtime but not in the new runtime should now format properly.
The Embed Content Management and Dashboard Embed Content Navigation features, previously available as Labs features, are now generally available.
Now generally available, the new permissions manage_project_connections, manage_project_models, and use_global_connections let admins delegate connection creation and model connection.
In the new LookML runtime, using the Liquid case tag with a parameter value of type: string will evaluate the same as the legacy runtime.
Admins and other System Activity users can now easily see all recent queries to your Looker instance from Looker's BI Connectors, using the new Recent BI Connector Queries Quick Start in the System Activity History Explore. This quick start shows BI Connector queries from the last seven days by connector, user, Looker model, and other relevant dimensions.
An embed_domain parameter has been added to the signed embed url creation endpoint to streamline the process of adding a domain to the embed domain allowlist. If the parameter is passed to the endpoint, is valid, and is not found in the current allowlist, it will be added before the created URL is passed back to the API caller.
The drilling dialog will now inherit the visualization settings from the query or dashboard element from which drilling was initiated. For example, conditional formatting and color collection settings will carry over to the visualization in the drilling dialog.
An issue where the Blocks section of the left navigation panel would load indefinitely on certain pages has been fixed.
An issue where suggestions failed to populate on Exasol connections has been fixed.
An issue with visualization options for table calcs not being added to the generated dashboard LookML has been fixed.
An issue with navigating to group folders when viewing SSO embedded content has been fixed.
An issue where geoJSON map layers would not load on embedded content has been fixed.
An issue where a hardcoded row limit of 5000 would cause visualization options to disappear has been fixed.
An issue where suggestions were not working when a field's derived table referenced another view in Liquid has been fixed.
Project level README files will not be overwritten when new project files are generated.
When hitting the Get Async Query Results endpoint for queries in JSON formats, Looker now returns a meaningful error.
The Clustrix database dialect is no longer supported by Looker.
New connections for Apache Hive 2 can no longer be created. Existing connections will continue to work.
New connections for Apache Spark 1.5+ can no longer be created. Existing connections will continue to work.
New connections for Apache Spark 2.0 can no longer be created. Existing connections will still work.
New connections for Qubole Presto can no longer be created. Existing connections will still work.
New connections for IBM AS400 can no longer be created. Existing connections will still work.
New connections for Qubole Presto Service can no longer be created. Existing connections will still work.
New connections for IBM DB2 can no longer be created. Existing connections will still work.
This information applies only to customers who are part of the Private Preview for the SQL interface. All modeled timestamps, except for the raw timeframe, will be treated as BigQuery DATETIME objects instead of TIMESTAMP objects.
The Set up a trial Looker (Google Cloud core) instance documentation page now clarifies that you can cancel a Looker (Google Cloud core) 30-day trial by deleting the trial instance.
Looker (Google Cloud core) instances can now be created with the Google Cloud Terraform Provider, by provisioning a google_looker_instance resource. To learn more about this release, please see the Google Cloud Terraform Provider documentation.
When you create a Looker (Google Cloud core) instance, the Google Cloud console now displays a cost estimate on the right side of the console pane.
Cloud Storage Backint agent for SAP HANA version 1.0.27
Version 1.0.27 of the Cloud Storage Backint agent for SAP HANA is available. This version includes updated libraries.
For more information about the agent, see Cloud Storage Backint agent for SAP HANA overview.
Preview stage support for the following integration:
General availability support for the following integration:
Imagen Multimodal embeddings available in GA
Imagen on Vertex AI now offers the following GA feature:
- Multimodal embeddings
This feature incurs different pricing based on if you use image input or text input. For more information, see the multimodal embeddings feature page.
August 08, 2023
AlloyDB for PostgreSQLAlloyDB Omni version alloydb-omni-0.3.0-preview-postgresql-15.2 is available. This version introduces PostgreSQL 15, and applies various bug fixes and query performance improvements.
The rollout of managed Anthos Service Mesh version 1.15 to the stable channel has completed.
See Select a managed Anthos Service Mesh release channel for more information.
Cross-org authorization for device attributes in access levels is generally available (GA). You can now configure authorization across organizations by using Access Context Manager.
The following features are now generally available (GA) in queries and materialized views:
The following resource types are now publicly available through the ExportAssets, ListAssets, BatchGetAssetsHistory, QueryAssets, and Feed APIs.
- GKE Multicloud
gkemulticloud.googleapis.com/AwsClustergkemulticloud.googleapis.com/AzureClustergkemulticloud.googleapis.com/AzureClientgkemulticloud.googleapis.com/AwsNodePoolgkemulticloud.googleapis.com/AttachedClustergkemulticloud.googleapis.com/AzureNodePool
The price of Managed Service for Prometheus samples ingested into Cloud Monitoring has dropped by 60 percent. For more information, see Cloud Monitoring pricing summary, and for worked examples, see Pricing examples based on samples ingested.
You can now override the arguments, environment variables, number of tasks, and task timeout already configured for a job when you execute a job. (In Preview)
Cloud Spanner database deletion protection is now generally available. You can enable database deletion protection to prevent the accidental deletion of databases. For more information, see Prevent accidental database deletion.
Dialogflow CX conversation history has added two new views: flow analysis table and flow analysis graph.
Dialogflow CX analytics has been reimplemented to provide all new views and metrics. The old views have been renamed legacy analytics.
Dialogflow CX now provides intent suggestions.
Dialogflow CX now provides a split intents feature.
Dialogflow CX now provides a compare and merge intents feature.
Dialogflow CX now provides a timeout-based end of speech sensitivity setting.
(2023-R17) Version updates
GKE cluster versions have been updated.
New versions available for upgrades and new clusters
The following Kubernetes versions are now available for new clusters and for opt-in control plane upgrades and node upgrades for existing clusters. For more information on versioning and upgrades, see GKE versioning and support and Upgrades.
No channel
- Version 1.27.3-gke.100 is now the default version.
- The following control plane and node versions are now available:
- The following control plane versions are no longer available:
- 1.22.17-gke.12700
- 1.22.17-gke.14100
- 1.23.17-gke.7700
- 1.24.14-gke.1200
- 1.25.10-gke.1200
- 1.25.10-gke.1400
- 1.26.5-gke.1200
- Control planes and nodes with auto-upgrade enabled will be upgraded from version 1.22 to version 1.23.17-gke.8400 with this release.
- Control planes and nodes with auto-upgrade enabled will be upgraded from version 1.23 to version 1.24.14-gke.1400 with this release.
- Control planes and nodes with auto-upgrade enabled will be upgraded from version 1.24 to version 1.25.10-gke.2100 with this release.
- Control planes and nodes with auto-upgrade enabled will be upgraded from version 1.25 to version 1.25.10-gke.2100 with this release.
- Control planes and nodes with auto-upgrade enabled will be upgraded from version 1.26 to version 1.26.5-gke.2100 with this release.
- Control planes and nodes with auto-upgrade enabled will be upgraded from version 1.27 to version 1.27.3-gke.100 with this release.
Stable channel
- Version 1.27.3-gke.100 is now the default version in the Stable channel.
- The following versions are now available in the Stable channel:
- The following versions are no longer available in the Stable channel:
- 1.22.17-gke.12700
- 1.23.17-gke.7700
- 1.24.14-gke.1200
- 1.25.10-gke.1200
- 1.26.5-gke.1400
- Control planes and nodes with auto-upgrade enabled in the Stable channel will be upgraded from version 1.22 to version 1.23.17-gke.8400 with this release.
- Control planes and nodes with auto-upgrade enabled in the Stable channel will be upgraded from version 1.23 to version 1.24.14-gke.1400 with this release.
- Control planes and nodes with auto-upgrade enabled in the Stable channel will be upgraded from version 1.24 to version 1.25.10-gke.2100 with this release.
- Control planes and nodes with auto-upgrade enabled in the Stable channel will be upgraded from version 1.25 to version 1.25.10-gke.2100 with this release.
- Control planes and nodes with auto-upgrade enabled in the Stable channel will be upgraded from version 1.26 to version 1.26.5-gke.2100 with this release.
Regular channel
- Version 1.27.3-gke.100 is now the default version in the Regular channel.
- The following versions are now available in the Regular channel:
- The following versions are no longer available in the Regular channel:
- 1.22.17-gke.14100
- 1.23.17-gke.8400
- 1.24.14-gke.1400
- 1.25.10-gke.1400
- 1.26.5-gke.1400
- 1.27.2-gke.1200
- Control planes and nodes with auto-upgrade enabled in the Regular channel will be upgraded from version 1.22 to version 1.23.17-gke.10000 with this release.
- Control planes and nodes with auto-upgrade enabled in the Regular channel will be upgraded from version 1.23 to version 1.24.14-gke.2700 with this release.
- Control planes and nodes with auto-upgrade enabled in the Regular channel will be upgraded from version 1.24 to version 1.25.10-gke.2700 with this release.
- Control planes and nodes with auto-upgrade enabled in the Regular channel will be upgraded from version 1.25 to version 1.26.5-gke.2700 with this release.
- Control planes and nodes with auto-upgrade enabled in the Regular channel will be upgraded from version 1.26 to version 1.26.5-gke.2700 with this release.
- Control planes and nodes with auto-upgrade enabled in the Regular channel will be upgraded from version 1.27 to version 1.27.3-gke.100 with this release.
Rapid channel
- Version 1.27.3-gke.1700 is now the default version in the Rapid channel.
- The following versions are now available in the Rapid channel:
- The following versions are no longer available in the Rapid channel:
- 1.22.17-gke.14100
- 1.23.17-gke.8400
- 1.24.15-gke.1700
- 1.25.10-gke.2700
- 1.26.5-gke.2700
- 1.27.3-gke.100
- Control planes and nodes with auto-upgrade enabled in the Rapid channel will be upgraded from version 1.22 to version 1.23.17-gke.10000 with this release.
- Control planes and nodes with auto-upgrade enabled in the Rapid channel will be upgraded from version 1.23 to version 1.24.16-gke.500 with this release.
- Control planes and nodes with auto-upgrade enabled in the Rapid channel will be upgraded from version 1.24 to version 1.25.11-gke.1700 with this release.
- Control planes and nodes with auto-upgrade enabled in the Rapid channel will be upgraded from version 1.25 to version 1.26.6-gke.1700 with this release.
- Control planes and nodes with auto-upgrade enabled in the Rapid channel will be upgraded from version 1.26 to version 1.27.3-gke.1700 with this release.
- Control planes and nodes with auto-upgrade enabled in the Rapid channel will be upgraded from version 1.27 to version 1.27.3-gke.1700 with this release.
(2023-R17) Version updates
- Version 1.27.3-gke.100 is now the default version.
- The following control plane and node versions are now available:
- The following control plane versions are no longer available:
- 1.22.17-gke.12700
- 1.22.17-gke.14100
- 1.23.17-gke.7700
- 1.24.14-gke.1200
- 1.25.10-gke.1200
- 1.25.10-gke.1400
- 1.26.5-gke.1200
- Control planes and nodes with auto-upgrade enabled will be upgraded from version 1.22 to version 1.23.17-gke.8400 with this release.
- Control planes and nodes with auto-upgrade enabled will be upgraded from version 1.23 to version 1.24.14-gke.1400 with this release.
- Control planes and nodes with auto-upgrade enabled will be upgraded from version 1.24 to version 1.25.10-gke.2100 with this release.
- Control planes and nodes with auto-upgrade enabled will be upgraded from version 1.25 to version 1.25.10-gke.2100 with this release.
- Control planes and nodes with auto-upgrade enabled will be upgraded from version 1.26 to version 1.26.5-gke.2100 with this release.
- Control planes and nodes with auto-upgrade enabled will be upgraded from version 1.27 to version 1.27.3-gke.100 with this release.
(2023-R17) Version updates
- Version 1.27.3-gke.100 is now the default version in the Stable channel.
- The following versions are now available in the Stable channel:
- The following versions are no longer available in the Stable channel:
- 1.22.17-gke.12700
- 1.23.17-gke.7700
- 1.24.14-gke.1200
- 1.25.10-gke.1200
- 1.26.5-gke.1400
- Control planes and nodes with auto-upgrade enabled in the Stable channel will be upgraded from version 1.22 to version 1.23.17-gke.8400 with this release.
- Control planes and nodes with auto-upgrade enabled in the Stable channel will be upgraded from version 1.23 to version 1.24.14-gke.1400 with this release.
- Control planes and nodes with auto-upgrade enabled in the Stable channel will be upgraded from version 1.24 to version 1.25.10-gke.2100 with this release.
- Control planes and nodes with auto-upgrade enabled in the Stable channel will be upgraded from version 1.25 to version 1.25.10-gke.2100 with this release.
- Control planes and nodes with auto-upgrade enabled in the Stable channel will be upgraded from version 1.26 to version 1.26.5-gke.2100 with this release.
(2023-R17) Version updates
- Version 1.27.3-gke.100 is now the default version in the Regular channel.
- The following versions are now available in the Regular channel:
- The following versions are no longer available in the Regular channel:
- 1.22.17-gke.14100
- 1.23.17-gke.8400
- 1.24.14-gke.1400
- 1.25.10-gke.1400
- 1.26.5-gke.1400
- 1.27.2-gke.1200
- Control planes and nodes with auto-upgrade enabled in the Regular channel will be upgraded from version 1.22 to version 1.23.17-gke.10000 with this release.
- Control planes and nodes with auto-upgrade enabled in the Regular channel will be upgraded from version 1.23 to version 1.24.14-gke.2700 with this release.
- Control planes and nodes with auto-upgrade enabled in the Regular channel will be upgraded from version 1.24 to version 1.25.10-gke.2700 with this release.
- Control planes and nodes with auto-upgrade enabled in the Regular channel will be upgraded from version 1.25 to version 1.26.5-gke.2700 with this release.
- Control planes and nodes with auto-upgrade enabled in the Regular channel will be upgraded from version 1.26 to version 1.26.5-gke.2700 with this release.
- Control planes and nodes with auto-upgrade enabled in the Regular channel will be upgraded from version 1.27 to version 1.27.3-gke.100 with this release.
(2023-R17) Version updates
- Version 1.27.3-gke.1700 is now the default version in the Rapid channel.
- The following versions are now available in the Rapid channel:
- The following versions are no longer available in the Rapid channel:
- 1.22.17-gke.14100
- 1.23.17-gke.8400
- 1.24.15-gke.1700
- 1.25.10-gke.2700
- 1.26.5-gke.2700
- 1.27.3-gke.100
- Control planes and nodes with auto-upgrade enabled in the Rapid channel will be upgraded from version 1.22 to version 1.23.17-gke.10000 with this release.
- Control planes and nodes with auto-upgrade enabled in the Rapid channel will be upgraded from version 1.23 to version 1.24.16-gke.500 with this release.
- Control planes and nodes with auto-upgrade enabled in the Rapid channel will be upgraded from version 1.24 to version 1.25.11-gke.1700 with this release.
- Control planes and nodes with auto-upgrade enabled in the Rapid channel will be upgraded from version 1.25 to version 1.26.6-gke.1700 with this release.
- Control planes and nodes with auto-upgrade enabled in the Rapid channel will be upgraded from version 1.26 to version 1.27.3-gke.1700 with this release.
- Control planes and nodes with auto-upgrade enabled in the Rapid channel will be upgraded from version 1.27 to version 1.27.3-gke.1700 with this release.
The AcceptSpoke and RejectSpoke API methods and the network-connectivity spokes accept and network-connectivity spokes reject CLI commands have the following usability issue:
- As the user, if you do not have the
networkconnectivity.operations.getIAM permission in a spoke project, you cannot get the status of a long-running operation for that spoke.
The issue is being worked on. The workaround is that the spoke administrator can grant the required permissions to the appropriate hub administrator. For information about granting permissions, see Give access.
August 07, 2023
Apigee XOn August 7, 2023, we released an updated version of Apigee X (1-10-0-apigee-7).
| Bug ID | Description |
|---|---|
| N/A | Upgraded infrastructure and libraries. |
Accessing a service that's prohibited by the Internal or Internal and Cloud Load Balancing ingress setting now results in a 404 rather than 403 error code.
Accessing a service that's prohibited by the Internal or Internal and Cloud Load Balancing ingress setting now results in a 404 rather than 403 error code.
Accessing a service that's prohibited by the Internal or Internal and Cloud Load Balancing ingress setting now results in a 404 rather than 403 error code.
Accessing a service that's prohibited by the Internal or Internal and Cloud Load Balancing ingress setting now results in a 404 rather than 403 error code.
Accessing a service that's prohibited by the Internal or Internal and Cloud Load Balancing ingress setting now results in a 404 rather than 403 error code.
Accessing a service that's prohibited by the Internal or Internal and Cloud Load Balancing ingress setting now results in a 404 rather than 403 error code.
Accessing a service that's prohibited by the Internal or Internal and Cloud Load Balancing ingress setting now results in a 404 rather than 403 error code.
Accessing a service that's prohibited by the Internal or Internal and Cloud Load Balancing ingress setting now results in a 404 rather than 403 error code.
Accessing a service that's prohibited by the Internal or Internal and Cloud Load Balancing ingress setting now results in a 404 rather than 403 error code.
Accessing a service that's prohibited by the Internal or Internal and Cloud Load Balancing ingress setting now results in a 404 rather than 403 error code.
Accessing a service that's prohibited by the Internal or Internal and Cloud Load Balancing ingress setting now results in a 404 rather than 403 error code.
Accessing a service that's prohibited by the Internal or Internal and Cloud Load Balancing ingress setting now results in a 404 rather than 403 error code.
Accessing a service that's prohibited by the Internal or Internal and Cloud Load Balancing ingress setting now results in a 404 rather than 403 error code.
Accessing a service that's prohibited by the Internal or Internal and Cloud Load Balancing ingress setting now results in a 404 rather than 403 error code.
The quantitive LIKE operator is now in
preview. With this operator, you can check a search value for matches against several patterns, using one of these conditions:
LIKE ANY: Checks if at least one pattern matches.LIKE SOME: Synonym forLIKE ANY.LIKE ALL: Checks if every pattern matches.
The following JSON functions are now generally available (GA).
JSON_ARRAY: Creates a JSON array.JSON_ARRAY_APPEND: Appends JSON data to the end of a JSON array.JSON_ARRAY_INSERT: Inserts JSON data into a JSON array.JSON_OBJECT: Creates a JSON object.JSON_REMOVE: Produces JSON with the specified JSON data removed.JSON_SET: Inserts or replaces JSON data.JSON_STRIP_NULLS: Removes JSON nulls.LAX_BOOL: Attempts to convert a JSON value to a SQLBOOLvalue.LAX_FLOAT64: Attempts to convert a JSON value to a SQLFLOAT64value.LAX_INT64: Attempts to convert a JSON value to a SQLINT64value.LAX_STRING: Attempts to convert a JSON value to a SQLSTRINGvalue.
BigQuery now supports the ability to deny access to principals via deny policies for the following IAM permissions :
- Managing reservations and capacity commitments:
bigquery.googleapis.com/capacityCommitments.*, bigquery.googleapis.com/bireservations.*, bigquery.googleapis.com/reservationAssignments.*, bigquery.googleapis.com/reservations.* - Resource Deletion:
bigquery.googleapis.com/[datasets, tables, models, routines, jobs, connections].delete - Dataset tag bindings:
bigquery.googleapis.com/datasets.[createTagBinding, listTagBinding] - Row Access Policies:
bigquery.rowAccessPolicies.[create, delete, update, setIamPolicy]
A weekly digest of client library updates from across the Cloud SDK.
Node.js
Changes for @google-cloud/bigquery
7.1.1 (2023-08-03)
Bug Fixes
7.1.0 (2023-08-01)
Features
- Support and optionally parse JSON field (#1229) (cd11447)
- Support create/list datasets on a different project (#1230) (86c63fb)
7.0.0 (2023-07-31)
⚠ BREAKING CHANGES
- migrate to node 14 (#1236)
Bug Fixes
Miscellaneous Chores
Analytics Hub now supports the use of routines in linked datasets. This feature is now in preview.
Airflow CLI commands no longer require access to the control plane of your environment's cluster.
The composer.environments.executeAirflowCommand permission is now required to run Airflow CLI commands through the gcloud environments run command:
The
composer.userandcomposer.environmentAndStorageObjectViewerroles do not have this permission and are not permitted to run Airflow CLI commands.This permission is added to the
composer.adminandcomposer.environmentAndStorageObjectAdminroles.
You can run Airflow CLI commands through Cloud Composer API.
Fixed the cause of failures when creating Qwiklabs environments in some scenarios.
GCSFuse version updated to 1.01. Cloud Composer uses GCSFuse to sync files between the environment bucket and worker pods.
Cloud Composer 2.4.0 images are available:
- composer-2.4.0-airflow-2.5.3 (default)
- composer-2.4.0-airflow-2.4.3
Cloud Composer versions 2.0.22 and 1.19.5 have reached their end of full support period.
You can now select internal Application Load Balancers as a health checked target for DNS routing policies. For more information, see Manage DNS routing policies and health checks.
Accessing a service that's prohibited by the Internal or Internal and Cloud Load Balancing ingress setting now results in a 404 rather than 403 error code.
Cloud Logging now supports the following regions:
- europe-west10
- europe-west12
- me-central2
For more information, see Supported regions.
The Metrics management page in Cloud Monitoring replaces the Metrics diagnostics page, extending the information available about the chargeable metrics in your Google Cloud projects. For more information, see View metric usage and diagnostics.
Observability for Google Kubernetes Engine: Charts on the Observability tab for each of your GKE clusters and workloads now includes an optional fleet ID filter, where applicable. If the current project is a host project for a fleet, the cluster and workload charts show metrics from all projects in the fleet, even if the metrics are hosted in a different project.
cos-dev-113-17811-0-0
| Kernel | Docker | Containerd | GPU Drivers |
| COS-6.1.42 | v24.0.4 | v1.7.2 | v535.54.03(default),v470.199.02(R470) |
Simplified GPU driver installation by remounting driver installation path as executable from cos-extensions.
Updated GPU drivers to 535.54.03 (R535 LTSB NVIDIA branch).
Updated google-guest-agent to v20230726.00.
Updated app-emulation/cloud-init to v23.2.1.
Updated sys-apps/systemd to v253.7.
Update cos-gpu-installer to v2.1.2. Switched precompiled driver and signature location to COS build artifacts for M109.
Updated the Linux kernel to v6.1.42.
Added support for user.* xattr on tmpfs.
Upgraded net-misc/curl to v8.2.1.
Upgraded sys-apps/file to v5.45-r1.
Upgraded app-editors/vim to v9.0.1627, Upgraded app-editors/vim-core to v9.0.1627.
Upgraded sys-process/procps to v3.3.17-r2.
Upgraded sys-process/lsof to v4.98.0-r1.
Upgraded sys-block/thin-provisioning-tools to v0.9.0-r2.
Upgraded sys-apps/pv to v1.7.0.
Upgraded sys-apps/less to v633-r2.
Upgraded net-fs/cifs-utils to v7.0.
Upgraded app-misc/jq to v1.7_pre20230210.
Upgraded app-arch/tar to v1.35.
Upgraded app-admin/sudo to v1.9.14_p3.
Fixed CVE-2022-40896 in pygments.
cos-93-16623-461-1
| Kernel | Docker | Containerd | GPU Drivers |
| COS-5.10.186 | v20.10.24 | v1.6.20 | v450.248.02(default),v470.199.02(R470),v525.125.06 |
Updated app-emulation/docker and app-emulation/docker-cli to v20.10.24.
Updated containerd to v1.6.20.
Updated app-admin/google-osconfig-agent to v20230222.00.
Updated open-vm-tools to 12.2.5 to fix CVE-2023-20867
cos-101-17162-279-6
| Kernel | Docker | Containerd | GPU Drivers |
| COS-5.15.120 | v20.10.24 | v1.6.21 | v470.199.02(default),v525.125.06 |
Fixed CVE-2022-28737 in sys-boot/shim.
Fixed CVE-2023-38408 in net-misc/openssh.
Fixed CVE-2022-40896 in dev-python/pygments.
Fixed CVE-2023-3776 in the Linux kernel.
Added a dataproc:dataproc.cluster.caching.enabled flag to enable and disable Dataproc on Compute Engine cluster caching. The flag is false by default. Use this feature with the latest Dataproc on Compute Engine images.
You can now visualize heatmap pattern for index keys and make better workload pattern predictions. To learn more, see Key Visualizer. This feature is in Preview.
A weekly digest of client library updates from across the Cloud SDK.
Java
Changes for google-cloud-datastore
2.16.3 (2023-08-02)
Documentation
Dependencies
You can now visualize heatmap pattern for entity keys and make better workload pattern predictions. To learn more, see Key Visualizer. This feature is in Preview.
You can now specify custom actions to perform before and/or after deploying, using deploy hooks, supported in preview.
A weekly digest of client library updates from across the Cloud SDK.
Node.js
Changes for @google-cloud/pubsub
4.0.0 (2023-08-03)
⚠ BREAKING CHANGES
- node 12 eos (#1774) (#1784)
Features
Bug Fixes
Java
Changes for google-cloud-pubsub
1.124.1 (2023-08-03)
Dependencies
Google Cloud's Agent for SAP version 2.4
Version 2.4 of Google Cloud's Agent for SAP is generally available (GA). This version includes bug fixes for the collection of Workload Manager Corosync validation metrics.
For more information, see What's new with Google Cloud's Agent for SAP.
August 06, 2023
Cloud NATCloud NAT support for Standard Tier egress is available in General Availability.
The following previously released sub-minor versions of Dataproc on Compute Engine images unintentionally reverted several dependency library versions. This caused a risk of backward-incompatibility for some workloads.
These sub-minor versions have been rolled back, and can only be used when updating existing clusters that already use them:
- 2.0.71-debian10, 2.0.71-rocky8, 2.0.71-ubuntu18
- 2.1.19-debian11, 2.1.19-rocky8, 2.1.19-ubuntu20, 2.1.19-ubuntu20-arm
August 05, 2023
Access ApprovalAccess Approval supports AlloyDB for PostgreSQL in the GA stage.
Access Transparency supports AlloyDB for PostgreSQL in the GA stage.
New Dataproc on Compute Engine image versions:
- 2.0.72-debian10, 2.0.72-rocky8, 2.0.72-ubuntu18
- 2.1.20-debian11, 2.1.20-rocky8, 2.1.20-ubuntu20, 2.1.20-ubuntu20-arm
Upgraded Hudi to 0.12.3 and added the BigQuery Sync tool as part of the Hudi optional component.
Downgraded Cloud Storage connector version to 2.2.15 in all Dataproc on Compute Engine image versions to prevent potential performance regression.
Backported ZEPPELIN-5434 to image 2.1 to fix CVE-2022-2048.
Backported the patches for HIVE-22170 and HIVE-22331.