The following release notes cover the most recent changes over the last 60 days. For a comprehensive list of product-specific release notes, see the individual product release note pages.
You can also see and filter all release notes in the Google Cloud console or you can programmatically access release notes in BigQuery.
To get the latest product updates delivered to you, add the URL of this page to your
feed
reader, or add the feed URL directly: https://cloud.google.com/feeds/gcp-release-notes.xml
January 26, 2023
Network Intelligence CenterConnectivity Tests now includes a feature that verifies connectivity from a Cloud Run revision to a VM instance, an IP address, or a Google-managed service. For more information, see Create and run Connectivity Tests.
Connectivity Tests now includes a feature that verifies connectivity from an App Engine standard environment version to a VM instance, an IP address, or a Google-managed service. For more information, see Create and run Connectivity Tests.
January 25, 2023
Anthos clusters on VMwareAnthos clusters on VMware version 1.14.0 has a known issue where the calico-node Pod is unable to renew the auth token in the calico CNI kubeconfig file.
For more information, see
Pod create or delete errors due to Calico CNI service account auth token issue.
Because of this issue, you cannot use Anthos On-Prem API clients to create and manage 1.14.0 clusters.
Cloud Composer 1.20.4 and 2.1.4 release started on January 25, 2023. Get ready for upcoming changes and features as we roll out the new release to all regions. This release is in progress at the moment. Listed changes and features might not be available in some regions yet.
Cloud Composer 1.20.4 and 2.1.4 images are available:
- composer-1.20.4-airflow-1.10.15 (default)
- composer-1.20.4-airflow-2.2.5
- composer-1.20.4-airflow-2.3.4
- composer-1.20.4-airflow-2.4.3
- composer-2.1.4-airflow-2.2.5
- composer-2.1.4-airflow-2.3.4 (default)
- composer-2.1.4-airflow-2.4.3
(Airflow 2.2.5 only) The apache-airflow-providers-google package in images with Airflow 2.2.5 was upgraded to 2022.12.20+composer. Changes compared to version 2022.10.17+composer:
Cloud Composer 1.20.4 and 2.1.4 images are available:
- composer-1.20.4-airflow-1.10.15 (default)
- composer-1.20.4-airflow-2.2.5
- composer-1.20.4-airflow-2.3.4
- composer-1.20.4-airflow-2.4.3
- composer-2.1.4-airflow-2.2.5
- composer-2.1.4-airflow-2.3.4 (default)
- composer-2.1.4-airflow-2.4.3
Cloud Composer versions 2.0.2 and 1.17.9 have reached their end of full support period.
Now the alerting policy can forecast, or predict, that the threshold will be violated within a configurable time window. These policies are designed to monitor constraint metrics like those that record quota, memory, and storage usage. Forecasting alerts is in Public Preview. For more information, see Forecast condition.
January 24, 2023
AI Platform TrainingRuntime version 2.11 is available. You can use runtime version 2.11 to train with TensorFlow 2.11, scikit-learn 1.0.2, or XGBoost 1.6.1. Runtime version 2.11 supports training with CPUs, GPUs, or TPUs.
See the full list of updated dependencies in runtime version 2.11.
1.13.9-asm.10 is now available for in-cluster Anthos Service Mesh.
You can now download 1.13.9-asm.10 for in-cluster Anthos Service Mesh. It includes the features of Istio 1.13.9 subject to the list of supported features.
Announcing the General Availability (GA) release of the Dataproc driver node groups.
You can now expose randomly assigned host ports in Pods on GKE Autopilot running version 1.24.7-gke.1200 and later or 1.25.3-gke.1100 and later.
Configurable IAM recommendations are now generally available. With configurable IAM recommendations, you can set the minimum observation period for the IAM recommender to 30 or 60 days instead of the default period of 90 days.
General availability for the following integration:
January 23, 2023
AI Platform Data Labeling ServiceAI Hub and the legacy versions of the following products are deprecated and will no longer be available on Google Cloud after January 17, 2024:
All the functionality of these legacy versions and new features are available on the Vertex AI platform. See Migrate to Vertex AI to learn how to migrate your resources.
Access Transparency supports Cloud NAT in GA stage. For the complete list of services that Access Transparency supports, see Supported services.
AI Hub and the legacy versions of the following products are deprecated and will no longer be available on Google Cloud after January 17, 2024:
All the functionality of these legacy versions and new features are available on the Vertex AI platform. See Migrate to Vertex AI to learn how to migrate your resources.
AI Hub and the legacy versions of the following products are deprecated and will no longer be available on Google Cloud after January 17, 2024:
All the functionality of these legacy versions and new features are available on the Vertex AI platform. See Migrate to Vertex AI to learn how to migrate your resources.
AI Hub and the legacy versions of the following products are deprecated and will no longer be available on Google Cloud after January 17, 2024:
All the functionality of these legacy versions and new features are available on the Vertex AI platform. See Migrate to Vertex AI to learn how to migrate your resources.
AI Hub and the legacy versions of the following products are deprecated and will no longer be available on Google Cloud after January 17, 2024:
All the functionality of these legacy versions and new features are available on the Vertex AI platform. See Migrate to Vertex AI to learn how to migrate your resources.
AI Hub and the legacy versions of the following products are deprecated and will no longer be available on Google Cloud after January 17, 2024:
All the functionality of these legacy versions and new features are available on the Vertex AI platform. See Migrate to Vertex AI to learn how to migrate your resources.
A weekly digest of client library updates from across the Cloud SDK.
Python
Changes for google-cloud-bigquery
3.4.2 (2023-01-13)
Bug Fixes
Dependencies
Documentation
- Create sample to write schema file from table (#1439) (093cc68)
- Created samples for load table and create table from schema file (#1436) (8ad2e5b)
- Revise create table cmek sample (#1452) (57740e4)
- Revise get table labels code sample, add TODO to clean up snipp… (#1464) (b5ccbfe)
- Revise label table code samples (#1451) (14ae1f2)
- Revise sample for nested schema (#1446) (a097631)
A weekly digest of client library updates from across the Cloud SDK.
Java
Changes for google-cloud-bigtable
2.18.1 (2023-01-17)
Dependencies
Cloud Build repositories (2nd gen) lets you easily create and manage repository connections, not only through Cloud Console but also through gcloud and the Cloud Build API. Cloud Build repositories (2nd gen) is available for GitHub and GitHub Enterprise repositories at the preview release stage. To learn more, see the Repositories overview page.
New Dataproc Serverless for Spark runtime versions:
- 1.0.27
- 2.0.7
The value of hive.server2.builtin.udf.blacklist is now set by default to reflect,reflect2 in hive-site.xml to prevent arbitrary code execution.
Added support for enabling Hive Metastore OSS metrics by passing hivemetastore to --metric-sources property during cluster creation.
A weekly digest of client library updates from across the Cloud SDK.
Node.js
Changes for @google-cloud/datastore
7.1.0 (2023-01-18)
Features
- Add datastore aggregation query APIs (#1008) (d5c2cb1)
- Add the count aggregate function (#972) (76adfc6)
- Snapshot reads (#963) (0ecca86)
- Support regapic LRO (#957) (99778fb)
Bug Fixes
- Allow passing gax instance to client constructor (#974) (386b9c7)
- Better support for fallback mode (#967) (0447d87)
- Bring back LRO mixin (#1009) (1d8de5f)
- Change import long to require (#968) (5e710f2)
- deps: Update dependency @google-cloud/promisify to v3 (#942) (7b35856)
- deps: Use google-gax v3.5.2 (#1013) (1753eae)
- Do not import the whole google-gax from proto JS (#1553) (#973) (9550bbc)
- Preserve default values in x-goog-request-params header (#979) (2b80e1e)
- Regenerated protos JS and TS definitions (#1016) (d0ae656)
- Remove pip install statements (#1546) (#970) (2225fc7)
- Use google-gax v3.3.0 (9550bbc)
Python
Changes for google-cloud-datastore
2.13.0 (2023-01-14)
Features
You now receive an ENTITLEMENT_OFFER_ACCEPTED Pub/Sub message when a customer accepts a private offer. For details, refer to List of event types for account tasks.
Removed ability to create stateful outbound firewall rules for new projects and projects that have not yet created stateful outbound rules. Customers can continue to create a firewall rule set in NSX-T Gateway or NSX-T Distributed Firewall rules to limit or control outbound access.
A weekly digest of client library updates from across the Cloud SDK.
Java
Changes for google-cloud-pubsub
1.123.1 (2023-01-20)
Dependencies
- Update dependency com.google.cloud:google-cloud-bigquery to v2.20.2 (#1441) (a675556)
- Update dependency com.google.cloud:google-cloud-core to v2.9.2 (#1449) (e68c9e0)
- Update dependency com.google.cloud:google-cloud-shared-dependencies to v3.1.2 (#1463) (e9e6649)
- Update dependency com.google.protobuf:protobuf-java-util to v3.21.12 (#1437) (88f7a99)
- Update dependency org.junit.vintage:junit-vintage-engine to v5.9.2 (#1451) (054572a)
Python
Changes for google-cloud-pubsub
2.14.0 (2023-01-18)
Features
You can now migrate your producers from Apache Kafka to Pub/Sub Lite with only configuration changes. To check the feasibility of the migration and to perform the migration workflow, refer to the Kafka to Pub/Sub Lite migration guide.
January 20, 2023
ChronicleListCuratedRules and ListCuratedRuleDetections
Two new methods are now available for the Detection Engine API. ListCuratedRules enables you to return a current list of all of the Chronicle rules with detections. ListCuratedRuleDetections enables you to return a list of the detections associated with a specified rule.
The following changes are available in the Unified Data Model:
- A new field, called
source_labels, was added to EntityMetadata. - A new field, called
enrichment_state, was added to event.metadata. - A new field, called
ip_geo_artifact, was added to Noun. - A new field, called
parsed_user_agent, was added to network.http. - A new enumerated list, called Metadata.EnrichmentState, was added.
- The new type was added, called Artifact.
- The following values were added to the relation.relationship enumerated list:
EXECUTES,DOWNLOADED_FROM, andCONTACTS. - The following values were added to Noun.Platform enumerated list:
IOS,ANDROID,CHROME_OS. - The following value was added to the SecurityResult.SecurityCategory enumerated list, called
TOR_EXIT_NODE.
For a list of all fields in the Unified Data Model, and their descriptions, see the Unified Data Model field list.
You can now use the Observability tab on the Compute Engine VM instances page to see the five virtual machines consuming the most of a resource. For more information, see Troubleshooting VM performance issues.
You can now use the Observability tab on the Compute Engine VM instances page to see the five virtual machines consuming the most of a resource. For more information, see Troubleshooting VM performance issues.
Google Cloud Deploy now supports Skaffold version 2.0. The default Skaffold version remains 1.39.
January 19, 2023
Anthos Service Mesh1.14.6-asm.4 is now available for in-cluster Anthos Service Mesh.
You can now download 1.14.6-asm.4 for in-cluster Anthos Service Mesh. It includes the features of Istio 1.14.6 subject to the list of supported features.
On January 19, we released an updated version of Apigee X (1-9-0-apigee-19).
The VerifyAPIKey policy and the VerifyAccessToken action of the OAuth2 policy now support CacheExpiryInSeconds. Setting this variable enforces TTL on the cache and enables customization of the time period for cached token expiry.
| Bug ID | Description |
|---|---|
| 217173784 | The HMAC.policy-name.error variable is populated for HMAC failing policies. |
| 257268790 | Fixed bug where invalid proxy configuration halted Message Processor boot up. |
| 254911914 | ServiceCallout policy now working in async mode as expected. |
| 250638658 | Fixed the SetIntegrationRequest policy that fails if the JSON payload contains {foo}. |
| N/A | Upgraded infrastructure and libraries. |
You can now attach Resource Manager tags to datasets, which let you conditionally apply Identity and Access Management (IAM) policies to your resources. This feature is generally available (GA).
More than 20 BigQuery ML components for Vertex AI Managed Pipelines are now generally available. These components benefit AI/ML users for the following:
- Building pipelines using the KFP SDK and TFX SDK
- Linking and tracking metadata automatically
- Seamless integration with Vertex AI for online prediction
Major Google Cloud pipeline components available in Vertex AI are.
You can now use the TRANSFORM clause to train models which you can then export in the Tensorflow SavedModel format. This feature is now available in preview.
The following functions have been added for BigQuery ML:
These features are now available in preview.
Chronicle has released a set of ingestion scripts, written in Python, that can be deployed as Cloud Functions. These scripts ingest data from the following log sources, listed by name and ingestion label:
- Citrix audit logs (CITRIX_MONITOR)
- Duo Admin (DUO_ADMIN)
- One Login User Context (ONELOGIN_USER_CONTEXT)
- MISP (MISP_IOC)
- Citrix session metadata (CITRIX_SESSION_METADATA)
- Slack Audit (SLACK_AUDIT)
- Box (BOX)
- OneLogin (ONELOGIN_SSO)
- Google Cloud Pub/Sub
- STIX/TAXII threat intelligence (STIX)
The scripts can be used as-is or as templates to customize and ingest logs from another product. They are located in the Chronicle GitHub repository. See Use ingestion scripts deployed as Cloud Functions for instructions about how to configure and deploy the scripts in your environment.
Database Migration Service support for migrating Oracle workloads into Cloud SQL for PostgreSQL is now in Public Preview. Click here to access the documentation.
Dedicated Interconnect support is available in the following colocation facilities:
- Telefónica Nabiax Alcala datacentre, Madrid
- Telecom Italia Cebrosa Campus, Turin
For more information, see the Locations table.
MySQL 8.0.29 was deprecated on January 19, 2023. You will not be able to create new instances for MySQL 8.0.29, upgrade existing instances to MySQL 8.0.29, or promote an existing MySQL 8.0.29 replica to primary. For more information, see Changes in my MySQL 8.0.29.
If you have a MySQL 8.0.29 instance, it will automatically be upgraded to MySQL 8.0.30 as part of regular maintenance prior to March 31, 2023. You can also upgrade your instance to higher available versions. See Upgrade the database minor version for more information.
Some gsutil commands that use the -m global flag, such as cp and rsync, are currently failing if the requester does not have the storage.buckets.get permission.
If you installed gsutil as part of the Cloud SDK, you can work around this issue by reverting to an earlier version. To do so, run the command
gcloud components update --version=413.0.0If you installed gsutil as a standalone tool, you can work around this issue by reverting to version 5.17
Dataproc Metastore is available in the following regions: asia-east2 (Hong Kong), europe-central2 (Warsaw), europe-north1 (Finland), and us-west4 (Las Vagas). For more information, see Dataproc Metastore locations.
Preview stage support for the following integration:
January 18, 2023
Anthos Service Mesh1.15.4-asm.2 is now available for in-cluster Anthos Service Mesh.
You can now download 1.15.4-asm.2 for in-cluster Anthos Service Mesh. It includes the features of Istio 1.15.4 subject to the list of supported features.
1.13.9-asm.9 is now available for in-cluster Anthos Service Mesh.
You can now download 1.13.9-asm.9 for in-cluster Anthos Service Mesh. It includes the features of Istio 1.13.9 subject to the list of supported features.
Service mesh cloud gateway is now available as a preview feature for managed Anthos Service Mesh in the rapid release channel. With service mesh cloud gateway, you can configure Anthos Service Mesh ingress gateway with Cloud Load Balancing through the Kubernetes Gateway API. For more information, see Configure external HTTP(S) Load Balancing for managed Anthos Service Mesh.
The following supported default parsers have changed. Each is listed by product name and ingestion label, if applicable.
- Atlassian Jira (ATLASSIAN_JIRA)
- Azure AD (AZURE_AD)
- CrowdStrike Falcon (CS_EDR)
- ESET AV (ESET_AV)
- FortiGate (FORTINET_FIREWALL)
- GitHub (GITHUB)
- Infoblox (INFOBLOX)
- Juniper (JUNIPER_FIREWALL)
- Juniper Junos (JUNIPER_JUNOS)
- Kubernetes Node logs (KUBERNETES_NODE)
- McAfee Web Gateway (MCAFEE_WEBPROXY)
- Microsoft Defender for Endpoint (MICROSOFT_DEFENDER_ENDPOINT)
- Netskope Web Proxy (NETSKOPE_WEBPROXY)
- Office 365 (OFFICE_365)
- Pulse Secure (PULSE_SECURE_VPN)
- Ruckus Networks (RUCKUS_WIRELESS)
- Sentinelone Alerts (SENTINELONE_ALERT)
- SentinelOne EDR (SENTINEL_EDR)
- Silverfort Authentication Platform (SILVERFORT)
- VMware vCenter (VMWARE_VCENTER)
- Windows Event (XML) (WINEVTLOG_XML)
- Zscaler (ZSCALER_WEBPROXY)
For details about changes in each parser, see Supported default parsers.
Client-side metrics are now available to customers who use the Cloud Bigtable HBase client for Java version 2.6.4 or later. To learn more about using client-side monitoring metrics for performance optimization and troubleshooting, see the Client-side metrics overview.
Committed Use Discounts: View your usage data at an hourly granularity in the CUD Analysis dashboard
You can now analyze the effectiveness of your spend-based or resource-based committed use discounts at an hourly granularity. Previously, you could only analyze your CUDs at the daily level.
Access your usage data at an hourly granularity in the CUD Analysis dashboard.
Users can now configure private pools to consume fewer IP addresses within their peered Virtual Private Clouds (VPCs). The new peeredNetworkIpRange config field enables users to specify a starting IP address and the IP block size that a private pool uses. The IP block size can be as small as /29. This feature is generally available.
The ability to optionally configure 2nd gen functions with user-specified concurrency and vCPU is now available in preview.
Cloud Functions now supports the Node.js 18 runtime at the General Availability release level.
Dataplane v2 for Cloud Interconnect is fully available for customers using Dedicated Interconnect or Partner Interconnect in the following regions:
us-west2(Los Angeles)us-west4(Las Vegas)
All new VLAN attachments that you create in these regions are automatically provisioned on Dataplane v2. Existing VLAN attachments for these regions can be migrated to Dataplane v2. You can migrate existing attachments yourself by re-creating the attachments, or you can request and schedule an assisted migration. Contact Google Cloud Support for assistance.
Cloud SQL now supports viewing an audit log for an automated backup of an instance to verify whether the backup is completed successfully. You can also configure a log-based alert so that a user can be notified of the backup's status.
Cloud SQL now supports viewing an audit log for an automated backup of an instance to verify whether the backup is completed successfully. You can also configure a log-based alert so that a user can be notified of the backup's status.
Cloud SQL for SQL Server enables you to use point-in-time recovery.
Point-in-time recovery helps you recover an instance to a specific point in time. For example, if an error causes a loss of data, you can recover a database to its state before the error occurred. This feature is generally available.
Cloud SQL now supports viewing an audit log for an automated backup of an instance to verify whether the backup is completed successfully. You can also configure a log-based alert so that a user can be notified of the backup's status.
gcloud storage GA release 1.2 is now available.
- The 1.2 release adds support for managing access with IAM and ACLs at the bucket and object level.
- The 1.2 release also adds support for managing the Autoclass and turbo replication features.
Dialogflow CX now provides channel-specific responses.
Dialogflow CX now provides custom payload templates.
Vertex AI Explainability
When uploading TensorFlow 2 models, the ExplanationMetadata field is now optional, making it easier to configure your model for explainability. For more information, see Import a model with an explanationSpec field.
January 17, 2023
Apigee Integrated PortalOn January 17, 2023 we released an updated version of Apigee integrated portal.
| Bug ID | Description |
|---|---|
| 262260756 | We have updated the new account notification to administrators to read: "A new account was created by {{firstname}} {{lastname}} ({{email}}), for site {{siteurl}}. If you have enabled manual approval for new user accounts, this user will not be able to log in until you approve their account creation request by setting their status to 'active'." This is to highlight that they need to manually activate new accounts ONLY if they have enabled manual approval for new accounts. |
| 261788412 | Updated the version of GraphiQL used in the portal. |
The Go 1.18 and Go 1.19 runtimes for App Engine standard environment are now generally available.
The Node.js 18 runtime for App Engine standard environment is now generally available.
Batch is available in the following regions:
northamerica-northeast1(Montréal)europe-west2(London)
For more information, see Locations.
BigQuery ML support for multivariate time-series forecasting with the ARIMA_PLUS_XREG model is now available in preview. This feature lets you perform time-series forecasting with extra feature columns. For more information, see the ARIMA_PLUS_XREG sections in the end-to-end user journey and the multivariate time-series forecasting from Seattle air quality data tutorial.
Sparse input support in BigQuery ML model training is now generally available (GA). This feature improves model training for data whose values are mostly zero or empty. For additional examples, see the sparse features support in BigQuery blog.
gcloud commands for creating and managing build triggers are now generally available.
Cloud CDN supports private origin authentication for Amazon Simple Storage Service (Amazon S3) and compatible object stores. This capability improves security by allowing only trusted connections to access the content on your private origins and preventing users from directly accessing it. This feature is supported in Preview.
Internal TCP/UDP load balancers can now be configured to handle private IPv6 traffic within your VPC. To enable this, you must configure your dual-stack subnet, backend VMs, health checks, and the forwarding rules to handle IPv6 traffic.
For details, see:
This feature is available in Preview.
You can now save your SQL queries, and you can set custom retention periods on log buckets upgraded to use Log Analytics. For more information, see Save a query.
Cloud SQL for MySQL now supports using the lower_case_table_names flag for MySQL 8.0. For more information, see Configure database flags.
You can now apply labels to Cloud Workstations resources.
For more information, see Label resources and Customize workstation configurations.
See also the labels field added to the following REST API resources:
workstation clusters,
workstation configurations,
workstations, and the following RPC resources:
location and
workstations.v1beta.
Migrating from Dialogflow ES to Dialogflow CX is recommended for complex agents, and migrating can significantly improve your agent design and end-user experience. See the new migration guide.
If you are running VMware Engine Horizon (VDI) on Google Cloud VMware Engine, you may encounter errors after changing your private cloud resource naming to meet the standards for Google Cloud CLI and VMware Engine API.
To troubleshoot this issue, see VMware Engine Known issues.
You can now attach ephemeral and block devices backed by Local NVMe SSDs during GKE node pool creation, using the Ephemeral Storage Local SSD API and the Local NVMe SSD Block API respectively, with node version 1.25.3-gke.1800 or later.
Temporary pricing for Storage Transfer Service has expired; refer to Pricing for current charges.
Customers under contract can reach out to Google Cloud representatives for details.
Starting with version 2.9, TensorFlow Enterprise releases are supported for one year. It is recommended that you update regularly to keep your projects within a supported TensorFlow Enterprise version. Previous TensorFlow Enterprise releases that included Long Term Version Support (three years) are still supported for the three-year time period.
January 16, 2023
BigQueryA weekly digest of client library updates from across the Cloud SDK.
Java
Changes for google-cloud-bigquery
2.20.2 (2023-01-12)
Dependencies
- Update com.google.cloud:google-cloud-bigquerystorage-bom to 2.28.1 (b62391d)
- Update dependency com.google.apis:google-api-services-bigquery to v2-rev20221209-2.0.0 (#2449) (9d0a107)
- Update dependency com.google.apis:google-api-services-bigquery to v2-rev20221217-2.0.0 (#2459) (08e2927)
- Update dependency com.google.cloud:google-cloud-shared-dependencies to v3.1.1 (#2455) (412710c)
- Update dependency org.junit.vintage:junit-vintage-engine to v5.9.2 (#2456) (04d47ad)
- Update dependency org.threeten:threeten-extra to v1.7.2 (#2450) (485be56)
A weekly digest of client library updates from across the Cloud SDK.
Java
Changes for google-cloud-bigtable
2.18.0 (2023-01-12)
Features
Bug Fixes
- Call attemptStarted method with the request (#1562) (325f09c)
- Defer instance admin api errors to RPC time rather then client construction time (#1576) (06a0ced)
Dependencies
Python
Changes for google-cloud-bigtable
2.15.0 (2023-01-10)
Features
A weekly digest of client library updates from across the Cloud SDK.
Preview: When a managed instance group (MIG) repairs a failed or an unhealthy VM, you can apply the latest instance template and per-instance configuration to recreate the VM instead of applying the configuration originally used to create the VM. For more information, see Apply configuration updates during repairs.
A weekly digest of client library updates from across the Cloud SDK.
Python
Changes for google-cloud-dataflow-client
0.8.0 (2023-01-10)
Features
A weekly digest of client library updates from across the Cloud SDK.
Python
Changes for google-cloud-datastore
2.12.0 (2023-01-10)
Features
Java
Changes for google-cloud-datastore
2.13.2 (2023-01-10)
Dependencies
Generally available: Migrate to Virtual Machines from an AWS source lets you migrate AWS EC2 instances to Compute Engine.
A weekly digest of client library updates from across the Cloud SDK.
Java
Changes for google-cloud-pubsub
1.123.0 (2023-01-10)
Features
Dependencies
Python
Changes for google-cloud-pubsub
2.13.12 (2023-01-06)
Bug Fixes
- deps: Require google-api-core >=1.34.0, >=2.11.0 (060f00b)
- Drop usage of pkg_resources (060f00b)
- Fix timeout default values (060f00b)
Documentation
- samples: Snippetgen should call await on the operation coroutine before calling result (060f00b)
January 13, 2023
ChronicleChronicle Curated Detections has been enhanced with the following additional detection content for Cloud threats. A new rule set was added, called Resource Masquerading, that detects Google Cloud resources created with names or characteristics of another resource or resource type. This could be used to mask malicious activity carried out by or within the resource, with the intent of appearing legitimate.
The default build timeout period has been extended. Cloud Build now allows builds to run for up to 60 minutes unless you specify another timeout limit by using the timeout field.
Config Controller now uses the following versions of its included products:
- Anthos Config Management v1.14.0, release notes
- Config Connector v1.98.0, release notes
New Dataproc Serverless for Spark runtime versions:
- 1.0.26
- 2.0.6
Stretched private clouds are now available in the australia-southeast1 (Sydney) Google Cloud region. Stretched private clouds enable you to stretch your vSphere/vSAN clusters across Google Cloud zones and protect against zone level failures. This functionality enables high levels of availability for business critical applications.
(2023-R02) Version updates
GKE cluster versions have been updated.
New versions available for upgrades and new clusters
The following Kubernetes versions are now available for new clusters and for opt-in control plane upgrades and node upgrades for existing clusters. For more information on versioning and upgrades, see GKE versioning and support and Upgrades.
No channel
- Version 1.24.8-gke.2000 is now the default version.
- The following control plane and node versions are now available:
- The following control plane versions are no longer available:
- 1.23.11-gke.300
- 1.23.12-gke.100
- 1.23.12-gke.1600
- 1.24.5-gke.600
- 1.24.6-gke.1500
- Control planes and nodes with auto-upgrade enabled will be upgraded from version 1.23 to version 1.23.14-gke.1800 with this release.
- Control planes and nodes with auto-upgrade enabled will be upgraded from version 1.24 to version 1.24.7-gke.900 with this release.
Stable channel
- Version 1.23.14-gke.1800 is now the default version in the Stable channel.
- Control planes and nodes with auto-upgrade enabled in the Stable channel will be upgraded from version 1.23 to version 1.23.14-gke.1800 with this release.
Regular channel
- Version 1.24.8-gke.2000 is now the default version in the Regular channel.
- Control planes and nodes with auto-upgrade enabled in the Regular channel will be upgraded from version 1.22 to version 1.23.14-gke.401 with this release.
- Control planes and nodes with auto-upgrade enabled in the Regular channel will be upgraded from version 1.24 to version 1.24.8-gke.2000 with this release.
Rapid channel
- Version 1.25.5-gke.1500 is now the default version in the Rapid channel.
- The following versions are now available in the Rapid channel:
- The following versions are no longer available in the Rapid channel:
- 1.21.14-gke.14100
- 1.22.15-gke.2500
- 1.23.14-gke.401
- 1.24.7-gke.900
- 1.25.4-gke.2100
- 1.26.0-gke.1500
- Control planes and nodes with auto-upgrade enabled in the Rapid channel will be upgraded from version 1.20 to version 1.21.14-gke.14600 with this release.
- Control planes and nodes with auto-upgrade enabled in the Rapid channel will be upgraded from version 1.21 to version 1.22.16-gke.1300 with this release.
- Control planes and nodes with auto-upgrade enabled in the Rapid channel will be upgraded from version 1.22 to version 1.23.14-gke.1800 with this release.
- Control planes and nodes with auto-upgrade enabled in the Rapid channel will be upgraded from version 1.23 to version 1.24.8-gke.401 with this release.
- Control planes and nodes with auto-upgrade enabled in the Rapid channel will be upgraded from version 1.24 to version 1.24.8-gke.401 with this release.
- Control planes and nodes with auto-upgrade enabled in the Rapid channel will be upgraded from version 1.25 to version 1.25.5-gke.1500 with this release.
- Control planes and nodes with auto-upgrade enabled in the Rapid channel will be upgraded from version 1.26 to version 1.26.0-gke.2000 with this release.
(2023-R02) Version updates
- Version 1.24.8-gke.2000 is now the default version.
- The following control plane and node versions are now available:
- The following control plane versions are no longer available:
- 1.23.11-gke.300
- 1.23.12-gke.100
- 1.23.12-gke.1600
- 1.24.5-gke.600
- 1.24.6-gke.1500
- Control planes and nodes with auto-upgrade enabled will be upgraded from version 1.23 to version 1.23.14-gke.1800 with this release.
- Control planes and nodes with auto-upgrade enabled will be upgraded from version 1.24 to version 1.24.7-gke.900 with this release.
(2023-R02) Version updates
- Version 1.23.14-gke.1800 is now the default version in the Stable channel.
- Control planes and nodes with auto-upgrade enabled in the Stable channel will be upgraded from version 1.23 to version 1.23.14-gke.1800 with this release.
(2023-R02) Version updates
- Version 1.24.8-gke.2000 is now the default version in the Regular channel.
- Control planes and nodes with auto-upgrade enabled in the Regular channel will be upgraded from version 1.22 to version 1.23.14-gke.401 with this release.
- Control planes and nodes with auto-upgrade enabled in the Regular channel will be upgraded from version 1.24 to version 1.24.8-gke.2000 with this release.
(2023-R02) Version updates
- Version 1.25.5-gke.1500 is now the default version in the Rapid channel.
- The following versions are now available in the Rapid channel:
- The following versions are no longer available in the Rapid channel:
- 1.21.14-gke.14100
- 1.22.15-gke.2500
- 1.23.14-gke.401
- 1.24.7-gke.900
- 1.25.4-gke.2100
- 1.26.0-gke.1500
- Control planes and nodes with auto-upgrade enabled in the Rapid channel will be upgraded from version 1.20 to version 1.21.14-gke.14600 with this release.
- Control planes and nodes with auto-upgrade enabled in the Rapid channel will be upgraded from version 1.21 to version 1.22.16-gke.1300 with this release.
- Control planes and nodes with auto-upgrade enabled in the Rapid channel will be upgraded from version 1.22 to version 1.23.14-gke.1800 with this release.
- Control planes and nodes with auto-upgrade enabled in the Rapid channel will be upgraded from version 1.23 to version 1.24.8-gke.401 with this release.
- Control planes and nodes with auto-upgrade enabled in the Rapid channel will be upgraded from version 1.24 to version 1.24.8-gke.401 with this release.
- Control planes and nodes with auto-upgrade enabled in the Rapid channel will be upgraded from version 1.25 to version 1.25.5-gke.1500 with this release.
- Control planes and nodes with auto-upgrade enabled in the Rapid channel will be upgraded from version 1.26 to version 1.26.0-gke.2000 with this release.
January 12, 2023
Anthos clusters on VMwareAnthos clusters on VMware 1.13.4-gke.19 is now available. To upgrade, see Upgrading Anthos clusters on VMware. Anthos clusters on VMware 1.13.4-gke.19 runs on Kubernetes 1.24.9-gke.100
The supported versions offering the latest patches and updates for security vulnerabilities, exposures, and issues impacting Anthos clusters on VMware are 1.14, 1.13, and 1.12.
In the vSphere CSI driver, enabled
improved-csi-idempotency, andasync-query-volume, and disabledtrigger-csi-fullsync. This enhances the vSphere CSI driver to ensure volume operations are idempotent.In the admin cluster configuration file,
gkeadmnow prepopulatescaCertPathand the service account key paths with absolute paths instead of relative paths.
- If you specify a CIDR range (subnet) in the IP block file for your cluster nodes, the broadcast IP of the subnet, the network CIDR IP, and the network gateway IP will be excluded from the pool of addresses that get assigned to nodes.
- Fixed a bug where CIDR ranges cannot be used in an IP block file.
Fixed the following vulnerabilities:
Critical container vulnerabilities:
High-severity container vulnerabilities:
- CVE-2022-45934
- CVE-2022-3566
- CVE-2022-3554
- CVE-2021-3714
- CVE-2022-3565
- CVE-2022-3176
- CVE-2022-3594
- CVE-2022-45885
- CVE-2019-15794
- CVE-2022-1247
- CVE-2022-40304
- CVE-2022-3567
- CVE-2022-45919
- CVE-2022-42896
- CVE-2022-43750
- CVE-2022-39189
- CVE-2022-20421
- CVE-2022-45884
- CVE-2022-3640
- CVE-2021-3847
- CVE-2022-43680
- CVE-2022-47520
- CVE-2021-4037
- CVE-2022-47518
- CVE-2022-47519
- CVE-2022-3564
- CVE-2022-44638
- CVE-2022-3621
- CVE-2022-45886
- CVE-2022-0400
- CVE-2022-40303
- CVE-2022-3555
- CVE-2022-43945
- CVE-2022-3524
- CVE-2022-2978
- CVE-2022-47521
- CVE-2022-2625
- CVE-2021-3864
- CVE-2022-3545
- CVE-2013-7445
- CVE-2022-2961
- CVE-2022-23218
- CVE-2021-33574
- CVE-2021-3999
- CVE-2022-23219
- CVE-2019-25013
Container-Optimized OS vulnerabilities:
Ubuntu vulnerabilities:
The following resource types are now publicly available through the Export APIs (ExportAssets, ListAssets, and BatchGetAssetsHistory), Feed API, and Search APIs (SearchAllResources, SearchAllIamPolicies).
- VertexAI
aiplatform.googleapis.com/Featurestoreaiplatform.googleapis.com/Tensorboard
- Cloud Filestore
file.googleapis.com/Snapshot
Terraform resources for Cloud Run Services and Cloud Run Jobs based on the Cloud Run Admin API v2 are now generally available (GA).
Preview: You can now simulate host maintenance events on sole-tenant nodes.
For more information, see Simulate host maintenance events on sole-tenant nodes.
Errors generated by GKE applications (that is, applications with a
MonitoredResource type of k8s_container) now support additional labels for metadata extraction. The values of the following labels will now appear in the resource filter and in various tables and displays on Error Reporting pages in the Google Cloud console:
- The
appvalue from your GKE YAML configuration is now used for the primary resource label (also referred to as "service"). - The
pod_namelabel of thek8s_containermonitored-resource type is now used for the secondary resource label (also referred to as "version").
We continue to support the use of the YAML metadata labels k8s-pod/serving_knative_dev/service and
k8s-pod/serving_knative_dev/revision. These labels are prioritized for users already using them over the k8s-pod/app and pod_name labels described in this note. But we encourage users to begin using the new labels.
If you do not set the k8s-pod/app label, GKE application errors continue to use the default service name of gke_instances.
Two new vulnerabilities (CVE-2022-3786 and CVE-2022-3602) have been discovered in OpenSSL v3.0.6 that can potentially cause a crash. While this has been rated a High in the NVD database, GKE endpoints use boringSSL or an older version of OpenSSL that is not affected, so the rating has been reduced to a Medium for GKE. For more information, refer to the GCP-2022-026 security bulletin.
Browse search is generally available using Retail Search. Typically, browsing products using site navigation produces results that are all of equal relevance or sorted by best-selling items. Retail Search leverages AI to optimize how browse results are sorted by considering popularity, buyability, and personalization. See About text search and browse search with Retail Search.
Retail Search can now automatically deliver personalized results for your text query searches and browse searches. Results are personalized for each end-user based on their behavior on your site, including each user's history of product views, clicks, additions to carts, and purchases.
You can use the Data Quality panel on the Retail console Data page to get an assessment of whether the data you have imported is sufficient to turn on automatic personalization. See Personalization.
The Page-level Optimization model is now generally available. Page-level Optimization extends Recommendations AI from optimizing for a single recommendation panel at a time to optimizing for an entire page with multiple panels. The Page-level Optimization model selects the contents for each panel and determines the panel order on your page. For more about this feature, see Page-level Optimization.
January 11, 2023
Apigee UIOn January 11, 2023, we released an updated version of the Apigee UI.
GA release of the new Proxy Editor
The new Proxy Editor simplifies the process of adding policies to an API proxy, configuring those policies, and then deploying the proxy. See Introducing the new Proxy Editor.
The validate_only and force parameters were added to the projects.locations.connectionProfiles resource in the Datastream API. To learn more, see the Datastream API reference documentation.
gRPC Java releases 1.51.0, 1.51.1, and 1.52.0 have an important bug that can cause them to stop receiving updates from Traffic Director. We encourage users of gRPC Java to avoid these releases and use the older v1.50.x until patch releases with fixes are available. See the public gRPC announcement for more information.
Vertex AI Matching Engine is available in the following regions:
us-west2– (Los Angeles)us-west3– (Salt Lake City)northamerica-northeast1– (Montréal)northamerica-northeast2– (Toronto)europe-central2– (Warsaw)europe-west2– (London)europe-west3– (Frankfurt)europe-west6– (Zurich)asia-east1– (Taiwan)Asia-east2– (Hong Kong)me-west1– (Tel aviv)
To see all of the available locations for Matching Engine, see the Vertex AI Locations page.
January 10, 2023
Apigee IntegrationOn January 10, 2023 we released an updated version of the Apigee Integrations software.
Cloud Scheduler trigger (Preview)
The Cloud Scheduler trigger lets you schedule your integration executions for defined time periods or regular intervals across multiple regions. Cloud Scheduler triggers leverage the Cloud Scheduler services to provide a fully managed enterprise-grade cron job scheduler within Apigee Integration.
For more information, see Cloud Scheduler trigger.
The ALTER CAPACITY SET OPTIONS statement and ALTER RESERVATION SET OPTIONS statement are now generally available (GA). Additionally, the CREATE CAPACITY, CREATE RESERVATION, and CREATE ASSIGNMENT statements now support the OPTIONS clause.
Multiple enhancements were made to the UDM Search capability, including the additions of search templates and shared searches. You can now do the following in UDM Search:
- Use Chronicle-provided pre-made search templates in Quick Searches and Search Manager
- Create, edit, and share searches in Search Manager (an enhancement to Saved Searches)
- Use reference lists in UDM searches
Fixed a problem where the number of active workers was reported as 0 after an environment's cluster update.
Cloud Composer 1.20.3 and 2.1.3 images are available:
- composer-1.20.3-airflow-1.10.15 (default)
- composer-1.20.3-airflow-2.2.5
- composer-1.20.3-airflow-2.3.4
- composer-2.1.3-airflow-2.2.5
- composer-2.1.3-airflow-2.3.4 (default)
Cloud Composer versions 2.0.1, 2.0.0, and 1.17.8 have reached their end of full support period.
Cloud Functions has added support for a new runtime, Python 3.11, at the Preview release level.
Managed Service for Prometheus: Dashboards for exporter integrations are available and automatically installed when you configure the integration. You can also view static previews of dashboards without configuring the integration. For more information, see the exporter documentation at Set up commonly used exporters.
You can use striped import and striped export to reduce the time needed for BAK file operations and for other purposes. This feature is generally available.
The Form Parser Release Candidate version has been renamed to pretrained-form-parser-v2.0-2022-11-10. See Document AI release notes--December 12, 2022 for more information about this release.
You can now configure fine-grained permissions by using Identity and Access Management (IAM) to perform tasks in Network Topology. For more information, see Roles and permissions.
On or after July 9th, 2023, Cloud Text-to-Speech will replace the following voices with new voices of similar quality and accent. The new voices are available to try now. No action will be needed from you to switch to the new voice on July 9th, 2023. However, you are free to switch to the new voice at any time.
- Removing ml-IN-Standard-A
- Redirecting to ml-IN-Standard-C
- Removing ml-IN-Wavenet-A
- Redirecting ml-IN-Wavenet-C
- Removing ml-IN-Standard-B
- Redirecting to ml-IN-Standard-D
- Removing ml-IN-Wavenet-B
- Redirecting ml-IN-Wavenet-D
- Removing bn-IN-Standard-A
- Redirecting to bn-IN-Standard-C
- Removing bn-IN-Wavenet-A
- Redirecting bn-IN-Wavenet-C
- Removing bn-IN-Standard-B
- Redirecting to bn-IN-Standard-D
- Removing bn-IN-Wavenet-B
- Redirecting bn-IN-Wavenet-D
- Removing kn-IN-Standard-A
- Redirecting to kn-IN-Standard-C
- Removing kn-IN-Wavenet-A
- Redirecting kn-IN-Wavenet-C
- Removing kn-IN-Standard-B
- Redirecting to kn-IN-Standard-D
- Removing kn-IN-Wavenet-B
- Redirecting kn-IN-Wavenet-D
- Removing gu-IN-Standard-A
- Redirecting to gu-IN-Standard-C
- Removing gu-IN-Wavenet-A
- Redirecting gu-IN-Wavenet-C
- Removing gu-IN-Standard-B
- Redirecting to gu-IN-Standard-D
- Removing gu-IN-Wavenet-B
- Redirecting gu-IN-Wavenet-D
- Removing it-IT-Standard-A
- Redirecting to it-IT-Standard-B
- Removing it-IT-Wavenet-A
- Redirecting to it-IT-Wavenet-B
- Removing es-ES-Standard-A
- Redirecting to es-ES-Standard-C
A get_type function that returns a string indicating an argument's data type is available.
January 09, 2023
Apigee UIOn January 9, 2023, we released an updated version of the Apigee UI.
Specify an IP range with prefix /28 when creating a new instance
Previously, you could only specify an IP range with prefix /22 when creating an instance. This change makes it possible to specify /28 ranges as well as /22 ranges when creating an Apigee instance in the instance manager or the provisioning wizard.
| Bug ID | Description |
|---|---|
| 255609921 | Advanced API Security table rows now use links or span tags |
The following generally available (GA) features have been added for sessions:
In a session, temporary functions are now maintained until the session ends.
In a session, statements that include the
TEMPkeyword can also include theOR REPLACEandIF NOT EXISTSkeywords.
A weekly digest of client library updates from across the Cloud SDK.
Go
Changes for bigquery/storage/apiv1beta1
1.45.0 (2023-01-05)
Features
Java
Changes for google-cloud-bigquery
2.20.1 (2023-01-04)
Dependencies
The US_MEDICARE_BENEFICIARY_ID_NUMBER and MEDICAL_RECORD_NUMBER infoType detectors are available in all regions.
A weekly digest of client library updates from across the Cloud SDK.
Charts defined by Prometheus Query Language (PromQL) now support dashboard-wide filters and can be configured to support template variables. For more information, see Create a permanent filter.
For new Cloud SQL instances that have point-in-time recovery enabled or for existing instances that enable point-in-time recovery, Cloud SQL for PostgreSQL now stores write-ahead logs in Google Cloud Storage.
Before this release, write-ahead logs, which are used to perform point-in-time recovery, were stored on disk. Now, logs are stored in Google Cloud Storage in the same region as the instances.
All other existing instances that have point-in-time recovery enabled will continue to have their logs stored on disk. The change to storing logs in Google Cloud Storage will be made available at a later time.
Support for VPC Service Controls is now at General Availability. To learn more, see Set up a service perimeter using VPC Service Controls.
Preview: Use the Google Cloud console to rename VMs. For more information, see Rename a VM.
A weekly digest of client library updates from across the Cloud SDK.
Go
Changes for dataflow/apiv1beta3
0.8.0 (2023-01-04)
Features
- dataflow: Add REST client (06a54a1)
Display of a SQL workflow as a compiled graph in a workspace is available in Preview.
Allow users to set Project ACLs with conditions based on document schema ID or property name.
Fix the exception thrown when customers type a non-existent project number.
A weekly digest of client library updates from across the Cloud SDK.
Python
Changes for google-cloud-datastore
2.11.1 (2022-12-09)
Bug Fixes
- deps: Require google-api-core >=1.34.0, >=2.11.0 (6f6bb63)
- Drop usage of pkg_resources (6f6bb63)
- Fix timeout default values (6f6bb63)
Documentation
- samples: Snippetgen should call await on the operation coroutine before calling result (6f6bb63)
Java
Changes for google-cloud-datastore
2.13.1 (2023-01-03)
Dependencies
The release notes for 1.26 available in the Rapid channel were modified with an additional notable change:
- New node pools created on 1.26 will default to use the cgroupv2 resource management subsystem enabling the latest container resource management capabilities. Node System Configuration can be used to switch between cgroup settings.
Windows Server 2022 OS image is generally available on GKE. You can now create Windows Node pools with Windows Server 2022 OS images using the command line. For more information, see Creating a cluster using Windows Server node pools.
The release notes for 1.26 available in the Rapid channel were modified with an additional notable change:
- New node pools created on 1.26 will default to use the cgroupv2 resource management subsystem enabling the latest container resource management capabilities. Node System Configuration can be used to switch between cgroup settings.
Google Cloud's monitoring agent for SAP NetWeaver version 2.8
Version 2.8 of the Google Cloud's monitoring agent for SAP NetWeaver is now available. This version includes bug fixes and supportability improvements.
For more information about the agent, see Google Cloud's monitoring agent for SAP NetWeaver.
A weekly digest of client library updates from across the Cloud SDK.
Go
Changes for secretmanager/apiv1
1.10.0 (2023-01-04)
Features
- secretmanager: Add REST client (06a54a1)
Python
Changes for google-cloud-secret-manager
2.14.0 (2023-01-04)
Features
As of this release, Google SAS no longer enforces Part 90 of the Groundwater Protection Zone (GWPZ) regulations. This change opens more spectrum for CBRS usage in the 3650-3700 MHz range, particularly in Texas and Louisiana.
- CBSDs that were located within GWPZs can now use the upper 50 MHz of the range.
- CBSDs within 40km of GWPZs now have EIRP restrictions removed when requesting grants (if no other incumbent limitations are present).
In order to take advantage of the potentially higher EIRP, CBSDs must perform a spectrum Inquiry to check available EIRP or otherwise request new grants. For more information on how to perform a Spectrum Inquiry, see Best Practices. This feature is Generally Available (GA).
Support for Cloud Tasks is now at General Availability. To learn more, see the Cloud Tasks documentation on setting up a service perimeter using VPC Service Controls.
January 06, 2023
ChronicleChronicle Curated Detections has been enhanced with the following additional detection content for Windows-based threats. A new rule set was added, called Anomalous PowerShell, that identifies PowerShell commands containing obfuscation techniques or other anomalous behavior.
Cloud Functions now supports the following runtimes at the General Availability release level.
Config Connector version 1.99.0 is now available.
Added support for DataCatalogPolicyTag resource. This resource has been auto-generated and is in alpha stability.
Added support for TagsTagKey resource. This resource has been auto-generated and is in alpha stability.
Added support for TagsTagValue resource. This resource has been auto-generated and is in alpha stability.
Fixed export error for IAMCustomRole in config-connector CLI with --resource-format=terraform.
Added fields spec.configmanagement.oci and spec.mesh.controlPlane in GKEHubFeatureMembership.
Added field spec.skipAwaitRollout in OSConfigOSPolicyAssignment.
Removed field spec.authorizationPolicyRef in NetworkServicesGateway (Alpha).
Added field spec.deletionPolicy in BigtableGCPolicy.
Added field spec.deletionProtection in BigtableTable.
Added field spec.cdnPolicy.cacheKeyPolicy.includeHttpHeaders in ComputeBackendService.
Added fields spec.privateIpAddressRef, spec.redundantInterfaceRef, spec.subnetworkRef in ComputeRouterInterface.
Added fields spec.recaptchaOptionsConfig, spec.rule.headerAction, spec.rule.preconfiguredWafConfig in ComputeSecurityPolicy.
Added fields spec.clusterAutoscaling.autoProvisioningDefaults.management, spec.clusterAutoscaling.autoProvisioningDefaults.shieldedInstanceConfig spec.clusterAutoscaling.autoProvisioningDefaults.upgradeSettings, spec.gatewayApiConfig, spec.masterAuthorizedNetworksConfig.gcpPublicCidrsAccessEnabled, spec.nodeConfig.loggingVariant, spec.nodeConfig.resourceLabels, spec.nodePoolDefaults.nodeConfigDefaults.loggingVariant, spec.privateClusterConfig.privateEndpointSubnetworkRef in ContainerCluster.
Added fields spec.networkConfig.enablePrivateNodes, spec.nodeConfig.loggingVariant, spec.nodeConfig.resourceLabels, spec.upgradeSettings.blueGreenSettings, spec.upgradeSettings.stategy in ContainerNodePool.
Added field spec.privateVisibilityConfig.gkeClustersRef in DNSManagedZone.
Added field spec.mesh.controlPlane in GKEHubFeatureMembership.
Added field spec.deletionPolicy in SQLDatabase.
Added fields spec.settings.connectorEnforcement, spec.settings.denyMaintenancePeriod, spec.settings.insightsConfig.queryPlansPerMinute in SQLInstance.
Added field spec.autoclass in StorageBucket.
Supported the regional spec.defaultRouteAction.requestMirrorPolicy.backendServiceRef, spec.defaultRouteAction.weightedBackendServices.backendServiceRef for the regional ComputeURLMap resources.
Field spec.labels in CloudIdentityGroup has become mutable.
Field spec.ipv6AccessType in ComputeSubnetwork has become mutable.
Extended faster reconciliation of resources with dependencies to support IAMPartialPolicy.
The Firestore indexes pages in the Google Cloud and Firebase
consoles now show the __name__ field in each composite index definition.
The __name__ field is added by default to each index definition and affects the
sorting of results. The __name__ field was always part of each index
definition but was previously hidden by the console.
This is a patch release of Google Distributed Cloud Edge (version 1.2.2).
The following changes have been introduced in this release of Distributed Cloud Edge:
- The NVIDIA Tesla T4 GPU driver has been updated to version 515.65.01.
- The NVIDIA Tesla T4 GPU resource name has been changed from
nvidia.com/gputonvidia.com/gpu-pod-TESLA_T4. If you have existing GPU-based container workloads, you must manually update their configuration to use the new resource name. For more information, see Configure a container to use GPU resources. - The Kubernetes worker node agent (
kubelet) has been updated to version 1.23.5-gke.1505.
January 05, 2023
App Engine standard environment PythonThe Python 3.11 runtime for App Engine standard environment is now available in preview.
The SAP SuccessFactors Batch Source plugin is available in Preview. You can connect your data pipeline to an SAP SuccessFactors Source and a BigQuery Sink with this plugin in Cloud Data Fusion versions 6.5.1 and later.
1.26 is now available in the Rapid channel
Kubernetes 1.26 is now available in the Rapid channel. Before upgrading, read the Kubernetes 1.26 Release Notes, especially the action required and deprecation sections.
Notable changes
- kubectl 1.26 removes compiled-in support for Azure and Google Cloud authentication methods.
- The removal doesn't affect operators that are deployed in the cluster and use Kubernetes service accounts to communicate with the API server, Kubernetes service account authentication continues to work as-is.
- GKE has released an updated authentication plugin, gke-gcloud-auth-plugin. This plugin uses the client-go Credential Plugins framework to provide authentication tokens to communicate with GKE clusters.
- For more information, see Deprecated authentication plugin for Kubernetes clients and Install required plugins.
- New node pools created on 1.26 will default to use the cgroupv2 resource management subsystem enabling the latest container resource management capabilities. Node System Configuration can be used to switch between cgroup settings.
New API versions
- flowcontrol.apiserver.k8s.io/v1beta3 FlowSchema, PriorityLevelConfiguration
- The PriorityLevelConfiguration
spec.limited.assuredConcurrencySharesfield is renamed tospec.limited.nominalConcurrencyShares
- The PriorityLevelConfiguration
Deprecated API versions
These APIs are still served in version 1.26 but are in a deprecation period:
- The following Beta versions of graduated APIs will be removed in 1.27 in favor of newer versions:
- storage.k8s.io/v1beta1 CSIStorageCapacity
- deprecated since 1.24
- use storage.k8s.io/v1 instead, available since 1.24
- The following Beta versions of graduated APIs will be removed in 1.29 in favor of newer versions:
- flowcontrol.apiserver.k8s.io/v1beta2 FlowSchema, PriorityLevelConfiguration
- deprecated since 1.26
- use flowcontrol.apiserver.k8s.io/v1beta3 instead, available since 1.26
Removed API versions
The following Beta versions of graduated APIs will be removed in 1.26 in favor of newer versions:
- flowcontrol.apiserver.k8s.io/v1beta1 FlowSchema, PriorityLevelConfiguration
- deprecated since 1.23
- use flowcontrol.apiserver.k8s.io/v1beta2 instead, available since 1.23
- autoscaling/v2beta2 HorizontalPodAutoscaler
- deprecated since 1.23
- use autoscaling/v2 instead, available since 1.23 (or autoscaling/v1)
2023-01-09 update: Added an additional Notable change to 1.26 for this release note.
(2023-R01) Version updates
GKE cluster versions have been updated.
New versions available for upgrades and new clusters
The following Kubernetes versions are now available for new clusters and for opt-in control plane upgrades and node upgrades for existing clusters. For more information on versioning and upgrades, see GKE versioning and support and Upgrades.
No channel
- The following control plane and node versions are now available:
- The following control plane versions are no longer available:
- 1.22.15-gke.100
- 1.25.3-gke.800
- Control planes and nodes with auto-upgrade enabled will be upgraded from version 1.21 to version 1.22.15-gke.1000 with this release.
- Control planes and nodes with auto-upgrade enabled will be upgraded from version 1.22 to version 1.22.15-gke.1000 with this release.
- Control planes and nodes with auto-upgrade enabled will be upgraded from version 1.25 to version 1.25.4-gke.2100 with this release.
Stable channel
- The following versions are now available in the Stable channel:
- The following versions are no longer available in the Stable channel:
- 1.22.15-gke.100
- 1.23.11-gke.300
- 1.24.7-gke.900
- Control planes and nodes with auto-upgrade enabled in the Stable channel will be upgraded from version 1.21 to version 1.22.15-gke.2500 with this release.
- Control planes and nodes with auto-upgrade enabled in the Stable channel will be upgraded from version 1.22 to version 1.22.15-gke.2500 with this release.
- Control planes and nodes with auto-upgrade enabled in the Stable channel will be upgraded from version 1.24 to version 1.24.8-gke.401 with this release.
Regular channel
- The following versions are now available in the Regular channel:
- The following versions are no longer available in the Regular channel:
- 1.22.15-gke.100
- 1.23.13-gke.900
- 1.24.5-gke.600
- 1.25.3-gke.800
- Control planes and nodes with auto-upgrade enabled in the Regular channel will be upgraded from version 1.21 to version 1.22.15-gke.1000 with this release.
- Control planes and nodes with auto-upgrade enabled in the Regular channel will be upgraded from version 1.22 to version 1.23.14-gke.401 with this release.
- Control planes and nodes with auto-upgrade enabled in the Regular channel will be upgraded from version 1.23 to version 1.23.14-gke.401 with this release.
- Control planes and nodes with auto-upgrade enabled in the Regular channel will be upgraded from version 1.25 to version 1.25.4-gke.2100 with this release.
Rapid channel
- Version 1.25.4-gke.2100 is now the default version in the Rapid channel.
- The following versions are now available in the Rapid channel:
- The following versions are no longer available in the Rapid channel:
- 1.21.14-gke.8500
- 1.22.15-gke.1000
- 1.23.13-gke.900
- 1.24.6-gke.1500
- 1.25.4-gke.1600
- Control planes and nodes with auto-upgrade enabled in the Rapid channel will be upgraded from version 1.20 to version 1.21.14-gke.14100 with this release.
- Control planes and nodes with auto-upgrade enabled in the Rapid channel will be upgraded from version 1.21 to version 1.22.15-gke.2500 with this release.
- Control planes and nodes with auto-upgrade enabled in the Rapid channel will be upgraded from version 1.22 to version 1.23.14-gke.401 with this release.
- Control planes and nodes with auto-upgrade enabled in the Rapid channel will be upgraded from version 1.23 to version 1.24.7-gke.900 with this release.
- Control planes and nodes with auto-upgrade enabled in the Rapid channel will be upgraded from version 1.24 to version 1.24.7-gke.900 with this release.
- Control planes and nodes with auto-upgrade enabled in the Rapid channel will be upgraded from version 1.25 to version 1.25.4-gke.2100 with this release.
- Control planes and nodes with auto-upgrade enabled in the Rapid channel will be upgraded from version 1.26 to version 1.26.0-gke.1500 with this release.
2023-01-09 update: Added an additional Notable change to 1.26 for this release note.
(2023-R01) Version updates
- Version 1.25.4-gke.2100 is now the default version in the Rapid channel.
- The following versions are now available in the Rapid channel:
- The following versions are no longer available in the Rapid channel:
- 1.21.14-gke.8500
- 1.22.15-gke.1000
- 1.23.13-gke.900
- 1.24.6-gke.1500
- 1.25.4-gke.1600
- Control planes and nodes with auto-upgrade enabled in the Rapid channel will be upgraded from version 1.20 to version 1.21.14-gke.14100 with this release.
- Control planes and nodes with auto-upgrade enabled in the Rapid channel will be upgraded from version 1.21 to version 1.22.15-gke.2500 with this release.
- Control planes and nodes with auto-upgrade enabled in the Rapid channel will be upgraded from version 1.22 to version 1.23.14-gke.401 with this release.
- Control planes and nodes with auto-upgrade enabled in the Rapid channel will be upgraded from version 1.23 to version 1.24.7-gke.900 with this release.
- Control planes and nodes with auto-upgrade enabled in the Rapid channel will be upgraded from version 1.24 to version 1.24.7-gke.900 with this release.
- Control planes and nodes with auto-upgrade enabled in the Rapid channel will be upgraded from version 1.25 to version 1.25.4-gke.2100 with this release.
- Control planes and nodes with auto-upgrade enabled in the Rapid channel will be upgraded from version 1.26 to version 1.26.0-gke.1500 with this release.
(2023-R01) Version updates
- The following versions are now available in the Regular channel:
- The following versions are no longer available in the Regular channel:
- 1.22.15-gke.100
- 1.23.13-gke.900
- 1.24.5-gke.600
- 1.25.3-gke.800
- Control planes and nodes with auto-upgrade enabled in the Regular channel will be upgraded from version 1.21 to version 1.22.15-gke.1000 with this release.
- Control planes and nodes with auto-upgrade enabled in the Regular channel will be upgraded from version 1.22 to version 1.23.14-gke.401 with this release.
- Control planes and nodes with auto-upgrade enabled in the Regular channel will be upgraded from version 1.23 to version 1.23.14-gke.401 with this release.
- Control planes and nodes with auto-upgrade enabled in the Regular channel will be upgraded from version 1.25 to version 1.25.4-gke.2100 with this release.
(2023-R01) Version updates
- The following versions are now available in the Stable channel:
- The following versions are no longer available in the Stable channel:
- 1.22.15-gke.100
- 1.23.11-gke.300
- 1.24.7-gke.900
- Control planes and nodes with auto-upgrade enabled in the Stable channel will be upgraded from version 1.21 to version 1.22.15-gke.2500 with this release.
- Control planes and nodes with auto-upgrade enabled in the Stable channel will be upgraded from version 1.22 to version 1.22.15-gke.2500 with this release.
- Control planes and nodes with auto-upgrade enabled in the Stable channel will be upgraded from version 1.24 to version 1.24.8-gke.401 with this release.
(2023-R01) Version updates
- The following control plane and node versions are now available:
- The following control plane versions are no longer available:
- 1.22.15-gke.100
- 1.25.3-gke.800
- Control planes and nodes with auto-upgrade enabled will be upgraded from version 1.21 to version 1.22.15-gke.1000 with this release.
- Control planes and nodes with auto-upgrade enabled will be upgraded from version 1.22 to version 1.22.15-gke.1000 with this release.
- Control planes and nodes with auto-upgrade enabled will be upgraded from version 1.25 to version 1.25.4-gke.2100 with this release.
January 04, 2023
Apigee ConnectorsOn January 04, 2023, we released the preview version of new connectors for Apigee.
BigQuery ML support for image analytics with vision models is available in preview. Customers can import vision models to perform inference modeling with images to detect objects, perform optical character recognition (OCR), and more. To request access to these features, complete the BigQuery ML interest sign up form.
This new capability uses BigQuery object tables to access image data stored in GCS and predict results from machine learning models. You can now generate insights from structured and unstructured data with the following steps:
- Create an object table to access images stored in GCS.
- Import vision models in TensorFlow vision models such as ImageNet or ResNet 50, or import your own models to detect objects from images, to annotate photos, and to perform OCR.
- Unify image data with structured data such as user activities or sales orders to train machine learning models. You can then use prediction results to extract insights from your data.
The following supported default parsers have changed. Each is listed by product name and ingestion label, if applicable.
- AWS CloudWatch (AWS_CLOUDWATCH)
- AWS Control Tower (AWS_CONTROL_TOWER)
- AWS WAF (AWS_WAF)
- Azure AD (AZURE_AD)
- Azure AD Organizational Context (AZURE_AD_CONTEXT)
- Barracuda Email (BARRACUDA_EMAIL)
- Cisco ASA (CISCO_ASA_FIREWALL)
- Cisco Email Security (CISCO_EMAIL_SECURITY)
- Cisco ISE (CISCO_ISE)
- Cisco Umbrella Web Proxy (UMBRELLA_WEBPROXY)
- Citrix Monitor (CITRIX_MONITOR)
- Cloud Audit Logs (N/A)
- CrowdStrike Falcon (CS_EDR)
- Digital Guardian EDR (DIGITALGUARDIAN_EDR)
- Elastic Windows Event Log Beats (ELASTIC_WINLOGBEAT)
- ExtraHop RevealX (EXTRAHOP)
- ForgeRock OpenAM (OPENAM)
- Google Chrome Browser Cloud Management (CBCM) (N/A)
- Infoblox (INFOBLOX)
- McAfee ePolicy Orchestrator (MCAFEE_EPO)
- Microsoft Graph API Alerts (MICROSOFT_GRAPH_ALERT)
- Netscout Arbor Sightline (ARBOR_SIGHTLINE)
- Office 365 (OFFICE_365)
- Okta (OKTA)
- Palo Alto Networks Firewall (PAN_FIREWALL)
- Rapid7 Insight (RAPID7_INSIGHT)
- Salesforce (SALESFORCE)
- Sophos Intercept EDR (SOPHOS_EDR)
- Splunk Platform (SPLUNK)
- STIX Threat Intelligence (STIX)
- Tanium Stream (TANIUM_TH)
- tenable.io (TENABLE_IO)
- ThreatLocker Platform (THREATLOCKER)
- VMware AirWatch (AIRWATCH)
- WatchGuard (WATCHGUARD)
- Windows Event (XML) (WINEVTLOG_XML)
- Windows Sysmon (WINDOWS_SYSMON)
- Zscaler (ZSCALER_WEBPROXY)
For details about changes in each parser, see Supported default parsers.
You can now run GPU-based workloads in GA in Autopilot clusters that use GKE version 1.24.2-gke.1800 and later.
Preview stage support for the following integration:
Support for an Application Integration connector is available in Preview.
January 03, 2023
Backup and DRBackup and DR release 11.0.2.9632 is now available. This release:
- Improves the ease of use for Compute Engine instances by eliminating creation of service account, cloud credentials, cloud storage bucket, and OnVault pool.
- Addresses security concerns by removing the need to export private keys.
- Supports restoring Compute Engine instances to its appropriate sole-tenant node.
BigQuery ML integration with Vertex AI Model Registry is now generally available. With this integration, you can now use the following capabilities:
- Register and monitor BigQuery ML models with Vertex AI Model Registry
- Deploy BigQuery ML models directly from Vertex AI Model Registry to Vertex Deployment endpoints
- Use Vertex AI to compare and track evaluation metrics.
- Explainable AI for BigQuery ML models, including built-in XAI, inside Vertex AI
- The seamless integration between BigQuery ML and Vertex AI lets you use Vertex AI for MLOps.
Key features include:
- Model versioning for models registered with Vertex AI Model Registry
- Revision alias for different model versions, and User specified model ID
- List the models by type (custom model, BigQuery ML, AutoML)
- BigQuery ML models can be registered with Vertex AI Model Registry to help you explore, manage, and govern your BigQuery ML models
- Ability to deploy BigQuery ML models to Vertex AI end points
- BigQuery ML models deployed on Vertex AI endpoints can use MLOps features such as model monitoring
Customers can use BigQuery ML to train and run models on BigLake in Cloud Storage. See Data Cloud Blog and End to end unstructured data use cases demo.
Starting in version 2023-01-03-00_RC00, the Google-provided Dataflow templates support ES6 syntax for JavaScript user-defined functions (UDFs). This change is backwards-compatible. ES5 syntax and existing user-defined functions are still supported.
When you run Google-provided templates using the latest version, your jobs are upgraded automatically on restart. If you want to keep running an earlier version of a template, when you run the template, specify version 2022-12-15-00_RC00 or earlier.
January 02, 2023
Cloud LoggingA weekly digest of client library updates from across the Cloud SDK.
Python
Changes for google-cloud-logging
3.4.0 (2022-12-15)
Features
- Add typing to proto.Message based class attributes (9d505f1)
Bug Fixes
- Add dict typing for client_options (9d505f1)
- deps: Require google-api-core >=1.34.0, >=2.11.0 (9d505f1)
- Drop usage of pkg_resources (9d505f1)
- Fix timeout default values (9d505f1)
Documentation
December 29, 2022
Cloud InterconnectDedicated Interconnect support is available in the following colocation facilities:
- Lamda Hellix Athens Campus (Athens-1 & Athens-2), Athens
For more information, see the Locations table.
December 28, 2022
Google Cloud ArmorThe rule signature
942550-sqli,
which covers the vulnerability in which malicious attackers can
bypass WAF by appending JSON syntax to SQL injection payloads, is now available. For more information, see the WAF rules overview.
December 27, 2022
Cloud BuildUsers can now customize email, BigQuery, and webhook-based notifications using notifier templates. To learn more, see Configure SMTP notifications, Configure BigQuery notifications, and Configure HTTP notifications.
The current default PERSON_NAME infoType detection model, which is accessible when InfoType.version is set to latest or stable, is now also used when InfoType.version is set to legacy.
The old detection model that was previously accessible by setting InfoType.version to legacy is no longer accessible.
The changes listed in the December 20 release notes entry for the lower_case_table_names flag for MySQL 8.0 have been postponed.
Starting with Beam SDK version 2.44.0, Dataflow will not support running Dataflow jobs with workers in a region that is different from the Dataflow regional endpoint.
Dialogflow CX now supports the MATCH system function.
December 26, 2022
Apigee IntegrationOn December 26, 2022 we released an updated version of the Apigee Integrations software.
Test without publishing an integration
You can now test your integration without the need to publish or create a new integration version. Testing an integration lets you experiment with the integration input variable values, and helps in identifying any faults in the integration connection flow before you finalize and publish the integration.
For more information, see Test and publish integrations.
A weekly digest of client library updates from across the Cloud SDK.
Node.js
Changes for @google-cloud/logging
10.3.3 (2022-12-16)
Bug Fixes
Java
Changes for google-cloud-logging
3.13.7 (2022-12-19)
Bug Fixes
December 23, 2022
Carbon FootprintFixed an issue that omitted Scope 1 and Scope 3 emissions for a given region in a given month that has zero Scope 2 emissions due to 100% carbon free energy.
Specifically, in July 2022, northamerica-northeast1 had 100% of its electricity generated from hydro power for the month, resulting in no Scope 2 emissions for the month despite positive energy consumption to run the data center. However, there were Scope 1 and Scope 3 emissions apportioned to the usage of this data center, but our data erroneously omitted them.
As a fix, we have added the Scope 1 and Scope 3 emissions back for any usage in northamerica-northeast1 in July 2022, and will not omit such emissions going forward that have positive apportioned Scope 1 and Scope 3 emissions but zero Scope 2 emissions.
Electricity Maps (EM), our carbon emissions factors data source, is making improvements to their methodology that will affect carbon emissions data released beginning on December 15th. For a detailed description of the improvement, please see Electricity Maps blog post here.
In sum, EM will now be incorporating the efficiency and technology of power plants into consideration when calculating emission factors, increasing the precision of how emission factors are measured. It represents a data quality improvement, which will impact data for cost centers located in the United States and European Union.
Updated carbon model to version 7 to reflect the above-mentioned changes.
December 22, 2022
Anthos clusters on VMwareA new vulnerability (CVE-2022-2602) has been discovered in the io_uring subsystem in the Linux kernel that can allow an attacker to potentially execute arbitrary code.
For more information see the GCP-2022-025 security bulletin.
On December 22, 2022, we released the preview version of new connectors for Apigee.
The following new connectors are available in preview:
Connectors for Google services
Connectors for other applications
Documentation has been updated to include new samples. The following samples are available in Go, Node.js, and Python:
- Create and submit a job using a VM instance template
- Create and submit a job that uses a Cloud Storage bucket
- List tasks
- Describe a task
The following sample is available in Go and Python:
For more information, see All Batch code samples.
The Lineage tab in the table properties page lets you track how your data moves and transforms through BigQuery. This feature is now in preview.
BigQuery now blocks saving query results to Google Drive from projects inside a VPC Service Controls protected perimeter.
The new Cloud Spanner Kafka connector publishes change streams records to Kafka for application integration and event triggering. For more information, see Build change streams connections to Kafka.
Generally available: N2 VMs with 64 or more vCPUs now support up to 4 GB/s (read) and 3 GB/s (write) throughput per instance with Extreme persistent disks (pd-extreme). Previously the maximum was 2.2 GB/s per instance.
We are launching a public preview version of the Purchase Order (PO) processor, pretrained-purchase-order-v1.1-2022-06-17, with the following new features:
- Support for uptraining to improve, add, and remove entities in the schema
- Support for uptraining to add support for unsupported languages
- Improvements to overall performance
Dual-stack clusters in GKE are now generally available. Dual-stack networking is supported on both Standard and Autopilot clusters. To learn more, see Use an IPv4/IPv6 dual-stack network to create a dual-stack cluster.
Recommendations AI now provides the On-sale model. The On-sale model is a personalized promotions-based model that can recommend on-sale products. You can use this model type to encourage users to purchase discounted items.
For more information about the On-sale model, see the About recommendation models documentation. For how to create this model, see Create recommendation models.
The userName attribute was added to the Finding object of the Security Command Center API.
The value of the userName attribute depends on the type of the finding and is likely not an IAM principal. For example, this can be a system username if the finding is related to a virtual machine, or it be an application login username.
For more information, see the Security Command Center API documentation for the Finding object.
Text-to-Speech now offers these new voices. See the supported voices page for a complete list of voices and audio samples.
- cloud-ml-IN-Wavenet-C
- cloud-ml-IN-Wavenet-D
Note these voices are bilingual with en-IN.
Text-to-Speech now offers these new news reading voices. See the supported voices page for a complete list of voices and audio samples.
- cloud-es-US-News-D
- cloud-es-US-News-E
- cloud-es-US-News-F
- cloud-es-US-News-G
- cloud-en-AU-News-E
- cloud-en-AU-News-F
- cloud-en-AU-News-G
- cloud-en-GB-News-G
- cloud-en-GB-News-H
- cloud-en-GB-News-I
- cloud-en-GB-News-J
- cloud-en-GB-News-K
- cloud-en-GB-News-L
- cloud-en-GB-News-M
December 21, 2022
Anthos clusters on AWSA new vulnerability (CVE-2022-2602) has been discovered in the io_uring subsystem in the Linux kernel that can allow an attacker to potentially execute arbitrary code. For more information, see the GCP-2022-2025 security bulletin.
A new vulnerability (CVE-2022-2602) has been discovered in the io_uring subsystem in the Linux kernel that can allow an attacker to potentially execute arbitrary code. For more information, see the GCP-2022-2025 security bulletin.
A new vulnerability (CVE-2022-2602) has been discovered in the io_uring subsystem in the Linux kernel that can allow an attacker to potentially execute arbitrary code. For more information, see the GCP-2022-2025 security bulletin.
Anthos clusters on VMware 1.14.0-gke.430 is now available. To upgrade, see Upgrading Anthos clusters on VMware. Anthos clusters on VMware 1.14.0-gke.430 runs on Kubernetes 1.25.5-gke.100.
The supported versions offering the latest patches and updates for security vulnerabilities, exposures, and issues impacting Anthos clusters on VMware are 1.14, 1.13, and 1.12.
- Support for user cluster creation with Controlplane V2 enabled is now generally available. For more details on how to create a user cluster with this model, see Create a user cluster with Controlplane V2.
- Preview: You can now roll back node pools to a previous working version if you detect an issue in the new version after a cluster upgrade. For more information, see Rolling back a node pool after an upgrade.
- Preview: The following private registry updates are now available:
- Support for private registry credentials using prepared Secrets is now available as a preview feature. A new
privateRegistryfield has been added in the Secrets configuration file. - Added a new
privateRegistrysection in the user cluster configuration file. You can use different private registry credentials for the user cluster and admin cluster. You can also use a different private registry address for user clusters with Controlplane V2 enabled. - You can also update private registry credentials for an admin cluster or user cluster with the
gkectl update credentialscommand. For more information, see Update private registry credentials.
- Support for private registry credentials using prepared Secrets is now available as a preview feature. A new
- Cluster names are now included in kubeconfig files when creating a new admin cluster or user cluster. If you are upgrading your existing cluster to 1.14.0 or higher, the existing kubeconfig file is updated with the cluster name.
cluster-health-controlleris now integrated withhealth-check-exporterto emit metrics based on the periodic health check results, making it easy to monitor and detect cluster health problems.- GA: The node pool update policy is generally available. With this feature, you can configure the value of
maximumConcurrentNodePoolUpdatein the user cluster configuration file to1. This will configure the maximum number of additional nodes spawned during cluster upgrade or update, which can potentially avoid two issues — resource quota limit issue and PDB deadlock issue. For more information, see Configure node pool update policy. - Support for vSphere cluster/host/network/datastore folders is generally available. You can use folders to group objects of the same type for easier management. For more information, see Specify vSphere folders in cluster configuration and the relevant sections in the admin cluster and user cluster configuration files.
- Added a feature enabling cluster administrators to configure RBAC policies based on Azure Active Directory (AD) groups. Group information for users belonging to more than 200 groups can now be retrieved.
- Upgraded Kubernetes from 1.24 to 1.25:
- Migrated PDB API version from policy/v1beta1 to policy/v1. You must ensure that any workload PDB API version is updated to policy/v1 before upgrading your cluster to 1.14.0.
- Migrated autoscaling/v2beta1 to autoscaling/v2.
- Disabled CSI Migration for vSphere as this is enabled by default in Kubernetes 1.25.
- Added storage validation that checks if in-use Kubernetes PersistentVolumes (PV) have disks present in the configured datastore, and if
node.Status.VolumesAttachedis consistent with the actual PV/disk attachment states during admin and user cluster upgrade preflight checks. - Updated gcloud version to 410.0.0 on the admin workstation.
- Upgraded VMware vSphere Container Storage Plug-in from 2.5 to 2.7. This version bump includes support for Kubernetes version 1.25. For more information, see VMware vSphere Container Storage Plug-in 2.7 Release Notes.
- In the generated user cluster configuration template, the prepopulated value for
enableDataplaneV2is nowtrue. - Removed unnecessary RBAC policies for managing the lifecycle of user clusters in the Google Cloud console.
- Updated the parser of container logs to extract severity level.
- Simplified the cluster snapshot uploading process by automatically retrieving GKE connect-register service account key, and making the flag
--service-account-key-fileoptional. When the cluster is not registered correctly, and no additional service account key file is passed in through the flag, thegkectl diagnose snapshotcommand will use theGOOGLE_APPLICATION_CREDENTIALSenvironment variable to authenticate the request. - Upgraded Container-Optimized OS to m101.
- In the admin cluster and user cluster configuration file templates,
loadbalancer.kindfield is now prepopulated withMetalLB.
A known issue has been discovered. See the January 25, 2023 release note.
- Fixed an issue where
anet-operatorcould be scheduled to a Windows node withenableControlplaneV2: true. - Buggy IPs are excluded in node IPAM when a CIDR range is specified in the IP block file.
- Increased memory limit of
monitoring-operator-Pods 1 GB to avoid potential OOM events under certain configurations. - Fixed the issue of missing control plane metrics for user clusters that have Controlplane V2 enabled.
- Switched the scraping port of
metrics-agentfrom 10255 to 10250 (secure port) to collectkubeletsummary API metrics. - Fixed the issue where nodes fail to register if the configured hostname in the IP block file contains one or more periods.
- Fixed the issue where deleting a user cluster also deleted
cluster-health-controllerandvsphere-metrics-exporterClusterRole objects. - Fixed the unspecified Internal Server error in ClientConfig when using the AIS hub feature to manage the OpenID Connect (OIDC) configuration.
- Fixed a bug where running
gkectl diagnose snapshotusingsystemscenario did not capture Cluster API resources in thedefaultnamespace. - Fixed an issue where cluster deletion may be stuck at node draining when the user cluster control plane and node pools are on different datastores.
- Fixed the issue of
/var/log/audit/filling up disk space on the admin workstation. - Fixed the issue where the Connect Agent in the admin cluster does not upgrade after failures to upgrade nodes in the user cluster control plane.
- Improved the GCP preflight check error message by including the project ID that requires the GCP permission.
- Fixed the issue during admin cluster creation where
gkectl check-configfails due to missing OS images, ifgkectl prepareis not run first. - Fixed the issue where updating a cluster to enable or disable anti-affinity does not work when Controlplane V2 is enabled.
- Replaced
text/templatelibrary withsafetext/yamltemplatelibrary to fix YAML injection vulnerabilities. - Converted the resource type of certain
stackdriver-operatormetrics fromk8s_podtok8s_container. If you keep the default setting ofscalablemonitoringtotrue, the old resource typek8s_podwill remain. - Fixed the following vulnerabilities:
- Critical container vulnerabilities:
- High-severity container vulnerabilities:
- CVE-2021-46828
- CVE-2022-2509
- CVE-2022-40303
- CVE-2022-43680
- CVE-2022-3555
- CVE-2022-3554
- CVE-2022-40304
- CVE-2020-35525
- CVE-2022-2795
- CVE-2022-1247
- CVE-2022-3621
- CVE-2022-1679
- CVE-2022-3545
- CVE-2022-45885
- CVE-2022-3564
- CVE-2019-15794
- CVE-2022-43945
- CVE-2022-3635
- CVE-2022-3623
- CVE-2022-3324
- CVE-2013-7445
- CVE-2022-3028
- CVE-2022-3522
- CVE-2021-3714
- CVE-2022-45886
- CVE-2022-20421
- CVE-2022-3134
- CVE-2022-3566
- CVE-2021-4037
- CVE-2022-0400
- CVE-2022-3176
- CVE-2022-2625
- CVE-2022-3099
- CVE-2022-45884
- CVE-2022-42896
- CVE-2022-3567
- CVE-2021-3864
- CVE-2022-38178
- CVE-2022-3524
- CVE-2022-2961
- CVE-2022-44638
- CVE-2022-43750
- CVE-2022-3565
- CVE-2022-38177
- CVE-2022-3640
- CVE-2021-3847
- CVE-2022-39189
- CVE-2022-3594
- CVE-2022-45919
- CVE-2022-20422
- CVE-2022-2978
- Container-optimized OS vulnerabilities:
Anthos clusters on bare metal release 1.14.0 is now available for download. Note that Anthos clusters on bare metal version 1.14.0 runs on Kubernetes 1.25. Multiple deprecated APIs are deleted in Kubernetes 1.25. Before you upgrade version 1.13 Anthos clusters to version 1.14, check to see if you are affected by the Kubernetes API deletions.
If you aren't affected by the API deletions, see Upgrade clusters in the 1.14 documentation for upgrade instructions.
The option to update a Serverless VPC Access connector is now available in preview. This feature allows you to edit the machine (instance) type, as well as the minimum and maximum number of instances.
The option to update a Serverless VPC Access connector is now available in preview. This feature allows you to edit the machine (instance) type, as well as the minimum and maximum number of instances.
The option to update a Serverless VPC Access connector is now available in preview. This feature allows you to edit the machine (instance) type, as well as the minimum and maximum number of instances.
The option to update a Serverless VPC Access connector is now available in preview. This feature allows you to edit the machine (instance) type, as well as the minimum and maximum number of instances.
The option to update a Serverless VPC Access connector is now available in preview. This feature allows you to edit the machine (instance) type, as well as the minimum and maximum number of instances.
The option to update a Serverless VPC Access connector is now available in preview. This feature allows you to edit the machine (instance) type, as well as the minimum and maximum number of instances.
The option to update a Serverless VPC Access connector is now available in preview. This feature allows you to edit the machine (instance) type, as well as the minimum and maximum number of instances.
The option to update a Serverless VPC Access connector is now available in preview. This feature allows you to edit the machine (instance) type, as well as the minimum and maximum number of instances.
Cloud SQL for MySQL now supports minor version 8.0.31. To upgrade your existing instance to the new version, see Upgrade the database minor version.
VMware Engine nodes are now available in the following additional region:
- Milan, Italy, Europe (
europe-west8)
A new vulnerability (CVE-2022-2602) has been discovered in the io_uring subsystem in the Linux kernel that can allow an attacker to potentially execute arbitrary code. For more information, see the GCP-2022-025 security bulletin.
You can now enable NCCL Fast Socket on your multi-GPU workloads. NCCL Fast Socket is a transport layer plugin designed to improve NVIDIA Collective Communication Library (NCCL) performance on Google Cloud. To enable NCCL Fast Socket, you must be using a GKE Standard cluster with control plane version 1.25.2-gke.1700 or later. For more information, see Improve workload efficiency using NCCL Fast Socket.
December 20, 2022
Anthos clusters on VMwareAnthos clusters on VMware 1.12.4-gke.42 is now available. To upgrade, see Upgrading Anthos clusters on VMware. Anthos clusters on VMware 1.12.4-gke.42 runs on Kubernetes 1.23.13-gke.1700.
The supported versions offering the latest patches and updates for security vulnerabilities, exposures, and issues impacting Anthos clusters on VMware are 1.13, 1.12, and 1.11.
- Changed the relative file path fields in the admin cluster configuration file to use absolute paths.
- Added
yqtool in the admin workstation.
- Increased memory limit of
monitoring-operator-Pods to 1 GB to avoid potential OOM events under certain configurations. - Fixed the issue where deleting a user cluster also deleted
cluster-health-controllerandvsphere-metrics-exporterClusterRole objects. - Fixed the issue during admin cluster creation where
gkectl check-configfails due to missing OS images, ifgkectl prepareis not run first. - Fixed an issue where cluster deletion may be stuck at node draining when the user cluster control plane and node pools are on different datastores.
- Fixed the issue of
/var/log/audit/filling up disk space on the admin workstation. - Fixed the following vulnerabilities:
- Critical container vulnerabilities:
- High-severity container vulnerabilities:
- Container-optimized OS vulnerabilities:
- Ubuntu vulnerabilities:
(Available without upgrading) Fixed an issue where upgrading a Private IP environment with VPC peerings to Cloud Composer 2.0.31 and later versions resulted in intermittent issues with database connections.
Cloud Composer 1.20.2 and 2.1.2 are versions with an extended upgrade timeline.
Cloud SQL for MySQL now supports using the lower_case_table_names flag for MySQL 8.0. For more information, see Configure database flags.
update the GetOperation API to remove empty response strings in pending operations.
Preview stage support for the following integration:
Vertex AI TensorFlow Profiler
Vertex AI TensorFlow Profiler is generally available GA. You can use TensorFlow Profiler to debug model training performance for your custom training jobs.
For details, see Profile model training performance using Profiler.
Vertex AI Matching Engine
Vertex AI Matching Engine now offers General Availability support for updating your indices using Streaming Update, which is real-time indexing for the Approximate Nearest Neighbor (ANN) service.
Vertex AI Feature Store streaming ingestion is now generally available (GA).
You can now override the default data retention limit of 4000 days for the online store and the offline store in Vertex AI Feature Store.
- You can set the data retention limit for the online store at the featurestore level.
- You can set the data retention limit for the offline store at the entity type level.
Preview: You can use geo-location objects in firewall policy rules to filter external IPv4 and external IPv6 traffic based on specific geographic locations or regions.
Preview: You can use Threat Intelligence for firewall policy rules to secure your network by allowing or blocking traffic based on threat intelligence data.
Preview: You can use address groups to combine multiple IP addresses and IP ranges into a single named logical unit. You can then use this unit across multiple rules in the same or different firewall policies.
Preview: You can use fully qualified domain name (FQDN) objects in firewall policy rules to filter incoming or outgoing traffic from specific domain names.
December 19, 2022
Anthos clusters on bare metalRelease 1.13.3
Anthos clusters on bare metal 1.13.3 is now available for download. To upgrade, see Upgrading Anthos on bare metal. Anthos clusters on bare metal 1.13.3 runs on Kubernetes 1.24.
The following container image security vulnerabilities have been fixed:
- CVE-2022-35737
- CVE-2022-42311
- CVE-2022-33745
- CVE-2022-42309
- CVE-2022-42320
- CVE-2022-42323
- CVE-2022-33748
- CVE-2022-42321
- CVE-2022-33746
- CVE-2022-42310
- CVE-2022-42316
- CVE-2022-42322
- CVE-2022-42319
- CVE-2022-42325
- CVE-2022-42315
- CVE-2022-42324
- CVE-2022-42314
- CVE-2022-42317
- CVE-2022-42312
- CVE-2022-42318
- CVE-2022-42313
- CVE-2022-42326
Known issues:
For information about the latest known issues, see Anthos on bare metal known issues in the Troubleshooting section.
A weekly digest of client library updates from across the Cloud SDK.
Java
Changes for google-cloud-bigquery
2.20.0 (2022-12-13)
Features
- Add fast query path support when empty jobId object is passed (#2349) (42c083a)
- Next release from main branch is 2.20.0 (#2405) (9297a43)
Dependencies
- Update arrow.version to v10.0.1 (#2426) (aff9019)
- Update cloud client dependencies (#2444) (7255357)
- Update dependency com.google.api.grpc:proto-google-cloud-bigqueryconnection-v1 to v2.8.0 (#2418) (1ac1653)
- Update dependency com.google.api.grpc:proto-google-cloud-bigqueryconnection-v1 to v2.9.0 (#2441) (01cc3c3)
- Update dependency com.google.apis:google-api-services-bigquery to v2-rev20221127-2.0.0 (#2437) (eb52002)
- Update dependency com.google.cloud:google-cloud-datacatalog-bom to v1.12.0 (#2419) (c449031)
- Update dependency com.google.cloud:google-cloud-shared-dependencies to v3.1.0 (#2435) (c99b215)
- Update dependency com.google.cloud:google-cloud-storage to v2.15.1 (#2420) (baf337a)
- Update dependency org.graalvm.buildtools:junit-platform-native to v0.9.18 (#2424) (63b5196)
- Update dependency org.graalvm.buildtools:junit-platform-native to v0.9.19 (#2432) (396c6dc)
- Update dependency org.graalvm.buildtools:native-maven-plugin to v0.9.18 (#2425) (cd2ae9f)
- Update dependency org.graalvm.buildtools:native-maven-plugin to v0.9.19 (#2433) (bf94087)
- Update jmh.version to v1.36 (#2415) (0676586)
Python
Changes for google-cloud-bigquery
3.4.1 (2022-12-09)
Documentation
Dependencies
- make pyarrow and BQ Storage optional dependencies (e1aa921)
A weekly digest of client library updates from across the Cloud SDK.
Java
Changes for google-cloud-bigtable
2.17.1 (2022-12-13)
Dependencies
View your Cloud SQL costs in Billing export to BigQuery
You can now view your granular Cloud SQL instance cost data in the Cloud Billing Detailed cost export. Use the resource.global_name field in the export to view and filter your Cloud SQL instance data.
A release was made. Updates may include general performance improvements, bug fixes, and updates to the API reference documentation.
Cloud Logging now supports the following regions:
USEU
For more information, see Data regionality for Cloud Logging.
You can now use the ALTER INDEX statement to add columns into an index or drop non-key columns. For more information, see Alter an index.
Cloud TPU now supports TensorFlow patches: 2.8.4, 2.9.3, and 2.10.1. See the TensorFlow release notes for details:
A weekly digest of client library updates from across the Cloud SDK.
Python
Changes for google-cloud-dataflow-client
0.7.0 (2022-12-15)
Features
- Add support for
google.cloud.dataflow.__version__(5f36251) - Add typing to proto.Message based class attributes (5f36251)
Bug Fixes
- Add dict typing for client_options (5f36251)
- deps: Require google-api-core >=1.34.0, >=2.11.0 (9b9083c)
- Drop usage of pkg_resources (9b9083c)
- Fix timeout default values (9b9083c)
Documentation
New sub-minor versions of Dataproc images:
- 1.5.79-debian10, 1.5.79-rocky8, 1.5.79-ubuntu18
- 2.0.53-debian10, 2.0.53-rocky8, 2.0.53-ubuntu18
- 2.1.1-debian11, 2.1.1-rocky8, 2.1.1-ubuntu20
New Dataproc Serverless for Spark runtime versions:
- 1.0.25
- 2.0.5
Backported Spark patch in Dataproc Serverless for Spark runtime 1.0 and 2.0:
- SPARK-40481: Ignore stage fetch failure caused by decommissioned executor.
The Document AI OCR Processor has the following new features:
The OCR Processor now supports extracting embedded text from digital PDFs in public preview. A fallback to the optical OCR model is automatically triggered to extract text in the regions when the PDF being processed contains non-digital text. To opt into this feature, set
process_options.ocr_config.enable_native_pdf_parsing=truein your API request to the OCR Processor.Added advanced versioning support to the Document AI OCR, which enables OCR users to pin to a historical model version. When enabled, OCR outputs are guaranteed to be consistent and virtually frozen, with zero behavioral drifts. To enable advanced versioning, select the release candidate version
pretrained-ocr-v1.2-2022-11-10in your Document AI console.
Known issues with the digital PDF feature of the Document AI OCR Processor:
On a small number of documents, the word ordering within lines of text as reported by native text extraction might be wrong.
On certain documents, invisible text embedded in a native PDF may be reported.
On certain Japanese documents, currency symbols such as Yen might be incorrectly extracted as
/.On certain documents, apostrophe symbols may be missing in word/line results.
On certain documents, native text extraction might report different word/line results than those obtained by image-based OCR on an identical document.
Support for the australia-southeast2 (Melbourne) region.
Support for the australia-southeast2 (Melbourne) region.
A weekly digest of client library updates from across the Cloud SDK.
CVE-2022-37434, CVE-2022-40674, CVE-2022-1586, CVE-2022-1587 have been patched in the PD CSI driver in 1.22, 1.23, 1.24 for newly created clusters. CVE-2022-37434, CVE-2021-3999, CVE-2022-40674, CVE-2022-1586, CVE-2022-1587 have been patched in the PD CSI driver in 1.25 for newly created clusters.
Managed Microsoft AD supports applying Microsoft security baselines on your Managed Microsoft AD VMs. For more information, see Microsoft security baselines.
Managed Microsoft AD has added a set of new event IDs to audit logs that you can export for a domain. For the updated list of event IDs, see Exported event IDs.
A weekly digest of client library updates from across the Cloud SDK.
Pub/Sub Lite now supports export subscriptions. You can use an export subscription to export Pub/Sub Lite messages to a destination Pub/Sub topic. This feature is generally available (GA).
A weekly digest of client library updates from across the Cloud SDK.
Python
Changes for google-cloud-secret-manager
2.13.0 (2022-12-14)
Features
- Add support for
google.cloud.secretmanager.__version__(5530112) - Add typing to proto.Message based class attributes (5530112)
- Regenerate client for v1beta1 (dc9b1e3)
Bug Fixes
- Add dict typing for client_options (5530112)
- deps: Require google-api-core >=1.34.0, >=2.11.0 (dc9b1e3)
- Drop usage of pkg_resources (dc9b1e3)
- Fix timeout default values (dc9b1e3)
Documentation
Storage Transfer Service now offers Preview support for tracking progress of a Transfer Job using Cloud Monitoring, allowing you to monitor the number of objects and amount of data copied by Storage Transfer Service in near real-time.
See Monitor transfer jobs for details.
December 16, 2022
Assured WorkloadsThe ITAR compliance regime is now generally available.
You can now enable up to 500 active rules within your Chronicle account. Up to 75 of those can be multi-event rules. See Running a rule against live data for information on how to enable rules and Manage rules using Rules Editor for information on how to configure rules.
You can now enable a keyboard shortcuts helper. This overlay displays contextual shortcuts based on what's on the screen, or which UI element is focused such as code editors, tables, and menu bars.
For more information, see Keyboard shortcuts.
Automatic IAM database authentication for Cloud SQL for MySQL is now available. To get started using automatic IAM database authentication, see Cloud SQL IAM database authentication.
MySQL 5.7.38 has been upgraded to 5.7.39. For more information, see MySQL 5.7 release notes.
Landmark Detection Upgrade
Specify "builtin/latest" in the model field of a Feature object to use the new model.
We'll support both the current model and the new model the next 90 days. After 90 days the current model will be deprecated and only the new model will be used for all landmark detection requests.
Face Detection Upgrade
Specify "builtin/latest" in the model field of a Feature object to use the new model.
We'll support both the current model and the new model the next 90 days. After 90 days the latest model will become the default model. The old model will be available for another 90 days by specifying "builtin/legacy".
The image import tool now supports importing RHEL 9 images to Google Cloud.
Dataflow now supports regional placement for workers.
Dataplex BigLake integration is now available in Preview. Dataplex BigLake integration allows upgrading a Cloud Storage bucket to managed, creating BigLake tables instead of external tables. This allows the manual application of column-level, row-level, and table-level policies.
Dialogflow CX now supports flow export to diagram in the draw.io XML format.
To improve security, the "dialogflow.sessions.detectIntent" and "dialogflow.sessions.streamingDetectIntent" permissions are being removed from the IAM Viewer role on January 31, 2023.
To continue using the Dialogflow CX/ES console simulator or making detectIntent/streamingDetectIntent API calls, users and service accounts with the IAM Viewer role must update roles granted to them to include a role with these permissions. For example, the IAM Dialogflow API Client role (ES documentation, CX documentation) includes these permissions. For Dialogflow CX, you can apply the agent-specific Client role using the Dialogflow console.
Advanced network DDoS protection is now Generally Available for network load balancers, protocol forwarding, and VMs with public IP addresses. Metering and billing of Managed Protection Plus protected resources and the data processing fee for the endpoint covered by advanced Network DDoS protection will begin on Jan 31, 2023. For more information, see Configure advanced DDoS protection and the Cloud armor pricing page.
Global external HTTP(S) load balancer is now supported with the GKE Gateway controller in Preview. You can now configure GKE clusters with control plane version 1.24 or later in Rapid channel to use a global external HTTP(S) load balancer to expose web services to the Internet, in a single cluster or multi-cluster architecture. You can benefit from many advanced traffic management capabilities offered by the new generation of Google Cloud global external HTTP(S) load balancers natively in GKE by using the Kubernetes Gateway API and specifying a new Gateway class. To see the difference between Gateway classes compatible with our GKE Gateway controller, see here.
Event Threat Detection, a built-in service of Security Command Center, launched the Initial Access: Dormant Service Account Action rule to Preview. This rule detects events where a dormant user-managed service account triggered an action. For more information, see Event Threat Detection rules.
A new series of enhancements for handling locality load balancing in proxyless mesh deployments is now available in GA. These enhancements let you do the following:
Create and use a list of preferred load-balancing policies. With this feature, if your first preferred policy can't be used by a particular client, gRPC falls back to the next policy on the list.
Use a custom load-balancing policy that you created and deployed with gRPC. As part of a related gRPC enhancement, a new set of APIs lets you capture metrics about query cost and server utilization. You can use these APIs to fine-tune your custom policy.
For more information about using these features, see Locality load balancing.
December 15, 2022
Access ApprovalAccess Approval supports Artifact Registry in the Preview stage. For the complete list of services that Access Approval supports, see Supported services.
A new generation of Anthos attached clusters is now available. This release includes the following Anthos attached clusters platform versions:
- 1.21.0-gke.1
- 1.22.0-gke.1
- 1.23.0-gke.2
- 1.24.0-gke.1
- 1.25.0-gke.1
This release of Anthos attached clusters supports AKS and EKS cluster versions 1.21, 1.22, 1.23, 1.24 and 1.25.
This generation of Anthos attached clusters further streamlines the process of attaching your cluster to the Google Cloud infrastructure.
This release supports logging and monitoring of your cluster's status with full log examination through Google's Cloud Logging UI.
This release supports migration of your existing EKS and AKS clusters from the previous generation Anthos attached clusters product.
You can now launch clusters with the following Kubernetes versions:
- 1.23.14-gke.1100
- 1.24.8-gke.1300
- 1.25.4-gke.1300
You can now dynamically update AWS node pool security groups. To do so your API role must have the ec2:ModifyInstanceAttribute and ec2:DescribeInstances permissions.
You can now dynamically updating AWS node pool tags. To do so, your API role must have the autoscaling:CreateOrUpdateTags, autoscaling:DeleteTags, ec2:CreateTags, ec2:DeleteTags, and ec2:DescribeLaunchTemplates permissions.
Elastic File System (EFS) dynamic provisioning is now available in GA for clusters at version 1.25 or later. To use this feature, you must add the following permissions to the control plane role:
- ec2:DescribeAvailabilityZones
- elasticfilesystem:DescribeAccessPoints
- elasticfilesystem:DescribeFileSystems
- elasticfilesystem:DescribeMountTargets
- elasticfilesystem:CreateAccessPoint
- elasticfilesystem:DeleteAccessPoint
You can now upload workload metrics using Google Managed Service for Prometheus with managed collection to Cloud Monarch. This has been upgraded from a preview feature to GA.
You can now enable and update CloudWatch metrics collection on AWS node pool's auto scaling group. To use this feature your API role must have the autoscaling:EnableMetricsCollection and autoscaling:DisableMetricsCollection permissions.
Added a new token manager (gke-token-manager) to generate tokens for control plane components. This eliminates a control-plane component dependency on kube-apiserver, removes the need for RBAC in token generation, and permits logging to begin earlier in the startup cycle.
As a preview feature, Google Cloud Monitoring can now ingest a set of control plane metrics from kube-apiserver, kube-scheduler, kube-controller manager and etcd.
Administrators can grant AWS cluster access to all members of a Google Group by granting the required RBAC permission to the group. For details, see Set up the Connect gateway with Google Groups.
To use the following features with gcloud requires gcloud v413.0.0, scheduled for release in January 2023. You can access these features through the API now:
- Dynamically updating AWS node pool tags
- Enable and update CloudWatch metrics collection on AWS node pools
Static pods running on the cluster's control plane VMs are now restricted to run as non-root Linux users.
This release fixes the following vulnerabilities:
- CVE-2016-10228
- CVE-2019-19126
- CVE-2019-25013
- CVE-2020-10029
- CVE-2020-16156
- CVE-2020-1752
- CVE-2020-27618
- CVE-2020-6096
- CVE-2021-27645
- CVE-2021-3326
- CVE-2021-33574
- CVE-2021-35942
- CVE-2021-3671
- CVE-2021-3999
- CVE-2021-4037
- CVE-2021-43618
- CVE-2022-0171
- CVE-2022-1184
- CVE-2022-1586
- CVE-2022-1587
- CVE-2022-20421
- CVE-2022-23218
- CVE-2022-23219
- CVE-2022-2602
- CVE-2022-2663
- CVE-2022-2978
- CVE-2022-3061
- CVE-2022-3116
- CVE-2022-3176
- CVE-2022-32221
- CVE-2022-3303
- CVE-2022-35737
- CVE-2022-3586
- CVE-2022-3621
- CVE-2022-3646
- CVE-2022-3649
- CVE-2022-37434
- CVE-2022-3903
- CVE-2022-39188
- CVE-2022-39842
- CVE-2022-40303
- CVE-2022-40304
- CVE-2022-40307
- CVE-2022-40768
- CVE-2022-4095
- CVE-2022-41674
- CVE-2022-41916
- CVE-2022-42010
- CVE-2022-42011
- CVE-2022-42012
- CVE-2022-42719
- CVE-2022-42720
- CVE-2022-42721
- CVE-2022-42722
- CVE-2022-43680
- CVE-2022-43750
- CVE-2022-44638
Fixed an issue in which outdated versions of gke-connect-agent were not always removed after cluster upgrades.
Kubernetes 1.22 versions are no longer supported. To upgrade to a supported version, see Upgrade your AWS cluster version.
Kubernetes version 1.25 deprecates several APIs. For details, see the Kubernetes Deprecated API Migration Guide.
You can now launch clusters with the following Kubernetes versions:
- 1.23.14-gke.1100
- 1.24.8-gke.1300
- 1.25.4-gke.1300
You can now upload workload metrics using Google Managed Service for Prometheus with managed collection to Cloud Monarch. This has been upgraded from a preview feature to GA.
Azure ActiveDirectory is now supported in GA, letting cluster admins configure RBAC policies based on Azure AD groups for authorization in clusters and supporting retrieval of groups information for users belonging who belong to more than 200 groups.
Added a new token manager (gke-token-manager) to generate tokens for control plane components. This eliminates a control-plane component dependency on kube-apiserver, removes the need for RBAC in token generation, and permits logging to begin earlier in the startup cycle.
As a preview feature, Google Cloud Monitoring can now ingest a set of control plane metrics from kube-apiserver, kube-scheduler, kube-controller manager and etcd.
Administrators can grant Azure cluster access to all members of a Google Group by granting the required RBAC permission to the group. For details, see Set up the Connect gateway with Google Groups.
Static pods running on the cluster's control plane VMs are now restricted to run as non-root Linux users.
This release fixes the following vulnerabilities:
- CVE-2016-10228
- CVE-2019-19126
- CVE-2019-25013
- CVE-2020-10029
- CVE-2020-16156
- CVE-2020-1752
- CVE-2020-27618
- CVE-2020-6096
- CVE-2021-27645
- CVE-2021-3326
- CVE-2021-33574
- CVE-2021-35942
- CVE-2021-3671
- CVE-2021-3999
- CVE-2021-4037
- CVE-2021-43618
- CVE-2022-0171
- CVE-2022-1184
- CVE-2022-1586
- CVE-2022-1587
- CVE-2022-20421
- CVE-2022-23218
- CVE-2022-23219
- CVE-2022-2602
- CVE-2022-2663
- CVE-2022-2978
- CVE-2022-3061
- CVE-2022-3116
- CVE-2022-3176
- CVE-2022-32221
- CVE-2022-3303
- CVE-2022-35737
- CVE-2022-3586
- CVE-2022-3621
- CVE-2022-3646
- CVE-2022-3649
- CVE-2022-37434
- CVE-2022-3903
- CVE-2022-39188
- CVE-2022-39842
- CVE-2022-40303
- CVE-2022-40304
- CVE-2022-40307
- CVE-2022-40768
- CVE-2022-4095
- CVE-2022-41674
- CVE-2022-41916
- CVE-2022-42010
- CVE-2022-42011
- CVE-2022-42012
- CVE-2022-42719
- CVE-2022-42720
- CVE-2022-42721
- CVE-2022-42722
- CVE-2022-43680
- CVE-2022-43750
- CVE-2022-44638
Fixed an issue in which outdated versions of gke-connect-agent were not always removed after cluster upgrades.
Kubernetes 1.22 versions are no longer supported. To upgrade to a supported version, see Upgrade your Azure cluster version.
Kubernetes version 1.25 deprecates several APIs. For details, see the Kubernetes Deprecated API Migration Guide.
Anthos clusters on VMware 1.13.3-gke.26 is now available. To upgrade, see Upgrading Anthos clusters on VMware. Anthos clusters on VMware 1.13.3-gke.26 runs on Kubernetes 1.24.7-gke.1700.
The supported versions offering the latest patches and updates for security vulnerabilities, exposures, and issues impacting Anthos clusters on VMware are 1.13, 1.12, and 1.11.
- Added
yqtool in the admin workstation to simplify troubleshooting. - Upgraded VMware vSphere Container Storage Plug-in from 2.5 to 2.6.2. This version bump includes support for Kubernetes version 1.24. For more information, see VMware vSphere Container Storage Plug-in 2.6 Release Notes.
- Added storage validation that checks Kubernetes PersistentVolumes and vSphere virtual disks as part of admin and user cluster upgrade preflight checks.
- Fixed an issue where
anet-operatorcould be scheduled to a Windows node withenableControlplaneV2: true. - Fixed OOM events associated with
monitoring-operator-Pods by increasing memory limit to 1GB. - Fixed the issue where deleting a user cluster also deleted
cluster-health-controllerandvsphere-metrics-exporterClusterRole objects. - Fixed the following vulnerabilities:
- High-severity container vulnerabilities:
Enhancements to Bare Metal Solution resource management for SAP HANA–For Bare Metal Solution environments running SAP HANA, you can now use the Google Cloud console, gcloud CLI, and API to view and manage your Bare Metal Solution servers, storage, and networks.
For more information, see Maintaining your Bare Metal Solution environment in the SAP HANA on Bare Metal Solution deployment guide.
Any job can use a custom machine type. (Before, you could only use custom machine types by creating a job from a Compute Engine instance template.)
Preview: Batch supports VPC Service Controls, which lets you create perimeters that protect the resources and data of Google Cloud services that you explicitly specify. For more information about using VPC Service Controls with Batch, see Supported products and limitations.
You can now access and query Cloud SQL data over a private connection. This feature is generally available (GA).
You can now view a list of certificates managed by Certificate Manager in your project in the Cloud Console. You can also view detailed information about each certificate. For instructions, see Manage Certificates.
Load Balancing SSL certificates, previously available in the "Certificates" tab on the "Load Balancing" page, are now also available in the Certificate Manager page in the "Classic Certificates" tab.
Starting December 15, 2022, you may not see data in your Chronicle instance that is older than the data retention period defined in your contract. For more information, see Data Retention.
All Composer environment GKE clusters are set up with maintenance exclusions for the period between December 22, 2022 and January 2, 2023. For more information, see Maintenance exclusions.
Cloud Data Fusion integrates with Data Catalog for asset level lineage in Preview.
Dataplane v2 for Cloud Interconnect is fully available for customers using Dedicated Interconnect or Partner Interconnect in the following regions:
us-central1(Iowa)us-east4(Virginia)
All new VLAN attachments that you create in these regions are automatically provisioned on Dataplane v2. Existing VLAN attachments for these regions can be migrated to Dataplane v2. You can migrate existing attachments yourself by re-creating the attachments, or you can request and schedule an assisted migration. Contact Google Cloud Support for assistance.
You can now allow other Google Cloud services, such as BigQuery, to access data in Cloud SQL for MySQL and make queries against this data over a private connection. For more information, see Create instances.
You can now allow other Google Cloud services, such as BigQuery, to access data in Cloud SQL for PostgreSQL and make queries against this data over a private connection. For more information, see Create instances.
The Dataflow VM image has been updated to include mitigations for OpenSSL CVE-2022-3602 by upgrading to cos-97-16919-189-12. For jobs that use GPUs, the NVIDIA drivers have also been updated to mitigate the vulnerability. Dataflow jobs started on or after December 14, 2022 will run VM instances that use this image.
M102 Release
- TensorFlow 2.11 is now available.
- PyTorch 1.13 is now available.
- Regular security patches and package upgrades.
M102 Release
- TensorFlow 2.11 is now available.
- PyTorch 1.13 is now available.
- Added support for Jupyter[Lab] Language Server Protocol.
- Regular security patches and package upgrades.
We are launching the Release Candidate version, pretrained-utility-v1.2-2022-12-15 of the Utility processor. This version includes the following new features:
- Removal of three entities from schema:
delivery_date,receiver_email,receiver_phone - Improvements to overall performance
The Utility processor version pretrained-utility-v1.1-2021-04-09 will continue to serve as the current latest Stable version.
Eventarc support for creating triggers for direct events from the following sources is available in Preview:
- API Gateway
- Apigee Registry
- BeyondCorp
- Certificate Manager
- Cloud Data Fusion
- Cloud Functions
- Cloud Memorystore for Memcached
- Database Migration
- Datastream
- Eventarc
- Workflows
The ability to join a Windows VM automatically to a Managed Microsoft AD domain is available in Preview.
Enhancements to Bare Metal Solution resource management for SAP HANA
For Bare Metal Solution environments running SAP HANA, you can now view and manage your Bare Metal Solution servers, storage, and networks using the Google Cloud console, CLI, and API.
For more information, see Maintaining your Bare Metal Solution environment in the SAP HANA on Bare Metal Solution deployment guide.
Event Threat Detection, a built-in service of Security Command Center, launched the following rules to Preview.
- Privilege Escalation: Anomalous Impersonation of Service Account for Admin Activity
- Privilege Escalation: Anomalous Multistep Service Account Delegation for Admin Activity
- Privilege Escalation: Anomalous Multistep Service Account Delegation for Data Access
- Privilege Escalation: Anomalous Service Account Impersonator for Admin Activity
- Privilege Escalation: Anomalous Service Account Impersonator for Data Access
These rules detect the unusual impersonation or delegation of a service account, as recorded in either the Admin Activity or Data Access audit logs. For more information, see Event Threat Detection rules.
Storage Transfer Service now offers GA Support for transferring data between file systems, including on-premises file systems and Filestore instances. This allows you to use the Transfer Service API, gcloud command line tool, or the Cloud console to migrate data from a self-managed file system to Filestore; accelerate data transfer from an on-premise file system to a cloud file system; or move data between on-premises systems.
You can also transfer specific files or objects using a manifest for file system to file system transfers.
TensorFlow Enterprise 2.11 is now available. Note that this TensorFlow Enterprise version does not include Long Term Version Support.
Preview stage support for the following integrations:
M102 Release
The M102 release of Vertex AI Workbench includes the following:
- TensorFlow 2.11 is now available.
- PyTorch 1.13 is now available.
- Regular security patches and package upgrades.
A workflow's source and details can now be updated independently through the Cloud Console using the Source and Details tabs for quicker editing.
December 14, 2022
AnthosAnthos component releases for October, 2022
Anthos clusters on VMware:
- October 28, 2022: CVE-2022-20409
- October 27, 2022: CVE-2022-3176
- October 25, 2022: 1.12.3-gke.23 patch release
- October 13, 2022: 1.11.4-gke.32 patch release
- October 12, 2022
- October 11, 2022
Anthos clusters on bare metal:
- October 31, 2022: 1.13.1 patch release
- October 28, 2022: 1.11.7 patch release
- October 05, 2022: 1.12.3 patch release
Anthos clusters on AWS:
Anthos clusters on Azure:
Anthos Config Management:
Anthos Service Mesh:
- October 25, 2022: 1.15.2-asm.6, 1.14.5-asm.3, 1.13.9-asm.1 patch releases
- October 19, 2022: Managed Anthos Service Mesh
- October 05, 2022: 1.14.4-asm.2, 1.13.8-asm.3, 1.13.8-asm.4, 1.12.9-asm.3 patch releases
Connect:
- N/A
Cloud Run for Anthos:
- N/A
Migrate to Containers:
- N/A
Cloud Logging:
- October 31, 2022: release updates
- October 24, 2022: release updates
- October 21, 2022: release updates
- October 17, 2022: release updates
- October 10, 2022: release updates
- October 04, 2022: release updates
- October 03, 2022: release updates
Cloud Monitoring:
Release 1.12.6
Anthos clusters on bare metal 1.12.6 is now available for download. To upgrade, see Upgrading Anthos on bare metal. Anthos clusters on bare metal 1.12.6 runs on Kubernetes 1.23.
The following container image security vulnerabilities have been fixed:
Known issues:
For information about the latest known issues, see Anthos on bare metal known issues in the Troubleshooting section.
On December 14, 2022 we released an updated version of Apigee integrated portal.
| Bug ID | Description |
|---|---|
| 260725456 | The x-xss-protection header on portal runtime loading changed from value of "1;" to be "1; mode=block". |
| 254053443 | Fixed a bug to ensure that a Not found page is displayed whenever an invalid document path is navigated to in a portal. |
The following resource types are now publicly available through the Export APIs (ExportAssets, ListAssets, and BatchGetAssetsHistory), Feed API, and Search APIs (SearchAllResources, SearchAllIamPolicies).
- Transcoder
transcoder.googleapis.com/Jobtranscoder.googleapis.com/JobTemplate
Zonal Cloud DNS zones are now available in GA.
You can create private DNS zones that are scoped only to a Google Cloud zone.
Configuring Cloud DNS scopes is now available in GA.
Cloud Data Fusion is available in the following regions:
us-east5us-south1
A new detection model is available for the STREET_ADDRESS infoType detector. The new model offers improved detection quality. You can try it out by setting InfoType.version to latest when including the STREET_ADDRESS infoType in your InspectConfig.
You can still use the old model by setting InfoType.version to stable or leaving it unset when using the STREET_ADDRESS infoType. In 30 days, the new model will be promoted to stable.
You can disable noisy or otherwise unnecessary threat IDs by using the
--threat-exceptions flag when you create or update your Cloud IDS
endpoint. IDS Threat Exceptions is now Generally Available. For more information, see the Cloud IDS overview
You can now use the Observability tab on the Kubernetes Engine Workloads page to see the five workloads consuming the most of a resource. For more information, see View cluster and workload observability metrics.
Cloud Router supports Multiprotocol BGP (MP-BGP) and can exchange IPv6 prefixes over IPv4 BGP sessions. Cloud Router supports IPv6 prefix advertisement for VPC networks with dual-stack subnets. You can enable IPv6 prefix exchange over IPv4 BGP sessions that are created for HA VPN tunnels. This feature is generally available.
Cloud Spanner now offers the Cloud Spanner change streams to Pub/Sub Dataflow template, which streams Cloud Spanner data change records and writes them into Pub/Sub topics.
You can now create a custom instance configuration and add optional read-only replicas to your custom instance configurations to scale reads and support low latency stale reads. For more information, see Regional and multi-region configurations.
Cloud VPN supports dual-stack HA VPN gateways that allow both IPv4 and IPv6 traffic. By using Multiprotocol BGP (MP-BGP) sessions in Cloud Router, HA VPN can connect your peer networks to VPC networks with dual-stack subnets. This feature is generally available.
Config Controller now uses the following versions of its included products:
- Config Connector v1.97.0, release notes
VPC Service Controls support for Config Controller is in GA status. This note was updated on January 11 2023.
(2022-R28) Version updates
GKE cluster versions have been updated.
New versions available for upgrades and new clusters
The following Kubernetes versions are now available for new clusters and for opt-in control plane upgrades and node upgrades for existing clusters. For more information on versioning and upgrades, see GKE versioning and support and Upgrades.
No channel
- Version 1.24.7-gke.900 is now the default version
- The following control plane and node versions are now available:
- The following control plane versions are no longer available:
- 1.22.13-gke.1000
- 1.22.14-gke.300
- Control planes and nodes with auto-upgrade enabled will be upgraded from version 1.23 to version 1.23.13-gke.900 with this release.
- Control planes and nodes with auto-upgrade enabled will be upgraded from version 1.25 to version 1.25.3-gke.800 with this release.
Stable channel
- Version 1.23.13-gke.900 is now the default version in the Stable channel
- Control planes and nodes with auto-upgrade enabled in the Stable channel will be upgraded from version 1.23 to version 1.23.13-gke.900 with this release.
Regular channel
- Version 1.24.7-gke.900 is now the default version in the Regular channel
- The following versions are now available in the Regular channel:
- The following versions are no longer available in the Regular channel:
- 1.22.13-gke.1000
- 1.23.12-gke.1600
- Control planes and nodes with auto-upgrade enabled in the Regular channel will be upgraded from version 1.21 to version 1.22.15-gke.100 with this release.
- Control planes and nodes with auto-upgrade enabled in the Regular channel will be upgraded from version 1.22 to version 1.23.13-gke.900 with this release.
- Control planes and nodes with auto-upgrade enabled in the Regular channel will be upgraded from version 1.23 to version 1.23.13-gke.900 with this release.
- Control planes and nodes with auto-upgrade enabled in the Regular channel will be upgraded from version 1.24 to version 1.24.7-gke.900 with this release.
- Control planes and nodes with auto-upgrade enabled in the Regular channel will be upgraded from version 1.25 to version 1.25.3-gke.800 with this release.
Rapid channel
- Version 1.25.4-gke.1600 is now the default version in the Rapid channel
- The following versions are now available in the Rapid channel:
- The following versions are no longer available in the Rapid channel:
- 1.22.15-gke.100
- 1.23.12-gke.1600
- 1.24.5-gke.600
- 1.25.3-gke.800
- Control planes and nodes with auto-upgrade enabled in the Rapid channel will be upgraded from version 1.21 to version 1.22.15-gke.1000 with this release.
- Control planes and nodes with auto-upgrade enabled in the Rapid channel will be upgraded from version 1.22 to version 1.23.13-gke.900 with this release.
- Control planes and nodes with auto-upgrade enabled in the Rapid channel will be upgraded from version 1.23 to version 1.23.13-gke.900 with this release.
- Control planes and nodes with auto-upgrade enabled in the Rapid channel will be upgraded from version 1.25 to version 1.25.4-gke.1600 with this release.
Cloud DNS for GKE (cluster scope) is now Generally Available. You can now configure GKE clusters with control plane version 1.24.7-gke.800, 1.25.3-gke.700 or later to use Cloud DNS as the DNS provider for in-cluster name resolution, and replace the existing DNS service based on kube-dns.
GKE Autopilot clusters may now migrate the cluster's datapath provider to Dataplane V2. Migration is triggered during a control plane upgrade (see version requirements below). The migration is complete once all nodes running the legacy datapath have been recreated. Node pools created after the control plane upgrade will be created using Dataplane V2.
For clusters running 1.24 without Dataplane V2, upgrading to
1.24.7-gke.300or a higher 1.24 version will begin the migration to Dataplane V2.For clusters running 1.25 without Dataplane V2, upgrading to
1.25.3-gke.200or a higher 1.25 version will begin the migration to Dataplane V2.
To determine whether you are in the process of migrating the datapath, run:
gcloud container clusters describe <CLUSTER> --region <REGION> --project <PROJECT> --format="value(networkConfig.datapathProvider)"
Clusters migrating to Dataplane V2 will have the datapath provider field of the cluster set to MIGRATE_TO_ADVANCED_DATAPATH.
Clusters that have migrated to Dataplane V2 will have the datapath provider field of the cluster set to ADVANCED_DATAPATH.
(2022-R28) Version updates
- Version 1.24.7-gke.900 is now the default version in the Regular channel
- The following versions are now available in the Regular channel:
- The following versions are no longer available in the Regular channel:
- 1.22.13-gke.1000
- 1.23.12-gke.1600
- Control planes and nodes with auto-upgrade enabled in the Regular channel will be upgraded from version 1.21 to version 1.22.15-gke.100 with this release.
- Control planes and nodes with auto-upgrade enabled in the Regular channel will be upgraded from version 1.22 to version 1.23.13-gke.900 with this release.
- Control planes and nodes with auto-upgrade enabled in the Regular channel will be upgraded from version 1.23 to version 1.23.13-gke.900 with this release.
- Control planes and nodes with auto-upgrade enabled in the Regular channel will be upgraded from version 1.24 to version 1.24.7-gke.900 with this release.
- Control planes and nodes with auto-upgrade enabled in the Regular channel will be upgraded from version 1.25 to version 1.25.3-gke.800 with this release.
(2022-R28) Version updates
- Version 1.25.4-gke.1600 is now the default version in the Rapid channel
- The following versions are now available in the Rapid channel:
- The following versions are no longer available in the Rapid channel:
- 1.22.15-gke.100
- 1.23.12-gke.1600
- 1.24.5-gke.600
- 1.25.3-gke.800
- Control planes and nodes with auto-upgrade enabled in the Rapid channel will be upgraded from version 1.21 to version 1.22.15-gke.1000 with this release.
- Control planes and nodes with auto-upgrade enabled in the Rapid channel will be upgraded from version 1.22 to version 1.23.13-gke.900 with this release.
- Control planes and nodes with auto-upgrade enabled in the Rapid channel will be upgraded from version 1.23 to version 1.23.13-gke.900 with this release.
- Control planes and nodes with auto-upgrade enabled in the Rapid channel will be upgraded from version 1.25 to version 1.25.4-gke.1600 with this release.
(2022-R28) Version updates
- Version 1.24.7-gke.900 is now the default version
- The following control plane and node versions are now available:
- The following control plane versions are no longer available:
- 1.22.13-gke.1000
- 1.22.14-gke.300
- Control planes and nodes with auto-upgrade enabled will be upgraded from version 1.23 to version 1.23.13-gke.900 with this release.
- Control planes and nodes with auto-upgrade enabled will be upgraded from version 1.25 to version 1.25.3-gke.800 with this release.
(2022-R28) Version updates
- Version 1.23.13-gke.900 is now the default version in the Stable channel
- Control planes and nodes with auto-upgrade enabled in the Stable channel will be upgraded from version 1.23 to version 1.23.13-gke.900 with this release.
For information about issues with workforce identity federation, see Troubleshoot workforce identity federation
The Pull subscription guide is now updated with improved conceptual information regarding the following topics:
Cloud Storage Backint agent for SAP HANA version 1.0.24
Version 1.0.24 of the Cloud Storage Backint agent for SAP HANA is now available. This version includes logging enhancements.
For more information about the agent, see Cloud Storage Backint agent for SAP HANA overview.
General Availability: VPC Peering supports the exchange of IPv6 routes between peered VPC networks.
December 13, 2022
AlloyDB for PostgreSQLAlloyDB for PostgreSQL is generally available (GA).
Anthos clusters on AWS (previous generation) aws-1.14.0-gke.2 is now available.
You can now launch clusters with the following Kubernetes versions:
- 1.23.13-gke.2000
- 1.24.7-gke.2000
- 1.25.3-gke.1900
This release fixes the following vulnerabilities:
Kubernetes version 1.25 deprecates several APIs. See the Kubernetes Deprecated API Migration Guide for details.
Release 1.14.0
Anthos clusters on bare metal 1.14.0 is now available for download. To upgrade, see Upgrading Anthos on bare metal. Anthos clusters on bare metal 1.14.0 runs on Kubernetes 1.25.
Improved cluster lifecycle functionalities:
Upgraded from Kubernetes version 1.24 to 1.25.
Enabled customers to run the latest health and preflight checks by running the command
bmctl check cluster –check-image-version=latest. Setting thecheck-image-versionflag to 'latest' ensures that clusters are examined for more recent issues, including issues discovered after a release.Preview: Added support of Control group v2 (cgroup v2).
GA: Added automatic reservation of CPU and memory resources on cluster nodes so that system daemons have the resources they require.
Optimized the consumption of resources by components such as
cluster-operator,cap-manager,preflight-check operator, andlifecycle-controllers-manager.GA: Enabled automatic and periodic health checks on all clusters.
Networking:
Preview: Added support for turning on kube-proxy-free mode for cluster objects. WARNING: This operation is not reversible. Once enabled, it cannot be disabled.
Changed behavior of Dataplane V2 so that it drops a packet if no service backends are available. Previously, the packet was passed to the kernel stack.
Enabled automatic API rate limit adjustments in Dataplane V2.
Observability:
Added severity level to container logs.
Enabled collection of uptime and other Kubernetes resource metrics from the kubelet summary API.
Enabled Stackdriver log forwarder in the bootstrap cluster. This log forwarder publishes bootstrap container logs to Cloud Logging.
Security and Identity:
GA: Added feature enabling cluster administrators to configure RBAC policies based on Azure Active Directory (AD) groups. Groups information for users belonging to more than 200 groups can now be retrieved.
GA: Added secure computing mode (seccomp) support. Running containers with a seccomp profile improves the security of a cluster because it restricts the system calls that containers are allowed to make to the kernel.
Added annotation in the cluster configuration file which allows customers to disable the kubelet read-only port. After disabling the read-only port, customers have to change their cluster configurations so that workloads use the kubelet secure port.
VM Runtime:
GA: Added support for guest OS booting of UEFI. Previously, only BIOS was supported.
Preview: Enabled Terraform scripting to create VMs on an Anthos cluster. For more information, including usage instructions, an input reference, and examples, see the terraform-google-anthos-vm GitHub repository.
Preview: Add support for non-uniform memory access (NUMA) awareness. When enabled, all communication within the VM is local to the NUMA node, thus avoiding the performance cost of data transactions with remote memory locations.
Preview: Enabled multicast traffic for VMs.
Added Anthos VM Runtime preflight checks to validate hardware accelerator configuration.
Enabled configuration of storage's volume mode (block or filesystem) and access modes, such as RWO and RWX.
Enabled means to configure the storage class of a scratch space. A scratch space is sometimes required when importing or uploading a VM disk image.
Added support for configuring
cloud-init, usingvirtctl.Enabled ability to disable auto-installation of the guest agent binary. After the initial guest agent installation, yoiu can set the
autoInstallGuestAgentflag tofalseso that the binary doesn't mount in subsequent restarts.Enabled the support of multiple network interfaces, by default, for all clusters.
Improved security for creating a VM with
kubectl virt create. If an initial password is specified, it is now stored in a secret and not as a VM annotation.Reduced the permissions of the network controller.
Changed default to always use Asynchronous IO mode (AIO) in order to reduce QEMU memory pressure.
Added VM creation and disk provisioning times to Prometheus metrics.
Added support for the Tesla T4 GPU.
Enabled reset of GPU card to its original status when GPU functionality is disabled.
Enabled ability to disable Anthos VM Runtime when it's in the enabling state and custom resource definitions haven't yet been installed.
Added the following command, which allows you to display the VM screen:
kubectll virt vnc --screenshot VM_NAME.Fixed the IP address update for Windows guest VMs.
Resolved the MacVTap interface creation failure which occurred when the name of the interface was too long.
Fixed attaching VM disk using SATA driver.
Fixed issue so that setting
disableCDIUploadProxyVIPto true correctly disables thecdi-uploadproxyservice.Fixed issue so that specifying a
PersistentVolumeClaim(PVC) with an empty underlyingPersistentVolume(PV) correctly creates the underlying empty disk format (raw or qcow2).Enforced VM names to follow the standard RFC1123 format.
Fixed issue so that ISO image is correctly imported from a Cloud Storage bucket.
Fixed benign crash looping of the NVIDIA device plugin and the Multi-Instance GPU (MIG) manager when all GPU cards are allocated to a VM.
Fixed issue so that
virt-launcherPod can be created when advanced compute is enabled.
Known issues:
For information about the latest known issues, see Anthos on bare metal known issues in the Troubleshooting section.
You can now use any configured service account in your Cloud project as the app-level default service account, while creating and updating your App Engine applications.
You can now use any configured service account in your Cloud project as the app-level default service account, while creating and updating your App Engine applications.
You can now use any configured service account in your Cloud project as the app-level default service account, while creating and updating your App Engine applications.
You can now use any configured service account in your Cloud project as the app-level default service account, while creating and updating your App Engine applications.
You can now use any configured service account in your Cloud project as the app-level default service account, while creating and updating your App Engine applications.
You can now use any configured service account in your Cloud project as the app-level default service account, while creating and updating your App Engine applications.
You can now use any configured service account in your Cloud project as the app-level default service account, while creating and updating your App Engine applications.
You can now use any configured service account in your Cloud project as the app-level default service account, while creating and updating your App Engine applications.
You can now use any configured service account in your Cloud project as the app-level default service account, while creating and updating your App Engine applications.
You can now use any configured service account in your Cloud project as the app-level default service account, while creating and updating your App Engine applications.
You can now use any configured service account in your Cloud project as the app-level default service account, while creating and updating your App Engine applications.
You can now use any configured service account in your Cloud project as the app-level default service account, while creating and updating your App Engine applications.
You can now use any configured service account in your Cloud project as the app-level default service account, while creating and updating your App Engine applications.
You can now use any configured service account in your Cloud project as the app-level default service account, while creating and updating your App Engine applications.
Data lineage is available in Preview in Cloud Composer 2.
Data lineage is a Dataplex feature that lets you track how data moves through your systems: where it comes from, where it is passed to, and what transformations are applied to it.
Fixed an issue where a failed upgrade to the latest Cloud Composer version caused further upgrade attempts to fail.
Cloud SDK updated to version 411.0.0 in images provided by Cloud Composer. This version resolves issues encountered in version 410.0.0.
Cloud Composer 1.20.2 and 2.1.2 images are available:
- composer-1.20.2-airflow-1.10.15 (default)
- composer-1.20.2-airflow-2.2.5
- composer-1.20.2-airflow-2.3.4
- composer-2.1.2-airflow-2.2.5
- composer-2.1.2-airflow-2.3.4 (default)
Cloud Composer versions 1.17.6, 1.17.7, 2.0.0-preview.6, and 2.0.0-preview.7 have reached their end of full support period.
Database Migration Service now supports high availability (HA) instances for MySQL and PostgreSQL database migrations. To find out how to configure connectivity for a high availability instance, click here. To learn how to configure a high availability instance when creating a migration job, click here.
The cloudfunctions.googleapis.com/v2 API now supports reading 1st gen functions, using the get and list methods. Function responses contain an Environment field that differentiates between 1st and 2nd gen functions.
You can use the filter field to restrict the response to only 2nd gen functions, for example: filter=environment="GEN_2".
Note that 1st gen functions in europe-west5 can't be read from the v2 API as the region is not available yet in 2nd gen.
If you are using an older version of gcloud, the gcloud functions list command may show 1st gen functions twice. Updating to a newer version of gcloud should fix this.
You can use the new Map view on the VM Instances dashboard to visualize the health of the resources in your fleet. Using the map, you can group VMs by resource labels, like "instance group" or "zone", and color the VMs by the value of a metric, like CPU utilization, to highlight hotspots and anomalies in your fleet.
The Cloud SQL System insights dashboard now shows additional metrics and an events timeline. You can also use the Auto refresh function to keep the dashboard up to date.
Generally available: NVIDIA® T4 GPUs are now available in the following region and zones:
- Hong Kong, APAC:
asia-east2-a,c
For more information about using GPUs on Compute Engine, see GPU platforms.
Config Connector version 1.98.0 is now available.
Added support for DataCatalogTaxonomy resource. This resource has been auto-generated and is in alpha stability.
Added spec.maxTimeTravelHours to BigQueryDataset.
Added spec.build.step.script to CloudBuildTrigger.
Added spec.sourceDiskRef and status.sourceDiskId to ComputeDisk.
Added spec.rules to ComputeRouterNAT.
Added spec.clusterAutoscaling.autoProvisioningDefaults.diskSize to ContainerCluster.
Fixed spec.datapathProvider in ContainerCluster by making it immutable.
Added mutation support to spec.nodeConfig.tags in ContainerCluster.
Added status.member to IAMServiceAccount.
Fixed spec.schemaSettings.encoding in PubSubTopic by making it immutable (#698).
Added spec.settings.timeZone to SQLInstance.
Text extracted flag (text_extraction_disabled) will be deprecated. While customers can still use it in the client library, it will be no-op in our server-side. Meanwhile, a new flag (text_extraction_enabled) will be used to replace the old one. UI will have a new button for this new flag to let customers control the behavior.
CreateDocument response will only return document metadata instead of the whole document.
Mark async_enabled field as internal only.
Compact placement policy is now generally available. Set up a compact placement policy to specify that nodes within the node pool should be placed in closer physical proximity to each other within a zone. Having nodes closer to each other can reduce network latency between nodes, which can be useful for tightly-coupled batch workloads.
Reserving static regional internal IPv6 addresses is available in Preview.
December 12, 2022
AlloyDB for PostgreSQLThe AlloyDB index advisor helps you optimize your databases by observing the queries your databases handle, and then recommending new indexes based on these observations.
Chronicle has added a supported region for Chronicle customers in the UK, europe-west2.
A weekly digest of client library updates from across the Cloud SDK.
Java
Changes for google-cloud-bigtable
2.17.0 (2022-12-07)
Features
- Add a query paginator (#1530) (5c8e1f6)
- Add test proxy to java-bigtable client (#1498) (132b4e4)
- Implement cross-project table restore (#1536) (335977c)
- Next release from main branch is 2.17.0 (#1514) (4fc6a93)
Dependencies
- Update dependency com.google.cloud:google-cloud-monitoring-bom … (#1531) (ee98338)
- Update dependency com.google.cloud:google-cloud-shared-dependencies to v3.1.0 (#1539) (3244cef)
- Update dependency kr.motd.maven:os-maven-plugin to v1.7.1 (#1518) (8309681)
- Update dependency org.graalvm.buildtools:junit-platform-native to v0.9.19 (#1537) (7f7c478)
- Update dependency org.graalvm.buildtools:native-maven-plugin to v0.9.19 (#1538) (9d3df57)
Python
Changes for google-cloud-bigtable
2.14.1 (2022-12-06)
Bug Fixes
- Deps: Require google-api-core >=1.34.0, >=2.11.0 (e5875cb)
- Drop usage of pkg_resources (e5875cb)
- Fix timeout default values (e5875cb)
Documentation
- Samples: Snippetgen should call await on the operation coroutine before calling result (e5875cb)
A weekly digest of client library updates from across the Cloud SDK.
Java
Changes for google-cloud-logging
3.13.6 (2022-12-07)
Bug Fixes
3.13.5 (2022-12-06)
Dependencies
Python
Changes for google-cloud-logging
3.3.1 (2022-12-05)
Bug Fixes
You can now use the Monitoring API to configure a snooze, which prevents Cloud Monitoring from sending notifications or creating incidents during specific time periods. You can also configure a snooze by using the Google Cloud Console. For information about how to create, view, and modify a snooze, see Create and manage snoozes.
Support for moving a Cloud Spanner instance is now generally available. You can request to move your Spanner instance from any instance configuration to any other instance configuration, including between regional and multi-region configurations. For more information, see Move an instance.
An update to Spanner change streams provides two new data capture types for change records:
NEW_VALUESmode captures only new values in non-key columns, and no old values. Keys are always captured.NEW_ROWmode captures the full new row, including columns that are not included in updates. No old values are captured.
Note that existing change streams remain set to OLD_AND_NEW_VALUES.
Dataplex auto data quality (AutoDQ) is now available in Preview. Dataplex auto data quality helps data users build trust in their data with a turnkey and automated product that encapsulates the entire process of data quality.
Dataplex data profiling is now available in Preview. Dataplex data profiling helps data users build deeper understanding about their data by identifying common data characteristics. Dataplex utilizes this information to recommend the data quality rules as well.
General Availability (GA) release of Dataproc 2.1 images.
New sub-minor versions of Dataproc images:
- 1.5.78-debian10, 1.5.78-rocky8, 1.5.78-ubuntu18
- 2.0.52-debian10, 2.0.52-rocky8, 2.0.52-ubuntu18
- 2.1.0-debian11, 2.1.0-rocky8, 2.1.0-ubuntu20
Upgrade Cloud Storage connector version to 2.1.9 for 1.5 images.
Upgrade Cloud Storage connector version to 2.2.9 for 2.1 images.
New Dataproc Serverless for Spark runtime versions: 1.0.24 and 2.0.4
Dataproc Serverless for Spark runtime 1.0:
- Upgrade to Spark to 3.2.3
- Upgrade Cloud Storage connector to 2.2.9
- Upgrade Spark dependencies:
- Jetty to 9.4.49.v20220914
- ORC to 1.7.7
- Protobuf to 3.19.6
- RoaringBitmap to 0.9.35
- Scala to 2.12.17
Dataproc Serverless for Spark runtime 2.0:
- Upgrade Cloud Storage connector to 2.2.9
- Upgrade Spark dependencies:
- Protobuf to 3.21.9
- RoaringBitmap to 0.9.35
Use jemalloc as a default OS memory allocator in Dataproc Serverless for Spark runtime.
Backport Spark patches in Dataproc Serverless for Spark runtime 1.0 and 2.0:
- SPARK-39324: Log ExecutorDecommission as INFO level in TaskSchedulerImpl
- SPARK-40168: Handle SparkException during shuffle block migration
- SPARK-40269: Randomize the orders of peer in BlockManagerDecommissioner
- SPARK-40778: Make HeartbeatReceiver as an IsolatedRpcEndpoint
Dialogflow CX now supports interaction logging export to BigQuery.
Dialogflow CX added sentiment analysis support in the following regions for English (en), French (fr), Italian (it), German (de), and Spanish (es) languages:
- asia-southeast1
- europe-west1
- europe-west2
- europe-west3
- northamerica-northeast1
The Form Parser now supports Generic Entity Extraction in Public Preview, covering the following entity types:
email: email addressphone: phone numberurl: website URLsdate_time: partial or full date/time/periodaddress: full address or street address in a single lineperson: partial or full name of a personorganization: full name of an organizationquantity: a number specifying quantity or percentageprice: a number specifying monetary amountid: a number specifying identitypage_number: a number specifying page number
The Form Parser has the following feature enhancements:
The Form Parser key-value pair (entity and checkbox) extraction and table extraction now support 200+ languages that are supported by the underlying multi-language OCR model. This language expansion is in Public Preview, with key-value pair internationalization backed by quality benchmarks in selected languages such as Simplified Chinese, Traditional Chinese, Japanese, and Korean.
Table extraction in Form Parser is now powered by an enhanced vision-based table parsing model.
These enhanced features are automatically enabled for Form Parser processor version pretrained-parser-v2.0-2022-11-10 and all future versions. Note that this is a Release Candidate version, which is subject to further changes before graduating to the Stable version.
A weekly digest of client library updates from across the Cloud SDK.
Python
Changes for google-cloud-ndb
2.0.0 (2022-12-06)
⚠ BREAKING CHANGES
- dependencies: Upgrade to google-cloud-datastore >= 2.7.2
Features
- dependencies: Upgrade to google-cloud-datastore >= 2.7.2 (12bbcb5)
Bug Fixes
Java
Changes for google-cloud-datastore
2.13.0 (2022-12-06)
Features
Bug Fixes
Dependencies
- Update dependency com.google.cloud:google-cloud-shared-dependencies to v3.1.0 (#932) (1dbcea7)
- Update dependency org.graalvm.buildtools:junit-platform-native to v0.9.18 (#924) (625e896)
- Update dependency org.graalvm.buildtools:junit-platform-native to v0.9.19 (#930) (77285be)
- Update dependency org.graalvm.buildtools:native-maven-plugin to v0.9.18 (#925) (0c7539d)
- Update dependency org.graalvm.buildtools:native-maven-plugin to v0.9.19 (#931) (40b4011)
Public clusters upgraded to GKE versions 1.25 and later will eventually be migrated to use Private Service Connect (PSC) for private control plane communication. There is no price increase for using GKE public clusters running on PSC.
You can now use the Google Cloud console to write IAM policy analysis results to BigQuery. This feature is generally available.
A weekly digest of client library updates from across the Cloud SDK.
Go
Changes for pubsub/apiv1
1.28.0 (2022-12-05)
Features
- pubsub: rewrite signatures and type in terms of new location (620e6d8)
Preview stage support for the following integration:
December 09, 2022
Anthos clusters on bare metalRelease 1.12.5
Anthos clusters on bare metal 1.12.5 is now available for download. To upgrade, see Upgrading Anthos on bare metal. Anthos clusters on bare metal 1.12.5 runs on Kubernetes 1.23.
Fixes:
The following container image security vulnerabilities have been fixed:
- CVE-2019-25013
- CVE-2021-3326
- CVE-2021-3999
- CVE-2021-4037
- CVE-2021-33574
- CVE-2021-35942
- CVE-2022-1184
- CVE-2022-1586
- CVE-2022-1587
- CVE-2022-2663
- CVE-2022-3061
- CVE-2022-3176
- CVE-2022-3303
- CVE-2022-3586
- CVE-2022-3621
- CVE-2022-3646
- CVE-2022-3649
- CVE-2022-20421
- CVE-2022-23218
- CVE-2022-23219
- CVE-2022-32221
- CVE-2022-33745
- CVE-2022-33746
- CVE-2022-33748
- CVE-2022-34903
- CVE-2022-37434
- CVE-2022-39188
- CVE-2022-40307
- CVE-2022-42309
- CVE-2022-42310
- CVE-2022-42311
- CVE-2022-42312
- CVE-2022-42313
- CVE-2022-42314
- CVE-2022-42315
- CVE-2022-42316
- CVE-2022-42317
- CVE-2022-42318
- CVE-2022-42319
- CVE-2022-42320
- CVE-2022-42321
- CVE-2022-42322
- CVE-2022-42323
- CVE-2022-42324
- CVE-2022-42325
- CVE-2022-42326
- CVE-2022-43680
- CVE-2022-43750
Known issues:
For information about the latest known issues, see Anthos on bare metal known issues in the Troubleshooting section.
Operating systems updates for Bare Metal Solution servers–The following OS is now supported on general-purpose servers:
- Red Hat Enterprise Linux (RHEL) 8.4
Other formatting revisions have been added to the Bare Metal Solution operating systems page and the SAP HANA on Bare Metal Solution operating systems page to make them easier to use.
More options are now available when you create and manage repricing configurations for your customers. This includes the option to add one override per SKU group (currently only Google Marketplace and Maps groups) to provide further discounts or markups for your customers.
A snapshot of product SKUs for each SKU group can be downloaded as a CSV from the partner Sales Console. Use this feature for greater control and transparency of partner program discounts. Visit the rebilling overview to learn more about this feature.
Rebilling data exported to BigQuery now includes the columns: CustomerRepricingConfigName, ChannelPartnerRepricingName, and Tags. The first full month with this data will be Jan, 2023. For more information see the Rebilling Table Schema and sample export queries.
Tags are attached to resources and support inheritance, centralized management, nomenclature standardization, and policy engine integration. For Cloud Billing, Tags help map costs across your organization. In cost reporting, you can query on Tags to perform Cost Management tasks like chargebacks, audits, and other cost allocations.
The Key Usage dashboard in the Google Cloud console and the new KMS Inventory REST API are now in Preview.
For more information about the Key Usage dashboard, see View key usage.
For more information about the KMS Inventory REST API, see KMS Inventory API.
For example curl commands using the KMS Inventory REST API, see View key usage and View keys by project.
Healthcheck probes are now at general availability (GA).
Added the dataproc.googleapis.com/job/state metric to track the status of Dataproc Jobs states (such as, RUNNING or PENDING). This metric is collected by default and is not chargeable to customers.
Dataproc job IDs are now queryable and viewable from MQL(Monitoring Query Language), and the metric can be used for long-running job monitoring and alerting.
M101 Release
- TensorFlow patch version upgrades:
- From 2.8.3 to 2.8.4.
- From 2.9.2 to 2.9.3.
- From 2.10.0 to 2.10.1.
- TensorFlow 1.15 Deep Learning Containers images are now deprecated.
- Regular security patches and package upgrades.
M101 Release
- TensorFlow patch version upgrades:
- From 2.8.3 to 2.8.4.
- From 2.9.2 to 2.9.3.
- From 2.10.0 to 2.10.1.
- TensorFlow 1.15 Deep Learning VM images are now deprecated.
- Regular security patches and package upgrades.
Storage Transfer Service offers Preview support for event-driven transfers - serverless, real-time replication from AWS S3 to Cloud Storage, and between Cloud Storage buckets. With this new capability, you can accelerate your event-driven analytics pipeline, enable automatic replication across Cloud Storage buckets, create a backup copy of data in a different region or project, or perform live migration.
Learn more about Event-driven transfers.
M101 Release
The M101 release of Vertex AI Workbench includes the following:
- TensorFlow patch version upgrades:
- From 2.8.3 to 2.8.4.
- From 2.9.2 to 2.9.3.
- From 2.10.0 to 2.10.1.
- TensorFlow 1.15 on Vertex AI Workbench is now deprecated.
- Added
*.notebooks.cloud.google.comas part of the domains required for users to access Notebooks API. Removed*.datalab.cloud.google.com. - Regular security patches and package upgrades.
A list.prepend function is available to support creating a copy of a list with a new element added to the beginning.
December 08, 2022
AlloyDB for PostgreSQLAlloyDB cross-region replication replicates your primary cluster's data and resources. It makes the data and resources available in different regions, allowing disaster recovery in the event of an outage in the primary region.
Config Sync now ignores validating and applying any resource configuration that has the annotation config.kubernetes.io/local-config with any value except for "false", instead of ignoring only when the value is "true". This is consistent with its behavior in kpt.
The following five metrics are removed because these metrics aren't needed for monitoring system performance or health:
rendering_countskip_rendering_countresource_override_countgit_sync_depth_override_countno_ssl_verify_count
For information on current metrics, see Monitor Config Sync.
The first edition of the Config Sync Service Level Indicators (SLIs) is published. You can set up alerts based on these SLIs, and get alerts if a threshold is hit. To learn more about the Config Sync SLIs, see Use Config Sync SLIs.
The constraint template library includes a new template: K8sBlockAllIngress. For reference see Constraint template library.
The constraint template library includes a new template: K8sBlockCreationWithDefaultServiceAccount. For reference see Constraint template library.
The constraint template library includes a new template: K8sBlockObjectsOfType. For reference see Constraint template library.
The constraint template library includes a new template: K8sEnforceCloudArmorBackendConfig. For reference see Constraint template library.
The constraint template library includes a new template: K8sEnforceConfigManagement. For reference see Constraint template library.
The constraint template library includes a new template: K8sRequireDaemonsets. For reference see Constraint template library.
The constraint template library includes a new template: K8sRequireDefaultDenyEgressPolicy. For reference see Constraint template library.
The constraint template library includes a new template: K8sRequireValidRangesForNetworks. For reference see Constraint template library.
The constraint template library includes a new template: K8sRestrictRbacSubjects. For reference see Constraint template library.
The following enhancements are made to Config Sync metrics:
- Enhanced the histogram distribution bounds for the
parser_duration_secondsandapply_duration_secondsmetrics to support longer durations. - Enhanced the
last_sync_timestampmetric to prevent timeseries with empty commits. - Added a new label called
controllerinto theapply_operationsmetric to track whether the operation is from the applier or the remediator. - Support the
errorclasslabel of thereconciler_errorsmetric correctly.
For more details, see Monitor Config Sync.
Added resource tags to all Config Sync metrics to identify the source component. For more information, see Config Sync Metric Tags.
Fixed a known compatibility issue in Config Sync that was announced in Anthos Config Management 1.13.1 affecting Autopilot on GKE 1.23 and later. Config Sync is now compatible with Autopilot clusters on all supported GKE versions.
Various reliability and stability improvements to Config Sync.
Anthos clusters on VMware 1.11.6-gke.18 is now available. To upgrade, see Upgrading Anthos clusters on VMware. Anthos clusters on VMware 1.11.6-gke.18 runs on Kubernetes 1.22.15-gke.3300.
The supported versions offering the latest patches and updates for security vulnerabilities, exposures, and issues impacting Anthos clusters on VMware are 1.13, 1.12, and 1.11.
- Fixed OOM events associated with
monitoring-operator-Pods by increasing memory limit to 1 GB. - Fixed the issue where deleting a user cluster also deleted
cluster-health-controllerandvsphere-metrics-exporterClusterRole objects. - Fixed the following vulnerabilities:
- Critical container vulnerabilities:
- High-severity container vulnerabilities:
- Container-optimized OS vulnerabilities:
On December 8, we released an updated version of Apigee X.
GA release of Simplified Onboarding for Apigee X (Pay-as-you-go) in the Google Cloud console.
With this release, new Apigee customers using Pay-as-you-go pricing can quickly configure Apigee using a simplified onboarding flow accessible from the Google Cloud console.
- The new onboarding UI provides stepped navigation consistent with other products available in the console.
- Apigee X (Pay-as-you-go) provisioning is simplified but remains flexible. Default settings are provided, with the option to customize as needed.
- Improved contextual help streamlines decision-making during onboarding.
See Before you begin and Get started in the Cloud Console for more details on provisioning Apigee X with Pay-as-you-go pricing from the Google Cloud console.
The demo query guide helps you query a public dataset from Google Trends and is now in preview.
The following changes were made to UDM Search. You can now do the following:
- Use enhanced filtering to include Bottom 30 values in addition to Top 30 values for each UDM Field in search results
- Use 'field[key] = value' exact match to search the 'additional' and 'labels' fields
- Pin fields (using the push pin icon) in Quick Filter to save them as a favorite. They will appear at the top of the Quick Filters list
- Save column layouts and load them
- Escape special characters by using backslashes and double-quotes
Cloud Bigtable now lets you restore from a backup to a different project. This feature is generally available (GA). To learn more, see Bigtable backups.
The ability to configure deletion protection for a Cloud Bigtable table is now generally available (GA). This setting prevents deletion of the table, its column families, and the instance containing the table. See Modify deletion protection for instructions.
Preview: Get estimated costs in the Google Cloud console
You can now estimate the cost of Compute Engine and Cloud Storage workloads in the Google Cloud console. The Cost Estimation tool provides estimates that also include any custom contract prices on your Cloud Billing account. These cost estimates can help you make more informed business decisions.
A release was made. Updates may include general performance improvements, bug fixes, and updates to the API reference documentation.
Generally available: You can merge your active hardware resource commitments into one larger commitment to track and manage them as a single entity. You can now also merge your commitments by using the Google Cloud Console. For more information, see Merging commitments.
Invoice Parser and Expense Parser are now available in the following single-region locations:
australia-southeast1(Sydney)northamerica-northeast1(Montréal)
AutoProvision service will return an operation ID for immediate completed operations.
Enable operation service for Document AI Warehouse v1 service.
Partially supports Google AIP-160 syntax (https://google.aip.dev/160) in search query. Search query now supports literals, logical operators, negation operators, comparison operators, and functions.
Fix operation status fetching for pending AutoProvision long running operations.
Disable text extraction for Google Cloud Storage based ingestion.
VPC Service Controls for Document AI Warehouse are publicly supported.
In order to support new features in the future, Google Cloud VMware Engine will convert the resource names for private clouds to a standardized format that is more consistent with Google Cloud. Specifically, this resource name translation will make minor changes to the names of resources in your project, such as:
- Changing capital letters to lowercase
- Changing white space to hyphens
Resource name translation is currently optional, but existing private clouds must perform a resource name translation in order to access the gcloud CLI or VMware Engine API. Resource name translation will be required after September 2023.
For more information on resource name translation, see Resource Name Translation.
Performance Dashboard now shows latency metrics between VMs and Internet endpoints:
- In the Project performance view, Performance Dashboard shows latency between VMs across all Google Cloud regions and Internet endpoints.
- In the Google Cloud performance view, Performance Dashboard shows latency metrics for regions where you have VM instances and the Internet locations communicating with the VMs.
The Malicious URL Observed detector of Container Threat Detection, a built-in service of Security Command Center Premium, is now generally available.
The detector checks URLs observed in arguments passed by executables against known phishing and malware URLs to determine if they are malicious.
You can see the full details of the detector's findings only if you upgrade to the refreshed findings display in the Security Command Center dashboard.
For more information, see the following pages:
Sensitive Actions Service, a built-in service of Security Command Center Premium, is now generally available.
Sensitive Actions Service detects when actions are taken in your Google Cloud organization, folders, and projects that could be damaging to your business if they were to be taken by a malicious actor.
For more information, see Sensitive Actions Service overview.
You can now enable the email verification feature of MFA from the Google Cloud console. For instructions, see Configure Multi-factor authentication.
December 07, 2022
App Engine standard environment GoThe Go 1.18 and Go 1.19 runtimes for App Engine standard environment are now available in Preview.
The Node.js 18 runtime for App Engine standard environment is now available in Preview.
BeyondCorp Enterprise integration with Microsoft Intune is generally available (GA).
With this integration, you can collect real-time information about the devices in your organization using Microsoft Intune, and use this information to manage your devices and control access to your organizational resources using BeyondCorp Enterprise.
The following supported default parsers have changed. Each is listed by product name and ingestion label, if applicable.
- Cisco Router (
CISCO_ROUTER) - Digital Guardian DLP (
DIGITALGUARDIAN_DLP) - Linux Auditing System (AuditD) (
AUDITD) - Microsoft Azure Activity (
AZURE_ACTIVITY) - Rubrik (
RUBRIK) - Sentinelone Alerts (
SENTINELONE_ALERT) - SentinelOne EDR (
SENTINEL_EDR) - Sophos Firewall (Next Gen) (
SOPHOS_FIREWALL) - STIX Threat Intelligence (
STIX) - Thales Luna Hardware Security Module (
THALES_LUNA_HSM) - Thinkst Canary (
THINKST_CANARY) - Unix system (
NIX_SYSTEM) - Workspace Activities (
WORKSPACE_ACTIVITY)
For details about changes in each parser, see Supported default parsers.
You can now retrieve information about a Cloud Bigtable query to help you evaluate the query's performance. This feature is generally available (GA). For more information, see Get query stats.
Cloud Data Fusion is available in the following region:
me-west1
For public and private uptime checks, a new create flow is available in Public Preview. For private uptime checks, the Public Preview flow lets you create the Service Directory service and perform other prerequisite steps by using the Google Cloud console. For more information, see Create public uptime checks and Create private uptime checks.
A weekly digest of client library updates from across the Cloud SDK.
Go
Changes for datastore/admin/apiv1
1.10.0 (2022-11-29)
Features
- datastore: start generating proto stubs (eed371e)
Python
Changes for google-cloud-ndb
1.12.0 (2022-11-29)
Bug Fixes
- Drop Python 2 support (90efd77)
- Drop Python 3.6 support (#829) (b110199)
- model: Ensure repeated props have same kind when converting from ds (#824) (29f5a85)
Documentation
- Add note in Django middleware documentation that it is unimplemented (#805) (aa7621d)
- Add note that ProtoRPC message classes are unimplemented (#819) (ae813e9)
- context: Note that several methods are no longer implemented. (#821) (34c2c38)
- CONTRIBUTING: Note the need for Redis/Memcached env vars in tests (#838) (19f8415), closes #836
- Fix bad import path in migration guide (#827) (7b44961)
- Fix typo in begin_transaction docstring (#822) (7fd3ed3)
- README: Syncronize supported version text with python-datastore (#837) (316f959)
- tasklets: Fix Py2-style print statement (#840) (0ebfaed)
Changes for google-cloud-datastore
2.11.0 (2022-11-30)
Features
Generally available: Vertex AI Vision is now Generally Available. View pricing details at the Vertex AI Vision pricing page.
For more information, see the Vertex AI Vision documentation.
December 06, 2022
Channel ServicesThe Partner Sales Console Dashboard and the Reporting API now use the rebilled values for Google Cloud and Maps customer costs. You can use this data set to simplify your customer billing process by using the API to integrate rebilled data in your billing applications.
Preview: You can now query asset metadata via the Cloud Asset Inventory API or the Cloud console, without needing to export the data to a BigQuery table first. This feature is available as a preview for Security Command Center Premium customers.
(Cloud Composer 2) Environment snapshots and Scheduled snapshots are now generally available (GA) for Cloud Composer 2 versions 2.1.1 and later.
Scheduled snapshots provide additional support for running disaster recovery scenarios.
The following versions for Cloud Composer 1.20.1 and 2.1.1 are available:
- composer-1.20.1-airflow-1.10.15 (default)
- composer-1.20.1-airflow-2.2.5
- composer-1.20.1-airflow-2.3.4
- composer-2.1.1-airflow-2.2.5
- composer-2.1.1-airflow-2.3.4 (default)
(Available without upgrading) Allowed custom secondary IP range for pods is now narrower. You can now create Composer environments using IP ranges with /23 masks.
Cloud Composer versions 1.17.7 and 2.0.0-preview.7 have reached their end of full support period.
Cloud Data Fusion version 6.8.0 is in Preview. This release is in parallel with the CDAP 6.8.0 release.
Features in 6.8.0:
Replication from Oracle to BigQuery using Datastream is generally available (GA).
Cloud Data Fusion supports BigQuery batch source pushdown.
Cloud Data Fusion supports AND triggers. You can create OR and AND triggers. Previously, all triggers were OR triggers.
In Cloud Data Fusion 6.8.0, Reference name is no longer mandatory for the following plugins:
- BigQuery Source
- BigQuery Sink
- Dataplex Source
- Dataplex Sink
- Spanner Sink
- GCS Sink
For these plugins, their unique identifiers in lineage are generated based on their configuration properties. For example, project ID+dataset+table is used as a unique identifier for BigQuery. This identifier can be seen on the lineage diagram. For more information, see Cloud Data Fusion Plugins.
Changes in 6.8.0:
For Replication jobs with an Oracle (by Datastream) source, ensured data consistency when multiple CDC events are generated with the same timestamp, by ordering events reliably.
For Oracle replication sources, added a purge policy for a Cloud Storage bucket created by the plugin where Datastream writes its output.
In the Oracle replication source, added the GCS Bucket Location property, where Datastream writes its output.
In the Oracle replication source, added the list of Datastream regions to the Region property. You no longer need to manually enter the Datastream region.
The Oracle replication source identifies each row by the Primary key of the table. Previously, the plugin identified each row by the
ROWID.For Replication jobs, improved performance for Review Assessment.
Splitter Transformation based plugins have access to
prepareRun()andonRunFinish()methods.In Wrangler, added the Average
arithmeticfunction, which calculates the average of the selected columns.In Wrangler, Numeric functions support 3 or more columns.
In the Dataplex Sink plugin, added the Update Dataplex Metadata property, which adds support for updating metadata in Dataplex for newly generated data.
In the GCS Delete Action plugin, added support for bulk deletion of files and folders. You can use the (
*) wildcard character to represent any character.
Fixed in 6.8.0:
For custom Dataproc compute profiles, fixed the issue causing the wrong Cloud Storage bucket to be used to stage data. Cloud Data Fusion uses the bucket specified in the custom compute profile.
Fixed the issue in the BigQuery Replication Target plugin causing Replication jobs to fail when the BigQuery target table already existed. The new version of the plugin is used by default in new Replication jobs. To use the new plugin version in existing jobs, recreate the job.
Fixed an issue causing the Replication Assessment to get stuck when the Oracle (by Datastream) storage bucket property was empty, or had an invalid bucket name. Cloud Data Fusion returns a
400error code during assessment when the property is empty or has an invalid bucket name.Fixed an issue causing Replication jobs to fail when the source column name didn't comply with BigQuery table naming conventions. In 6.8.0, if a source column name doesn't comply with BigQuery naming conventions, Cloud Data Fusion replaces invalid characters with an underscore, prepends an underscore when the first character is a number, and truncates the name when it exceeds the maximum length.
In the File batch source, fixed an issue causing Get Schema to appear only when Format was set to
delimited. Get Schema appears for all formats.Fixed an issue with the output schema when connecting a Splitter transformation with a Joiner transformation.
Fixed an issue causing imports in the Cloud Data Fusion UI to fail for pipelines exported through the Pipeline Microservices.
In the Oracle Batch Source, when the source data included fields with the
Numericdata type (undefined precision and scale), Cloud Data Fusion set the precision to38and the scale to0. If any values in the field had scale other than0, Cloud Data Fusion truncated the values, which could have resulted in data loss. If the scale for a field was overridden in the plugin output schema, the pipeline failed. For more information, see the CDAP 6.8.0 bug fixes.In the Wrangler transformation, fixed the issue causing the pipeline to not fail when the Error Handling property was set to
Fail Pipeline. This happened when an error was returned, but no exception was thrown, and there were0records in the output. For example, this happened when one of the directives (suchas.parse-as-simple-date) failed because the input data wasn't in the correct format. This fix is not available by default. Instead, contact support if you need this fix for your projects.In Wrangler, fixed the issue causing the Wrangler page to get stuck when a BigQuery table name contained non-alphanumeric characters, such as underscores. Wrangler imports BigQuery tables that follow BigQuery table naming conventions.
Upgrading the Cloud Data Fusion version for Replication jobs is broken. Upgrading Replication jobs to Cloud Data Fusion version 6.8.0 isn't recommended.
Cloud Run support for a new second generation execution environment is now at generally availability (GA).
Cloud Run support for network file systems such as NFS, NDB, 9P, CIFS/Samba, and Ceph, as well as Cloud Filestore and Cloud Storage FUSE, is now at general availability (GA.)
We identified an issue in how we calculate the Total Database Storage metric in multi-regional Spanner instances. This metric is used to calculate the charges for Spanner database storage.
Database storage is currently incorrectly reported lower than it actually is in multi-regional configurations, resulting in undercharging for database storage. We communicated a Service Announcement in October and started rolling out this change to pricing on December 1, 2022. Depending on your configuration, your Total Database Storage could increase by up to 25%.
For the majority of impacted customers, the impact on your total bill will be less than 0.5%. For those affected, you will notice an increase in database storage charges that reflect this corrected metric.
We waived the under-billed amount for all past billing cycles. Please note that this issue only affects multi-region configurations of Spanner. It does not affect regional configurations of Spanner. Additionally, the Total Backup Storage metric is not affected by this issue, and has always been reported correctly.
For more information, see Database storage prices.
Dataproc Serverless for Spark runtime version 2.0 will become the default Dataproc Serverless for Spark runtime version on January 24, 2023 (instead of December 13, 2022, as previously announced).
On the Error Reporting page, use the new resource filter to filter error groups by resource type. For more information, see Filter errors.
On Dec 6, 2022 we released Migrate to Containers 1.14.0.
Support for refactoring applications running on JBoss Enterprise Application Platform or WildFly application platform to containers, which lets you deploy the application as containers on GKE, GKE Autopilot clusters, Anthos clusters, and Cloud Run, released for Public Preview. See Migrate JBoss Servers.
Support for refactoring Apache 2 Linux based applications to containers, which lets you deploy Apache 2 application components as containers on GKE, GKE Autopilot clusters, Anthos clusters, and Cloud Run, released for Public Preview. See Migrate Apache 2 Servers.
Enhanced control on the verbosity of backend logs. You can now use the migctl logging set-verbosity <verbosity> command, where verbosity 0 corresponds to info logs only and verbosity 1 shows debug logs. See migctl reference.
Containerization from AWS and Azure sources and local processing in AWS cluster are now deprecated and planned to be supported until April 2023.
The following issues were fixed:
- Windows IIS modernization - In case IIS files are not accessible to BUILTIN/Administrators, the discovery phase of IIS modernization will fail.
- Support migration of Windows IIS sites where Administrator user has no permissions to access the IIS configuration files.
- On Linux migrations, if the migration plan YAML is missing the Image section, the task will fail with a panic instead of an indicative message.
The following are open issues:
- migctl migration status sometimes prints an error message before the migration table. This message does not indicate a concrete problem and can be ignored.
- UI fails when performing "Processing Cluster Add" having Resource Location Org Policy. To overcome that, the processing cluster installation should be done using migctl and the target region should be provided using
--gcp-region. - Two migrations from different M2VM sources on the same VM can affect each other. When using M2VM sources, users should avoid creating multiple Migration objects from different sources at the same time for the same VM.
- Creation of multiple source providers at the same time may cause timeouts. If this happens users should delete and recreate source provider objects that failed to be created.
- Replicated VM deletion can hang depending on other object deletion. To prevent this from happening users should delete M2VM source after deleting the corresponding Migration objects. Otherwise, if this happens users should delete the M2VM replications manually.
- migctl setup uninstall failure - source snapshot is not deleted. This is happening when the corresponding source provider was already deleted. If this happens users should recreate the corresponding source provider and after migrations are removed to proceed with uninstalling.
- Starting a migration from the UI page "Sources & Candidates" might get stuck on a "retrying" step. If this happens users should create a Migration using the VM name as input.
December 05, 2022
Apigee hybridhybrid v1.8.3
On December 5, 2022 we released an updated version of the Apigee hybrid software, v1.8.3.
For information on upgrading, see Upgrading Apigee hybrid to version 1.8.
| Bug ID | Description |
|---|---|
| 259738092 | Intermittent 404's were seen at the Apigee Ingress Gateway due to an inconsistent configuration delivery mechanism. |
| 255677576 | In fresh installations with Apigee Ingress (instead of user-installed Anthos Service Mesh), the Apigee UI would sometimes show red (not working) status. This is because in certain circumstances Watcher did not send the correct deployment status due to using the wrong selector for the Apigee Ingress Gateway. |
| 218567150 | The ingress gateway is now configured to consistently preserve UUID in the x-request-id header. This applies to both Apigee Ingress gateway and to the Istio ingress gateway when are using customer-installed Anthos Service Mesh. Note: This setting does have some impact on tracing in the ingress gateway. For more information, see pack_trace_reason in the "UUID (proto)" page in the envoy documentation. |
| Bug ID | Description |
|---|---|
| 259290668 | Update Kubectl in the backup utility. This addresses the following vulnerabilities: ∙ CVE-2022-42004 ∙ CVE-2022-42003 ∙ CVE-2022-32189 ∙ CVE-2022-30635 ∙ CVE-2022-30633 ∙ CVE-2022-30632 ∙ CVE-2022-30631 ∙ CVE-2022-30630 ∙ CVE-2022-30580 ∙ CVE-2022-28327 ∙ CVE-2022-28131 ∙ CVE-2022-27664 ∙ CVE-2022-25857 ∙ CVE-2022-24921 ∙ CVE-2022-24675 ∙ CVE-2022-23773 ∙ CVE-2022-23772 ∙ CVE-2022-23635 ∙ CVE-2022-0391 ∙ CVE-2021-39156 ∙ CVE-2021-39155 ∙ CVE-2021-37137 ∙ CVE-2021-37136 ∙ CVE-2021-29482 ∙ CVE-2021-20190 ∙ CVE-2021-3121 ∙ CVE-2020-36518 ∙ CVE-2020-36189 ∙ CVE-2020-36188 ∙ CVE-2020-36187 ∙ CVE-2020-36186 ∙ CVE-2020-36185 ∙ CVE-2020-36184 ∙ CVE-2020-36183 ∙ CVE-2020-36182 ∙ CVE-2020-36181 ∙ CVE-2020-36180 ∙ CVE-2020-36179 ∙ CVE-2020-35728 ∙ CVE-2020-35491 ∙ CVE-2020-35490 ∙ CVE-2020-29652 ∙ CVE-2020-25649 ∙ CVE-2020-24750 ∙ CVE-2020-24616 ∙ CVE-2020-17516 ∙ CVE-2020-16845 ∙ CVE-2020-14195 ∙ CVE-2020-14062 ∙ CVE-2020-14061 ∙ CVE-2020-14060 ∙ CVE-2019-16869 ∙ CVE-2019-9674 ∙ CVE-2019-0205 ∙ CVE-2018-1320 ∙ CVE-2017-18640 ∙ CVE-2016-5397 |
| 254862745, 249630685 | Security fix for apigee-diagnostics-runner and apigee-envoy. This addresses the following vulnerabilities: ∙ CVE-2021-3999 ∙ CVE-2022-2068 |
| 254774167 | Fix for apigee-mart-server, apigee-mint-task-scheduler, apigee-runtime, and apigee-synchronizer. This addresses the following vulnerabilities: ∙ CVE-2022-42004 ∙ CVE-2022-42003 |
| 254773838, 254773636, 254772551, 254771693 | Fix for vulnerability in apigee-diagnostics-collector, apigee-mart-server, apigee-mint-task-scheduler, apigee-runtime, and apigee-synchronizer. This addresses the following vulnerabilities: ∙ CVE-2022-25857 ∙ CVE-2022-0239 ∙ CVE-2021-37136 ∙ CVE-2021-30468 ∙ CVE-2017-18640 |
| 254774193, 254773110 | Fix for vulnerability in apigee-diagnostics-collector, apigee-mart-server, and apigee-mint-task-scheduler. This addresses the following vulnerability: ∙ CVE-2022-2048 |
| 254770883, 249633275, 249629782 | Security fixes for apigee-diagnostics-collector, apigee-mart-server, apigee-runtime, and apigee-synchronizer. This addresses the following vulnerabilities: ∙ CVE-2022-42889 ∙ CVE-2022-42004 ∙ CVE-2022-42003 ∙ CVE-2022-40150 ∙ CVE-2022-40149 ∙ CVE-2022-38752 ∙ CVE-2022-38751 ∙ CVE-2022-38750 ∙ CVE-2022-38749 ∙ CVE-2022-25857 ∙ CVE-2022-3171 ∙ CVE-2022-2097 ∙ CVE-2022-2068 ∙ CVE-2022-2048 ∙ CVE-2022-2047 ∙ CVE-2022-1292 ∙ CVE-2021-31684 ∙ CVE-2021-29425 ∙ CVE-2021-27568 ∙ CVE-2020-13936 ∙ CVE-2020-8908 ∙ CVE-2019-18276 ∙ CVE-2018-10237 ∙ CVE-2017-18640 |
| 254521563, 246970779 | Fix for golang vulnerability in Cassandra. This addresses the following vulnerability: ∙ CVE-2017-5929 |
| 249635718, 249629771 | Security fixes for Apigee Connect and apigee-redis. This addresses the following vulnerabilities: ∙ CVE-2022-32189 ∙ CVE-2022-30635 ∙ CVE-2022-30633 ∙ CVE-2022-30632 ∙ CVE-2022-30631 ∙ CVE-2022-30630 ∙ CVE-2022-30580 ∙ CVE-2022-28327 ∙ CVE-2022-28131 ∙ CVE-2022-27664 ∙ CVE-2022-24921 ∙ CVE-2022-24675 ∙ CVE-2022-23773 ∙ CVE-2022-23772 |
| 249633289 | Fix for apigee-prometheus-adapter. This addresses the following vulnerabilities: ∙ CVE-2022-21698 ∙ CVE-2022-1996 |
A weekly digest of client library updates from across the Cloud SDK.
Go
Changes for bigquery/storage/apiv1beta1
1.44.0 (2022-11-30)
Features
- bigquery/datatransfer: Add Location API methods docs: updated comments (22ec3e3)
- bigquery/storage: Add missing_value_interpretations to AppendRowsRequest (2a0b1ae)
- bigquery: Add default partition expiration to Dataset (#7096) (601c77a), refs #7021
- bigquery: Remove code for reservation/apiv1beta1 (#7010) (451acc1)
- bigquery: Start generating proto stubs (#7026) (debc4c7)
- bigquery: Widen retry predicate (#6976) (753b751)
Bug Fixes
Documentation
- bigquery/storage: Remove stale header guidance for AppendRows (9c5d6c8)
A new suite of client-side metrics for the Cloud Bigtable client for Java is generally available (GA) in versions 2.16.0 and later. To learn more about using the new monitoring metrics for performance optimization and troubleshooting, see the Client-side metrics overview.
A weekly digest of client library updates from across the Cloud SDK.
Python
Changes for google-cloud-bigtable
2.14.0 (2022-11-30)
Features
- Add typing to proto.Message based class attributes (c1538d5)
- Remove enum value ReadRowsRequest.RequestStatsView.REQUEST_STATS_EFFICIENCY (c1538d5)
- Remove field ReadIterationStats.deletes_seen (c1538d5)
- Remove field RequestStats.read_efficiency_stats (c1538d5)
- Remove proto ReadEfficiencyStats (c1538d5)
- Rename field RequestStats.all_read_stats to full_read_stats_view (c1538d5)
- Rename proto AllReadStats to FullReadStatsView (c1538d5)
- Rename proto ReadIteratorStats to ReadIterationStats (c1538d5)
Bug Fixes
- Add dict typing for client_options (c1538d5)
View expiring commitments and automatically renew resource-based commitments with the Committed use discount dashboard
In the Committed use discount dashboard, you can now see subscription expiration notifications for commitments that are expiring within the next 30 days. In the dashboard's auto renewal column, you can automatically renew your resource-based commitments.
For more information about viewing the Commitment dashboard, see Committed use discount overview.
(Cloud Composer 2) The Composer Local Development CLI tool is now available to help streamline testing and developing using local Airflow environments with Composer 2.
Cloud DNS per resource IAM permissions are available in GA.
Currently, health check probes for hybrid NEGs originate from Google's centralized health checking mechanism. If you cannot allow traffic that originates from the Google health check ranges to reach your hybrid endpoints and would prefer to have the health check probes originate from your own private IP addresses instead, speak to your Google account representative to get your project allowlisted for distributed Envoy health checks.
This feature is available in General availability for allowlisted projects only.
A weekly digest of client library updates from across the Cloud SDK.
Node.js
Changes for @google-cloud/logging
10.3.2 (2022-12-02)
Bug Fixes
Go
Changes for logging/apiv2
1.6.1 (2022-12-02)
Bug Fixes
- logging: downgrade some dependencies (7540152)
1.6.0 (2022-11-29)
Features
- logging: start generating proto stubs (0eb700d)
Bug Fixes
Java
Changes for google-cloud-logging
3.13.4 (2022-12-03)
Dependencies
- Update dependency org.graalvm.buildtools:junit-platform-native to v0.9.19 (#1214) (f104203)
- Update dependency org.graalvm.buildtools:native-maven-plugin to v0.9.19 (#1215) (7785a7c)
3.13.3 (2022-12-01)
Bug Fixes
Python
Changes for google-cloud-logging
3.3.0 (2022-11-26)
Features
- Add support for custom JSON encoders (#657) (77e621c)
- Include context on batch log errors (#650) (d08be9a)
- Set partial_success to default to true for batched logs (#649) (e56d3e8)
- Support Django asgi middleware (#625) (f52b3aa)
Bug Fixes
New SQL syntax, RETURNING in the PostgreSQL dialect and THEN RETURN in Google Standard SQL, selects and returns data from rows that were just updated as part of a DML statement. This is especially useful for getting values from default or generated columns and can reduce latency over equivalent multi-statement transactions. The preview supports the Java, JDBC, Python, and Go Spanner clients as well as PostgreSQL drivers that connect through PGAdapter.
Product Search legacy category migration
In 90 days, the legacy categories "apparel", "homegoods", and "toys" will be upgraded. You will still be able to use these categories. However, when running searches, they will perform similar to the "apparel-v2", "homegoods-v2", and "toys-v2" categories.
Dataproc Metastore administrator interface is available in preview.
The administrator interface provides you with a centralized tool to inspect and manage the metadata stored in your Dataproc Metastore service.
(2022-R27) Version updates
GKE cluster versions have been updated.
New versions available for upgrades and new clusters
The following Kubernetes versions are now available for new clusters and for opt-in control plane upgrades and node upgrades for existing clusters. For more information on versioning and upgrades, see GKE versioning and support and Upgrades.
No channel
- Version 1.24.5-gke.600 is now the default version.
- The following control plane and node versions are now available:
- The following control plane versions are no longer available:
- 1.21.14-gke.3000
- 1.21.14-gke.9500
- 1.22.12-gke.2300
- 1.23.8-gke.1900
- 1.23.9-gke.900
- 1.23.9-gke.2100
- 1.23.10-gke.1000
- 1.24.4-gke.800
- The following node version is no longer available: 1.21.14-gke.9500
- Control planes and nodes with auto-upgrade enabled will be upgraded from version 1.20 to version 1.21.14-gke.4300 with this release.
- Control planes and nodes with auto-upgrade enabled will be upgraded from version 1.21 to version 1.22.15-gke.100 with this release.
- Control planes and nodes with auto-upgrade enabled will be upgraded from version 1.23 to version 1.23.11-gke.300 with this release.
- Control planes and nodes with auto-upgrade enabled will be upgraded from version 1.24 to version 1.24.5-gke.600 with this release.
Stable channel
- Version 1.23.11-gke.300 is now the default version in the Stable channel
- The following versions are now available in the Stable channel:
- The following versions are no longer available in the Stable channel:
- 1.21.14-gke.3000
- 1.22.12-gke.2300
- Control planes and nodes with auto-upgrade enabled in the Stable channel will be upgraded from version 1.20 to version 1.21.14-gke.4300 with this release.
- Control planes and nodes with auto-upgrade enabled in the Stable channel will be upgraded from version 1.21 to version 1.22.15-gke.100 with this release.
- Control planes and nodes with auto-upgrade enabled in the Stable channel will be upgraded from version 1.24 to version 1.24.7-gke.900 with this release.
Regular channel
- Version 1.24.5-gke.600 is now the default version in the Regular channel
- The following versions are now available in the Regular channel:
- The following versions are no longer available in the Regular channel:
- 1.22.12-gke.2300
- 1.23.12-gke.100
- Control planes and nodes with auto-upgrade enabled in the Regular channel will be upgraded from version 1.21 to version 1.22.13-gke.1000 with this release.
- Control planes and nodes with auto-upgrade enabled in the Regular channel will be upgraded from version 1.22 to version 1.23.12-gke.1600 with this release.
- Control planes and nodes with auto-upgrade enabled in the Regular channel will be upgraded from version 1.23 to version 1.23.12-gke.1600 with this release.
Rapid channel
- Version 1.25.3-gke.800 is now the default version in the Rapid channel
- The following versions are now available in the Rapid channel:
- The following versions are no longer available in the Rapid channel:
- 1.21.14-gke.7100
- 1.21.14-gke.9500
- 1.22.14-gke.300
- 1.23.12-gke.100
- 1.24.4-gke.800
- 1.25.2-gke.1700
- Control planes and nodes with auto-upgrade enabled in the Rapid channel will be upgraded from version 1.20 to version 1.21.14-gke.8500 with this release.
- Control planes and nodes with auto-upgrade enabled in the Rapid channel will be upgraded from version 1.21 to version 1.22.15-gke.100 with this release.
- Control planes and nodes with auto-upgrade enabled in the Rapid channel will be upgraded from version 1.22 to version 1.23.12-gke.1600 with this release.
- Control planes and nodes with auto-upgrade enabled in the Rapid channel will be upgraded from version 1.23 to version 1.24.6-gke.1500 with this release.
- Control planes and nodes with auto-upgrade enabled in the Rapid channel will be upgraded from version 1.24 to version 1.24.6-gke.1500 with this release.
- Control planes and nodes with auto-upgrade enabled in the Rapid channel will be upgraded from version 1.25 to version 1.25.3-gke.800 with this release.
(2022-R27) Version updates
- Version 1.24.5-gke.600 is now the default version.
- The following control plane and node versions are now available:
- The following control plane versions are no longer available:
- 1.21.14-gke.3000
- 1.21.14-gke.9500
- 1.22.12-gke.2300
- 1.23.8-gke.1900
- 1.23.9-gke.900
- 1.23.9-gke.2100
- 1.23.10-gke.1000
- 1.24.4-gke.800
- The following node version is no longer available: 1.21.14-gke.9500
- Control planes and nodes with auto-upgrade enabled will be upgraded from version 1.20 to version 1.21.14-gke.4300 with this release.
- Control planes and nodes with auto-upgrade enabled will be upgraded from version 1.21 to version 1.22.15-gke.100 with this release.
- Control planes and nodes with auto-upgrade enabled will be upgraded from version 1.23 to version 1.23.11-gke.300 with this release.
- Control planes and nodes with auto-upgrade enabled will be upgraded from version 1.24 to version 1.24.5-gke.600 with this release.
(2022-R27) Version updates
- Version 1.23.11-gke.300 is now the default version in the Stable channel
- The following versions are now available in the Stable channel:
- The following versions are no longer available in the Stable channel:
- 1.21.14-gke.3000
- 1.22.12-gke.2300
- Control planes and nodes with auto-upgrade enabled in the Stable channel will be upgraded from version 1.20 to version 1.21.14-gke.4300 with this release.
- Control planes and nodes with auto-upgrade enabled in the Stable channel will be upgraded from version 1.21 to version 1.22.15-gke.100 with this release.
- Control planes and nodes with auto-upgrade enabled in the Stable channel will be upgraded from version 1.24 to version 1.24.7-gke.900 with this release.
(2022-R27) Version updates
- Version 1.24.5-gke.600 is now the default version in the Regular channel
- The following versions are now available in the Regular channel:
- The following versions are no longer available in the Regular channel:
- 1.22.12-gke.2300
- 1.23.12-gke.100
- Control planes and nodes with auto-upgrade enabled in the Regular channel will be upgraded from version 1.21 to version 1.22.13-gke.1000 with this release.
- Control planes and nodes with auto-upgrade enabled in the Regular channel will be upgraded from version 1.22 to version 1.23.12-gke.1600 with this release.
- Control planes and nodes with auto-upgrade enabled in the Regular channel will be upgraded from version 1.23 to version 1.23.12-gke.1600 with this release.
(2022-R27) Version updates
- Version 1.25.3-gke.800 is now the default version in the Rapid channel
- The following versions are now available in the Rapid channel:
- The following versions are no longer available in the Rapid channel:
- 1.21.14-gke.7100
- 1.21.14-gke.9500
- 1.22.14-gke.300
- 1.23.12-gke.100
- 1.24.4-gke.800
- 1.25.2-gke.1700
- Control planes and nodes with auto-upgrade enabled in the Rapid channel will be upgraded from version 1.20 to version 1.21.14-gke.8500 with this release.
- Control planes and nodes with auto-upgrade enabled in the Rapid channel will be upgraded from version 1.21 to version 1.22.15-gke.100 with this release.
- Control planes and nodes with auto-upgrade enabled in the Rapid channel will be upgraded from version 1.22 to version 1.23.12-gke.1600 with this release.
- Control planes and nodes with auto-upgrade enabled in the Rapid channel will be upgraded from version 1.23 to version 1.24.6-gke.1500 with this release.
- Control planes and nodes with auto-upgrade enabled in the Rapid channel will be upgraded from version 1.24 to version 1.24.6-gke.1500 with this release.
- Control planes and nodes with auto-upgrade enabled in the Rapid channel will be upgraded from version 1.25 to version 1.25.3-gke.800 with this release.
You can now set the minimum observation period for the IAM recommender to 30 or 60 days instead of the default period of 90 days. For more information, see Configure role recommendation generation. This feature is available in Preview.
A weekly digest of client library updates from across the Cloud SDK.
Go
Changes for pubsub/apiv1
1.27.1 (2022-12-02)
Bug Fixes
- pubsub: downgrade some dependencies (7540152)
1.27.0 (2022-11-29)
Features
- pubsub: start generating proto stubs (cf89415)
Java
Changes for google-cloud-pubsub
1.122.1 (2022-12-02)
Dependencies
- Update dependency org.graalvm.buildtools:junit-platform-native to v0.9.19 (#1428) (bfa9c3d)
- Update dependency org.graalvm.buildtools:native-maven-plugin to v0.9.19 (#1429) (d3c44e7)
1.122.0 (2022-12-01)
Features
Dependencies
The kernelRootkit attribute was added to the Finding object of the Security Command Center API.
The kernelRootkit attribute contains information about a kernel rootkit that triggered a finding, including the following:
- Name of the rootkit, if available.
- Whether unexpected modifications were made to the kernel's code, read-only data memory, or certain important kernel data structures.
For more information, see the Security Command Center API documentation for the Finding object.
Preview stage support for the following integrations:
The Pipeline Templates feature is now generally available (GA). The Your Templates tab is supported by Artifact Registry and allows you to publish and curate pipeline and component templatess. For documentation, refer to Create, upload, and use a pipeline template.
December 04, 2022
Cloud Composer(New environments only) Creating Cloud Composer 2 environments no longer depends on the constraints/compute.requireOsLogin organization policy setting.
(Cloud Composer 2) Cloud Composer 2 environments now include the composer-user-workloads namespace that you can use to run user-defined workloads.
(Available without upgrading) Fixed an issue where Cloud Storage bucket metadata would reset to defaults when an update labels operation was triggered for a Cloud Composer environment.
Fix to address occasional backfills deadlocks was backported to Airflow versions 2.2.5 and 2.3.4 (#26161).
(Cloud Composer 2.1.0 with Airflow 2.3.4) Version 5.0.0 of the CNCF Kubernetes Provider package (apache-airflow-providers-cncf-kubernetes) introduces several backward incompatible changes. The most important changes are related to the kubernetes_default connection which is not used in version 5.0.0. These changes affect GKEStartPodOperator and KubernetesPodOperator operators. For more information, see Information about CNCF Kubernetes Provider.
The following versions for Cloud Composer 1.20.0 and 2.1.0 are available:
- composer-2.1.0-airflow-2.2.5
- composer-2.1.0-airflow-2.3.4 (default)
- composer-1.20.0-airflow-1.10.15 (default)
- composer-1.20.0-airflow-2.2.5
- composer-1.20.0-airflow-2.3.4
(New environments only) Airflow 2.3.4 is now the default Airflow version for Composer 2 environments.
(Cloud Composer 2) Starting with version 2.1.0, Composer environments no longer use Deployment Manager.
Cloud Composer versions 1.17.6 and 2.0.0-preview.6 have reached their end of full support period.
December 02, 2022
Cloud SpannerThe number of concurrent database restore operations per instance that Cloud Spanner supports has increased from five to ten. For more information, see Backup and restore limits.
Preview: Confidential Space is designed to let parties share sensitive data with a mutually agreed upon workload, while they retain confidentiality and ownership of that data. Such data might include personally identifiable information (PII), protected health information (PHI), intellectual property, cryptographic secrets, and more. Confidential Space helps create isolation so that data is only visible to the workload and the original owners of the data.
Eventarc support for customer-managed encryption keys (CMEK) is generally available (GA).
Event Threat Detection, a built-in service of Security Command Center, launched the Initial Access: Database Superuser Writes to User Tables rule to General Availability. This rule detects events where a Cloud SQL superuser (postgres for PostgreSQL servers or root for MySQL users) writes to non-system tables. For more information, see Event Threat Detection rules.
December 01, 2022
AlloyDB for PostgreSQLThe AlloyDB Clusters page of the Google Cloud console displays summary cards and a resource table that provide an overview on the overall health of your databases. This helps you monitor the real-time performance of your database fleet.
BigQuery now supports querying Apache Iceberg tables that are created by open source engines. This feature is in preview.
Google Cloud Platform Plugins version 0.20.4 is generally available (GA) in Cloud Data Fusion versions 6.7.1 and 6.7.2. This version includes Dataplex Source and Sink plugins in GA. For more information, see the CDAP Hub release log.
Google Cloud Platform Plugins version 0.19.3 is generally available (GA) in Cloud Data Fusion version 6.6.0. This version includes Dataplex Source and Sink plugins in GA. For more information, see the CDAP Hub release log.
The NEW_ZEALAND_IRD_NUMBER infoType detector is available in all regions.
The VAT_NUMBER infoType detector is available in all regions. Currently, this detector identifies VAT numbers from France, Germany, Hungary, Indonesia, Italy, and the Netherlands.
For more information about all built-in infoTypes, see InfoType detector reference.
The changes listed in the October 19th release rotes entry for PostgreSQL minor versions, extension versions, and plugin versions have been postponed.
Cloud TPU now supports Tensorflow 2.11.0. For more information see TensorFlow 2.11 release notes.
Dataplex Source and Sink plugins are generally available (GA) in Cloud Data Fusion for ingesting and processing data.
Error Reporting is a Virtual Private Cloud (VPC) supported service.
For some users, the IAM basic and predefined roles reference is crashing or is very slow to load. We are working to mitigate this issue.
Exactly once delivery is now GA.
November 30, 2022
Agent AssistThe Agent Assist Smart Reply feature now supports French (Canada) in addition to English (United states). See the language support page for details.
The following supported default parsers have changed. Each is listed by product name and ingestion label, if applicable.
- Akamai WAF (AKAMAI_WAF)
- AlgoSec Security Management (ALGOSEC)
- Ansible AWX (ANSIBLE_AWX)
- Arcsight CEF (ARCSIGHT_CEF)
- AWS Cloudtrail (AWS_CLOUDTRAIL)
- AWS Control Tower (AWS_CONTROL_TOWER)
- AWS GuardDuty (GUARDDUTY)
- Azure AD Directory Audit (AZURE_AD_AUDIT)
- BIND (BIND_DNS)
- Bluecat DDI (BLUECAT_DDI)
- Carbon Black (CB_EDR)
- Check Point (CHECKPOINT_FIREWALL)
- Cisco Firepower NGFW (CISCO_FIREPOWER_FIREWALL)
- Cisco Meraki (CISCO_MERAKI)
- Cisco Router (CISCO_ROUTER)
- Deep Instinct EDR (DEEP_INSTINCT_EDR)
- Department of Homeland Security (DHS_IOC)
- Elastic Windows Event Log Beats (ELASTIC_WINLOGBEAT)
- Emerging Threats Pro (ET_PRO_IOC)
- ESET Threat Intelligence (ESET_IOC)
- FortiGate (FORTINET_FIREWALL)
- Fortinet (FORTINET_DHCP)
- Cloud Audit (N/A)
- Security Command Center (N/A)
- GitHub (GITHUB)
- Hitachi Cloud Platform (HITACHI_CLOUD_PLATFORM)
- Juniper (JUNIPER_FIREWALL)
- Linux Auditing System (AuditD) (AUDITD)
- Mandiant Threat Intelligence (MANDIANT_IOC)
- Microsoft Azure Resource (AZURE_RESOURCE_LOGS)
- Microsoft Exchange (EXCHANGE_MAIL)
- Microsoft Graph API Alerts (MICROSOFT_GRAPH_ALERT)
- Microsoft Powershell (POWERSHELL)
- Netscout Arbor Sightline (ARBOR_SIGHTLINE)
- Office 365 (OFFICE_365)
- Okta (OKTA)
- Palo Alto Networks Firewall (PAN_FIREWALL)
- Palo Alto Prisma Access (PAN_CASB)
- Sentinelone Alerts (SENTINELONE_ALERT)
- Shrubbery TACACS+ (SHRUBBERY_TACACS)
- Signal Sciences WAF (SIGNAL_SCIENCES_WAF)
- Solarwinds Kiwi Syslog Server (SOLARWINDS_KSS)
- Splunk Platform (SPLUNK)
- Stealthbits Defend (STEALTHBITS_DEFEND)
- STIX Threat Intelligence (STIX)
- Symantec Endpoint Protection (SEP)
- Tanium Discover (TANIUM_DISCOVER)
- Tanium Threat Response (TANIUM_THREAT_RESPONSE)
- WatchGuard (WATCHGUARD)
- Windows Event (WINEVTLOG)
- Windows Network Policy Server (WINDOWS_NET_POLICY_SERVER)
For details about changes in each parser, see Supported default parsers.
Users can generate Supply chain Levels for Software Artifacts (SLSA) build provenance information for standalone Java and Python packages when they upload artifacts to Artifact Registry using new fields available in the Cloud Build config file. This feature is in public preview. For more information, see Build and test Java applications and Build and test Python applications.
Cloud Data Fusion version 6.4 is no longer supported as of December 1, 2022. You should upgrade your instances to run in a supported version. For instructions, see Upgrading your Cloud Data Fusion environment.
Marking keyword_searchable_job_custom_attributes on the Company as deprecated. Moving forward please use the keyword searchable tag on the Job.CustomAttribute to specify keyword searchable.
Marking company_size histogram facet as deprecated.
Cloud Storage Backint agent for SAP HANA version 1.0.23
Version 1.0.23 of the Cloud Storage Backint agent for SAP HANA is now available. This version includes stability enhancements.
For more information about the agent, see Cloud Storage Backint agent for SAP HANA overview.
AutoML image model updates
AutoML image classification and object detection now support a higher-accuracy model type. This model is available in Preview.
For information about how to train a model using the higher accuracy model type, see Begin AutoML model training.
Batch prediction is currently not supported for this model type.
Cloud Logging for Vertex AI Pipelines is now generally available (GA). For more information, see View pipeline job logs.
reCAPTCHA Enterprise Mobile SDK iOS v18.0.3 is now available. This version contains the following changes:
- Performance improvements
- Dependency of the Protobuf library is removed
- Build support for Xcode13
- Bug fixes
reCAPTCHA Enterprise Mobile SDK Android v18.0.1 is now available. This version contains performance improvements.
November 29, 2022
Apigee IntegrationOn November 29, 2022 we released an updated version of the Apigee Integrations software.
Integration variable color code
The color codes of all the integration variable data types is removed and now changed to a single uniform color. Integration variables will no longer be color coded (green, blue, orange) based on their data type.
See Format of an integration variable.
Data Mapping editor
- The background color of the Input and Output row is changed to a single uniform color.
- Input rows are updated to add line breaks and indentations according to the use of mapping functions to improve readability and structure recognition.
- A confirmation dialog is displayed before proceeding to delete an entire Input row.
See Data Mapping editor.
Three new rate limiting keys are now Generally Available:
- HTTP-PATH
- SNI
- REGION-CODE
For more information about using rate limiting keys, see the Rate limiting overview.
Kubernetes control plane logs are now Generally Available. You can now configure GKE clusters with control plane version 1.22.0 or later to export to Cloud Logging logs emitted by the Kubernetes API server, Scheduler, and Controller Manager.
These logs are stored in Cloud Logging and can be queried in the Cloud Logging Log Explorer or Cloud Logging API. These logs can also be sent to Google Cloud Storage, BigQuery, or Pub/Sub using the Log Router.
You can now use deprecation insights to identify clusters on versions 1.23 and earlier that use Docker-based node images, which are unsupported on GKE version 1.24 and later.
Text-to-Speech now offers additional Neural2 voices across 9 locales with 40+ speakers. Voices are available in the us-central1, us, and eu endpoints. See the supported voices page for a complete list of voices and audio samples.
November 28, 2022
BigQueryBigQuery now supports the following features when you load data:
- ASCII control characters for CSV files.
- Reference file with the expected table schema for creating external tables with Avro, ORC, and Parquet files.
These features are generally available (GA).
View granular cost data from Cloud Run instances in Cloud Billing exports to BigQuery
You can now view granular Cloud Run cost data in the Google Cloud Billing detailed export. Use the resource.global_name field in the export to view and filter your Cloud Run instances.
View granular cost data from Cloud Function instances in Cloud Billing exports to BigQuery
You can now view granular Cloud Function cost data in the Google Cloud Billing detailed export. Use the resource.global_name field in the export to view and filter your Cloud Function instances.
A weekly digest of client library updates from across the Cloud SDK.
Zerto Solution version 9.5u1 is now supported as a disaster recovery solution with VMware Engine. Learn more about setting up Zerto Solution.
Preview: VMware Engine private clouds support the addition of a Trusted Platform Module (TPM) 2.0 virtual cryptoprocessor to a virtual machine.
For details about this feature, see About Virtual Trusted Platform Module.
A weekly digest of client library updates from across the Cloud SDK.
Java
Changes for google-cloud-pubsub
1.121.1 (2022-11-21)
Dependencies
- Update dependency com.google.cloud:google-cloud-bigquery to v2.18.0 (#1375) (b6ada4e)
- Update dependency com.google.cloud:google-cloud-bigquery to v2.19.1 (#1416) (e140a49)
- Update dependency org.graalvm.buildtools:junit-platform-native to v0.9.18 (#1413) (b3fb828)
- Update dependency org.graalvm.buildtools:native-maven-plugin to v0.9.18 (#1414) (74d2dc3)