Google Cloud release notes

BigQuery Table ACL is now available as a beta release. For more information, see Introduction to table access controls .

Access Transparency GA

Access Transparency logging is now Generally Available. If you want to enable Access Transparency logs, see Enabling Access Transparency.

Flow parameters: Create flow parameters that you can reference in the recipes of your flow.

• NOTE: For this release, flow parameters can be applied into your recipes only.
• As needed, you can apply overrides to the parameters in your flow or to downstream flows.
• NOTE: Flow parameters do not apply to datasets or output objects, which have their own parameters. However, if you specify an override at the flow level, any parameters within the flow that use the same name receive the override value, including output object parameters and datasets with parameters.
• See Manage Parameters Dialog.
• For more information on parameters, see Overview of Parameterization.

Introducing new Flow View: The Flow View page has been redesigned to improve the user experience and overall productivity.

NOTE: This feature is in Beta release.

• Enhancements include:
  • Drag and drop to reposition objects on the Flow View canvas, and zoom in and out to focus on areas of development.
  • Perform joins and unions between objects on the Flow View canvas.
  • Annotate the canvas with notes.
• You can toggle between new and classic views through the context menu in the corner of Flow View. See Flow View Page.

Redesigned Settings and Help menus: See Home Page.

• User settings are now modified through Preferences. See Preferences Page.

Report issue: If you are experiencing an issue with Cloud Dataprep by TRIFACTA INC., you can gather useful information from the application to deliver to Support.

• From the Help menu, select Report issue.

Transformer page:

• Join steps are now created in a larger window for more workspace. See Join Window.
• New column selection UI simplifies choosing columns in your transformations. See Transform Builder.

Transformer page performance:

• Improved performance when loading the Transformer page and when navigating between the Flow View and Transformer pages.
• Faster and improved method of surfacing transform suggestions based on machine learning.

PDF profiles: When visual profiling is enabled for a job, you can now download your visual profile in PDF format. See Job Details Page.

New functions:

• New aggregation functions for Datetime values:
  • MINDATE Function
  • MAXDATE Function
  • MODEDATE Function
• New parsing by data type functions:
  • PARSEBOOL Function
  • PARSEFLOAT Function
  • PARSEINT Function
  • PARSEDATE Function
• New functions for calculating working days between two valid dates:
  • NETWORKDAYS Function
  • NETWORKDAYSINTL Function
  • WORKDAY Function
  • WORKDAYINTL Function
• New time zone conversion functions:
  • CONVERTFROMUTC Function
  • CONVERTTOUTC Function
  • CONVERTTIMEZONE Function
• New statistical functions:
  • MEDIAN Function
  • PERCENTILE Function
  • QUARTILE Function
  • CORREL Function
  • COVAR Function
  • COVARSAMP Function
• Ignore case parameter added to string functions:
  • STARTSWITH Function
  • ENDSWITH Function
  • EXACT Function
  • MATCHES Function
  • STRINGGREATERTHAN Function
  • STRINGGREATERTHANEQUAL Function
  • STRINGLESSTHAN Function
  • STRINGLESSTHANEQUAL Function
  • SUBSTITUTE Function

The VPC accessible services feature is now generally available. Use VPC accessible services to limit the access of network endpoints and VMs in a perimeter to only services protected by that perimeter.

For more information about the feature, see VPC accessible services.

HTTP(S) Load Balancing logging is now available in General Availability.

In the Logs Viewer (Preview), you can now save your queries, which can then be viewed and run from the Saved queries tab. For more information, see the Saved queries section on the Building queries page.

The Cloud Run user interface now allows you to edit the service YAML.

The Version Upgrade and Redis version 5.0 features are now Generally Available on Memorystore for Redis.

Hierarchical firewall policies are now available in Beta.

You can now purchase BigQuery slots using the bq command-line tool. BigQuery Reservations allows you to purchase slots to take advantage of BigQuery flat-rate pricing and allocate slots for workload management.

A new GIS function, ST_Simplify, is available. ST_Simplify returns a simplified version of the input GEOGRAPHY by replacing sections with straight lines.

You can now use a custom filter when you list endpoints in a zonal network endpoint group. This feature is available as a Beta release.

General availability of custom access levels.

Custom access levels provide a way to use Common Expression Language to craft custom conditions. Create custom access levels using the gcloud command line tool, the Access Context Manager API, and in the Google Cloud Console using the Advanced Mode for configuring access levels.

NVIDIA® Tesla® T4 GPUs are now available in the following additional regions and zones:

• Changua County, Taiwan asia-east1-c

For information about using T4 GPUs on Compute Engine, see GPUs on Compute Engine.

Labels column added to the flat table view of the Cloud Billing Cost Table report. The Cost Table report provides a tabular view of your invoice costs. You can quickly filter your costs by available fields, such as project, service, SKU, and labels (among other fields), and you can download the table to CSV for offline analysis. See the documentation for more details.

The ability to authenticate users with external identities is now generally available.

GKE annotations and advanced controls for VPC Flow Logs is now available in General Availability.

Several fields related to data integrity have been added to the Cloud KMS API, along with guidelines for using them. To learn more about maintaining data integrity when performing cryptographic operations, see Verifying end-to-end data integrity.

Dataproc now provides beta support for Dataproc Hub.

Cloud Functions has added support for a new runtime, Java 11, in Beta:

• The Java Runtime

Pub/Sub Lite is now available at the beta launch stage.

You can now view, prioritize, and apply recommendations in the Google Cloud Console using Recommendation Hub (Beta).

Get started with Recommendation Hub.

You can now use TPUs with TensorFlow 2.1 when you create a training job with runtime version 2.1. You can also use TPUs with TensorFlow 2.1 when you train in a custom container.

Read the guide to using TPUs with AI Platform Training, which has been updated to show how to use TPUs with TensorFlow 2 APIs.

Anthos 1.3.2 is now available.

Updated components:

• Anthos GKE on-prem release notes
• Anthos Config Management release notes
• Anthos GKE on AWS is available as a limited preview for customers with an existing relationship with Google Cloud. Contact your sales representative for access.

Anthos Config Management now includes Config Connector v1.8.0.

Workload Identity is now available in Alpha for GKE on-prem. Please contact support if you are interested in a trial of Workload Identity in GKE on-prem.

Cloud Billing Budget API: new budget filters for groups of subaccounts and resource labels are now available in the Budget API. See the documentation for more details.

PostgreSQL version 12 is now generally available. To start using PostgreSQL 12, see Creating instances.

E2 shared-core machine types now support committed use discounts in all regions. See the VM instance pricing page for more information.

You can now SSH to your VMs using hardware-backed SSH key pairs. For more information, see SSH with security keys.

You can now set core:fs.defaultFS to a location in Cloud Storage (for example, gs://bucket) when creating a cluster to set Cloud Storage as the default filesystem. This also sets core:fs.gs.reported.permissions, the reported permission returned by the Cloud Storage connector for all files, to 777. If Cloud Storage is not set as the default filesystem, this property will continue to return 700, the default value.

Image 1.4 and 1.5

HADOOP-16984: Enable persistent history server to read from done directory.

Beta stage support for the following integration:

• Service Directory

The following features are available in the Video Intelligence API version v1p3beta1:

Face detection: Locate faces within a video, and identify attributes such as glasses being worn. Learn more

Person detection: Locate people in a video, and identify attributes and 2D landmarks. Learn more

1.5.4-asm.2

1.5.4-asm.2 is now available.

Beta release of the Anthos CLI

The Anthos CLI simplifies the installation of Anthos Service Mesh. You can use the Anthos CLI to:

• Create a new cluster that meets the Anthos Service Mesh cluster requirements and install Anthos Service Mesh. See Installing Anthos Service Mesh on a new cluster using the Anthos CLI.
• Update an existing cluster with the options that Anthos Service Mesh requires and install Anthos Service Mesh. See Installing Anthos Service Mesh on an existing cluster using the Anthos CLI.

Happy 10th birthday, BigQuery!

Cloud SQL federated queries are now generally available (GA).

Hourly partitioned tables are now in beta.

Dynamic SQL is now available as a beta release in all BigQuery regions. Dynamic SQL lets you generate and execute SQL statements dynamically at runtime. For more information, see EXECUTE IMMEDIATE.

BigQuery Trial slots are now available in US and EU multi-regions. Trial slots are a limited promotion for qualified customers.

For internal TCP/UDP load balancers, you can create multiple forwarding rules with the same IP address. The forwarding rules can have different protocols and ports. This feature is available in Beta.

Cloud Monitoring introduces an improved experience for viewing and managing incidents. Improvements include performance optimizations for Workspaces with large numbers of incidents, summary statics, and the ability to filter by alerting policy name, metric type, and resource type. For more information, see Incidents and events.

The Cloud Run container instance metadata server now exposes the unique identifier of the container instance and the region of the Cloud Run service

If your managed instance group encountered errors - for example, if a VM could not be created - you can view those errors to diagnose and mitigate the cause. This is Generally available.

Cloud Debugger now lets you canary snapshots and logpoints on your Java applications. To learn more, see the Java page for setting up Cloud Debugger.

Troubleshoot VMs by capturing screenshots. This is in beta.

Learn how to create low disk space alerts for your Filestore instances.

TensorFlow 2.2 images have been added. The new TensorFlow 2.2 image families are tf2-2-2-cpu and tf2-2-2-cu101. See the available image families.

Cloud Billing budgets emails: ensure your budget alert emails are seen by the right people using Cloud Monitoring notifications on your Cloud Billing budgets. By default, alert emails are sent to Billing Account Administrators. With the Monitoring notifications feature, you can customize your budget to send alerts to up to five additional email recipients you specify. See the documentation for more details.

New information is now available on your Cloud Billing account Overview page in the Cloud Console, featuring at-a-glance summaries of the top five spending projects and top five spending products over the last 12 months.

To see the updated Billing Account Overview page, go to the Manage billing accounts page in the Cloud Console and sign in, then select the name of the Cloud Billing account you want to view. The Billing Overview page is displayed with the BILLING ACCOUNT OVERVIEW tab selected. You might need to scroll the page to see all the features.

DNS forwarding to a non-RFC 1918 address is available in General Availability.

Logs Viewer now contains the Logs field explorer panel, which lets you view aggregation-based results for your project's log fields and makes it more efficient to refine queries. To learn more, go to the Logs Viewer (Preview) page.

MySQL 5.6 minor version is upgraded to 5.6.42. MySQL 5.7 minor version is upgraded to 5.7.25.

You can now run SQL queries to retrieve transaction statistics for your database over recent one-minute, 10-minute, and one-hour time periods.

Subnets in VPC networks now support IP addresses other than RFC 1918 addresses. For more information, see Subnet ranges.

Added infoType detectors:

AWS_CREDENTIALS

• Resource quota limits have been updated, allowing environment administrators to set quotas with more granularity. The default quotas for read and write operations have also changed; see Cloud Composer resource quotas for details. The old limits are deprecated, but will not be removed from the Cloud Console Quotas page until a future release.

PostgreSQL 9.6 minor version is upgraded to 9.6.16. PostgreSQL 10 minor version is upgraded to 10.11. PostgreSQL 11 minor version is upgraded to 11.6. PostgreSQL 12 minor version is upgraded to 12.1.

To get a fine-grained view of billing data for each resource used by your App Engine services, you can apply labels to the services, export your billing data to BigQuery, and run queries. For more information, see Labeling App Engine resources.

To get a fine-grained view of billing data for each resource used by your App Engine services, you can apply labels to the services, export your billing data to BigQuery, and run queries. For more information, see Labeling App Engine resources.

To get a fine-grained view of billing data for each resource used by your App Engine services, you can apply labels to the services, export your billing data to BigQuery, and run queries. For more information, see Labeling App Engine resources.

To get a fine-grained view of billing data for each resource used by your App Engine services, you can apply labels to the services, export your billing data to BigQuery, and run queries. For more information, see Labeling App Engine resources.

To get a fine-grained view of billing data for each resource used by your App Engine services, you can apply labels to the services, export your billing data to BigQuery, and run queries. For more information, see Labeling App Engine resources.

To get a fine-grained view of billing data for each resource used by your App Engine services, you can apply labels to the services, export your billing data to BigQuery, and run queries. For more information, see Labeling App Engine resources.

To get a fine-grained view of billing data for each resource used by your App Engine services, you can apply labels to the services, export your billing data to BigQuery, and run queries. For more information, see Labeling App Engine resources.

To get a fine-grained view of billing data for each resource used by your App Engine services, you can apply labels to the services, export your billing data to BigQuery, and run queries. For more information, see Labeling App Engine resources.

To get a fine-grained view of billing data for each resource used by your App Engine services, you can apply labels to the services, export your billing data to BigQuery, and run queries. For more information, see Labeling App Engine resources.

To get a fine-grained view of billing data for each resource used by your App Engine services, you can apply labels to the services, export your billing data to BigQuery, and run queries. For more information, see Labeling App Engine resources.

To get a fine-grained view of billing data for each resource used by your App Engine services, you can apply labels to the services, export your billing data to BigQuery, and run queries. For more information, see Labeling App Engine resources.

To get a fine-grained view of billing data for each resource used by your App Engine services, you can apply labels to the services, export your billing data to BigQuery, and run queries. For more information, see Labeling App Engine resources.

To get a fine-grained view of billing data for each resource used by your App Engine services, you can apply labels to the services, export your billing data to BigQuery, and run queries. For more information, see Labeling App Engine resources.

To get a fine-grained view of billing data for each resource used by your App Engine services, you can apply labels to the services, export your billing data to BigQuery, and run queries. For more information, see Labeling App Engine resources.

To get a fine-grained view of billing data for each resource used by your App Engine services, you can apply labels to the services, export your billing data to BigQuery, and run queries. For more information, see Labeling App Engine resources.

To get a fine-grained view of billing data for each resource used by your App Engine services, you can apply labels to the services, export your billing data to BigQuery, and run queries. For more information, see Labeling App Engine resources.

AI Platform Prediction now supports the following regions for batch prediction, in addition to those that were already supported:

• northamerica-northeast1 (Montréal)
• southamerica-east1 (São Paulo)
• australia-southeast1 (Sydney)

See the full list of available regions.

northamerica-northeast1 and southamerica-east1 have the same pricing as other Americas regions, and australia-southeast1 has the same pricing as other Asia Pacific regions. Learn about pricing for each region.

AI Platform Training now supports the following regions, in addition to those that were already supported:

• northamerica-northeast1 (Montréal)
• southamerica-east1 (São Paulo)
• australia-southeast1 (Sydney)

GPUs are available for training in each of the new regions:

• NVIDIA Tesla P4 GPUs are available in northamerica-northeast1.
• NVIDIA Tesla T4 GPUs are available in southamerica-east1.
• NVIDIA Tesla P4 GPUs and NVIDIA Tesla P100 GPUs are available in australia-southeast1.

See the full list of available regions and the guide to training with GPUs.

northamerica-northeast1 and southamerica-east1 have the same pricing as other Americas regions, and australia-southeast1 has the same pricing as other Asia Pacific regions. Learn about pricing for each region.

Cloud Run (fully managed) now supports connecting to a VPC network with Serverless VPC Access, in beta.

Released support for VPC Service Controls for Memorystore for Redis.

Beta stage support for the following integration:

• Memorystore for Redis

Automatically manage the size of sole-tenant node groups with the sole-tenant node group autoscaler. This is Generally Available.

Security Command Center Premium and Standard tiers are now available.

The Security Command Center Premium tier includes:

• Security Health Analytics
• Web Security Scanner managed scans
• Event Threat Detection
• Container Threat Detection

Learn more about the Security Command Center Premium tier.

Container Threat Detection currently supports the following Kubernetes Engine versions on the Regular and Rapid channels:

• >= 1.15.9-gke.12
• >= 1.16.5-gke.2
• >= 1.17

In a future update, Container Threat Detection will support version 1.14 and the Stable channel.

You can now use regular expressions to query your logs data and create filters. For more information, go to Using regular expressions.

Cloud SQL has expanded support for PostgreSQL extensions. Eight additional PostgreSQL extensions are now available:

• pageinspect
• pgfincore
• pg_freespacemap
• pg_repack
• pg_visibility
• PL/Proxy
• postgres_fdw
• postgresql-hll

For information about these newly-added extensions, see PostgreSQL extensions.

You can identify idle persistent disk resources by using idle persistent disk recommendations. Following these recommendations will help reduce unused resources and reduce your compute bill. This feature is Generally available.