Welcome to issue #217 November 23rd, 2020

News

The need for speed: Using C2 machines for your HPC workloads - Optimize your HPC workloads for the compute-optimized (C2) VMs based on second generation Intel Xeon Scalable Processors.

How we're advancing intelligent automation in network security - We’re announcing four new capabilities to help customers protect their users, data, and applications in the cloud.

I do declare! Infrastructure automation with Configuration as Data - Configuration as Data enables operational consistency, security, and velocity on Google Cloud with products like Config Connector.

Filestore Backups eases migration of file-based apps to cloud - The new Filestore Backups lets you migrate your copy data services and backup strategy for your file systems in Google Cloud.

Introducing .NET on Google Cloud Functions - .NET Core 3.1 is now available for Cloud Functions, letting you write cloud functions with our Functions Framework for .NET.

Data governance in Google Cloud–new ways to securely access and discover data - As organizations bring ever more sensitive data analytics workloads to the cloud, BigQuery column-level security, now GA, provides fine-grained controls to help them satisfy principles of least-privileged access.

Turbocharge your software supply chain with Artifact Registry, now GA - Artifact Registry is now GA and lets you store OS and language packages as well as container images for your software supply chain.

Introducing Voucher, a service to help secure the container supply chain - Shopify developed the open-source Voucher on top of Google Cloud Binary Authorization to help secure its container supply chain.

Articles, Tutorials

Infrastructure, Networking, Security, Kubernetes

A developer’s guide to Google Kubernetes Engine, or GKE - Learn how to develop applications destined for GKE, and the benefits that Kubernetes brings to developers, in these blogs.

Lessons learned from managing a Kubernetes cluster for side projects - Experience in using GKE for one year for personal projects.

How to automate management of TLS certificates on GKE - This article describes how to set up a managed certificate for a custom domain on GKE.

Running Elixir apps on GKE at scale with PostgreSQL backend using PGBouncer - Running Elixir apps on GKE at scale with PostgreSQL backend using PGBouncer for better connection pooling with transaction pool mode.

Autobucket Operator - Building a Cloud Storage Kubernetes Operator with Go and Operator SDK.

Understanding Google Container Registry in GKE - Dissecting how to securely store your images and configure access from your cluster.

Migrate For Anthos: Migration from VM’s to Containers - Let’s Start with Understanding Migration and Modernisation concept and how Anthos help to enhance this process.

GCP: Do not suffer anymore from Key Leaks! - How Google Cloud handles leaked secret keys.

Building monitoring dashboards for fun and profit - New functionalities of Dashboard Editor for Cloud Monitoring.

Google Auth — Dispelling the Magic - What to do when Google Application Default Credentials break on you.

Announcing Project Lockdown - Project Lockdown is a collection of automated remediations that react in real time to keep your GCP environment secure.

Implementing the principle of least privilege at Voi - How Voi (Scandinavian micro mobility company) implements the principle of least privilege for their developers.

Getting Kubernetes logs into BigQuery cost-effectively - How to navigate those JSON logs safely to BigQuery harbour.

App Development, Serverless, Databases, DevOps

.NET 5.0 on Google Cloud - .NET 5.0 was released just a few days ago with many new features and improvements. In this blog post, we show you how to deploy .NET 5.0 to Cloud Run.

Four ways to generate value from your APIs - Explore four ways to get more value from your APIs, from API monetization to expanded brand reach.

Collecting your GCE Syslogs to Stackdriver in GCP - Consolidate logging from GCE into Cloud Logging for further use case.

Take a Look at Google Buildpacks - Do you know Google Buildpacks? Compare it with the general version.

Upload file to GCS, create URL which expires using Spring Cloud - A Spring Boog Java application which creates signed URL to upload file to Cloud Storage.

Working with Cloud Spanner and Java - Building and application using Cloud Spanner.

Testing a Spring Boot application with the Google Cloud Spanner Emulator - Using Cloud Spanner emulator with Spring Boot Java application.

GraphQL Server Using Firebase - Using GraphQL with FIrebase.

Orchestrating microservices with Cloud Workflows - Demo of Cloud Workflows.

Big Data, Analytics, ML&AI

Use real-time anomaly detection reference patterns to combat fraud - Algorithms and machine learning models can help you implement a streaming anomaly detection architecture using pre-designed reference patterns and cloud data analytics.

Scaling Google BigQuery analytical functions - Google BigQuery, Google’s data warehouse solution, has many functions and capabilities.

How to de-duplicate rows in a BigQuery table - Duplicate data sometimes can cause wrong aggregates or results in joins. You probably need to remove those duplicate rows before doing any….

Google Data Studio reference lines with parameter - Data Studio now supports parameters as a new option for reference line types.

Google Cloud Healthcare API - Learn how this can accelerate AI solutions to benefit modern medicine.

Google Cloud AI Platform Unified - Launched on 16 Nov 2020, AI Platform Unified caught us by surprise. Learn exactly what’s been “unified”.

Building a CI Pipeline with Jupyter Notebooks on GCP - Implementing a CI Pipeline with Jupyter Notebooks on GCP.

Google Cloud Pub/Sub: How to Monitor the Health of your Subscription for optimal end-to-end Latency - This blog post will discuss how you can measure the ‘health’ of your Cloud Pub/Sub Subscription when it comes to end to end latency.

Quick Start With Kubeflow Pipelines on Google Cloud Platform - The main purpose of this article is to demonstrate the way to install and use Kubeflow on Google Cloud Platform.

How AI, and specifically BERT, helps the patent industry - How AI helps businesses do better patent analysis.

How ZSL uses ML to classify gunshots to protect wildlife - The analysis of acoustic (sound) data to support wildlife conservation is one of the major lines of work at ZSL’s monitoring and technology programme.

Google Cloud AI digitizes StoryCorps archive: largest collection of human voices on planet - Google Cloud AI unlocks StoryCorps archive of 300,000+ interviews.

Google Cloud, Harvard Global Health Institute release improved COVID-19 Public Forecasts, share lessons learned - Google Cloud AI and Harvard improve COVID-19 forecasts, share lessons learned.

Various

Empowering customers and the ecosystem with an open cloud - An open cloud based on open source and open data can help organizations innovate faster and more safely.

How BigQuery helped Theta Labs and NASA bring science and hope to streaming - See how Theta Labs helped livestream the SpaceX launch with help from Google Cloud’s databases and data analytics tools.

The 10 most popular sessions from Google Cloud Next ‘20: OnAir - From cloud migration to security to productivity: here’s a quick breakdown of our top 10 sessions from Next OnAir.

The democratization of data and insights: Expanding machine learning access - Learn why machine learning is critical to generating insights in today’s world of big data, as well as what Google Cloud is doing to expand access to this powerful method of analysis.

How to pass Google Cloud Platform — Professional Data engineer exams - Preparing for Professional Data Engineer exam.

Slides, Videos, Audio

Kubernetes Podcast - #130 KubeCon NA 2020, with Stephen Augustus.

Firebase Podcast - Everything announced at the Firebase Summit (Part 1).

Releases

Anthos - Anthos 1.5.2 is now available.

AppEngine Standard PHP7 - The PHP7.4 runtime for the App Engine standard environment are now generally available.

AppEngine Standard Ruby - The Ruby 2.6 and 2.7 runtimes for the App Engine standard environment are now generally available.

BigQuery - BigQuery column-level security is now generally available.

Cloud Build - Users can now transfer Cloud Build metrics to BigQuery through the BigQuery notifier, a new open-source notifier.

Cloud Composer - Composer version 1.12.5 or newer: File synchronization between buckets in Domain restricted sharing compliant environments has been improved.

Compute Engine - Preview: Reserve GPUs and local SSDs on sole-tenant nodes. Preview: Rename VM instances. You can now use security keys as a 2-step verification method when connecting to VMs using OS Login. GA: Collect diagnostic information from Windows Server VMs. N2D machine types are now available in us-west1-a, The Dalles, Oregon.

Dataproc - New sub-minor versions of Dataproc images: 1.3.77-debian10, 1.3.77-ubuntu18, 1.4.48-debian10, 1.4.48-ubuntu18, 1.5.23-debian10, 1.5.23-ubuntu18, 2.0.0-RC19-debian10, and 2.0.0-RC19-ubuntu18. Image 2.0 preview Upgraded Hue to version 4.8.0.

Dialogflow - The Dialogflow Messenger integration is now implemented for Dialogflow CX. Agent Validation is now implemented for Dialogflow CX.

Cloud Filestore - Filestore now supports access over VPN.

Cloud Functions - Cloud Functions has added support for a new runtime, .NET, in Preview. Cloud Functions now supports Node.js 12 at the General Availability release level.

GKE on Prem - Anthos GKE on-prem 1.5.2-gke.3 is now available. GKE Data Plane V2 Preview is now available. Binary Authorization for GKE on-prem 0.2.1 is now available. Fixes: Fixed false warning in gkectl check-config for admin cluster for manual load balancing category.

Anthos Migrate - On November 17, 2020 we released Migrate for Anthos 1.5.1. 170604382: Running migctl when not connected to a cluster no longer results in a panic error, but instead returns an error message describing the issue. 169919740: When using a custom services blocklist to disable a service in a workload, if the service was already disabled by default, the migrated container no longer can crash when deployed. 171173082: Mistakenly creating a local VMware source on a Cloud-based cluster, normally used only in an on-prem migration, no longer results in the source being in PROCESSING state forever but instead returns an error. 170566991: For Windows migrations, only HTTP and HTTPS site bindings are supported. 170618192: Similarly to Linux migrations, Windows migrations now add to the generate artifacts object an annotation containing the migration spec and comments. When creating a migration source for Compute Engine workload, Migrate for Anthos now tests that the GCP specified project exists.

Cloud Monitoring - A new dashboard editor is available in Preview.

Private Catalog - Private Catalog launches an updated Cloud Console experience for cloud admins.

Cloud PubSub - Pub/Sub message filtering is now available in GA.

Cloud Run for Anthos - Cloud Run for Anthos on Google Cloud version 0.18.0-gke.5 is now available for following GKE minor version: 1.17 1.18 1.19. Authentication failures when image tags used during private container image deployment from Artifact Registry.

Cloud SQL MySQL - Cloud SQL for MySQL now supports retention settings for automated backups. Cloud SQL for MySQL now supports retention settings for point-in-time recovery.

Cloud SQL Postgres - Cloud SQL for PostgreSQL now supports retention settings for automated backups. Cloud SQL for PostgreSQL now supports retention settings for point-in-time recovery.

Cloud SQL SQL Server - Cloud SQL for SQL Server now supports retention settings for automated backups.

VPC Service Controls - General availability support for the following integration: Artifact Registry.

Network Intelligence Center - Firewall Insights is available in General Availability.

Anthos GKE deployed on-prem - Anthos GKE on-prem 1.5.2-gke.3 is now available. GKE Data Plane V2 Preview is now available. Binary Authorization for GKE on-prem 0.2.1 is now available. Fixes: Fixed false warning in gkectl check-config for admin cluster for manual load balancing category.

Dialogflow Enterprise - The Dialogflow Messenger integration is now implemented for Dialogflow CX. Agent Validation is now implemented for Dialogflow CX.

Artifact Registry - Artifact Registry is now generally available.

If you have suggestion, feedback or link you want to share feel free to email me at zdenko@gcpweekly.com

Have a great week,

Zdenko