GCP Newsletter #250

Welcome to issue #250 July 12th, 2021

News

Official Blog

Cloud SQL for MySQL launches IAM database authentication - Simplify administration and security in Cloud SQL for MySQL with IAM database authentication, now in GA.

BigQuery Data Analytics Official Blog

New This Month in Data Analytics: Simple, Sophisticated, and Secure - We used all the hours we could in June to deliver a flurry of new features across BigQuery, Dataflow, Data Fusion, and more. Let’s take a look!

GCP Certification Official Blog

Learn to code for the cloud: Earn native app development skills badges for free - Google Cloud’s new Native App Development skills challenge lets you earn badges that demonstrate your ability to create cloud-native apps.

 

Articles, Tutorials

Infrastructure, Networking, Security, Kubernetes

Config Connector Google Kubernetes Engine Official Blog

Build a platform with KRM: Part 5 - Manage hosted resources from Kubernetes - Learn how to manage your Google Cloud-hosted resources with GKE and Config Connector.

DevOps Networking Windows

Accidental Network Outage? Here’s How You Can Regain Access to Your Google Cloud Windows Instance - Reconnecting when Windows server is unexpectedly disconnected from the internet.

Beginner Python Terraform

First steps in Pulumi with Python & Google Cloud Platform - Getting started with Pulumi on GCP.

App Development, Serverless, Databases, DevOps

Cloud SQL Official Blog

Authenticating to Cloud SQL for PostgreSQL with IAM service accounts - This blog post’s goal is to provide an ELI5 procedural outline of the steps that one needs to take in order to that led to perform: Configure Cloud SQL for IAM Authentication Configure a user agent to connect to a given database using assigned service account credentials.

Cloud Spanner Official Blog

Measuring Cloud Spanner performance for your workload - In this post, we will explore a middle ground to performance testing using JMeter. Performance test Cloud Spanner for a custom workload before making application code changes and executing data migration.

Cloud Firestore Official Blog

All you need to know about Firestore: A cheatsheet - Building applications is a heavy lift due to the technical complexity, which includes the complexity of backend services that are used to manage and store data. Firestore alters this by having Google Cloud manage your backend complexity through a complete backend-as-a-service!

Billing Cloud Storage GCP Experience

Saving $30000 a month by improving Garbage Collection - Improving storage costs at Mixpanel.

Billing Cloud Monitoring

Case of Cost Spike in GCP Stackdriver Monitoring - Optimizing Cloud Monitoring costs.

Cloud Run NodeJS Serverless

Session Management on Google Cloud Run with Serverless Redis - A basic web application that runs on Google Cloud Run and keeps the user sessions in Upstash Redis.

Cloud Pub/Sub NodeJS

Setting Up Gmail Pub/Sub - This article is a basic walkthrough of setting up Pub/Sub notifications when new emails arrive in Gmail.

Cloud Storage Firebase NodeJS Tutorial

Uploading an Image to Firebase Cloud Storage and returning URL with Express / Nodejs - A step by step tutorial to create and deploy web application in Firebase to upload images.

Big Data, Analytics, ML&AI

Cloud Dataproc Official Blog

How to build an open cloud datalake with Delta Lake, Presto & Dataproc Metastore - Building an Open Data Lake with Apache Spark for data processing, Presto as a query engine and Open Formats such as Delta Lake for storing all data.

Cloud Pub/Sub NodeJS Python

Exploring Pub/Sub and Pub/Sub Lite - Exploring and comparing Pub/Sub and Pub/Sub Lite.

BigQuery Javascript

Using NPM Library in Google BigQuery UDF - Javascript UDF’s are cool and using with NPM library is a whole new world to explore!

BigQuery Data Analytics

Why We Shouldn’t Ignore Null Values and How to Treat Them - Data cleaning using Google BigQuery SQL.

Beginner BigQuery Data Science

Working with Times and Dates in BigQuery - Common operations with dates in BigQuery.

BigQuery Terraform

Version control BigQuery with Terraform (with CI/CD too) - Using Terraform to version BigQuery views.

BigQuery dbt

Data Status Time Machine on Persisted dbt Artifacts - Storying and analyzing dbt artifacts in BigQuery.

CI Data Analytics dbt

Step-by-step guide to run dbt in production with Google Cloud Platform - A step-by-step guide to run dbt in production with GCP.

BigQuery Data Studio

Data Layers in Data Studio - Understanding the difference between DWH data, data source, and chart data.

AI BigQuery Machine Learning

Unsupervised Anomaly Detection using BigQuery ML - Three unsupervised Machine learning models provided by BigQuery ML to predict anomalies in both time series and non-time series data.

Various

GCP Certification

Passing the Google Cloud Certified Professional Architect 2021 exam - Sharing experience on the preparation for the GCP Architect certification exam and the actual exam itself.

GCP Certification

GCP Associate Cloud Engineer Exam Preparation App for iOS, android, Windows10 - GCP Associate Cloud Engineer Exam Preparation App for iOS, Android, Windows10.

GCP Certification

Notes from my beta Google Cloud Digital Leader certification exam - An overview of Cloud Digital leader certification exam.

Slides, Videos, Audio

GCP Podcast - #266 Data Analytics Launches with Bruno Aziza and Eric Schmidt.

Kubernetes Podcast - #153 Komodor, with Itiel Shwartz.

 

Releases

AI Platform - Deep Learning VMs - M74 Release Re-released all CUDA 11 images to fix an issue in which VM instances are unable to detect GPU accelerators after a reboot. In Debian 10 GPU images, updated NVIDIA drivers to 460.73.01 and CUDA to 11.0.3.

Anthos clusters on AWS - Anthos clusters on AWS aws-1.8.0-gke.8 is now available. This release fixes an issue mentioned in the entry on July 2, 2021. When you upgrade or update a user cluster, the Connect agent is automatically updated to the latest version.

BigQuery - BigQuery now supports materialized views without aggregation and materialized views with inner join.

Cloud Composer - Cloud Composer 1.16.9 release started on July 8, 2021. New versions of Cloud Composer images: composer-1.17.0-preview.5-airflow-2.0.1 composer-1.16.9-airflow-1.10.15 (default) composer-1.16.9-airflow-1.10.14 composer-1.16.9-airflow-1.10.12. When PyPI modules installation fails with certain error types in VPC SC environments, an additional attempt to perform the environment update operation is made using an in-cluster build. Cloud Composer 1.10.6 has reached its end of full support period.

Dataproc - Custom image limitation: New images announced in the Dataproc release notes are not available for use as the base for custom images until one week from their announcement date. The Dataproc v1beta2 APIs are deprecated. The end date of support for Dataproc image version 1.4 has been extended from August, 2021 to November, 2021. New sub-minor versions of Dataproc images: 1.3.92-debian10, 1.3.92-ubuntu18, 1.4.63-debian10, 1.4.63-ubuntu18, 1.5.38-centos8, 1.5.38-debian10, 1.5.38-ubuntu18, 2.0.12-centos8, 2.0.12-debian10, and 2.0.12-ubuntu18. Upgraded Spark version to 2.4.8 in the following images: Image 1.4 Image 1.5. Minimum boot disk sizes for Dataproc images: Image 2.0: 30GB Image 1.5: 20GB Image 1.4: 15GB Image 1.3: 15GB. Fixed stdout/stderr links on Spark History Server Web UI of the Persistent History Server in the following images: Image 1.4 Image 1.5. Fixed a bug where personal auth credentials would not propagate to every VM in the cluster if VPC service controls were enabled.

Deep Learning VM - M74 Release Re-released all CUDA 11 images to fix an issue in which VM instances are unable to detect GPU accelerators after a reboot. In Debian 10 GPU images, updated NVIDIA drivers to 460.73.01 and CUDA to 11.0.3.

Error Reporting - Error Reporting notifications has been upgraded to use the Alerting infrastructure.

Cloud Functions - Cloud Functions now logs pending queue requests abort error messages.

Cloud Healthcare API - The Cloud Healthcare API offers single-region support in the europe-west3 (Frankfurt) region. The Cloud Healthcare API offers single-region support in the asia-northeast3 (Seoul) region. The Cloud Healthcare API offers single-region support in the asia-south1 (Mumbai) region.

Google Kubernetes Engine - (2021-R22) Version updates GKE cluster versions have been updated. Microsoft published a security bulletin on a Remote code execution (RCE) vulnerability, CVE-2021-34527, that affects the print spooler in Windows servers.

GKE - (2021-R22) Version updates The following versions are now available: 1.18.18-gke.1101 1.18.18-gke.1701 1.18.19-gke.1701 1.18.19-gke.2101 1.18.20-gke.900 1.19.10-gke.1001 1.19.10-gke.1601 1.19.10-gke.1701 1.19.11-gke.1701 1.19.11-gke.2101 1.19.12-gke.700 1.20.8-gke.700 The following versions are no longer available: 1.18.18-gke.1100 1.18.18-gke.1700 1.18.19-gke.1700 1.18.19-gke.2100 1.19.10-gke.1600 1.19.10-gke.1700 1.19.11-gke.1700 1.19.11-gke.2100.

Google Kubernetes Engine Rapid - (2021-R22) Version updates Version 1.20.7-gke.2200 is now the default version.

Google Kubernetes Engine Regular - (2021-R22) Version updates Version 1.19.11-gke.1701 is now available in the Regular channel.

Google Kubernetes Engine Stable - (2021-R22) Version updates Version 1.18.19-gke.1701 is now available in the Stable channel.

Load Balancing - External TCP/UDP Network Load Balancing now allows you to configure a connection tracking policy.

Cloud Logging - The Share link feature for queries in the Logs Explorer now lets you choose whether to include an absolute time range or a relative time range. Preview: Cloud Logging now supports alerts based on matching the content of your logs.

Cloud Monitoring - Preview: Cloud Logging now supports alerts based on matching the content of your logs.

Network Connectivity Center - Network Connectivity Center now includes hard limits on the number of resources that can be linked to an individual spoke.

Cloud Spanner - The NUMERIC data type is now supported as a valid key column type, so you can now use NUMERIC type columns when specifying primary keys, foreign keys, and secondary indexes.

Cloud SQL MySQL - IAM database authentication for Cloud SQL for MySQL is now generally available.

Cloud Trace - Cloud Trace announces that the OpenTelemetry library for Java is now generally available.

Vertex AI - You can now containerize and run your training code locally by using the new gcloud beta ai custom-jobs local-run command.

If you have suggestion, feedback or link you want to share feel free to email me at zdenko@gcpweekly.com

Have a great week,

Zdenko

Older messages

GCP Newsletter #249

Monday, July 5, 2021

Welcome to issue #249 July 5th, 2021 News BigQuery Data Analytics Official Blog What's new with BigQuery ML: Unsupervised anomaly detection for time series and non-time series data BigQuery Data

GCP Newsletter #248

Monday, June 28, 2021

Welcome to issue #248 June 28th, 2021 News Cloud CDN Cloud Load Balancing Networking Official Blog HTTP/3 gets your content there QUIC, with Cloud CDN and Load Balancing - Cloud CDN and Load Balancing

GCP Newsletter #247

Monday, June 21, 2021

Welcome to issue #247 June 21st, 2021 News Compute Engine Official Blog New Tau VMs deliver leading price-performance for scale-out workloads - Compute Engine's new Tau VMs based on AMD EPYC

GCP Newsletter #246

Monday, June 14, 2021

Welcome to issue #246 June 14th, 2021 News Cloud Operations Official Blog Multi-Project Cloud Monitoring made easier - We're providing more flexibility in Cloud Monitoring by replacing Workspaces

GCP Newsletter #245

Monday, June 7, 2021

Welcome to issue #245 June 7th, 2021 News Cloud Security Command Center Official Blog Security Command Center now supports CIS 1.1 benchmarks and granular access control - Apply fine-grained access

The numbers don't lie | Act now to save on Disrupt passes

Thursday, August 5, 2021

Don't miss out on $100 savings before Friday Your Logo Disrupt Email Header. Event is September 21 to 23 Sign up to network with 10k TechCrunch enthusiasts at Disrupt Great news for budget-

A terminal dashboard for K8s, semantic grep for code, and a GitHub/GitLab alternative

Thursday, August 5, 2021

StackShare Weekly Email not displaying correctly? View it in your browser. StackShare Weekly Digest August 5th, 2021 Sponsored by CircleCI. Let CircleCI focus on CI/CD, so you can build the next big

Infographic | Visualizing the 4,000-Year History of Global Power 💪

Thursday, August 5, 2021

We examine an ambitious timeline that details the power of various civilizations going all the way back to 2000 BC TIMELESS Histomap: Visualizing the 4000 Year History of Global Power We examine an

Issue 175 - Tesla's mobile app redesign

Thursday, August 5, 2021

🎨 View this email in your browser If you are just now finding out about Tesletter, you can subscribe here! If you already know Tesletter and want to support us, check out our Patreon page If you have

 Automate The Planet- Compelling Tuesday

Thursday, August 5, 2021

Compelling Tuesday xUnit Tutorial | Part 7 | Geolocation Testing Using xUnit The last module of my XUnit course. There I discuss what Geolocation testing is and how to write such automated tests. Check

Programmer Weekly - Issue 66

Thursday, August 5, 2021

View this email in your browser Programmer Weekly Welcome to issue 66 of Programmer Weekly. Let's get straight to the links this week. From Our Sponsor Retool: The Fastest Way To Build Internal

Daily Coding Problem: Problem #486 [Medium]

Thursday, August 5, 2021

Daily Coding Problem Good morning! Here's a solution to yesterday's problem. This is your coding interview problem for today. This problem was asked by Pinterest. At a party, there is a single

New Course: Integrate Combine Into an App!

Thursday, August 5, 2021

Hey there! We have a new course for you. 🎥 Integrate Combine Into an App iOS & SWIFT • 27 MIN • INTERMEDIATE Check it out! Learn Combine in iOS by practice—while building a Chuck Norris jokes app!

Python Weekly - Issue 511

Thursday, August 5, 2021

View this email in your browser Python Weekly Welcome to issue 511 of Python Weekly. Let's get straight to the links this week. From Our Sponsor SonarLint Free and Open Source IDE Extension for

Google's quantum 'time crystal' is as weird as it sounds

Thursday, August 5, 2021

Windows 365: Hands on... ZDNet Facebook Twitter LinkedIn ZDNet Tech Today August 5, 2021 placeholder Google says it has created a time crystal in a quantum computer, and it's weirder than you can