Google Cloud Weekly - GCP Newsletter #250

Welcome to issue #250 July 12th, 2021

News

Official Blog

Cloud SQL for MySQL launches IAM database authentication - Simplify administration and security in Cloud SQL for MySQL with IAM database authentication, now in GA.

BigQuery Data Analytics Official Blog

New This Month in Data Analytics: Simple, Sophisticated, and Secure - We used all the hours we could in June to deliver a flurry of new features across BigQuery, Dataflow, Data Fusion, and more. Let’s take a look!

GCP Certification Official Blog

Learn to code for the cloud: Earn native app development skills badges for free - Google Cloud’s new Native App Development skills challenge lets you earn badges that demonstrate your ability to create cloud-native apps.

 

Articles, Tutorials

Infrastructure, Networking, Security, Kubernetes

Config Connector Google Kubernetes Engine Official Blog

Build a platform with KRM: Part 5 - Manage hosted resources from Kubernetes - Learn how to manage your Google Cloud-hosted resources with GKE and Config Connector.

DevOps Networking Windows

Accidental Network Outage? Here’s How You Can Regain Access to Your Google Cloud Windows Instance - Reconnecting when Windows server is unexpectedly disconnected from the internet.

Beginner Python Terraform

First steps in Pulumi with Python & Google Cloud Platform - Getting started with Pulumi on GCP.

App Development, Serverless, Databases, DevOps

Cloud SQL Official Blog

Authenticating to Cloud SQL for PostgreSQL with IAM service accounts - This blog post’s goal is to provide an ELI5 procedural outline of the steps that one needs to take in order to that led to perform: Configure Cloud SQL for IAM Authentication Configure a user agent to connect to a given database using assigned service account credentials.

Cloud Spanner Official Blog

Measuring Cloud Spanner performance for your workload - In this post, we will explore a middle ground to performance testing using JMeter. Performance test Cloud Spanner for a custom workload before making application code changes and executing data migration.

Cloud Firestore Official Blog

All you need to know about Firestore: A cheatsheet - Building applications is a heavy lift due to the technical complexity, which includes the complexity of backend services that are used to manage and store data. Firestore alters this by having Google Cloud manage your backend complexity through a complete backend-as-a-service!

Billing Cloud Storage GCP Experience

Saving $30000 a month by improving Garbage Collection - Improving storage costs at Mixpanel.

Billing Cloud Monitoring

Case of Cost Spike in GCP Stackdriver Monitoring - Optimizing Cloud Monitoring costs.

Cloud Run NodeJS Serverless

Session Management on Google Cloud Run with Serverless Redis - A basic web application that runs on Google Cloud Run and keeps the user sessions in Upstash Redis.

Cloud Pub/Sub NodeJS

Setting Up Gmail Pub/Sub - This article is a basic walkthrough of setting up Pub/Sub notifications when new emails arrive in Gmail.

Cloud Storage Firebase NodeJS Tutorial

Uploading an Image to Firebase Cloud Storage and returning URL with Express / Nodejs - A step by step tutorial to create and deploy web application in Firebase to upload images.

Big Data, Analytics, ML&AI

Cloud Dataproc Official Blog

How to build an open cloud datalake with Delta Lake, Presto & Dataproc Metastore - Building an Open Data Lake with Apache Spark for data processing, Presto as a query engine and Open Formats such as Delta Lake for storing all data.

Cloud Pub/Sub NodeJS Python

Exploring Pub/Sub and Pub/Sub Lite - Exploring and comparing Pub/Sub and Pub/Sub Lite.

BigQuery Javascript

Using NPM Library in Google BigQuery UDF - Javascript UDF’s are cool and using with NPM library is a whole new world to explore!

BigQuery Data Analytics

Why We Shouldn’t Ignore Null Values and How to Treat Them - Data cleaning using Google BigQuery SQL.

Beginner BigQuery Data Science

Working with Times and Dates in BigQuery - Common operations with dates in BigQuery.

BigQuery Terraform

Version control BigQuery with Terraform (with CI/CD too) - Using Terraform to version BigQuery views.

BigQuery dbt

Data Status Time Machine on Persisted dbt Artifacts - Storying and analyzing dbt artifacts in BigQuery.

CI Data Analytics dbt

Step-by-step guide to run dbt in production with Google Cloud Platform - A step-by-step guide to run dbt in production with GCP.

BigQuery Data Studio

Data Layers in Data Studio - Understanding the difference between DWH data, data source, and chart data.

AI BigQuery Machine Learning

Unsupervised Anomaly Detection using BigQuery ML - Three unsupervised Machine learning models provided by BigQuery ML to predict anomalies in both time series and non-time series data.

Various

GCP Certification

Passing the Google Cloud Certified Professional Architect 2021 exam - Sharing experience on the preparation for the GCP Architect certification exam and the actual exam itself.

GCP Certification

GCP Associate Cloud Engineer Exam Preparation App for iOS, android, Windows10 - GCP Associate Cloud Engineer Exam Preparation App for iOS, Android, Windows10.

GCP Certification

Notes from my beta Google Cloud Digital Leader certification exam - An overview of Cloud Digital leader certification exam.

Slides, Videos, Audio

GCP Podcast - #266 Data Analytics Launches with Bruno Aziza and Eric Schmidt.

Kubernetes Podcast - #153 Komodor, with Itiel Shwartz.

 

Releases

AI Platform - Deep Learning VMs - M74 Release Re-released all CUDA 11 images to fix an issue in which VM instances are unable to detect GPU accelerators after a reboot. In Debian 10 GPU images, updated NVIDIA drivers to 460.73.01 and CUDA to 11.0.3.

Anthos clusters on AWS - Anthos clusters on AWS aws-1.8.0-gke.8 is now available. This release fixes an issue mentioned in the entry on July 2, 2021. When you upgrade or update a user cluster, the Connect agent is automatically updated to the latest version.

BigQuery - BigQuery now supports materialized views without aggregation and materialized views with inner join.

Cloud Composer - Cloud Composer 1.16.9 release started on July 8, 2021. New versions of Cloud Composer images: composer-1.17.0-preview.5-airflow-2.0.1 composer-1.16.9-airflow-1.10.15 (default) composer-1.16.9-airflow-1.10.14 composer-1.16.9-airflow-1.10.12. When PyPI modules installation fails with certain error types in VPC SC environments, an additional attempt to perform the environment update operation is made using an in-cluster build. Cloud Composer 1.10.6 has reached its end of full support period.

Dataproc - Custom image limitation: New images announced in the Dataproc release notes are not available for use as the base for custom images until one week from their announcement date. The Dataproc v1beta2 APIs are deprecated. The end date of support for Dataproc image version 1.4 has been extended from August, 2021 to November, 2021. New sub-minor versions of Dataproc images: 1.3.92-debian10, 1.3.92-ubuntu18, 1.4.63-debian10, 1.4.63-ubuntu18, 1.5.38-centos8, 1.5.38-debian10, 1.5.38-ubuntu18, 2.0.12-centos8, 2.0.12-debian10, and 2.0.12-ubuntu18. Upgraded Spark version to 2.4.8 in the following images: Image 1.4 Image 1.5. Minimum boot disk sizes for Dataproc images: Image 2.0: 30GB Image 1.5: 20GB Image 1.4: 15GB Image 1.3: 15GB. Fixed stdout/stderr links on Spark History Server Web UI of the Persistent History Server in the following images: Image 1.4 Image 1.5. Fixed a bug where personal auth credentials would not propagate to every VM in the cluster if VPC service controls were enabled.

Deep Learning VM - M74 Release Re-released all CUDA 11 images to fix an issue in which VM instances are unable to detect GPU accelerators after a reboot. In Debian 10 GPU images, updated NVIDIA drivers to 460.73.01 and CUDA to 11.0.3.

Error Reporting - Error Reporting notifications has been upgraded to use the Alerting infrastructure.

Cloud Functions - Cloud Functions now logs pending queue requests abort error messages.

Cloud Healthcare API - The Cloud Healthcare API offers single-region support in the europe-west3 (Frankfurt) region. The Cloud Healthcare API offers single-region support in the asia-northeast3 (Seoul) region. The Cloud Healthcare API offers single-region support in the asia-south1 (Mumbai) region.

Google Kubernetes Engine - (2021-R22) Version updates GKE cluster versions have been updated. Microsoft published a security bulletin on a Remote code execution (RCE) vulnerability, CVE-2021-34527, that affects the print spooler in Windows servers.

GKE - (2021-R22) Version updates The following versions are now available: 1.18.18-gke.1101 1.18.18-gke.1701 1.18.19-gke.1701 1.18.19-gke.2101 1.18.20-gke.900 1.19.10-gke.1001 1.19.10-gke.1601 1.19.10-gke.1701 1.19.11-gke.1701 1.19.11-gke.2101 1.19.12-gke.700 1.20.8-gke.700 The following versions are no longer available: 1.18.18-gke.1100 1.18.18-gke.1700 1.18.19-gke.1700 1.18.19-gke.2100 1.19.10-gke.1600 1.19.10-gke.1700 1.19.11-gke.1700 1.19.11-gke.2100.

Google Kubernetes Engine Rapid - (2021-R22) Version updates Version 1.20.7-gke.2200 is now the default version.

Google Kubernetes Engine Regular - (2021-R22) Version updates Version 1.19.11-gke.1701 is now available in the Regular channel.

Google Kubernetes Engine Stable - (2021-R22) Version updates Version 1.18.19-gke.1701 is now available in the Stable channel.

Load Balancing - External TCP/UDP Network Load Balancing now allows you to configure a connection tracking policy.

Cloud Logging - The Share link feature for queries in the Logs Explorer now lets you choose whether to include an absolute time range or a relative time range. Preview: Cloud Logging now supports alerts based on matching the content of your logs.

Cloud Monitoring - Preview: Cloud Logging now supports alerts based on matching the content of your logs.

Network Connectivity Center - Network Connectivity Center now includes hard limits on the number of resources that can be linked to an individual spoke.

Cloud Spanner - The NUMERIC data type is now supported as a valid key column type, so you can now use NUMERIC type columns when specifying primary keys, foreign keys, and secondary indexes.

Cloud SQL MySQL - IAM database authentication for Cloud SQL for MySQL is now generally available.

Cloud Trace - Cloud Trace announces that the OpenTelemetry library for Java is now generally available.

Vertex AI - You can now containerize and run your training code locally by using the new gcloud beta ai custom-jobs local-run command.

If you have suggestion, feedback or link you want to share feel free to email me at zdenko@gcpweekly.com

Have a great week,

Zdenko

Older messages

GCP Newsletter #249

Monday, July 5, 2021

Welcome to issue #249 July 5th, 2021 News BigQuery Data Analytics Official Blog What's new with BigQuery ML: Unsupervised anomaly detection for time series and non-time series data BigQuery Data

GCP Newsletter #248

Monday, June 28, 2021

Welcome to issue #248 June 28th, 2021 News Cloud CDN Cloud Load Balancing Networking Official Blog HTTP/3 gets your content there QUIC, with Cloud CDN and Load Balancing - Cloud CDN and Load Balancing

GCP Newsletter #247

Monday, June 21, 2021

Welcome to issue #247 June 21st, 2021 News Compute Engine Official Blog New Tau VMs deliver leading price-performance for scale-out workloads - Compute Engine's new Tau VMs based on AMD EPYC

GCP Newsletter #246

Monday, June 14, 2021

Welcome to issue #246 June 14th, 2021 News Cloud Operations Official Blog Multi-Project Cloud Monitoring made easier - We're providing more flexibility in Cloud Monitoring by replacing Workspaces

GCP Newsletter #245

Monday, June 7, 2021

Welcome to issue #245 June 7th, 2021 News Cloud Security Command Center Official Blog Security Command Center now supports CIS 1.1 benchmarks and granular access control - Apply fine-grained access

You Might Also Like

Re: Last Chance

Friday, March 29, 2024

Dear there, By this time tomorrow, your exclusive new subscriber discount will be gone and you'll have to pay twice as much to join Insider and master everything your iPhone has to offer. If, like

Hacker Newsletter #694

Friday, March 29, 2024

Always forgive your enemies - nothing annoys them so much. //Oscar Wilde hackernewsletter Issue #694 // 2024-03-29 // View in your browser Happy Easter if you celebrate it! Heads up - we're taking

Apple RCS 📱, SBF's 25 year sentence 👮, Linux Foundation's Redis fork 👨‍💻

Friday, March 29, 2024

RCS is coming to the iPhone in the fall of 2024 Sign Up|Advertise|View Online TLDR Together With Veracode TLDR 2024-03-29 Build fast, build secure (Sponsor) Software is drowning in security debt.

Data Science Weekly - Issue 540

Friday, March 29, 2024

Curated news, articles and jobs related to Data Science, AI, & Machine Learning ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏

This Week in Rust #540

Friday, March 29, 2024

Email isn't displaying correctly? Read this e-mail on the Web This Week in Rust issue 540 — 27 MAR 2024 Hello and welcome to another issue of This Week in Rust! Rust is a programming language

The Value Of A Promise 🤞

Friday, March 29, 2024

How much is a promise from a tech company really worth, anyway? Here's a version for your browser. Hunting for the end of the long tail • March 28, 2024 The Value Of A Promise When you hear a

New Elastic Security for SIEM Training Course

Friday, March 29, 2024

Detect and respond to evolving threats ㅤㅤㅤㅤㅤㅤㅤㅤㅤㅤㅤㅤㅤㅤㅤㅤㅤㅤㅤㅤㅤㅤㅤㅤㅤㅤ ㅤㅤㅤㅤㅤㅤㅤㅤㅤㅤㅤㅤㅤㅤㅤㅤㅤㅤㅤㅤㅤㅤㅤㅤㅤㅤ ㅤㅤㅤㅤㅤㅤㅤㅤㅤㅤㅤㅤㅤㅤㅤㅤㅤㅤㅤㅤㅤㅤㅤㅤㅤㅤ elastic | Search. Observe. Protect Detect anomalies and malicious behavior March

SBF gets 25 years 

Thursday, March 28, 2024

Sam Bankman-Fried is sentenced View this email online in your browser By Christine Hall Thursday, March 28, 2024 Welcome back to TechCrunch PM! The editorial team spent a chunk of the day discussing

💎 Issue 410 - Being laid off in 2023-2024 as an early-career developer

Thursday, March 28, 2024

This week's Awesome Ruby Newsletter Read this email on the Web The Awesome Ruby Newsletter Issue » 410 Release Date Mar 28, 2024 Your weekly report of the most popular Ruby news, articles and

💻 Issue 403 - Microsoft defends .NET 9 features competing with open source ecosystem

Thursday, March 28, 2024

This week's Awesome .NET Weekly Read this email on the Web The Awesome .NET Weekly Issue » 403 Release Date Mar 28, 2024 Your weekly report of the most popular .NET news, articles and projects