Google Cloud Weekly - GCP Newsletter #250
Welcome to issue #250 July 12th, 2021
News
Official BlogCloud SQL for MySQL launches IAM database authentication - Simplify administration and security in Cloud SQL for MySQL with IAM database authentication, now in GA.
BigQuery Data Analytics Official BlogNew This Month in Data Analytics: Simple, Sophisticated, and Secure - We used all the hours we could in June to deliver a flurry of new features across BigQuery, Dataflow, Data Fusion, and more. Let’s take a look!
GCP Certification Official BlogLearn to code for the cloud: Earn native app development skills badges for free - Google Cloud’s new Native App Development skills challenge lets you earn badges that demonstrate your ability to create cloud-native apps.
Articles, Tutorials
Infrastructure, Networking, Security, Kubernetes
Config Connector Google Kubernetes Engine Official BlogBuild a platform with KRM: Part 5 - Manage hosted resources from Kubernetes - Learn how to manage your Google Cloud-hosted resources with GKE and Config Connector.
DevOps Networking WindowsAccidental Network Outage? Here’s How You Can Regain Access to Your Google Cloud Windows Instance - Reconnecting when Windows server is unexpectedly disconnected from the internet.
Beginner Python TerraformFirst steps in Pulumi with Python & Google Cloud Platform - Getting started with Pulumi on GCP.
App Development, Serverless, Databases, DevOps
Cloud SQL Official BlogAuthenticating to Cloud SQL for PostgreSQL with IAM service accounts - This blog post’s goal is to provide an ELI5 procedural outline of the steps that one needs to take in order to that led to perform: Configure Cloud SQL for IAM Authentication Configure a user agent to connect to a given database using assigned service account credentials.
Cloud Spanner Official BlogMeasuring Cloud Spanner performance for your workload - In this post, we will explore a middle ground to performance testing using JMeter. Performance test Cloud Spanner for a custom workload before making application code changes and executing data migration.
Cloud Firestore Official BlogAll you need to know about Firestore: A cheatsheet - Building applications is a heavy lift due to the technical complexity, which includes the complexity of backend services that are used to manage and store data. Firestore alters this by having Google Cloud manage your backend complexity through a complete backend-as-a-service!
Billing Cloud Storage GCP ExperienceSaving $30000 a month by improving Garbage Collection - Improving storage costs at Mixpanel.
Billing Cloud MonitoringCase of Cost Spike in GCP Stackdriver Monitoring - Optimizing Cloud Monitoring costs.
Cloud Run NodeJS ServerlessSession Management on Google Cloud Run with Serverless Redis - A basic web application that runs on Google Cloud Run and keeps the user sessions in Upstash Redis.
Cloud Pub/Sub NodeJSSetting Up Gmail Pub/Sub - This article is a basic walkthrough of setting up Pub/Sub notifications when new emails arrive in Gmail.
Cloud Storage Firebase NodeJS TutorialUploading an Image to Firebase Cloud Storage and returning URL with Express / Nodejs - A step by step tutorial to create and deploy web application in Firebase to upload images.
Big Data, Analytics, ML&AI
Cloud Dataproc Official BlogHow to build an open cloud datalake with Delta Lake, Presto & Dataproc Metastore - Building an Open Data Lake with Apache Spark for data processing, Presto as a query engine and Open Formats such as Delta Lake for storing all data.
Cloud Pub/Sub NodeJS PythonExploring Pub/Sub and Pub/Sub Lite - Exploring and comparing Pub/Sub and Pub/Sub Lite.
BigQuery JavascriptUsing NPM Library in Google BigQuery UDF - Javascript UDF’s are cool and using with NPM library is a whole new world to explore!
BigQuery Data AnalyticsWhy We Shouldn’t Ignore Null Values and How to Treat Them - Data cleaning using Google BigQuery SQL.
Beginner BigQuery Data ScienceWorking with Times and Dates in BigQuery - Common operations with dates in BigQuery.
BigQuery TerraformVersion control BigQuery with Terraform (with CI/CD too) - Using Terraform to version BigQuery views.
BigQuery dbtData Status Time Machine on Persisted dbt Artifacts - Storying and analyzing dbt artifacts in BigQuery.
CI Data Analytics dbtStep-by-step guide to run dbt in production with Google Cloud Platform - A step-by-step guide to run dbt in production with GCP.
BigQuery Data StudioData Layers in Data Studio - Understanding the difference between DWH data, data source, and chart data.
AI BigQuery Machine LearningUnsupervised Anomaly Detection using BigQuery ML - Three unsupervised Machine learning models provided by BigQuery ML to predict anomalies in both time series and non-time series data.
Various
GCP CertificationPassing the Google Cloud Certified Professional Architect 2021 exam - Sharing experience on the preparation for the GCP Architect certification exam and the actual exam itself.
GCP CertificationGCP Associate Cloud Engineer Exam Preparation App for iOS, android, Windows10 - GCP Associate Cloud Engineer Exam Preparation App for iOS, Android, Windows10.
GCP CertificationNotes from my beta Google Cloud Digital Leader certification exam - An overview of Cloud Digital leader certification exam.
Slides, Videos, Audio
GCP Podcast - #266 Data Analytics Launches with Bruno Aziza and Eric Schmidt.
Kubernetes Podcast - #153 Komodor, with Itiel Shwartz.
Releases
AI Platform - Deep Learning VMs - M74 Release Re-released all CUDA 11 images to fix an issue in which VM instances are unable to detect GPU accelerators after a reboot. In Debian 10 GPU images, updated NVIDIA drivers to 460.73.01 and CUDA to 11.0.3.
Anthos clusters on AWS - Anthos clusters on AWS aws-1.8.0-gke.8 is now available. This release fixes an issue mentioned in the entry on July 2, 2021. When you upgrade or update a user cluster, the Connect agent is automatically updated to the latest version.
BigQuery - BigQuery now supports materialized views without aggregation and materialized views with inner join.
Cloud Composer - Cloud Composer 1.16.9 release started on July 8, 2021. New versions of Cloud Composer images: composer-1.17.0-preview.5-airflow-2.0.1 composer-1.16.9-airflow-1.10.15 (default) composer-1.16.9-airflow-1.10.14 composer-1.16.9-airflow-1.10.12. When PyPI modules installation fails with certain error types in VPC SC environments, an additional attempt to perform the environment update operation is made using an in-cluster build. Cloud Composer 1.10.6 has reached its end of full support period.
Dataproc - Custom image limitation: New images announced in the Dataproc release notes are not available for use as the base for custom images until one week from their announcement date. The Dataproc v1beta2 APIs are deprecated. The end date of support for Dataproc image version 1.4 has been extended from August, 2021 to November, 2021. New sub-minor versions of Dataproc images: 1.3.92-debian10, 1.3.92-ubuntu18, 1.4.63-debian10, 1.4.63-ubuntu18, 1.5.38-centos8, 1.5.38-debian10, 1.5.38-ubuntu18, 2.0.12-centos8, 2.0.12-debian10, and 2.0.12-ubuntu18. Upgraded Spark version to 2.4.8 in the following images: Image 1.4 Image 1.5. Minimum boot disk sizes for Dataproc images: Image 2.0: 30GB Image 1.5: 20GB Image 1.4: 15GB Image 1.3: 15GB. Fixed stdout/stderr links on Spark History Server Web UI of the Persistent History Server in the following images: Image 1.4 Image 1.5. Fixed a bug where personal auth credentials would not propagate to every VM in the cluster if VPC service controls were enabled.
Deep Learning VM - M74 Release Re-released all CUDA 11 images to fix an issue in which VM instances are unable to detect GPU accelerators after a reboot. In Debian 10 GPU images, updated NVIDIA drivers to 460.73.01 and CUDA to 11.0.3.
Error Reporting - Error Reporting notifications has been upgraded to use the Alerting infrastructure.
Cloud Functions - Cloud Functions now logs pending queue requests abort error messages.
Cloud Healthcare API - The Cloud Healthcare API offers single-region support in the europe-west3 (Frankfurt) region. The Cloud Healthcare API offers single-region support in the asia-northeast3 (Seoul) region. The Cloud Healthcare API offers single-region support in the asia-south1 (Mumbai) region.
Google Kubernetes Engine - (2021-R22) Version updates GKE cluster versions have been updated. Microsoft published a security bulletin on a Remote code execution (RCE) vulnerability, CVE-2021-34527, that affects the print spooler in Windows servers.
GKE - (2021-R22) Version updates The following versions are now available: 1.18.18-gke.1101 1.18.18-gke.1701 1.18.19-gke.1701 1.18.19-gke.2101 1.18.20-gke.900 1.19.10-gke.1001 1.19.10-gke.1601 1.19.10-gke.1701 1.19.11-gke.1701 1.19.11-gke.2101 1.19.12-gke.700 1.20.8-gke.700 The following versions are no longer available: 1.18.18-gke.1100 1.18.18-gke.1700 1.18.19-gke.1700 1.18.19-gke.2100 1.19.10-gke.1600 1.19.10-gke.1700 1.19.11-gke.1700 1.19.11-gke.2100.
Google Kubernetes Engine Rapid - (2021-R22) Version updates Version 1.20.7-gke.2200 is now the default version.
Google Kubernetes Engine Regular - (2021-R22) Version updates Version 1.19.11-gke.1701 is now available in the Regular channel.
Google Kubernetes Engine Stable - (2021-R22) Version updates Version 1.18.19-gke.1701 is now available in the Stable channel.
Load Balancing - External TCP/UDP Network Load Balancing now allows you to configure a connection tracking policy.
Cloud Logging - The Share link feature for queries in the Logs Explorer now lets you choose whether to include an absolute time range or a relative time range. Preview: Cloud Logging now supports alerts based on matching the content of your logs.
Cloud Monitoring - Preview: Cloud Logging now supports alerts based on matching the content of your logs.
Network Connectivity Center - Network Connectivity Center now includes hard limits on the number of resources that can be linked to an individual spoke.
Cloud Spanner - The NUMERIC data type is now supported as a valid key column type, so you can now use NUMERIC type columns when specifying primary keys, foreign keys, and secondary indexes.
Cloud SQL MySQL - IAM database authentication for Cloud SQL for MySQL is now generally available.
Cloud Trace - Cloud Trace announces that the OpenTelemetry library for Java is now generally available.
Vertex AI - You can now containerize and run your training code locally by using the new gcloud beta ai custom-jobs local-run command.
If you have suggestion, feedback or link you want to share feel free to email me at zdenko@gcpweekly.com
Have a great week,
Zdenko
Older messages
GCP Newsletter #249
Monday, July 5, 2021
Welcome to issue #249 July 5th, 2021 News BigQuery Data Analytics Official Blog What's new with BigQuery ML: Unsupervised anomaly detection for time series and non-time series data BigQuery Data
GCP Newsletter #248
Monday, June 28, 2021
Welcome to issue #248 June 28th, 2021 News Cloud CDN Cloud Load Balancing Networking Official Blog HTTP/3 gets your content there QUIC, with Cloud CDN and Load Balancing - Cloud CDN and Load Balancing
GCP Newsletter #247
Monday, June 21, 2021
Welcome to issue #247 June 21st, 2021 News Compute Engine Official Blog New Tau VMs deliver leading price-performance for scale-out workloads - Compute Engine's new Tau VMs based on AMD EPYC
GCP Newsletter #246
Monday, June 14, 2021
Welcome to issue #246 June 14th, 2021 News Cloud Operations Official Blog Multi-Project Cloud Monitoring made easier - We're providing more flexibility in Cloud Monitoring by replacing Workspaces
GCP Newsletter #245
Monday, June 7, 2021
Welcome to issue #245 June 7th, 2021 News Cloud Security Command Center Official Blog Security Command Center now supports CIS 1.1 benchmarks and granular access control - Apply fine-grained access
You Might Also Like
Import AI 399: 1,000 samples to make a reasoning model; DeepSeek proliferation; Apple's self-driving car simulator
Friday, February 14, 2025
What came before the golem? ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏
Defining Your Paranoia Level: Navigating Change Without the Overkill
Friday, February 14, 2025
We've all been there: trying to learn something new, only to find our old habits holding us back. We discussed today how our gut feelings about solving problems can sometimes be our own worst enemy
5 ways AI can help with taxes 🪄
Friday, February 14, 2025
Remotely control an iPhone; 💸 50+ early Presidents' Day deals -- ZDNET ZDNET Tech Today - US February 10, 2025 5 ways AI can help you with your taxes (and what not to use it for) 5 ways AI can help
Recurring Automations + Secret Updates
Friday, February 14, 2025
Smarter automations, better templates, and hidden updates to explore 👀 ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏
The First Provable AI-Proof Game: Introducing Butterfly Wings 4
Friday, February 14, 2025
Top Tech Content sent at Noon! Boost Your Article on HackerNoon for $159.99! Read this email in your browser How are you, @newsletterest1? undefined The Market Today #01 Instagram (Meta) 714.52 -0.32%
GCP Newsletter #437
Friday, February 14, 2025
Welcome to issue #437 February 10th, 2025 News BigQuery Cloud Marketplace Official Blog Partners BigQuery datasets now available on Google Cloud Marketplace - Google Cloud Marketplace now offers
Charted | The 1%'s Share of U.S. Wealth Over Time (1989-2024) 💰
Friday, February 14, 2025
Discover how the share of US wealth held by the top 1% has evolved from 1989 to 2024 in this infographic. View Online | Subscribe | Download Our App Download our app to see thousands of new charts from
The Great Social Media Diaspora & Tapestry is here
Friday, February 14, 2025
Apple introduces new app called 'Apple Invites', The Iconfactory launches Tapestry, beyond the traditional portfolio, and more in this week's issue of Creativerly. Creativerly The Great
Daily Coding Problem: Problem #1689 [Medium]
Friday, February 14, 2025
Daily Coding Problem Good morning! Here's your coding interview problem for today. This problem was asked by Google. Given a linked list, sort it in O(n log n) time and constant space. For example,
📧 Stop Conflating CQRS and MediatR
Friday, February 14, 2025
Stop Conflating CQRS and MediatR Read on: my website / Read time: 4 minutes The .NET Weekly is brought to you by: Step right up to the Generative AI Use Cases Repository! See how MongoDB powers your