Google Cloud Weekly - GCP Newsletter #250
Welcome to issue #250 July 12th, 2021
News
Official BlogCloud SQL for MySQL launches IAM database authentication - Simplify administration and security in Cloud SQL for MySQL with IAM database authentication, now in GA.
BigQuery Data Analytics Official BlogNew This Month in Data Analytics: Simple, Sophisticated, and Secure - We used all the hours we could in June to deliver a flurry of new features across BigQuery, Dataflow, Data Fusion, and more. Let’s take a look!
GCP Certification Official BlogLearn to code for the cloud: Earn native app development skills badges for free - Google Cloud’s new Native App Development skills challenge lets you earn badges that demonstrate your ability to create cloud-native apps.
Articles, Tutorials
Infrastructure, Networking, Security, Kubernetes
Config Connector Google Kubernetes Engine Official BlogBuild a platform with KRM: Part 5 - Manage hosted resources from Kubernetes - Learn how to manage your Google Cloud-hosted resources with GKE and Config Connector.
DevOps Networking WindowsAccidental Network Outage? Here’s How You Can Regain Access to Your Google Cloud Windows Instance - Reconnecting when Windows server is unexpectedly disconnected from the internet.
Beginner Python TerraformFirst steps in Pulumi with Python & Google Cloud Platform - Getting started with Pulumi on GCP.
App Development, Serverless, Databases, DevOps
Cloud SQL Official BlogAuthenticating to Cloud SQL for PostgreSQL with IAM service accounts - This blog post’s goal is to provide an ELI5 procedural outline of the steps that one needs to take in order to that led to perform: Configure Cloud SQL for IAM Authentication Configure a user agent to connect to a given database using assigned service account credentials.
Cloud Spanner Official BlogMeasuring Cloud Spanner performance for your workload - In this post, we will explore a middle ground to performance testing using JMeter. Performance test Cloud Spanner for a custom workload before making application code changes and executing data migration.
Cloud Firestore Official BlogAll you need to know about Firestore: A cheatsheet - Building applications is a heavy lift due to the technical complexity, which includes the complexity of backend services that are used to manage and store data. Firestore alters this by having Google Cloud manage your backend complexity through a complete backend-as-a-service!
Billing Cloud Storage GCP ExperienceSaving $30000 a month by improving Garbage Collection - Improving storage costs at Mixpanel.
Billing Cloud MonitoringCase of Cost Spike in GCP Stackdriver Monitoring - Optimizing Cloud Monitoring costs.
Cloud Run NodeJS ServerlessSession Management on Google Cloud Run with Serverless Redis - A basic web application that runs on Google Cloud Run and keeps the user sessions in Upstash Redis.
Cloud Pub/Sub NodeJSSetting Up Gmail Pub/Sub - This article is a basic walkthrough of setting up Pub/Sub notifications when new emails arrive in Gmail.
Cloud Storage Firebase NodeJS TutorialUploading an Image to Firebase Cloud Storage and returning URL with Express / Nodejs - A step by step tutorial to create and deploy web application in Firebase to upload images.
Big Data, Analytics, ML&AI
Cloud Dataproc Official BlogHow to build an open cloud datalake with Delta Lake, Presto & Dataproc Metastore - Building an Open Data Lake with Apache Spark for data processing, Presto as a query engine and Open Formats such as Delta Lake for storing all data.
Cloud Pub/Sub NodeJS PythonExploring Pub/Sub and Pub/Sub Lite - Exploring and comparing Pub/Sub and Pub/Sub Lite.
BigQuery JavascriptUsing NPM Library in Google BigQuery UDF - Javascript UDF’s are cool and using with NPM library is a whole new world to explore!
BigQuery Data AnalyticsWhy We Shouldn’t Ignore Null Values and How to Treat Them - Data cleaning using Google BigQuery SQL.
Beginner BigQuery Data ScienceWorking with Times and Dates in BigQuery - Common operations with dates in BigQuery.
BigQuery TerraformVersion control BigQuery with Terraform (with CI/CD too) - Using Terraform to version BigQuery views.
BigQuery dbtData Status Time Machine on Persisted dbt Artifacts - Storying and analyzing dbt artifacts in BigQuery.
CI Data Analytics dbtStep-by-step guide to run dbt in production with Google Cloud Platform - A step-by-step guide to run dbt in production with GCP.
BigQuery Data StudioData Layers in Data Studio - Understanding the difference between DWH data, data source, and chart data.
AI BigQuery Machine LearningUnsupervised Anomaly Detection using BigQuery ML - Three unsupervised Machine learning models provided by BigQuery ML to predict anomalies in both time series and non-time series data.
Various
GCP CertificationPassing the Google Cloud Certified Professional Architect 2021 exam - Sharing experience on the preparation for the GCP Architect certification exam and the actual exam itself.
GCP CertificationGCP Associate Cloud Engineer Exam Preparation App for iOS, android, Windows10 - GCP Associate Cloud Engineer Exam Preparation App for iOS, Android, Windows10.
GCP CertificationNotes from my beta Google Cloud Digital Leader certification exam - An overview of Cloud Digital leader certification exam.
Slides, Videos, Audio
GCP Podcast - #266 Data Analytics Launches with Bruno Aziza and Eric Schmidt.
Kubernetes Podcast - #153 Komodor, with Itiel Shwartz.
Releases
AI Platform - Deep Learning VMs - M74 Release Re-released all CUDA 11 images to fix an issue in which VM instances are unable to detect GPU accelerators after a reboot. In Debian 10 GPU images, updated NVIDIA drivers to 460.73.01 and CUDA to 11.0.3.
Anthos clusters on AWS - Anthos clusters on AWS aws-1.8.0-gke.8 is now available. This release fixes an issue mentioned in the entry on July 2, 2021. When you upgrade or update a user cluster, the Connect agent is automatically updated to the latest version.
BigQuery - BigQuery now supports materialized views without aggregation and materialized views with inner join.
Cloud Composer - Cloud Composer 1.16.9 release started on July 8, 2021. New versions of Cloud Composer images: composer-1.17.0-preview.5-airflow-2.0.1 composer-1.16.9-airflow-1.10.15 (default) composer-1.16.9-airflow-1.10.14 composer-1.16.9-airflow-1.10.12. When PyPI modules installation fails with certain error types in VPC SC environments, an additional attempt to perform the environment update operation is made using an in-cluster build. Cloud Composer 1.10.6 has reached its end of full support period.
Dataproc - Custom image limitation: New images announced in the Dataproc release notes are not available for use as the base for custom images until one week from their announcement date. The Dataproc v1beta2 APIs are deprecated. The end date of support for Dataproc image version 1.4 has been extended from August, 2021 to November, 2021. New sub-minor versions of Dataproc images: 1.3.92-debian10, 1.3.92-ubuntu18, 1.4.63-debian10, 1.4.63-ubuntu18, 1.5.38-centos8, 1.5.38-debian10, 1.5.38-ubuntu18, 2.0.12-centos8, 2.0.12-debian10, and 2.0.12-ubuntu18. Upgraded Spark version to 2.4.8 in the following images: Image 1.4 Image 1.5. Minimum boot disk sizes for Dataproc images: Image 2.0: 30GB Image 1.5: 20GB Image 1.4: 15GB Image 1.3: 15GB. Fixed stdout/stderr links on Spark History Server Web UI of the Persistent History Server in the following images: Image 1.4 Image 1.5. Fixed a bug where personal auth credentials would not propagate to every VM in the cluster if VPC service controls were enabled.
Deep Learning VM - M74 Release Re-released all CUDA 11 images to fix an issue in which VM instances are unable to detect GPU accelerators after a reboot. In Debian 10 GPU images, updated NVIDIA drivers to 460.73.01 and CUDA to 11.0.3.
Error Reporting - Error Reporting notifications has been upgraded to use the Alerting infrastructure.
Cloud Functions - Cloud Functions now logs pending queue requests abort error messages.
Cloud Healthcare API - The Cloud Healthcare API offers single-region support in the europe-west3 (Frankfurt) region. The Cloud Healthcare API offers single-region support in the asia-northeast3 (Seoul) region. The Cloud Healthcare API offers single-region support in the asia-south1 (Mumbai) region.
Google Kubernetes Engine - (2021-R22) Version updates GKE cluster versions have been updated. Microsoft published a security bulletin on a Remote code execution (RCE) vulnerability, CVE-2021-34527, that affects the print spooler in Windows servers.
GKE - (2021-R22) Version updates The following versions are now available: 1.18.18-gke.1101 1.18.18-gke.1701 1.18.19-gke.1701 1.18.19-gke.2101 1.18.20-gke.900 1.19.10-gke.1001 1.19.10-gke.1601 1.19.10-gke.1701 1.19.11-gke.1701 1.19.11-gke.2101 1.19.12-gke.700 1.20.8-gke.700 The following versions are no longer available: 1.18.18-gke.1100 1.18.18-gke.1700 1.18.19-gke.1700 1.18.19-gke.2100 1.19.10-gke.1600 1.19.10-gke.1700 1.19.11-gke.1700 1.19.11-gke.2100.
Google Kubernetes Engine Rapid - (2021-R22) Version updates Version 1.20.7-gke.2200 is now the default version.
Google Kubernetes Engine Regular - (2021-R22) Version updates Version 1.19.11-gke.1701 is now available in the Regular channel.
Google Kubernetes Engine Stable - (2021-R22) Version updates Version 1.18.19-gke.1701 is now available in the Stable channel.
Load Balancing - External TCP/UDP Network Load Balancing now allows you to configure a connection tracking policy.
Cloud Logging - The Share link feature for queries in the Logs Explorer now lets you choose whether to include an absolute time range or a relative time range. Preview: Cloud Logging now supports alerts based on matching the content of your logs.
Cloud Monitoring - Preview: Cloud Logging now supports alerts based on matching the content of your logs.
Network Connectivity Center - Network Connectivity Center now includes hard limits on the number of resources that can be linked to an individual spoke.
Cloud Spanner - The NUMERIC data type is now supported as a valid key column type, so you can now use NUMERIC type columns when specifying primary keys, foreign keys, and secondary indexes.
Cloud SQL MySQL - IAM database authentication for Cloud SQL for MySQL is now generally available.
Cloud Trace - Cloud Trace announces that the OpenTelemetry library for Java is now generally available.
Vertex AI - You can now containerize and run your training code locally by using the new gcloud beta ai custom-jobs local-run command.
If you have suggestion, feedback or link you want to share feel free to email me at zdenko@gcpweekly.com
Have a great week,
Zdenko
Older messages
GCP Newsletter #249
Monday, July 5, 2021
Welcome to issue #249 July 5th, 2021 News BigQuery Data Analytics Official Blog What's new with BigQuery ML: Unsupervised anomaly detection for time series and non-time series data BigQuery Data
GCP Newsletter #248
Monday, June 28, 2021
Welcome to issue #248 June 28th, 2021 News Cloud CDN Cloud Load Balancing Networking Official Blog HTTP/3 gets your content there QUIC, with Cloud CDN and Load Balancing - Cloud CDN and Load Balancing
GCP Newsletter #247
Monday, June 21, 2021
Welcome to issue #247 June 21st, 2021 News Compute Engine Official Blog New Tau VMs deliver leading price-performance for scale-out workloads - Compute Engine's new Tau VMs based on AMD EPYC
GCP Newsletter #246
Monday, June 14, 2021
Welcome to issue #246 June 14th, 2021 News Cloud Operations Official Blog Multi-Project Cloud Monitoring made easier - We're providing more flexibility in Cloud Monitoring by replacing Workspaces
GCP Newsletter #245
Monday, June 7, 2021
Welcome to issue #245 June 7th, 2021 News Cloud Security Command Center Official Blog Security Command Center now supports CIS 1.1 benchmarks and granular access control - Apply fine-grained access
You Might Also Like
Re: Last Chance
Friday, March 29, 2024
Dear there, By this time tomorrow, your exclusive new subscriber discount will be gone and you'll have to pay twice as much to join Insider and master everything your iPhone has to offer. If, like
Hacker Newsletter #694
Friday, March 29, 2024
Always forgive your enemies - nothing annoys them so much. //Oscar Wilde hackernewsletter Issue #694 // 2024-03-29 // View in your browser Happy Easter if you celebrate it! Heads up - we're taking
Apple RCS 📱, SBF's 25 year sentence 👮, Linux Foundation's Redis fork 👨💻
Friday, March 29, 2024
RCS is coming to the iPhone in the fall of 2024 Sign Up|Advertise|View Online TLDR Together With Veracode TLDR 2024-03-29 Build fast, build secure (Sponsor) Software is drowning in security debt.
Data Science Weekly - Issue 540
Friday, March 29, 2024
Curated news, articles and jobs related to Data Science, AI, & Machine Learning ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏
This Week in Rust #540
Friday, March 29, 2024
Email isn't displaying correctly? Read this e-mail on the Web This Week in Rust issue 540 — 27 MAR 2024 Hello and welcome to another issue of This Week in Rust! Rust is a programming language
The Value Of A Promise 🤞
Friday, March 29, 2024
How much is a promise from a tech company really worth, anyway? Here's a version for your browser. Hunting for the end of the long tail • March 28, 2024 The Value Of A Promise When you hear a
New Elastic Security for SIEM Training Course
Friday, March 29, 2024
Detect and respond to evolving threats ㅤㅤㅤㅤㅤㅤㅤㅤㅤㅤㅤㅤㅤㅤㅤㅤㅤㅤㅤㅤㅤㅤㅤㅤㅤㅤ ㅤㅤㅤㅤㅤㅤㅤㅤㅤㅤㅤㅤㅤㅤㅤㅤㅤㅤㅤㅤㅤㅤㅤㅤㅤㅤ ㅤㅤㅤㅤㅤㅤㅤㅤㅤㅤㅤㅤㅤㅤㅤㅤㅤㅤㅤㅤㅤㅤㅤㅤㅤㅤ elastic | Search. Observe. Protect Detect anomalies and malicious behavior March
SBF gets 25 years
Thursday, March 28, 2024
Sam Bankman-Fried is sentenced View this email online in your browser By Christine Hall Thursday, March 28, 2024 Welcome back to TechCrunch PM! The editorial team spent a chunk of the day discussing
💎 Issue 410 - Being laid off in 2023-2024 as an early-career developer
Thursday, March 28, 2024
This week's Awesome Ruby Newsletter Read this email on the Web The Awesome Ruby Newsletter Issue » 410 Release Date Mar 28, 2024 Your weekly report of the most popular Ruby news, articles and
💻 Issue 403 - Microsoft defends .NET 9 features competing with open source ecosystem
Thursday, March 28, 2024
This week's Awesome .NET Weekly Read this email on the Web The Awesome .NET Weekly Issue » 403 Release Date Mar 28, 2024 Your weekly report of the most popular .NET news, articles and projects