Welcome to issue #224 January 11th, 2021

News

Find logs fast with new “tail -f” functionality in Cloud Logging - Now, you can troubleshoot your Google Cloud logs in real-time with Cloud Logging’s new “tail -f”-like functionality.

Articles, Tutorials

Infrastructure, Networking, Security, Kubernetes

Exploring Cloud Build, Source Repository plugin in Jenkins w/ Gitlab as SCM - Jenkins plugin for Cloud Build, Source Repo and Gitlab — CICD in GCP.

GKE private cluster with a bastion host - Leaving GKE cluster opened for access from internet poses a security risk. Layering security to multiple level improves security posture.

Choosing Service or User or Impersonated Credentials For Google APIs - This article focuses on administration and security concepts that illustrate the power of and remove the myths around choosing credentials for Google API calls.

GKE with Istio and Config sync - Google cloud has a great product called Anthos. Its best feature is able to span the Kubernetes engine cluster to other cloud providers or….

Create a Data Studio dashboard to monitor VPC-SC violations on your Google Cloud Organization - Fixing VPC Service Control violations and creating a dashboard for monitoring.

App Development, Serverless, Databases, DevOps

RStudio Server on GCP: the right way - This quick tutorial details how to install an RStudio Server on a Google Cloud Virtual Machine and how to easily enable remote access in a secure manner through SSH port forwarding.

The Magic Of Distributed Joins in Cloud Spanner - How do you join two tables when both of them are divided into multiple splits managed by multiple different machines? In this blog entry, we'll describe distributed joins using the Distributed Cross Apply (DCA) operator.

Behind the scenes of Cloud Spanner’s ExecuteQuery request - What happens when an application executes a query against Cloud Spanner? This post is going to shed some light on the magic that happens behind the scenes. How does Spanner take an arbitrary SQL statement, locate the data, and return the response in milliseconds? We will take some of the concepts described in SIGMOD’17 paper and explain, step by step, how the execution occurs.

Cloud SQL with private IP only: the Good, the Bad and the Ugly - To remove private IP on the database is a legacy pattern. Cloud SQL and its proxy allow to go beyond and always secured.

How to code review security rules - This post will walk through how to approach reviewing and giving good feedback on Security Rules in Firebase.

Firebase hosting: Production and Staging environment with Cloudbuild - Firebase deployments with Cloud Build.

Building a Fully Automated, Scalable, Cost Efficient and Performant Web Infrastructure for 2021 - Part 1: Setting Up Locally.

Create a Cloud Run service and https load balancer with Pulumi - Options to set a custom domain to Cloud Run.

CI/CD for Cloud Run with Terraform - How to automate GCP Cloud Run setup with Terraform Cloud (Parts 1& 2).

Production-Scale IoT Best Practices: Implementation with GCP (Part 1/3) - How to securely register millions of IoT devices streaming telemetry data to your Google Cloud environment.

Watch Google Bucket with Elixir: Google Cloud Storage + PubSub + Elixir Broadway - Example of processing Pub/Sub messages in Exilir.

Big Data, Analytics, ML&AI

Running Kedro Machine Learning Pipelines with Google Cloud BigQuery ML - Simplifying Kedro pipelines by deploying them in Google Cloud Notebooks, and using BigQuery for data storage and machine learning.

How to Discover Your Sap HANA Assets in Google Data Catalog - Learn how to ingest SAP HANA metadata to Google Data Catalog and extend it with your user needs.

Running large-scale C++ workloads with Cloud Pub/Sub and GKE - Learn how to use Pub/Sub and GKE effectively to run large-scale C++ applications on Google Cloud.

Reducing BigQuery production cost by 70% with Flex Slots - Reducing BigQuery costs.

Send Cloud SQL Data to BigQuery - Automated data pipeline to move Cloud SQL data to BigQuery.

Analyze Jira Issues using BigQuery and Data Studio - Analyzing Jira issues in BigQuery.

Agile Machine Learning with dbt and BigQuery ML - Combine the orchestration power of dbt with the ML power of BigQuery.

Running PyTorch with TPUs on GCP AI Platform Training - Using TPUs in PyTorch on AI Platform.

AI Platform Notebooks with multiple “Docker” kernels - This post will show you how to create different Jupyter kernels where each kernel will be using a different Deep Learning Container.

Google Cloud Functions for Cloud Dataprep - Examples of Google Cloud Functions for Cloud Dataprep.

How we compress Pub/Sub messages and more, saving a load of money - Migrating logs from one Elasticsearch cluster to another via Pub Sub and doing price optimisations.

Various

My journey to Google Cloud Platform ( GCP ) Professional Architect certification - A Google Cloud Certified — Professional Cloud Architect enables organizations to leverage Google Cloud technologies. Through an….

How I fail the GCP Professional Cloud Architect certification exam - Self reflection after not passing GCP certification exam.

GCP Sketchnotes on GitHub - Every product in the Google Cloud family described in the visual sketchnote format to grasp the capability of the tools quickly and easily.

Releases

Anthos Config Management - 1.6.0. Config Sync unintentionally started using the absolute path in the file system with spec.git.policyDir.

Cloud Composer - In an upcoming Cloud Composer version release, DAG Serialization will be enabled by default when creating new Cloud Composer environments.

Config Connector - Config Connector version 1.34.0 is now available. Added support for IAM Member References. Added support for the GameServicesRealm resource. Added IAM support for ComputeDisk. Added cacheMode, clientTtl, defaultTtl, maxTtl, negativeCaching, negativeCachingPolicy, serveWhileStale, and customResponseHeaders fields to ComputeBackendBucket. Added customTimeBefore, daysSinceCustomTime, daysSinceNoncurrentTime, and noncurrentTimeBefore fields to StorageBucket. Allow for IAMPolicy, IAMPolicyMember, and IAMAuditConfig to reference resources in other namespaces. Added support for UpdateFailed, DeleteFailed, DependencyNotFound, and DependencyNotReady events to IAMPolicy, IAMPoicyMember, IAMAuditConfig. Allow for Project and Folder resources to be migrated across folders and organizations by updating the folder-id/organization-id annotation.

Dataproc - Added support for new persistent disk type, pd-balanced. New sub-minor versions of Dataproc images: 1.3.80-debian10, 1.3.80-ubuntu18, 1.4.51-debian10, 1.4.51-ubuntu18, 1.5.26-centos8, 1.5.26-debian10, 1.5.26-ubuntu18, 2.0.0-RC22-debian10, and 2.0.0-RC22-ubuntu18. Image 2.0 preview: Upgraded Delta Hive connector to version 0.2.0. Image 2.0 preview: HIVE-21646: Tez: Prevent TezTasks from escaping thread logging context.

Cloud Data Loss Prevention - Hybrid Jobs are now available for inspecting external data sources.

Traffic Director - Traffic Director now supports TCP-based services in Preview.

VPC Service Controls - General availability for the following integration: Compute Engine.

If you have suggestion, feedback or link you want to share feel free to email me at zdenko@gcpweekly.com

Have a great week,

Zdenko