Welcome to issue #202 August 10th, 2020

Last week of Cloud Next OnAir was about Security, this week is about Data Analytics!

News

A better, safer normal: Helping you modernize security in the cloud or in place - Sharing more on unique and powerful capabilities Google Cloud has to simplify security operations in your organization.

Introducing CAS: Securing applications with private CAs and certificates - Certificate Authority Service (CAS) is a highly scalable and available service that simplifies and automates the management and deployment of private CAs.

New multi-region configurations for Spanner in Asia and Europe - New Cloud Spanner database multi-regions in Asia and Europe bring 5 9s of availability to users for scalability and high availability.

Google Cloud named a Leader in the 2020 Forrester Wave for API Management Solutions - Forrester Research has recognized Google Cloud Apigee as a leader in The Forrester Wave™: API Management Solutions, Q3 2020.

Articles, Tutorials

Infrastructure, Networking, Security, Kubernetes

New best practices to help automate more secure Cloud deployments - Google Cloud security best practices center is a new web destination that delivers world-class security expertise from Google and our partners.

Logs-based Security Alerting in Google Cloud: Detecting attacks in Cloud Identity - How to use Cloud Identity logs to as a necessary first line of defense against authentication/authorization-based attacks.

Achieve least privilege with less effort using IAM Recommender - Best practices establishing least privilege at scale and how IAM Recommender can help.

Three months, 30x demand: How we scaled Google Meet during COVID-19 - Learn how Google's SRE team ramped up to handle high demand for Google Meet in response to COVID-19.

Fine-grained Cloud DNS IAM via Service Directory - This article and example show how to leverage Service discovery Cloud DNS integration, to address the common ask of supporting fine-grained IAM control of DNS zones and records.

Deployment of containerized application to GKE using CircleCI - CircleCI provides CI/CD to automate deployment of containerized app to GKE, let’s look at how easy it can be done!

Migrate for Anthos — Application Migration and Modernization - The article goes through a process of migrating an application to Anthos.

App Development, Serverless, Databases, DevOps

Authenticate with Firebase using Okta - With Firebase Custom Authentication, you can use any user identity service to authenticate with Firebase, as demonstrated on example of Octa.

Google Sheets + Cloud Run - Integrate the Google Sheets API to Cloud Run app.

Using Google Cloud Firestore as a Configuration Source for .Net Core Applications - NuGet package that includes Firestore as a Configuration Source for .NET applications.

Managing payments in your app: Check out the checkout — the code - See how to create a Stripe Checkout intent in Cloud Run and pass the Session ID to the client.

Looking for an emulator for Cloud Tasks? - Introducing a simple Tasks emulator that makes it easy to deploy and debug.

Upload Data to Firebase Cloud Firestore with 10 line of Python Code - Example of uploading local CSV files to Cloud Firestore using Python.

Compute Engine explained: Picking the right licensing model for your VMs - Understand your options for images and licensing on Google Cloud Compute Engine.

Big Data, Analytics, ML&AI

The Smarter Way of Scaling With Composer’s Airflow Scheduler on GKE - Reducing monthly billing for Cloud Composer.

Building some Data Pipeline with Google Data Fusion - Step by step tutorial on start using Data Fusion and creating pipelines.

Batch data processing pipeline using Google Data Fusion - What is Google Data Fusion?

Demystifying BigQuery reservations - Learn ho to mix flat-rate and on-demand pricing.

5 reasons why BigQuery users should use dbt - Highlighting useful functions of dbt tool.

Big Data in Google Cloud — Cost Monitoring (part II) - The article explains how to analyze Billing data in BigQuery in order to get insights about most expensive queries etc.

Yet another way to generate fake datasets in BigQuery - Wrapping faker.js with a Javascript UDF.

Part II: Analyze Antigen Epitope Data with BigQuery and Build ML Model - Analyzing Immune Epitope Database with BigQuery.

Getting to know Looker: How LookML can simplify BI workflows - LookML from Looker, now part of Google Cloud, offers better business intelligence (BI) workflows for data analysts, modelers, engineers, CDOs, IT security, and more.

Performance and cost optimization best practices for machine learning - Best practices on how you can enhance the performance and decrease the costs of your ML workloads on Google Cloud.

TensorFlow model on BigQuery ML - In this blog you learn how you can deploy a trained TensorFlow model on BigQuery so you can make predictions right from your data warehouse.

Managing Fine-Grained Data Access Control in BigQuery - Column-level security to restrict unauthorized access to sensitive data in BigQuery.

Various

Google Cloud AI and Harvard Global Health Institute Collaborate on new COVID-19 forecasting model - To help first responders be better prepared for what lies ahead, Google Cloud is releasing the COVID-19 Public Forecasts.

Session guide: Get the most out of Next OnAir Security Week - Google Cloud Next ‘20: OnAir has a range of sessions touching on all aspects of helping to secure your organization.

The best of Google Cloud Next ’20: OnAir's Security Week for technical practitioners - A look at resources for security practitioners during Next Security week—and beyond.

Announcing the GCP Organization Policy Notifier - Track GCP Org Policy Updates on Twitter and Slack.

Slides, Videos, Audio

GCP Podcast - #230 Traffic Director and Microservices with Stewart Reichling and John Laham.

Kubernetes Podcast - #115 Minikube Redux, with Thomas Strömberg.

Releases

AI Platform - Deep Learning VMs - M53 release TensorFlow Enterprise 2.3 images, including images that support CUDA 11.0, are now available.

Cloud Asset Inventory - k8s.io/Node fields deprecation The following two fields for assets of k8s.io/Node are now deprecated in the exported output of Cloud Storage and BigQuery.

BigQuery - BigQuery is now available in the following regions: Oregon (us-west1), Belgium (europe-west1), and Netherlands (europe-west4).

Billing - If you have a negotiated pricing contract associated with your Cloud Billing account, starting with your July 2020 invoice, the Cloud Billing report and the Cost Breakdown report now support displaying your costs calculated using list prices, displaying your negotiated savings as a separate credit.

Cloud Composer - New versions of Cloud Composer images: composer-1.11.1-airflow-1.10.3, composer-1.11.1-airflow-1.10.6, and composer-1.11.1-airflow-1.10.9. Private IP environments can now be creating using non-rfc 1918 CGN ranges (100.64.0.0/10) New PyPi packages have been added for Composer version composer-1.11.0-airflow-1.10.6. A more informative error message was added for environment creation failures caused by issues with Cloud SQL instance creation.

Compute Engine - You can now update multiple instance properties using a single request from the command-line tool or the Compute Engine API to update multiple instance properties. You can attach a maximum of 24 local SSD partitions for 9 TB per instance. You can now access C2 machine types in the following zones: Taiwan: asia-east1-a, Singapore: asia-southeast1-a, Sao Paulo: southamerica-east1-b,c, and Oregon: us-west1-b.

Dataproc - Dataproc users are required to have service account ActAs permission to deploy Dataproc resources, for example, to create clusters and submit jobs.

Cloud Functions - Cloud Functions Java 11, Python 3.7 or 3.8, and Go 1.13 runtimes now build container images in the user's project, providing direct access to build logs and removing the preset build-time quota.

GKE on Prem - Stackdriver monitor error condition Under certain conditions, the default Stackdriver monitoring pod, deployed by default in each new cluster, can become unresponsive. Installer fails when creating vSphere datadisk The GKE on-prem installer can fail if custom roles are bound at the wrong permissions level.

Istio on GKE - 1.4.x. Starting with version 1.6, the Istio on GKE add-on uses the Istio Operator for installation and configuration.

Cloud PubSub - Pub/Sub message ordering is now available at the beta launch stage.

Cloud Run - When setting up Continuous Deployment in the Cloud Run user interface, you can now select a repository that contains Go, Node.js, Python Java or .NET Core code.

Cloud Spanner - A new multi-region instance configuration is now available in North America - nam10 (Iowa/Salt Lake).

Deep Learning VM - M53 release TensorFlow Enterprise 2.3 images, including images that support CUDA 11.0, are now available.

Anthos GKE deployed on-prem - Stackdriver monitor error condition Under certain conditions, the default Stackdriver monitoring pod, deployed by default in each new cluster, can become unresponsive. Installer fails when creating vSphere datadisk The GKE on-prem installer can fail if custom roles are bound at the wrong permissions level.

AI Platform Training - Read a new guide to distributed PyTorch training.

Anthos GKE on-prem - Stackdriver monitor error condition Under certain conditions, the default Stackdriver monitoring pod, deployed by default in each new cluster, can become unresponsive. Installer fails when creating vSphere datadisk The GKE on-prem installer can fail if custom roles are bound at the wrong permissions level.

Anthos GKE on AWS - Anthos GKE on AWS 1.4.1-gke.17 is released. Use version 1.16.9-gke.15 for creating new clusters. Anthos GKE on AWS 1.4.1-gke.15 clusters will experience a memory leak that results in an unresponsive cluster.

If you have suggestion, feedback or link you want to share feel free to email me at zdenko@gcpweekly.com

Have a great week,

Zdenko