Google Cloud Weekly - GCP Newsletter #197

Welcome to issue #197 July 6th, 2020

News

Official Blog VMware Engine

Google Cloud VMware Engine is now generally available - Google Cloud VMware Engine is a first-party, fully managed VMware service that lets you modernize and enhance existing applications.

Cloud Dataproc Data Analytics Official Blog

Presto optional component now available on Dataproc - The Presto query engine optional component is now available for Dataproc, Google Cloud’s fully managed Spark and Hadoop cluster service.

Cloud Dataproc Data Analytics Official Blog

Dataproc Metastore: Fully managed Hive metastore now available for alpha testing - Dataproc Metastore is a fully managed open source Apache Hive metastore service, so you can easily build data lakes on Google Cloud.

Official Blog

New IT Cost Assessment program: Unlock value to reinvest for growth - Our new IT Cost Assessment program lets you understand how your company’s IT spend compares to your industry peers, so you can quickly identify key areas of opportunity to unlock value to reinvest for growth.

Official Blog Security

Reinforcing our commitment to privacy with accredited ISO/IEC 27701 certification - Google Cloud is the first major cloud provider to receive an accredited ISO/IEC 27701 certification as a data processor.

BigQuery Official Blog

Analyzing petabytes of data just got easier, with Google Sheets - Announcing the general availability of Connected Sheets, which provides the power and scale of BigQuery in the familiar context of Sheets.

Compute Engine Infrastructure Official Blog

Bare Metal Solution: Coming to a Google Cloud data center near you - With Bare Metal Solution, now you can run specialized databases in five new Google Cloud regions.

 

Articles, Tutorials

Infrastructure, Networking, Security, Kubernetes

Official Blog Security

Not just compliance: reimagining DLP for today’s cloud-centric world - A look back at the history of DLP before discussing how DLP is useful in today’s environment, including compliance, security, and privacy use cases.

Secret Manager Security Terraform

How to use GCP Secret Manager to Manage your Secrets using Terraform - Setting secrets in Secret Manager with Terraform.

NoSQL Terraform

How to Deploy MongoDB Atlas on GCP using Terraform - Deploying MongoDB Atlas with Terraform on Google Cloud.

Google Kubernetes Engine Istio Kubernetes

Canary Deployment using Istio and Google Kubernetes Engine - In a production environment, the best practice is to roll out your new features in a phase-wise release, and therefore, a need arises to split the incoming traffic between the older and the newer versions of the application. A combination of GKE and Istio would help in achieving this type of methodology.

IAM Security

Google Cloud Platform pentest notes — service accounts - Using a service account file to access GCP services.

Google Kubernetes Engine Istio

Deploying Service or Ingress on GKE - Getting Started with GKE: Endpoints with Service and Ingress.

Google Kubernetes Engine Istio Kubernetes Networking

Kubernetes, Istio and The World Outside Rapido - Handling egress traffic for a private GKE cluster.

CI DevOps Google Kubernetes Engine Tutorial

How I Setup A Simple CI/ CD Process With Jenkins And GKE Part 2 - Setting CI/CD pipeline with Jenkins on GKE.

Google Kubernetes Engine Kubernetes Networking

Google Kubernetes Networking options explained & demonstrated - This blog post explores the different network modes available in Google Kubernetes Engine, including the differences between them and the advantages of each when creating a new GKE cluster.

App Development, Serverless, Databases, DevOps

Cloud Storage Official Blog

A guide to setting up monitoring for object creation in Cloud Storage - Learn how to set up monitoring and alerting when an object is created in Cloud Storage.

.NET App Engine

.NET Core 3.1 updates in Cloud Shell and App Engine flexible environment - Deploying .NET application on App Engine Flexible.

Cloud Run Docker

Swift on Cloud Run - Build a highly scalable Docker applications using Swift + Cloud Run!

SAP

SAP on Google Cloud : When SAP Developers join the cloud (pt. 1) - Learn how to create a CI/CD pipeline for SAP HANA HDI containers and micro-services extending SAP functionality in Google Cloud.

App Engine Billing Serverless

Don’t Accept the Defaults! How to Reduce Costs with Google App Engine Autoscaling - Getting higher performance at lower costs by modifying the default values to match the workload of your service for App Engine workloads.

Big Data, Analytics, ML&AI

Data Science Machine Learning Python TensorFlow

Model with TensorFlow and Serve on Google Cloud Platform - Serving TensorFlow Models on a scalable cloud platform.

Data Analytics Official Blog

Building a genomics analysis architecture with Hail, BigQuery, and Dataproc - Try a cloud architecture for creating large clusters for genomics analysis with BigQuery and Google-built healthcare tooling.

Data Analytics Official Blog

Genomics analysis with Hail, BigQuery, and Dataproc - Try data analytics for genomics research in the cloud using BigQuery, Dataproc and Hail for fast large-scale research.

Apache Beam BigQuery Cloud Dataflow

How to load XML data into BigQuery using Python Dataflow - Parse the XML into a Python dictionary and use Apache Beam’s BigQueryIO.

BigQuery Data Science

How to handle Google Analytics data in BigQuery - The ways & tricks to tackle Shaded Tables and ARRAYs in BigQuery tables.

BigQuery Cloud Dataflow Cloud Datastore Python

The Python implementation of Dataflow to transfer Datastore entities to BigQuery - Transferring entities of Google Cloud Datastore into BigQuery in bulk with Dataflow implemented in Python.

BigQuery Python

Load files faster into BigQuery - Benchmarking CSV, GZIP, AVRO and PARQUET file types for ingestion.

Big Data Cloud Storage

Migrating HDFS Data to Google Cloud Storage - Moving data from Hadoop cluster to Cloud Storage with Cloud Storage Connector.

Cloud Dataprep

Cleanse Salesforce Address Data using Cloud Dataprep by Trifacta - Learn Data Management with Cloud Dataprep and Salesforce.

AI Machine Learning Official Blog

Google Cloud’s AI Adoption Framework: Helping you build a transformative AI capability - The Google Cloud AI Adoption Framework whitepaper aims to provide a guiding framework for technology leaders who want to leverage the power of AI.

Various

Billing Official Blog

11 best practices for operational efficiency and cost reduction with Google Cloud - Our new eGuide examples how fundamental IT changes like migrating on-premises workloads to the cloud can reduce costs, increase agility, and pay ROI dividends down the line.

Slides, Videos, Audio

GCP Podcast - #225 Cloud Audit Logging with Philip O'Toole and Oscar Guerrero.

Kubernetes Podcast - #110 Mirantis, with Adrian Ionel.

 

Releases

BigQuery - Flex slots are now generally available (GA). The BigQuery SLA has been updated to >= 99.99% Monthly Uptime Percentage for all users.

BigQuery ML - BigQuery ML now supports time series models as a beta release.

Cloud Build - Cloud Build now provides open-source notifiers for Slack and SMTP.

Cloud Composer - Cloud Composer support for VPC Service Controls is now in Beta.

Cloud Debugger - Cloud Debugger now lets you canary snapshots and logpoints on your Node.js applications.

Dialogflow - The V1 API is in the process of a gradual shutdown.

IAM - The organization policy constraint to prevent automatic role grants to Cloud IAM service accounts is now generally available. Starting on July 27, 2020, IAM policies will identify deleted members that are bound to a role. Starting on July 27, 2020, if a binding in a policy refers to a deleted member (for example, deleted:user:tamika@example.com?uid=123456789012345678901), you cannot add a binding for a newly created member with the same name (in this case, user:tamika@example.com).

Google Kubernetes Engine - NodeLocal DNSCache is now generally available. GKE Node System Configuration is now beta. Starting with GKE 1.17.6, Vertical Pod Autoscaler recommendations are more fine-grained, starting from 1 mCPU and 1 MiB. GKE cluster versions have been updated. Nodes with auto-upgrade enabled will be upgraded: Rollouts are phased across multiple weeks, to ensure cluster and fleet stability. The following Kubernetes versions are now available for new clusters and for opt-in master upgrades and node upgrades for existing clusters. No channel Note: Your clusters might not have these versions available. The COS image for GKE 1.14.10-gke.45 clusters is cos-73-11647-534-0. The COS image for GKE 1.15.12-gke.6 clusters is cos-77-12371-251-0.

Load Balancing - You can now create an internal HTTP(S) load balancer in a Shared VPC service project.

Cloud Logging - Cloud Logging now contains a Logs Dashboard page that provides a high-level overview into the health of your systems running within a project.

Resource Manager - The Organization Policy for restricting automatic IAM permission grants to new service accounts has launched into general availability.

Cloud Run - Cloud Run (fully managed) support for connecting to a VPC network with Serverless VPC Access is now at general availability (GA). Cloud Run is now available in the following regions: asia-northeast2 (Osaka) australia-southeast1 (Sydney) northamerica-northeast1 (Montréal).

VPC Service Controls - Beta release of the VPC Service Controls Troubleshooter. Beta stage support for the following integrations: Cloud Composer Cloud Healthcare API.

Network Intelligence Center - Connectivity Tests now supports running tests from the Network interface details screen of a Compute Engine VM instance in the Google Cloud Console.

Dialogflow Enterprise - The V1 API is in the process of a gradual shutdown.

Service Mesh - 1.6.4-asm.9 is now available. ASM 1.6 is compatible with and has the feature set of Istio 1.6 (see Istio release notes), subject to the list of ASM Supported Features. 1.5.7-asm.0 and 1.4.10-asm.3 Fixes the security issue, ISTIO-SECURITY-2020-007, with the same fixes as Istio 1.6.4. Anthos Service Mesh now supports multi-cluster meshes (beta) when running on GKE on Google Cloud. Users that configure multiple clusters in their mesh can now see unified, multi-cluster views of their services in the Anthos Service Mesh pages in the Cloud Console. ASM 1.6 is supported in a single cluster configuration in Anthos Attached Clusters in the following environments: Amazon Elastic Kubernetes Service (EKS) and Microsoft Azure Kubernetes Service (AKS). The profile to install ASM in GKE has been renamed from asm to asm-gcp, see Upgrading Anthos Service Mesh on GKE. In the asm-multicloud profile, ASM now installs a complete observability stack (Prometheus, Grafana and Kiali). Support for cross-cluster load balancing (beta) for your multi-cluster mesh for GKE on Google Cloud. New installation guides: Installing Anthos Service Mesh on attached clusters and Adding clusters to an Anthos Service Mesh. Anthos Service Mesh now supports cross-cluster security policies (beta) for your multi-cluster mesh when running on GKE on Google Cloud. Upgrade from ASM 1.5 to ASM 1.6 without downtime using a dual control plane upgrade. Known Issue: If you upgrade from Istio to ASM 1.6 and have set SLOs on your service metrics, those SLOs might be lost and need to be recreated after the upgrade.

If you have suggestion, feedback or link you want to share feel free to email me at zdenko@gcpweekly.com

Have a great week,

Zdenko

Older messages

GCP Newsletter #196

Monday, June 29, 2020

Welcome to issue #196 June 29th, 2020 News Google Cloud Platform Official Blog Your Next '20 OnAir journey starts here: Resources and session guides available now - Google Cloud Next '20 OnAir,

GCP Newsletter #195

Monday, June 22, 2020

Welcome to issue #195 June 22nd, 2020 News Apigee Official Blog Announcing API management for services that use Envoy - To help integrate Envoy-based services into Apigee environment, GCP is announcing

GCP Newsletter #194

Monday, June 15, 2020

Welcome to issue #194 June 15th, 2020 News Networking Official Blog Security Google Cloud firewalls adds new policy and insights - New Google Cloud firewall features provide more flexibility, control,

GCP Newsletter #193

Monday, June 8, 2020

Welcome to issue #193 June 8th, 2020 Cloud SQL gets a cross-region replication, dbt is used more and more with BigQuery and examples of how to use the simplicity of serverless products to integrate

GCP Newsletter #192

Monday, June 1, 2020

Welcome to issue #192 June 1st, 2020 News Cloud Dataproc Data Analytics Jupyter Notebook Official Blog Combining the power of Apache Spark and AI Platform Notebooks with Dataproc Hub - Dataproc Hub:

You Might Also Like

Import AI 399: 1,000 samples to make a reasoning model; DeepSeek proliferation; Apple's self-driving car simulator

Friday, February 14, 2025

What came before the golem? ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏

Defining Your Paranoia Level: Navigating Change Without the Overkill

Friday, February 14, 2025

We've all been there: trying to learn something new, only to find our old habits holding us back. We discussed today how our gut feelings about solving problems can sometimes be our own worst enemy

5 ways AI can help with taxes 🪄

Friday, February 14, 2025

Remotely control an iPhone; 💸 50+ early Presidents' Day deals -- ZDNET ZDNET Tech Today - US February 10, 2025 5 ways AI can help you with your taxes (and what not to use it for) 5 ways AI can help

Recurring Automations + Secret Updates

Friday, February 14, 2025

Smarter automations, better templates, and hidden updates to explore 👀 ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏

The First Provable AI-Proof Game: Introducing Butterfly Wings 4

Friday, February 14, 2025

Top Tech Content sent at Noon! Boost Your Article on HackerNoon for $159.99! Read this email in your browser How are you, @newsletterest1? undefined The Market Today #01 Instagram (Meta) 714.52 -0.32%

GCP Newsletter #437

Friday, February 14, 2025

Welcome to issue #437 February 10th, 2025 News BigQuery Cloud Marketplace Official Blog Partners BigQuery datasets now available on Google Cloud Marketplace - Google Cloud Marketplace now offers

Charted | The 1%'s Share of U.S. Wealth Over Time (1989-2024) 💰

Friday, February 14, 2025

Discover how the share of US wealth held by the top 1% has evolved from 1989 to 2024 in this infographic. View Online | Subscribe | Download Our App Download our app to see thousands of new charts from

The Great Social Media Diaspora & Tapestry is here

Friday, February 14, 2025

Apple introduces new app called 'Apple Invites', The Iconfactory launches Tapestry, beyond the traditional portfolio, and more in this week's issue of Creativerly. Creativerly The Great

Daily Coding Problem: Problem #1689 [Medium]

Friday, February 14, 2025

Daily Coding Problem Good morning! Here's your coding interview problem for today. This problem was asked by Google. Given a linked list, sort it in O(n log n) time and constant space. For example,

📧 Stop Conflating CQRS and MediatR

Friday, February 14, 2025

​ Stop Conflating CQRS and MediatR Read on: m​y website / Read time: 4 minutes The .NET Weekly is brought to you by: Step right up to the Generative AI Use Cases Repository! See how MongoDB powers your