Welcome to issue #432 January 6th, 2025

News

A Look Back at the AI Innovations Transforming the Public Sector - In 2024, Google AI made significant advancements in quantum computing, generative AI models, and open foundation models. These advancements will enable increased agility and efficiency for public sector organizations by automating tasks, improving data accessibility, and bolstering security. Google Public Sector remains committed to helping public sector customers meet their mission by investing in an open platform, training the next generation of leaders, and providing AI solutions that empower agencies.

Articles, Tutorials

Infrastructure, Networking, Security, Kubernetes

Building a Kubernetes Cluster on GCP Using Kubeadm: Part 1 - This article provides a step-by-step guide to creating a Kubernetes cluster using Kubeadm on Google Cloud Platform. The guide includes instructions for installing prerequisites, initializing the control plane, configuring kubectl, installing Calico as a network plugin, joining worker nodes, and verifying the cluster status.

Message-driven (Pub/Sub) PAM activity in GCP: a Terraformed example - Using Privileged Access Manager (PAM) to manage just-in-time temporary privilege elevation for select principals.

Continuous Delivery for GKE with Cloud Deploy and Argo CD - GitOps Continuous Delivery for GKE with Cloud Deploy.

Comprehensive Guide to Learning Kubernetes with Google Cloud

App Development, Serverless, Databases, DevOps

Upload big files with Spring Flux to Google Cloud Storage. - Spring Flux can efficiently upload large files (1GB or more) to Google Cloud Storage. The solution avoids loading the entire file into memory and processes the data in chunks.

Creating a Local Environment to Operate GCS Emulator from Flask

Data Transfer from S3 to Cloud Storage using GCP Storage Transfer Service - This article shows how to create a one-time storage transfer job from an S3 bucket to Cloud Storage, and to set up an event-driven transfer job to continuously sync new or modified objects from the source S3 bucket.

Securing Cloud Run function calls from your Frontend app - Avoid storing secrets in frontend apps. Protect serverless backends in Google Cloud using the power of OAuth 2.0.

Building RAG for Product Recommendation using Google Gemini 2.0 API’s - A Comparison of LangChain and Vertex AI RAG Engine on Amazon Product Data using Vertex AI Search.

Big Data, Analytics, ML&AI

Write better Jupyter Markdown using Gemini - Automated documentation generator for Jupyter notebooks using Google's Vertex AI and Gemini model. It analyzes code cells, generates descriptive titles, creates detailed explanations for each section, and provides a navigable table of contents. The tool leverages Google Search grounding to avoid hallucinations and ensures consistent documentation across multiple notebooks.

Monitor Apache Solr on Dataproc - Integrating Solr’s embedded Prometheus exporter with Google Cloud Monitoring and create beautiful dashboards.

Building machine learning pipelines with Vertex AI and KubeFlow in GCP - This article discusses how to use Vertex AI pipelines with Kubeflow to automate the process of training, testing, and deploying machine learning models. It provides a step-by-step guide to building a pipeline for a Fashion MNIST classifier, including data preprocessing, model training, evaluation, and registration.

Building a Reproducible RAG Data Processing Pipeline with Google Dataflow Flex Templates - This article presents a step-by-step guide to building a flexible and reproducible data processing pipeline for Retrieval-Augmented Generation (RAG) using Google Cloud Dataflow Flex Templates. The pipeline demonstrates how to handle dependencies, leverage custom container images, and ensure a reproducible environment.

Various

How to Prepare for the Google Cloud Professional Cloud Database Engineer Certification Exam

How to Prepare for the Google Cloud Associate Data Practitioner Certification Exam

How to Prepare for the Google Cloud Professional Data Engineer Certification Exam

Releases

Cloud Architecture Center - Google Cloud Architecture Framework: Reliability pillar: Major update to align the recommendations with core principles of reliability.

SAP Solutions - ABAP SDK for Google Cloud version 1.1 (SAP BTP edition) Version 1.1 of the SAP BTP edition of the ABAP SDK for Google Cloud is generally available (GA). In addition to supporting more Google Cloud APIs and few other enhancements, this version introduces the Vertex AI SDK for ABAP – a dedicated toolset for seamless interaction with Google Cloud's Vertex AI platform from your SAP BTP, ABAP environment. For more information, see What's new with the SAP BTP edition of the ABAP SDK for Google Cloud.