Welcome to this week’s edition of the DevOps Bulletin!

This week, dive into how adding a little extra to Lambda can slow things down by 20 ms 😱, and see how DuckDB might just be the better jq for playing with JSON. Get smart with Google Cloud security, and don’t miss out on mastering those Git commands that make life easier.

Ever thought about making a knowledge base with Amazon tech or committing code without Git? We got you! Plus, we're talking about how to use Lambda for your own analytics magic, enforcing rules with Terraform in Azure, turning a SQLite database into a filesystem, and setting up an EKS dream team with Terraform and Packer.

Need to handle a Linux crisis or build a video pipeline with AWS? Check out our tips. Also, peek at eBPF for file monitoring that’s next level.

This week's cool projects? Shuk for easy S3 uploads, Pack for squishing files tight, pre-commit hooks for Terraform, Hatchet for task queues, a CLI for SQLite diagrams, and fail-safe API Gateways.

Hot off the press: GoDaddy’s big save with Amazon EMR, a look at Kubernetes v1.30, switching from MongoDB to PostgreSQL, Doctolib’s failover tricks, lessons from data disasters, Netflix’s kernel panic solutions, and why the big tech is all over Valkey Redis fork.

Tutorials of the week

• The impact of Lambda environment variables on cold starts: They could increase cold start times over 20 ms? 😱

• Using DuckDB as the new jq: Explore the utility of DuckDB as an alternative to jq for processing JSON data.

• Mastering security on GCP: A complete roadmap to navigate the complexities of cloud security.

• Popular Git config options: Pretty useful commands!

• Creating a knowledge base with OpenSearch: A step-by-step guide to setting up a knowledge base using Amazon OpenSearch, Lambda, and API Gateway.

• Committing without Git: Create a branch with Python and understand Git Objects!

• Statistics with Lambda@Edge: Gain insights into utilizing Lambda@Edge to build your own Google Analytics:

• Enforcing OPA policies with Terraform: How OPA integrates with Azure DevOps and a network-isolated self-hosted pipeline agent.

• Mount a SQLite database as a Filesystem: How to turn your SQLite db into a user-friendly file system with wddbfs.

• EKS optimized golden AMI with Terraform and Packer: How to deploy a Netflix clone by Argocd in EKS worker node using Terraform and Packer.

• Linux crisis tools: Essential tools for crisis management in Linux environments.

• Build your video processing pipeline with AWS: Building a Serverless video transcoding and analysis pipeline with Step Functions and Rekognition.

• File monitoring with eBPF and Tetragon: Monitoring pod files, inline enforcement, and controlling execution.

Projects of the week

Highlighting cool DevOps projects to keep an eye on:

• Shuk is used to upload files to Amazon S3 and have them shared with others.

• Pack is the highest compression-to-time ratio container for files and raw data. Safe, fast, and reliable.

• List of pre-commit git hooks to take care of Terraform configurations.

• Hatchet is a distributed, fault-tolerant task queue that replaces traditional message brokers and pub/sub systems.

• An open-source CLI to generate SQLite schema diagrams.

• API Gateway Multi-Region Failover is an API Gateway multi-region active-passive public API that proxies two independent multi-region active-passive service APIs.

Newsworthy Stories

Stay informed with the latest news impacting the DevOps and SRE world:

• How has GoDaddy achieved over 60% cost reduction with Amazon EMR Serverless?

• A peek at Kubernetes v1.30.

• The great migration from MongoDB to PostgreSQL.

• How Doctolib has built an infrastructure failover checklist?

• 4 instructive Postmortems on data downtime and loss

• How Netflix’s connect Linux Kernel panics to Kubernetes Pods?

• Why AWS, Google and Oracle are backing the Valkey Redis fork?

  Certo Modo

  In Defense of Shell Scripts

  (cross-posted from certomodo.io) Throughout my career, I’ve been known as the engineer who solves a LOT of problems using shell scripts. With it, I’ve built: a tool that creates and destroys test services at Meta to help new engineers learn how to use the…

  Read more

  a month ago · 1 like · Amin Astaneh

Meme of the week