#109: Streaming from AWS Lambda

This week, I'm examining an array of subjects, from streaming with OpenAI on AWS Lambda to strategies for securing an SRE role.

First, I'll walk you through how to use AWS CodePipeline to create completely managed deployment pipelines for Terraform. Then, I'll show you how to replace a Dockerfile with Go and Dagger SDK, enhancing your Docker build workflow.

I'll also cover how to develop Lambda extensions using Go, and offer tips for testing Step Functions' Timeout and Wait states. Our exploration doesn't stop there! I'll delve into how to enforce secure, cost-effective IaC with the help of Terraform, Open Policy Agent (OPA), and Infracost, and share some optimization secrets using Lambda layers and EsBuild.

For those with career aspirations, I've put together a comprehensive guide on how to secure an SRE role in just six months. And for those planning to attend AWS re:Invent 2023, I'll share the ten key things you need to know to make the most out of the conference.

I will also take a reflective look at AWS's latest incident in us-east-1, discussing the implications and lessons learned.

As always, my weekly newsletter is packed with exciting open-source projects. This week I feature a multi-database client tool, an observability platform for logs, metrics, traces, and analytics, and a self-hosted GitHub Actions runner on GCP.

But that's not all, there's much more in the full newsletter. So stick around, stay informed, and enjoy this week's DevOps Bulletin!

📖 TUTORIALS OF THE WEEK

"OpenAI streaming from AWS Lambda" - Building real-time AI-powered WebSocket APIs with AWS API Gateway, Lambda, and OpenAI - Read more »

"Use AWS CodePipeline to build fully-managed deployment pipelines for Terraform" - The title says it all - Read more »

"I don't need your query language" - Often this new database engine comes with a new query language. And that’s probably good, too. Or maybe it’s not - Read more »

"Replace a Dockerfile with Go (or Python, or Node.js)" - How to write a similar pipeline with Dagger SDK - Read more »

"Lambda extension with Golang" - Extensions can give you the ability to have cross-team reuse of code without being tied to a particular language or build process - Read more »

"Linux hardening guide" - For security folks, this is a must read! - Read more »

"Testing step functions" - How to skip time when testing Timeout and Wait states - Read more »

"An alerting strategy for the cloud" - Not much articles out there on alerting strategies. This article is an attempt to address that gap - Read more »

"Automate DynamoDB migration with AWS Serverless services" - This article explores DynamoDB cross-region migration using AWS Lambda and Step Functions - Read more »

"Enforcing secure and cost-effective IaC with Terraform, OPA, and Infracost" - Explore the implementation of OPA and Infracost in a Terraform project - Read more »

"Reducing Lambda bundle size with EsBuild and Lambda layers" - Optimization tips using Lambda layers, EsBuild, and smarter BE framework choices - Read more »

🛠 PROJECTS OF THE WEEK

1️⃣ Chat2DB is a multi-database client tool - Learn more »

2️⃣ OpenObserve is an observability platform for logs, metrics, traces, and analytics - Learn more »

3️⃣ Try lets you run a command and inspect its effects before changing your live system - Learn more »

4️⃣ Pod transcription with OpenAI Whisper and AWS - Learn more »

5️⃣ Self-hosted GitHub Actions runner on GCP using GCE - Learn more »

6️⃣ A fuzzy-finder command-line tool for removing resources from terraform state - Learn more »

📰 NEWSWORTHY STORIES

"How I went from Operations Manager to Site Reliability Engineer In 6 months!" - Read more »

"How Platform Engineering works" - Read more »

"It’s not always DNS — unless it is" - Read more »

"Why did AWS Support fail with US-EAST-1 again?" - Read more »

"10 things you need to know before attending AWS re:Invent 2023" - Read more »

💡 THREAD OF THE WEEK

😂 MEMES OF THE WEEK

Hand-picked DevOps opportunities to work from home, remotely, freelance, full-time, part-time, contract and internships - See more »

I hope you enjoy this week’s newsletter! Share it with a friend or colleague if you find it helpful, drop me an email or send me a DM on Twitter about topics you’d like to hear about in future editions.

Remember to share if you enjoyed this issue!

Share

Forward

Digest #109: Streaming from AWS Lambda 😳

#109: Streaming from AWS Lambda

Older messages

Digest #108: Kubernetes vs Docker Swarm ⚔️

Digest #107: End-to-End Monitoring Platform 📊

Digest #106: I love git-blame-someone-else! 😳

Digest #105: Kubernetes CronJobs at Scale 🚀

Digest #104: Testing CloudFormation Stacks 🧪

You Might Also Like

Import AI 399: 1,000 samples to make a reasoning model; DeepSeek proliferation; Apple's self-driving car simulator

Defining Your Paranoia Level: Navigating Change Without the Overkill

5 ways AI can help with taxes 🪄

Recurring Automations + Secret Updates

The First Provable AI-Proof Game: Introducing Butterfly Wings 4

GCP Newsletter #437

Charted | The 1%'s Share of U.S. Wealth Over Time (1989-2024) 💰

The Great Social Media Diaspora & Tapestry is here

Daily Coding Problem: Problem #1689 [Medium]

📧 Stop Conflating CQRS and MediatR