View this email in your browser

Programmer Weekly

Welcome to issue 216 of Programmer Weekly. Let's get straight to the links this week.

Quote of the Week

“A complex system that works is invariably found to have evolved from a simple system that works. The inverse proposition also appears to be true: A complex system designed from scratch never works and cannot be made to work.” ― John Gall

Reading List

How to Compile Your Language
This guide provides a practical introduction to designing and implementing a modern compiler for a new programming language, covering key aspects like language design, syntax, and compiler components. It focuses on implementing the frontend (lexer, parser, and semantic analyzer) while utilizing LLVM for optimization and code generation, aiming to showcase various algorithms and techniques used in popular languages like C++, Kotlin, and Rust.

Debugging distributed database mysteries with Rust, packet capture and Polars
Unravel a mysterious network bandwidth issue in QuestDB's primary-replica replication was identified and resolved. Learn about the tools and techniques used, including Rust for packet capture and Python with Polars for data analysis, to optimize network performance.

Fear of over-engineering has killed engineering altogether
The article argues that the fear of over-engineering has led to a decline in engineering quality, as developers prioritize rapid shipping over thoughtful design and planning. It emphasizes the importance of "napkin math" and Fermi problems in making informed decisions, advocating for a balanced approach that combines speed with necessary engineering practices to enhance project outcomes.

Musings on building a Generative AI product
The article discusses key considerations for building generative AI products, emphasizing the importance of user experience, data quality, and model selection. It highlights the need for a robust feedback loop, continuous improvement, and addressing challenges like hallucinations and biases while maintaining transparency and ethical standards in AI development.

Scaling One Million Checkboxes to 650,000,000 checks
The article discusses the rapid growth and scaling challenges faced by the "One Million Checkboxes" website, which unexpectedly attracted tens of thousands of users and over 650 million checkbox interactions shortly after its launch. It highlights the author's lessons learned from managing high traffic, the importance of quick iteration, and the value of creating engaging, anonymous online interactions.

AI models collapse when trained on recursively generated data
The study reveals that AI models, including large language models, suffer from "model collapse" when trained on recursively generated data, leading to a loss of information about the original data distribution over generations. This phenomenon has significant implications for the future of AI training, emphasizing the importance of maintaining access to genuine human-generated data to prevent degradation of model performance and accuracy.

Meet Chrono, our scalable, consistent, metadata caching solution
The article introduces Chrono, Dropbox's scalable and consistent metadata caching solution designed to handle high-volume read queries while maintaining read-after-write guarantees. Built on the Panda key-value storage system, Chrono addresses challenges in traditional caching by ensuring data consistency and supporting new high-volume metadata workflows.

Building A Generative AI Platform
The article outlines the common components and architecture of a generative AI platform, discussing how to enhance context input, implement guardrails, add model routing and gateways, optimize with caching, and incorporate complex logic and write actions. It provides a comprehensive guide for building and scaling AI applications, emphasizing the importance of observability and orchestration in managing these complex systems.

Watch and Listen

Local-First Conf 2024 Videos
The videos from the the world’s first local-first conference. One day of talks and discussion with a rapidly-growing community in an intimate setting.

This Fixes CORS
Learn how to fix CORS errors and enable cross-origin requests in an API endpoint.

Practical Applications for DuckDB
DuckDB is a versatile data tool excelling in various data formats, schema inference, and language integration. This episode explores practical use cases and advanced tips for maximizing DuckDB's potential with insights from experts Simon Aubury and Ned Letcher.

Interesting Projects, Tools and Libraries

CubeCL
Multi-platform high-performance compute language extension for Rust.

Cyclops
Cyclops is an open-source dev tool that simplifies Kubernetes with an easy-to-use UI, making it less intimidating.

sgrep
grep for words with similar meaning to the query.

vdm
A General-Purpose Versioned-Dependency Manager.

OpenShield
Firewall for AI models.

Beszel
A lightweight server monitoring hub with historical data, docker stats, and alerts.

SSOReady
Open-source dev tools for enterprise SSO. Ship SAML support this afternoon.

Our Other Newsletters

Python Weekly - A free weekly newsletter featuring the best hand curated news, articles, tools and libraries, new releases, jobs etc related to Python.

Founder Weekly - A free weekly newsletter for entrepreneurs featuring best curated content, must read articles, how to guides, tips and tricks, resources, events and more.

Copyright © 2024 Programmer Weekly, All rights reserved.
You are receiving our weekly newsletter because you signed up at http://www.ProgrammerWeekly.com

Our mailing address is:

Programmer Weekly

Brooklyn

Brooklyn, NY 11228

Add us to your address book

Want to change how you receive these emails?
You can update your preferences or unsubscribe from this list.

Programmer Weekly - Programmer Weekly - Issue 216

Programmer Weekly

Older messages

Programmer Weekly - Issue 215

Programmer Weekly - Issue 214

Programmer Weekly - Issue 213

Programmer Weekly - Issue 212

Programmer Weekly - Issue 211

You Might Also Like

Recording: 'Data Storytelling: What Organizations Need to Know Going Into 2025'

💻 Issue 437 - Introducing local Azure Service Bus Emulator

💎 Issue 444 - Why did people rub snow on frozen feet? (2017)

💻 Issue 444 - JavaScript Dos and Donts

📱 Issue 438 - Reverse Engineering iOS 18 Inactivity Reboot

💻 Issue 362 - React Anti-Pattern: Stop Passing Setters Down the Components Tree

💻 Issue 444 - Building simple event-driven applications with Pub/Sub

📱 Issue 441 - Shift Left Is the Tip of the Iceberg

💻 Issue 439 - Async/Await Is Real And Can Hurt You

📲 Why I Ditched Linux for Samsung DeX — Buy This Instead of a Gaming Headset