BetterDev #264 - Implement realtime mouse pointer and Postgres as a search engine
Better Dev #264 Aug 26, 2024
Hi all,
This week, I’ve already started to feel the first signs of autumn in the air where I live. I hope everyone can savor these last few days of summer and gear up for the fall season.
As engineers, we’re often advised not to reinvent the wheel—use Redis for caching, ElasticSearch for searching, and so on. But let’s challenge that mindset. If you’re curious, dive in and experiment. Build your own search engine, write your own database. That’s the spirit behind this week’s curated links. I hope you find them inspiring.
Now, let’s dive into the newsletter. If you enjoy BetterDev, please spread the word by sharing it with your friends. And if you’d like to support my work, buying me a coffee would be much appreciated.
In collabortion app you will usually see the cursor of all the user moving around. How would we implement that? At scale. Canvas engineering share with us here. Some good find such as using a Binary serialization instead of JSON to reduce CPU load on backend
Build a retrieval system with semantic, full-text, and fuzzy search in Postgres to be used as a backbone in RAG pipelines. We will do all: full text search, semantic search, fuzzy search with Postgres
It’s surprising how little is known about the foundations of machine learning. Yes, from an engineering point of view, an immense amount has been figured out about how to build neural nets that do all kinds of impressive and sometimes almost magical things. But at a fundamental level we still don’t really know why neural nets “work”—and we don’t have any kind of “scientific big picture” of what’s going on inside them.
Some programs use a particular system call “vmsplice” to move data faster through a pipe. When not using vmsplice, Linux pipes are slower than what I would have expected. Since we cannot always use it, lets see exactly why that was, and whether it could be improved.
Marc Olson has been part of the team shaping Elastic Block Store (EBS) for over a decade. In this post, Marc provides a fascinating insider’s perspective on the journey of EBS. He shares hard-won lessons in areas such as queueing theory, the importance of comprehensive instrumentation, and the value of incrementalism versus radical changes. Most importantly, he emphasizes how constraints can often breed creative solutions. It’s an insightful look at how one of AWS’s foundational services has evolved to meet the needs of our customers (and the pace at which they’re innovating).
Take us into the history of Ethernet to see why things happened the way they did. It will also significantly enhance your network knowledge.
As developers, we use databases all the time. But how do they work? In this series, we’ll try to answer that question by building our own SQLite-compatible database from scratch.Source code examples will be provided in Rust, but you are encouraged to follow along using your language of choice, as we won’t be relying on many language-specific features or libraries.
Detect memory by just looking at growth rate of memory is simple. What if we train a model of leak pattern, and apply it to detect it sooner and more efficent?
databases are basically magic, and SQL is the arcane tongue that allows you to channel that magic. In fact, it’s easy to think of databases like a black box where you make sure your tables are indexed sensibly and your queries aren’t doing anything silly, and the rest just happens. But at the end of day, they are just software, that works with hardware, and use some great tricks or abstraction. So we will dive into that
Code to read
Enjoy a slice! A utility library for dealing with slices and maps that focuses on type safety and performance.
Goa tool that lets you execute commands on a server by sending UDP packets. The commands are configured on the server side, so the client does not define what is going to be executed, it only picks from existing commands.
RustJavaScript library for all kinds of color manipulations. Working with color is really fun because it invole a lot of matrix manipulation and some cool tip.
JavaScriptTools
a visualization grammar, a declarative language for creating, saving, and sharing interactive visualization designs. With Vega, you can describe the visual appearance and interactive behavior of a visualization in a JSON format, and generate web-based views using Canvas or SVG.
DuckDB-powered Postgres for high performance apps & analytics. Check out the introduction post
Self Hosted
Pull Request-like Review/Approval flow for database queries. For compliant but smooth Engineering access to production.
Instant is a client-side database that makes it easy to build real-time and collaborative apps like Notion or Figma.
allows you to build private and resilient communications platforms that are in complete control and ownership of the people that use them. No signups, no agreements, no handover of any data, no permissions and gatekeepers.
You can view this issue in web browser.
If you have any suggestion/feedback, do tell me by replying to this email. I read them all.
No longer want to receive these emails? Unsubscribe
Older messages
BetterDev #263 - What every SRE should know about GNU/Linux resolvers and Dual-Stack applications
Tuesday, August 20, 2024
Better Dev #263 Aug 19, 2024 Hi all, Another issue for another week. Trying to get back to my schedule. If you like BetterDev, please help spead word out by refer to your friends. Buy me a coffee would
BetterDev #261 - Hacking Millions of Modems (and Investigating Who Hacked My Modem)
Tuesday, June 11, 2024
Better Dev #261 Jun 10, 2024 Hi all, We come back with a new issue this week. If you like BetterDev, please help spead word out by refer to your friends. Buy me a coffee would be great too. Hacking
BetterDev #260 - The Worst Website In The Entire World and Uber Migrates 1T Records from DynamoDB to LedgerStore to Save $6M Annually
Wednesday, May 22, 2024
Better Dev #260 May 21, 2024 Hi all, We come back with a new issue this week. If you like BetterDev, please help spead word out by refer to your friends. Buy me a coffee would be great too. I'm a
BetterDev #259 - How LLMs Work, Explained Without Math and Turning AirPods into a Fitness Tracker to Fight Cancer
Monday, May 13, 2024
Better Dev #259 May 13, 2024 Hi all, We come back with a new issue this week. If you like BetterDev, please help spead word out by refer to your friends. Buy me a coffee would be great too. Many link
BetterDev #258 - Build an 8-bit computer from scratch and Home automation with ESP8266
Wednesday, May 1, 2024
Better Dev #258 Apr 30, 2024 Hi all, We come back with a new issue this week. If you like BetterDev, please help spead word out by refer to your friends. Buy me a coffee would be great too. Build an 8-
You Might Also Like
Overcoming Perfectionism: How to Break Free from the Enemy of Progress
Wednesday, November 27, 2024
Discover how perfectionism hinders progress and learn practical strategies to overcome the fear of imperfection, boost productivity, and achieve your goals without getting stuck in the pursuit of
🖤 Laravel Black Friday Deals!
Wednesday, November 27, 2024
The biggest deals of the year Laravel Black Friday Deals View in browser Laravel News Editor Note: We are sending this outside the regular Sunday newsletter schedule because some of these specials end
BetterDev #271 - Memory: The Forgotten History and Why did Windows 95 setup use three operating systems?
Wednesday, November 27, 2024
Better Dev #271 Nov 26, 2024 Hi all, Welcome to thanksgiving issue of BetterDev. Hope everyone had a safe and warm thanksgiving. It's getting so cold these days. If you are in warzone such as
Mapped | Unemployment Rate By U.S. State in 2024 💼
Tuesday, November 26, 2024
As of October 2024, DC and Nevada tied for the highest unemployment rate in the US at 5.7%. Which states saw the lowest rates? View Online | Subscribe | Download Our App FINAL CHANCE - ENDS TONIGHT!
🔊 7 DIY Tips for Soundproofing a Room — Why I Switched to Xfce for Linux Mint
Tuesday, November 26, 2024
Also: Home Theater Sound Terms Explained, and More! How-To Geek Logo November 26, 2024 Did You Know The shiny layer of a CD doesn't contain the data; the plastic polycarbonate layer does. The shiny
JSK Daily for Nov 26, 2024
Tuesday, November 26, 2024
JSK Daily for Nov 26, 2024 View this email in your browser A community curated daily e-mail of JavaScript news JavaScript Certification Black Friday Offer – Up to 54% Off! Certificates.dev, the trusted
NumPy, Loop Targets, Vector Animation, and More
Tuesday, November 26, 2024
NumPy Practical Examples: Useful Techniques #657 – NOVEMBER 26, 2024 VIEW IN BROWSER The PyCoder's Weekly Logo NumPy Practical Examples: Useful Techniques In this tutorial, you'll learn how to
Your Games Quarterly newsletter has arrived
Tuesday, November 26, 2024
What's new for games in Google Play and Android Email not displaying correctly? View it online November 2024 The First Developer Preview of Android 16 The First Developer Preview of Android 16
Daily Coding Problem: Problem #1620 [Hard]
Tuesday, November 26, 2024
Daily Coding Problem Good morning! Here's your coding interview problem for today. This problem was asked by Dropbox. Sudoku is a puzzle where you're given a partially-filled 9 by 9 grid with
Final Hours: Help Save "The Art of Data" From Falling Short 🙏
Tuesday, November 26, 2024
Will Visual Capitalist end up revealing the secrets behind data storytelling? There are 12 hours left to change the fate of "The Art of Data". View Online | Subscribe | Download Our App Help