BetterDev #247 - Cryptographic Best Practices and A Journey through Color Space with FFmpeg
Better Dev #247 Apr 17, 2023
These continue to be big weeks in AI world. I share some LLM tools. Enjoy.
Putting cryptographic primitives together is a lot like putting a jigsaw puzzle together, where all the pieces are cut exactly the same way, but there is only one correct solution. Thankfully, there are some projects out there that are working hard to make sure developers are getting it right.
For those who want to understand color spaces, transform videos from one color space to another, or read how I almost went crazy working out why my Canva-generated videos looked slightly off, color-wise
iMessage is slow and clunky when searching message. At the end, it’s just text store in a SQLIte database. If we can reverse engineer it, we can yield better search result
A very detail write up on how to generate enough power for the OP usage on his equipment. Fun experiment and I think it feeling great when knowing the blog is powered by Solar energy :)
In this post we’re going to focus on the ways that a single load balancer might distribute HTTP requests to a set of servers. We’ll start from the bottom and work our way up to modern load balancing algorithms.
Someone asked if I could write about the rise of AI and Large Language Models (LLMs) and what I think that means for the future of people, technology, society, and so on. Although that’s a fun topic, it left me with two problems: I know approximately nothing about AI, and predicting the future is hard even for people who know what they’re talking about. Instead, I’ll tell you a bunch of things I do know that are somehow related to the topic, and then you can predict the future yourself.
Slack is a very complicated system with complicated rule. Mute channel, when to send notification, where(email or device), did user see this notification in email already? Debugging notification is complicated at Slack scale, so they build a system to trace the notification across the system.
Challenge of Microservice is they call each others, one client request turns into many internal RPC call, and amplify the failure rate when making these requests due to nature of network. Retrying is often use, but if the service is completeley failed, how can we skip it immediately. This is DoorDash strategy for that
help beginners understand and set up server replication in PostgreSQL using failover and failback. Postgres evolve fast and process to setup Postgres replication is way simpler than in Postgres 10 or 12 for example.
Storing time ranges in a database is easy, but you must also prevent overlapping rows for some applications. Accomplishing this requirement can be challenging because of race conditions.
A tip to monitor the progress of certain operations in PostgreSQL? Yes, we can monitor the progress of these operations in PostgreSQL: index creation, re-index, vacuum, and more
Code to read
A component toolkit for creating live-running code editing experiences, using the power of CodeSandbox.
One of a neat way to extend Postgres is define your own function using SQL. But needless to say SQL has its limit, so there are PL/Python where you can define function with Python code. Now that go futher, you can define function in Rust, which compile to native machine code, not interprer through Postgres engine, so you will get great performance
RustA PostgreSQL extension provides few general credential checks, which will be evaluated during the user creation, during the password change and user renaming. By using this extension, we can define a set of rules like password policy or password expiration
CA tool by DDH to deploy web app anywhere. Similar to capistrano but with a strong focus on docker deployment and coordination with load balancer.
RubyThis project brings language model chats directly onto web browsers. Everything runs inside the browser with no server support and accelerated with WebGPU. We can bring a lot of fun opportunities to build AI assistants for everyone and enable privacy while enjoying GPU acceleration.
PythonPure Go implementation of OpenAI’s tiktoken tokenizer. Also checkout OpenAI’s Go API client
GoTools
A self-hosted archiving service integrated with Internet Archive, archive.today, IPFS and beyond.
The perfect library for adding search, sort, filters and flexibility to tables, lists and various HTML elements. Built to be invisible and work on existing HTML.
A simple, standalone, and lightweight tool that can do health/status checking, written in Go.
a tool that can help you manage and optimize the performance of your PostgreSQL database cluster. Enable you to do Load balancing, Connection pooling, Query caching and more.
makes it easy to avoid vendor lock-in. You can use many open source icon sets with a large choice of open source icon components. Thousands of high quality icons from 100+ icon sets, all validated, cleaned up, optimised and always up to date
You can view this issue in web browser.
If you have any suggestion/feedback, do tell me by replying to this email. I read them all.
No longer want to receive these emails? Unsubscribe
Older messages
BetterDev #246 - Is your Postgres ready for production and where to store your OAuth tokens
Monday, April 3, 2023
Better Dev #246 Apr 03, 2023 Is your Postgres ready for production? your database ready for whatever may come on launch day or even 2 months in? Here's a handy checklist to make sure you're not
BetterDev #245 - Scaling Kubernetes to 7,500 nodes
Monday, March 20, 2023
Better Dev #245 Mar 20, 2023 Scaling Kubernetes to 7500 nodes At this point no one doesn't know OpenAI and their ChatGPT. They run a massive K8S cluster with 7500 nodes. Needless to say that come
BetterDev #244 - How discord stores trillions of messages and How Cloudflare run Prometheus at scale
Monday, March 13, 2023
Better Dev #244 Mar 13, 2023 How discord stores trillions of messages Rewrite in Rust, migrate to ScylaDB from cassandra. But the most important thing to me is the request coalescing. If two user read
BetterDev #243 - Scaling Etsy Payments with Vitess and Husky DataDog Exactly Once Ingestion and Multi Tenancy at Scale
Monday, February 27, 2023
Better Dev #243 Feb 26, 2023 Scaling Etsy Payments with Vitess: Part 1 – The Data Model Etsy Payment system reached the point where vertical scale won't work anymore. They used biggest instance on
BetterDev #242 - Neural Networks: Zero to Hero and Bit Hacking with Go code
Monday, February 13, 2023
Better Dev #242 Feb 13, 2023 Neural Networks: Zero to Hero A course by Andrej Karpathy on building neural networks, from scratch, in code. We start with the basics of backpropagation and build up to
You Might Also Like
Matrix Botnet Exploits IoT Devices in Widespread DDoS Botnet Campaign
Wednesday, November 27, 2024
THN Daily Updates Newsletter cover The AI Value Playbook ($35.99) FREE for a Limited Time Business leaders are challenged by the speed of AI innovation and how to navigate disruption and uncertainty.
The Sequence Chat: Why are Foundation Models so Hard to Explain and What are we Doing About it?
Wednesday, November 27, 2024
Addressing some of the interpretability challenges of foundation models and the emerging fields of mechanistic interpretability and behavioral probing. ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏
Overcoming Perfectionism: How to Break Free from the Enemy of Progress
Wednesday, November 27, 2024
Discover how perfectionism hinders progress and learn practical strategies to overcome the fear of imperfection, boost productivity, and achieve your goals without getting stuck in the pursuit of
🖤 Laravel Black Friday Deals!
Wednesday, November 27, 2024
The biggest deals of the year Laravel Black Friday Deals View in browser Laravel News Editor Note: We are sending this outside the regular Sunday newsletter schedule because some of these specials end
BetterDev #271 - Memory: The Forgotten History and Why did Windows 95 setup use three operating systems?
Wednesday, November 27, 2024
Better Dev #271 Nov 26, 2024 Hi all, Welcome to thanksgiving issue of BetterDev. Hope everyone had a safe and warm thanksgiving. It's getting so cold these days. If you are in warzone such as
Mapped | Unemployment Rate By U.S. State in 2024 💼
Tuesday, November 26, 2024
As of October 2024, DC and Nevada tied for the highest unemployment rate in the US at 5.7%. Which states saw the lowest rates? View Online | Subscribe | Download Our App FINAL CHANCE - ENDS TONIGHT!
🔊 7 DIY Tips for Soundproofing a Room — Why I Switched to Xfce for Linux Mint
Tuesday, November 26, 2024
Also: Home Theater Sound Terms Explained, and More! How-To Geek Logo November 26, 2024 Did You Know The shiny layer of a CD doesn't contain the data; the plastic polycarbonate layer does. The shiny
JSK Daily for Nov 26, 2024
Tuesday, November 26, 2024
JSK Daily for Nov 26, 2024 View this email in your browser A community curated daily e-mail of JavaScript news JavaScript Certification Black Friday Offer – Up to 54% Off! Certificates.dev, the trusted
NumPy, Loop Targets, Vector Animation, and More
Tuesday, November 26, 2024
NumPy Practical Examples: Useful Techniques #657 – NOVEMBER 26, 2024 VIEW IN BROWSER The PyCoder's Weekly Logo NumPy Practical Examples: Useful Techniques In this tutorial, you'll learn how to
Your Games Quarterly newsletter has arrived
Tuesday, November 26, 2024
What's new for games in Google Play and Android Email not displaying correctly? View it online November 2024 The First Developer Preview of Android 16 The First Developer Preview of Android 16