BetterDev #247 - Cryptographic Best Practices and A Journey through Color Space with FFmpeg
Better Dev #247 Apr 17, 2023
These continue to be big weeks in AI world. I share some LLM tools. Enjoy.
Putting cryptographic primitives together is a lot like putting a jigsaw puzzle together, where all the pieces are cut exactly the same way, but there is only one correct solution. Thankfully, there are some projects out there that are working hard to make sure developers are getting it right.
For those who want to understand color spaces, transform videos from one color space to another, or read how I almost went crazy working out why my Canva-generated videos looked slightly off, color-wise
iMessage is slow and clunky when searching message. At the end, it’s just text store in a SQLIte database. If we can reverse engineer it, we can yield better search result
A very detail write up on how to generate enough power for the OP usage on his equipment. Fun experiment and I think it feeling great when knowing the blog is powered by Solar energy :)
In this post we’re going to focus on the ways that a single load balancer might distribute HTTP requests to a set of servers. We’ll start from the bottom and work our way up to modern load balancing algorithms.
Someone asked if I could write about the rise of AI and Large Language Models (LLMs) and what I think that means for the future of people, technology, society, and so on. Although that’s a fun topic, it left me with two problems: I know approximately nothing about AI, and predicting the future is hard even for people who know what they’re talking about. Instead, I’ll tell you a bunch of things I do know that are somehow related to the topic, and then you can predict the future yourself.
Slack is a very complicated system with complicated rule. Mute channel, when to send notification, where(email or device), did user see this notification in email already? Debugging notification is complicated at Slack scale, so they build a system to trace the notification across the system.
Challenge of Microservice is they call each others, one client request turns into many internal RPC call, and amplify the failure rate when making these requests due to nature of network. Retrying is often use, but if the service is completeley failed, how can we skip it immediately. This is DoorDash strategy for that
help beginners understand and set up server replication in PostgreSQL using failover and failback. Postgres evolve fast and process to setup Postgres replication is way simpler than in Postgres 10 or 12 for example.
Storing time ranges in a database is easy, but you must also prevent overlapping rows for some applications. Accomplishing this requirement can be challenging because of race conditions.
A tip to monitor the progress of certain operations in PostgreSQL? Yes, we can monitor the progress of these operations in PostgreSQL: index creation, re-index, vacuum, and more
Code to read
A component toolkit for creating live-running code editing experiences, using the power of CodeSandbox.
One of a neat way to extend Postgres is define your own function using SQL. But needless to say SQL has its limit, so there are PL/Python where you can define function with Python code. Now that go futher, you can define function in Rust, which compile to native machine code, not interprer through Postgres engine, so you will get great performance
RustA PostgreSQL extension provides few general credential checks, which will be evaluated during the user creation, during the password change and user renaming. By using this extension, we can define a set of rules like password policy or password expiration
CA tool by DDH to deploy web app anywhere. Similar to capistrano but with a strong focus on docker deployment and coordination with load balancer.
RubyThis project brings language model chats directly onto web browsers. Everything runs inside the browser with no server support and accelerated with WebGPU. We can bring a lot of fun opportunities to build AI assistants for everyone and enable privacy while enjoying GPU acceleration.
PythonPure Go implementation of OpenAI’s tiktoken tokenizer. Also checkout OpenAI’s Go API client
GoTools
A self-hosted archiving service integrated with Internet Archive, archive.today, IPFS and beyond.
The perfect library for adding search, sort, filters and flexibility to tables, lists and various HTML elements. Built to be invisible and work on existing HTML.
A simple, standalone, and lightweight tool that can do health/status checking, written in Go.
a tool that can help you manage and optimize the performance of your PostgreSQL database cluster. Enable you to do Load balancing, Connection pooling, Query caching and more.
makes it easy to avoid vendor lock-in. You can use many open source icon sets with a large choice of open source icon components. Thousands of high quality icons from 100+ icon sets, all validated, cleaned up, optimised and always up to date
You can view this issue in web browser.
If you have any suggestion/feedback, do tell me by replying to this email. I read them all.
No longer want to receive these emails? Unsubscribe
Key phrases
Older messages
BetterDev #246 - Is your Postgres ready for production and where to store your OAuth tokens
Monday, April 3, 2023
Better Dev #246 Apr 03, 2023 Is your Postgres ready for production? your database ready for whatever may come on launch day or even 2 months in? Here's a handy checklist to make sure you're not
BetterDev #245 - Scaling Kubernetes to 7,500 nodes
Monday, March 20, 2023
Better Dev #245 Mar 20, 2023 Scaling Kubernetes to 7500 nodes At this point no one doesn't know OpenAI and their ChatGPT. They run a massive K8S cluster with 7500 nodes. Needless to say that come
BetterDev #244 - How discord stores trillions of messages and How Cloudflare run Prometheus at scale
Monday, March 13, 2023
Better Dev #244 Mar 13, 2023 How discord stores trillions of messages Rewrite in Rust, migrate to ScylaDB from cassandra. But the most important thing to me is the request coalescing. If two user read
BetterDev #243 - Scaling Etsy Payments with Vitess and Husky DataDog Exactly Once Ingestion and Multi Tenancy at Scale
Monday, February 27, 2023
Better Dev #243 Feb 26, 2023 Scaling Etsy Payments with Vitess: Part 1 – The Data Model Etsy Payment system reached the point where vertical scale won't work anymore. They used biggest instance on
BetterDev #242 - Neural Networks: Zero to Hero and Bit Hacking with Go code
Monday, February 13, 2023
Better Dev #242 Feb 13, 2023 Neural Networks: Zero to Hero A course by Andrej Karpathy on building neural networks, from scratch, in code. We start with the basics of backpropagation and build up to
You Might Also Like
Data Science Weekly - Issue 543
Friday, April 19, 2024
Curated news, articles and jobs related to Data Science, AI, & Machine Learning ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏
A deal made in cloud security heaven
Thursday, April 18, 2024
Meta's Llama 3 goes public and hackers hold World-Check data for ransom View this email online in your browser By Christine Hall Thursday, April 18, 2024 Welcome to TechCrunch PM! I'm glad you
💎 Issue 413 - RubyJS-Vite
Thursday, April 18, 2024
This week's Awesome Ruby Newsletter Read this email on the Web The Awesome Ruby Newsletter Issue » 413 Release Date Apr 18, 2024 Your weekly report of the most popular Ruby news, articles and
💻 Issue 406 - Swift for C++ Practitioners, Part 1
Thursday, April 18, 2024
This week's Awesome .NET Weekly Read this email on the Web The Awesome .NET Weekly Issue » 406 Release Date Apr 18, 2024 Your weekly report of the most popular .NET news, articles and projects
💻 Issue 413 - How to implement HLS Video Streaming in a React App
Thursday, April 18, 2024
This week's Awesome Node.js Weekly Read this email on the Web The Awesome Node.js Weekly Issue » 413 Release Date Apr 18, 2024 Your weekly report of the most popular Node.js news, articles and
📱 Issue 407 - Textual Healing: iOS Text Editing Minutiae
Thursday, April 18, 2024
This week's Awesome iOS Weekly Read this email on the Web The Awesome iOS Weekly Issue » 407 Release Date Apr 18, 2024 Your weekly report of the most popular iOS news, articles and projects Popular
💻 Issue 413 - Interview with Senior JavaScript Developer 2024 [video]
Thursday, April 18, 2024
This week's Awesome JavaScript Weekly Read this email on the Web The Awesome JavaScript Weekly Issue » 413 Release Date Apr 18, 2024 Your weekly report of the most popular JavaScript news, articles
💻 Issue 331 - 30+ app ideas with complete source code
Thursday, April 18, 2024
This week's Awesome React Weekly Read this email on the Web The Awesome React Weekly Issue » 331 Release Date Apr 18, 2024 Your weekly report of the most popular React news, articles and projects
💻 Issue 408 - Curl: Hyper, is it worth it?
Thursday, April 18, 2024
This week's Awesome Rust Weekly Read this email on the Web The Awesome Rust Weekly Issue » 408 Release Date Apr 18, 2024 Your weekly report of the most popular Rust news, articles and projects
📱 Issue 410 - Swift for C++ Practitioners, Part 1
Thursday, April 18, 2024
This week's Awesome Swift Weekly Read this email on the Web The Awesome Swift Weekly Issue » 410 Release Date Apr 18, 2024 Your weekly report of the most popular Swift news, articles and projects