BetterDev #171 - How to remove the first 300 million lines from a 700 GB txt file on a system with 1 TB max disk space?
Better Dev #171 Sep 28, 2020
Hi everyone, Welcome to issue #171.
The accepted answer is boring but all other answers are very creative and informative.
Event Loop is a leak abstraction. It forces us to understand is characters to write well perform applications. It’s the primary primitive browser that allows writing code that won’t cause blocking behaviour. Callbacks, Promises and Async/Await is how to deal with event loop.
FixedArray and FixedDoubleArray are used to create objects in JavaScript, and although the new implementations looked valid at first glance, they were missing a key component: a maximum length check to ensure that the newly created array’s length cannot not go past a predefined upper limit. To the untrained eye, this bug does not look exploitable, but as shown on the bug report, Sergey made use of TurboFan’s typer to gain access to a very powerful exploitation primitive: an array whose length field is much larger than its capacity. This primitive provides an attacker with an out-of-bounds access primitive on the V8 heap, which can very easily lead to code execution
The percentile calculations were taking about 6 minutes instead of the required 30 second SLA. How and which tools we can use to debug and reduce that to the target SLA: 30 seconds
HOT stand for “Heap Only Tuple”. It is a feature that overcomes some of the inefficiencies of how PostgreSQL handles UPDATEs. Update adds a new row version call tuple. In other words, an update is like delete followed by an insert. Essentially, UPDATE-heavy workloads are challenging for PostgreSQL. This is the area where HOT updates help.
Using some high school level statistics and a fair knowledge of SQL, I implemented a simple anomaly detection system that works
Show what makes a test a good one and describe desired and unwanted properties. Interestingly enough, all those properties hold, no matter how isolated or integrated the test is
Network is the backbone of almost any cloud application. When companies scale, we add more network, qa, staging, prod, support, rds, elasticache. Eventually we need to allow those network to communicate with each others. How to manage that complexity? Adding a new network and allow traffic flow require you to add a new route table. A single bad route can cause lost traffic? Let’s learn how Slack manage that complexity
You cannot secure your wifi network without knowing about attack vectors. How will you validate that your netowrk is secure? You need to know some tools for hacking purposes.
This is in Golang code sample but you get the idea of building an inverted index, text analysis, tokenizer, filter and the trick to drop stop words - because almost anything in English contains them(such as them, I, you, etc)
The quickest way to allow SSH access is adding their public key to authorized_keys
, which obviously won’t scale. In this, we looked at how we setup a CA as a centralization auth method for SSH
Code to read
Can you imagine a battleships game implement with SQL? Yes, this is that level 9000 of SQL.
SQLa compile-time spell checker using only typescript’s type checker. obviously not that serious, but it does work.
TypeScriptLast week, I included diagrams, a tool allow us to define graph using Python code. This time we have a loose port of diagrams
Goa basic proof of concept (horribly hacked together) that allows annotating method declarations to automatically be specialized and compiled to C.
RubyVideo
Tools
Scan your site for security headers. Useful to know what headers you should set to enhance security.
a fast, memory-efficient Canvas 2D-based chart for plotting time series, lines, areas, ohlc & bars; from a cold start it can create an interactive chart containing 150,000 data points in 135ms
A few XSS snippet that you can use whenever you want to test some XSS, or test it on your own site :-).
an embeddable SQL OLAP database management system. Like SQLite but has more Postgres-like features.
You can view this issue in web browser.
If you have any suggestion/feedback, do tell me by replying to this email. I read them all.
No longer want to receive these emails? Unsubscribe
Older messages
BetterDev #170 - What Gitlab leanred after a year on Kubernetes
Monday, September 21, 2020
Better Dev #170 Sep 21, 2020 Hi everyone, Welcome to issue #170. I have noticed many companies has reduced their head count during Covid-19. So if you are looking for a job now, or want a job soon, you
BetterDev #169 - Who will test the tests themselves and How Gitlab upgraded PostgresSQL
Monday, September 14, 2020
Better Dev #169 Sep 14, 2020 Hi everyone, Welcome to issue #169. Thank you for being a reader to my newsletter. I hope you can help spread the words out by telling your friend about this :-) Mutation
BetterDev #168 - The Life of a Data Byte: Be kind and rewind and Things I Learnt from a Senior Software Enginee
Monday, September 7, 2020
Better Dev #168 Sep 07, 2020 Hi everyone, Welcome to issue #168. Let's get straight to our links this time The Life of a Data Byte: Be kind and rewind A byte of data has been stored in a number of
BetterDev #167 - WebRTC for the Curious and APIs at scale
Tuesday, September 1, 2020
Better Dev #167 Aug 31, 2020 Hi everyone, Welcome to issue #167. Let's get straight to our links this time WebRTC for the Curious This book was created by WebRTC implementers to share their hard-
BetterDev #166 - Building resilient services at Prime Video with chaos engineering
Monday, August 24, 2020
Better Dev #166 Aug 24, 2020 Hi everyone, Welcome to issue #166. Let's get straight to our links this time Building resilient services at Prime Video with chaos engineering Large-scale distributed
You Might Also Like
Spyglass Dispatch: The Xitter Bail Out • OpenAI Tender • Grokking Grok • Smartphone Sales • Fischer Random Chess • Scott Bessent for Treasury
Wednesday, November 27, 2024
The Xitter Bail Out • OpenAI Tender • Grokking Grok • Smartphone Sales • Fischer Random Chess • Scott Bessent for Treasury The Spyglass Dispatch is a free newsletter sent out daily on weekdays. Feel
The Long Road Home: A Story of Loss, Learning, and Renaissance - PART 4
Wednesday, November 27, 2024
Top Tech Content sent at Noon! How the world collects web data Read this email in your browser How are you, @newsletterest1? 🪐 What's happening in tech today, November 27, 2024? The HackerNoon
Top Tech Deals 🏷️ PS5 Slim, 4K TVs, 10th Gen iPad, and More!
Wednesday, November 27, 2024
The Black Friday madness is here! How-To Geek Logo November 27, 2024 Top Tech Deals: PS5 Slim, 4K TVs, 10th Gen iPad, and More! The Black Friday madness is here! Black Friday sales are here, and we
The 165+ best Black Friday deals
Wednesday, November 27, 2024
Windows Super God Mode; Bluesky starter packs; Tech gifts under $100 -- ZDNET ZDNET Tech Today - US November 27, 2024 Black Friday 2024 live blog Best Black Friday deals 2024: 165+ sales live now
⚙️ Neuralink's new trial
Wednesday, November 27, 2024
Plus: Zoom is becoming an AI-first company
Matrix Botnet Exploits IoT Devices in Widespread DDoS Botnet Campaign
Wednesday, November 27, 2024
THN Daily Updates Newsletter cover The AI Value Playbook ($35.99) FREE for a Limited Time Business leaders are challenged by the speed of AI innovation and how to navigate disruption and uncertainty.
The Sequence Chat: Why are Foundation Models so Hard to Explain and What are we Doing About it?
Wednesday, November 27, 2024
Addressing some of the interpretability challenges of foundation models and the emerging fields of mechanistic interpretability and behavioral probing. ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏
Overcoming Perfectionism: How to Break Free from the Enemy of Progress
Wednesday, November 27, 2024
Discover how perfectionism hinders progress and learn practical strategies to overcome the fear of imperfection, boost productivity, and achieve your goals without getting stuck in the pursuit of
🖤 Laravel Black Friday Deals!
Wednesday, November 27, 2024
The biggest deals of the year Laravel Black Friday Deals View in browser Laravel News Editor Note: We are sending this outside the regular Sunday newsletter schedule because some of these specials end
BetterDev #271 - Memory: The Forgotten History and Why did Windows 95 setup use three operating systems?
Wednesday, November 27, 2024
Better Dev #271 Nov 26, 2024 Hi all, Welcome to thanksgiving issue of BetterDev. Hope everyone had a safe and warm thanksgiving. It's getting so cold these days. If you are in warzone such as