BetterDev #242 - Neural Networks: Zero to Hero and Bit Hacking with Go code
Better Dev #242 Feb 13, 2023
A course by Andrej Karpathy on building neural networks, from scratch, in code. We start with the basics of backpropagation and build up to modern deep neural networks, like GPT. In my opinion language models are an excellent place to learn deep learning, even if your intention is to eventually go to other areas like computer vision because most of what you learn will be immediately transferable. This is why we dive into and focus on languade models.
What is the magic of GPT? I want to understand how GPT works but can easily get lost in so many terms and papers so by looking at a minimal implementation give me some ideas.
Don’t let the “Go code” put you off if you aren’t a Go user. Bit manipulation is the fundamental in programming. It can do quite a cool tricks such as check same sign(positive/negative) by looking at the last bit of both number or a fast way to compute avg.
FILTER and CASE can be use in an aggregate funcion in your SQL to caculate a value from a set of row that match the conditions. They looks similar in term of functionality, but FILTER is much nicer to read because its appear on the left of your aggregate function, not wrap around like case. So is there any perf impact? Generally, no, you can safely switch to FILTER.
You do not have to follow these rules every time. If you have a good reason to break any of them, do. But they are safe to follow every time.
There is a certain directory on MacOS has a specific icon in Finder. So let looks at how they work
explain how YouTube works under the hood, how it serves streams to the client, and also how you can exploit that knowledge to download videos from the site
A window function performs a calculation across a set of table rows that are somehow related to the current row. It’s very flexible because it doesn’t need to pre-group row, and can work It’s useful to calculate extra data between the current row and a group of row related to current row by any condition that you can express in code. This post has many practical use of window function to calculate ranking
Introduce many approachs we can use to do responsive design in 2023. If you never heard of clamp
, minxmax
, Size Container Queries.. time to refresh your CSS skill for 2023.
Code to read
A pathfinding visualizer made in Python and Pygame. This project aims to provide a fun and interactive way to learn about popular pathfinding algorithms such as Dijkstra’s, A* and other supported algorithms.
Pythona library preloader to speed up process startup, uses a client/server approach. The server loads the libraries and listens on a UNIX socket, and the client connects to that socket to run a process. For each client connection, the server forks a worker process, which uses the current directory, stdin, stdout, stderr, and environment of the client process. The worker process then processes the arguments provided by the client.
RubyIf you need to handle many common spreadsheet types, looks no more. It supports Excel, Libre, CSV, and even google sheet.
RubyAn SVG rendering library. It can do thing like accept SVG, render to PNG and customize SVG attribute. There is also a JavaScript binding call resvg-js
Rustboxxy is a tool for boxing up misbehaving Linux applications and forcing them to put their files and directories in the right place, without symlinks! It uses Linux namespaces for its functionality. Kind of like docker, but here simply prefix your command with boxxy
and boxxy setup a namespace file system with dir mount etc then run your process inside that namespace. It’s Rust but you will learn a lot about this concept. Highly recomended to check it out.
A fast, offline-first, reactive database for JavaScript. We linked to it on issue 122 but it’s still going strong
TypeScriptA minimal PyTorch re-implementation of the OpenAI GPT (Generative Pretrained Transformer) training
PythonVideo
Andrej implements nanoGPT which we linked to in issue #238 and this is a video to show some aspect of its
Tools
a Postgres extension for adding hypothetical indexes to Postgres so you can do index planning. Read the introduction article to get a sense of it.
A “Notion-style” block-based extensible JavaScript text editor built on top of Prosemirror and Tiptap. I always need these JS editor at some points and having a set of option to pick is great.
When working with message queue we sometimes need ability to peek into the queue from CLI. With so many solutions like Kafka, RabbitMQ, PubSub, SNS,Nats, Redis,… it’s hard to remember all the syntax. This tool rule them all using a consistent syntax. Support a lot of message queues system.
Query, provision and operate Cloud and SaaS resources(such as AWS, GCP, Azure, Okta, Github,…) and APIs using an extensible SQL. Super useful when you want to have a big picture of what resources we have in a big org, not just for AWS, GCP but say how many users we have in Github and who belongs to which group
aims to be a reliable, easy-to-use backup and restore solution that can seamlessly scale up to the largest databases and workloads by utilizing algorithms that are optimized for database-specific requirements.
a template for you to create your own customized, high-availability solution using Python and - for maximum accessibility - a distributed configuration store like ZooKeeper, etcd, Consul or Kubernetes.
List of ngrok alternatives and other ngrok-like tunneling software and services. Focus on self-hosting.
an observability tool that consumes logs from various inputs, transforms them, and exports logs and/or metrics to a chosen target.
You can view this issue in web browser.
If you have any suggestion/feedback, do tell me by replying to this email. I read them all.
No longer want to receive these emails? Unsubscribe
Older messages
BetterDev #241 - How a single line of code brought down a half-billion euro rocket launch
Monday, February 6, 2023
Better Dev #241 Feb 06, 2023 How a single line of code brought down a half-billion euro rocket launch How a rocket launch fail? Re-use of code written for 32-bit system on a 64-bit data range. Novo
BetterDev #240 - Hello, PNG
Tuesday, January 24, 2023
Better Dev #240 Jan 23, 2023 Start speaking a new language in just three weeks with Babbel (SPONSOR) Learning to speak a new language goes beyond just vocabulary: it's about being able to hold a
BetterDev #239 - What happens when you open a terminal and enter ‘ls’
Friday, January 20, 2023
Better Dev #239 Jan 16, 2023 What happens when you open a terminal and enter 'ls' This could be the equivalent of the in famous “what happen when you type an address into the browser”, but for
BetterDev #238 - Avoiding Double Payments in a Distributed Payments System
Monday, January 9, 2023
Better Dev #238 Jan 9, 2023 Hi everyone, this week is security week. First, if you used CircleCI, make sure to rotate any secret since they suffered a breach. Second, Slack private repository got
BetterDev #237 - Challenging algorithms and data structures every programmer should try
Monday, January 2, 2023
Better Dev #237 Jan 2, 2023 Happy new year everyone. 2022 was a brutal year for me. A few app and idea I was working on wasnt turning out well and my start-up also shutdown. At the end of 2022, I got a
You Might Also Like
The Sequence Chat: Why are Foundation Models so Hard to Explain and What are we Doing About it?
Wednesday, November 27, 2024
Addressing some of the interpretability challenges of foundation models and the emerging fields of mechanistic interpretability and behavioral probing. ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏
Overcoming Perfectionism: How to Break Free from the Enemy of Progress
Wednesday, November 27, 2024
Discover how perfectionism hinders progress and learn practical strategies to overcome the fear of imperfection, boost productivity, and achieve your goals without getting stuck in the pursuit of
🖤 Laravel Black Friday Deals!
Wednesday, November 27, 2024
The biggest deals of the year Laravel Black Friday Deals View in browser Laravel News Editor Note: We are sending this outside the regular Sunday newsletter schedule because some of these specials end
BetterDev #271 - Memory: The Forgotten History and Why did Windows 95 setup use three operating systems?
Wednesday, November 27, 2024
Better Dev #271 Nov 26, 2024 Hi all, Welcome to thanksgiving issue of BetterDev. Hope everyone had a safe and warm thanksgiving. It's getting so cold these days. If you are in warzone such as
Mapped | Unemployment Rate By U.S. State in 2024 💼
Tuesday, November 26, 2024
As of October 2024, DC and Nevada tied for the highest unemployment rate in the US at 5.7%. Which states saw the lowest rates? View Online | Subscribe | Download Our App FINAL CHANCE - ENDS TONIGHT!
🔊 7 DIY Tips for Soundproofing a Room — Why I Switched to Xfce for Linux Mint
Tuesday, November 26, 2024
Also: Home Theater Sound Terms Explained, and More! How-To Geek Logo November 26, 2024 Did You Know The shiny layer of a CD doesn't contain the data; the plastic polycarbonate layer does. The shiny
JSK Daily for Nov 26, 2024
Tuesday, November 26, 2024
JSK Daily for Nov 26, 2024 View this email in your browser A community curated daily e-mail of JavaScript news JavaScript Certification Black Friday Offer – Up to 54% Off! Certificates.dev, the trusted
NumPy, Loop Targets, Vector Animation, and More
Tuesday, November 26, 2024
NumPy Practical Examples: Useful Techniques #657 – NOVEMBER 26, 2024 VIEW IN BROWSER The PyCoder's Weekly Logo NumPy Practical Examples: Useful Techniques In this tutorial, you'll learn how to
Your Games Quarterly newsletter has arrived
Tuesday, November 26, 2024
What's new for games in Google Play and Android Email not displaying correctly? View it online November 2024 The First Developer Preview of Android 16 The First Developer Preview of Android 16
Daily Coding Problem: Problem #1620 [Hard]
Tuesday, November 26, 2024
Daily Coding Problem Good morning! Here's your coding interview problem for today. This problem was asked by Dropbox. Sudoku is a puzzle where you're given a partially-filled 9 by 9 grid with