BetterDev #242 - Neural Networks: Zero to Hero and Bit Hacking with Go code
Better Dev #242 Feb 13, 2023
A course by Andrej Karpathy on building neural networks, from scratch, in code. We start with the basics of backpropagation and build up to modern deep neural networks, like GPT. In my opinion language models are an excellent place to learn deep learning, even if your intention is to eventually go to other areas like computer vision because most of what you learn will be immediately transferable. This is why we dive into and focus on languade models.
What is the magic of GPT? I want to understand how GPT works but can easily get lost in so many terms and papers so by looking at a minimal implementation give me some ideas.
Don’t let the “Go code” put you off if you aren’t a Go user. Bit manipulation is the fundamental in programming. It can do quite a cool tricks such as check same sign(positive/negative) by looking at the last bit of both number or a fast way to compute avg.
FILTER and CASE can be use in an aggregate funcion in your SQL to caculate a value from a set of row that match the conditions. They looks similar in term of functionality, but FILTER is much nicer to read because its appear on the left of your aggregate function, not wrap around like case. So is there any perf impact? Generally, no, you can safely switch to FILTER.
You do not have to follow these rules every time. If you have a good reason to break any of them, do. But they are safe to follow every time.
There is a certain directory on MacOS has a specific icon in Finder. So let looks at how they work
explain how YouTube works under the hood, how it serves streams to the client, and also how you can exploit that knowledge to download videos from the site
A window function performs a calculation across a set of table rows that are somehow related to the current row. It’s very flexible because it doesn’t need to pre-group row, and can work It’s useful to calculate extra data between the current row and a group of row related to current row by any condition that you can express in code. This post has many practical use of window function to calculate ranking
Introduce many approachs we can use to do responsive design in 2023. If you never heard of clamp
, minxmax
, Size Container Queries.. time to refresh your CSS skill for 2023.
Code to read
A pathfinding visualizer made in Python and Pygame. This project aims to provide a fun and interactive way to learn about popular pathfinding algorithms such as Dijkstra’s, A* and other supported algorithms.
Pythona library preloader to speed up process startup, uses a client/server approach. The server loads the libraries and listens on a UNIX socket, and the client connects to that socket to run a process. For each client connection, the server forks a worker process, which uses the current directory, stdin, stdout, stderr, and environment of the client process. The worker process then processes the arguments provided by the client.
RubyIf you need to handle many common spreadsheet types, looks no more. It supports Excel, Libre, CSV, and even google sheet.
RubyAn SVG rendering library. It can do thing like accept SVG, render to PNG and customize SVG attribute. There is also a JavaScript binding call resvg-js
Rustboxxy is a tool for boxing up misbehaving Linux applications and forcing them to put their files and directories in the right place, without symlinks! It uses Linux namespaces for its functionality. Kind of like docker, but here simply prefix your command with boxxy
and boxxy setup a namespace file system with dir mount etc then run your process inside that namespace. It’s Rust but you will learn a lot about this concept. Highly recomended to check it out.
A fast, offline-first, reactive database for JavaScript. We linked to it on issue 122 but it’s still going strong
TypeScriptA minimal PyTorch re-implementation of the OpenAI GPT (Generative Pretrained Transformer) training
PythonVideo
Andrej implements nanoGPT which we linked to in issue #238 and this is a video to show some aspect of its
Tools
a Postgres extension for adding hypothetical indexes to Postgres so you can do index planning. Read the introduction article to get a sense of it.
A “Notion-style” block-based extensible JavaScript text editor built on top of Prosemirror and Tiptap. I always need these JS editor at some points and having a set of option to pick is great.
When working with message queue we sometimes need ability to peek into the queue from CLI. With so many solutions like Kafka, RabbitMQ, PubSub, SNS,Nats, Redis,… it’s hard to remember all the syntax. This tool rule them all using a consistent syntax. Support a lot of message queues system.
Query, provision and operate Cloud and SaaS resources(such as AWS, GCP, Azure, Okta, Github,…) and APIs using an extensible SQL. Super useful when you want to have a big picture of what resources we have in a big org, not just for AWS, GCP but say how many users we have in Github and who belongs to which group
aims to be a reliable, easy-to-use backup and restore solution that can seamlessly scale up to the largest databases and workloads by utilizing algorithms that are optimized for database-specific requirements.
a template for you to create your own customized, high-availability solution using Python and - for maximum accessibility - a distributed configuration store like ZooKeeper, etcd, Consul or Kubernetes.
List of ngrok alternatives and other ngrok-like tunneling software and services. Focus on self-hosting.
an observability tool that consumes logs from various inputs, transforms them, and exports logs and/or metrics to a chosen target.
You can view this issue in web browser.
If you have any suggestion/feedback, do tell me by replying to this email. I read them all.
No longer want to receive these emails? Unsubscribe
Key phrases
Older messages
BetterDev #241 - How a single line of code brought down a half-billion euro rocket launch
Monday, February 6, 2023
Better Dev #241 Feb 06, 2023 How a single line of code brought down a half-billion euro rocket launch How a rocket launch fail? Re-use of code written for 32-bit system on a 64-bit data range. Novo
BetterDev #240 - Hello, PNG
Tuesday, January 24, 2023
Better Dev #240 Jan 23, 2023 Start speaking a new language in just three weeks with Babbel (SPONSOR) Learning to speak a new language goes beyond just vocabulary: it's about being able to hold a
BetterDev #239 - What happens when you open a terminal and enter ‘ls’
Friday, January 20, 2023
Better Dev #239 Jan 16, 2023 What happens when you open a terminal and enter 'ls' This could be the equivalent of the in famous “what happen when you type an address into the browser”, but for
BetterDev #238 - Avoiding Double Payments in a Distributed Payments System
Monday, January 9, 2023
Better Dev #238 Jan 9, 2023 Hi everyone, this week is security week. First, if you used CircleCI, make sure to rotate any secret since they suffered a breach. Second, Slack private repository got
BetterDev #237 - Challenging algorithms and data structures every programmer should try
Monday, January 2, 2023
Better Dev #237 Jan 2, 2023 Happy new year everyone. 2022 was a brutal year for me. A few app and idea I was working on wasnt turning out well and my start-up also shutdown. At the end of 2022, I got a
You Might Also Like
React Native Newsletter #181
Tuesday, April 30, 2024
This week's issue features This week's issue features articles about the release of RN 0.74 and React 19 Beta Issue 181 • Open in browser React Native Newsletter This issue: Release of RN 0.74
An inside look at Techstars’ horrible year
Tuesday, April 30, 2024
TechCrunch spoke with over 30 people to find out just what happened at Techstars last year View this email online in your browser By Alex Wilhelm Tuesday, April 30, 2024 Welcome to TechCrunch AM! This
LW 131 - Test And Debug Shopify Functions
Tuesday, April 30, 2024
Test And Debug Shopify Functions Shopify Development news and articles Issue 131 - 04/30/2024 Read Online Liquid Weekly All Things Shopify Development Test And Debug Shopify Functions In this video we
Node.js 22; Bun 1.1.5; JSR is not a package manager
Tuesday, April 30, 2024
We have 5 links for you - Stay up-to-date on JavaScript and tools Node.js 22: require() ESM modules, --run package scripts, --watch files, fs.glob() and more nodejs.org @nodejs@social.lfx.dev
Meta is offering popular Threads users thousands of dollars in bonuses
Tuesday, April 30, 2024
The Morning After It's Tuesday, April 30, 2024. Meta is offering some creators thousands of dollars if they go viral on Threads. The payouts are part of a new invitation-only bonus program that
New U.K. Law Bans Default Passwords on Smart Devices Starting April 2024
Tuesday, April 30, 2024
THN Daily Updates Newsletter cover Coding with AI For Dummies ($18.00 Value) FREE for a Limited Time Boost your coding output and accuracy with artificial intelligence tools Download Now Sponsored
Post from Syncfusion Blogs on 04/30/2024
Tuesday, April 30, 2024
New blogs from Syncfusion Start Using the npm Query Today: Powerful Commands for Every Developer By Osusara Kammalawatta Explore npm query commands for efficient dependency management in Node.js.
Edge 391: Autonomous Agents and LLM Function Calling
Tuesday, April 30, 2024
LLMs that invoke external functions, UC Berkeley's LLM Compiler and the Phidata framework. ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏
China approves Tesla FSD 🚗, GitHub Copilot Workspace 👨💻, Mystery chatbot appears 🤖
Tuesday, April 30, 2024
China's government has signaled its blessing for Tesla to roll out its advanced driver-assistance service in the country Sign Up |Advertise|View Online TLDR Together With Dollar Flight Club TLDR
I/O is coming, get ready
Tuesday, April 30, 2024
What's new in Google Play and Android Email not displaying correctly? View it online April 2024 Google I/O program details are now live Google I/O program details are now live Get a sneak peek at