BetterDev #242 - Neural Networks: Zero to Hero and Bit Hacking with Go code
Better Dev #242 Feb 13, 2023
A course by Andrej Karpathy on building neural networks, from scratch, in code. We start with the basics of backpropagation and build up to modern deep neural networks, like GPT. In my opinion language models are an excellent place to learn deep learning, even if your intention is to eventually go to other areas like computer vision because most of what you learn will be immediately transferable. This is why we dive into and focus on languade models.
What is the magic of GPT? I want to understand how GPT works but can easily get lost in so many terms and papers so by looking at a minimal implementation give me some ideas.
Don’t let the “Go code” put you off if you aren’t a Go user. Bit manipulation is the fundamental in programming. It can do quite a cool tricks such as check same sign(positive/negative) by looking at the last bit of both number or a fast way to compute avg.
FILTER and CASE can be use in an aggregate funcion in your SQL to caculate a value from a set of row that match the conditions. They looks similar in term of functionality, but FILTER is much nicer to read because its appear on the left of your aggregate function, not wrap around like case. So is there any perf impact? Generally, no, you can safely switch to FILTER.
You do not have to follow these rules every time. If you have a good reason to break any of them, do. But they are safe to follow every time.
There is a certain directory on MacOS has a specific icon in Finder. So let looks at how they work
explain how YouTube works under the hood, how it serves streams to the client, and also how you can exploit that knowledge to download videos from the site
A window function performs a calculation across a set of table rows that are somehow related to the current row. It’s very flexible because it doesn’t need to pre-group row, and can work It’s useful to calculate extra data between the current row and a group of row related to current row by any condition that you can express in code. This post has many practical use of window function to calculate ranking
Introduce many approachs we can use to do responsive design in 2023. If you never heard of clamp
, minxmax
, Size Container Queries.. time to refresh your CSS skill for 2023.
Code to read
A pathfinding visualizer made in Python and Pygame. This project aims to provide a fun and interactive way to learn about popular pathfinding algorithms such as Dijkstra’s, A* and other supported algorithms.
Pythona library preloader to speed up process startup, uses a client/server approach. The server loads the libraries and listens on a UNIX socket, and the client connects to that socket to run a process. For each client connection, the server forks a worker process, which uses the current directory, stdin, stdout, stderr, and environment of the client process. The worker process then processes the arguments provided by the client.
RubyIf you need to handle many common spreadsheet types, looks no more. It supports Excel, Libre, CSV, and even google sheet.
RubyAn SVG rendering library. It can do thing like accept SVG, render to PNG and customize SVG attribute. There is also a JavaScript binding call resvg-js
Rustboxxy is a tool for boxing up misbehaving Linux applications and forcing them to put their files and directories in the right place, without symlinks! It uses Linux namespaces for its functionality. Kind of like docker, but here simply prefix your command with boxxy
and boxxy setup a namespace file system with dir mount etc then run your process inside that namespace. It’s Rust but you will learn a lot about this concept. Highly recomended to check it out.
A fast, offline-first, reactive database for JavaScript. We linked to it on issue 122 but it’s still going strong
TypeScriptA minimal PyTorch re-implementation of the OpenAI GPT (Generative Pretrained Transformer) training
PythonVideo
Andrej implements nanoGPT which we linked to in issue #238 and this is a video to show some aspect of its
Tools
a Postgres extension for adding hypothetical indexes to Postgres so you can do index planning. Read the introduction article to get a sense of it.
A “Notion-style” block-based extensible JavaScript text editor built on top of Prosemirror and Tiptap. I always need these JS editor at some points and having a set of option to pick is great.
When working with message queue we sometimes need ability to peek into the queue from CLI. With so many solutions like Kafka, RabbitMQ, PubSub, SNS,Nats, Redis,… it’s hard to remember all the syntax. This tool rule them all using a consistent syntax. Support a lot of message queues system.
Query, provision and operate Cloud and SaaS resources(such as AWS, GCP, Azure, Okta, Github,…) and APIs using an extensible SQL. Super useful when you want to have a big picture of what resources we have in a big org, not just for AWS, GCP but say how many users we have in Github and who belongs to which group
aims to be a reliable, easy-to-use backup and restore solution that can seamlessly scale up to the largest databases and workloads by utilizing algorithms that are optimized for database-specific requirements.
a template for you to create your own customized, high-availability solution using Python and - for maximum accessibility - a distributed configuration store like ZooKeeper, etcd, Consul or Kubernetes.
List of ngrok alternatives and other ngrok-like tunneling software and services. Focus on self-hosting.
an observability tool that consumes logs from various inputs, transforms them, and exports logs and/or metrics to a chosen target.
You can view this issue in web browser.
If you have any suggestion/feedback, do tell me by replying to this email. I read them all.
No longer want to receive these emails? Unsubscribe
Older messages
BetterDev #241 - How a single line of code brought down a half-billion euro rocket launch
Monday, February 6, 2023
Better Dev #241 Feb 06, 2023 How a single line of code brought down a half-billion euro rocket launch How a rocket launch fail? Re-use of code written for 32-bit system on a 64-bit data range. Novo
BetterDev #240 - Hello, PNG
Tuesday, January 24, 2023
Better Dev #240 Jan 23, 2023 Start speaking a new language in just three weeks with Babbel (SPONSOR) Learning to speak a new language goes beyond just vocabulary: it's about being able to hold a
BetterDev #239 - What happens when you open a terminal and enter ‘ls’
Friday, January 20, 2023
Better Dev #239 Jan 16, 2023 What happens when you open a terminal and enter 'ls' This could be the equivalent of the in famous “what happen when you type an address into the browser”, but for
BetterDev #238 - Avoiding Double Payments in a Distributed Payments System
Monday, January 9, 2023
Better Dev #238 Jan 9, 2023 Hi everyone, this week is security week. First, if you used CircleCI, make sure to rotate any secret since they suffered a breach. Second, Slack private repository got
BetterDev #237 - Challenging algorithms and data structures every programmer should try
Monday, January 2, 2023
Better Dev #237 Jan 2, 2023 Happy new year everyone. 2022 was a brutal year for me. A few app and idea I was working on wasnt turning out well and my start-up also shutdown. At the end of 2022, I got a
You Might Also Like
Import AI 399: 1,000 samples to make a reasoning model; DeepSeek proliferation; Apple's self-driving car simulator
Friday, February 14, 2025
What came before the golem? ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏
Defining Your Paranoia Level: Navigating Change Without the Overkill
Friday, February 14, 2025
We've all been there: trying to learn something new, only to find our old habits holding us back. We discussed today how our gut feelings about solving problems can sometimes be our own worst enemy
5 ways AI can help with taxes 🪄
Friday, February 14, 2025
Remotely control an iPhone; 💸 50+ early Presidents' Day deals -- ZDNET ZDNET Tech Today - US February 10, 2025 5 ways AI can help you with your taxes (and what not to use it for) 5 ways AI can help
Recurring Automations + Secret Updates
Friday, February 14, 2025
Smarter automations, better templates, and hidden updates to explore 👀 ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏
The First Provable AI-Proof Game: Introducing Butterfly Wings 4
Friday, February 14, 2025
Top Tech Content sent at Noon! Boost Your Article on HackerNoon for $159.99! Read this email in your browser How are you, @newsletterest1? undefined The Market Today #01 Instagram (Meta) 714.52 -0.32%
GCP Newsletter #437
Friday, February 14, 2025
Welcome to issue #437 February 10th, 2025 News BigQuery Cloud Marketplace Official Blog Partners BigQuery datasets now available on Google Cloud Marketplace - Google Cloud Marketplace now offers
Charted | The 1%'s Share of U.S. Wealth Over Time (1989-2024) 💰
Friday, February 14, 2025
Discover how the share of US wealth held by the top 1% has evolved from 1989 to 2024 in this infographic. View Online | Subscribe | Download Our App Download our app to see thousands of new charts from
The Great Social Media Diaspora & Tapestry is here
Friday, February 14, 2025
Apple introduces new app called 'Apple Invites', The Iconfactory launches Tapestry, beyond the traditional portfolio, and more in this week's issue of Creativerly. Creativerly The Great
Daily Coding Problem: Problem #1689 [Medium]
Friday, February 14, 2025
Daily Coding Problem Good morning! Here's your coding interview problem for today. This problem was asked by Google. Given a linked list, sort it in O(n log n) time and constant space. For example,
📧 Stop Conflating CQRS and MediatR
Friday, February 14, 2025
Stop Conflating CQRS and MediatR Read on: my website / Read time: 4 minutes The .NET Weekly is brought to you by: Step right up to the Generative AI Use Cases Repository! See how MongoDB powers your