Better Dev Link - BetterDev #249 - Running my own LLM
Better Dev #249 Sep 19, 2023
Happy tuesday everyone. We’re back for other issue. Lot of exiciting article. Hope you like this issue. This issue is a bit short and lack the summary but hope you still like it.
Instead of just using OpenAI and consume, we can look into how to run and play with a real LLM on your own computer. That will help us learn much faster, especially if we’re dipping our toe into AI/ML. Also checkout the petals tool at the tool section in this issue.
This article focuses on improving the modeling performance of LLMs by finetuning them using carefully curated datasets. Specifically, this article highlights strategies that involve modifying, utilizing, or manipulating the datasets for instruction-based finetuning rather than altering the model architecture or training algorithms. This article will also explain how you can prepare your own datasets to finetune open-source LLMs.
This sounds so easy. Just get youtube raw video and download it. But turning out they throttling it, how do those download script by pass it?
Code to read
Python has a super cool feature where you add @name
on top of a function and name is call, wrap your function inside. Now we can do similar to that in Ruby, implement entirely as a library at Ruby level. no new keyword, just pure Ruby syntax.
Minimal and opinionated eBPF tooling for the Rust ecosystem. Read the introduction post to play around
RustTools
A self-hosted, offline, ChatGPT-like chatbot. Powered by Llama 2. 100% private, with no data leaving your device.
is a chat interface crafted with llama.cpp for running Alpaca models. No API keys, entirely self-hosted!
Another wireguard based VPN automation with SSO/MFA. Wireguard is very performance and easy to setup, but there isn’t an easy solution to manage user out of the box. Therefore we need tool like netmaker or netbird
You can view this issue in web browser.
If you have any suggestion/feedback, do tell me by replying to this email. I read them all.
No longer want to receive these emails? Unsubscribe
Older messages
BetterDev #248 - Putting the “You” in CPU
Monday, August 14, 2023
Better Dev #248 Aug 14, 2023 Hi all, I'm really sorry for sending out no issue in last few months. Works get in but I'm finally manage to spend time again on this newsletter. I missed it so
BetterDev #247 - Cryptographic Best Practices and A Journey through Color Space with FFmpeg
Wednesday, April 19, 2023
Better Dev #247 Apr 17, 2023 These continue to be big weeks in AI world. I share some LLM tools. Enjoy. Cryptographic Best Practices Putting cryptographic primitives together is a lot like putting a
BetterDev #246 - Is your Postgres ready for production and where to store your OAuth tokens
Monday, April 3, 2023
Better Dev #246 Apr 03, 2023 Is your Postgres ready for production? your database ready for whatever may come on launch day or even 2 months in? Here's a handy checklist to make sure you're not
BetterDev #245 - Scaling Kubernetes to 7,500 nodes
Monday, March 20, 2023
Better Dev #245 Mar 20, 2023 Scaling Kubernetes to 7500 nodes At this point no one doesn't know OpenAI and their ChatGPT. They run a massive K8S cluster with 7500 nodes. Needless to say that come
BetterDev #244 - How discord stores trillions of messages and How Cloudflare run Prometheus at scale
Monday, March 13, 2023
Better Dev #244 Mar 13, 2023 How discord stores trillions of messages Rewrite in Rust, migrate to ScylaDB from cassandra. But the most important thing to me is the request coalescing. If two user read
You Might Also Like
Import AI 399: 1,000 samples to make a reasoning model; DeepSeek proliferation; Apple's self-driving car simulator
Friday, February 14, 2025
What came before the golem? ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏
Defining Your Paranoia Level: Navigating Change Without the Overkill
Friday, February 14, 2025
We've all been there: trying to learn something new, only to find our old habits holding us back. We discussed today how our gut feelings about solving problems can sometimes be our own worst enemy
5 ways AI can help with taxes 🪄
Friday, February 14, 2025
Remotely control an iPhone; 💸 50+ early Presidents' Day deals -- ZDNET ZDNET Tech Today - US February 10, 2025 5 ways AI can help you with your taxes (and what not to use it for) 5 ways AI can help
Recurring Automations + Secret Updates
Friday, February 14, 2025
Smarter automations, better templates, and hidden updates to explore 👀 ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏
The First Provable AI-Proof Game: Introducing Butterfly Wings 4
Friday, February 14, 2025
Top Tech Content sent at Noon! Boost Your Article on HackerNoon for $159.99! Read this email in your browser How are you, @newsletterest1? undefined The Market Today #01 Instagram (Meta) 714.52 -0.32%
GCP Newsletter #437
Friday, February 14, 2025
Welcome to issue #437 February 10th, 2025 News BigQuery Cloud Marketplace Official Blog Partners BigQuery datasets now available on Google Cloud Marketplace - Google Cloud Marketplace now offers
Charted | The 1%'s Share of U.S. Wealth Over Time (1989-2024) 💰
Friday, February 14, 2025
Discover how the share of US wealth held by the top 1% has evolved from 1989 to 2024 in this infographic. View Online | Subscribe | Download Our App Download our app to see thousands of new charts from
The Great Social Media Diaspora & Tapestry is here
Friday, February 14, 2025
Apple introduces new app called 'Apple Invites', The Iconfactory launches Tapestry, beyond the traditional portfolio, and more in this week's issue of Creativerly. Creativerly The Great
Daily Coding Problem: Problem #1689 [Medium]
Friday, February 14, 2025
Daily Coding Problem Good morning! Here's your coding interview problem for today. This problem was asked by Google. Given a linked list, sort it in O(n log n) time and constant space. For example,
📧 Stop Conflating CQRS and MediatR
Friday, February 14, 2025
Stop Conflating CQRS and MediatR Read on: my website / Read time: 4 minutes The .NET Weekly is brought to you by: Step right up to the Generative AI Use Cases Repository! See how MongoDB powers your