Better Dev Link - BetterDev #249 - Running my own LLM
Better Dev #249 Sep 19, 2023
Happy tuesday everyone. We’re back for other issue. Lot of exiciting article. Hope you like this issue. This issue is a bit short and lack the summary but hope you still like it.
Instead of just using OpenAI and consume, we can look into how to run and play with a real LLM on your own computer. That will help us learn much faster, especially if we’re dipping our toe into AI/ML. Also checkout the petals tool at the tool section in this issue.
This article focuses on improving the modeling performance of LLMs by finetuning them using carefully curated datasets. Specifically, this article highlights strategies that involve modifying, utilizing, or manipulating the datasets for instruction-based finetuning rather than altering the model architecture or training algorithms. This article will also explain how you can prepare your own datasets to finetune open-source LLMs.
This sounds so easy. Just get youtube raw video and download it. But turning out they throttling it, how do those download script by pass it?
Code to read
Python has a super cool feature where you add @name on top of a function and name is call, wrap your function inside. Now we can do similar to that in Ruby, implement entirely as a library at Ruby level. no new keyword, just pure Ruby syntax.
Minimal and opinionated eBPF tooling for the Rust ecosystem. Read the introduction post to play around
RustTools
A self-hosted, offline, ChatGPT-like chatbot. Powered by Llama 2. 100% private, with no data leaving your device.
is a chat interface crafted with llama.cpp for running Alpaca models. No API keys, entirely self-hosted!
Another wireguard based VPN automation with SSO/MFA. Wireguard is very performance and easy to setup, but there isn’t an easy solution to manage user out of the box. Therefore we need tool like netmaker or netbird
You can view this issue in web browser.
If you have any suggestion/feedback, do tell me by replying to this email. I read them all.
No longer want to receive these emails? Unsubscribe
Older messages
BetterDev #248 - Putting the “You” in CPU
Monday, August 14, 2023
Better Dev #248 Aug 14, 2023 Hi all, I'm really sorry for sending out no issue in last few months. Works get in but I'm finally manage to spend time again on this newsletter. I missed it so
BetterDev #247 - Cryptographic Best Practices and A Journey through Color Space with FFmpeg
Wednesday, April 19, 2023
Better Dev #247 Apr 17, 2023 These continue to be big weeks in AI world. I share some LLM tools. Enjoy. Cryptographic Best Practices Putting cryptographic primitives together is a lot like putting a
BetterDev #246 - Is your Postgres ready for production and where to store your OAuth tokens
Monday, April 3, 2023
Better Dev #246 Apr 03, 2023 Is your Postgres ready for production? your database ready for whatever may come on launch day or even 2 months in? Here's a handy checklist to make sure you're not
BetterDev #245 - Scaling Kubernetes to 7,500 nodes
Monday, March 20, 2023
Better Dev #245 Mar 20, 2023 Scaling Kubernetes to 7500 nodes At this point no one doesn't know OpenAI and their ChatGPT. They run a massive K8S cluster with 7500 nodes. Needless to say that come
BetterDev #244 - How discord stores trillions of messages and How Cloudflare run Prometheus at scale
Monday, March 13, 2023
Better Dev #244 Mar 13, 2023 How discord stores trillions of messages Rewrite in Rust, migrate to ScylaDB from cassandra. But the most important thing to me is the request coalescing. If two user read
You Might Also Like
WP Weekly 192 - WP Biz - Brands Merged, Woo Cart Popup, Fastest Hosting
Monday, May 6, 2024
Read on Website WP Weekly 192 / WP Biz The 'business of WordPress' is buzzing for sure, be it the acquisition of plugins or the massive Envato ownership change. Also, WordPress content brands
SRE Weekly Issue #423
Monday, May 6, 2024
View on sreweekly.com A message from our sponsor, FireHydrant: FireHydrant is now AI-powered for faster, smarter incidents! Power up your incidents with auto-generated real-time summaries,
⚠️ Avoiding AI Scams on Social Media — An Open Source Google Photos Alternative
Sunday, May 5, 2024
Also: Reviewing the Customizable Drop Mechanical Keyboard, and More! How-To Geek Logo May 5, 2024 📩 Get expert reviews, the hottest deals, how-to's, breaking news, and more delivered directly to
Daily Coding Problem: Problem #1432 [Medium]
Sunday, May 5, 2024
Daily Coding Problem Good morning! Here's your coding interview problem for today. This question was asked by Snapchat. Given the head to a singly linked list, where each node also has a “random”
PD#572 Good Ideas in Computer Science
Sunday, May 5, 2024
Ideas every programmer likes and why Garbage Collection and Object Oriented Programming don't count
RD#454 API Layer & Fetch Functions
Sunday, May 5, 2024
ixing API and UI code quickly leads to messy and unmaintainable code
The Shiny Toy Syndrome & Tiny macOS utility apps I love
Sunday, May 5, 2024
Lex launching its redesign, Raycast shares another monthly update packed with AI updates, prompts should be designed not engineered, and a lot more in this week's issue of Creativerly. Creativerly
Hyundai antes up $1B for AV startup Motional and Elon unplugs the Tesla Supercharger team
Sunday, May 5, 2024
Plus, layoffs come for Luminar, Fisker and Ola View this email online in your browser By Kirsten Korosec Sunday, May 5, 2024 Image Credits: Motional Welcome back to TechCrunch Mobility — your central
C#504 Adventures serializing absolutely everything in C#
Sunday, May 5, 2024
A fantastic journey porting Newtonsoft.Json to System.Text.Json
Sunday Digest | Featuring 'Which City Has the Most Billionaires in 2024?' 📊
Sunday, May 5, 2024
Every visualization published this week, in one place. Visual Capitalist Sunday Digest logo May 5, 2024 | View Online | Subscribe | VC+ The Best of This Week's Visuals Presented by Voronoi: The