Better Dev Link - BetterDev #249 - Running my own LLM
Better Dev #249 Sep 19, 2023
Happy tuesday everyone. We’re back for other issue. Lot of exiciting article. Hope you like this issue. This issue is a bit short and lack the summary but hope you still like it.
Instead of just using OpenAI and consume, we can look into how to run and play with a real LLM on your own computer. That will help us learn much faster, especially if we’re dipping our toe into AI/ML. Also checkout the petals tool at the tool section in this issue.
This article focuses on improving the modeling performance of LLMs by finetuning them using carefully curated datasets. Specifically, this article highlights strategies that involve modifying, utilizing, or manipulating the datasets for instruction-based finetuning rather than altering the model architecture or training algorithms. This article will also explain how you can prepare your own datasets to finetune open-source LLMs.
This sounds so easy. Just get youtube raw video and download it. But turning out they throttling it, how do those download script by pass it?
Code to read
Python has a super cool feature where you add @name
on top of a function and name is call, wrap your function inside. Now we can do similar to that in Ruby, implement entirely as a library at Ruby level. no new keyword, just pure Ruby syntax.
Minimal and opinionated eBPF tooling for the Rust ecosystem. Read the introduction post to play around
RustTools
A self-hosted, offline, ChatGPT-like chatbot. Powered by Llama 2. 100% private, with no data leaving your device.
is a chat interface crafted with llama.cpp for running Alpaca models. No API keys, entirely self-hosted!
Another wireguard based VPN automation with SSO/MFA. Wireguard is very performance and easy to setup, but there isn’t an easy solution to manage user out of the box. Therefore we need tool like netmaker or netbird
You can view this issue in web browser.
If you have any suggestion/feedback, do tell me by replying to this email. I read them all.
No longer want to receive these emails? Unsubscribe
Older messages
BetterDev #248 - Putting the “You” in CPU
Monday, August 14, 2023
Better Dev #248 Aug 14, 2023 Hi all, I'm really sorry for sending out no issue in last few months. Works get in but I'm finally manage to spend time again on this newsletter. I missed it so
BetterDev #247 - Cryptographic Best Practices and A Journey through Color Space with FFmpeg
Wednesday, April 19, 2023
Better Dev #247 Apr 17, 2023 These continue to be big weeks in AI world. I share some LLM tools. Enjoy. Cryptographic Best Practices Putting cryptographic primitives together is a lot like putting a
BetterDev #246 - Is your Postgres ready for production and where to store your OAuth tokens
Monday, April 3, 2023
Better Dev #246 Apr 03, 2023 Is your Postgres ready for production? your database ready for whatever may come on launch day or even 2 months in? Here's a handy checklist to make sure you're not
BetterDev #245 - Scaling Kubernetes to 7,500 nodes
Monday, March 20, 2023
Better Dev #245 Mar 20, 2023 Scaling Kubernetes to 7500 nodes At this point no one doesn't know OpenAI and their ChatGPT. They run a massive K8S cluster with 7500 nodes. Needless to say that come
BetterDev #244 - How discord stores trillions of messages and How Cloudflare run Prometheus at scale
Monday, March 13, 2023
Better Dev #244 Mar 13, 2023 How discord stores trillions of messages Rewrite in Rust, migrate to ScylaDB from cassandra. But the most important thing to me is the request coalescing. If two user read
You Might Also Like
Matrix Botnet Exploits IoT Devices in Widespread DDoS Botnet Campaign
Wednesday, November 27, 2024
THN Daily Updates Newsletter cover The AI Value Playbook ($35.99) FREE for a Limited Time Business leaders are challenged by the speed of AI innovation and how to navigate disruption and uncertainty.
The Sequence Chat: Why are Foundation Models so Hard to Explain and What are we Doing About it?
Wednesday, November 27, 2024
Addressing some of the interpretability challenges of foundation models and the emerging fields of mechanistic interpretability and behavioral probing. ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏
Overcoming Perfectionism: How to Break Free from the Enemy of Progress
Wednesday, November 27, 2024
Discover how perfectionism hinders progress and learn practical strategies to overcome the fear of imperfection, boost productivity, and achieve your goals without getting stuck in the pursuit of
🖤 Laravel Black Friday Deals!
Wednesday, November 27, 2024
The biggest deals of the year Laravel Black Friday Deals View in browser Laravel News Editor Note: We are sending this outside the regular Sunday newsletter schedule because some of these specials end
BetterDev #271 - Memory: The Forgotten History and Why did Windows 95 setup use three operating systems?
Wednesday, November 27, 2024
Better Dev #271 Nov 26, 2024 Hi all, Welcome to thanksgiving issue of BetterDev. Hope everyone had a safe and warm thanksgiving. It's getting so cold these days. If you are in warzone such as
Mapped | Unemployment Rate By U.S. State in 2024 💼
Tuesday, November 26, 2024
As of October 2024, DC and Nevada tied for the highest unemployment rate in the US at 5.7%. Which states saw the lowest rates? View Online | Subscribe | Download Our App FINAL CHANCE - ENDS TONIGHT!
🔊 7 DIY Tips for Soundproofing a Room — Why I Switched to Xfce for Linux Mint
Tuesday, November 26, 2024
Also: Home Theater Sound Terms Explained, and More! How-To Geek Logo November 26, 2024 Did You Know The shiny layer of a CD doesn't contain the data; the plastic polycarbonate layer does. The shiny
JSK Daily for Nov 26, 2024
Tuesday, November 26, 2024
JSK Daily for Nov 26, 2024 View this email in your browser A community curated daily e-mail of JavaScript news JavaScript Certification Black Friday Offer – Up to 54% Off! Certificates.dev, the trusted
NumPy, Loop Targets, Vector Animation, and More
Tuesday, November 26, 2024
NumPy Practical Examples: Useful Techniques #657 – NOVEMBER 26, 2024 VIEW IN BROWSER The PyCoder's Weekly Logo NumPy Practical Examples: Useful Techniques In this tutorial, you'll learn how to
Your Games Quarterly newsletter has arrived
Tuesday, November 26, 2024
What's new for games in Google Play and Android Email not displaying correctly? View it online November 2024 The First Developer Preview of Android 16 The First Developer Preview of Android 16