[Python Dependency Pitfalls] Artisanal "from-scratch" development

Hey there,

The other day I got this question from Newsletter member Newvick in my email inbox:

~~~

I'm trying to get past the beginner's stage in Python and one problem I have is:

When do you use libraries/frameworks and when do you make things from scratch? (whether for learning or developing something for a client/work)

~~~

When to code functionality from scratch and when to use libraries, that's an important question.

There's a fine balance you need to strike here:

When I learned how to program I was "reinventing wheels" left and right—and it pushed my abilities forward quickly.

I was constantly writing all kinds of existing functionality from scratch and it was the right thing to do because it helped me grow my skills.

It was a great learning exercise.

But there comes a time in a developer's life when that strategy doesn't work so well any more:

Eventually I found that I wasn't learning as quickly anymore trying to build everything from scratch.

Plus my development pace was dog-slow.

I was spinning my wheels—and my productivity began to plateau.

Another downside is this:

It's difficult to work on a team when someone always wants to approach every single problem from first principles. It can drive coworkers and managers NUTS.

These days I try to use (good quality + well-documented!) third-party libraries where possible.

But again, you'll want to find a balance there:

For example, any professional chef worth their salt needs to learn how to make mayonnaise from scratch.

But eventually they'll know how to prepare it—and what great quality looks like.

From this point on buying pre-made mayo off the shelf can be a huge time saver:

In some dishes it simply WON'T make a difference on the end result.

It just *takes longer* to make everything from scratch…

Bringing it back to Python dependency management, here's my general rule of thumb:

"Only consider 'write from scratch' if time is NOT an issue. Otherwise use 3rd-party libraries and frameworks—but don't overdo it and only go for the trustworthy ones."

(Remember, you'll want to avoid another "left-pad" incident.)

Sometimes it's just tough as nails to strike the right balance here…and there's so much more to talk about on this topic.

If you want to dig deep and see how to make the leap from "amateur cook" to "professional chef" as a Pythonista, my Managing Python Dependencies course shows you how to get there.

It includes a complete step-by-step workflow for researching packages and making Python dependency decisions (and explaining them to your team, manager, or client).

Click the link below to learn more:

realpython.com/products/managing-python-dependencies/

— Dan Bader

P.S. "Re-inventing the wheel" disease was really something I struggled with as a fledgling dev. I'll show you how I got over it tomorrow.

Older messages

[Python Mastery] Learn Python in 21 days!!!!11 (what a lie)

Friday, September 9, 2022

Hey there, One of the first programming books I ever bought was "Teach Yourself C in 21 Days." This four pound tome came with a CD-ROM that included an ancient version (3.1) of the Borland

[Python Dependency Pitfalls] What dev managers expect from Python candidates

Thursday, September 8, 2022

Hey there, My friend Og is a senior manager at Red Hat and works with a large team of developers and quality engineers using Python. I got to pick his brain on what he thought were the most important

[Python Mastery] The secret to "ethical self-promotion"?

Thursday, September 8, 2022

Hey there, Here's some food for thought: There's a difference between *doing* a great job as a Python developer, and *to be seen doing* a great job. Being a skilled developer among peers—and

[Python Mastery] What does it mean to "master" Python?

Wednesday, September 7, 2022

Hey there, A couple of years ago I'd become quite interested in martial arts. Hours upon hours of watching "The Karate Kid" growing up must've taken their toll on me... And so, I

[Python Dependency Pitfalls] How to set the world on fire

Wednesday, September 7, 2022

Hey there, #1 on my list of dependency management pitfalls is there for a good reason: It lead to a single developer causing mayhem and breaking thousands of open-source projects around the world in

Kotlin Weekly #321

Sunday, September 25, 2022

ISSUE #321 25th of September 2022 Hello from Berlin! We are here to run the Berlin marathon, which does not make us better at Kotlin, but does it make us happier? Also not. Find our selection of

The image in this post displays its own MD5 hash — and A mysterious voice is haunting American Airlines’ in-flight announcements

Saturday, September 24, 2022

Issue #900 — Top 20 stories of September 25, 2022 Issue #900 — September 25, 2022 You receive this email because you are subscribed to Hacker News Digest. You can open it in the browser if you prefer.

Weekend Reading — 👋 0.1 + 0.2

Saturday, September 24, 2022

This week we play Dungeon & Types, visualize our designs IRL, FOMO into the Metaverse, and wrestle a bear for a Belgium waffle. Weekend Reading — 👋 0.1 + 0.2 By Assaf Arkin – 24 Sep 2022 – View

Daily Coding Problem: Problem #889 [Easy]

Saturday, September 24, 2022

Daily Coding Problem Good morning! Here's your coding interview problem for today. This problem was asked by Amazon. Run-length encoding is a fast and simple method of encoding strings. The basic

Animated | Visualizing 140 Years of Global Surface Temperatures 🌐

Saturday, September 24, 2022

Here's a look at 140 years of global surface temperatures, highlighting the ten coldest and warmest years since 1880. View Online | Subscribe Presented by: Explore what 8 billion people means for

The Best Laptops of 2022

Saturday, September 24, 2022

Did You Know?: The stethoscope was invented in 1816 by French physician René-Théophile-Hyacinthe Laennec and motivated by a desire to accurately (and modestly) diagnose heart problems in women. The

Noonification: Monsters of Mars

Saturday, September 24, 2022

Top Tech Content sent at Noon! Private Applications Begin Here How are you, @hacker? 🪐 What's happening in tech this week: The Noonification by HackerNoon has got you covered with fresh content

Week in Review - GTA 6 footage leaks, Revolut gets hacked, and Wipro fires 300 for "moonlighting"

Saturday, September 24, 2022

TechCrunch Newsletter TechCrunch logo Week in Review logo By Greg Kumparak Saturday, September 24, 2022 Hi, friends! Welcome back to Week in Review, the newsletter where we very quickly sum up the most

London Police Arrested 17-Year-Old Hacker Suspected of Uber and GTA 6 Breaches

Saturday, September 24, 2022

The Hacker News Daily Updates Newsletter cover 2022 First Half Threat Report A Semiannual Report by FortiGuard Labs Download Now Sponsored LATEST NEWS Sep 24, 2022 London Police Arrested 17-Year-Old

Startups Weekly - Tiger Global, fickle checks and the difficulty of acceleration

Saturday, September 24, 2022

TechCrunch Newsletter TechCrunch logo Startups Weekly logo By Natasha Mascarenhas Saturday, September 24, 2022 Welcome to Startups Weekly, a fresh human-first take on this week's startup news and