[Python Dependency Pitfalls] "Re-inventing the wheel" disease

Hey there,

PyPI, the Python packaging repository, now contains more than 100,000 third-party packages in total.

That's an *overwhelming* number of packages to choose from...

And this feeling of overwhelm and "choice paralysis" is exactly what held me back earlier on in my Python career.

Here, let me explain:

Back when I got "serious" about building my Python skills, mastering the syntax of the language was NOT the hardest part.

Python's syntax is quite clear and intuitive by comparison, and there's a (relatively) obvious path to learning it.

But when it comes to Python's 100k+ libraries and frameworks that's simply an OVERWHELMING number to choose from (and there's no way to memorize all of them.)

So anyway, what tripped me up as a fledgling Pythonista was this:

I had the basics of Python under my belt, but I struggled when it came to adopting the right workflows and tools of the "ecosystem" surrounding the core language.

Thus, I wasted time reinventing existing solutions left and right...

Sometimes I spent DAYS writing my own (crappy) versions of common building blocks like config file parsers, data validators, or visualization tools.

Now, sure I learned quite a bit from doing that—

But I kept repeating the same mistake and was "reinventing the wheel" even when under a tight deadline.

In hindsight, my ignorance caused me a ton of undue stress and sleep deprivation.

Part of it was overconfidence in my abilities, and another part was a lack of experience using "bread and butter" tools like the pip package manager, virtual environments, and requirements files.

Once I got the hang of Python's dependency management tools and workflows I was able to overcome my "reinventing the wheel disease" relatively quickly.

Mastering those tools and coming up with strategies for identifying high-quality Python packages opened up a whole new world to me:

By leveraging Python's packaging ecosystem I was suddenly coding at a higher level of abstraction.

And it had a MASSIVE impact on my productivity and efficiency.

Saying it allowed me to 10X my output wouldn't be too far off.

If you use Python and you're wondering how to go from "writing scripts" to "building applications"—

Then there's a good chance you could benefit from focusing on your dependency management skills.

You might be ready for a similar "quantum leap" in your productivity.

In Managing Python Dependencies With Pip and Virtual Environments, I give you the exact step-by-step workflows I use every day to work on Python projects small and large.

When you add just one of these tricks to your personal dev workflow you'll *permanently* increase your productivity and efficiency as a developer.

Details here:

realpython.com/products/managing-python-dependencies/

— Dan Bader

Key phrases

common building blocks config file parsers similar quantum leap personal dev workflow dependency management skills pip package manager dependency management tools Python packaging repository highquality Python packages

Older messages

[Python Mastery] What Pythonistas can learn from bestselling authors

Friday, June 24, 2022

Hey there, I just finished reading Stephen King's "On Writing." It's a great little book where he shares some of the writing advice and stories he's picked up over the course of

[Python Mastery] The hidden costs of "copy-paste" Python programming

Thursday, June 23, 2022

Hey there, Here's a development story that plays out thousands of times each day: Avid Pythonista Max is working on a function to find the 10 oldest files in a nested directory hierarchy. He needs

[PythonistaCafe] Q&A

Thursday, June 23, 2022

Hey there, At this point you should have a pretty good idea of what PythonistaCafe is about and what makes it special. In this email I want to answer some common questions that I get asked about the

[Python Dependency Pitfalls] Artisanal "from-scratch" development

Thursday, June 23, 2022

Hey there, The other day I got this question from Newsletter member Newvick in my email inbox: ~~~ I'm trying to get past the beginner's stage in Python and one problem I have is: When do you

[Python Mastery] Learn Python in 21 days!!!!11 (what a lie)

Wednesday, June 22, 2022

Hey there, One of the first programming books I ever bought was "Teach Yourself C in 21 Days." This four pound tome came with a CD-ROM that included an ancient version (3.1) of the Borland

A House of Brands Allows For A Concise Acquisition Strategy

Tuesday, September 28, 2021

A House of Brands Allows for a Concise Acquisition Strategy Read online There is a semblance of schadenfreude when The New York Times publishes a pretty intense piece confirming what many in media

[Python Mastery] What does it mean to "master" Python?

Tuesday, July 5, 2022

Hey there, A couple of years ago I'd become quite interested in martial arts. Hours upon hours of watching "The Karate Kid" growing up must've taken their toll on me... And so, I

[PythonistaCafe] What makes PythonistaCafe different

Tuesday, July 5, 2022

Hey there, Mastering Python is *not* just about getting the books and courses to study—to be successful you also need a way to stay motivated and to grow your abilities in the long run. Many

Pirate Library Mirror: Preserving 7TB of books (that are not in Libgen) — and Why nobody ever wins the car at the mall (2018)

Monday, July 4, 2022

Issue #818 — Top 20 stories of July 05, 2022 Issue #818 — July 05, 2022 You receive this email because you are subscribed to Hacker News Digest. You can open it in the browser if you prefer. 1 Pirate

JSK Daily for Jul 4, 2022

Monday, July 4, 2022

JSK Daily for Jul 4, 2022 View this email in your browser A community curated daily e-mail of JavaScript news WebSockets vs. Server-Sent Events Over the years, the HTTP request-response model has been

Max Q - Capped

Monday, July 4, 2022

TechCrunch Newsletter TechCrunch logo Max Q logo By Aria Alamalhodaei Monday, July 04, 2022 Hello and welcome back to Max Q. I hope all my American readers had a restful Independence Day. In this issue

Top 3: StackOverflow asked 70,000 devs about Angular, a fictional interview with Seneca, and what makes a healthy engineering team

Monday, July 4, 2022

3 best articles I read this week ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌

Bytes: Like any good doggo, ESLint might be a little overbearing

Monday, July 4, 2022

Happy Fourth of July to those who celebrate and happy July 4th to those who don't. This week, we've got our special Bytes Cocktail recipe, our class action lawsuit Airbnb developers, and a

Daily Coding Problem: Problem #808 [Hard]

Monday, July 4, 2022

Daily Coding Problem Good morning! Here's your coding interview problem for today. This problem was asked by Palantir. Typically, an implementation of in-order traversal of a binary tree has O(h)

What to Do If You Drop Your Smartphone in the Ocean

Monday, July 4, 2022

Did You Know?: Easter Island, famous for its massive monumental statues called moai, is a special territory of Chile. Read in Browser Logo for How-To Geek July 4, 2022 Did You Know? Easter Island,

That’s nuts

Monday, July 4, 2022

One of the biggest struggles amongst people with a tight budget is coming to terms with how much is actually... Product Hunt Read in browser This newsletter is brought to you by This app shows you your