[Python Dependency Pitfalls] "Re-inventing the wheel" disease

Hey there,

PyPI, the Python packaging repository, now contains more than 100,000 third-party packages in total.

That's an *overwhelming* number of packages to choose from...

And this feeling of overwhelm and "choice paralysis" is exactly what held me back earlier on in my Python career.

Here, let me explain:

Back when I got "serious" about building my Python skills, mastering the syntax of the language was NOT the hardest part.

Python's syntax is quite clear and intuitive by comparison, and there's a (relatively) obvious path to learning it.

But when it comes to Python's 100k+ libraries and frameworks that's simply an OVERWHELMING number to choose from (and there's no way to memorize all of them.)

So anyway, what tripped me up as a fledgling Pythonista was this:

I had the basics of Python under my belt, but I struggled when it came to adopting the right workflows and tools of the "ecosystem" surrounding the core language.

Thus, I wasted time reinventing existing solutions left and right...

Sometimes I spent DAYS writing my own (crappy) versions of common building blocks like config file parsers, data validators, or visualization tools.

Now, sure I learned quite a bit from doing that—

But I kept repeating the same mistake and was "reinventing the wheel" even when under a tight deadline.

In hindsight, my ignorance caused me a ton of undue stress and sleep deprivation.

Part of it was overconfidence in my abilities, and another part was a lack of experience using "bread and butter" tools like the pip package manager, virtual environments, and requirements files.

Once I got the hang of Python's dependency management tools and workflows I was able to overcome my "reinventing the wheel disease" relatively quickly.

Mastering those tools and coming up with strategies for identifying high-quality Python packages opened up a whole new world to me:

By leveraging Python's packaging ecosystem I was suddenly coding at a higher level of abstraction.

And it had a MASSIVE impact on my productivity and efficiency.

Saying it allowed me to 10X my output wouldn't be too far off.

If you use Python and you're wondering how to go from "writing scripts" to "building applications"—

Then there's a good chance you could benefit from focusing on your dependency management skills.

You might be ready for a similar "quantum leap" in your productivity.

In Managing Python Dependencies With Pip and Virtual Environments, I give you the exact step-by-step workflows I use every day to work on Python projects small and large.

When you add just one of these tricks to your personal dev workflow you'll *permanently* increase your productivity and efficiency as a developer.

Details here:

realpython.com/products/managing-python-dependencies/

— Dan Bader

Older messages

[Python Dependency Pitfalls] Artisanal "from-scratch" development

Friday, July 23, 2021

Hey there, The other day I got this question from Newsletter member Newvick in my email inbox: ~~~ I'm trying to get past the beginner's stage in Python and one problem I have is: When do you

[PythonistaCafe] Q&A

Thursday, July 22, 2021

Hey there, At this point you should have a pretty good idea of what PythonistaCafe is about and what makes it special. In this email I want to answer some common questions that I get asked about the

[Python Dependency Pitfalls] What dev managers expect from Python candidates

Thursday, July 22, 2021

Hey there, My friend Og is a senior manager at Red Hat and works with a large team of developers and quality engineers using Python. I got to pick his brain on what he thought were the most important

[Python Dependency Pitfalls] How to set the world on fire

Wednesday, July 21, 2021

Hey there, #1 on my list of dependency management pitfalls is there for a good reason: It lead to a single developer causing mayhem and breaking thousands of open-source projects around the world in

[PythonistaCafe] What's in PythonistaCafe for you?

Wednesday, July 21, 2021

Hey there, A couple of years ago I'd become quite interested in martial arts. Hours upon hours of watching "The Karate Kid" growing up must've taken their toll on me... And so, I

[PythonistaCafe] What makes PythonistaCafe different

Friday, September 24, 2021

Hey there, Mastering Python is *not* just about getting the books and courses to study—to be successful you also need a way to stay motivated and to grow your abilities in the long run. Many

[Python Dependency Pitfalls] Artisanal "from-scratch" development

Friday, September 24, 2021

Hey there, The other day I got this question from Newsletter member Newvick in my email inbox: ~~~ I'm trying to get past the beginner's stage in Python and one problem I have is: When do you

[Sublime + Python Setup] Grumpy old greybeard with a whitespace problem

Friday, September 24, 2021

One fateful day, the Agile Gods that be decided to “add some firepower” to my little team… And so, developer Paul joined (name changed to protect the guilty). Before I dive into this story, let me ask

This Week in Rust 409

Friday, September 24, 2021

Email isn't displaying correctly? Read this e-mail on the Web This Week in Rust issue 409 — 22 SEP 2021 Hello and welcome to another issue of This Week in Rust! Rust is a programming language

Data Science Weekly - Issue 409

Friday, September 24, 2021

Curated news, articles and jobs related to Data Science. Keep up with all the latest developments Email not displaying correctly? View it in your browser. Issue #409 September 23 2021 Editor Picks Tree

Google Drive of historical footage locked and flagged as terrorist activity — and How we got to LiveView

Thursday, September 23, 2021

Issue #535 — Top 20 stories of September 24, 2021 Issue #535 — September 24, 2021 You receive this email because you are subscribed to Hacker News Digest. You can open it in the browser if you prefer.

Cellino wins TechCrunch Disrupt Startup Battlefield 2021

Thursday, September 23, 2021

TechCrunch Newsletter TechCrunch logo The Daily Crunch logo Thursday, September 23, 2021 • By Alex Wilhelm Hello and welcome to Daily Crunch for September 23, 2021. We just put the final bow on Disrupt

📱 Issue 273 - iOS: app upload via GitHub Actions

Thursday, September 23, 2021

This week's Awesome iOS Weekly Read this email on the Web The Awesome iOS Weekly Issue » 273 Release Date Sep 23, 2021 Your weekly report of the most popular iOS news, articles and projects Popular

💻 Issue 279 - Automate your personal CRM with Notion and Kelvin Data

Thursday, September 23, 2021

This week's Awesome Node.js Weekly Read this email on the Web The Awesome Node.js Weekly Issue » 279 Release Date Sep 23, 2021 Your weekly report of the most popular Node.js news, articles and

💻 Issue 279 - Q1K3-Quake in Javascript

Thursday, September 23, 2021

This week's Awesome JavaScript Weekly Read this email on the Web The Awesome JavaScript Weekly Issue » 279 Release Date Sep 23, 2021 Your weekly report of the most popular JavaScript news, articles