[Python Dependency Pitfalls] "Re-inventing the wheel" disease

Hey there,

PyPI, the Python packaging repository, now contains more than 100,000 third-party packages in total.

That's an *overwhelming* number of packages to choose from...

And this feeling of overwhelm and "choice paralysis" is exactly what held me back earlier on in my Python career.

Here, let me explain:

Back when I got "serious" about building my Python skills, mastering the syntax of the language was NOT the hardest part.

Python's syntax is quite clear and intuitive by comparison, and there's a (relatively) obvious path to learning it.

But when it comes to Python's 100k+ libraries and frameworks that's simply an OVERWHELMING number to choose from (and there's no way to memorize all of them.)

So anyway, what tripped me up as a fledgling Pythonista was this:

I had the basics of Python under my belt, but I struggled when it came to adopting the right workflows and tools of the "ecosystem" surrounding the core language.

Thus, I wasted time reinventing existing solutions left and right...

Sometimes I spent DAYS writing my own (crappy) versions of common building blocks like config file parsers, data validators, or visualization tools.

Now, sure I learned quite a bit from doing that—

But I kept repeating the same mistake and was "reinventing the wheel" even when under a tight deadline.

In hindsight, my ignorance caused me a ton of undue stress and sleep deprivation.

Part of it was overconfidence in my abilities, and another part was a lack of experience using "bread and butter" tools like the pip package manager, virtual environments, and requirements files.

Once I got the hang of Python's dependency management tools and workflows I was able to overcome my "reinventing the wheel disease" relatively quickly.

Mastering those tools and coming up with strategies for identifying high-quality Python packages opened up a whole new world to me:

By leveraging Python's packaging ecosystem I was suddenly coding at a higher level of abstraction.

And it had a MASSIVE impact on my productivity and efficiency.

Saying it allowed me to 10X my output wouldn't be too far off.

If you use Python and you're wondering how to go from "writing scripts" to "building applications"—

Then there's a good chance you could benefit from focusing on your dependency management skills.

You might be ready for a similar "quantum leap" in your productivity.

In Managing Python Dependencies With Pip and Virtual Environments, I give you the exact step-by-step workflows I use every day to work on Python projects small and large.

When you add just one of these tricks to your personal dev workflow you'll *permanently* increase your productivity and efficiency as a developer.

Details here:

realpython.com/products/managing-python-dependencies/

— Dan Bader

Key phrases

common building blocks config file parsers similar quantum leap personal dev workflow dependency management skills pip package manager dependency management tools Python packaging repository highquality Python packages

Older messages

[Python Dependency Pitfalls] Artisanal "from-scratch" development

Friday, April 8, 2022

Hey there, The other day I got this question from Newsletter member Newvick in my email inbox: ~~~ I'm trying to get past the beginner's stage in Python and one problem I have is: When do you

[Sublime + Python Setup] Grumpy old greybeard with a whitespace problem

Friday, April 8, 2022

One fateful day, the Agile Gods that be decided to “add some firepower” to my little team… And so, developer Paul joined (name changed to protect the guilty). Before I dive into this story, let me ask

[Python Dependency Pitfalls] What dev managers expect from Python candidates

Thursday, April 7, 2022

Hey there, My friend Og is a senior manager at Red Hat and works with a large team of developers and quality engineers using Python. I got to pick his brain on what he thought were the most important

[Sublime + Python Setup] Don’t build “nag screen muscle memory”

Thursday, April 7, 2022

Hey there, Once I worked with a developer who refused to buy a registered copy of Sublime for months on end, even though he *loved* Sublime. He used it as his main code editor every day and was very

[Sublime + Python Setup] why Atom can’t replace Sublime

Wednesday, April 6, 2022

Hey there, "In a nutshell, Atom is a Sublime Text editor that just got better." When I read this quote I got so worked up I nearly fell off my chair. Because every time I've tried Atom or

Import AI 317: DeepMind speeds up language model sampling; voice cloning tech gets abused; more scaling laws for RL

Monday, February 6, 2023

Right before a tsunami hits the tide goes way out and things seem to get oddly quiet. My general feel is that this is happening with some AI stuff where I have an inkling that labs are holding back or

SRE Weekly Issue #358

Monday, February 6, 2023

View on sreweekly.com A message from our sponsor, Rootly: Manage incidents directly from Slack with Rootly 🚒. Rootly automates manual tasks like creating an incident channel, Jira ticket and Zoom rooms

WP Weekly 132 - Geeky - Auto Save Forms, WP ShowOff, Event Automator

Monday, February 6, 2023

Read on Website WP Weekly 132 / Geeky A lot of geeky things are in focus this week, ready for implementation on your WordPress websites. Be it 'save and continue' in Gravity Forms or connecting

Weekend Reading — 👋 How many fingers to a hand?

Monday, February 6, 2023

This week we ask who's responsible for technical decisions, dig into the origins of spaghetti code, discover a new dopamine loop, talk a lot (too much?) about generative AI, and wrap it up with a

U.S. military shoots down suspected Chinese surveillance balloon — and Ask HN: Are you tired of reading ChatGPT headlines?

Sunday, February 5, 2023

Issue #1034 — Top 20 stories of February 06, 2023 Issue #1034 — February 06, 2023 You receive this email because you are subscribed to Hacker News Digest. You can open it in the browser if you prefer.

Dragons, bailouts and resort buyers

Sunday, February 5, 2023

Neologism #19, 05.02.2023 ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌

Daily Coding Problem: Problem #1014 [Medium]

Sunday, February 5, 2023

Daily Coding Problem Good morning! Here's your coding interview problem for today. This problem was asked by Facebook. Given a start word, an end word, and a dictionary of valid words, find the

The end of writing & No Tracking, no bias

Sunday, February 5, 2023

In this week's issue of Creativerly: Supercharged daily productivity, up your game, date-focused note-taking, and a lot more. Creativerly Creativerly The end of writing & No Tracking, no bias

The Station - Elon dodges liability, Ford falters and Rivian lays off more workers

Sunday, February 5, 2023

TechCrunch Newsletter TechCrunch logo The Transportation logo By Kirsten Korosec Sunday, February 05, 2023 Welcome back to The Station, your central hub for all past, present and future means of moving

Contracts you should never sign

Sunday, February 5, 2023

The good news is that contracts are not set in stone, they are usually open to negotiation #508 – February 06, 2023 View in browser Programming Digest Contracts you should never sign The good news is