[Python Dependency Pitfalls] "Re-inventing the wheel" disease

Hey there,

PyPI, the Python packaging repository, now contains more than 100,000 third-party packages in total.

That's an *overwhelming* number of packages to choose from...

And this feeling of overwhelm and "choice paralysis" is exactly what held me back earlier on in my Python career.

Here, let me explain:

Back when I got "serious" about building my Python skills, mastering the syntax of the language was NOT the hardest part.

Python's syntax is quite clear and intuitive by comparison, and there's a (relatively) obvious path to learning it.

But when it comes to Python's 100k+ libraries and frameworks that's simply an OVERWHELMING number to choose from (and there's no way to memorize all of them.)

So anyway, what tripped me up as a fledgling Pythonista was this:

I had the basics of Python under my belt, but I struggled when it came to adopting the right workflows and tools of the "ecosystem" surrounding the core language.

Thus, I wasted time reinventing existing solutions left and right...

Sometimes I spent DAYS writing my own (crappy) versions of common building blocks like config file parsers, data validators, or visualization tools.

Now, sure I learned quite a bit from doing that—

But I kept repeating the same mistake and was "reinventing the wheel" even when under a tight deadline.

In hindsight, my ignorance caused me a ton of undue stress and sleep deprivation.

Part of it was overconfidence in my abilities, and another part was a lack of experience using "bread and butter" tools like the pip package manager, virtual environments, and requirements files.

Once I got the hang of Python's dependency management tools and workflows I was able to overcome my "reinventing the wheel disease" relatively quickly.

Mastering those tools and coming up with strategies for identifying high-quality Python packages opened up a whole new world to me:

By leveraging Python's packaging ecosystem I was suddenly coding at a higher level of abstraction.

And it had a MASSIVE impact on my productivity and efficiency.

Saying it allowed me to 10X my output wouldn't be too far off.

If you use Python and you're wondering how to go from "writing scripts" to "building applications"—

Then there's a good chance you could benefit from focusing on your dependency management skills.

You might be ready for a similar "quantum leap" in your productivity.

In Managing Python Dependencies With Pip and Virtual Environments, I give you the exact step-by-step workflows I use every day to work on Python projects small and large.

When you add just one of these tricks to your personal dev workflow you'll *permanently* increase your productivity and efficiency as a developer.

Details here:


— Dan Bader

Key phrases

Older messages

[Python Dependency Pitfalls] Artisanal "from-scratch" development

Wednesday, November 10, 2021

Hey there, The other day I got this question from Newsletter member Newvick in my email inbox: ~~~ I'm trying to get past the beginner's stage in Python and one problem I have is: When do you

[PythonistaCafe] Q&A

Tuesday, November 9, 2021

Hey there, At this point you should have a pretty good idea of what PythonistaCafe is about and what makes it special. In this email I want to answer some common questions that I get asked about the

[Python Dependency Pitfalls] What dev managers expect from Python candidates

Tuesday, November 9, 2021

Hey there, My friend Og is a senior manager at Red Hat and works with a large team of developers and quality engineers using Python. I got to pick his brain on what he thought were the most important

[Sublime + Python Setup] Sublime Text is just a blank canvas…

Monday, November 8, 2021

Hey there, When I became serious about optimizing Sublime Text with plugins, it was hard for me to separate the wheat from the chaff. Without a real guideline or roadmap I resorted to installing *any*

[Python Dependency Pitfalls] How to set the world on fire

Monday, November 8, 2021

Hey there, #1 on my list of dependency management pitfalls is there for a good reason: It lead to a single developer causing mayhem and breaking thousands of open-source projects around the world in

Tuesday Triage #72

Wednesday, December 1, 2021

Your weekly crème de la crème of the Internet is here! The 72nd edition of Tuesday Triage, featuring oroshigane, Schlörwagen, and cranachan. ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌

AWS unveils new open source autoscaling tool Karpenter at customer conference

Tuesday, November 30, 2021

TechCrunch Newsletter TechCrunch logo The Daily Crunch logo Tuesday, November 30, 2021 • By Alex Wilhelm Hello and welcome to Daily Crunch for Tuesday, November 30, 2021! This is the last newsletter of

Accepted and ghosted: interviewing for a leadership position at Stripe — and 4x Smaller, 50x Faster

Tuesday, November 30, 2021

Issue #603 — Top 20 stories of December 01, 2021 Issue #603 — December 01, 2021 You receive this email because you are subscribed to Hacker News Digest. You can open it in the browser if you prefer. 1

BetterDev #221 - How JavaScript engines achieve great performance

Tuesday, November 30, 2021

Better Dev #221 Nov 29, 2021 Hi all, It has been 3 weeks without an issue and I miss BetterDev myself. We're planning for some new release of a new version of BetterDev to also contribute useful

Data Elixir - Issue 364

Tuesday, November 30, 2021

Shuffling the cloud. Data for good, responsibly. Decision tree viz. Longform NLP pipelines. Controlling the job hunt. ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌

Python Argument Defaults, Data Viz With Dash, Rats in VR, and More

Tuesday, November 30, 2021

Late-Bound Argument Defaults for Python #501 – NOVEMBER 30, 2021 VIEW IN BROWSER The PyCoder's Weekly Logo Late-Bound Argument Defaults for Python Python supports default values for arguments to

JSK Daily for Nov 30, 2021

Tuesday, November 30, 2021

JSK Daily for Nov 30, 2021 View this email in your browser A community curated daily e-mail of JavaScript news Introducing JavaScript Breadcrumb Control in Essential JS 2 The Breadcrumb component is a

Charts | Population Boom: How We Got to Nearly 8 Billion People 🌎

Tuesday, November 30, 2021

In the next year or so, humanity is expected to pass the 8 billion person milestone. These charts and maps put global population growth into context. The new edition of "Signals". Available

WebAIM November 2021 Newsletter

Tuesday, November 30, 2021

WebAIM November 2021 Newsletter Read this newsletter online at https://webaim.org/newsletter/2021/november Microsoft Excel - Optimizing Spreadsheet Accessibility This new WebAIM article covers some

3 views on Jack Dorsey’s decision to step down as Twitter’s CEO

Tuesday, November 30, 2021

TechCrunch+ Newsletter TechCrunch+ logo TechCrunc+ Roundup logo By Walter Thompson and Ram Iyer Tuesday, November 30, 2021 Welcome to TechCrunch+ Tuesday Image Credits: Joe+Raedle / Getty Images Jack