[Python Dependency Pitfalls] "Re-inventing the wheel" disease

Hey there,

PyPI, the Python packaging repository, now contains more than 100,000 third-party packages in total.

That's an *overwhelming* number of packages to choose from...

And this feeling of overwhelm and "choice paralysis" is exactly what held me back earlier on in my Python career.

Here, let me explain:

Back when I got "serious" about building my Python skills, mastering the syntax of the language was NOT the hardest part.

Python's syntax is quite clear and intuitive by comparison, and there's a (relatively) obvious path to learning it.

But when it comes to Python's 100k+ libraries and frameworks that's simply an OVERWHELMING number to choose from (and there's no way to memorize all of them.)

So anyway, what tripped me up as a fledgling Pythonista was this:

I had the basics of Python under my belt, but I struggled when it came to adopting the right workflows and tools of the "ecosystem" surrounding the core language.

Thus, I wasted time reinventing existing solutions left and right...

Sometimes I spent DAYS writing my own (crappy) versions of common building blocks like config file parsers, data validators, or visualization tools.

Now, sure I learned quite a bit from doing that—

But I kept repeating the same mistake and was "reinventing the wheel" even when under a tight deadline.

In hindsight, my ignorance caused me a ton of undue stress and sleep deprivation.

Part of it was overconfidence in my abilities, and another part was a lack of experience using "bread and butter" tools like the pip package manager, virtual environments, and requirements files.

Once I got the hang of Python's dependency management tools and workflows I was able to overcome my "reinventing the wheel disease" relatively quickly.

Mastering those tools and coming up with strategies for identifying high-quality Python packages opened up a whole new world to me:

By leveraging Python's packaging ecosystem I was suddenly coding at a higher level of abstraction.

And it had a MASSIVE impact on my productivity and efficiency.

Saying it allowed me to 10X my output wouldn't be too far off.

If you use Python and you're wondering how to go from "writing scripts" to "building applications"—

Then there's a good chance you could benefit from focusing on your dependency management skills.

You might be ready for a similar "quantum leap" in your productivity.

In Managing Python Dependencies With Pip and Virtual Environments, I give you the exact step-by-step workflows I use every day to work on Python projects small and large.

When you add just one of these tricks to your personal dev workflow you'll *permanently* increase your productivity and efficiency as a developer.

Details here:

realpython.com/products/managing-python-dependencies/

— Dan Bader

Older messages

[Python Mastery] Learn Python in 21 days!!!!11 (what a lie)

Friday, September 30, 2022

Hey there, One of the first programming books I ever bought was "Teach Yourself C in 21 Days." This four pound tome came with a CD-ROM that included an ancient version (3.1) of the Borland

[Python Mastery] The secret to "ethical self-promotion"?

Thursday, September 29, 2022

Hey there, Here's some food for thought: There's a difference between *doing* a great job as a Python developer, and *to be seen doing* a great job. Being a skilled developer among peers—and

[Python Dependency Pitfalls] Artisanal "from-scratch" development

Thursday, September 29, 2022

Hey there, The other day I got this question from Newsletter member Newvick in my email inbox: ~~~ I'm trying to get past the beginner's stage in Python and one problem I have is: When do you

[Sublime + Python Setup] The Ctrl+s "Heisenbug"

Thursday, September 29, 2022

"What the **** is going on?!" I heard Keith yell. Returning from my lunch break and in a helpful mood I grabbed my coffee mug and shuffled over to my coworker's desk. "What's

[Python Dependency Pitfalls] What dev managers expect from Python candidates

Wednesday, September 28, 2022

Hey there, My friend Og is a senior manager at Red Hat and works with a large team of developers and quality engineers using Python. I got to pick his brain on what he thought were the most important

Kotlin Weekly #340

Sunday, February 5, 2023

ISSUE #340 5th of February 2023 Announcements We Are Improving Library Authors' Experience! Are you a Kotlin librarian? The JetBrains team explains in this post some of the things they are doing to

Open Assistant – project meant to give everyone access to a great chat based LLM — Update on Samsung SSD Reliability — and Universal Summarizer

Saturday, February 4, 2023

Issue #1033 — Top 20 stories of February 05, 2023 Issue #1033 — February 05, 2023 You receive this email because you are subscribed to Hacker News Digest. You can open it in the browser if you prefer.

Daily Coding Problem: Problem #1013 [Medium]

Saturday, February 4, 2023

Daily Coding Problem Good morning! Here's your coding interview problem for today. This problem was asked by Yahoo. Write a function that returns the bitwise AND of all integers between M and N ,

How to Use a USB Flash Drive With an Android Phone or Tablet

Saturday, February 4, 2023

Did You Know?: The theme song for the popular PBS show The Magic School Bus was performed by none other than rock-and-roll great Little Richard. Read in Browser Logo for How-To Geek February 4, 2023

Ranked | Top Online Music Services in the U.S. by Monthly Users 🎼

Saturday, February 4, 2023

This graphic shows the percentage of Americans that are monthly music listeners for each service. Which is most popular? View Online | Subscribe FEATURED STORY The Top Online Music Services in the US

Week in Review - Netflix crackdown, monetizing ChatGPT and bypassing FB’s 2FA

Saturday, February 4, 2023

TechCrunch Newsletter TechCrunch logo Week in Review logo By Henry Pickavet Saturday, February 04, 2023 Happy weekend, folks, and welcome back to the TechCrunch Week in Review. Henry here, standing in

Noonification: A Brief History of Open Source

Saturday, February 4, 2023

Top Tech Content sent at Noon! Get hands-on learning from ML experts on Coursera How are you, @hacker? 🪐 What's happening in tech this week: The Noonification by HackerNoon has got you covered with

Startups Weekly - 2023 is the year of the bottom line

Saturday, February 4, 2023

TechCrunch Newsletter TechCrunch logo Startups Weekly logo By Natasha Mascarenhas Saturday, February 04, 2023 Welcome to Startups Weekly, a nuanced take on this week's startup news and trends by

One Song, Many Writers 🎸

Saturday, February 4, 2023

Why modern songs have super-sized writing credits. Here's a version for your browser. Hunting for the end of the long tail • February 04, 2023 Hey all, Ernie here with a piece from Chris Dalla Riva

🐍 New Python tutorials on Real Python

Saturday, February 4, 2023

Hey there, There's always something going on over at realpython.com as far as Python tutorials go. Here's what you may have missed this past week: How to Iterate Over Rows in pandas, and Why