[Python Dependency Pitfalls] "Re-inventing the wheel" disease

Hey there,

PyPI, the Python packaging repository, now contains more than 100,000 third-party packages in total.

That's an *overwhelming* number of packages to choose from...

And this feeling of overwhelm and "choice paralysis" is exactly what held me back earlier on in my Python career.

Here, let me explain:

Back when I got "serious" about building my Python skills, mastering the syntax of the language was NOT the hardest part.

Python's syntax is quite clear and intuitive by comparison, and there's a (relatively) obvious path to learning it.

But when it comes to Python's 100k+ libraries and frameworks that's simply an OVERWHELMING number to choose from (and there's no way to memorize all of them.)

So anyway, what tripped me up as a fledgling Pythonista was this:

I had the basics of Python under my belt, but I struggled when it came to adopting the right workflows and tools of the "ecosystem" surrounding the core language.

Thus, I wasted time reinventing existing solutions left and right...

Sometimes I spent DAYS writing my own (crappy) versions of common building blocks like config file parsers, data validators, or visualization tools.

Now, sure I learned quite a bit from doing that—

But I kept repeating the same mistake and was "reinventing the wheel" even when under a tight deadline.

In hindsight, my ignorance caused me a ton of undue stress and sleep deprivation.

Part of it was overconfidence in my abilities, and another part was a lack of experience using "bread and butter" tools like the pip package manager, virtual environments, and requirements files.

Once I got the hang of Python's dependency management tools and workflows I was able to overcome my "reinventing the wheel disease" relatively quickly.

Mastering those tools and coming up with strategies for identifying high-quality Python packages opened up a whole new world to me:

By leveraging Python's packaging ecosystem I was suddenly coding at a higher level of abstraction.

And it had a MASSIVE impact on my productivity and efficiency.

Saying it allowed me to 10X my output wouldn't be too far off.

If you use Python and you're wondering how to go from "writing scripts" to "building applications"—

Then there's a good chance you could benefit from focusing on your dependency management skills.

You might be ready for a similar "quantum leap" in your productivity.

In Managing Python Dependencies With Pip and Virtual Environments, I give you the exact step-by-step workflows I use every day to work on Python projects small and large.

When you add just one of these tricks to your personal dev workflow you'll *permanently* increase your productivity and efficiency as a developer.

Details here:

realpython.com/products/managing-python-dependencies/

— Dan Bader

Key phrases

common building blocks config file parsers similar quantum leap personal dev workflow dependency management skills pip package manager dependency management tools Python packaging repository highquality Python packages

Older messages

[PythonistaCafe] Q&A

Tuesday, June 28, 2022

Hey there, At this point you should have a pretty good idea of what PythonistaCafe is about and what makes it special. In this email I want to answer some common questions that I get asked about the

[Sublime + Python Setup] Don’t build “nag screen muscle memory”

Tuesday, June 28, 2022

Hey there, Once I worked with a developer who refused to buy a registered copy of Sublime for months on end, even though he *loved* Sublime. He used it as his main code editor every day and was very

[Python Dependency Pitfalls] Artisanal "from-scratch" development

Tuesday, June 28, 2022

Hey there, The other day I got this question from Newsletter member Newvick in my email inbox: ~~~ I'm trying to get past the beginner's stage in Python and one problem I have is: When do you

[Python Dependency Pitfalls] What dev managers expect from Python candidates

Monday, June 27, 2022

Hey there, My friend Og is a senior manager at Red Hat and works with a large team of developers and quality engineers using Python. I got to pick his brain on what he thought were the most important

[PythonistaCafe] What's in PythonistaCafe for you?

Monday, June 27, 2022

Hey there, A couple of years ago I'd become quite interested in martial arts. Hours upon hours of watching "The Karate Kid" growing up must've taken their toll on me... And so, I

Midjourney closes free trials of its AI image generator

Friday, March 31, 2023

The Morning After Now available on your smart speaker and wherever you get your podcasts Apple Podcasts | Spotify | Google Podcasts It's Friday, March 31, 2023. It's a day of reality catching

How Nintendo Made Me Love Cardio

Friday, March 31, 2023

Read in Browser Logo for Review Geek March 31, 2023 Getting your workout in is a big chore sometimes, especially when you don't care for a specific kind of exercise. But, like with most things,

Your weekly Notion templates #82

Friday, March 31, 2023

3 new templates + 1 cool tip, just for you 🔥 ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌

New Wi-Fi Protocol Security Flaw Affecting Linux, Android and iOS Devices

Friday, March 31, 2023

The Hacker News Daily Updates Newsletter cover Cloud Native Security ($24.00 Value) FREE for a Limited Time Explore the latest and most comprehensive guide to securing your Cloud Native technology

Post from Syncfusion Blogs on 03/31/2023

Friday, March 31, 2023

New blogs from Syncfusion Streamline MAUI Projects with the Syncfusion .NET MAUI Template Studio What's New in 2023 Volume 1: .NET MAUI Charts More from the Syncfusion Ecosystem Bold Reports:

ASP.NET Core News - 03/31/2023

Friday, March 31, 2023

View this email in your browser Get ready for this weeks best blog posts about ASP.NET Core! This newsletter is sponsored by Box III: Gavin Belson Signature Edition. Well, it's not really. But this

Webinar #8 - Slim down your aggregates!

Friday, March 31, 2023

Watch now (98 min) | Aggregate is one of the most stimulating terms in the programming world. Some people are treating it as the Holy Graal of business logic design. When planning to design a new one,

📝 Guest Post: Switching from Spreadsheets to Experiment Tracker and How It Improved My Model Development Process*

Friday, March 31, 2023

In this guest post, neptune.ai shares the story of one of its users, Nikita Kozodoi. He talks about his model development process before and after using Neptune. Give it a read! You can find the full

DeveloPassion's Newsletter - Midweek Links #16

Friday, March 31, 2023

Hello everyone! I'm Sébastien Dubois, your host. You're receiving this email because you signed up for DeveloPassion's Newsletter. Thank you for being here with me ✨ The best way to support

OpenAI's robotics investment 🤖, Arc's new mobile browser 📱, guide to CSS masking 👨‍💻

Friday, March 31, 2023

Norwegian robotics firm, 1X (previously known as Halodi), has secured $23.5 million in a Series A2 funding round led by the OpenAI Startup Fund. Sign Up|Jobs|Advertise|View Online TLDR Together With