Web Scraping Tools & Legality, How Async Should've Been, 90% Python Wheels Adoption, and More

#424 – JUNE 9, 2020
The PyCoder’s Weekly Logo
Web Scraping in Python: Tools, Techniques, and Legality
Do you want to get started with web scraping using Python? Are you concerned about the potential legal implications? What are the tools required and what are some of the best practices? This week Kimberly Fessel is a guest on the Real Python Podcast to discuss her excellent tutorial created for PyCon 2020 online titled “It’s Officially Legal so Let’s Scrape the Web.”
REAL PYTHON podcast

Pedantic Configuration Management with Pydantic
Dealing with multiple configuration files for a Python application can be stressful. Learn how to take the edge off with a custom workflow centered around the Pydantic library.
REDOWAN NAFI • Shared by Redowan Delowar

Find Performance Bottlenecks in Python Code
“We should forget about small efficiencies, say about 97% of the time: premature optimization is the root of all evil. Yet we should not pass up our opportunities in that critical 3%.” - Donald Knuth Blackfire is built to let you find the 3%. Quick install, appealing and user-friendly UI. →
BLACKFIREsponsor

How Async Should Have Been
Sometimes synchronous and asynchronous code can look very similar. The only difference might be the use of async and await keywords. In this opinion piece, Nikita Sobolev argues that the potential for repeated code is a design fault of Python’s asyncio framework, and describes a solution that allows synchronous Python to execute asynchronous code.
NIKITA SOBOLEV • Shared by Nikita Sobolev opinion

Our Python Monorepo
Opendoor, a residential real-estate startup, has quite a few Python services. These services were spread across several git repositories, but Opendoor’s engineering team recently moved them all into a single monorepo. Learn about the challenges the team faced with many repositories and how they set-up their monorepo to solve their problems.
DAN HIPSCHMAN

Fastest Way to Flatten a List in Python
Explore six different was to flatten a list of lists in Python and how their performance compares. The fastest of the six methods mentioned might surprise you!
CHRIS CONLAN

Nominees for 2020 Python Software Foundation Board Election
Ballots were sent out on June 8th.
PYTHON.ORG


Discussions


Classifying Values Based on Ranges That Contain Them
Avoid big if/else blocks by using the bisect module!
STACK OVERFLOW

Can You Change the Value of the Integer 1 in Python?
Spoiler alert: yes! But you probably shouldn’t do that.
STACK OVERFLOW


Python Jobs


Senior Python Engineer (Remote)
GORGIAS

Software Engineer Python (Remote)
NETIZEN CORPORATION

Senior Backend Engineer Python/Django/PostgreSQL (Remote)
CYBERCODERS

More Python Jobs >>>


Articles & Tutorials


Python Wheels Crosses 90% Adoption
Wheels are the new standard of Python distribution and are intended to replace “eggs.” This site shows the top 360 most-downloaded packages on PyPI showing which have been uploaded as wheel archives. As of today, 90% of the top Python packages are now available as wheels on PyPI.
PYTHONWHEELS.COM

15 Amazing pytest Plugins
pytest plugins are an amazing way to supercharge your test suites, leveraging great solutions from people solving test problems all over the world. In this episode of the Test & Code Podcast, Michael Kennedy and Brian Okken discuss 15 favorite plugins that you should know about.
TESTANDCODE.COM podcast

Python 2 to 3 Migration: A Developer’s Experience
Still haven’t migrated your Python 2 application to Python 3? This article provides guidelines, strategies and tips to make the process as easy as possible, along with a ready-to-use Python 2-to-3 runtime containing the most relevant packages. Check it out! →
ACTIVESTATEsponsor

Regular Expressions: Regexes in Python (Part 2)
In the previous tutorial in this series, you learned how to perform sophisticated pattern matching using regular expressions, or regexes, in Python. This tutorial explores more regex tools and techniques that are available in Python.
REAL PYTHON

Getting the Most Out of a Python Traceback
Learn how to read and understand the information you can get from a Python stack traceback. You’ll walk through several examples and see some of the most common tracebacks in Python.
REAL PYTHON video

Python Community Interview With Kattni Rembor
Kattni Rembor is a creative engineer at Adafruit Industries. In this interview, she talks about her work developing CircuitPython and the role mentorship has played in her career to date. She also shares her advice for anyone looking to start their first hardware project using CircuitPython.
REAL PYTHON

Combining Flask and Vue
Learn about three ways to combine Flask and Vue, the pros and cons of each, and some guidelines for when to use each method.
JACE MEDLIN • Shared by Jace Medlin

What is Python Redis? Enhance Python with Redis – The Fastest In-Memory Cloud Database
Install redis-py & Python Redis Client. Explore how Redis can enhance Python capabilities. Learn how to use Connection Pooling, SSL, Reading & Writing, & Opening a Connection with redis-py.
REDIS LABSsponsor

Django Stripe Tutorial
Learn how to configure a new Django website from scratch to accept one-time payments with Stripe Checkout.
MICHAEL HERMAN • Shared by Michael Herman

Why You Should Use More Enums in Python
Learn about Python’s Enum type and why you should consider using them in your own programs.
FLORIAN DAHLITZ • Shared by Florian Dahlitz

Python Debugging Tips
MARTIN HEINZ


Projects & Code


pydantic: Data Parsing and Validation Using Python Type Hints
GITHUB.COM/SAMUELCOLVIN

altair: Declarative Statistical Visualization Library for Python
GITHUB.COM/ALTAIR-VIZ

pyinfra: Automate Infrastructure Super Fast at Massive Scale
GITHUB.COM/FIZZADAR

falcon: The No-Nonsense, Minimalist Web Services and App Backend Framework
GITHUB.COM/FALCONRY

icl: An Interactive Memory Aid for One-Liners
GITHUB.COM/PLAINAS

falconify: Falcon Microservice Template for Quick Bootstrapping
GITLAB.COM/RAPHACOSTA

Happy Pythoning!
Copyright © 2020 PyCoder’s Weekly, All rights reserved.
You are receiving this email because you opted in on our website at pycoders.com
Our mailing address: DevCademy Media Inc. · #720-999 West Broadway, Vancouver BC V5Z 1K5, Canada

 | 

Older messages

Python 3.9 PEPs, Dependency Mgmt & Injection, Python on the Raspberry Pi, and More

Tuesday, June 2, 2020

The Many Ways to Pass Code to Python From the Terminal #423 – JUNE 2, 2020 VIEW IN BROWSER The PyCoder's Weekly Logo The Many Ways to Pass Code to Python From the Terminal You might know about

Async Python Tips, The Hypermodern Python Dev Setup, Job Hunting in a Pandemic, and More

Tuesday, May 26, 2020

Waiting in `asyncio` #422 – MAY 26, 2020 VIEW IN BROWSER The PyCoder's Weekly Logo Waiting in asyncio There are many ways to wait on the results of a coroutine in Python's asyncio framework.

Python vs JavaScript, Python Dev Survey 2019 Results, CPython 3.8.3 Released, and More

Tuesday, May 19, 2020

Python vs JavaScript for Pythonistas #421 – MAY 19, 2020 VIEW IN BROWSER The PyCoder's Weekly Logo Python vs JavaScript for Pythonistas Python and JavaScript are two of the most popular programming

Python Performance, Moving Django Models, the 2020 Python Language Summit, and More

Tuesday, May 12, 2020

Under Discussion: The Performance of Python #420 – MAY 12, 2020 VIEW IN BROWSER The PyCoder's Weekly Logo Under Discussion: The Performance of Python Victor Stinner and Julien Danjou sat down (

Python 3.9 Release Schedule, Documenting Tests, RegExes, Pythonic Lightsabers, and More

Tuesday, May 5, 2020

Python 3.9 Release Schedule #419 – MAY 5, 2020 VIEW IN BROWSER The PyCoder's Weekly Logo Python 3.9 Release Schedule In last week's episode we had the dates mixed up, here are the correct ones:

You Might Also Like

Daily Coding Problem: Problem #1647 [Medium]

Tuesday, December 24, 2024

Daily Coding Problem Good morning! Here's your coding interview problem for today. This problem was asked by Square. In front of you is a row of N coins, with values v 1 , v 1 , ..., v n . You are

Sentiment Analysis, Topological Sort, Web Security, and More

Tuesday, December 24, 2024

Exploring Modern Sentiment Analysis Approaches in Python #661 – DECEMBER 24, 2024 VIEW IN BROWSER The PyCoder's Weekly Logo Exploring Modern Sentiment Analysis Approaches in Python What are the

🤫 Do Not Disturb Mode Is My Secret to Sanity — 8 Gadgets I Want To See Nintendo Make

Tuesday, December 24, 2024

Also: The Best Christmas Movies to Watch on Netflix, and More! How-To Geek Logo December 24, 2024 Did You Know Their association with the Christmas season might make you think poinsettias hail from a

😱 AzureEdge.net DNS Retiring Jan. 2025, 🚀 Microsoft Phi-4 AI Outperforms, 🔒 Microsoft Secure Future Initiative

Tuesday, December 24, 2024

Blog | Advertise | View Online Your trusted source for Cloud, AI and DevOps guidance with industry expert Chris Pietschmann! Phi-4: Microsoft's New Small Language Model Outperforms Giants in AI

Mapped | The Top Health Insurance Companies by State 🏥

Tuesday, December 24, 2024

In 13 US states, a single company dominates the health insurance market, holding at least half of the total market share. View Online | Subscribe | Download Our App Presented by: Global X ETFs Power

The Stanford Grad Who Forgot How To Think

Tuesday, December 24, 2024

Top Tech Content sent at Noon! Boost Your Article on HackerNoon for $159.99! Read this email in your browser How are you, @newsletterest1? 🪐 What's happening in tech today, December 24, 2024? The

The next big HDMI leap is coming

Tuesday, December 24, 2024

Sora side hustles; Casio's tiny watch comes to the US -- ZDNET ZDNET Tech Today - US December 24, 2024 Ecovacs Deebot T30S Combo robot vacuum and mop The next big HDMI leap is coming next month -

⚙️ Robo-suits

Tuesday, December 24, 2024

Plus: The data center energy surge ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌

Apache Tomcat Vulnerability CVE-2024-56337 Exposes Servers to RCE Attacks

Tuesday, December 24, 2024

THN Daily Updates Newsletter cover The Data Science Handbook, 2nd Edition ($60.00 Value) FREE for a Limited Time Practical, accessible guide to becoming a data scientist, updated to include the latest

Edge 459: Quantization Plus Distillation

Tuesday, December 24, 2024

Some insights into quantized distillation ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏