this post was submitted on 16 Feb 2024
2 points (100.0% liked)
Python
6360 readers
12 users here now
Welcome to the Python community on the programming.dev Lemmy instance!
π Events
Past
November 2023
- PyCon Ireland 2023, 11-12th
- PyData Tel Aviv 2023 14th
October 2023
- PyConES Canarias 2023, 6-8th
- DjangoCon US 2023, 16-20th (!django π¬)
July 2023
- PyDelhi Meetup, 2nd
- PyCon Israel, 4-5th
- DFW Pythoneers, 6th
- Django Girls Abraka, 6-7th
- SciPy 2023 10-16th, Austin
- IndyPy, 11th
- Leipzig Python User Group, 11th
- Austin Python, 12th
- EuroPython 2023, 17-23rd
- Austin Python: Evening of Coding, 18th
- PyHEP.dev 2023 - "Python in HEP" Developer's Workshop, 25th
August 2023
- PyLadies Dublin, 15th
- EuroSciPy 2023, 14-18th
September 2023
- PyData Amsterdam, 14-16th
- PyCon UK, 22nd - 25th
π Python project:
- Python
- Documentation
- News & Blog
- Python Planet blog aggregator
π Python Community:
- #python IRC for general questions
- #python-dev IRC for CPython developers
- PySlackers Slack channel
- Python Discord server
- Python Weekly newsletters
- Mailing lists
- Forum
β¨ Python Ecosystem:
π Fediverse
Communities
- #python on Mastodon
- c/django on programming.dev
- c/pythorhead on lemmy.dbzer0.com
Projects
- PythΓΆrhead: a Python library for interacting with Lemmy
- Plemmy: a Python package for accessing the Lemmy API
- pylemmy pylemmy enables simple access to Lemmy's API with Python
- mastodon.py, a Python wrapper for the Mastodon API
Feeds
founded 1 year ago
MODERATORS
you are viewing a single comment's thread
view the rest of the comments
view the rest of the comments
Is pip the real bottle neck in software development? How many dependencies are you managing that require this speed?
The longest running tool in our toolchain is
pytest, followed somewhat closely bypoetry. I work on a project with several teams, so I end up needing to reinstall deps pretty frequently.It's not something I'm actively looking for, but I wouldn't say no to some improvements. But I need the additional features of
poetry, so I probably won't bother until it gets a bit more sophisticated.The slowness of poetry is mostly due to network bottlenecks. While a Rust based tool, might be faster, it won't be a dramatic improvement, unlike the one we have seen with Ruff.
True, but poetry still has a long startup time (probably reading the lock file?) before it gets to the network parts. Also, a lot of the time spent in our projects is compiling/installing dependencies, not downloading them, and at least the install part could probably be sped up (I'm guessing async Rust is faster than whatever Poetry is doing).
But yeah, I'm not expecting huge wins here, but if it saves me a minute or so when rebuilding my docker images (currently takes >5 min in the poetry part alone), that's worth taking the time to switch.
I'm a lot more excited about projects like Ruff though, but any part of the Python tooling ecosystem is interesting.
Damn. Poetry alone takes 5 minutes in Docker rebuilds? That's good to know.
It does for us, ymmv. pip wasn't that much faster, so the version resolution isn't our main bottleneck, we just have a lot of packages (like 30 direct deps, and they have their own deps; seems like ~140 packages in our biggest microservice).
Damn
Well, I don't need to reinstall deps very often, like every 2 weeks at most. My regular workflow is like a 5s restart of the container, and that's if something breaks with the auto-reload.
But I still wouldn't say no to some speed improvements. It's way better than our FE codebase, which takes way longer.
FE?
Frontend (Javascript).
Ah. Thanks for clarifying, and apologies if I appeared stupid.
No worries, always happy to clarify. π