Deinventing the Wheel - Loris Cro

Описание: Deinventing the Wheel - Loris Cro - PyCon Italia 2024

Elevator Pitch:
The ability to include pre-built binaries into Python packages has been crucial for Python but now 75% of PyPi's 66TB total data is occupied by binary blobs.

What would happen if we didn't have to bundle binaries into Python packages anymore?

Description:
When a Python package depends on non-python code (usually C/C++ libraries), it's customary to include in the package also pre-built binary blobs of those external dependencies. This is done for good reasons as it's the only way to ensure that clients won't have problems when installing the package. Or, at least, it used to be the only way.

Bundling binary blobs into packages also comes with some downsides, the biggest of which is that, of the current 66TB of package data stored in PyPI, 50TB (75%) is just binary blobs (see https://py-code.org/stats), which is only going to get worse as the rise of new architectures will mean that even more pre-built blobs will have to be bundled in each package.

In this talk I will explain why building C/C++ projects can be problematic and will show how those problems are solved by the Zig compiler toolchain. After that I will explain the exciting things that could be achieved once building C/C++ code stops being a problem, from helping PyPI free some space, to creating maximally efficient builds for the target machine.

By the end of the talk attendees should have gained some insight into how Python tooling interacts with C/C++ dependencies, have gained some sympathy for PyPI (running a package index is expensive!), and be inspired by the positive effects that advances in the systems programming space can bring to Python.

Learn more: https://2024.pycon.it/event/deinventi...

#Tooling #Packaging #Performance #PyPi