Packaging Python and PyTorch for a Machine Learning Application
· 9 min read
note
Since writing this post, we updated our installer to use uv, and it's great. We now use conda to install python then use uv for everything else.
One of our primary goals is to make Transformer Lab the most powerful tool available when working with local LLMs. Almost all of the most powerful libraries and tools out there are written in Python. So, we need a way to package Python, PyTorch, and associated tools as part of our application. All of this has to work reliably across multiple operating systems and hardware architectures.
This ended up being much harder than we could ever have imagined...