Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

how to share large packages between projects/environments? #2604

Closed
fancyerii opened this issue Feb 2, 2024 · 1 comment
Closed

how to share large packages between projects/environments? #2604

fancyerii opened this issue Feb 2, 2024 · 1 comment
Labels
⭐ enhancement Improvements for existing features

Comments

@fancyerii
Copy link

I have many projects with shared large packages such as pytorch(4G+). Every time I create a new project I need to install it. It wastes time and disk space. Is there any way to share these large packages like maven(java) or docker.

Java's maven is project based-- it manage each projects indenpendently. But all the dependents(jars) are stored centrally in .m2. So If project A and project B share exactly the same version of a lib, There is only one copy of this jar file.

I tried and searched many python package manager tools: pip,conda,pipenv,poetry,PDM. No of them has this features. A similar issue can be found pypa/packaging-problems#328. But I can't find solution there.

@fancyerii fancyerii added the ⭐ enhancement Improvements for existing features label Feb 2, 2024
@frostming
Copy link
Collaborator

PDM. No of them has this features

Really? https://pdm-project.org/latest/usage/config/#central-installation-caches

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
⭐ enhancement Improvements for existing features
Projects
None yet
Development

No branches or pull requests

2 participants