Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

What about GPU accelerated images? #2

Closed
benz0li opened this issue May 9, 2024 · 4 comments
Closed

What about GPU accelerated images? #2

benz0li opened this issue May 9, 2024 · 4 comments
Assignees
@benz0li
Labels
enhancement New feature or request

Comments

@benz0li
Copy link
Member

benz0li commented May 9, 2024 •
edited
Loading

i.e. CUDA-based images
@benz0li benz0li added the enhancement New feature or request label May 9, 2024
@benz0li benz0li self-assigned this May 9, 2024
@benz0li
Copy link
Member Author

benz0li commented May 9, 2024 •
edited
Loading

The MAX Engine does not support NVIDIA GPUs yet: https://docs.modular.com/max/faq#what-hardware-is-currently-supported-by-max-engine

GPU accelerated 'MAX Engine'-based images, i.e.

  • glcr.b-data.ch/jupyterlab/cuda/max/base
  • glcr.b-data.ch/jupyterlab/cuda/max/scipy

will be published as soon as the MAX Engine supports Python 3.12 and NVIDIA GPUs.
ℹ️ Supposedly this summer: https://twitter.com/Modular/status/1785131461345157140

Cross references:

@benz0li benz0li pinned this issue May 9, 2024
@benz0li benz0li mentioned this issue Jun 21, 2024
Closed
@benz0li
Copy link
Member Author

benz0li commented Aug 23, 2024

Regarding the new MAX & Mojo Community License Terms, see #1 (comment).

@benz0li
Copy link
Member Author

benz0li commented Dec 31, 2024

Here they are:

@benz0li
Copy link
Member Author

benz0li commented Dec 31, 2024

For models with an optimised [GPU accelerated] MAX Graph implementation, one could also use the regular images:

and run it with option --gpus '"device=all"'. PyTorch is still required, but the CPU-only version is sufficient.

Cross reference:

@benz0li benz0li closed this as completed Dec 31, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@benz0li benz0li

Labels
enhancement New feature or request
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
1 participant
@benz0li