Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Feature] add Dockerfile dev image and doc #2317

Closed
2 tasks
zhyncs opened this issue Dec 2, 2024 · 2 comments
Closed
2 tasks

[Feature] add Dockerfile dev image and doc #2317

zhyncs opened this issue Dec 2, 2024 · 2 comments
Assignees
Labels

Comments

@zhyncs
Copy link
Member

zhyncs commented Dec 2, 2024

Checklist

Motivation

Recently, the community has seen an influx of new developers. However, many are unfamiliar with using Docker for development and set up environments directly on their host machines, risking damage to the environment and affecting other developers. To efficiently utilize the cloud hosting resources sponsored by Nvidia H100, I will create a daily updated dev image and provide basic documentation to help new developers get started.

Related resources

No response

@zhyncs zhyncs added the backlog label Dec 2, 2024
@zhyncs zhyncs self-assigned this Dec 2, 2024
@zhyncs zhyncs mentioned this issue Dec 12, 2024
3 tasks
@zhyncs
Copy link
Member Author

zhyncs commented Dec 12, 2024

Closing for now, I will update later when I have bandwidth.

naive version

# pull
docker pull lmsysorg/sglang:dev

# run
# use -v for dir mapping
docker run -itd --shm-size 32g --gpus all lmsysorg/sglang:dev /bin/zsh

# exec
docker exec -it $(docker ps | grep sglang:dev | awk '{print $1}') /bin/zsh

@zhyncs zhyncs closed this as completed Dec 12, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

No branches or pull requests

1 participant