Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

document dvc import and dvc get (previously pkg commands) #385

Closed
efiop opened this issue May 28, 2019 · 5 comments · Fixed by #464
Closed

document dvc import and dvc get (previously pkg commands) #385

efiop opened this issue May 28, 2019 · 5 comments · Fixed by #464
Assignees
Labels
A: docs Area: user documentation (gatsby-theme-iterative) p1-important Active priorities to deal within next sprints

Comments

@efiop
Copy link
Contributor

efiop commented May 28, 2019

UPDATE: See description in iterative/dvc#2160 instead.


OLD: Some introductory descriptions for DVC packages (from Discord):

You have project named awesome_project, which has awesome_data in it
pkg will allow you to "import" the project
dvc pkg import awesome_project://awesome_data (syntax may be incorrect)

  1. Any DVC repo is a package. Outputs inside packages can be called artifacts (that we'll also be able to work with)
  2. There will be a set of commands to import/export these packages across different repositories and from a repository to a file system (just a data artifact)
  3. basic use cases include things like: dataset registry (reuse a single dataset in multiple project, while having a single point of responsibility for the dataset itself), easy mechanism to pull a data artifact w/o doing git clone + dvc pull data.dvc, etc
  4. in the future (no need to focus on this for now) any set of DVC files will be considered as package, thus making pipelines reusable
@efiop efiop added A: docs Area: user documentation (gatsby-theme-iterative) command-reference labels May 28, 2019
@shcheklein shcheklein added the p1-important Active priorities to deal within next sprints label May 28, 2019
@jorgeorpinel

This comment has been minimized.

@efiop

This comment has been minimized.

@jorgeorpinel

This comment has been minimized.

@shcheklein

This comment has been minimized.

@efiop
Copy link
Contributor Author

efiop commented Jul 12, 2019

  • Note: also need to make sure to add a note that old import was moved to import-url.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
A: docs Area: user documentation (gatsby-theme-iterative) p1-important Active priorities to deal within next sprints
Projects
None yet
3 participants