Support Shared Storage

[zojw]

This is a tracking issue for implementing the cache storage

the design can be found in #247

• Prototype & Basic Trait storage: add a cached storage #252
• Implement Storage trait for S3 storage: implement storage trait for s3 #271
• Implement gRPC Storage #322
• Implement Cache Storage #323
• Implement Storage Master #324
• Implement Remote storage client-side #332
• Port-back file system local storage for cache node service
• Replace mocked orchestrator by k8s backend implement

[zojw]

I'd like to take 2nd item: "implement Storage trait for S3" first and investigate 3rd item after finish it

[huachaohuang]

Thanks. I had some discussion with @zojw and he would like to take over the design and implementation of the cached storage once #252 gets merged.

[zojw]

Hi, I'd update the issue sub-task list with more component implementation details

And I'd like to take 3rd item "Define Communication API between components and implement as Remote Storage Trait" first, it will demonstrate how components work together and final use API (trait)(for implements detail it's planning to use memory or mock implement first in this work item)

[tisonkun]

@zojw could you create issues for all these subtasks? The reason as in #221 (comment). Of course, you can always make your progress but describing the status helps participants to extend your strength.

For example, currently the S3 implementation isn't well tested and you can create an issue for it.

[zojw]

The shared storage development work has been migrated to another repo as one of engula's external implements, the related issue has be replaced with zojw/shared-storage#4, so close this first