Skip to content

Huawei-MRC-OSI/modelcap

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

15 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

Modelcap is a Nix like library for lightweight state-tracking in Python, but extremely lightweight.

Modelcap

Features:

  • Modelcap is a tool for tracking immutable application-defined states in Python
  • States reside in a storage which is a pre-defined folder in a filesystem.
  • Basic (and currently the only) base classes are:
    • Config, which represents JSON-serializable configuration. Configurations may contain references to other states in the storage.
    • Model, for moving the state across its lifecycle from creation to sealing into the storage.
  • For Models, there are methods to keep record of non-determenistic state modifications via JSON-serializable abstractions called Program s.
  • There is a collection of functions for search and dependency-tracking.
  • Mypy-based typing
  • No extra ependencies
  • <1K lines of code

The main usecase for this library is managing long multi-staged training of Machine learning models which is required by modern NLP. The ML-specific parts will be released soon as a separate library.

About

Lightweight Nix-like storage library in Python

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published