Currently we are releasing our codebase with support for the following benchmarks:
| Benchmark Suite | Observation Space | Action Space | Goal Specification | Policy Learning |
|---|---|---|---|---|
| Metaworld | RGB + proprio. | Continuous | - | IL |
| ImageNav | RGB | Discrete | Goal Image | RL |
We are planning to add the OVMM benchmark soon.
To install CortexBench, please follow the instructions in ../INSTALLATION.md.
| Benchmark | Description | Download Link |
|---|---|---|
| ImageNav | The ImageNav benchmark uses Gibson scene datasets. The training and validation episode datasets for ImageNav can be downloaded from this link. | Gibson dataset, Training and Validation dataset |
| Metaworld | The Metaworld benchmark dataset. | Metaworld dataset |