Tactile-Augmented Radiance Fields (CVPR 2024)

Dataset · Checkpoints · Website · Paper

Yiming Dou, Fengyu Yang, Yi Liu, Antonio Loquercio, Andrew Owens

Installation

1. Install Nerfstudio modules

1.1. Install Nerfstudio dependencies

Follow these instructions up to and including "tinycudann" to install dependencies and create an environment

1.2. Clone this repo

git clone https://github.com/Dou-Yiming/TaRF.git

1.3. Install tarf modules as a python package

cd TaRF/nerfstudio_modules
python -m pip install -e .

1.4. Run ns-install-cli

1.5. Check the install

Run ns-train -h: you should see a list of "subcommands" with tarf included among them.

2. Install Diffusion modules

2.1 Create another Conda environment

conda create --name ldm -y python=3.8

2.2 Install ldm

cd TaRF/img2touch
python -m pip install -e .

Using TaRF

Train your own TaRF

Coming soon!

Bibtex

If you find TaRF useful, please conside citing:

@inproceedings{dou2024tactile,
  title={Tactile-augmented radiance fields},
  author={Dou, Yiming and Yang, Fengyu and Liu, Yi and Loquercio, Antonio and Owens, Andrew},
  booktitle={Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition},
  pages={26529--26539},
  year={2024}
}