Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[BUG] AlexNet, ResNet scripts of TensorFlow use wrong data path #23

Open
shishaochen opened this issue Sep 19, 2017 · 4 comments
Open

Comments

@shishaochen
Copy link

From tools/tensorflowbm6_gpu21.config and http://dlbench.comp.hkbu.edu.hk/, we know dlbench of version 8 will call alexnet and resnet for CNN tests.
But, Cifar10 experiments won't succeed as the data path is wrong in scritps.

# From tools/tensorflow/cnn/alexnet/alexnet_cifar10.py and tools/tensorflow/cnn/resnet/resnet_cifar10.py
tf.app.flags.DEFINE_string('data_dir', os.environ['HOME']+'/data/tensorflow/cifar10/cifar-10-batches-bin', """Data directory""")

I manually download the data file tensorflow.zip and make a test. The correct path should be:
~/data/tensorflow/cifar10/cifar-10-batches-py
By the way, if will be appreciated if you can dynamically set the data path instead of using user home directory.

@shyhuai
Copy link
Collaborator

shyhuai commented Sep 19, 2017

Thanks for your suggestion. We assume that users put their data in the directory of $HOME/data/.

@shishaochen
Copy link
Author

shishaochen commented Sep 19, 2017

@shyhuai I mean the directory name should be "cifar-10-batches-py" rather than "cifar-10-batches-bin" at https://github.com/hclhkbu/dlbench/blob/master/tools/mxnet/train_cifar10.py#L32.
Besides, '$HOME' is the same as "~" in Linux Shell/Python or you can set it to "$HOME/data/tensorflow/cifar10/cifar-10-batches-py".

@shyhuai
Copy link
Collaborator

shyhuai commented Sep 20, 2017

@shishaochen cifar-10-batches-py is used for the new input method, which was added for faster data reading, while cifar-10-batches-bin is also needed when set --dataset to False. We will unify these two soon.

@shishaochen
Copy link
Author

@shyhuai As we call the benchmark.py you provide, the error occurs. It is grateful that you can make the pipeline of "benchmark.py -> xxxbm.py -> t.sh -> network.py" correct and smooth.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants