To calibrate your model to the INT8 precision, follow the steps below:
-
Install the Accuracy Checker and Post-Training Optimization tool in your environment. Both tools are delivered as a part of the OpenVINO™ toolkit, but you can use the Accuracy Checker directly from the Open Model Zoo GitHub* repository if you like.
-
Download a dataset and convert annotations to the Accuracy Checker friendly format.
-
Convert your model to the Intermediate Representation (IR). The IR contains a generated JSON config file for calibration. Find examples like inception_v3.json in the directories of INT8 models.
-
Run the Post-Training Optimization tool with the JSON config file and wait for the calibration process completion.