You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Is your feature request related to a problem? Please describe.
Variables like max_batch_size, dynamic_batching, etc. need to be changed based on the hardware environment and third-party claims every run
Right now there isn't a convenient way to do so
Describe the solution you'd like
Support environment variables inside config
example config.pbtxt:
...
max_batch_size: ${MAX_BATCH_SIZE} or $$MAX_BATCH_SIZE
...
Describe alternatives you've considered
I wrote shell script to be runned before tritonserver with sed command to replace based on env
It works, but it isn't convenient and poses issues inside Kubernetes
forconfigin$(find $MODELS_PATH -type f -name 'config.pbtxt');do
sed -i -e "s/max_batch_size: [0-9]\{1,\}/max_batch_size: ${max_batch_size}/g"$configdone
The text was updated successfully, but these errors were encountered:
riZZZhik
changed the title
Support env variables in config.pbtxt
Support passing variables in config.pbtxt
Aug 15, 2024
Is your feature request related to a problem? Please describe.
Variables like max_batch_size, dynamic_batching, etc. need to be changed based on the hardware environment and third-party claims every run
Right now there isn't a convenient way to do so
Describe the solution you'd like
Support environment variables inside config
example config.pbtxt:
and/or pass them to
tritonserver
command:tritonserver --model-repository models --custom_variables '{"var1": "value1"}'
Describe alternatives you've considered
I wrote shell script to be runned before tritonserver with
sed
command to replace based on envIt works, but it isn't convenient and poses issues inside Kubernetes
The text was updated successfully, but these errors were encountered: