Code

feat: add LLAMA_CPP_N_THREADS env#742

Code

Merged

wsxiaoys merged 4 commits intoTabbyML:mainTabbyML/tabby:mainfrom erfanium:add-llama-threads-envCopy head branch name to clipboardNov 9, 2023

+5-1

Commits

Commits on Nov 9, 2023

• feat: add LLAMA_CPP_N_THREADS and LLAMA_CPP_N_THREADS_BATCH envs

  erfanium

  committed
  d137bf4

• apply format

  erfanium

  committed
  0831a3c

• improve: use LLAMA_CPP_N_THREADS for both n_threads and n_threads_batch

  erfanium

  committed
  b01ccec

• Update crates/llama-cpp-bindings/src/engine.cc

  wsxiaoys

  authored
  ae0c701