fix: keep logit_scale on same device

[numb3r3]

No description provided.

[codecov]

Codecov Report

Merging #710 (592dbb5) into main (835eb13) will not change coverage.
The diff coverage is 100.00%.

@@           Coverage Diff           @@
##             main     #710   +/-   ##
=======================================
  Coverage   81.24%   81.24%           
=======================================
  Files          16       16           
  Lines        1189     1189           
=======================================
  Hits          966      966           
  Misses        223      223           

Flag	Coverage Δ
cas	81.24% <100.00%> (ø)

Flags with carried forward coverage won't be shown. Click here to find out more.

Impacted Files	Coverage Δ
client/clip_client/__init__.py	100.00% <100.00%> (ø)
server/clip_server/__init__.py	100.00% <100.00%> (ø)
server/clip_server/executors/clip_torch.py	88.09% <100.00%> (ø)

---

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 099e221...592dbb5. Read the comment docs.