Host on JCloud

Warning

JCloud does not support GPU hosting yet. Hence clip_server deployed on JCloud will be run on CPU.

Essentially clip_server is a Jina Flow. Any Jina Flow can be hosted on JCloud, hence clip_server can be hosted on JCloud as well. Learn more about JCloud here.

First, you need a Flow YAML file for deploy. A minimum YAML file is as follows:

torch-flow.yml

jtype: Flow
executors:
  - uses: jinahub+docker://CLIPTorchEncoder

onnx-flow.yml

jtype: Flow
executors:
  - uses: jinahub+docker://CLIPOnnxEncoder

Note that, port is unnecessary here as JCloud will assign a new URL for any deployed service.

Executors now must start with jinahub+docker:// as it is required by JCloud. We currently provide containerized executors jinahub+docker://CLIPTorchEncoder and jinahub+docker://CLIPOnnxEncoder on Jina Hub. They are automatically synced on the new release of clip_server module.

To deploy,

PyTorch-backed

jc deploy torch-flow.yml

ONNX-backed

jc deploy onnx-flow.yml

If Flow is successfully deployed you will see:

You can now connect to it via client by setting server as the URL given by JCloud:

from clip_client import Client

c = Client(
    'grpcs://174eb69ba3.wolf.jina.ai'
)  # This is the URL you get from previous step
c.profile()