Hi, I’m trying to get VISIONE running on my system and I’m stuck when building the necessary Docker images.
When running the import command, the setup process starts, but after some steps it stops with the following output:
$ visione import --bulk
[+] Running 4/4
! features-dinov2 Warning pull access denied for visione/features-dinov2, repository does not exist or may require 'docker login': denied: requested access to the resource is denied 1.3s
! features-clipvip Warning pull access denied for visione/features-clipvip, repository does not exist or may require 'docker login': denied: requested access to the resource is denied 1.3s
! features-aladin Warning pull access denied for visione/features-aladin, repository does not exist or may require 'docker login': denied: requested access to the resource is denied 1.3s
! features-clip2video Warning pull access denied for visione/features-clip2video, repository does not exist or may require 'docker login': denied: requested access to the resource is denied 1.3s
[+] Building 1.3s (39/60) docker:default
=> [features-dinov2 internal] load build definition from Dockerfile 0.0s
=> => transferring dockerfile: 638B 0.0s
=> [features-aladin internal] load build definition from Dockerfile 0.0s
=> => transferring dockerfile: 3.24kB 0.0s
=> [features-clipvip internal] load build definition from Dockerfile 0.0s
=> => transferring dockerfile: 750B 0.0s
=> WARN: UndefinedVar: Usage of undefined variable '$PYTHONPATH' (line 16) 0.0s
=> WARN: LegacyKeyValueFormat: "ENV key=value" should be used instead of legacy "ENV key value" format (line 16) 0.0s
=> WARN: LegacyKeyValueFormat: "ENV key=value" should be used instead of legacy "ENV key value" format (line 17) 0.0s
=> [features-clip2video internal] load build definition from Dockerfile 0.0s
=> => transferring dockerfile: 1.12kB 0.0s
=> WARN: UndefinedVar: Usage of undefined variable '$PYTHONPATH' (line 26) 0.0s
=> WARN: LegacyKeyValueFormat: "ENV key=value" should be used instead of legacy "ENV key value" format (line 26) 0.0s
=> [features-clip2video internal] load metadata for docker.io/pytorch/pytorch:1.13.0-cuda11.6-cudnn8-runtime 0.0s
=> [features-dinov2 internal] load metadata for docker.io/pytorch/pytorch:2.0.0-cuda11.7-cudnn8-runtime 0.8s
=> [features-clipvip internal] load .dockerignore 0.0s
=> => transferring context: 2B 0.0s
=> [features-aladin internal] load metadata for docker.io/pytorch/pytorch:1.12.1-cuda11.3-cudnn8-runtime 0.8s
=> [features-clip2video internal] load .dockerignore 0.0s
=> => transferring context: 2B 0.0s
=> [features-clipvip internal] load build context 0.0s
=> => transferring context: 268B 0.0s
=> [features-clip2video 1/8] FROM docker.io/pytorch/pytorch:1.13.0-cuda11.6-cudnn8-runtime 0.0s
=> CACHED [features-clip2video 2/8] WORKDIR /usr/src/app 0.0s
=> CACHED [features-clipvip 3/8] RUN apt-get update && apt-get install -y git wget 0.0s
=> CACHED [features-clipvip 4/8] RUN git clone https://github.com/mesnico/clip-vip_video_search 0.0s
=> CACHED [features-clipvip 5/8] RUN mv clip-vip_video_search/clipvip . 0.0s
=> CANCELED [features-clipvip 6/8] RUN wget "https://hdvila.blob.core.windows.net/dataset/pretrain_clipvip_base_16.pt?sp=r&st=2023-03-16T05:02:05Z&se=2026-07-31T13:02:05Z&spr=https&sv=2021-12-02&sr=b&sig=XNd7fZSsUhW7eesL3hTfYUMiAvCCN3Bys2TadXlWzFU%3D" -k -O "pretrain_clipvip_base_16.pt" 1.3s
=> [features-clip2video internal] load build context 0.0s
=> => transferring context: 514B 0.0s
=> CACHED [features-clip2video 3/10] RUN apt-get update && apt-get install -y ffmpeg git wget 0.0s
=> CACHED [features-clip2video 4/10] RUN git clone https://github.com/CryhanFang/CLIP2Video && cd CLIP2Video && git checkout e94131800a3a1434f6d00b89b7301d741db8ba06 0.0s
=> CACHED [features-clip2video 5/10] RUN sed -i '/torch/d' CLIP2Video/requirements.txt 0.0s
=> CANCELED [features-clip2video 6/10] RUN pip install -r CLIP2Video/requirements.txt 1.3s
=> [features-aladin internal] load .dockerignore 0.0s
=> => transferring context: 2B 0.0s
=> [features-dinov2 internal] load .dockerignore 0.0s
=> => transferring context: 2B 0.0s
=> [features-dinov2 internal] load build context 0.0s
=> => transferring context: 268B 0.0s
=> [features-dinov2 1/7] FROM docker.io/pytorch/pytorch:2.0.0-cuda11.7-cudnn8-runtime@sha256:fabb5a665a05b8ee0ac76f0d943acc40039e13536e11a44d3dc47625a266e759 0.0s
=> CACHED [features-dinov2 2/7] RUN apt-get update && apt-get install -y --no-install-recommends git && rm -rf /var/lib/apt/lists/* 0.0s
=> CANCELED [features-dinov2 3/7] RUN cd /usr/src && git clone https://github.com/facebookresearch/dinov2 && cd /usr/src/dinov2 && git checkout c3c2683a13cde94d4d99f523cf4170384b00c34c && pip install -r requirements.txt 0.5s
=> [features-aladin internal] load build context 0.0s
=> => transferring context: 62B 0.0s
=> [features-aladin stage-0 1/22] FROM docker.io/pytorch/pytorch:1.12.1-cuda11.3-cudnn8-runtime@sha256:0bc0971dc8ae319af610d493aced87df46255c9508a8b9e9bc365f11a56e7b75 0.0s
=> CACHED [features-aladin stage-0 2/22] RUN apt-get update && apt-get install -y build-essential git 0.0s
=> CACHED [features-aladin stage-0 3/22] WORKDIR /usr/src/app/ 0.0s
=> CACHED [features-aladin stage-0 4/22] RUN git clone https://github.com/mesnico/scene_graph_benchmark 0.0s
=> CACHED [features-aladin stage-0 5/22] WORKDIR /usr/src/app/scene_graph_benchmark 0.0s
=> CACHED [features-aladin stage-0 6/22] RUN sed -i -e 's|if torch._six.PY3:|if True:|' maskrcnn_benchmark/utils/imports.py 0.0s
=> CACHED [features-aladin stage-0 7/22] RUN sed -i -e 's|from torch.hub import _download_url_to_file|from torch.hub import download_url_to_file|' maskrcnn_benchmark/utils/model_zoo.py 0.0s
=> CACHED [features-aladin stage-0 8/22] RUN pip install h5py==3.7.0 nltk==3.8.1 joblib==1.3.2 scipy==1.7.3 ninja==1.11.1.1 yacs>=0.1.8 cython==0.29.34 tqdm opencv-python-headless==4.9.0.80 numpy==1.21.2 timm==0.6.13 einops==0.6.1 pycocotools cityscapesscripts==2.2.2 pyyaml==6.0 requests==2.31.0 scikit-image==0.19.3 anyt 0.0s
=> CACHED [features-aladin stage-0 9/22] RUN python setup.py build develop 0.0s
=> CACHED [features-aladin stage-0 10/22] RUN apt-get install -y curl 0.0s
=> ERROR [features-aladin stage-0 11/22] RUN --mount=type=secret,id=asset_token,required mkdir -p models/vinvl && cd models/vinvl && curl -LJO -H "Authorization: token $(cat /run/secrets/asset_token | tr -d '\n')" -H "Accept:application/octet-stream" https://api.github.com/repos/aimh-lab/visione/releases/assets/112022853 && test -f vinvl_vg_x152c4.pth & 0.4s
------
> [features-aladin stage-0 11/22] RUN --mount=type=secret,id=asset_token,required mkdir -p models/vinvl && cd models/vinvl && curl -LJO -H "Authorization: token $(cat /run/secrets/asset_token | tr -d '\n')" -H "Accept:application/octet-stream" https://api.github.com/repos/aimh-lab/visione/releases/assets/112022853 && test -f vinvl_vg_x152c4.pth && curl -LJO -H "Authorization: token $(cat /run/secrets/asset_token | tr -d '\n')" -H "Accept:application/octet-stream" https://api.github.com/repos/aimh-lab/visione/releases/assets/112022837 && test -f VG-SGG-dicts-vgoi6-clipped.json:
0.237 % Total % Received % Xferd Average Speed Time Time Time Current
0.237 Dload Upload Total Spent Left Speed
100 109 100 109 0 0 731 0 --:--:-- --:--:-- --:--:-- 731
------
failed to solve: process "/bin/sh -c mkdir -p models/vinvl && cd models/vinvl && curl -LJO -H \"Authorization: token $(cat /run/secrets/asset_token | tr -d '\\n')\" -H \"Accept:application/octet-stream\" https://api.github.com/repos/aimh-lab/visione/releases/assets/112022853 && test -f vinvl_vg_x152c4.pth && curl -LJO -H \"Authorization: token $(cat /run/secrets/asset_token | tr -d '\\n')\" -H \"Accept:application/octet-stream\" https://api.github.com/repos/aimh-lab/visione/releases/assets/112022837 && test -f VG-SGG-dicts-vgoi6-clipped.json" did not complete successfully: exit code: 1
Traceback (most recent call last):
File "/home/smadmin01/visione/bin/visione", line 8, in <module>
sys.exit(__main__.main())
^^^^^^^^^^^^^^^
File "/home/smadmin01/visione/lib/python3.12/site-packages/visione/cli/__main__.py", line 40, in main
ret = func(**args)
^^^^^^^^^^^^
File "/home/smadmin01/visione/lib/python3.12/site-packages/visione/cli/commands/import_.py", line 81, in __call__
self.create_services_containers()
File "/home/smadmin01/visione/lib/python3.12/site-packages/visione/cli/commands/command.py", line 202, in create_services_containers
return subprocess.run(command, env=self.compose_env, check=True)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/lib/python3.12/subprocess.py", line 571, in run
raise CalledProcessError(retcode, process.args,
subprocess.CalledProcessError: Command '['docker', 'compose', '--file', '/home/smadmin01/visione/lib/python3.12/site-packages/visione/services/docker-compose.yaml', '--file', '/home/smadmin01/visione/lib/python3.12/site-packages/visione/services/analysis-services.yaml', '--file', '/home/smadmin01/visione/lib/python3.12/site-packages/visione/services/index-services.yaml', '--project-directory', '/home/smadmin01/visione/lib/python3.12/site-packages/visione/services', '--project-name', 'dma-visione-poc', '--profile', 'query', '--profile', 'features-dinov2', '--profile', 'features-aladin', '--profile', 'features-clip-openai', '--profile', 'features-clip-laion', '--profile', 'features-clip-datacomp', '--profile', 'features-biomed-clip', '--profile', 'features-clip2video', '--profile', 'features-clipvip', '--profile', 'lucene-index-manager', '--profile', 'str-object-encoder', '--profile', 'str-feature-encoder', '--profile', 'faiss-index-manager', 'up', '--no-start', '--no-recreate', '--remove-orphans']' returned non-zero exit status 17.
Hi, I’m trying to get VISIONE running on my system and I’m stuck when building the necessary Docker images.
When running the
importcommand, the setup process starts, but after some steps it stops with the following output:As far as I understand, two file (
vinvl_vg_x152c4.pth&VG-SGG-dicts-vgoi6-clipped.json) downloads are failing.Is there a way to resolve the file download issue?