Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

WARN dora_daemon::pending: node no_webcam exited before initializing dora connection #295

Closed
meua opened this issue May 23, 2023 · 1 comment
Closed

WARN dora_daemon::pending: node no_webcam exited before initializing dora connection #295

meua opened this issue May 23, 2023 · 1 comment
Labels
bug Something isn't working cli CLI daemon linux python Python API runtime rust

Comments

@meua
Copy link
Contributor

meua commented May 23, 2023

Describe the bug

jarvis@jia:~/coding/dora_home/dora/examples/python-dataflow$ ./run.sh 
Looking in indexes: https://pypi.tuna.tsinghua.edu.cn/simple
Requirement already satisfied: maturin in ./.env/lib/python3.10/site-packages (0.15.1)
Requirement already satisfied: tomli>=1.1.0 in ./.env/lib/python3.10/site-packages (from maturin) (2.0.1)
🍹 Building a mixed python/rust project
🔗 Found pyo3 bindings with abi3 support for Python ≥ 3.7
🐍 Not using a specific python interpreter
📡 Using build options features from pyproject.toml
    Finished dev [unoptimized + debuginfo] target(s) in 0.11s
⚠️ Warning: Failed to set rpath for /home/jarvis/coding/dora_home/dora/target/debug/libdora.so: Failed to execute 'patchelf', did you install it? Hint: Try `pip install maturin[patchelf]` (or just `pip install patchelf`)
📦 Built wheel for abi3 Python ≥ 3.7 to /tmp/.tmpeaEO15/dora_rs-0.2.3rc6-cp37-abi3-linux_x86_64.whl
🛠 Installed dora-rs-0.2.3rc6
Looking in indexes: https://pypi.tuna.tsinghua.edu.cn/simple
Requirement already satisfied: pip in ./.env/lib/python3.10/site-packages (23.1.2)
Looking in indexes: https://pypi.tuna.tsinghua.edu.cn/simple
Requirement already satisfied: gitpython in ./.env/lib/python3.10/site-packages (from -r requirements.txt (line 5)) (3.1.31)
Requirement already satisfied: ipython in ./.env/lib/python3.10/site-packages (from -r requirements.txt (line 6)) (8.13.2)
Requirement already satisfied: matplotlib>=3.2.2 in ./.env/lib/python3.10/site-packages (from -r requirements.txt (line 7)) (3.7.1)
Requirement already satisfied: numpy>=1.18.5 in ./.env/lib/python3.10/site-packages (from -r requirements.txt (line 8)) (1.24.3)
Requirement already satisfied: opencv-python>=4.1.1 in ./.env/lib/python3.10/site-packages (from -r requirements.txt (line 9)) (4.7.0.72)
Requirement already satisfied: Pillow>=7.1.2 in ./.env/lib/python3.10/site-packages (from -r requirements.txt (line 10)) (9.5.0)
Requirement already satisfied: psutil in ./.env/lib/python3.10/site-packages (from -r requirements.txt (line 11)) (5.9.5)
Requirement already satisfied: PyYAML>=5.3.1 in ./.env/lib/python3.10/site-packages (from -r requirements.txt (line 12)) (6.0)
Requirement already satisfied: requests>=2.23.0 in ./.env/lib/python3.10/site-packages (from -r requirements.txt (line 13)) (2.30.0)
Requirement already satisfied: scipy>=1.4.1 in ./.env/lib/python3.10/site-packages (from -r requirements.txt (line 14)) (1.10.1)
Requirement already satisfied: thop>=0.1.1 in ./.env/lib/python3.10/site-packages (from -r requirements.txt (line 15)) (0.1.1.post2209072238)
Requirement already satisfied: torch>=1.7.0 in ./.env/lib/python3.10/site-packages (from -r requirements.txt (line 16)) (2.0.1)
Requirement already satisfied: torchvision>=0.8.1 in ./.env/lib/python3.10/site-packages (from -r requirements.txt (line 17)) (0.15.2)
Requirement already satisfied: tqdm>=4.64.0 in ./.env/lib/python3.10/site-packages (from -r requirements.txt (line 18)) (4.65.0)
Requirement already satisfied: tensorboard>=2.4.1 in ./.env/lib/python3.10/site-packages (from -r requirements.txt (line 21)) (2.13.0)
Requirement already satisfied: pandas>=1.1.4 in ./.env/lib/python3.10/site-packages (from -r requirements.txt (line 26)) (2.0.1)
Requirement already satisfied: seaborn>=0.11.0 in ./.env/lib/python3.10/site-packages (from -r requirements.txt (line 27)) (0.12.2)
Requirement already satisfied: gitdb<5,>=4.0.1 in ./.env/lib/python3.10/site-packages (from gitpython->-r requirements.txt (line 5)) (4.0.10)
Requirement already satisfied: backcall in ./.env/lib/python3.10/site-packages (from ipython->-r requirements.txt (line 6)) (0.2.0)
Requirement already satisfied: decorator in ./.env/lib/python3.10/site-packages (from ipython->-r requirements.txt (line 6)) (5.1.1)
Requirement already satisfied: jedi>=0.16 in ./.env/lib/python3.10/site-packages (from ipython->-r requirements.txt (line 6)) (0.18.2)
Requirement already satisfied: matplotlib-inline in ./.env/lib/python3.10/site-packages (from ipython->-r requirements.txt (line 6)) (0.1.6)
Requirement already satisfied: pickleshare in ./.env/lib/python3.10/site-packages (from ipython->-r requirements.txt (line 6)) (0.7.5)
Requirement already satisfied: prompt-toolkit!=3.0.37,<3.1.0,>=3.0.30 in ./.env/lib/python3.10/site-packages (from ipython->-r requirements.txt (line 6)) (3.0.38)
Requirement already satisfied: pygments>=2.4.0 in ./.env/lib/python3.10/site-packages (from ipython->-r requirements.txt (line 6)) (2.15.1)
Requirement already satisfied: stack-data in ./.env/lib/python3.10/site-packages (from ipython->-r requirements.txt (line 6)) (0.6.2)
Requirement already satisfied: traitlets>=5 in ./.env/lib/python3.10/site-packages (from ipython->-r requirements.txt (line 6)) (5.9.0)
Requirement already satisfied: pexpect>4.3 in ./.env/lib/python3.10/site-packages (from ipython->-r requirements.txt (line 6)) (4.8.0)
Requirement already satisfied: contourpy>=1.0.1 in ./.env/lib/python3.10/site-packages (from matplotlib>=3.2.2->-r requirements.txt (line 7)) (1.0.7)
Requirement already satisfied: cycler>=0.10 in ./.env/lib/python3.10/site-packages (from matplotlib>=3.2.2->-r requirements.txt (line 7)) (0.11.0)
Requirement already satisfied: fonttools>=4.22.0 in ./.env/lib/python3.10/site-packages (from matplotlib>=3.2.2->-r requirements.txt (line 7)) (4.39.4)
Requirement already satisfied: kiwisolver>=1.0.1 in ./.env/lib/python3.10/site-packages (from matplotlib>=3.2.2->-r requirements.txt (line 7)) (1.4.4)
Requirement already satisfied: packaging>=20.0 in ./.env/lib/python3.10/site-packages (from matplotlib>=3.2.2->-r requirements.txt (line 7)) (23.1)
Requirement already satisfied: pyparsing>=2.3.1 in ./.env/lib/python3.10/site-packages (from matplotlib>=3.2.2->-r requirements.txt (line 7)) (3.0.9)
Requirement already satisfied: python-dateutil>=2.7 in ./.env/lib/python3.10/site-packages (from matplotlib>=3.2.2->-r requirements.txt (line 7)) (2.8.2)
Requirement already satisfied: charset-normalizer<4,>=2 in ./.env/lib/python3.10/site-packages (from requests>=2.23.0->-r requirements.txt (line 13)) (3.1.0)
Requirement already satisfied: idna<4,>=2.5 in ./.env/lib/python3.10/site-packages (from requests>=2.23.0->-r requirements.txt (line 13)) (3.4)
Requirement already satisfied: urllib3<3,>=1.21.1 in ./.env/lib/python3.10/site-packages (from requests>=2.23.0->-r requirements.txt (line 13)) (1.26.15)
Requirement already satisfied: certifi>=2017.4.17 in ./.env/lib/python3.10/site-packages (from requests>=2.23.0->-r requirements.txt (line 13)) (2023.5.7)
Requirement already satisfied: filelock in ./.env/lib/python3.10/site-packages (from torch>=1.7.0->-r requirements.txt (line 16)) (3.12.0)
Requirement already satisfied: typing-extensions in ./.env/lib/python3.10/site-packages (from torch>=1.7.0->-r requirements.txt (line 16)) (4.5.0)
Requirement already satisfied: sympy in ./.env/lib/python3.10/site-packages (from torch>=1.7.0->-r requirements.txt (line 16)) (1.12)
Requirement already satisfied: networkx in ./.env/lib/python3.10/site-packages (from torch>=1.7.0->-r requirements.txt (line 16)) (3.1)
Requirement already satisfied: jinja2 in ./.env/lib/python3.10/site-packages (from torch>=1.7.0->-r requirements.txt (line 16)) (3.1.2)
Requirement already satisfied: nvidia-cuda-nvrtc-cu11==11.7.99 in ./.env/lib/python3.10/site-packages (from torch>=1.7.0->-r requirements.txt (line 16)) (11.7.99)
Requirement already satisfied: nvidia-cuda-runtime-cu11==11.7.99 in ./.env/lib/python3.10/site-packages (from torch>=1.7.0->-r requirements.txt (line 16)) (11.7.99)
Requirement already satisfied: nvidia-cuda-cupti-cu11==11.7.101 in ./.env/lib/python3.10/site-packages (from torch>=1.7.0->-r requirements.txt (line 16)) (11.7.101)
Requirement already satisfied: nvidia-cudnn-cu11==8.5.0.96 in ./.env/lib/python3.10/site-packages (from torch>=1.7.0->-r requirements.txt (line 16)) (8.5.0.96)
Requirement already satisfied: nvidia-cublas-cu11==11.10.3.66 in ./.env/lib/python3.10/site-packages (from torch>=1.7.0->-r requirements.txt (line 16)) (11.10.3.66)
Requirement already satisfied: nvidia-cufft-cu11==10.9.0.58 in ./.env/lib/python3.10/site-packages (from torch>=1.7.0->-r requirements.txt (line 16)) (10.9.0.58)
Requirement already satisfied: nvidia-curand-cu11==10.2.10.91 in ./.env/lib/python3.10/site-packages (from torch>=1.7.0->-r requirements.txt (line 16)) (10.2.10.91)
Requirement already satisfied: nvidia-cusolver-cu11==11.4.0.1 in ./.env/lib/python3.10/site-packages (from torch>=1.7.0->-r requirements.txt (line 16)) (11.4.0.1)
Requirement already satisfied: nvidia-cusparse-cu11==11.7.4.91 in ./.env/lib/python3.10/site-packages (from torch>=1.7.0->-r requirements.txt (line 16)) (11.7.4.91)
Requirement already satisfied: nvidia-nccl-cu11==2.14.3 in ./.env/lib/python3.10/site-packages (from torch>=1.7.0->-r requirements.txt (line 16)) (2.14.3)
Requirement already satisfied: nvidia-nvtx-cu11==11.7.91 in ./.env/lib/python3.10/site-packages (from torch>=1.7.0->-r requirements.txt (line 16)) (11.7.91)
Requirement already satisfied: triton==2.0.0 in ./.env/lib/python3.10/site-packages (from torch>=1.7.0->-r requirements.txt (line 16)) (2.0.0)
Requirement already satisfied: setuptools in ./.env/lib/python3.10/site-packages (from nvidia-cublas-cu11==11.10.3.66->torch>=1.7.0->-r requirements.txt (line 16)) (67.7.2)
Requirement already satisfied: wheel in ./.env/lib/python3.10/site-packages (from nvidia-cublas-cu11==11.10.3.66->torch>=1.7.0->-r requirements.txt (line 16)) (0.40.0)
Requirement already satisfied: cmake in ./.env/lib/python3.10/site-packages (from triton==2.0.0->torch>=1.7.0->-r requirements.txt (line 16)) (3.26.3)
Requirement already satisfied: lit in ./.env/lib/python3.10/site-packages (from triton==2.0.0->torch>=1.7.0->-r requirements.txt (line 16)) (16.0.3)
Requirement already satisfied: absl-py>=0.4 in ./.env/lib/python3.10/site-packages (from tensorboard>=2.4.1->-r requirements.txt (line 21)) (1.4.0)
Requirement already satisfied: grpcio>=1.48.2 in ./.env/lib/python3.10/site-packages (from tensorboard>=2.4.1->-r requirements.txt (line 21)) (1.54.0)
Requirement already satisfied: google-auth<3,>=1.6.3 in ./.env/lib/python3.10/site-packages (from tensorboard>=2.4.1->-r requirements.txt (line 21)) (2.18.0)
Requirement already satisfied: google-auth-oauthlib<1.1,>=0.5 in ./.env/lib/python3.10/site-packages (from tensorboard>=2.4.1->-r requirements.txt (line 21)) (1.0.0)
Requirement already satisfied: markdown>=2.6.8 in ./.env/lib/python3.10/site-packages (from tensorboard>=2.4.1->-r requirements.txt (line 21)) (3.4.3)
Requirement already satisfied: protobuf>=3.19.6 in ./.env/lib/python3.10/site-packages (from tensorboard>=2.4.1->-r requirements.txt (line 21)) (4.23.0)
Requirement already satisfied: tensorboard-data-server<0.8.0,>=0.7.0 in ./.env/lib/python3.10/site-packages (from tensorboard>=2.4.1->-r requirements.txt (line 21)) (0.7.0)
Requirement already satisfied: werkzeug>=1.0.1 in ./.env/lib/python3.10/site-packages (from tensorboard>=2.4.1->-r requirements.txt (line 21)) (2.3.4)
Requirement already satisfied: pytz>=2020.1 in ./.env/lib/python3.10/site-packages (from pandas>=1.1.4->-r requirements.txt (line 26)) (2023.3)
Requirement already satisfied: tzdata>=2022.1 in ./.env/lib/python3.10/site-packages (from pandas>=1.1.4->-r requirements.txt (line 26)) (2023.3)
Requirement already satisfied: smmap<6,>=3.0.1 in ./.env/lib/python3.10/site-packages (from gitdb<5,>=4.0.1->gitpython->-r requirements.txt (line 5)) (5.0.0)
Requirement already satisfied: cachetools<6.0,>=2.0.0 in ./.env/lib/python3.10/site-packages (from google-auth<3,>=1.6.3->tensorboard>=2.4.1->-r requirements.txt (line 21)) (5.3.0)
Requirement already satisfied: pyasn1-modules>=0.2.1 in ./.env/lib/python3.10/site-packages (from google-auth<3,>=1.6.3->tensorboard>=2.4.1->-r requirements.txt (line 21)) (0.3.0)
Requirement already satisfied: six>=1.9.0 in ./.env/lib/python3.10/site-packages (from google-auth<3,>=1.6.3->tensorboard>=2.4.1->-r requirements.txt (line 21)) (1.16.0)
Requirement already satisfied: rsa<5,>=3.1.4 in ./.env/lib/python3.10/site-packages (from google-auth<3,>=1.6.3->tensorboard>=2.4.1->-r requirements.txt (line 21)) (4.9)
Requirement already satisfied: requests-oauthlib>=0.7.0 in ./.env/lib/python3.10/site-packages (from google-auth-oauthlib<1.1,>=0.5->tensorboard>=2.4.1->-r requirements.txt (line 21)) (1.3.1)
Requirement already satisfied: parso<0.9.0,>=0.8.0 in ./.env/lib/python3.10/site-packages (from jedi>=0.16->ipython->-r requirements.txt (line 6)) (0.8.3)
Requirement already satisfied: ptyprocess>=0.5 in ./.env/lib/python3.10/site-packages (from pexpect>4.3->ipython->-r requirements.txt (line 6)) (0.7.0)
Requirement already satisfied: wcwidth in ./.env/lib/python3.10/site-packages (from prompt-toolkit!=3.0.37,<3.1.0,>=3.0.30->ipython->-r requirements.txt (line 6)) (0.2.6)
Requirement already satisfied: MarkupSafe>=2.1.1 in ./.env/lib/python3.10/site-packages (from werkzeug>=1.0.1->tensorboard>=2.4.1->-r requirements.txt (line 21)) (2.1.2)
Requirement already satisfied: executing>=1.2.0 in ./.env/lib/python3.10/site-packages (from stack-data->ipython->-r requirements.txt (line 6)) (1.2.0)
Requirement already satisfied: asttokens>=2.1.0 in ./.env/lib/python3.10/site-packages (from stack-data->ipython->-r requirements.txt (line 6)) (2.2.1)
Requirement already satisfied: pure-eval in ./.env/lib/python3.10/site-packages (from stack-data->ipython->-r requirements.txt (line 6)) (0.2.2)
Requirement already satisfied: mpmath>=0.19 in ./.env/lib/python3.10/site-packages (from sympy->torch>=1.7.0->-r requirements.txt (line 16)) (1.3.0)
Requirement already satisfied: pyasn1<0.6.0,>=0.4.6 in ./.env/lib/python3.10/site-packages (from pyasn1-modules>=0.2.1->google-auth<3,>=1.6.3->tensorboard>=2.4.1->-r requirements.txt (line 21)) (0.5.0)
Requirement already satisfied: oauthlib>=3.0.0 in ./.env/lib/python3.10/site-packages (from requests-oauthlib>=0.7.0->google-auth-oauthlib<1.1,>=0.5->tensorboard>=2.4.1->-r requirements.txt (line 21)) (3.2.2)
   Compiling dora-operator-api-c v0.2.3-rc6 (/home/jarvis/coding/dora_home/dora/apis/c/operator)
   Compiling dora-cli v0.2.3-rc6 (/home/jarvis/coding/dora_home/dora/binaries/cli)
    Finished dev [unoptimized + debuginfo] target(s) in 4.51s
     Running `/home/jarvis/coding/dora_home/dora/target/debug/dora-cli up`
    Finished dev [unoptimized + debuginfo] target(s) in 0.11s
     Running `/home/jarvis/coding/dora_home/dora/target/debug/dora-daemon --run-dataflow dataflow_without_webcam.yml`
  2023-05-23T09:19:39.129115Z ERROR dora_daemon: 
    ae86c2e2-49b1-4af2-b750-e9672d5abdf2/no_webcam failed with exit code 1.

    Check logs using: dora logs ae86c2e2-49b1-4af2-b750-e9672d5abdf2 no_webcam
                            
    at binaries/daemon/src/lib.rs:906

  2023-05-23T09:19:39.129165Z  WARN dora_daemon::pending: node `no_webcam` exited before initializing dora connection
    at binaries/daemon/src/pending.rs:76

  2023-05-23T09:21:24.222078Z ERROR dora_daemon: 
    ae86c2e2-49b1-4af2-b750-e9672d5abdf2/object_detection failed with exit code 1.

    Check logs using: dora logs ae86c2e2-49b1-4af2-b750-e9672d5abdf2 object_detection
                            
    at binaries/daemon/src/lib.rs:906

  2023-05-23T09:21:24.222120Z  WARN dora_daemon::pending: node `object_detection` exited before initializing dora connection
    at binaries/daemon/src/pending.rs:76

  2023-05-23T09:21:24.234340Z ERROR dora_daemon: 
    ae86c2e2-49b1-4af2-b750-e9672d5abdf2/plot failed with exit code 1.

    Check logs using: dora logs ae86c2e2-49b1-4af2-b750-e9672d5abdf2 plot
                            
    at binaries/daemon/src/lib.rs:906

Error: some nodes failed:
  - ae86c2e2-49b1-4af2-b750-e9672d5abdf2/no_webcam: 
    ae86c2e2-49b1-4af2-b750-e9672d5abdf2/no_webcam failed with exit code 1.

    Check logs using: dora logs ae86c2e2-49b1-4af2-b750-e9672d5abdf2 no_webcam
                            
  - ae86c2e2-49b1-4af2-b750-e9672d5abdf2/object_detection: 
    ae86c2e2-49b1-4af2-b750-e9672d5abdf2/object_detection failed with exit code 1.

    Check logs using: dora logs ae86c2e2-49b1-4af2-b750-e9672d5abdf2 object_detection
                            
  - ae86c2e2-49b1-4af2-b750-e9672d5abdf2/plot: 
    ae86c2e2-49b1-4af2-b750-e9672d5abdf2/plot failed with exit code 1.

    Check logs using: dora logs ae86c2e2-49b1-4af2-b750-e9672d5abdf2 plot
                            

Location:
    /home/jarvis/coding/dora_home/dora/binaries/daemon/src/lib.rs:163:13
jarvis@jia:~/coding/dora_home/dora/examples/python-dataflow$

To Reproduce
Steps to reproduce the behavior:

  1. Dora start daemon: cd examples/python-dataflow && ./run.sh

Environments (please complete the following information):

  • System info: 22.04
  • Dora version: v0.2.2
@github-actions github-actions bot added bug Something isn't working cli CLI daemon linux python Python API runtime rust labels May 23, 2023
meua added a commit to meua/dora that referenced this issue May 23, 2023
@meua
fix bug for issues: dora-rs#295
a7bc6f3
@meua meua mentioned this issue May 23, 2023
Merged
@meua
Copy link
Contributor Author

meua commented May 23, 2023 •
edited
Loading

The bug is fixed in this commit a7bc6f3.
image

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
bug Something isn't working cli CLI daemon linux python Python API runtime rust
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
2 participants
@meua @haixuanTao