📷📷📷 MULTIWEBCAM 📷📷📷

Concurrent webcam recording to bootstrap low-cost/early-stage computer vision projects

mwc_sample.mp4

Introduction

I needed a cheap way to record concurrent frames while prototyping a computer vision project (caliscope). Extreme precision was less important than getting something reasonable with a minimal budget. When conscientiously managed, USB webcams controlled via OpenCV can perform surprisingly well at this task. I have spun this functionality off into its own package to create a clear separation of concerns between data capture and data processing, while hopefully creating a simpler package that others might find useful.

If MultiWebCam (MWC) is close to what you need but not quite, please feel free to raise an issue and I'll see if I can incorporate your use case. These are the core functions that are currently implemented:

• Record concurrent frames from multiple webcams
• Record from single webcams to pull single camera calibration video.
• "time-align" frames in real time to understand dropped frame rate
• include frame-by-frame time stamp history to facilitate off-line processing
• easy adjustment of the following parameters:
  • resolution
  • exposure
  • target fps

Quick Start

Basic pip install

You can install MWC into your python environment with pip install multiwebcam and then launch it from the command line with

mwc

Note that this has primarily been tested on Windows 10, infrequently on MacOS, and will not work on Linux as far as I can tell ☹️. If someone is familiar with getting USB cameras working through OpenCV on Linux, I'm all ears.

Editable Install Using Poetry

If you prefer to contribute to MWC or want to install it in editable mode, follow these steps using Poetry:

Clone the Repository:

git clone https://github.com/mprib/multiwebcam.git
cd multiwebcam

Install Poetry:

pip install poetry

Set Up the Environment:

poetry install

By running poetry install, you'll install all dependencies and also set up the multiwebcam package in editable mode. Any changes you make to the code will be reflected in your environment.

Capturing Data

1. Launch MultiWebCam from the command line:

mwc

2. Make sure that the USB cameras you want to use are currently plugged in when you launch the new session.

3. Choose a new project directory through the File menu. MWC will attempt to connect to the cameras currently plugged in and will create a recording_config.toml file in the project directory.

4. From the Mode menu you can select single camera to change camera settings (such as resolution and exposure).

5. On the MultCamera mode you can set the target fps to achieve a desired dropped frame rate

6. Record videos

Checking Against System Clock

To provide a check of the accuracy of the time stamps, you can launch a widget that displays the perf_counter from the system by running from the command line:

mwc clock

Cross checking the frames with the recorded time stamp value can provide a sense of the temporal accuracy of the recording.