Hi! I tried to run the example on my MacBook, but encountered following error:

thread 'main' panicked at 'called `Result::unwrap()` on an `Err` value: CouldntOpenDevice("Device at 0 not found")', src/main.rs:10:6
note: run with `RUST_BACKTRACE=1` environment variable to display a backtrace

Hey there, I made a quick PR to bring the threaded example in sync with the actual code. I also added a github action so it stays in sync, I hope that's okay :)

When I run this I get

     Running `/Users/danielschmidt/fun/nokhwa/target/debug/threaded-capture`
CameraInfo { human_name: "FaceTime HD Camera", description: "Apple Inc.: FaceTime HD Camera - AVCaptureDeviceTypeBuiltInWideAngleCamera, Unspecified f0", misc: "EAB7A68F-EC2B-4487-AADF-D8A91C1CB782", index: Index(0) }
thread 'main' panicked at 'called `Result::unwrap()` on an `Err` value: OpenDeviceError("0", "Not Found")', examples/threaded-capture/src/main.rs:39:6
note: run with `RUST_BACKTRACE=1` environment variable to display a backtrace

Is this expected in the current RC state?

OS: 12.3.1 (21E258) Machine: MacBook Pro (13-inch, M1, 2020) rustc: 1.61.0 (fe5b13d68 2022-05-18)

I execute this command:

nokhwa/examples/capture on  senpai via 🦀 v1.61.0
❯ cargo run --features "input-avfoundation"

and it gives 14 errors:

 cargo run --features "input-avfoundation"

   Compiling nokhwa v0.10.0 (/Users/mo/dev/nokhwa)
error[E0412]: cannot find type `Output` in module `crate::pixel_format`
   --> /Users/mo/dev/nokhwa/src/backends/capture/avfoundation.rs:275:50
    |
275 |     ) -> Result<ImageBuffer<crate::pixel_format::Output, Vec<u8>>, NokhwaError> {
    |                                                  ^^^^^^ not found in `crate::pixel_format`
    |
help: consider importing this struct
    |
17  | use std::process::Output;
    |

error[E0425]: cannot find value `cp` in this scope
   --> /Users/mo/dev/nokhwa/src/camera.rs:454:44
    |
454 |                           Ok(cap) => Some(Ok(cp.into())),
    |                                              ^^ help: a local variable with a similar name exists: `cap`
...
549 | / cap_impl_fn! {
550 | |     // (GStreamerCaptureDevice, new, feature = "input-gst", gst),
551 | |     (OpenCvCaptureDevice, new_autopref, feature = "input-opencv", opencv),
552 | |     // (UVCCaptureDevice, create, feature = "input-uvc", uvc),
...   |
555 | |     (AVFoundationCaptureDevice, new, all(feature = "input-avfoundation", any(target_os = "macos", target_os = "ios")), avfoundation)
556 | | }
    | |_- in this macro invocation
    |
    = note: this error originates in the macro `cap_impl_fn` (in Nightly builds, run with -Z macro-backtrace for more info)

error[E0412]: cannot find type `MSMF` in this scope
  --> /Users/mo/dev/nokhwa/src/camera_traits.rs:37:5
   |
37 |     MSMF,
   |     ^^^^ not found in this scope
   |
help: there is an enum variant `crate::BackendsEnum::MSMF`; try using the variant's enum
   |
37 |     crate::BackendsEnum,
   |     ~~~~~~~~~~~~~~~~~~~

error[E0412]: cannot find type `AVF` in this scope
  --> /Users/mo/dev/nokhwa/src/camera_traits.rs:38:5
   |
38 |     AVF,
   |     ^^^ not found in this scope
   |
help: there is an enum variant `crate::BackendsEnum::AVF`; try using the variant's enum
   |
38 |     crate::BackendsEnum,
   |     ~~~~~~~~~~~~~~~~~~~

error[E0412]: cannot find type `V4L2` in this scope
  --> /Users/mo/dev/nokhwa/src/camera_traits.rs:39:5
   |
39 |     V4L2,
   |     ^^^^ not found in this scope
   |
help: there is an enum variant `crate::BackendsEnum::V4L2`; try using the variant's enum
   |
39 |     crate::BackendsEnum,
   |     ~~~~~~~~~~~~~~~~~~~

error[E0412]: cannot find type `OCV` in this scope
  --> /Users/mo/dev/nokhwa/src/camera_traits.rs:40:5
   |
40 |     OCV,
   |     ^^^ not found in this scope
   |
help: there is an enum variant `crate::BackendsEnum::OCV`; try using the variant's enum
   |
40 |     crate::BackendsEnum,
   |     ~~~~~~~~~~~~~~~~~~~

error[E0412]: cannot find type `MSMF` in this scope
  --> /Users/mo/dev/nokhwa/src/camera_traits.rs:50:1
   |
50 | #[enum_dispatch(BackendsEnum)]
   | ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ not found in this scope
   |
   = note: this error originates in the attribute macro `enum_dispatch` (in Nightly builds, run with -Z macro-backtrace for more info)
help: there is an enum variant `crate::BackendsEnum::MSMF`; try using the variant's enum
   |
50 | crate::BackendsEnum
   |

error[E0412]: cannot find type `AVF` in this scope
  --> /Users/mo/dev/nokhwa/src/camera_traits.rs:50:1
   |
50 | #[enum_dispatch(BackendsEnum)]
   | ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ not found in this scope
   |
   = note: this error originates in the attribute macro `enum_dispatch` (in Nightly builds, run with -Z macro-backtrace for more info)
help: there is an enum variant `crate::BackendsEnum::AVF`; try using the variant's enum
   |
50 | crate::BackendsEnum
   |

error[E0412]: cannot find type `V4L2` in this scope
  --> /Users/mo/dev/nokhwa/src/camera_traits.rs:50:1
   |
50 | #[enum_dispatch(BackendsEnum)]
   | ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ not found in this scope
   |
   = note: this error originates in the attribute macro `enum_dispatch` (in Nightly builds, run with -Z macro-backtrace for more info)
help: there is an enum variant `crate::BackendsEnum::V4L2`; try using the variant's enum
   |
50 | crate::BackendsEnum
   |

error[E0412]: cannot find type `OCV` in this scope
  --> /Users/mo/dev/nokhwa/src/camera_traits.rs:50:1
   |
50 | #[enum_dispatch(BackendsEnum)]
   | ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ not found in this scope
   |
   = note: this error originates in the attribute macro `enum_dispatch` (in Nightly builds, run with -Z macro-backtrace for more info)
help: there is an enum variant `crate::BackendsEnum::OCV`; try using the variant's enum
   |
50 | crate::BackendsEnum
   |

error[E0412]: cannot find type `ControlValue` in this scope
   --> /Users/mo/dev/nokhwa/src/utils.rs:984:40
    |
984 |     pub fn set_value(&mut self, value: ControlValue) -> Result<(), NokhwaError> {
    |                                        ^^^^^^^^^^^^ not found in this scope

error[E0412]: cannot find type `ControlValue` in this scope
   --> /Users/mo/dev/nokhwa/src/utils.rs:994:36
    |
994 |     pub fn with_value(self, value: ControlValue) -> Result<Self, NokhwaError> {
    |                                    ^^^^^^^^^^^^ not found in this scope

error[E0574]: expected struct, variant or union type, found enum `ControlDescription`
   --> /Users/mo/dev/nokhwa/src/utils.rs:997:12
    |
997 |         Ok(ControlDescription {
    |            ^^^^^^^^^^^^^^^^^^ not a struct, variant or union type

warning: unused import: `nokhwa_initialize`
  --> /Users/mo/dev/nokhwa/src/backends/capture/avfoundation.rs:18:33
   |
18 |     mjpeg_to_rgb, nokhwa_check, nokhwa_initialize, yuyv422_to_rgb, CameraControl, CameraFormat,
   |                                 ^^^^^^^^^^^^^^^^^
   |
   = note: `#[warn(unused_imports)]` on by default

warning: unused import: `std::process::Output`
  --> /Users/mo/dev/nokhwa/src/backends/capture/avfoundation.rs:27:5
   |
27 | use std::process::Output;
   |     ^^^^^^^^^^^^^^^^^^^^

warning: unused imports: `any::Any`, `ops::Deref`
  --> /Users/mo/dev/nokhwa/src/backends/capture/avfoundation.rs:28:11
   |
28 | use std::{any::Any, borrow::Borrow, borrow::Cow, collections::HashMap, ops::Deref};
   |           ^^^^^^^^                                                     ^^^^^^^^^^

warning: unused import: `pixel_format::PixelFormat`
  --> /Users/mo/dev/nokhwa/src/camera.rs:18:21
   |
18 |     buffer::Buffer, pixel_format::PixelFormat, BackendsEnum, CameraControl, CameraFormat,
   |                     ^^^^^^^^^^^^^^^^^^^^^^^^^

warning: unused import: `frame_formats`
  --> /Users/mo/dev/nokhwa/src/camera_traits.rs:19:5
   |
19 |     frame_formats,
   |     ^^^^^^^^^^^^^

warning: unused imports: `RgbaImage`, `buffer::ConvertBuffer`
  --> /Users/mo/dev/nokhwa/src/camera_traits.rs:26:13
   |
26 | use image::{buffer::ConvertBuffer, ImageBuffer, RgbaImage};
   |             ^^^^^^^^^^^^^^^^^^^^^               ^^^^^^^^^

error[E0204]: the trait `Copy` may not be implemented for this type
   --> /Users/mo/dev/nokhwa/src/utils.rs:941:10
    |
941 | #[derive(Copy, Clone, Debug, Hash, Eq, PartialEq)]
    |          ^^^^
...
945 |     name: String,
    |     ------------ this field does not implement `Copy`
946 |     value: ControlDescription,
    |     ------------------------- this field does not implement `Copy`
947 |     flag: Vec<KnownCameraControlFlag>,
    |     --------------------------------- this field does not implement `Copy`
    |
    = note: this error originates in the derive macro `Copy` (in Nightly builds, run with -Z macro-backtrace for more info)

Some errors have detailed explanations: E0204, E0412, E0425, E0574.
For more information about an error, try `rustc --explain E0204`.
warning: `nokhwa` (lib) generated 6 warnings
error: could not compile `nokhwa` due to 14 previous errors; 6 warnings emitted

I'm new to Rust and after digging for an hour didn't know what I should do. Thanks!

I can't get frame from camera, it says

ReadFrameError("Input/output error (os error 5)")'

after like 15-30 seconds on this line:

let frame = camera.frame().unwrap();

I'm on Linux and specified v4l backend

Try to get RGBA image from camera, but get error: thread 'main' panicked at 'called Result::unwrap() on an Err value: ReadFrameError("Frame Cow Too Small")'

let mut camera = nokhwa::Camera::new(
        0, // index
        Some(nokhwa::CameraFormat::new_from(640, 480, nokhwa::FrameFormat::MJPEG, 30)), // format
    )
    .unwrap();

camera.open_stream().unwrap();

let mut buffer2: Vec<u8> = vec![0; camera.min_buffer_size(true)];

camera.frame_to_buffer(&mut buffer2, true).unwrap();

As I understand, I should receive 6404804 bytes. But when I increase the size of a vector, I get this error as well.

Hi,

I've ended up copy-pasting the code from the example to make sure it's not something I introduced by mistake.

Same behaviour for 0.6.0 and 0.7.0.

I am not able to figure out what it is, just wondering if it is an access problem, but not finding a way to fix it.

I got logitech UVC webcam, windows 10 Home, Gstreamer and OpenCV installed, not from WSL, admin cmd, made sure python from the same terminal could capture from the webcam with opencv-for-python.

Does it sound like a classic rust - Windows 10 problem you know of or something?

All requests to consult camera parameters (controls) are returning an error using input-msmf. I'm still trying to discover what is the problem...

I'm getting:

Err(GUIDSetError("MEDIA_FOUNDATION_FIRST_VIDEO_STREAM", "MF_MEDIASOURCE_SERVICE", "O objeto não oferece suporte ao serviço especificado."))

Probably from here:

pub fn control(&self, control: MediaFoundationControls) -> Result<MFControl, BindingError> {
            let media_source = unsafe {
                let mut receiver: MaybeUninit<IMFMediaSource> = MaybeUninit::uninit();
                let mut ptr_receiver = receiver.as_mut_ptr();
                if let Err(why) = self.source_reader.GetServiceForStream(
                    MEDIA_FOUNDATION_FIRST_VIDEO_STREAM,
                    &MF_MEDIASOURCE_SERVICE,
                    &IMFMediaSource::IID,
                    (&mut ptr_receiver as *mut *mut IMFMediaSource).cast::<*mut std::ffi::c_void>(),
                ) {
                    return Err(BindingError::GUIDSetError(
                        "MEDIA_FOUNDATION_FIRST_VIDEO_STREAM".to_string(),
                        "MF_MEDIASOURCE_SERVICE".to_string(),
                        why.to_string(),
                    ));
                }
                receiver.assume_init()
            };

OS: MacOS 12.3.1 Hardware: Apple Macbook Pro (14 inch, 2021), M1 Pro Chip Rust Version: rustc 1.62.0 (a8314ef7d 2022-06-27) Nokhwa Commit: 5a8d9c3 (0.9.4)

Example invocation:

cargo run --release --features "input-avfoundation" -- --format YUYV

Output:

thread '<unnamed>' panicked at 'called `Result::unwrap()` on an `Err` value: GetPropertyError { property: "875704438", error: "Invalid Value" }', src/main.rs:195:88
stack backtrace:
   0: rust_begin_unwind
             at /rustc/a8314ef7d0ec7b75c336af2c9857bfaf43002bfc/library/std/src/panicking.rs:584:5
   1: core::panicking::panic_fmt
             at /rustc/a8314ef7d0ec7b75c336af2c9857bfaf43002bfc/library/core/src/panicking.rs:142:14
   2: core::result::unwrap_failed
             at /rustc/a8314ef7d0ec7b75c336af2c9857bfaf43002bfc/library/core/src/result.rs:1785:5
note: Some details are omitted, run with `RUST_BACKTRACE=full` for a verbose backtrace.
Thread terminated, closing!

875704438 corresponds to a FourCC of 420v, or CV420YpCbCr8BiPlanarVideoRange

This error comes from this match block:

https://github.com/l1npengtul/nokhwa/blob/bd8e78134a123dc5fd3685264468ad27e99ddb17/nokhwa-bindings-macos/src/lib.rs#L862-L871

I suppose this is due to the newer facetime camera in the 2021 macbook pros?

If it's just a matter of adding support for an extra color format then I'd be happy to take a crack at it. Let me know if you need any help testing on apple hardware, I have a macbook pro 2014 (intel), macbook pro 2021 (M1 pro), and an M1 mac mini.

I'm trying to port a library I wrote from my custom V4L2 bindings (https://github.com/SludgePhD/LinuxVideo) to nokhwa and am seeing reduced performance:

[2022-05-01T12:53:43Z DEBUG zaru::webcam] trying #3 'Logitech BRIO' (Video4Linux Device @ /dev/video3)
[2022-05-01T12:53:43Z INFO  zaru::webcam] started stream at 1280x720@90Hz
[2022-05-01T12:53:44Z DEBUG zaru::timer] webcam: 3 FPS (dequeue: 3x333.5ms, decode: 3x6.8ms)
[2022-05-01T12:53:45Z DEBUG zaru::timer] webcam: 29 FPS (dequeue: 29x25.3ms, decode: 29x9.8ms)
[2022-05-01T12:53:46Z DEBUG zaru::timer] webcam: 29 FPS (dequeue: 29x25.1ms, decode: 29x9.8ms)
[2022-05-01T12:53:47Z DEBUG zaru::timer] webcam: 29 FPS (dequeue: 29x22.9ms, decode: 29x11.7ms)
[2022-05-01T12:53:48Z DEBUG zaru::timer] webcam: 29 FPS (dequeue: 29x28.3ms, decode: 29x6.6ms)
[2022-05-01T12:53:49Z DEBUG zaru::timer] webcam: 29 FPS (dequeue: 29x28.5ms, decode: 29x6.6ms)
[2022-05-01T12:53:50Z DEBUG zaru::timer] webcam: 29 FPS (dequeue: 29x28.1ms, decode: 29x6.8ms)

dequeue is the average time taken by camera.frame_raw(), decode is the time mozjpeg needs to decode the JPEG frame (which I do by hand, hence frame_raw()). The result of this is correct, and the decode times remained about the same, but the performance of dequeue is a lot worse than before (and much lower than what the webcam can deliver or what was requested).

For comparison, with LinuxVideo I have no problems running at 86 FPS, which I think is as fast as the webcam outputs frames when requesting 90 Hz. Note that LinuxVideo sidesteps libv4l and directly calls the device ioctls. The dequeue time is essentially completely spent blocking on the device read.

It could be that libv4l does some expensive conversion, or that something with setting the frame rate is going wrong (though camera.frame_rate() does correctly return 90).

This is with nokhwa 0.9.4, not latest git, but I don't see much that could affect performance (EDIT: now tested with git, same behavior).

(side note, I have tried the gstreamer backend instead of input-v4l, but it fails with a nondescript UnsupportedOperationError(Auto))

Hi, thank you for maintaining this crate!

It seems there is symbol(s) not found for architecture arm64 when building on a MacBook with an M1 processor (update: the same issue is encountered while trying to build on x86-64 mac, so CPU architecture does not matter here).

Here is the code I use:

use {
    std::{thread::sleep, time::Duration},
    nokhwa::{Camera, nokhwa_initialize, query},
};

fn main() {
    nokhwa_initialize(|result| {
        println!("on_complete: {}, query: {:?}", result, query()); 
        let camera = Camera::new(1, None).unwrap();
        println!("camera: {:?}", camera.info());
    });
    sleep(Duration::from_secs(10));
}

Cargo.toml:

[package]
name = "nokhwa-testing"
version = "0.1.0"
edition = "2021"

[dependencies]
nokhwa = { version = "0.9.4", features = ["input-avfoundation"] }

Here is a linker error I encounter:

error: linking with `cc` failed: exit status: 1
  |
  = note: "cc" "-arch" "arm64" "/var/folders/k8/tc8kf6997r9gwl156j5b0g1h0000gn/T/rustcad2hl8/symbols.o" "/Users/nikitavbv/dev/nokhwa-testing/target/debug/deps/nokhwa_testing-ee6d6ca36fb7e9d8.11b26thxr2zkmh75.rcgu.o" "/Users/nikitavbv/dev/nokhwa-testing/target/debug/deps/nokhwa_testing-ee6d6ca36fb7e9d8.14ju9lp2uv7xhil7.rcgu.o" "/Users/nikitavbv/dev/nokhwa-testing/target/debug/deps/nokhwa_testing-ee6d6ca36fb7e9d8.1isbi16a1tjg7o5f.rcgu.o" "/Users/nikitavbv/dev/nokhwa-testing/target/debug/deps/nokhwa_testing-ee6d6ca36fb7e9d8.3157rqi1un27yfph.rcgu.o" "/Users/nikitavbv/dev/nokhwa-testing/target/debug/deps/nokhwa_testing-ee6d6ca36fb7e9d8.339giqviijkbdou6.rcgu.o" "/Users/nikitavbv/dev/nokhwa-testing/target/debug/deps/nokhwa_testing-ee6d6ca36fb7e9d8.3kwn36whf96wn4nw.rcgu.o" "/Users/nikitavbv/dev/nokhwa-testing/target/debug/deps/nokhwa_testing-ee6d6ca36fb7e9d8.3oypbmz1qu6dv53c.rcgu.o" "/Users/nikitavbv/dev/nokhwa-testing/target/debug/deps/nokhwa_testing-ee6d6ca36fb7e9d8.3p3ucd0uz6i9kmmt.rcgu.o" "/Users/nikitavbv/dev/nokhwa-testing/target/debug/deps/nokhwa_testing-ee6d6ca36fb7e9d8.3q1aqfnimpcwrq6k.rcgu.o" "/Users/nikitavbv/dev/nokhwa-testing/target/debug/deps/nokhwa_testing-ee6d6ca36fb7e9d8.3qmqqgs3zmfmeqas.rcgu.o" "/Users/nikitavbv/dev/nokhwa-testing/target/debug/deps/nokhwa_testing-ee6d6ca36fb7e9d8.3wb3sk0nl9iivagx.rcgu.o" "/Users/nikitavbv/dev/nokhwa-testing/target/debug/deps/nokhwa_testing-ee6d6ca36fb7e9d8.417cdvo4hhcqac1g.rcgu.o" "/Users/nikitavbv/dev/nokhwa-testing/target/debug/deps/nokhwa_testing-ee6d6ca36fb7e9d8.49s8netqzp6lphje.rcgu.o" "/Users/nikitavbv/dev/nokhwa-testing/target/debug/deps/nokhwa_testing-ee6d6ca36fb7e9d8.4zqfqkynbefkt7uy.rcgu.o" "/Users/nikitavbv/dev/nokhwa-testing/target/debug/deps/nokhwa_testing-ee6d6ca36fb7e9d8.51smx5yvu2pz9xip.rcgu.o" "/Users/nikitavbv/dev/nokhwa-testing/target/debug/deps/nokhwa_testing-ee6d6ca36fb7e9d8.54eb0f5x3en2jk52.rcgu.o" "/Users/nikitavbv/dev/nokhwa-testing/target/debug/deps/nokhwa_testing-ee6d6ca36fb7e9d8.8wxashage992bxm.rcgu.o" "/Users/nikitavbv/dev/nokhwa-testing/target/debug/deps/nokhwa_testing-ee6d6ca36fb7e9d8.nfdq08phd3fnq4o.rcgu.o" "/Users/nikitavbv/dev/nokhwa-testing/target/debug/deps/nokhwa_testing-ee6d6ca36fb7e9d8.x7vl8kune1u8ikw.rcgu.o" "/Users/nikitavbv/dev/nokhwa-testing/target/debug/deps/nokhwa_testing-ee6d6ca36fb7e9d8.3yj7iby9c11nidld.rcgu.o" "-L" "/Users/nikitavbv/dev/nokhwa-testing/target/debug/deps" "-L" "/Users/nikitavbv/dev/nokhwa-testing/target/debug/build/mozjpeg-sys-f582892835282850/out" "-L" "/Users/nikitavbv/dev/nokhwa-testing/target/debug/build/mozjpeg-sys-f582892835282850/out" "-L" "/Users/nikitavbv/dev/nokhwa-testing/target/debug/build/objc_exception-c7958e843b8e62bd/out" "-L" "/Users/nikitavbv/.rustup/toolchains/nightly-aarch64-apple-darwin/lib/rustlib/aarch64-apple-darwin/lib" "/Users/nikitavbv/dev/nokhwa-testing/target/debug/deps/libnokhwa-1a079bdbbb5589a9.rlib" "/Users/nikitavbv/dev/nokhwa-testing/target/debug/deps/libmozjpeg-6634d948351acdd4.rlib" "/Users/nikitavbv/dev/nokhwa-testing/target/debug/deps/librgb-480af82697f3e438.rlib" "/Users/nikitavbv/dev/nokhwa-testing/target/debug/deps/libfallible_collections-3309b696366dad20.rlib" "/Users/nikitavbv/dev/nokhwa-testing/target/debug/deps/libhashbrown-1d8e74aeb478f341.rlib" "/Users/nikitavbv/dev/nokhwa-testing/target/debug/deps/libahash-5f759626124e5b0b.rlib" "/Users/nikitavbv/dev/nokhwa-testing/target/debug/deps/libonce_cell-4e22a751c4ad0e53.rlib" "/Users/nikitavbv/dev/nokhwa-testing/target/debug/deps/libarrayvec-efc691a55c0983c5.rlib" "/Users/nikitavbv/dev/nokhwa-testing/target/debug/deps/libmozjpeg_sys-09fe7e07ea2f7db4.rlib" "/Users/nikitavbv/dev/nokhwa-testing/target/debug/deps/libnokhwa_bindings_macos-4cd999170c2a10bf.rlib" "/Users/nikitavbv/dev/nokhwa-testing/target/debug/deps/libflume-ed4efa3fd1d7557e.rlib" "/Users/nikitavbv/dev/nokhwa-testing/target/debug/deps/libspin-2407881c60aa70b0.rlib" "/Users/nikitavbv/dev/nokhwa-testing/target/debug/deps/liblock_api-7fbb72b6cfc1b0c6.rlib" "/Users/nikitavbv/dev/nokhwa-testing/target/debug/deps/libscopeguard-eb1e61010332a1cf.rlib" "/Users/nikitavbv/dev/nokhwa-testing/target/debug/deps/libpin_project-a98907d1fcb05856.rlib" "/Users/nikitavbv/dev/nokhwa-testing/target/debug/deps/libfutures_sink-40b09e67990431db.rlib" "/Users/nikitavbv/dev/nokhwa-testing/target/debug/deps/libfutures_core-1b3a27dc641a732a.rlib" "/Users/nikitavbv/dev/nokhwa-testing/target/debug/deps/libnanorand-a27a2d340e69126f.rlib" "/Users/nikitavbv/dev/nokhwa-testing/target/debug/deps/libgetrandom-732ae10a5aefa5d2.rlib" "/Users/nikitavbv/dev/nokhwa-testing/target/debug/deps/libdashmap-a83262b3454e3e27.rlib" "/Users/nikitavbv/dev/nokhwa-testing/target/debug/deps/libnum_cpus-3b913b51fe59fbf0.rlib" "/Users/nikitavbv/dev/nokhwa-testing/target/debug/deps/libcfg_if-e6509c5f025d8702.rlib" "/Users/nikitavbv/dev/nokhwa-testing/target/debug/deps/libcocoa_foundation-f4d5900a80da637b.rlib" "/Users/nikitavbv/dev/nokhwa-testing/target/debug/deps/libforeign_types-b1a73fdbd94e948a.rlib" "/Users/nikitavbv/dev/nokhwa-testing/target/debug/deps/libforeign_types_shared-b2b813634eacbc55.rlib" "/Users/nikitavbv/dev/nokhwa-testing/target/debug/deps/libcore_graphics_types-2e141c6049806b3c.rlib" "/Users/nikitavbv/dev/nokhwa-testing/target/debug/deps/libcore_foundation-8928320c492b4635.rlib" "/Users/nikitavbv/dev/nokhwa-testing/target/debug/deps/libcore_foundation_sys-a98884409e1a2efe.rlib" "/Users/nikitavbv/dev/nokhwa-testing/target/debug/deps/libbitflags-295066ef4f1a08fb.rlib" "/Users/nikitavbv/dev/nokhwa-testing/target/debug/deps/libblock-54d07849328ebd85.rlib" "/Users/nikitavbv/dev/nokhwa-testing/target/debug/deps/libcore_media_sys-06f8f5185bcc4631.rlib" "/Users/nikitavbv/dev/nokhwa-testing/target/debug/deps/libcore_foundation_sys-d16b009260a549e9.rlib" "/Users/nikitavbv/dev/nokhwa-testing/target/debug/deps/libcfg_if-504e5b6598191998.rlib" "/Users/nikitavbv/dev/nokhwa-testing/target/debug/deps/libthiserror-0b5d3046e86037a8.rlib" "/Users/nikitavbv/dev/nokhwa-testing/target/debug/deps/liblazy_static-f75dab69ff4510ec.rlib" "/Users/nikitavbv/dev/nokhwa-testing/target/debug/deps/libobjc-0959b0f3a1d78466.rlib" "/Users/nikitavbv/dev/nokhwa-testing/target/debug/deps/libobjc_exception-08e7865472ccbbe2.rlib" "/Users/nikitavbv/dev/nokhwa-testing/target/debug/deps/libmalloc_buf-36827c8d724d6279.rlib" "/Users/nikitavbv/dev/nokhwa-testing/target/debug/deps/liblibc-1b5ce4b92aa38abf.rlib" "/Users/nikitavbv/dev/nokhwa-testing/target/debug/deps/libimage-79c28f91dd58bf9a.rlib" "/Users/nikitavbv/dev/nokhwa-testing/target/debug/deps/libcolor_quant-22192260062230e7.rlib" "/Users/nikitavbv/dev/nokhwa-testing/target/debug/deps/libnum_iter-7d6461ad6c5f1c6d.rlib" "/Users/nikitavbv/dev/nokhwa-testing/target/debug/deps/libbytemuck-88e115a31e194307.rlib" "/Users/nikitavbv/dev/nokhwa-testing/target/debug/deps/libnum_rational-84c9edafed28713c.rlib" "/Users/nikitavbv/dev/nokhwa-testing/target/debug/deps/libnum_integer-824e1dd12fc03d2b.rlib" "/Users/nikitavbv/dev/nokhwa-testing/target/debug/deps/libnum_traits-4b4376f67277d6cf.rlib" "/Users/nikitavbv/.rustup/toolchains/nightly-aarch64-apple-darwin/lib/rustlib/aarch64-apple-darwin/lib/libstd-af3f3292c66eb7cc.rlib" "/Users/nikitavbv/.rustup/toolchains/nightly-aarch64-apple-darwin/lib/rustlib/aarch64-apple-darwin/lib/libpanic_unwind-bc47a5a819240eac.rlib" "/Users/nikitavbv/.rustup/toolchains/nightly-aarch64-apple-darwin/lib/rustlib/aarch64-apple-darwin/lib/libobject-5fa6d29c50391a26.rlib" "/Users/nikitavbv/.rustup/toolchains/nightly-aarch64-apple-darwin/lib/rustlib/aarch64-apple-darwin/lib/libmemchr-9f34659cc49c55cf.rlib" "/Users/nikitavbv/.rustup/toolchains/nightly-aarch64-apple-darwin/lib/rustlib/aarch64-apple-darwin/lib/libaddr2line-0ca0691d5024e0e7.rlib" "/Users/nikitavbv/.rustup/toolchains/nightly-aarch64-apple-darwin/lib/rustlib/aarch64-apple-darwin/lib/libgimli-8b09daf3a02ae894.rlib" "/Users/nikitavbv/.rustup/toolchains/nightly-aarch64-apple-darwin/lib/rustlib/aarch64-apple-darwin/lib/librustc_demangle-c8e6e1ad4a56d084.rlib" "/Users/nikitavbv/.rustup/toolchains/nightly-aarch64-apple-darwin/lib/rustlib/aarch64-apple-darwin/lib/libstd_detect-cc5bb2a5896a5a35.rlib" "/Users/nikitavbv/.rustup/toolchains/nightly-aarch64-apple-darwin/lib/rustlib/aarch64-apple-darwin/lib/libhashbrown-ba2ca40bd5b846ac.rlib" "/Users/nikitavbv/.rustup/toolchains/nightly-aarch64-apple-darwin/lib/rustlib/aarch64-apple-darwin/lib/libminiz_oxide-eddbbfd8a1284efa.rlib" "/Users/nikitavbv/.rustup/toolchains/nightly-aarch64-apple-darwin/lib/rustlib/aarch64-apple-darwin/lib/libadler-0d5fdbc7da87a8dd.rlib" "/Users/nikitavbv/.rustup/toolchains/nightly-aarch64-apple-darwin/lib/rustlib/aarch64-apple-darwin/lib/librustc_std_workspace_alloc-94febd0ddea042d3.rlib" "/Users/nikitavbv/.rustup/toolchains/nightly-aarch64-apple-darwin/lib/rustlib/aarch64-apple-darwin/lib/libunwind-9231f6f457586171.rlib" "/Users/nikitavbv/.rustup/toolchains/nightly-aarch64-apple-darwin/lib/rustlib/aarch64-apple-darwin/lib/libcfg_if-3e833ccda9a92f6a.rlib" "/Users/nikitavbv/.rustup/toolchains/nightly-aarch64-apple-darwin/lib/rustlib/aarch64-apple-darwin/lib/liblibc-e2416b3132f6fa90.rlib" "/Users/nikitavbv/.rustup/toolchains/nightly-aarch64-apple-darwin/lib/rustlib/aarch64-apple-darwin/lib/liballoc-a8cb71066dca08ca.rlib" "/Users/nikitavbv/.rustup/toolchains/nightly-aarch64-apple-darwin/lib/rustlib/aarch64-apple-darwin/lib/librustc_std_workspace_core-95a7e52c78a3fba1.rlib" "/Users/nikitavbv/.rustup/toolchains/nightly-aarch64-apple-darwin/lib/rustlib/aarch64-apple-darwin/lib/libcore-dd6de681850a671c.rlib" "/Users/nikitavbv/.rustup/toolchains/nightly-aarch64-apple-darwin/lib/rustlib/aarch64-apple-darwin/lib/libcompiler_builtins-aa21927f5da4d4a2.rlib" "-framework" "CoreMedia" "-framework" "AVFoundation" "-framework" "Foundation" "-framework" "CoreGraphics" "-framework" "CoreFoundation" "-lSystem" "-framework" "CoreMedia" "-framework" "CoreFoundation" "-lobjc" "-liconv" "-lSystem" "-lresolv" "-lc" "-lm" "-liconv" "-L" "/Users/nikitavbv/.rustup/toolchains/nightly-aarch64-apple-darwin/lib/rustlib/aarch64-apple-darwin/lib" "-o" "/Users/nikitavbv/dev/nokhwa-testing/target/debug/deps/nokhwa_testing-ee6d6ca36fb7e9d8" "-Wl,-dead_strip" "-nodefaultlibs"
  = note: Undefined symbols for architecture arm64:
            "_CVPixelBufferLockBaseAddress", referenced from:
                _$LT$nokhwa_bindings_macos..avfoundation..CALLBACK_CLASS$u20$as$u20$core..ops..deref..Deref$GT$::deref::__static_ref_initialize::capture_out_callback::hbcd689a01a46737c in libnokhwa_bindings_macos-4cd999170c2a10bf.rlib(nokhwa_bindings_macos-4cd999170c2a10bf.nokhwa_bindings_macos.51d10249-cgu.1.rcgu.o)
            "_CVPixelBufferGetPixelFormatType", referenced from:
                _$LT$nokhwa_bindings_macos..avfoundation..CALLBACK_CLASS$u20$as$u20$core..ops..deref..Deref$GT$::deref::__static_ref_initialize::capture_out_callback::hbcd689a01a46737c in libnokhwa_bindings_macos-4cd999170c2a10bf.rlib(nokhwa_bindings_macos-4cd999170c2a10bf.nokhwa_bindings_macos.51d10249-cgu.1.rcgu.o)
            "_CVPixelBufferGetBaseAddress", referenced from:
                _$LT$nokhwa_bindings_macos..avfoundation..CALLBACK_CLASS$u20$as$u20$core..ops..deref..Deref$GT$::deref::__static_ref_initialize::capture_out_callback::hbcd689a01a46737c in libnokhwa_bindings_macos-4cd999170c2a10bf.rlib(nokhwa_bindings_macos-4cd999170c2a10bf.nokhwa_bindings_macos.51d10249-cgu.1.rcgu.o)
            "_CVPixelBufferGetDataSize", referenced from:
                _$LT$nokhwa_bindings_macos..avfoundation..CALLBACK_CLASS$u20$as$u20$core..ops..deref..Deref$GT$::deref::__static_ref_initialize::capture_out_callback::hbcd689a01a46737c in libnokhwa_bindings_macos-4cd999170c2a10bf.rlib(nokhwa_bindings_macos-4cd999170c2a10bf.nokhwa_bindings_macos.51d10249-cgu.1.rcgu.o)
            "_CVPixelBufferUnlockBaseAddress", referenced from:
                _$LT$nokhwa_bindings_macos..avfoundation..CALLBACK_CLASS$u20$as$u20$core..ops..deref..Deref$GT$::deref::__static_ref_initialize::capture_out_callback::hbcd689a01a46737c in libnokhwa_bindings_macos-4cd999170c2a10bf.rlib(nokhwa_bindings_macos-4cd999170c2a10bf.nokhwa_bindings_macos.51d10249-cgu.1.rcgu.o)
          ld: symbol(s) not found for architecture arm64
          clang: error: linker command failed with exit code 1 (use -v to see invocation)


error: could not compile `nokhwa-testing` due to previous error

Any ideas on a possible workaround? Thank you!

• Dropped UVC backend
• Updated mozjpeg to a forked 0.9.1 version supporting in-buffer decoding
  • Ideally a PR should be done to mozjpeg-rust to mainline this change
• Modified existing decoding methods to take rgba as a parameter
  • yuyv422_to_rgb888 / yuyv422_to_rgba => yuyv422_to_rgb
  • mozjpeg_to_rgb888 / mozjpeg_to_rgba => mozjpeg_to_rgb
• Added in-buffer decoding methods
  • buf_yuyv422_to_rgb
  • buf_mozjpeg_to_rgb
  • Note: the aforementioned existing decoding methods allocate a sizable Vec then call into those new methods.
• Simplified code in some places
• Removed ^version in Cargo.toml dependencies as ^ is always implied

• [ ] FrameFormat Rework, Again
  • [ ] Support Every FourCC in Existance, at least in the Enum
  • [ ] Seperate FrameFormat, RGB, and Decoder
    • [ ] e.g. MJPEGDecoder decodes into RGB, GRAY, BRG, 10bit, etc..
    • [ ] This will allow for user-definable decoders
• [ ] Re-write WASM backend
  • [ ] Deprecate JSCamera and instead use BrowserCamera accessible from Camera
• [ ] AsyncCamera Support, Callback Camera but with Async instead of Threads
  • [ ] New Trait to describe Async-able Backends
  • [ ] V4L2: Async
  • [ ] AVFoundation: Wait on Callback
  • [ ] WASM: Directly pass JSFuture
  • [ ] MSMF: Use Async Capture
• [ ] FFMPEG Support
• [ ] Support HDR, maybe (if i get a hold of one)

OS: Windows 11 22H2 Camera: Name: AI Front Camera, Description: MediaFoundation Camera, Extra: \\?\display#qcom_avstream_8280_lenv#3&98d97ee&1&uid32768#{e5323777-f976-4f5b-9b55-b94699c46e44}\{4faeafd4-041b-4e46-85fd-400473891182}, Index: 0 (webcam of a Lenovo X13s) Backend: input-native

I've been trying out the capture example, which I would assume to produce correct images out of the box. However, with my webcam I get correct colors in medium-light areas, but wrong colors in high or low light areas.

See the below two images, the first taken with cargo run -- single 0 img_test.png AbsoluteHighestResolution, the second with Window's Camera app.

This looks like an HDR issue of some kind, but I'm not sure how to go about solving it.

Hi there 👋

I'm trying to use nokhwa (built from this main branch) to show my webcam video in an iced application. I am pretty new to this ecosystem, so sorry if this is a dumb question, but how do I use the camera output with the image widget of iced.

My application looks like this:

use iced::widget::{column, image, text};
use iced::{executor, Subscription};
use iced::{Alignment, Application, Command, Element, Settings, Theme};
use nokhwa::pixel_format::RgbFormat;
use nokhwa::utils::{ApiBackend, CameraInfo, RequestedFormat, RequestedFormatType};
use nokhwa::{query, Camera};

// TODO: set these via environment variables
const CAMERA_QUERY_INTERVAL: u64 = 2000;

pub fn main() -> iced::Result {
    MediaHub::run(Settings::default())
}

struct MediaHub {
    cameras: Box<Vec<CameraInfo>>,
}

#[derive(Debug, Clone)]
enum Message {
    CamerasListed(Box<Vec<CameraInfo>>),
}

fn query_all_cameras() -> Box<Vec<CameraInfo>> {
    Box::new(query(ApiBackend::Auto).unwrap())
}

impl Application for MediaHub {
    type Message = Message;
    type Executor = executor::Default;
    type Flags = ();
    type Theme = Theme;

    fn new(_flags: ()) -> (Self, Command<Self::Message>) {
        (
            Self {
                cameras: query_all_cameras(),
            },
            Command::none(),
        )
    }

    fn update(&mut self, message: Message) -> Command<Self::Message> {
        match message {
            Message::CamerasListed(new_cams) => self.cameras = new_cams,
        }
        Command::none()
    }

    fn subscription(&self) -> Subscription<Message> {
        iced::time::every(std::time::Duration::from_millis(CAMERA_QUERY_INTERVAL))
            .map(|_| Message::CamerasListed(query_all_cameras()))
    }

    fn title(&self) -> String {
        String::from("MediaHub - Iced")
    }

    fn view(&self) -> Element<Message> {
        if self.cameras.len() > 0 {
            let camera_info = self
                .cameras
                .iter()
                .map(|cam| cam.human_name())
                .collect::<Vec<String>>()
                .join(", ");

            let requested = RequestedFormat::new(RequestedFormatType::AbsoluteHighestFrameRate);

            let cam = Camera::new(nokhwa::utils::CameraIndex::Index(0), requested).unwrap();
            let frame = cam.frame().unwrap().decode_image().unwrap();

            let img = image::Handle::from_pixels(frame.width(), frame.height(), frame); // the last argument is wrong, it throws an error

            column![text(camera_info).size(50), image::viewer(img)]
                .padding(20)
                .align_items(Alignment::Center)
                .into()
        } else {
            column![text("No camera found").size(50)]
                .padding(20)
                .align_items(Alignment::Center)
                .into()
        }
    }
}

I can contribute an example for this integration if you like :)

hello, i want to use nokhwa to capture images from usb camera on windows, as the opencv didn't support MSMF backends well i found this lib based on nokhwa provided a python lib, yet it did not support control settings until now. i wonder is it possible to use nokhwa in python in the future? i think it will be more popular than the opencv-python or pycamera, which can not compare nokhwa on options abundance and stability