# Use AMB82-Mini as a ai powered usb webcam using the USB OTG

**URL:** <https://forum.amebaiot.com/t/use-amb82-mini-as-a-ai-powered-usb-webcam-using-the-usb-otg/3158>\
**Category:** USB\
**Tags:** evb-amb82, rtl8735b\
**Created:** [July 21, 2024, 11:22pm UTC](https://forum.amebaiot.com/t/use-amb82-mini-as-a-ai-powered-usb-webcam-using-the-usb-otg/3158 "2024-07-21T23:22:03Z")\
**Posts on this page:** 19\
**Page:** 1

<div class="post-metadata">

**Author:** ![Vignan\_Tej](https://sea2.discourse-cdn.com/flex016/user_avatar/forum.amebaiot.com/vignan_tej/32/2198_2.png) [@Vignan\_Tej](https://forum.amebaiot.com/u/Vignan_Tej)\
**Post date:** [July 21, 2024, 11:22pm UTC](https://forum.amebaiot.com/t/use-amb82-mini-as-a-ai-powered-usb-webcam-using-the-usb-otg/3158/1 "2024-07-21T23:22:03Z")

</div>

I want to use the AMB82-Mini with further functionality developed in a more powerful debian board (RPi / NanoPi / OrangePi, etc..). I need to access the H264 stream on these boards via USB or any other wired connection, after being processed for object detection and motion detection with the bounding boxes. How can I achieve this? The USB OTG functionality is not documented in Arduino docs. I am open to other suggestions too.

---

<div class="post-metadata">

**Author:** ![Kelvin\_Huang](https://sea2.discourse-cdn.com/flex016/user_avatar/forum.amebaiot.com/kelvin_huang/32/2130_2.png) [@Kelvin\_Huang](https://forum.amebaiot.com/u/Kelvin_Huang)\
**Post date:** [July 22, 2024, 1:48am UTC](https://forum.amebaiot.com/t/use-amb82-mini-as-a-ai-powered-usb-webcam-using-the-usb-otg/3158/2 "2024-07-22T01:48:13Z")

</div>

Hi @Vignan_Tej,

This feature is still not available yet.

To use AMB82-Mini as an ai powered usb webcam, this feature will have to be ported. You may raise this as a feature request in our Github repo.

Thank you.

---

<div class="post-metadata">

**Author:** ![Pammy](https://sea2.discourse-cdn.com/flex016/user_avatar/forum.amebaiot.com/pammy/32/936_2.png) [@Pammy](https://forum.amebaiot.com/u/Pammy)\
**Post date:** [August 12, 2024, 3:45am UTC](https://forum.amebaiot.com/t/use-amb82-mini-as-a-ai-powered-usb-webcam-using-the-usb-otg/3158/3 "2024-08-12T03:45:49Z")

</div>

Hi @Vignan_Tej,

The Arduino SDK prerelease version (4.0.8-build20240805) now supports USB UVC feature.

As it is a prerelease version (dev), the SDK could be unstable. Do let us know if you have encounter any issues.

To use the Arduino SDK prerelease version (4.0.8-build20240805), kindly input [https://github.com/ambiot/ambpro2\_arduino/raw/dev/Arduino\_package/package\_realtek\_amebapro2\_early\_index.json](https://github.com/ambiot/ambpro2_arduino/raw/dev/Arduino_package/package_realtek_amebapro2_early_index.json) under preference in Arduino IDE and install 4.0.8-build20240805.

---

<div class="post-metadata">

**Author:** ![Vignan\_Tej](https://sea2.discourse-cdn.com/flex016/user_avatar/forum.amebaiot.com/vignan_tej/32/2198_2.png) [@Vignan\_Tej](https://forum.amebaiot.com/u/Vignan_Tej)\
**Post date:** [August 12, 2024, 10:14am UTC](https://forum.amebaiot.com/t/use-amb82-mini-as-a-ai-powered-usb-webcam-using-the-usb-otg/3158/4 "2024-08-12T10:14:13Z")

</div>

Thanks for the reply. Trying out the prerelease version.

---

<div class="post-metadata">

**Author:** ![Vignan\_Tej](https://sea2.discourse-cdn.com/flex016/user_avatar/forum.amebaiot.com/vignan_tej/32/2198_2.png) [@Vignan\_Tej](https://forum.amebaiot.com/u/Vignan_Tej)\
**Post date:** [August 18, 2024, 6:24am UTC](https://forum.amebaiot.com/t/use-amb82-mini-as-a-ai-powered-usb-webcam-using-the-usb-otg/3158/5 "2024-08-18T06:24:53Z")

</div>

Hi Team,

Do we have an example code for the USB UVC with face recognition?

---

<div class="post-metadata">

**Author:** ![Pammy](https://sea2.discourse-cdn.com/flex016/user_avatar/forum.amebaiot.com/pammy/32/936_2.png) [@Pammy](https://forum.amebaiot.com/u/Pammy)\
**Post date:** [August 21, 2024, 1:20am UTC](https://forum.amebaiot.com/t/use-amb82-mini-as-a-ai-powered-usb-webcam-using-the-usb-otg/3158/6 "2024-08-21T01:20:18Z")

</div>

Hi @Vignan_Tej ,

We do not have this example, however you may refer the following guide to implement it.

USB UVC: [USB – UVC Device – Realtek IoT/Wi-Fi MCU Solutions](https://www.amebaiot.com/en/amebapro2-arduino-usb-uvc/)  
Face recognition: [Neural Nework – Face Recognition – Realtek IoT/Wi-Fi MCU Solutions](https://www.amebaiot.com/en/amebapro2-arduino-neuralnework-face-recognition/)  
API documentation:  
[Class UVCD – Realtek IoT/Wi-Fi MCU Solutions](https://www.amebaiot.com/en/rtl8735b-arduino-api-usb-uvc/)  
[FaceDetectionRecognition Class – Realtek IoT/Wi-Fi MCU Solutions](https://www.amebaiot.com/en/rtl8735b-arduino-api-neuralnetwork-facerecognition/)

---

<div class="post-metadata">

**Author:** ![Vignan\_Tej](https://sea2.discourse-cdn.com/flex016/user_avatar/forum.amebaiot.com/vignan_tej/32/2198_2.png) [@Vignan\_Tej](https://forum.amebaiot.com/u/Vignan_Tej)\
**Post date:** [August 21, 2024, 9:29am UTC](https://forum.amebaiot.com/t/use-amb82-mini-as-a-ai-powered-usb-webcam-using-the-usb-otg/3158/7 "2024-08-21T09:29:05Z")

</div>

Hi Pammy,

Thanks for the directions. I am not able to get any output from the USB UVC Example.

This is the console log output. I Have not made any changes to the example.

```auto
14:56:28.535 -> set_alt interface 0 alt =0

```

```auto
14:56:28.535 -> 
set_alt interface 1 alt =0

```

```auto
14:56:28.535 -> 
set_alt interface 1 alt =0

```

```auto
14:56:28.535 -> 
set_alt interface 1 alt =0

```

```auto
14:56:28.541 -> 
fun_suspend

```

```auto
14:56:34.102 -> streaming request (req 81 cs 01)

```

```auto
14:56:34.102 -> 
probe

```

```auto
14:56:34.102 -> streaming request (req 01 cs 01)

```

```auto
14:56:34.102 -> 
setting commit control, length = 26

```

```auto
14:56:34.102 -> 
format ->7014edac

```

```auto
14:56:34.134 -> 
interval[0] = 416666

```

```auto
14:56:34.134 -> 
format = 1 w = 1920 h = 1080 fps = 416666

```

```auto
14:56:34.134 -> 
streaming request (req 81 cs 01)

```

```auto
14:56:34.134 -> 
probe

```

```auto
14:56:34.134 -> streaming request (req 83 cs 01)

```

```auto
14:56:34.134 -> 
format ->7014eda4 ->7014eda4

```

```auto
14:56:34.134 -> 
Type_ = 0

```

```auto
14:56:34.134 -> 
format ->7014eda4 ->7014eda4 size 4147200

```

---

<div class="post-metadata">

**Author:** ![Pammy](https://sea2.discourse-cdn.com/flex016/user_avatar/forum.amebaiot.com/pammy/32/936_2.png) [@Pammy](https://forum.amebaiot.com/u/Pammy)\
**Post date:** [August 23, 2024, 5:26am UTC](https://forum.amebaiot.com/t/use-amb82-mini-as-a-ai-powered-usb-webcam-using-the-usb-otg/3158/8 "2024-08-23T05:26:01Z")

</div>

Hi @Vignan_Tej ,

May I know which media player you are using? I suggest that you can use PotPlayer.

If you using PotPlayer, please use the following setting to start stream.

 ![image](https://us1.discourse-cdn.com/flex016/uploads/ameba/original/2X/6/688129f2613813d9b6b82f171ab718038ea058a0.png)

---

<div class="post-metadata">

**Author:** ![Vignan\_Tej](https://sea2.discourse-cdn.com/flex016/user_avatar/forum.amebaiot.com/vignan_tej/32/2198_2.png) [@Vignan\_Tej](https://forum.amebaiot.com/u/Vignan_Tej)\
**Post date:** [August 23, 2024, 6:34am UTC](https://forum.amebaiot.com/t/use-amb82-mini-as-a-ai-powered-usb-webcam-using-the-usb-otg/3158/9 "2024-08-23T06:34:30Z")

</div>

I was using windows default camera application. It was being recognised as USB UVS Class, but black screen and the stream did not start.  
I am planning to get the stream through go2rtc to stream it over webrtc.

---

<div class="post-metadata">

**Author:** ![Pammy](https://sea2.discourse-cdn.com/flex016/user_avatar/forum.amebaiot.com/pammy/32/936_2.png) [@Pammy](https://forum.amebaiot.com/u/Pammy)\
**Post date:** [August 23, 2024, 7:37am UTC](https://forum.amebaiot.com/t/use-amb82-mini-as-a-ai-powered-usb-webcam-using-the-usb-otg/3158/10 "2024-08-23T07:37:50Z")

</div>

Currently we have not test on windows default camera application yet. there are chances that the example is not supported for windows default camera application yet.

There are also some updates for usb uvc, [Update USB UVCD APIs and CI workflow · ambiot/ambpro2\_arduino@509c46a · GitHub](https://github.com/ambiot/ambpro2_arduino/commit/509c46a09719ec3ac495c8c1af8bfb07cb618f16)  
You may need to modify the following in Arduino SDK to get more format type supported.

- cores/ambpro2/video\_drv.c
- cores/ambpro2/video\_drv.c
- src/UVCD.cpp
- src/UVCD.h

---

<div class="post-metadata">

**Author:** ![spikerguy](https://avatars.discourse-cdn.com/v4/letter/s/13edae/32.png) [@spikerguy](https://forum.amebaiot.com/u/spikerguy)\
**Post date:** [August 25, 2024, 1:56pm UTC](https://forum.amebaiot.com/t/use-amb82-mini-as-a-ai-powered-usb-webcam-using-the-usb-otg/3158/11 "2024-08-25T13:56:16Z")

</div>

> [@Pammy](#):
>
> USB UVC: [USB – UVC Device – Realtek IoT/Wi-Fi MCU Solutions](https://www.amebaiot.com/en/amebapro2-arduino-usb-uvc/)

Does it have Controls in camera UI when using it as usb-cam ?

I studied from the video presentation that brightness, contrast, exposure and gray mode can be set from the IDE but will the Camera app UI pick it up and can we be able to manually set it from UI instead of IDE command?

Regards,

---

<div class="post-metadata">

**Author:** ![Pammy](https://sea2.discourse-cdn.com/flex016/user_avatar/forum.amebaiot.com/pammy/32/936_2.png) [@Pammy](https://forum.amebaiot.com/u/Pammy)\
**Post date:** [August 26, 2024, 1:17am UTC](https://forum.amebaiot.com/t/use-amb82-mini-as-a-ai-powered-usb-webcam-using-the-usb-otg/3158/12 "2024-08-26T01:17:53Z")

</div>

Hi @spikerguy

which camera UI are you referring to? If you are creating your own UI, you can refer to [VideoStream Class – Realtek IoT/Wi-Fi MCU Solutions](https://www.amebaiot.com/en/rtl8735b-arduino-api-videostream/) to develop and program your UI. We does not provide UI; it can only be set manually from the IDE.

---

<div class="post-metadata">

**Author:** ![Vignan\_Tej](https://sea2.discourse-cdn.com/flex016/user_avatar/forum.amebaiot.com/vignan_tej/32/2198_2.png) [@Vignan\_Tej](https://forum.amebaiot.com/u/Vignan_Tej)\
**Post date:** [August 26, 2024, 7:26am UTC](https://forum.amebaiot.com/t/use-amb82-mini-as-a-ai-powered-usb-webcam-using-the-usb-otg/3158/13 "2024-08-26T07:26:24Z")

</div>

Hi @Pammy, I am not able to get the video stream using ffmpeg. Any specific configuration I should use? I tried this.

sudo ffmpeg -f v4l2 -video\_size 1920x1080 -i /dev/video0 -vcodec libx264 -preset veryfast -crf 23 output.mp4

This is the output I got:

 ![image](https://us1.discourse-cdn.com/flex016/uploads/ameba/original/2X/c/ca6d33bac3ee45381d8c4fda736946a82a166fca.png)

---

<div class="post-metadata">

**Author:** ![Vignan\_Tej](https://sea2.discourse-cdn.com/flex016/user_avatar/forum.amebaiot.com/vignan_tej/32/2198_2.png) [@Vignan\_Tej](https://forum.amebaiot.com/u/Vignan_Tej)\
**Post date:** [August 26, 2024, 7:49am UTC](https://forum.amebaiot.com/t/use-amb82-mini-as-a-ai-powered-usb-webcam-using-the-usb-otg/3158/14 "2024-08-26T07:49:14Z")

</div>

![image](https://us1.discourse-cdn.com/flex016/uploads/ameba/original/2X/e/e6fc8c4355b101a5c1a0fa1fb26dea88ad7b2d2a.png)  
Even the copying the stream directly didn’t work…

---

<div class="post-metadata">

**Author:** ![Vignan\_Tej](https://sea2.discourse-cdn.com/flex016/user_avatar/forum.amebaiot.com/vignan_tej/32/2198_2.png) [@Vignan\_Tej](https://forum.amebaiot.com/u/Vignan_Tej)\
**Post date:** [September 7, 2024, 4:26am UTC](https://forum.amebaiot.com/t/use-amb82-mini-as-a-ai-powered-usb-webcam-using-the-usb-otg/3158/15 "2024-09-07T04:26:35Z")

</div>

Hi Pammy,

Any update on connecting via ffmpeg? It would be great if it’s available.

Regards,  
Vignan Tej 🏁

---

<div class="post-metadata">

**Author:** ![Vignan\_Tej](https://sea2.discourse-cdn.com/flex016/user_avatar/forum.amebaiot.com/vignan_tej/32/2198_2.png) [@Vignan\_Tej](https://forum.amebaiot.com/u/Vignan_Tej)\
**Post date:** [September 19, 2024, 11:16am UTC](https://forum.amebaiot.com/t/use-amb82-mini-as-a-ai-powered-usb-webcam-using-the-usb-otg/3158/16 "2024-09-19T11:16:25Z")

</div>

Hi @Pammy,  
Any update on using the AMB82-Mini UVC via ffmpeg?

---

<div class="post-metadata">

**Author:** ![M-ichae-l](https://sea2.discourse-cdn.com/flex016/user_avatar/forum.amebaiot.com/m-ichae-l/32/33_2.png) [@M-ichae-l](https://forum.amebaiot.com/u/M-ichae-l)\
**Post date:** [September 24, 2024, 2:43am UTC](https://forum.amebaiot.com/t/use-amb82-mini-as-a-ai-powered-usb-webcam-using-the-usb-otg/3158/17 "2024-09-24T02:43:20Z")

</div>

I thinks there is no UI for ffmpeg currently.

---

<div class="post-metadata">

**Author:** ![Vignan\_Tej](https://sea2.discourse-cdn.com/flex016/user_avatar/forum.amebaiot.com/vignan_tej/32/2198_2.png) [@Vignan\_Tej](https://forum.amebaiot.com/u/Vignan_Tej)\
**Post date:** [September 24, 2024, 7:49am UTC](https://forum.amebaiot.com/t/use-amb82-mini-as-a-ai-powered-usb-webcam-using-the-usb-otg/3158/18 "2024-09-24T07:49:54Z")

</div>

I am not looking for a UI. If I can get ffmpeg to record video to file. I can develop my application accordingly.

Regards,  
Vignan Tej

---

<div class="post-metadata">

**Author:** ![Geo\_Muir](https://sea2.discourse-cdn.com/flex016/user_avatar/forum.amebaiot.com/geo_muir/32/2571_2.png) [@Geo\_Muir](https://forum.amebaiot.com/u/Geo_Muir)\
**Post date:** [April 17, 2025, 11:49am UTC](https://forum.amebaiot.com/t/use-amb82-mini-as-a-ai-powered-usb-webcam-using-the-usb-otg/3158/19 "2025-04-17T11:49:29Z")

</div>

Did you get anywhere with this. im currently using esp32 cameras but im wanting to use a AMB82 mini but to do that i need to be able to stream from it using ffmpeg.
