Camera Streaming with Web Application

Technical Discussion AMB82-mini
1

Hi,

Me and a team are trying to use the AMB82-Mini as a camera and to host our controller for a robot we are developing. Our idea is to use the AMB82-MINI to create an AP in which users can connect to by putting in the router address in the address bar of any browser. They can see a live stream feed from the robot’s perspective, and they can click on buttons to control the robot. Both the live stream and button-clicking (HTML + Javascript) are supposed to happen together simultaneously, however we came across a problem.

We were able to create an AP and users have no problems connecting to it, however, we have issues the actual web application itself.

If the camera stream starts after the webpage with the buttons, only the camera works and the buttons do not. Vice versa if the webpage is sent after the camera stream.

We were able to accomplish our desired outcome using the ESP32-CAM (dual-core), but we would to switch to the AMB82-MINI because of the better camera quality.

I’m using Arduino IDE, and I have 4.0.5.

This is not our project, but a famous example (for context) of what we are trying to accomplish (done with the ESP32): https://www.youtube.com/watch?v=HfQ7lhhgDOk&t=542s

Is there anyway that the web-application and camera feed could be done simultaneously, and if not would it be possible to use another microcontroller to handle some of the processing so that this could be possible.

2

you can try V7RC or VLC, as smart app for streaming.
or use any browser that has RTSP supported. \

or using JEPG Multimedia – Capture JPEG display over HTTP – Realtek IoT/Wi-Fi MCU Solutions

3

How can I use websocket’s features to send images to my server?

4

Can I add RTMP or HLS streaming to the AMB82-Mini ? I can use both Arduino or SDK library. Please suggest.

5

Hi @Trung_Phan_Thai,

Are you okay with using third party apps for the streaming? In the link below, it teaches users how to set up RTMP or HLS streaming with NGINX.

6

Hi @Kelvin_Huang , unfortunately the app mentioned in the thread above is not suitable, because for FFmpeg, the end user needs to install the app into their computer as a middle proxy server. While in my case, I just want the end user to be able to use their mobile phone using mobile applications directly, the app need to use ReactJS or other web based, cross platform user interface like Ionic framework. The mobile app should be installed directly into the end user mobile phone without need of using any other FFmpeg + Nginx middleware.

Please advise. I just think of modifying the SDK or Arduino source code to add RTMP or HLS libaries. Is it possible?

7

Hi @Trung_Phan_Thai,

Unfortunately, we do not have any RTMP or HLS libraries in our Arduino SDK or FreeRTOS SDK. You might need to test it out yourself to add these libraries and resolve any conflict with our SDK.

We do not directly support these 2 protocols on our board yet.

Thank you.