AMB82-Mini onboard camera sensor identification and VOE setup for wireless video and I2C

FreeRTOS SDK
1

Hello,

I am working with the AMB82-Mini (RTL8735B) development kit and trying to stream video wirelessly from the camera module that ships with the kit.

My goal is to:

  • capture video from the onboard camera

  • transmit the video wirelessly over WiFi

  • also communicate with the sensor via I2C for configuration and register access

However I am running into issues during sensor initialization.

Current setup

  • Board: AMB82-Mini

  • SDK: ameba-rtos-pro2

  • Example project: mmfv2_video_example

  • Camera module: the small square module included with the kit

  • Module marking: 台亦光电 (Taiyee Optoelectronics)

The module itself does not appear to have a visible sensor marking.

Issue

During boot I see the video subsystem initialize, but sensor commands fail:

VOE command 0x270 fail
VOE command 0x206 fail

and when probing registers through the video I2C interface I receive:

reg 0x0A data = 0x00
reg 0x0B data = 0x00

From examining the SDK I found that only these sensor drivers appear in the build:

sensor_ps5270.c
sensor_ps5420.c

and the firmware includes:

sensor_ps5270.bin
sensor_ps5270_hdr.bin

So it appears the system expects a PS5270 sensor, but I am not certain that the onboard module actually uses this sensor.

Questions

  1. What sensor is used in the AMB82-Mini kit camera module?

    • Is it PS5270, PS5420, or something else?

  2. Where is the sensor selected in the SDK?

    I see logs printing:

    sensor id %d iq_data %x sensor_data %x

    but I have not found where that ID maps to the sensor driver.

  3. Is the sensor GPIO configuration stored in the FCS / VOE firmware blob?

    I see the call:

    hal_video_isp_set_sensor_gpio(...)

    which loads pins from gpio_list.

  4. What is the recommended way to stream video wirelessly from this camera?

    • RTSP

    • RTMP

    • custom UDP streaming

  5. Is there a reference example for sending camera video over WiFi using the onboard module?

I want to build a system where the AMB82-Mini:

  • captures camera frames

  • sends them wirelessly over WiFi

  • allows remote I2C access to the camera registers.

Any guidance on the correct sensor configuration or example projects would be greatly appreciated.

Thank you.

2

Hi @Abi_Rusalavitch,

AMB82-Mini (RTL8735B) ships with a JXF37P camera sensor.

As we are using JXF37 by default, you have to modify sensor.h
You may refer to the sensor.h I have modified it as a reference.

sensor.zip (2.2 KB)

In FreeRTOS SDK, after modifying the sensor.h, you need to do a clean build, and amebapro2_sensor_set.json will be automatically updated.

  • cd to build folder and rm -rf * to clean up build folder
  • rebuild the example

Now you should be able to use the sensor.

The updated amebapro2_sensor_set.json can be found in \GCC-RELEASE\build\application after compiling.

Based on hal_video_isp_set_sensor_gpio(...) , the sensor GPIO configuration is taken from gpio_list , so it is more likely defined in the platform / driver initialization code rather than stored statically inside the FCS / VOE firmware blob.

The GPIO pin is configured in video_api.c, Line 1495 onwards.

For more information you can refer to [AmebaPro2] Introduction for AmebaPro2 Flow — AmebaPro2's Documentation v0.1 documentation

You can explore the following for video streaming.

  1. RTSP
  2. Websocket Viewer (low latency video streaming)

May I know where you want to send the video? Do you mean streaming video via RTSP?

Application Note for your reference as well: Realtek AmebaPro2 application note — AmebaPro2's Documentation v0.1 documentation

3

Yes, I will be streaming video via RTSP. Thank you for your help!