Further increasing frame rate?

[Knedox]

The frame rate is already pretty good, dont get me wrong :D
I am wondering whats currently limiting the frame rate in higher resolution modes like VGA and higher.
Seems like its independent from the data rate? Would it be possible to implement dynamic frame rate based on jpeg bandwidth? Can you point me in the right direction?

[me-no-dev]

the frame rate is limited by the sensor itself. in JPEG we have the bandwidth to read frames at max res at 25fps, but the camera itself is lowering it.

[Knedox]

just FYI

i have disabled pixel clock divider for CIF, disabled clock prescaler and enabled clock doubler

REG32_CIF = 0x09
{CLKRC, 0x00 | CLKRC_2X}

then i have set config.xclk_freq_hz to 12mhz

now i get 60 FPS in CIF
and 30 FPS in VGA/SVGA

but SXGA and up is broken.
Setting config.xclk_freq_hz to 10Mhz results in 15FPS for SXGA

might be good if you would include the changes in your code to get more FPS 👍

[me-no-dev]

i tested different prescalers but they did not result in stable operation. on top of that the network and all got so bogged down that I was not able to do any meaningful processing and the quality had to be lowered as well. will do more testing when necessary, but for now I think this is quite safe :)

[me-no-dev]

to note, not equal division from 80MHz is not a good idea on esp32 (and going above 20 is not even possible) because of how the peripheral works.

[me-no-dev]

Your suggestions have been added here :) Just set XCLK to 10MHz and double speed will be enabled

[Knedox]

another update:
seems like the HDF3M camera board that is supplied with the M5-Stack camera is very temperature dependent at high FPS. It has to reach temperature to get glitch free. The one supplied with esp32 cam board works at any temperature

[rochus-keller]

@me-no-dev

the frame rate is limited by the sensor itself. in JPEG we have the bandwidth to read frames at max res at 25fps, but the camera itself is lowering it.

Interesting. Where do you have this information from? I didn't find any confirmation in the OV2640 data sheet; instead the sensor is supposed to work at 30 fps in SVGA and even 60 fpw in CIF. Could you please provide more information about your assumptions?

[rochus-keller]

@Knedox

seems like the HDF3M camera board that is supplied with the M5-Stack camera is very temperature dependent at high FPS. It has to reach temperature to get glitch free. The one supplied with esp32 cam board works at any temperature

Thanks, great work! Can I conclude from your findings that with an ordinary ESP32-CAM board available for ~6$ (e.g. like this one https://www.aliexpress.com/item/ESP32-Cam-ESP32-Cam-WiFi-Bluetooth-ESP32-Camera-Module-Development-Board-with-OV2640-Camera-Module/33025675750.html) you are able to stream VGA (640x480) at 30 fps over Wifi without any crashes with your fix? So you cannot confirm the findings by @me-no-dev that the operation is unstable?

[Celppu]

I'm trying to achieve better frame rates but library provided in arduino ide is strange. In picture left and red is size in bytes and blue and right is time in ms.

Is library in arduino ide unoptimized or am I doing something wrong? I set 10mhz setting and 12 jpeg compression.

[me-no-dev]

there is nothing strange... how do you get those numbers? do you measure time between a frame is available or time between you getting and transfering it somewhere? You are trowing words but I do not get what you want to achieve? what is your target FPS at what resolution?

[Celppu]

I measured only the time taken by esp_camera_fb_get(). I didn't understand those examples and my code might be quite wrong...
`
long startters = millis();
fb = esp_camera_fb_get();
if(!fb) {
Serial.println("Camera capture failed");
return;
}
Serial.println(millis() - startters);
Serial.println(fb->len);

esp_camera_fb_return(fb);
`
Is there any example code how to achieve 30-60 frames second for vga and svga?

[me-no-dev]

you can't. you can do 25 :)
frame rates depend on many things but in essence the pixel clock needs to be compatible with what the ESP can handle. On top of that you have to get all the bytes from DMA and put them into PSRAM fast enough. That also needs time :) Here is a sheet of what is currently possible: