[Page Add][Enhanced Function]Support the camera interface for XIAO ESP32S3 Sense, by Zephyr

[MatthewJeffson]

Overview

• We need your help to support the camera interface for ESP32 device, and support XIAO ESP32S3 Sense at the following part, using Zephyr.
• Reference by Tim, the Seeed Contributor:
  • There's an open issue for further extending zephyr support for the camera and microphone on the device tree. https://github.com/zephyrproject-rtos/zephyr/issues/60148 May be worth circling back here once someone has a chance to tackle that issue to further augment it.

How do we work together?

• Leave a comment with your GitHub name below as you accept this assignment and will complete the contents about what we are trying to present.
• The maintainer will assign and record you as our only contact for this assignment.
• You can first Deploy this Wiki Platform Locally (The entire source code .zip file is only 30 M)
• You will be invited as our "Contributor" once you "Pull Request".
• The maintainer will review the PR and then merge.

  What do we offer?

  We want to express our gratitude to our contributors by offering a range of rewards. Depending on the difficulties(Tier 0/1/2/3), the time we expect(Days 1/3/7/15), the actual submission time and the actual submission contents, we will offer different levels of rewards.

  1. We will provide our products or cash bonus to our contributors as a token of appreciation.
  2. For those contributors who join our "Ranger Program"(announced soon), we offer even more exciting rewards, including access to our prototype products.
  3. In addition, all contributors and their contributions will be acknowledged and showcased on our wiki platform.

     FAQ

• For any question, the contributor can directly commend here.

  I think I can complete the assignment, but I need more time?

• The timeframe here is based on our old experience, from people who has done it or something like that.
• However, many projects will take much more time under actual circumstances (including the main language of the contributors receiving the task and the actual creative difficulty)
• You can leave the time you need and a brief reason, we will evaluate the situation accordingly.

[Priyanshu0901]

@MatthewJeffson I would love to take up on this project.

[MatthewJeffson]

NICE, and thank you! @Priyanshu0901

[havoc-dlt]

Any progress on this one? I am kinda torn between waiting for it and trying something myself right now.

[Priyanshu0901]

Yes, still a work in progress (still a bit of testing and documentation is left). ETA 1week.

[havoc-dlt]

Thanks a lot for your effort!

[epc-ake]

Hi, I'm also interested in this. Do you have already something to share?

[MatthewJeffson]

Hi! @epc-ake Yes! Thank you for considering it! @Priyanshu0901 Roy is currently not available on this assignment. If you can help us that would be really great! Here is my Discord account: matthew_yu0310 and we can discuss more on the Discord. Best Regards, Matthew

[bienxanh1901]

Hello Team, Any progress on this task? I can only use Xiao ESP32S3 Sense SD card and Micro on Zephyr. Can you share something about working with camera interface? Can we just only define device tree, or need further work?

Thank you, Hai Pham

[epc-ake]

The problem is that there is currently no driver for the lcd_cam component of the esp32s3. I'm actually writing one now and i already was able to receive some images. However, there are also changes to the DMA driver needed. For those I made a PR yesterday. Once they are merged I'll continue improving the camera driver and make a PR for it as well.

[MatthewJeffson]

Wow! Thank you for the update!

[bienxanh1901]

The problem is that there is currently no driver for the lcd_cam component of the esp32s3. I'm actually writing one now and i already was able to receive some images. However, there are also changes to the DMA driver needed. For those I made a PR yesterday. Once they are merged I'll continue improving the camera driver and make a PR for it as well.

Thank you so much for your hard working @epc-ake!

[epc-ake]

Hi all,

I made two drafts for a pull requests: zephyrproject-rtos/zephyr#75331 and zephyrproject-rtos/zephyr#74974. I can also provide the overlay file needed for the xiao_esp32s3, but I'm not sure where to place it yet. Note the limitations on external memory mentioned in the PR.

Feel free to test it out and leave your comments.

[MatthewJeffson]

Thank you so much! @epc-ake We will check it very soon! Best Regards, Matthew

[pblxptr]

@epc-ake how did it end up? I saw that support for ESP32S3 CAM interface has been merged to mainline, as well as the PR that allows to allocate video buffer in SPIRAM. How you tried to run these changes with xiao_esp32s3? Possibly with streaming cam over WIFI? I tried myself but did not manage to get any sensible results.