search

espressif / esp-hosted

Hosted Solution (Linux/MCU) with ESP32 (Wi-Fi + BT + BLE)
Other
668 stars 152 forks source link

esp_as_mcu_host SOP needed #462

Open Speakpig opened 3 weeks ago

Speakpig commented 3 weeks ago

I am new to ESP, I want to test the branch esp_as_mcu_host instance with two ESP-C3 development boards in my hands. Having read the introduction of the file for the specific operation steps , I am still very confused how to start. My computer has installed ESP-IDF, and can normally use CMD related commands, the following are my detailed questions:

  1. Do I need to create the host ESP-IDF project or use the host folder. If I do, how to create? And when shall I use the following instruction?

idf.py add-dependency "espressif/esp_wifi_remote" idf.py add-dependency "espressif/esp_hosted"

  1. Similarly, how do I create a slave ESP-IDF project? How to use slave folder? And when to use the following instruction?

idf.py create-project-from-example espressif/esp_hosted:slave

mantriyogesh commented 3 weeks ago

@SohKamYung-Espressif ++

SohKamYung-Espressif commented 3 weeks ago

Hello @Speakpig

I will take a look at steps needed to get you going. We usually target the esp_as_mcu_host branch for people who are using two different ESP chips as the host and slave. Using ESP32-C3s as both the host and slave wasn't considered, so some testing needs to be done to see if this is possible.

I am new to ESP

As a start, you can familiarise yourself with ESP-IDF first. You can look through the ESP-IDF examples/wifi/ folder for Wi-Fi examples, build them for one C3 first to see how Wi-Fi works on ESP.

Speakpig commented 3 weeks ago

Thanks for ur tips, I basically understand the WI-FI examples, I just never really built a prj based on this branch, so I acctually want more to know how to practice, I will be waiting for ur further advice, much thanks.

Speakpig commented 3 weeks ago

Now I am eager to know how to create a host project, can you tell me how to get started?More specifically: How to organize the file structure in this repository to form a host project involving the mentioned CMakeLists.txt, idf_component.yml and the host folder?

SohKamYung-Espressif commented 3 weeks ago

The steps to create a host under ESP-Hosted are covered in Section 3 of the readme [ https://github.com/espressif/esp-hosted/tree/feature/esp_as_mcu_host?tab=readme-ov-file#3-preparing-the-host-to-use-esp-hosted ].

For example, suppose you want to convert the ESP-IDF examples/wifi/scan to use ESP-Hosted. Inside that directory, you run:

idf.py add-dependency "espressif/esp_wifi_remote"
idf.py add-dependency "espressif/esp_hosted"

If you do ls (to list the directory), you will now find a new managed_components directory. Inside that directory, you will find two subdirectories, espressif__esp_wifi_remote and espressif__esp_hosted.

You will also find a idf_component.yml file in the main subdirectory which will show that the project now depends on those two components. You do not need to edit or change the file.

That is all that is needed to add ESP-Hosted to your project as a host. However, there is one further step, 3.2. Disabling Native Wi-Fi Support, which does not work for you because you want to use a ESP32-C3 as both a host and a slave device under ESP-Hosted. I will need some time to work on this so you can use a ESP32-C3 as the host.

Similarly, how do I create a slave ESP-IDF project? How to use slave folder? And when to use the following instruction? "idf.py create-project-from-example espressif/esp_hosted:slave"

For this step, go to an empty directory and run

idf.py create-project-from-example espressif/esp_hosted:slave

This will create the ESP-Hosted slave project. Configure the target device (as ESP32-C3) and build it like you use any other ESP-IDF project. This is the code that will be flashed to the ESP32-C3 that will act as the slave under ESP-Hosted.

Speakpig commented 3 weeks ago

Thanks a lot, this is so detailed for me, but I still have one big doubt: the "host" and "slave" folders in this branch are not envolved in the opration u mentioned, how is this working?

Speakpig commented 3 weeks ago

the "host" and "slave" folders in this branch are not envolved in the opration u mentioned, how is this working?

Should I do some replacements inside that directory formed by instuctions using the host or slave folder or something like that？

SohKamYung-Espressif commented 3 weeks ago

the "host" and "slave" folders in this branch are not envolved in the opration u mentioned, how is this working?

I'm not sure what you mean. Would the diagram from the README, help to make this clearer:

https://github.com/espressif/esp-hosted/raw/feature/esp_as_mcu_host/docs/images/hosted_diagram-ditaa.svg

For 'host', ESP-Hosted is the ESP Host Driver. It is meant to be used as an component that is added to your host code that requires Wi-Fi access.

For 'slave' under ESP-Hosted, there should be a slave folder created in the empty directory. This is the complete code that runs on the slave.

You should not need to replace or add any host folders. When building your host code, ESP-IDF will detect the presence of the components in managed_components and use them if required.

I should add that the managed_components folder appears after you run idf.py set-target esp32c3 in your host project.

Does this link help to make it clearer? IDF Component Manager

SohKamYung-Espressif commented 3 weeks ago

the "host" and "slave" folders in this branch are not envolved in the opration u mentioned, how is this working?

I think I understand your question now. You are asking how the esp_as_mcu_host github branch is related to the steps to add the ESP-Hosted component to the host code and getting the slave project?

It is a bit of GitHub and ESP-IDF Component Manager 'magic'. When triggered, the IDF Component Manager packages the ESP-Hosted code from github and makes a release. This release is fetch from the IDF Component Manager when you run idf.py add-dependency and idf.py create-project-from-example.

SohKamYung-Espressif commented 3 weeks ago

how should these two folders be made use of, I believe they are not mentioned in ur clarification which must be useful in some way?

The code on github is meant more for ESP-Hosted developers. You don't have to do git clone to use ESP-Hosted. IDF Component Manager takes care of fetching the code and putting it in the correct place for host and slave.

A bit more detail: the code in managed_components/espressif__esp_hosted is a copy of the esp_as_mcu_host branch. When you do idf.py create-project-from-example, it creates a copy of the code in the slave directory you see in the esp_as_mcu_host branch.

Speakpig commented 3 weeks ago

Thx, I just missed the new comment befor asking, I deleted last msg, I now have got it! Problem solved, that's so kind of you! But this leads me to a new one:

When you do idf.py create-project-from-example, it creates a copy of the code in the slave directory you see in the esp_as_mcu_host branch.

Is this copy from esp_as_mcu_host branch or master?

SohKamYung-Espressif commented 3 weeks ago

Is this copy from esp_as_mcu_host branch or master?

From the esp_as_mcu_host branch.

Speakpig commented 3 weeks ago

Why not from a specified tag or release version?

Speakpig commented 3 weeks ago

However, there is one further step, 3.2. Disabling Native Wi-Fi Support, which does not work for you because you want to use a ESP32-C3 as both a host and a slave device under ESP-Hosted. I will need some time to work on this so you can use a ESP32-C3 as the host.

When coming to this, why shall I do step 3.2 by:

To do this, edit the ESP-IDF components/soc/<host soc>/include/soc/Kconfig.soc_caps.in file and change all WIFI related configs to n.

Can I configure this by modify sdkconfig and rebuild the project or directly modify sdkconfig.h in directory build\config\sdkconfig.h?

SohKamYung-Espressif commented 3 weeks ago

Why not from a specified tag or release version?

As mentioned, there is some 'magic' in the background that tells the IDF Component Manager to do a release from the GitHub source.

If you check the IDF Component Page for ESP-Hosted https://components.espressif.com/components/espressif/esp_hosted/ there are various version releases, currently at 0.0.9. Each release is linked to a particular commit in the GitHub repository.

SohKamYung-Espressif commented 3 weeks ago

Can I configure this by modify sdkconfig and rebuild the project or directly modify sdkconfig.h in directory build\config\sdkconfig.h?

I have not looked at this option yet due to other work. You are welcome to try, but I don't know what the results will be.

Speakpig commented 3 weeks ago

Thx, as now you are sure about ESP32-C3 is not available for host, I will waiting ur further sugguestion meanwhile I wil be trying meself, thanks a lot!

SohKamYung-Espressif commented 3 weeks ago

Thx, as now you are sure about ESP32-C3 is not available for host

For now, until I have some time to look at it.

Do you have another ESP32-x (not a C3) which can be used as the host?

Speakpig commented 3 weeks ago

Sry, two C3s are all I got, and I have done prepared host and slave projects and connected the C3s refering to #186 , ready to go, but waiting for more guidance, am I doing right for now? image

Btw, I'm using example/wifi/iperf for the host prj as the test sample.

HP4LEVI commented 3 weeks ago

@Speakpig 您好，请问您的host主机工程编译通过了吗？

Speakpig commented 3 weeks ago

@HP4LEVI Yes, it has passed the build process.

SohKamYung-Espressif commented 3 weeks ago

Yes, it has passed the build process.

Did you build the code for host after you did this:

Can I configure this by modify sdkconfig and rebuild the project or directly modify sdkconfig.h in directory build\config\sdkconfig.h?

HP4LEVI commented 3 weeks ago

你好，能说明一下您的编译操作吗？我的编译显示配置文件有问题，但我的配置文件打不开。

Speakpig commented 3 weeks ago

I am using the VSCode extension for IDF, in the configure page(PIC 1), no configs like SOC_WIFI_xxx were found, so I haven't done that yet, but I am about to try modify the sdkconfig.h directly, there were 10 related(PIC 4) configs found in each two files(one under directory build\bootloader PIC 2,one under directory buildPIC 3), I'm not sure which to modify and if it's ok doing so. image image image image

Speakpig commented 3 weeks ago

你好，能说明一下您的编译操作吗？我的编译显示配置文件有问题，但我的配置文件打不开。

Have u formed ur host project? Then I did this using VSCode extension for IDF as below. image

HP4LEVI commented 3 weeks ago
Snipaste_2024-08-21_17-40-03

我直接使用vscode打开了这个文件，然后进行了组件下载，这样对吗？

Snipaste_2024-08-21_17-41-11
Speakpig commented 3 weeks ago

@HP4LEVI We were doing it quite the same, I just opened the host prj, and then just built it, all things were done automatically, it should be ok, I don't know what u are running into, what's the problem？How did u download the components manually, cause it's all automatical when I build it.

HP4LEVI commented 3 weeks ago
Snipaste_2024-08-21_17-46-48

我甚至都不能打开配置文件

Speakpig commented 3 weeks ago

but I am about to try modify the sdkconfig.h directly, there were 10 related(PIC 4) configs found in each two files(one under directory build\bootloader PIC 2,one under directory buildPIC 3), I'm not sure which to modify and if it's ok doing so.

@SohKamYung-Espressif If I want to do this, what is ur suggestion？Which file or both shall be changed out of the best consideration? Thanks a lot.

SohKamYung-Espressif commented 3 weeks ago

@Speakpig Sorry, I can't make any suggestions now, as I haven't tried it yet.

I have to work on another task first.

Speakpig commented 3 weeks ago

Thanks, I will try myself first, but if u got any progress in C3 as host, let me know, much thanks.

mantriyogesh commented 3 weeks ago

Although it is not a fix but it could be treated a workaround to just get you going:

1. Slave C3 flashing

2. Host C3 flashing

[!Note] These steps might only be required if you have same chipset type as host and slave ESP In other normal cases, these steps not required

Can you please check if this works for you?

Speakpig commented 3 weeks ago

@mantriyogesh I entirly got u, I should edit the local ESP-IDF repo applying 3.2 Disabling Native Wi-Fi Support after I built the slave, which may causing incorrect slave project, but I have to do this for host, right? My confusion is can I do this as below when configuring host prj, which is more convenient for the same chipset type as host and slave ESP as I doubt before?

but I am about to try modify the sdkconfig.h directly, there were 10 related(PIC 4) configs found in each two files(one under directory build\bootloader PIC 2,one under directory buildPIC 3), I'm not sure which to modify and if it's ok doing so.

Speakpig commented 3 weeks ago

And as it is mentioned by SohKamYung, specificly what is the reason C3 could not be a host? Is it like that when using another slave chip, C3 could be a host? So it is just a matter of configuration, right?

which does not work for you because you want to use a ESP32-C3 as both a host and a slave device under ESP-Hosted

mantriyogesh commented 3 weeks ago

sdkconfig.h cannot be changed, it is generated file and some of the configuration would still be loaded assuming wifi is enabled, which is not really correct. Some of the components might still think that the wifi is available.

Instead, I would really keep different directories for host and slave. And use above comment to evaluate.

As IDF changes would be done, 

1. rm -rf sdkconfig build
2. Change IDF source as your needs
3. idf.py -p <usb_port> set-target esp32c3 # sdkconfig.h generated here
4. idf.py -p <usb_port> flash monitor

This would make sure the sdkconfig.h is correctly co-related with all configurations.

mantriyogesh commented 3 weeks ago

C3 or for that matter, any ESP chipset can be used as host. Problem right now you face is both conditions satisfied at the same time:

  1. slave and host is same type of chipset
  2. Host chipset already supports wifi natively
Speakpig commented 3 weeks ago

@mantriyogesh OK, I will try and let u know, thx.

SohKamYung-Espressif commented 2 weeks ago

@Speakpig I have taken a look and the solution proposed by @mantriyogesh in https://github.com/espressif/esp-hosted/issues/462#issuecomment-2303465083 is the solution that works for your case.

My attempts at resolving it by modifying the sdkconfig.default file for the host did not work. And as Yogesh as mentioned, modifying the generated sdkconfig.h file may not work as expected.