search

mrhan1993 / Fooocus-API

FastAPI powered API for Fooocus
GNU General Public License v3.0
512 stars 137 forks source link

Skip Queue #202

Open arjundheek opened 5 months ago

arjundheek commented 5 months ago

@konieshadow Hello. I really appreciate your work and quick response on the queries. Could you let me know how can I skip the queue if more users try to use replicate at same time? I look forward your reply.

Thankyou..

konieshadow commented 5 months ago

@konieshadow Hello. I really appreciate your work and quick response on the queries. Could you let me know how can I skip the queue if more users try to use replicate at same time? I look forward your reply.

Thankyou..

As far as I understand, Replicate will handle the queue predicted by the model itself. The queue within the project will not actually take effect because a single instance will only process one request at a time.

arjundheek commented 5 months ago

@konieshadow Hello. I really appreciate your work and quick response on the queries. Could you let me know how can I skip the queue if more users try to use replicate at same time? I look forward your reply. Thankyou..

As far as I understand, Replicate will handle the queue predicted by the model itself. The queue within the project will not actually take effect because a single instance will only process one request at a time.

@konieshadow Thankyou for the reply. Do Colab notebook really works if I try to set up? Do colab notebook generates the same output as the replicate platform? I would like to integrate the workflow in my application for personal use. So, Do I have only one option of developing colab notebook or any other way? Plz, Guide me. thankyou

konieshadow commented 5 months ago

@arjundheek The free plan of Google Colab only provide limited RAM (about 15G), it's too low to run this project. Besides this, you can run it on Colab and it will generate same picture as the replicate model (use main branch), but it's not covered by this project's main goals. As I know, the tpc tunnels are highly unstable in Colab now, you may cannot expose the api outesides Colab, but run notebook within Colab is ok.

konieshadow commented 5 months ago

@arjundheek To start the app in notebook, you need to import main.py and run the codes inside "main" function. You may copy and paste these lines in notebook's code block.

arjundheek commented 5 months ago

@konieshadow Thanks Again. I'm trying to set up now and will get back to you if I stuck anywhere while running on colab.