search

servantrealestate / Isidore

0 stars 1 forks source link

Proposal for your rate limiter #1

Open starglow-it opened 1 week ago

starglow-it commented 1 week ago

HI Lance, As a developer experienced in web scraping, asynchronous programming, and managing rate limits, I believe I can assist you in ensuring the rate limiter works effectively for your Zillow property data extraction.

I’ve dealt with similar issues before, particularly around balancing the use of sessions, semaphores, and rate limiting in asynchronous environments. Based on your description, I believe the solution lies in adjusting the rate limiter implementation in the rapidapi_client.py and ensuring proper synchronization across requests.

In terms of next steps, I would first analyze how the requests are managed in your sem_process_zip function and the session handling. From there, we can pinpoint why the rate limiter is being ignored and resolve the issue so you can extract data without exceeding the API's rate limits.

I’m confident we can get your application running smoothly and asynchronously without hitting those rate limits. I'm available to start immediately and assist you with this issue.

Looking forward to discussing this further!

Best regards,

lancejohnson commented 1 week ago

Hi there!

Thank you for taking the time to respond to this. Did you apply on Upwork? If so, what is your name so I can reach out to you there. Or your email so we can get a contract started.

JMJ -Lance

On Thursday, September 5, 2024, StarGlow @.***> wrote:

HI Lance, As a developer experienced in web scraping, asynchronous programming, and managing rate limits, I believe I can assist you in ensuring the rate limiter works effectively for your Zillow property data extraction.

I’ve dealt with similar issues before, particularly around balancing the use of sessions, semaphores, and rate limiting in asynchronous environments. Based on your description, I believe the solution lies in adjusting the rate limiter implementation in the rapidapi_client.py and ensuring proper synchronization across requests.

In terms of next steps, I would first analyze how the requests are managed in your sem_process_zip function and the session handling. From there, we can pinpoint why the rate limiter is being ignored and resolve the issue so you can extract data without exceeding the API's rate limits.

I’m confident we can get your application running smoothly and asynchronously without hitting those rate limits. I'm available to start immediately and assist you with this issue.

Looking forward to discussing this further!

Best regards,

— Reply to this email directly, view it on GitHub https://github.com/servantrealestate/Isidore/issues/1, or unsubscribe https://github.com/notifications/unsubscribe-auth/AEHEG7GDTNMAKE66GHEXVPLZVBOYRAVCNFSM6AAAAABNWRTXRSVHI2DSMVQWIX3LMV43ASLTON2WKOZSGUYDOOBXGMZTGMA . You are receiving this because you are subscribed to this thread.Message ID: @.***>