omkarcloud / botasaurus

The All in One Framework to build Awesome Scrapers.
https://www.omkar.cloud/botasaurus/
MIT License
1.16k stars 104 forks source link

dont create temporary files on import botasaurus #38

Closed milahu closed 1 month ago

milahu commented 5 months ago

this should not create any temporary files

import botasaurus

currently, this will create

local_storage.json
output/
profiles/
profiles.json
tasks/
Chetan11-dev commented 1 month ago

Done! Please run the following commands:

python -m pip install bota botasaurus botasaurus_api botasaurus_driver bota botasaurus-proxy-authentication botasaurus_server --upgrade

And read the documentation at https://github.com/omkarcloud/botasaurus.

oseymour commented 1 month ago

I'm still getting output folders created when output=None, even after updating as describe above.

When I run the following code in a Jupyter Notebook for the first time it creates the files and directories @milahu described. If I delete them and re-run the cell they aren't re-made. But any time I restart the kernel and run the cell they get made again.

import botasaurus

@botasaurus.request(output=None, create_error_logs=False)
def task(reqs, data):
    return {}

task()

I have the following versions: image

Chetan11-dev commented 1 month ago

Please run the following commands again:

python -m pip install bota botasaurus botasaurus_api botasaurus_driver bota botasaurus-proxy-authentication botasaurus_server --upgrade
oseymour commented 1 month ago

Seems to be working now! Thank you!

Chetan11-dev commented 1 month ago

Welcome, My Great Joy to help you!