Is your feature request related to a problem? Please describe.
Since we are moving the scraping to the tee-worker, we need to have the Oracle be able to submit requests to the worker to produce the data which is being scraped.
That means that we will have to start both services separately, and the oracle have to accept a configuration setting to point to a tee-worker API endpoint
Describe alternatives you've considered
Additional context
The oracle can return the data both encrypted or decrypted because there are two users of the oracle, the subnet which requires the data to be in encrypted form that has to circulate to the bittensor network, and the users of only the oracle which works directly with decrypted data and do not want to interact anymore with the tee-worker directly.
Acceptance criteria
[ ] The oracle code doesn't scrape anymore directly
[ ] The oracle imports the tee-worker client, and connects to it to scrape the real data
[ ] The oracle have in its setting a way to configure a tee-worker endpoint
[ ] The oracle have in its setting a way to return all encrypted data, or all decrypted data (subnet users, or not)
Is your feature request related to a problem? Please describe. Since we are moving the scraping to the tee-worker, we need to have the Oracle be able to submit requests to the worker to produce the data which is being scraped.
Describe the solution you'd like We want the oracle to consume the tee-worker client here: https://github.com/masa-finance/tee-worker/tree/wip/pkg/client and connect to it instead of scraping directly with the provided scrapers.
That means that we will have to start both services separately, and the oracle have to accept a configuration setting to point to a tee-worker API endpoint
Describe alternatives you've considered
Additional context
The oracle can return the data both encrypted or decrypted because there are two users of the oracle, the subnet which requires the data to be in encrypted form that has to circulate to the bittensor network, and the users of only the oracle which works directly with decrypted data and do not want to interact anymore with the tee-worker directly.
Acceptance criteria