EveripediaNetwork / issues

Issues repo
9 stars 0 forks source link

Improving the Accuracy of Answers to Wrong Endpoint selecting Questions #1550

Open Softdev1 opened 1 year ago

Softdev1 commented 1 year ago

Description

We need to fix the prompts and descriptions to improve quality of questions such as "Tell me about the founders of Ethereum.", "what is the crypto with most returns during last week".

we need to improve the endpoint selection to make use of endpoints which enable agent to pass in time frame and refine the system around inputing the time .

Goal

To improve answers quality wherever wrong endpoint is chosen by it

s-1-n-t-h commented 1 year ago

keeping track of questions checked 9,10,12,37,48,66,70,75,119,124,147,148,149,150,220,221,434 from sheet https://docs.google.com/spreadsheets/d/1JlhAmf8qxtpdd_JV9ZE9h_wNAeAScN2IwoLENJTc6fM/edit#gid=0 .. some questions are ever loading weirdly

s-1-n-t-h commented 1 year ago

query no:

s-1-n-t-h commented 1 year ago

after a bit of tweak in query and description for the pro endpoint top gainers, it's building query w it, but pinging general API, not the pro endpoint https://api.coingecko.com/api/v3/coins/top_gainers_losers?vs_currency=usd&duration=1d&top_coins=300, it should be smtg like this https://pro-api.coingecko.com/api/v3/coins/top_gainers_losers?vs_currency=usd&duration=1h&top_coins=300&x_cg_pro_api_key={YOUR_KEY}" @Royal-lobster

query: What are today's top gaining cryptocurrencies with under $100 million market branch: wrong_endpoint_summaries

Royal-lobster commented 1 year ago

If you are seeing the endpoint url in logs without pro- at start, then its cuz we are just removing it and logging. we are doing this because with pro- at start you need to have auth token in header which won't be handy to just click on the url from terminal and checking from browser for non pro endpoints.

But we do pinging all pro/non pro endpoints to pro-api.coingecko.com and including api key in header on backend. there should not be a issue if the url path is fine.

s-1-n-t-h commented 1 year ago

If you are seeing the endpoint url in logs without pro- at start, then its cuz we are just removing it and logging. we are doing this because with pro- at start you need to have auth token in header which won't be handy to just click on the url from terminal and checking from browser for non pro endpoints.

But we do pinging all pro/non pro endpoints to pro-api.coingecko.com and including api key in header on backend. there should not be a issue if the url path is fine.

Screenshot 2023-07-24 at 16 53 36

it's hard to debug that way

Royal-lobster commented 1 year ago

If you are seeing the endpoint url in logs without pro- at start, then its cuz we are just removing it and logging. we are doing this because with pro- at start you need to have auth token in header which won't be handy to just click on the url from terminal and checking from browser for non pro endpoints. But we do pinging all pro/non pro endpoints to pro-api.coingecko.com and including api key in header on backend. there should not be a issue if the url path is fine.

Screenshot 2023-07-24 at 16 53 36

it's hard to debug that way

Only for pro endpoints, we have 2 pro endpoints currently integrated vs 25 or so normal endpoints, for pro endpoints, we can just click it to open in browser since it will ask auth token in header, you have to do it in thunder client anyway. so we are removing the pro and logging, and sending as source to client.

But the rule is in backend, we are using pro- endpoints for all with auth token in header.

s-1-n-t-h commented 1 year ago

IQ-GPT Ver [8758e54]

-9 What is the percentage difference in price between Bitcoin on Upbit and Binance. -10. What is the percentage difference in price between Ethereum on Upbit and Binance. -13. What is the price difference between Bitcoin on Upbit and Binance? -15. Create a list with the top five cryptocurrencies which have the greatest percentage price differential between Upbit and Coinbase? -26. Create a list of the five cryptocurrencies with the greatest percentage price differential between Upbit and Binance? -37&38. what was the first NFT ever created? - this has wright answer, but most accurate endpoint is not shown - needs to put most accurate end point as first source without requiring to check more sources i think -48. Which memecoins saw the greatest rise this week? -49. Which coin has the most significant jump in price after ICO? - too complex i think -116. Tell me about the founders of Ethereum. - some founders data isn't shown and inaccurate endpoint as primary source -119. Create a list of the five cryptocurrencies with the greatest percentage price differential between Upbit and Binance? -150. Please retrieve the current exchange rates for 1 BTC (Bitcoin) and 1 ETH (Ethereum). Utilizing the obtained data, calculate the amount of BTC that can be purchased with 1 ETH. -434. Who founded Binance? - answer is wright but, primary source is incorrect

@Royal-lobster , @Yadheedhya06

Royal-lobster commented 1 year ago

Nice ! Do proceed to fixing them, I think exchanges can be fixed with exchanges endpoint.

s-1-n-t-h commented 1 year ago

Nice ! Do proceed to fixing them, I think exchanges can be fixed with exchanges endpoint.

yeah there are a bunch of them, check this : wrong api endpoint built https://api.coingecko.com/api/v3/simple/price?ids=ethereum&vs_currencies=usd&include_last_updated_at=true, should pick https://api.coingecko.com/api/v3/exchanges/binance/tickers?coin_ids=etherem & https://api.coingecko.com/api/v3/exchanges/upbit/tickers?coin_ids=ethereum, pick "last" attr and later calculate price difference

Royal-lobster commented 1 year ago

Nice ! Do proceed to fixing them, I think exchanges can be fixed with exchanges endpoint.

yeah there are a bunch of them, check this : wrong api endpoint built https://api.coingecko.com/api/v3/simple/price?ids=ethereum&vs_currencies=usd&include_last_updated_at=true, should pick https://api.coingecko.com/api/v3/exchanges/binance/tickers?coin_ids=etherem & https://api.coingecko.com/api/v3/exchanges/upbit/tickers?coin_ids=ethereum, pick "last" attr and later calculate price difference

Oh yes ! its expected way. also lets split the issue if there are a lot of endpoints selection issues,

Some issues I can see:

s-1-n-t-h commented 11 months ago

Image Image Image Image