JoshuaMarden / bad_penny

A fledgling project to track and conceptualise the ever-shrinking orbit of the pound around the drain.
0 stars 0 forks source link

Build Ingestion Script For Yahoo Fin. API Data #4

Closed JoshuaMarden closed 1 month ago

JoshuaMarden commented 2 months ago

Build a Rust script that gets the data we want from Yahoo finance, as per our decisions for what should go into the minimum viable product.

Store this data.

Data For Minimum Viable Product

Maybe get the gold price from 1971 smooth it a lot, and then use the 1971 price a benchmark for real value and any increase in price is inflation (assumes Gold hans't changed in value in real terms). As well as using CPI. https://www.chards.co.uk/gold-price/gold-price-history

* For ONS links you can sometimes just put /data at the end of the URL to make an API request.

* To get data from Ofgem website will need to use fantoccini to automate browser clicking and data download.

* Will have to scrape it from Statisa. Go to inspect element, and search '534.2' (debt in 2000/2001) and it will show you the list of figures for each year in the js/css.