search

pipiku915 / FinMem-LLM-StockTrading

FinMem: A Performance-Enhanced LLM Trading Agent with Layered Memory and Character Design
MIT License
312 stars 73 forks source link

How to get data? #11

Closed NathanWang7 closed 4 months ago

NathanWang7 commented 7 months ago

when running the updated file named "01_SEC_API_10k10q_download.py", it raise FileNotFoundError, saying couldn't find the ' data\03_primary\price_data.parquet' when running the updated file named "04_data_pipeline.py", it got a price file in pkl format, then raise FileNotFoundError, saying couldn't find the './data/filing_data.parquet'

Carolyn-Jiang commented 7 months ago

A new version has just been updated. Please retry it.

NathanWang7 commented 7 months ago

A new version has just been updated. Please retry it.

01_SEC_API_10k1-q_download.py can work in the right way, but 01_Alpaca_News_API_download.py still couldn't work. It also need a file named price_data.parquet, which I have no idea how to get it.

data = pl.read_parquet(os.path.join("data", "03_primary", "price_data.parquet"))

Carolyn-Jiang commented 7 months ago

It is the same as the '1_SEC_API_10k1-q_download.py' code from line 148 to line 159, which is used to get the target ticker as a list of strings.

NathanWang7 commented 7 months ago

It is the same as the '1_SEC_API_10k1-q_download.py' code from line 148 to line 159, which is used to get the target ticker as a list of strings.

No, the '1_SEC_API_10k1-q_download.py' only needs a list of strings, but '01_Alpaca_News_API_download.py' needs a list of tuple, which consist of date and str. The problem is I don't know the structure of data = pl.read_parquet(os.path.join("data", "03_primary", "price_data.parquet")), so I have no idea how to fix it.

betterxujia commented 5 months ago

How can I obtain the ‘price_data.parquet’ file?

betterxujia commented 5 months ago

hi! for "01-Refinitiv_Real_Time_News_download.sql", Where can I find the database for this SQL file, and is there a reference link available?

Carolyn-Jiang commented 5 months ago

Refinitiv Real-Time News is a private dataset of Reuters articles. https://my.refinitiv.com/content/mytr/en/product/thomson-reuters-real-time-news.html

From: betterJia @.> Sent: Saturday, June 1, 2024 2:17:16 PM To: pipiku915/FinMem-LLM-StockTrading @.> Cc: Yuechen Jiang @.>; Comment @.> Subject: Re: [pipiku915/FinMem-LLM-StockTrading] How to get data? (Issue #11)

hi! for "01-Refinitiv_Real_Time_News_download.sql", Where can I find the database for this SQL file, and is there a reference link available?

— Reply to this email directly, view it on GitHubhttps://github.com/pipiku915/FinMem-LLM-StockTrading/issues/11#issuecomment-2143317933, or unsubscribehttps://github.com/notifications/unsubscribe-auth/ANUUDRRJRF4Y5HDOEUU6IX3ZFFROZAVCNFSM6AAAAABFAT4TRWVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMZDCNBTGMYTOOJTGM. You are receiving this because you commented.Message ID: @.***>

Carolyn-Jiang commented 5 months ago

You can obtain the price data via Yahoo Finance using the package “yfinance”.

From: betterJia @.> Sent: Saturday, June 1, 2024 6:02:58 AM To: pipiku915/FinMem-LLM-StockTrading @.> Cc: Yuechen Jiang @.>; Comment @.> Subject: Re: [pipiku915/FinMem-LLM-StockTrading] How to get data? (Issue #11)

How can I obtain the ‘price_data.parquet’ file?

— Reply to this email directly, view it on GitHubhttps://github.com/pipiku915/FinMem-LLM-StockTrading/issues/11#issuecomment-2143035428, or unsubscribehttps://github.com/notifications/unsubscribe-auth/ANUUDRRXT6A74I3RKY4ABD3ZFDXRFAVCNFSM6AAAAABFAT4TRWVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMZDCNBTGAZTKNBSHA. You are receiving this because you commented.Message ID: @.***>

Acatsama0871 commented 4 months ago

no activity, closed