[publicreporting.cftc.gov/6dca-aqww] Up-to-date data inaccessible through filters

stanboc commented 8 months ago

It seems that up-to-date data for each security is not accessible when filters are used.

For example, EURO FX most recent data is dated 2022-09-27 while accessed through the following url: https://publicreporting.cftc.gov/resource/6dca-aqww.json?contract_market_name=EURO%20FX&$select=report_date_as_yyyy_mm_dd Same problem with multiple other securities and when accessed through other filters like "market_and_exchange_names", "contract_market_name", "cftc_contract_market_code" or "contract_units". Any ideas how to deal with this problem ?

andrevdyk commented 8 months ago

You are not pulling the whole dataset it seems, try pulling the whole dataset and sorting it by date. Do you have a limit attribute maybe?

stanboc commented 8 months ago

Hello, I just stopped accessing this data through socrata and now access it directly through the query of cftc website which seems way more efficient. https://publicreporting.cftc.gov/Commitments-of-Traders/Legacy-Futures-Only/6dca-aqww/explore

andrevdyk commented 7 months ago

Oh wow, thank you so much, do you perhaps have a link to TFF that is similar to that?

Because when I try do that for TFF, I get redirected to socrata's page?

Edit: I have found it

socrata / discuss