transition-zero / tz-client

A client repository for accessing FEO data programmatically.
https://docs.feo.transitionzero.org
Apache License 2.0
21 stars 4 forks source link

Increase the limit for the amount of records per call #131

Open isabellasoldner opened 4 months ago

isabellasoldner commented 4 months ago

Feature Type

Problem Description

the limit of the number of rows at once isn’t really high enough (~1000) for a “regular” amount of generation data (daily data for a single plant for a couple of years would be a pretty normal usecase). Need to use nextpage function which isn’t really smooth.

records = []
for id in assets.id.unique():
  record_collection = RecordCollection.search(
      id,
      valid_timestamp_start="2023-01-01 00:00:00",
      datum_type=["production"],
      limit=1000
  )
  records.append(record_collection)
records = pd.concat(records)

records = records[records.valid_timestamp_start < "2023-02-15 00:00:00"]

Feature Description

increase the limit