googleapis / nodejs-bigquery

Node.js client for Google Cloud BigQuery: A fast, economical and fully-managed enterprise data warehouse for large-scale data analytics.
https://cloud.google.com/bigquery/
Apache License 2.0
467 stars 211 forks source link

feat: clean cached rows and responses after conversion #1393

Closed alvarowolfx closed 3 months ago

alvarowolfx commented 4 months ago

Reduce memory footprint when fetching data.

Tests running query: 'SELECT repository_url as url, repository_owner as owner, repository_forks as forks FROMbigquery-public-data.samples.github_timelinewhere repository_url is not null LIMIT 1000000'

Before change: ~70mb of heap memory usage After change: ~35mb of heap memory usage

Towards #1392