Allow NAN values in input raw data.

facebookresearch / ATEK

Aria Training and Evaluation Kit

Apache License 2.0

13 stars 1 forks source link

Allow NAN values in input raw data. #5

Closed YLouWashU closed 8 months ago

YLouWashU commented 8 months ago

Summary: The ASE-converted datasets have a number of "fake" columns that has NAN values in them, therefore this cleanup_df() function will basically remove everything. I'm wondering if this function is meant to capture any NaN values in specific fields? Happy to add a filtering for these specific fields.

Differential Revision: D53791411

facebook-github-bot commented 8 months ago

This pull request was exported from Phabricator. Differential Revision: D53791411

YLouWashU commented 8 months ago

Abandoning PR. This issue will be resolved elsewhere.