aws-samples / amazon-sagemaker-feature-store-end-to-end-workshop

MIT No Attribution
128 stars 50 forks source link

Add markdown comments about delays between data ingest and athena query for offline store #30

Open pmhargis-aws opened 2 years ago

pmhargis-aws commented 2 years ago

While running notebook that demos adding new features to existing FG, I have noticed multiple times that the Athena query pulls data for the new attribute as "NaN". This is presumably due to an inherent delay between parallel ingest (which goes to Online, then syncs to Offline) and the data landing in Offline store where Athena can query it.