Closed DaniJonesOcean closed 1 month ago
@eredding02 I can run this notebook on Google Colab with a T4 GPU. It executes without any code errors, but it does run out of ram (This is 15 GB GPU RAM and 12.7 GB CPU/System RAM). Perhaps it could be run with additional GPUs on U-M HPC?
@DaniJonesOcean I still get the same GriddedDataError with that linked notebook.
@eredding02 Ah, okay. I wonder if it's ultimately a memory issue.
A suggestion: In the meantime, perhaps after the individual lake training, you could use the ERA5 sample data and attached notebook to work on the active learning and acquisition function issues:
https://github.com/CIGLR-ai-lab/GreatLakes-TempSensors/issues/24
https://github.com/CIGLR-ai-lab/GreatLakes-TempSensors/issues/25
That might help us get our heads around this issue a bit better.
DJ: Next try running this on U-M HPC (more memory)
Will close for now to refocus, but can open up again if needed
Explanation
The
GriddedDataError: Cannot append to gridded data
error indicates that the greedy algorithm's current implementation doesn't support appending new observations to gridded data structures. This limitation is likely because the data format imposes constraints on how new context points can be added, specifically for non-gridded data structures.Bug Report: Cannot Append to Gridded Data in Active Learning Algorithm
Description
Using the active learning
GreedyAlgorithm
provided indeepsensor
to append new observations to gridded data results in aGriddedDataError
. This suggests that the current implementation does not support modifying gridded data structures dynamically, limiting the algorithm's effectiveness in active learning scenarios involving gridded data.Steps to Reproduce
Set Up Environment:
Active Learning Algorithm:
Error Message
Expected Behavior
The active learning algorithm should support appending new observations to gridded data or handle it in a way that's compatible with gridded datasets.
Suggested Solution
Handle Gridded Data: Modify the
append_obs_to_task
method or the relevant parts of theGreedyAlgorithm
to support appending observations to gridded data.Documentation Improvement: Update the documentation to clearly state any limitations regarding the type of data structures supported by the active learning algorithms, along with possible workarounds for gridded data.
Additional Context
Support for gridded data is essential for many geospatial applications, and providing robust handling of such data structures will enhance the flexibility and applicability of the active learning modules.