mrknorman / gravyflow

TensorFlow tools to facilitate machine learning for gravitational-wave data analysis.
Apache License 2.0
0 stars 1 forks source link

BUG: When generating injections with an injection chance of zero, num_waveforms is sometimes larger than rank 1. #18

Open mrknorman opened 1 week ago

mrknorman commented 1 week ago

I am unsure of what is going on here: /home/michael.norman/miniconda3/envs/gravyflow2/lib/python3.11/site-packages/keras/src/models/functional.py:225: UserWarning: The structure of inputs doesn't match the expected structure: ['ONSOURCE', 'OFFSOURCE']. Received: the structure of inputs={'ONSOURCE': '', 'OFFSOURCE': ''} warnings.warn( Epoch 1/10 3125/3125 ━━━━━━━━━━━━━━━━━━━━ 66s 17ms/step - accuracy: 0.9980 - loss: 0.0042 - val_accuracy: 1.0000 - val_loss: 0.0000e+00 Epoch 2/10 3125/3125 ━━━━━━━━━━━━━━━━━━━━ 46s 15ms/step - accuracy: 1.0000 - loss: 4.5733e-05 - val_accuracy: 1.0000 - val_loss: 0.0000e+00 Epoch 3/10 128/3125 ━━━━━━━━━━━━━━━━━━━━ 23s 8ms/step - accuracy: 0.9999 - loss: 0.0212 2024-10-31 11:27:00.210635: W tensorflow/core/framework/op_kernel.cc:1841] OP_REQUIRES failed at reduction_ops_common.h:147 : INVALID_ARGUMENT: Invalid reduction dimension (0 for input with 0 dimension(s) 2024-10-31 11:27:00.210884: I tensorflow/core/framework/local_rendezvous.cc:405] Local rendezvous is aborting with status: INVALID_ARGUMENT: Invalid reduction dimension (0 for input with 0 dimension(s) INFO:root:Injection generation failed: The truth value of an array with more than one element is ambiguous. Use a.any() or a.all() Traceback: Traceback (most recent call last): File "/home/michael.norman/gravyflow/gravyflow/src/dataset/dataset.py", line 240, in next injections, mask, parameters = next(self.injection_generator( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/michael.norman/gravyflow/gravyflow/src/dataset/features/injection.py", line 810, in call next(iterator) File "/home/michael.norman/gravyflow/gravyflow/src/dataset/features/injection.py", line 899, in generate_one if num_waveforms > 0: ValueError: The truth value of an array with more than one element is ambiguous. Use a.any() or a.all()

132/3125 ━━━━━━━━━━━━━━━━━━━━ 24s 8ms/step - accuracy: 0.9999 - loss: 0.0219 2024-10-31 11:27:00.267997: W tensorflow/core/framework/op_kernel.cc:1829] UNKNOWN: Exception: Traceback (most recent call last):

File "/home/michael.norman/gravyflow/gravyflow/src/dataset/dataset.py", line 240, in next injections, mask, parameters = next(self.injection_generator( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^

File "/home/michael.norman/gravyflow/gravyflow/src/dataset/features/injection.py", line 810, in call next(iterator)

File "/home/michael.norman/gravyflow/gravyflow/src/dataset/features/injection.py", line 899, in generate_one if num_waveforms > 0:

ValueError: The truth value of an array with more than one element is ambiguous. Use a.any() or a.all()

During handling of the above exception, another exception occurred:

Traceback (most recent call last):

File "/home/michael.norman/miniconda3/envs/gravyflow2/lib/python3.11/site-packages/tensorflow/python/ops/script_ops.py", line 269, in call ret = func(*args) ^^^^^^^^^^^ ... injections, mask, parameters = next(self.injection_generator( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ RuntimeError: generator raised StopIteration

Output is truncated. View as a scrollable element or open in a text editor. Adjust cell output settings... Unexpected exception formatting exception. Falling back to standard exception 2024-10-31 11:27:00.432754: W tensorflow/core/framework/op_kernel.cc:1829] UNKNOWN: Exception: Traceback (most recent call last):

File "/home/michael.norman/gravyflow/gravyflow/src/dataset/features/injection.py", line 810, in call next(iterator)

StopIteration

The above exception was the direct cause of the following exception:

Traceback (most recent call last):

File "/home/michael.norman/gravyflow/gravyflow/src/dataset/dataset.py", line 240, in next injections, mask, parameters = next(self.injection_generator( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^

RuntimeError: generator raised StopIteration

During handling of the above exception, another exception occurred:

Traceback (most recent call last): ... injections, mask, parameters = next(self.injection_generator( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ RuntimeError: generator raised StopIteration

Output is truncated. View as a scrollable element or open in a text editor. Adjust cell output settings... 2024-10-31 11:27:00.476142: W tensorflow/core/framework/op_kernel.cc:1829] UNKNOWN: Exception: Traceback (most recent call last):

File "/home/michael.norman/gravyflow/gravyflow/src/dataset/features/injection.py", line 810, in call next(iterator)

StopIteration

The above exception was the direct cause of the following exception:

Traceback (most recent call last):

File "/home/michael.norman/gravyflow/gravyflow/src/dataset/dataset.py", line 240, in next injections, mask, parameters = next(self.injection_generator( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^

RuntimeError: generator raised StopIteration

During handling of the above exception, another exception occurred:

Traceback (most recent call last): ...

Exception