search

magenta / ddsp-vst

Realtime DDSP Neural Synthesizer and Effect
Apache License 2.0
724 stars 72 forks source link

[BUG] VST training collab connects to GDrive but never prompts me to choose a folder #27

Closed rossbalch closed 2 years ago

rossbalch commented 2 years ago

Describe the bug What happened? What did you expect to happen? As described, the script runs, asks me to authorise my Google Drive, but then a prompt never pops up asking me to choose a folder where the file is stored, it just hangs at this point,

System Info

To Reproduce Steps to reproduce the behavior.

Screenshots If you have any, screenshots would be very helpful.

Additional context Anything else we should know?

rossbalch commented 2 years ago

When using the manual upload method training fails with the following output.

Creating dataset... This usually takes around 2-3 minutes for each minute of audio (10 minutes of training audio -> 20-30 minutes)

Training... I0820 05:51:54.979206 140026090964864 ddsp_run.py:179] Restore Dir: ./ddsp-training-2022-08-20-0413 I0820 05:51:54.979590 140026090964864 ddsp_run.py:180] Save Dir: ./ddsp-training-2022-08-20-0413 I0820 05:51:54.979815 140026090964864 resource_reader.py:50] system_path_file_exists:optimization/base.gin E0820 05:51:54.980043 140026090964864 resource_reader.py:55] Path not found: optimization/base.gin I0820 05:51:54.981687 140026090964864 resource_reader.py:50] system_path_file_exists:eval/basic.gin E0820 05:51:54.981898 140026090964864 resource_reader.py:55] Path not found: eval/basic.gin I0820 05:51:54.983518 140026090964864 ddsp_run.py:152] Operative config not found in ./ddsp-training-2022-08-20-0413 I0820 05:51:54.983788 140026090964864 resource_reader.py:50] system_path_file_exists:models/vst/vst.gin E0820 05:51:54.983992 140026090964864 resource_reader.py:55] Path not found: models/vst/vst.gin I0820 05:51:54.988860 140026090964864 resource_reader.py:50] system_path_file_exists:datasets/tfrecord.gin E0820 05:51:54.989081 140026090964864 resource_reader.py:55] Path not found: datasets/tfrecord.gin I0820 05:51:54.989506 140026090964864 resource_reader.py:50] system_path_file_exists:datasets/base.gin E0820 05:51:54.989742 140026090964864 resource_reader.py:55] Path not found: datasets/base.gin I0820 05:51:54.997555 140026090964864 ddsp_run.py:184] Operative Gin Config: import ddsp import ddsp.training as ddsp2

Macros:

==============================================================================

batch_size = 16 evaluators = [@BasicEvaluator] frame_rate = 50 frame_size = 1024 learning_rate = 0.0003 n_samples = 64320 sample_rate = 16000

Parameters for processors.Add:

==============================================================================

processors.Add.name = 'add'

Parameters for Autoencoder:

==============================================================================

Autoencoder.decoder = @decoders.RnnFcDecoder() Autoencoder.encoder = None Autoencoder.losses = [@losses.SpectralLoss()] Autoencoder.preprocessor = @preprocessing.OnlineF0PowerPreprocessor() Autoencoder.processor_group = @processors.ProcessorGroup()

Parameters for Crop:

==============================================================================

Crop.crop_location = 'back' Crop.frame_size = 320

Parameters for evaluate:

==============================================================================

evaluate.batch_size = 32 evaluate.data_provider = @data.TFRecordProvider() evaluate.evaluator_classes = %evaluators evaluate.num_batches = 5

Parameters for FilteredNoise:

==============================================================================

FilteredNoise.n_samples = %n_samples FilteredNoise.name = 'filtered_noise' FilteredNoise.scale_fn = @core.exp_sigmoid FilteredNoise.window_size = 0

Parameters for FilteredNoiseReverb:

==============================================================================

FilteredNoiseReverb.n_filter_banks = 32 FilteredNoiseReverb.n_frames = 500 FilteredNoiseReverb.name = 'reverb' FilteredNoiseReverb.reverb_length = 24000 FilteredNoiseReverb.trainable = True

Parameters for get_model:

==============================================================================

get_model.model = @models.Autoencoder()

Parameters for Harmonic:

==============================================================================

Harmonic.amp_resample_method = 'linear' Harmonic.n_samples = %n_samples Harmonic.name = 'harmonic' Harmonic.normalize_below_nyquist = True Harmonic.sample_rate = %sample_rate Harmonic.scale_fn = @core.exp_sigmoid

Parameters for OnlineF0PowerPreprocessor:

==============================================================================

OnlineF0PowerPreprocessor.compute_f0 = False OnlineF0PowerPreprocessor.compute_power = True OnlineF0PowerPreprocessor.crepe_saved_model_path = None OnlineF0PowerPreprocessor.frame_rate = %frame_rate OnlineF0PowerPreprocessor.frame_size = %frame_size OnlineF0PowerPreprocessor.padding = 'center'

Parameters for ProcessorGroup:

==============================================================================

ProcessorGroup.dag = \ [(@synths.Harmonic(), ['amps', 'harmonic_distribution', 'f0_hz']), (@synths.FilteredNoise(), ['noise_magnitudes']), (@processors.Add(), ['filtered_noise/signal', 'harmonic/signal']), (@effects.FilteredNoiseReverb(), ['add/signal']), (@processors.Crop(), ['reverb/signal'])]

Parameters for RnnFcDecoder:

==============================================================================

RnnFcDecoder.ch = 256 RnnFcDecoder.input_keys = ('pw_scaled', 'f0_scaled') RnnFcDecoder.layers_per_stack = 1 RnnFcDecoder.output_splits = \ (('amps', 1), ('harmonic_distribution', 60), ('noise_magnitudes', 65)) RnnFcDecoder.rnn_channels = 512 RnnFcDecoder.rnn_type = 'gru'

Parameters for sample:

==============================================================================

sample.batch_size = 16 sample.ckpt_delay_secs = 300 sample.data_provider = @data.TFRecordProvider() sample.evaluator_classes = %evaluators sample.num_batches = 1

Parameters for SpectralLoss:

==============================================================================

SpectralLoss.logmag_weight = 1.0 SpectralLoss.loss_type = 'L1' SpectralLoss.mag_weight = 1.0

Parameters for TFRecordProvider:

==============================================================================

TFRecordProvider.centered = True TFRecordProvider.file_pattern = '' TFRecordProvider.frame_rate = 50

Parameters for train:

==============================================================================

train.batch_size = %batch_size train.data_provider = @data.TFRecordProvider() train.num_steps = 30000 train.steps_per_save = 300 train.steps_per_summary = 300

Parameters for Trainer:

==============================================================================

Trainer.checkpoints_to_keep = 3 Trainer.grad_clip_norm = 3.0 Trainer.learning_rate = %learning_rate Trainer.lr_decay_rate = 0.98 Trainer.lr_decay_steps = 10000

I0820 05:51:54.997716 140026090964864 train_util.py:76] Defaulting to MirroredStrategy 2022-08-20 05:51:55.684680: W tensorflow/core/common_runtime/gpu/gpu_bfc_allocator.cc:39] Overriding allow_growth setting because the TF_FORCE_GPU_ALLOW_GROWTH environment variable is set. Original config value was 0. INFO:tensorflow:Using MirroredStrategy with devices ('/job:localhost/replica:0/task:0/device:GPU:0',) I0820 05:51:55.689630 140026090964864 mirrored_strategy.py:374] Using MirroredStrategy with devices ('/job:localhost/replica:0/task:0/device:GPU:0',) Traceback (most recent call last): File "/usr/local/bin/ddsp_run", line 8, in sys.exit(console_entry_point()) File "/usr/local/lib/python3.7/dist-packages/ddsp/training/ddsp_run.py", line 227, in console_entry_point app.run(main) File "/usr/local/lib/python3.7/dist-packages/absl/app.py", line 308, in run _run_main(main, args) File "/usr/local/lib/python3.7/dist-packages/absl/app.py", line 254, in _run_main sys.exit(main(argv)) File "/usr/local/lib/python3.7/dist-packages/ddsp/training/ddsp_run.py", line 202, in main report_loss_to_hypertune=FLAGS.hypertune) File "/usr/local/lib/python3.7/dist-packages/gin/config.py", line 1545, in gin_wrapper new_kwargs = copy.deepcopy(new_kwargs) File "/usr/lib/python3.7/copy.py", line 150, in deepcopy y = copier(x, memo) File "/usr/lib/python3.7/copy.py", line 241, in _deepcopy_dict y[deepcopy(key, memo)] = deepcopy(value, memo) File "/usr/lib/python3.7/copy.py", line 161, in deepcopy y = copier(memo) File "/usr/local/lib/python3.7/dist-packages/gin/config.py", line 778, in deepcopy return self._scoped_configurable_fn() File "/usr/local/lib/python3.7/dist-packages/gin/config.py", line 1605, in gin_wrapper utils.augment_exception_message_and_reraise(e, err_str) File "/usr/local/lib/python3.7/dist-packages/gin/utils.py", line 41, in augment_exception_message_and_reraise raise proxy.with_traceback(exception.traceback) from None File "/usr/local/lib/python3.7/dist-packages/gin/config.py", line 1582, in gin_wrapper return fn(*new_args, *new_kwargs) File "/usr/local/lib/python3.7/dist-packages/gin/config.py", line 516, in meta_call_wrapper return cls_meta.call(new_cls, args, **kwargs) File "/usr/local/lib/python3.7/dist-packages/ddsp/training/data.py", line 216, in init self._file_pattern = file_pattern or self.default_file_pattern File "/usr/local/lib/python3.7/dist-packages/ddsp/training/data.py", line 233, in default_file_pattern 'You must pass a "file_pattern" argument to the constructor or ' NotImplementedError: You must pass a "file_pattern" argument to the constructor or choose a FileDataProvider with a default_file_pattern. In call to configurable 'TFRecordProvider' (<class 'ddsp.training.data.TFRecordProvider'>)

Exporting model... Traceback (most recent call last): File "/usr/local/lib/python3.7/dist-packages/ddsp/training/train_util.py", line 165, in get_latest_operative_config restore_dir, prefix='operative_config-', suffix='.gin') File "/usr/local/lib/python3.7/dist-packages/ddsp/training/train_util.py", line 106, in get_latest_file f'No files found matching the pattern \'{search_pattern}\'.') FileNotFoundError: No files found matching the pattern './ddsp-training-2022-08-20-0413/operative_config-*.gin'.

During handling of the above exception, another exception occurred:

Traceback (most recent call last): File "/usr/local/bin/ddsp_export", line 8, in sys.exit(console_entry_point()) File "/usr/local/lib/python3.7/dist-packages/ddsp/training/ddsp_export.py", line 364, in console_entry_point app.run(main) File "/usr/local/lib/python3.7/dist-packages/absl/app.py", line 308, in run _run_main(main, args) File "/usr/local/lib/python3.7/dist-packages/absl/app.py", line 254, in _run_main sys.exit(main(argv)) File "/usr/local/lib/python3.7/dist-packages/ddsp/training/ddsp_export.py", line 333, in main export_impulse_response(model_path, save_dir, FLAGS.reverb_sample_rate) File "/usr/local/lib/python3.7/dist-packages/ddsp/training/ddsp_export.py", line 272, in export_impulse_response ddsp.training.inference.parse_operative_config(model_path) File "/usr/local/lib/python3.7/dist-packages/ddsp/training/inference.py", line 41, in parse_operative_config operative_config = train_util.get_latest_operative_config(ckpt_dir) File "/usr/local/lib/python3.7/dist-packages/ddsp/training/train_util.py", line 168, in get_latest_operative_config os.path.dirname(restore_dir), prefix='operative_config-', suffix='.gin') File "/usr/local/lib/python3.7/dist-packages/ddsp/training/train_util.py", line 106, in get_latest_file f'No files found matching the pattern \'{search_pattern}\'.') FileNotFoundError: No files found matching the pattern './operative_config-*.gin'. Export complete! Zipping ./ddsp-training-2022-08-20-0413/Dingwall to ./ddsp-training-2022-08-20-0413/Dingwall.zip adding: Dingwall/ (stored 0%) Zipping Complete! Downloading... Dingwall.zip You can also find your model at ./ddsp-training-2022-08-20-0413/Dingwall