File transfer from remote

[Vaibhav51093]

I am using Pyiron for Lammps calculations and I am facing the following problem while job file transfer from the remote.

Later, I figured out that the job is still running, but all the files are transferred to local. In local, I found the following incomplete Lammps log file.

I am using the following command to transfer and monitor the status.

  count = [0]
  for x in count:
    count.append(x+1)
    pr.get_jobs_status(recursive=True)
    if pr.queue_check_job_is_waiting_or_running(job_nvt) == True:
      continue
    else:
      break 
  job_nvt.status.collect=True
  job_nvt.transfer_from_remote()
  job_nvt.compress() 

[jan-janssen]

@Leimeroth Can you help here? I thought we had this fixed that transfer_from_remote() is never called directly by the user.

[Leimeroth]

Right now it is necessary to either downgrade versions or directly use transfer_from_remote() due to #pyiron_base702

I am really confused what this for loop is actually doing though. It is enought to run pr.update_from_remote() and then transfer jobs with status collect and initialized manually

[Leimeroth]

Actually this part

  count = [0]
  for x in count:
    count.append(x+1)
    pr.get_jobs_status(recursive=True)
    if pr.queue_check_job_is_waiting_or_running(job_nvt) == True:
      continue

looks like it will just fill up ram with a completely pointless list until the job is done

[Vaibhav51093]

Okay, I realize the loop is unnecessary, but my goal here is to automatically transmit the files as the jobs are completed.