search

dguest / pandamonium

Command line scripts to parse panda web api
BSD 3-Clause "New" or "Revised" License
27 stars 17 forks source link

fix: Replace 'reqid' with 'jeditaskid' for taskid #50

Closed matthewfeickert closed 3 years ago

matthewfeickert commented 3 years ago

Resolves #49

Suggested squash and merge commit message:

* Deprecate and remove 'reqid' in favor 'jeditaskid` given changes in PanDA's behavior
   - Keep 'reqid' only for --more-info option
* Add note to --taskid help information to check the PanDA JEDI docs for more information on JEDITASKID
matthewfeickert commented 3 years ago

@mswiatlo Do you have some current examples that we can use as (manual) API test cases for this PR?

Also, are you using pandamonium installed from the source using Git, or are you installing from PyPI? If PyPI we can cut a patch release once this PR is out so that you can take immediate advantage of this. If through Git then you're obviously just a git pull away.

mswiatlo commented 3 years ago

Thanks @matthewfeickert ! I'm using via git so I'll just pull down the update.

I don't have any good ideas for test cases. The problem is that this is user dependent and time dependent. E.g. when I have failed jobs, I do something like:

pandamon -d 31 -i done -t | panda-resub-taskid -n 1

This requires there be finished jobs that I can then resubmit, and this is how I noticed the problem-- when running the command, I'd get complaints that the tasks I was trying to restart weren't mine.

Sorry to not be any help on that!

matthewfeickert commented 3 years ago

Have you tested all this with some jobs? (i.e. the range of jobs option, the dantrim option, and the "normal" way to do things?)

@dguest 

$ pandamon user.feickert --days 100
done        23224391  100%   user.feickert.364712.Pythia8EvtGen_A14NNPDF23LO_jetjet_JZ12WithSW.e7142_s3126_r10724_p4128._2020-11-17_01-00/ 
done        23224390  100%   user.feickert.364711.Pythia8EvtGen_A14NNPDF23LO_jetjet_JZ11WithSW.e7142_s3126_r10724_p4128._2020-11-17_01-00/ 
done        23224388  100%   user.feickert.364710.Pythia8EvtGen_A14NNPDF23LO_jetjet_JZ10WithSW.e7142_s3126_r10724_p4128._2020-11-17_01-00/ 
done        23224387  100%   user.feickert.364709.Pythia8EvtGen_A14NNPDF23LO_jetjet_JZ9WithSW.e7142_s3126_r10724_p4128._2020-11-17_01-00/ 
done        23224386  100%   user.feickert.364708.Pythia8EvtGen_A14NNPDF23LO_jetjet_JZ8WithSW.e7142_s3126_r10724_p4128._2020-11-17_01-00/ 
done        23224385  100%   user.feickert.364707.Pythia8EvtGen_A14NNPDF23LO_jetjet_JZ7WithSW.e7142_s3126_r10724_p4128._2020-11-17_01-00/ 
done        23224384  100%   user.feickert.364706.Pythia8EvtGen_A14NNPDF23LO_jetjet_JZ6WithSW.e7142_s3126_r10724_p4128._2020-11-17_01-00/ 
done        23224383  100%   user.feickert.364705.Pythia8EvtGen_A14NNPDF23LO_jetjet_JZ5WithSW.e7142_s3126_r10724_p4128._2020-11-17_01-00/ 
done        23224381  100%   user.feickert.364704.Pythia8EvtGen_A14NNPDF23LO_jetjet_JZ4WithSW.e7142_s3126_r10724_p4128._2020-11-17_01-00/ 
done        23224380  100%   user.feickert.364703.Pythia8EvtGen_A14NNPDF23LO_jetjet_JZ3WithSW.e7142_s3126_r10724_p4128._2020-11-17_01-00/ 
done        23224379  100%   user.feickert.364702.Pythia8EvtGen_A14NNPDF23LO_jetjet_JZ2WithSW.e7142_s3126_r10724_p4128._2020-11-17_01-00/ 
done        23224378  100%   user.feickert.364701.Pythia8EvtGen_A14NNPDF23LO_jetjet_JZ1WithSW.e7142_s3126_r10724_p4128._2020-11-17_01-00/ 
done        23224377  100%   user.feickert.364700.Pythia8EvtGen_A14NNPDF23LO_jetjet_JZ0WithSW.e7142_s3126_r10724_p4128._2020-11-17_01-00/ 
done        23224376  100%   user.feickert.364712.Pythia8EvtGen_A14NNPDF23LO_jetjet_JZ12WithSW.e7142_s3126_r10201_p4128._2020-11-17_01-00/ 
done        23224375  100%   user.feickert.364711.Pythia8EvtGen_A14NNPDF23LO_jetjet_JZ11WithSW.e7142_s3126_r10201_p4128._2020-11-17_01-00/ 
done        23224374  100%   user.feickert.364710.Pythia8EvtGen_A14NNPDF23LO_jetjet_JZ10WithSW.e7142_s3126_r10201_p4128._2020-11-17_01-00/ 
done        23224373  100%   user.feickert.364709.Pythia8EvtGen_A14NNPDF23LO_jetjet_JZ9WithSW.e7142_s3126_r10201_p4128._2020-11-17_01-00/ 
done        23224372  100%   user.feickert.364708.Pythia8EvtGen_A14NNPDF23LO_jetjet_JZ8WithSW.e7142_s3126_r10201_p4128._2020-11-17_01-00/ 
done        23224370  100%   user.feickert.364707.Pythia8EvtGen_A14NNPDF23LO_jetjet_JZ7WithSW.e7142_s3126_r10201_p4128._2020-11-17_01-00/ 
done        23224369  100%   user.feickert.364706.Pythia8EvtGen_A14NNPDF23LO_jetjet_JZ6WithSW.e7142_s3126_r10201_p4128._2020-11-17_01-00/ 
done        23224368  100%   user.feickert.364705.Pythia8EvtGen_A14NNPDF23LO_jetjet_JZ5WithSW.e7142_s3126_r10201_p4128._2020-11-17_01-00/ 
done        23224367  100%   user.feickert.364704.Pythia8EvtGen_A14NNPDF23LO_jetjet_JZ4WithSW.e7142_s3126_r10201_p4128._2020-11-17_01-00/ 
done        23224366  100%   user.feickert.364703.Pythia8EvtGen_A14NNPDF23LO_jetjet_JZ3WithSW.e7142_s3126_r10201_p4128._2020-11-17_01-00/ 
done        23224365  100%   user.feickert.364702.Pythia8EvtGen_A14NNPDF23LO_jetjet_JZ2WithSW.e7142_s3126_r10201_p4128._2020-11-17_01-00/ 
done        23224364  100%   user.feickert.364701.Pythia8EvtGen_A14NNPDF23LO_jetjet_JZ1WithSW.e7142_s3126_r10201_p4128._2020-11-17_01-00/ 
done        23224363  100%   user.feickert.364700.Pythia8EvtGen_A14NNPDF23LO_jetjet_JZ0WithSW.e7142_s3126_r10201_p4128._2020-11-17_01-00/ 
done        23224362  100%   user.feickert.364712.Pythia8EvtGen_A14NNPDF23LO_jetjet_JZ12WithSW.e7142_s3126_r9364_p4128._2020-11-17_01-00/ 
done        23224361  100%   user.feickert.364711.Pythia8EvtGen_A14NNPDF23LO_jetjet_JZ11WithSW.e7142_s3126_r9364_p4128._2020-11-17_01-00/ 
done        23224360  100%   user.feickert.364710.Pythia8EvtGen_A14NNPDF23LO_jetjet_JZ10WithSW.e7142_s3126_r9364_p4128._2020-11-17_01-00/ 
done        23224359  100%   user.feickert.364709.Pythia8EvtGen_A14NNPDF23LO_jetjet_JZ9WithSW.e7142_s3126_r9364_p4128._2020-11-17_01-00/ 
done        23224358  100%   user.feickert.364708.Pythia8EvtGen_A14NNPDF23LO_jetjet_JZ8WithSW.e7142_s3126_r9364_p4128._2020-11-17_01-00/ 
done        23224357  100%   user.feickert.364707.Pythia8EvtGen_A14NNPDF23LO_jetjet_JZ7WithSW.e7142_s3126_r9364_p4128._2020-11-17_01-00/ 
done        23224356  100%   user.feickert.364706.Pythia8EvtGen_A14NNPDF23LO_jetjet_JZ6WithSW.e7142_s3126_r9364_p4128._2020-11-17_01-00/ 
done        23224355  100%   user.feickert.364705.Pythia8EvtGen_A14NNPDF23LO_jetjet_JZ5WithSW.e7142_s3126_r9364_p4128._2020-11-17_01-00/ 
done        23224354  100%   user.feickert.364704.Pythia8EvtGen_A14NNPDF23LO_jetjet_JZ4WithSW.e7142_s3126_r9364_p4128._2020-11-17_01-00/ 
done        23224353  100%   user.feickert.364703.Pythia8EvtGen_A14NNPDF23LO_jetjet_JZ3WithSW.e7142_s3126_r9364_p4128._2020-11-17_01-00/ 
done        23224352  100%   user.feickert.364702.Pythia8EvtGen_A14NNPDF23LO_jetjet_JZ2WithSW.e7142_s3126_r9364_p4128._2020-11-17_01-00/ 
done        23224351  100%   user.feickert.364701.Pythia8EvtGen_A14NNPDF23LO_jetjet_JZ1WithSW.e7142_s3126_r9364_p4128._2020-11-17_01-00/ 
done        23224350  100%   user.feickert.364700.Pythia8EvtGen_A14NNPDF23LO_jetjet_JZ0WithSW.e7142_s3126_r9364_p4128._2020-11-17_01-00/ 
$ pandamon user.feickert --days 100 --taskid
23224391
23224390
23224388
23224387
23224386
23224385
23224384
23224383
23224381
23224380
23224379
23224378
23224377
23224376
23224375
23224374
23224373
23224372
23224370
23224369
23224368
23224367
23224366
23224365
23224364
23224363
23224362
23224361
23224360
23224359
23224358
23224357
23224356
23224355
23224354
23224353
23224352
23224351
23224350
$ pandamon user.feickert --days 100 --more-info
done        23224391  14645     100%   0%     user.feickert.364712.Pythia8EvtGen_A14NNPDF23LO_jetjet_JZ12WithSW.e7142_s3126_r10724_p4128._2020-11-17_01-00/ 
done        23224390  14638     100%   0%     user.feickert.364711.Pythia8EvtGen_A14NNPDF23LO_jetjet_JZ11WithSW.e7142_s3126_r10724_p4128._2020-11-17_01-00/ 
done        23224388  14637     100%   0%     user.feickert.364710.Pythia8EvtGen_A14NNPDF23LO_jetjet_JZ10WithSW.e7142_s3126_r10724_p4128._2020-11-17_01-00/ 
done        23224387  14636     100%   0%     user.feickert.364709.Pythia8EvtGen_A14NNPDF23LO_jetjet_JZ9WithSW.e7142_s3126_r10724_p4128._2020-11-17_01-00/ 
done        23224386  14635     100%   0%     user.feickert.364708.Pythia8EvtGen_A14NNPDF23LO_jetjet_JZ8WithSW.e7142_s3126_r10724_p4128._2020-11-17_01-00/ 
done        23224385  14634     100%   0%     user.feickert.364707.Pythia8EvtGen_A14NNPDF23LO_jetjet_JZ7WithSW.e7142_s3126_r10724_p4128._2020-11-17_01-00/ 
done        23224384  14633     100%   0%     user.feickert.364706.Pythia8EvtGen_A14NNPDF23LO_jetjet_JZ6WithSW.e7142_s3126_r10724_p4128._2020-11-17_01-00/ 
done        23224383  14630     100%   0%     user.feickert.364705.Pythia8EvtGen_A14NNPDF23LO_jetjet_JZ5WithSW.e7142_s3126_r10724_p4128._2020-11-17_01-00/ 
done        23224381  14629     100%   0%     user.feickert.364704.Pythia8EvtGen_A14NNPDF23LO_jetjet_JZ4WithSW.e7142_s3126_r10724_p4128._2020-11-17_01-00/ 
done        23224380  14625     100%   0%     user.feickert.364703.Pythia8EvtGen_A14NNPDF23LO_jetjet_JZ3WithSW.e7142_s3126_r10724_p4128._2020-11-17_01-00/ 
done        23224379  14624     100%   0%     user.feickert.364702.Pythia8EvtGen_A14NNPDF23LO_jetjet_JZ2WithSW.e7142_s3126_r10724_p4128._2020-11-17_01-00/ 
done        23224378  14621     100%   0%     user.feickert.364701.Pythia8EvtGen_A14NNPDF23LO_jetjet_JZ1WithSW.e7142_s3126_r10724_p4128._2020-11-17_01-00/ 
done        23224377  14620     100%   0%     user.feickert.364700.Pythia8EvtGen_A14NNPDF23LO_jetjet_JZ0WithSW.e7142_s3126_r10724_p4128._2020-11-17_01-00/ 
done        23224376  14618     100%   0%     user.feickert.364712.Pythia8EvtGen_A14NNPDF23LO_jetjet_JZ12WithSW.e7142_s3126_r10201_p4128._2020-11-17_01-00/ 
done        23224375  14617     100%   0%     user.feickert.364711.Pythia8EvtGen_A14NNPDF23LO_jetjet_JZ11WithSW.e7142_s3126_r10201_p4128._2020-11-17_01-00/ 
done        23224374  14616     100%   0%     user.feickert.364710.Pythia8EvtGen_A14NNPDF23LO_jetjet_JZ10WithSW.e7142_s3126_r10201_p4128._2020-11-17_01-00/ 
done        23224373  14612     100%   0%     user.feickert.364709.Pythia8EvtGen_A14NNPDF23LO_jetjet_JZ9WithSW.e7142_s3126_r10201_p4128._2020-11-17_01-00/ 
done        23224372  14609     100%   0%     user.feickert.364708.Pythia8EvtGen_A14NNPDF23LO_jetjet_JZ8WithSW.e7142_s3126_r10201_p4128._2020-11-17_01-00/ 
done        23224370  14607     100%   0%     user.feickert.364707.Pythia8EvtGen_A14NNPDF23LO_jetjet_JZ7WithSW.e7142_s3126_r10201_p4128._2020-11-17_01-00/ 
done        23224369  14606     100%   0%     user.feickert.364706.Pythia8EvtGen_A14NNPDF23LO_jetjet_JZ6WithSW.e7142_s3126_r10201_p4128._2020-11-17_01-00/ 
done        23224368  14604     100%   0%     user.feickert.364705.Pythia8EvtGen_A14NNPDF23LO_jetjet_JZ5WithSW.e7142_s3126_r10201_p4128._2020-11-17_01-00/ 
done        23224367  14603     100%   0%     user.feickert.364704.Pythia8EvtGen_A14NNPDF23LO_jetjet_JZ4WithSW.e7142_s3126_r10201_p4128._2020-11-17_01-00/ 
done        23224366  14600     100%   0%     user.feickert.364703.Pythia8EvtGen_A14NNPDF23LO_jetjet_JZ3WithSW.e7142_s3126_r10201_p4128._2020-11-17_01-00/ 
done        23224365  14595     100%   0%     user.feickert.364702.Pythia8EvtGen_A14NNPDF23LO_jetjet_JZ2WithSW.e7142_s3126_r10201_p4128._2020-11-17_01-00/ 
done        23224364  14594     100%   0%     user.feickert.364701.Pythia8EvtGen_A14NNPDF23LO_jetjet_JZ1WithSW.e7142_s3126_r10201_p4128._2020-11-17_01-00/ 
done        23224363  14593     100%   0%     user.feickert.364700.Pythia8EvtGen_A14NNPDF23LO_jetjet_JZ0WithSW.e7142_s3126_r10201_p4128._2020-11-17_01-00/ 
done        23224362  14592     100%   0%     user.feickert.364712.Pythia8EvtGen_A14NNPDF23LO_jetjet_JZ12WithSW.e7142_s3126_r9364_p4128._2020-11-17_01-00/ 
done        23224361  14591     100%   0%     user.feickert.364711.Pythia8EvtGen_A14NNPDF23LO_jetjet_JZ11WithSW.e7142_s3126_r9364_p4128._2020-11-17_01-00/ 
done        23224360  14589     100%   0%     user.feickert.364710.Pythia8EvtGen_A14NNPDF23LO_jetjet_JZ10WithSW.e7142_s3126_r9364_p4128._2020-11-17_01-00/ 
done        23224359  14584     100%   0%     user.feickert.364709.Pythia8EvtGen_A14NNPDF23LO_jetjet_JZ9WithSW.e7142_s3126_r9364_p4128._2020-11-17_01-00/ 
done        23224358  14582     100%   0%     user.feickert.364708.Pythia8EvtGen_A14NNPDF23LO_jetjet_JZ8WithSW.e7142_s3126_r9364_p4128._2020-11-17_01-00/ 
done        23224357  14583     100%   0%     user.feickert.364707.Pythia8EvtGen_A14NNPDF23LO_jetjet_JZ7WithSW.e7142_s3126_r9364_p4128._2020-11-17_01-00/ 
done        23224356  14581     100%   0%     user.feickert.364706.Pythia8EvtGen_A14NNPDF23LO_jetjet_JZ6WithSW.e7142_s3126_r9364_p4128._2020-11-17_01-00/ 
done        23224355  14580     100%   0%     user.feickert.364705.Pythia8EvtGen_A14NNPDF23LO_jetjet_JZ5WithSW.e7142_s3126_r9364_p4128._2020-11-17_01-00/ 
done        23224354  14576     100%   0%     user.feickert.364704.Pythia8EvtGen_A14NNPDF23LO_jetjet_JZ4WithSW.e7142_s3126_r9364_p4128._2020-11-17_01-00/ 
done        23224353  14573     100%   0%     user.feickert.364703.Pythia8EvtGen_A14NNPDF23LO_jetjet_JZ3WithSW.e7142_s3126_r9364_p4128._2020-11-17_01-00/ 
done        23224352  14572     100%   0%     user.feickert.364702.Pythia8EvtGen_A14NNPDF23LO_jetjet_JZ2WithSW.e7142_s3126_r9364_p4128._2020-11-17_01-00/ 
done        23224351  14571     100%   0%     user.feickert.364701.Pythia8EvtGen_A14NNPDF23LO_jetjet_JZ1WithSW.e7142_s3126_r9364_p4128._2020-11-17_01-00/ 
done        23224350  14570     100%   0%     user.feickert.364700.Pythia8EvtGen_A14NNPDF23LO_jetjet_JZ0WithSW.e7142_s3126_r9364_p4128._2020-11-17_01-00/