dandi / dandi-api-webshots-tools

0 stars 0 forks source link

need to wait more for login button to appear? #6

Closed yarikoptic closed 2 years ago

yarikoptic commented 2 years ago

fresh fail on prs webshotting:

Your branch is up to date with 'origin/pr-857'.                                                                                                                                                                                                                                                                                                                                                                                                                                                                                        
2021-09-22T18:05:16-0400 [INFO    ] 8299 000001 landing                                                                                                                                                                                                                                                                                                                                                                                                                                                                                
2021-09-22T18:05:25-0400 [INFO    ] 8299 000001 edit-metadata                                                                                                                                                                                                                                                                                                                                                                                                                                                                          
2021-09-22T18:05:35-0400 [INFO    ] 8299 000001 view-data                                                                                                                                                                                                                                                                                                                                                                                                                                                                              
2021-09-22T18:05:45-0400 [INFO    ] 8299 000002 landing                                                                                                                                                                                                                                                                                                                                                                                                                                                                                
2021-09-22T18:05:55-0400 [INFO    ] 8299 000002 edit-metadata                                                                                                                                                                                                                                                                                                                                                                                                                                                                          
2021-09-22T18:06:05-0400 [INFO    ] 8299 000002 view-data                                                                                                                                                                                                                                                                                                                                                                                                                                                                              
2021-09-22T18:06:13-0400 [INFO    ] 8299 000003 landing                                                                                                                                                                                                                                                                                                                                                                                                                                                                                
2021-09-22T18:06:23-0400 [INFO    ] 8299 000003 edit-metadata                                                                                                                                                                                                                                                                                                                                                                                                                                                                          
2021-09-22T18:06:33-0400 [INFO    ] 8299 000003 view-data                                                                                                                                                                                                                                                                                                                                                                                                                                                                              
2021-09-22T18:06:43-0400 [INFO    ] 8299 000004 landing                                                                                                                                                                                                                                                                                                                                                                                                                                                                                
2021-09-22T18:06:52-0400 [INFO    ] 8299 000004 edit-metadata                                                                                                                                                                                                                                                                                                                                                                                                                                                                          
2021-09-22T18:07:04-0400 [INFO    ] 8299 000004 view-data                                                                                                                                                                                                                                                                                                                                                                                                                                                                              
2021-09-22T18:07:13-0400 [INFO    ] 8299 000005 landing                                                                                                                                                                                                                                                                                                                                                                                                                                                                                
2021-09-22T18:07:22-0400 [INFO    ] 8299 000005 edit-metadata                                                                                                                                                                                                                                                                                                                                                                                                                                                                          
2021-09-22T18:07:33-0400 [INFO    ] 8299 000005 view-data                                                                                                                                                                                                                                                                                                                                                                                                                                                                              
2021-09-22T18:07:42-0400 [INFO    ] 8299 000006 landing                                                                                                                                                                                                                                                                                                                                                                                                                                                                                
2021-09-22T18:07:51-0400 [INFO    ] 8299 000006 edit-metadata                                                                                                                                                                                                                                                                                                                                                                                                                                                                          
2021-09-22T18:08:00-0400 [INFO    ] 8299 000006 view-data                                                                                                                                                                                                                                                                                                                                                                                                                                                                              
2021-09-22T18:08:09-0400 [INFO    ] 8299 000007 landing                                                                                                                                                                                                                                                                                                                                                                                                                                                                                
2021-09-22T18:08:19-0400 [INFO    ] 8299 000007 edit-metadata                                                                                                                                                                                                                                                                                                                                                                                                                                                                          
2021-09-22T18:08:30-0400 [INFO    ] 8299 000007 view-data                                                                                                                                                                                                                                                                                                                                                                                                                                                                              
2021-09-22T18:08:39-0400 [INFO    ] 8299 000008 landing                                                                                                                                                                                                                                                                                                                                                                                                                                                                                
2021-09-22T18:08:47-0400 [INFO    ] 8299 000008 edit-metadata                                                                                                                                                                                                                                                                                                                                                                                                                                                                          
2021-09-22T18:08:57-0400 [INFO    ] 8299 000008 view-data                                                                                                                                                                                                                                                                                                                                                                                                                                                                              
2021-09-22T18:09:06-0400 [INFO    ] 8299 000009 landing                                                                                                                                                                                                                                                                                                                                                                                                                                                                                
2021-09-22T18:09:15-0400 [INFO    ] 8299 000009 edit-metadata                                                                                                                                                                                                                                                                                                                                                                                                                                                                          
2021-09-22T18:09:25-0400 [INFO    ] 8299 000009 view-data                                                                                                                                                                                                                                                                                                                                                                                                                                                                              
2021-09-22T18:09:34-0400 [INFO    ] 8299 000010 landing                                                                                                                                                                                                                                                                                                                                                                                                                                                                                
2021-09-22T18:09:42-0400 [INFO    ] 8299 000010 edit-metadata                                                                                                                                                                                                                                                                                                                                                                                                                                                                          
2021-09-22T18:09:52-0400 [INFO    ] 8299 000010 view-data                                                                                                                                                                                                                                                                                                                                                                                                                                                                              
2021-09-22T18:10:03-0400 [INFO    ] 8299 000011 landing                                                                                                                                                                                                                                                                                                                                                                                                                                                                                
2021-09-22T18:10:11-0400 [INFO    ] 8299 000011 edit-metadata                                                                                                                                                                                                                                                                                                                                                                                                                                                                          
2021-09-22T18:10:21-0400 [INFO    ] 8299 000011 view-data                                                                                                                                                                                                                                                                                                                                                                                                                                                                              
2021-09-22T18:10:32-0400 [INFO    ] 8299 000012 landing                                                                                                                                                                                                                                                                                                                                                                                                                                                                                
2021-09-22T18:10:41-0400 [INFO    ] 8299 000012 edit-metadata                                                                                                                                                                                                                                                                                                                                                                                                                                                                          
2021-09-22T18:10:51-0400 [INFO    ] 8299 000012 view-data                                                                                                                                                                                                                                                                                                                                                                                                                                                                              
2021-09-22T18:11:00-0400 [INFO    ] 8299 000013 landing                                                                                                                                                                                                                                                                                                                                                                                                                                                                                
2021-09-22T18:11:08-0400 [INFO    ] 8299 000013 edit-metadata                                                                                                                                                                                                                                                                                                                                                                                                                                                                          
2021-09-22T18:11:18-0400 [INFO    ] 8299 000013 view-data                                                                                                                                                                                                                                                                                                                                                                                                                                                                              
2021-09-22T18:11:27-0400 [INFO    ] 8299 000014 landing                                                                                                                                                                                                                                                                                                                                                                                                                                                                                
2021-09-22T18:11:37-0400 [INFO    ] 8299 000014 edit-metadata                                                                                                                                                                                                                                                                                                                                                                                                                                                                          
2021-09-22T18:11:47-0400 [INFO    ] 8299 000014 view-data                                                                                                                                                                                                                                                                                                                                                                                                                                                                              
2021-09-22T18:11:56-0400 [INFO    ] 8299 000015 landing                                                                                                                                                                                                                                                                                                                                                                                                                                                                                
2021-09-22T18:12:05-0400 [INFO    ] 8299 000015 edit-metadata                                                                                                                                                                                                                                                                                                                                                                                                                                                                          
2021-09-22T18:12:18-0400 [INFO    ] 8299 000015 view-data                                                                                                                                                                                                                                                                                                                                                                                                                                                                              
2021-09-22T18:12:27-0400 [INFO    ] 8299 000016 landing                                                                                                                                                                                                                                                                                                                                                                                                                                                                                
2021-09-22T18:12:36-0400 [INFO    ] 8299 000016 edit-metadata                                                                                                                                                                                                                                                                                                                                                                                                                                                                          
2021-09-22T18:12:47-0400 [INFO    ] 8299 000016 view-data                                                                                                                                                                                                                                                                                                                                                                                                                                                                              
2021-09-22T18:12:56-0400 [INFO    ] 8299 000017 landing                                                                                                                                                                                                                                                                                                                                                                                                                                                                                
2021-09-22T18:13:05-0400 [INFO    ] 8299 000017 edit-metadata                                                                                                                                                                                                                                                                                                                                                                                                                                                                          
2021-09-22T18:13:15-0400 [INFO    ] 8299 000017 view-data                                                                                                                                                                                                                                                                                                                                                                                                                                                                              
2021-09-22T18:13:24-0400 [INFO    ] 8299 000018 landing                                                                                                                                                                                                                                                                                                                                                                                                                                                                                
2021-09-22T18:13:32-0400 [INFO    ] 8299 000018 edit-metadata                                                                                                                                                                                                                                                                                                                                                                                                                                                                          
2021-09-22T18:13:42-0400 [INFO    ] 8299 000018 view-data                                                                                                                                                                                                                                                                                                                                                                                                                                                                              
2021-09-22T18:13:51-0400 [INFO    ] 8299 000019 landing                                                                                                                                                                                                                                                                                                                                                                                                                                                                                
2021-09-22T18:13:59-0400 [INFO    ] 8299 000019 edit-metadata                                                                                                                                                                                                                                                                                                                                                                                                                                                                          
2021-09-22T18:14:09-0400 [INFO    ] 8299 000019 view-data                                                                                                                                                                                                                                                                                                                                                                                                                                                                              
2021-09-22T18:14:18-0400 [INFO    ] 8299 000020 landing                                                                                                                                                                                                                                                                                                                                                                                                                                                                                
2021-09-22T18:14:27-0400 [INFO    ] 8299 000020 edit-metadata                                                                                                                                                                                                                                                                                                                                                                                                                                                                          
2021-09-22T18:15:39-0400 [INFO    ] 8299 000021 landing                                                                                                                                                                                                                                                                                                                                                                                                                                                                                
2021-09-22T18:15:48-0400 [INFO    ] 8299 000021 edit-metadata                                                                                                                                                                                                                                                                                                                                                                                                                                                                          
2021-09-22T18:15:57-0400 [INFO    ] 8299 000021 view-data                                                                                                                                                                                                                                                                                                                                                                                                                                                                              
concurrent.futures.process._RemoteTraceback:                                                                                                                                                                                                                                                                                                                                                                                                                                                                                           
"""                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                    
Traceback (most recent call last):                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                     
  File "/home/dandi/miniconda3/lib/python3.8/concurrent/futures/process.py", line 239, in _process_worker                                                                                                                                                                                                                                                                                                                                                                                                                              
    r = call_item.fn(*call_item.args, **call_item.kwargs)                                                                                                                                                                                                                                                                                                                                                                                                                                                                              
  File "/home/dandi/miniconda3/lib/python3.8/concurrent/futures/process.py", line 198, in _process_chunk                                                                                                                                                                                                                                                                                                                                                                                                                               
    return [fn(*args) for args in chunk]                                                                                                                                                                                                                                                                                                                                                                                                                                                                                               
  File "/home/dandi/miniconda3/lib/python3.8/concurrent/futures/process.py", line 198, in <listcomp>                                                                                                                                                                                                                                                                                                                                                                                                                                   
    return [fn(*args) for args in chunk]                                                                                                                                                                                                                                                                                                                                                                                                                                                                                               
  File "tools/make_webshots.py", line 263, in snapshot_page                                                                                                                                                                                                                                                                                                                                                                                                                                                                            
    with Webshotter(gui_url) as ws:                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                    
  File "tools/make_webshots.py", line 69, in __init__                                                                                                                                                                                                                                                                                                                                                                                                                                                                                  
    self.set_driver()                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                  
  File "tools/make_webshots.py", line 89, in set_driver                                                                                                                                                                                                                                                                                                                                                                                                                                                                                
    self.login(os.environ["DANDI_USERNAME"], os.environ["DANDI_PASSWORD"])                                                                                                                                                                                                                                                                                                                                                                                                                                                             
  File "tools/make_webshots.py", line 96, in login                                                                                                                                                                                                                                                                                                                                                                                                                                                                                     
    login_button = self.driver.find_elements_by_xpath("//button[@id='login']")[0]                                                                                                                                                                                                                                                                                                                                                                                                                                                      
IndexError: list index out of range                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                    
"""                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                    

The above exception was the direct cause of the following exception:                                                                                                                                                                                                                                                                                                                                                                                                                                                                   

Traceback (most recent call last):                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                     
  File "tools/make_webshots.py", line 369, in <module>                                                                                                                                                                                                                                                                                                                                                                                                                                                                                 
    main()                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                             
  File "/home/dandi/cronlib/dandi-api-webshots-prs/venv/lib/python3.8/site-packages/click/core.py", line 1137, in __call__                                                                                                                                                                                                                                                                                                                                                                                                             
    return self.main(*args, **kwargs)                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                  
  File "/home/dandi/cronlib/dandi-api-webshots-prs/venv/lib/python3.8/site-packages/click/core.py", line 1062, in main                                                                                                                                                                                                                                                                                                                                                                                                                 
    rv = self.invoke(ctx)                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                              
  File "/home/dandi/cronlib/dandi-api-webshots-prs/venv/lib/python3.8/site-packages/click/core.py", line 1404, in invoke                                                                                                                                                                                                                                                                                                                                                                                                               
    return ctx.invoke(self.callback, **ctx.params)                                                                                                                                                                                                                                                                                                                                                                                                                                                                                     
  File "/home/dandi/cronlib/dandi-api-webshots-prs/venv/lib/python3.8/site-packages/click/core.py", line 763, in invoke                                                                                                                                                                                                                                                                                                                                                                                                                
    return __callback(*args, **kwargs)                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                 
  File "tools/make_webshots.py", line 314, in main                                                                                                                                                                                                                                                                                                                                                                                                                                                                                     
    for stat in executor.map(                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                          
  File "/home/dandi/miniconda3/lib/python3.8/concurrent/futures/process.py", line 484, in _chain_from_iterable_of_lists                                                                                                                                                                                                                                                                                                                                                                                                                
    for element in iterable:                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                           
  File "/home/dandi/miniconda3/lib/python3.8/concurrent/futures/_base.py", line 611, in result_iterator                                                                                                                                                                                                                                                                                                                                                                                                                                
    yield fs.pop().result()                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                            
  File "/home/dandi/miniconda3/lib/python3.8/concurrent/futures/_base.py", line 439, in result                                                                                                                                                                                                                                                                                                                                                                                                                                         
    return self.__get_result()                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                         
  File "/home/dandi/miniconda3/lib/python3.8/concurrent/futures/_base.py", line 388, in __get_result                                                                                                                                                                                                                                                                                                                                                                                                                                   
    raise self._exception                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                              
IndexError: list index out of range                                                             

so may be we need for it to wait explicitly to appear?