search

vjcitn / AHtestAzure

testing and benchmarking AnnotationHub on Azure
1 stars 1 forks source link

Brussels, EU #9

Open lgatto opened 2 years ago

lgatto commented 2 years ago

It looked like the 4 test got stuck at some point, so I cancelled it and re-run the test:

> library(AHtestAzure)

Loading required package: tools
> report_comparison("Brussels", "AHtestAzureTimings_20210914.csv")
/home/lgatto/.cache/R/BiocFileCache
  does not exist, create directory? (yes/no): yes
  |======================================================================| 100%

  |======================================================================| 100%

  |======================================================================| 100%

  |======================================================================| 100%

  |=========================================================             |  81%

  C-c C-c
Error in .util_download(x, rid[i], proxy, config, "bfcadd()", ...) : 
  bfcadd() failed; see warnings()
In addition: Warning messages:
1: download failed
  web resource path: ‘https://annotationhub.bioconductor.org/azure/2’
  local file path: ‘/home/lgatto/.cache/R/BiocFileCache/5ad661ab80347_2’
  reason: Operation was aborted by an application callback 
2: bfcadd() failed; resource removed
  rid: BFC5
  fpath: ‘https://annotationhub.bioconductor.org/azure/2’
  reason: download failed 
> 
> report_comparison("Brussels", "AHtestAzureTimings_20210914.csv")
  |======================================================================| 100%

  |======================================================================| 100%

  |======================================================================| 100%

  |======================================================================| 100%

  |======================================================================| 100%

  |======================================================================| 100%

  |======================================================================| 100%

  |======================================================================| 100%

>

Data : AHtestAzureTimings_20210914.csv

location target sec
Brussels azure/5050 4.000504
Brussels azure/5050 3.107061
Brussels fetch/5050 1.936080
Brussels fetch/5050 1.852271
Brussels azure/2 1199.672422
Brussels azure/2 1184.995062
Brussels fetch/2 345.324902
Brussels fetch/2 138.506939
vjcitn commented 2 years ago

Thanks Laurent. I should enhance the function to report the time of run as well. Was your run conducted Sept 14 around ~1000 GMT?

lgatto commented 2 years ago

No, earlier, as 10:00 GMT is 12:00 my time in Brussels. The file was created at 09:23, which is 07:23 GMT.

$ ls -lh AHtestAzureTimings_20210914.csv 
-rw-r--r-- 1 lgatto lgatto 346 Sep 14 09:23 AHtestAzureTimings_20210914.csv

I'm happy to repeat it again several times, if of any help.

drisso commented 2 years ago

I may have been the one at around 10:00 GMT yesterday (https://github.com/vjcitn/AHtestAzure/issues/10) as I also did notice that the test was stuck. I left for a meeting and forgot to check again until this morning, but apparently it eventually got unstuck and finished.

lgatto commented 2 years ago

So I ran a second test today at 9:52 my time (cf file name). I had to cancel the first run because it got stuck for a couple of hours. The second run completed at 13:51 (time stamp of the attached file).

> library(AHtestAzure)

Loading required package: tools
> report_comparison("Brussels", "AHtestAzureTimings_202109150952.csv")
  |======================================================================| 100%

  |======================================================================| 100%

  |======================================================================| 100%

  |======================================================================| 100%

  |========================================                              |  58%  C-c C-c
Error in .util_download(x, rid[i], proxy, config, "bfcadd()", ...) : 
  bfcadd() failed; see warnings()
In addition: Warning messages:
1: download failed
  web resource path: ‘https://annotationhub.bioconductor.org/azure/2’
  local file path: ‘/home/lgatto/.cache/R/BiocFileCache/670823f55ac09_2’
  reason: Operation was aborted by an application callback 
2: bfcadd() failed; resource removed
  rid: BFC18
  fpath: ‘https://annotationhub.bioconductor.org/azure/2’
  reason: download failed 
> report_comparison("Brussels", "AHtestAzureTimings_202109150952.csv")
  |======================================================================| 100%

  |======================================================================| 100%

  |======================================================================| 100%

  |======================================================================| 100%

  |======================================================================| 100%

  |======================================================================| 100%

  |======================================================================| 100%

  |======================================================================| 100%

Data: AHtestAzureTimings_202109150952.csv

location target sec
Brussels azure/5050 4.591501
Brussels azure/5050 4.722919
Brussels fetch/5050 2.045152
Brussels fetch/5050 1.980194
Brussels azure/2 1216.414960
Brussels azure/2 1228.836258
Brussels fetch/2 393.569414
Brussels fetch/2 496.314426
lgatto commented 2 years ago

Here's a run after the storage class of the test resources was upgraded, started on 21 Sept 2021 at 8:56 and completed at 9:48.

Data: AHtestAzureTimings_202109210856.csv

location target sec
Brussels azure/5050 5.572579
Brussels azure/5050 3.033359
Brussels fetch/5050 2.027955
Brussels fetch/5050 2.202284
Brussels azure/2 1244.544891
Brussels azure/2 1224.368770
Brussels fetch/2 186.294067
Brussels fetch/2 451.800756