ebi-gene-expression-group / atlas-web-single-cell

Single Cell Expression Atlas web application
Apache License 2.0
5 stars 5 forks source link

SCXA fallback application broken due to directories missed from the path after pub- /nfs/ftb/pub/databases..etc in the both VMs #372

Closed upendrakumbham closed 8 months ago

upendrakumbham commented 9 months ago

Issue: Fallback VMs(wp-p2m-8e & 8f) unable to access path - /nfs/ftp/pub/databases...

Created this incident after my investigation in the VM: INC0014500

upendrakumbham commented 9 months ago
[root@wp-p2m-8e ~]# cd /nfs/ftp/
[root@wp-p2m-8e ftp]# ls -lrt
total 0
lrwxrwxrwx 1 root root 23 May  3  2018 pub -> /net/isilon8/ftp_public
[root@wp-p2m-8e ftp]# cd pub/
[root@wp-p2m-8e pub]# ls -lrt
total 0
[root@wp-p2m-8e pub]# cd /net/isilon8/ftp_public
[root@wp-p2m-8e ftp_public]# ls -lrt
total 0
[root@wp-p2m-8e ftp_public]#
upendrakumbham commented 9 months ago

We had a long discussion with the Webprod team- Vidya. Had a discussion with Mark and an internal discussion about the issue with Pedro and Anil.

Finally, Vidya had a discussion with the storage team and came up with an actual problem and fix 💯:

Some copying process was going on the storage team side, once they finish their copy process, they will remount the above path again, so that our application will work as normal.

when we reboot VMs all mounts paths will be remounted as per Vidya.

As storage team working now, our application had the issue with remount.

upendrakumbham commented 8 months ago

Yougandhara from the storage team mentioned that the NFC copying process was finished. They suggested that the web prod team fix the remount issue of our VMs. But as per him, no one responded from the web prod team.

He mentioned Khalid's name to contact as Vidya was on leave.

upendrakumbham commented 8 months ago

Finally, Vidya came and did a remount on the above missing directory's path, issue was fixed. I have verified the fallback SCXA application, it is working fine. So, I'm closing the issue.