search

icatproject / topcat

GUI to work with multiple ICAT and IDS servers.
Other
1 stars 8 forks source link

DLS: integrate TopCat with Ispyb #256

Open dfq16044 opened 8 years ago

dfq16044 commented 8 years ago

A way to integrate topCat and Ispyb is:

fisherab commented 8 years ago

If you just want to download data which you have identified in ispyb then you may only need the IDS and not TopCAT

dfq16044 commented 8 years ago

The requirement is the ability to download, move the data to a staging area and then reprocessing the data using the cluster. Frazer is working on a restore node for DLS, the user will choose DLS Cluster option on TopCat and then the data will be moved to a staging area at DLS.

tomgriffinstfc commented 8 years ago

It is possible to use the IDS API to move data to the cluster in the same way as TopCAT does.

Linking out to TopCAT as you suggest would work, and mean little extra development. Calling IDS directly from ISPyB would perhaps be more seamless to the user, but would require more development – mainly UI work in ISPyB.

From: Silvia da Graca Ramos [mailto:notifications@github.com] Sent: 27 May 2016 09:07 To: icatproject/topcat Subject: Re: [icatproject/topcat] DLS: integrate TopCat with Ispyb (#256)

The requirement is the ability to download, move the data to a staging area and then reprocessing the data using the cluster. Frazer is working on a restore node for DLS, the user will choose DLS Cluster option on TopCat and then the data will be moved to a staging area at DLS.

— You are receiving this because you are subscribed to this thread. Reply to this email directly, view it on GitHubhttps://github.com/icatproject/topcat/issues/256#issuecomment-222085964, or mute the threadhttps://github.com/notifications/unsubscribe/ABtNUeYLR80yU83aVVMmwwWl3NxcqqOtks5qFqYVgaJpZM4InrWk.

jodysalt commented 8 years ago

What is the current state of this issue? Is this requirement going to be implemented via ISPyB or Topcat? Shall I close this issue?

dfq16044 commented 8 years ago

Dear Jody,

This issue is still active. Maybe, I can organise a meeting with Karl Levik to discuss this issue. This is an important ticket as this is a way that we can integrate both databases ...

Sylvie.

From: Jody Salt [notifications@github.com] Sent: Monday, June 20, 2016 2:12 PM To: icatproject/topcat Cc: Da Graca Ramos, Silvia (DLSLtd,RAL,TEC); Author Subject: Re: [icatproject/topcat] DLS: integrate TopCat with Ispyb (#256)

What is the current state of this issue? Is this requirement going to be implemented via ISPyB or Topcat? Shall I close this issue?

� You are receiving this because you authored the thread. Reply to this email directly, view it on GitHubhttps://github.com/icatproject/topcat/issues/256#issuecomment-227137926, or mute the threadhttps://github.com/notifications/unsubscribe/AM_lD1hD5xsvTyA1e304PrMsL-LPvb6Bks5qNpHagaJpZM4InrWk.

This e-mail and any attachments may contain confidential, copyright and or privileged material, and are for the use of the intended addressee only. If you are not the intended addressee or an authorised recipient of the addressee please notify us of receipt by returning the e-mail and do not use, copy, retain, distribute or disclose the information in or attached to the e-mail. Any opinions expressed within this e-mail are those of the individual and not necessarily of Diamond Light Source Ltd. Diamond Light Source Ltd. cannot guarantee that this e-mail or any attachments are free from viruses and we cannot accept liability for any damage which you may sustain as a result of software viruses which may be transmitted in or with the message. Diamond Light Source Limited (company no. 4375679). Registered in England and Wales with its registered office at Diamond House, Harwell Science and Innovation Campus, Didcot, Oxfordshire, OX11 0DE, United Kingdom

jodysalt commented 8 years ago

Ok (I assume Karl Levik is the ISPyB developer) - if we meet up we can discuss our options, and work out what's for the end user. Next time I see you, could you demo ISPyB so I can better understand it.

dfq16044 commented 8 years ago

Hi Jody,

Karl Levik is the person responsible of IspyB. I can show Ispyb the next time I will be at STFC. Probably tomorrow or Wednesday.

Cheers,

Sylvie.

From: Jody Salt [notifications@github.com] Sent: Monday, June 20, 2016 3:19 PM To: icatproject/topcat Cc: Da Graca Ramos, Silvia (DLSLtd,RAL,TEC); Author Subject: Re: [icatproject/topcat] DLS: integrate TopCat with Ispyb (#256)

Ok (I assume Karl Levik is the ISPyB developer) - if we meet up we can discuss our options, and work out what's for the end user. Next time I see you, could you demo ISPyB so I can better understand it.

� You are receiving this because you authored the thread. Reply to this email directly, view it on GitHubhttps://github.com/icatproject/topcat/issues/256#issuecomment-227155535, or mute the threadhttps://github.com/notifications/unsubscribe/AM_lD0wKXDVcx2ZBmCQzXcUK7TpbSx60ks5qNqFUgaJpZM4InrWk.

This e-mail and any attachments may contain confidential, copyright and or privileged material, and are for the use of the intended addressee only. If you are not the intended addressee or an authorised recipient of the addressee please notify us of receipt by returning the e-mail and do not use, copy, retain, distribute or disclose the information in or attached to the e-mail. Any opinions expressed within this e-mail are those of the individual and not necessarily of Diamond Light Source Ltd. Diamond Light Source Ltd. cannot guarantee that this e-mail or any attachments are free from viruses and we cannot accept liability for any damage which you may sustain as a result of software viruses which may be transmitted in or with the message. Diamond Light Source Limited (company no. 4375679). Registered in England and Wales with its registered office at Diamond House, Harwell Science and Innovation Campus, Didcot, Oxfordshire, OX11 0DE, United Kingdom

jodysalt commented 8 years ago

Using Topcat does make sense as the user may only want to select certain files from a dataset.

Looking at the url in ISPyB all the info needed seems to be there.

Now that the CAS authentication has been implemented it should be pretty seamless for the user.

brianritchie1312 commented 5 years ago

Did anything happen on this? It is not clear from the above whether ISpyB creates Topcat URLs, or if there was more work to be done in Topcat. The latter is unlikely to happen now. Do we need to consider ISpyB integration in Topcat's replacement?

dfq16044 commented 5 years ago

Dear Brian, This was a requirement from Data Analysis group. Initially a CAS plugin was written to make it easier to connect to TopCat. I have written an email to the ISypB developer with the API that they need to use but I did not hear about him. Later a solution would be to map DataCollection in Ispyb tables and Dataset in ICAT but still to be decided. I will suggest to postponed this ticket for now until it is clearer on how to do it.

Sylvie.