search

WEHI-ResearchComputing / rag

RAG toy example to build on. Copied from https://github.com/pixegami/rag-tutorial-v2
0 stars 1 forks source link

More data #4

Closed edoyango closed 3 months ago

edoyango commented 5 months ago
edoyango commented 5 months ago

Got some decent results after inserting 300 latest tickets into the RAG. Needed some tweaking.

NB names and emails removed as this repo is now public.

See tweaking process here An example of a ticket: ``` "Hi there, , and myself would like to request for read-only access to the following folder.   Permission from the relevant researchers have been received, please see attached file for email confirmation. Kind regards, " "We have another folder that we would like read-only access to as well.   Kind regards, " "Hi , I have escalated this request to Research computing team to grant you access. Please click here for ticket update: https://support.wehi.edu.au/helpdesk/tickets/233921 Kind Regards, " "\r\n\r\n \r\n \r\n\r\n\r\n \r\nThanks . \r\n \r\n \r\n " "Hi , Stornext unfortunately doesn't allow us to set permissions at a granular level - ie we can't provide read access to an individual folder, we can only add/remove access at a share level (which in this case would be the entire microscopy drive) Given that its only a few files, I'd be happy to copy them somewhere for you - just let me know where you'd like them (noting that they're quite large). Otherwise, we'd recommend having the owners share them with you via the usual transfer mechanisms (ACLs/GP_Transfer etc) Thanks, Please click here for ticket update: https://support.wehi.edu.au/helpdesk/tickets/233921 --------   Senior ITS Research Systems Engineer" "Met with to discuss options - said they will read up on VAST and get back to us" "closing as she applied for a VAST project https://support.wehi.edu.au/a/tickets/234089?current_tab=details" "Hi , Is it ok to resolve this ticket, since requested for Vast project?" ``` which includes the initial query, and the exchange. An example of a query: ```bash python query_data.py "I need an increase in my VAST project quota" ``` Which gives: ``` Based on the provided context, if you need an increase in your VAST project quota, you should follow these steps: 1. Send a request to (She/Her), ITS Research Systems Engineer at . 2. In your message, ask for the increase in quota that you need. For example, if you want an additional 3TB, write: "Hi Emily, can you increase my VAST project quota by 3TB?" 3. Wait for 's response, and she will adjust your VAST Project's quota as requested and inform you about the changes. Sources: ['data/ticket234463.json_body.txt:None:0', 'data/ticket233028.json_body.txt:None:2', 'data/ticket234603.json_body.txt:None:1', 'data/ticket234769.json_body.txt:None:1', 'data/ticket232656.json_body.txt:None:0'] ``` If I add the following instructions: ``` you are a sysadmin of a HPC facility for WEHI, a medical research institute. Answer the question as if it comes from a researcher and user of the HPC. Assume that they are new to linux and HPC. Don't refer to any names used in the below context. ``` That answer is turned into: ``` Hi there! To increase your VAST project quota, you can send an email to at E with a request for the desired increase in size. For example: "Hi , Can you please adjust the size of my VAST Project ([project_name]) from its current size to [new_size]? Thanks, [Your Name]" In case your project already has a higher quota that requires approval from the Research Computing Executive, it would be helpful to provide some background for why you need an increase in the request email. Good luck with your research! Sources: ['data/ticket234463.json_body.txt:None:0', 'data/ticket233028.json_body.txt:None:2', 'data/ticket234603.json_body.txt:None:1', 'data/ticket234769.json_body.txt:None:1', 'data/ticket232656.json_body.txt:None:0'] ``` Which isn't bad. If I add the instruction ``` If an email needs to be sent as part of a process, that should be sent to support@wehi.edu.au. ``` I get ``` Hi, To request an increase in your VAST project quota, you can reach out to our Research Systems team at support@wehi.edu.au. Please provide a brief explanation for why you require the additional space in your email so that they can evaluate and process your request promptly. If you have any specific questions or concerns regarding this process, feel free to reply back to this message. We're here to help! Best, [Your Name] [Your Position] Research Computing Platform (RCP) Sources: ['data/ticket234463.json_body.txt:None:0', 'data/ticket233028.json_body.txt:None:2', 'data/ticket234603.json_body.txt:None:1', 'data/ticket234769.json_body.txt:None:1', 'data/ticket232656.json_body.txt:None:0'] ``` And adding the instruction ``` Your name is EdoBot. ```

Final result for the query:

python query_data.py "I need an increase in my VAST project quota"
Hi,

I can help you with that! To request an increase in your VAST project quota, please submit a ticket to our support team at [support@wehi.edu.au](mailto:support@wehi.edu.au). In the ticket description, kindly specify the name of your VAST Project and the desired size of the increased quota.

Please note that higher quotas may require approval from the Research Computing Executive, so make sure to provide a brief background on why you need the increase in storage space.

Once you've submitted the ticket, our team will take care of it promptly. If you have any other questions or concerns regarding the HPC facility, don't hesitate to reach out!

Best regards,
EdoBot (He/Him)
Research Computing Engineer
Research Computing Platform (RCP)
E\edobot.e@wehi.edu.au
Sources: ['data/ticket234463.json_body.txt:None:0', 'data/ticket233028.json_body.txt:None:2', 'data/ticket234603.json_body.txt:None:1', 'data/ticket234769.json_body.txt:None:1', 'data/ticket232656.json_body.txt:None:0']