search

deepset-ai / haystack

:mag: AI orchestration framework to build customizable, production-ready LLM applications. Connect components (models, vector DBs, file converters) to pipelines or agents that can interact with your data. With advanced retrieval methods, it's best suited for building RAG, question answering, semantic search or conversational agent chatbots.
https://haystack.deepset.ai
Apache License 2.0
17.28k stars 1.89k forks source link

Annotation Tool #1466

Closed Maheshkumar094 closed 3 years ago

Maheshkumar094 commented 3 years ago

Trying to build a custom squad dataset using the annotation tool I have cloned the project and am able to run the application by connecting the database but need to do some changes data capturing as depending on our custom dataset. Is it possible to do some modifications to the annotation tool application? Thanks

Timoeller commented 3 years ago

Hey @Maheshkumar094 thanks for using our tool. Just for clarification, you said you have cloned the project. Do you mean the haystack project? In there we do not have the actual code for the annotation tool, there are just pointers to the free online version or how to deploy the annotation tool with docker. So what do you mean with run the application and connect a database to it?

In any case, since we have not open sourced the actual code underlying the annotation tool, it is also unfortunately not possible to modify it. There is another annotatiol tool, with open source code from our friends at the etalab: https://github.com/etalab/piaf Maybe you can customize this to your needs?

Maheshkumar094 commented 3 years ago

Thank You so much for your reply...!

Maheshkumar094 commented 3 years ago

@Timoeller I have some more questions can you answer those

  1. How do Standard questions work?
  2. Can we add a set of questions which common for all documents and annotate the answer while reading the document? I have followed this step
  3. Add some questions in standard Question
  4. In the Annotation Document page In the Question section all the questions are listed down but after selecting the paragraph answer popup is not opening similar to the custom question.
aantti commented 3 years ago

Jfyi, there's also a new article on the annotation tool and working on labels here: https://www.deepset.ai/blog/labeling-data-with-haystack-annotation-tool :)

ZanSara commented 3 years ago

Hi @Maheshkumar094, I hope the article that @aantti posted helped! I'll close this issue for now. If you have more specific questions, please open an issue for each one of them :slightly_smiling_face: