Question Answer Tool changes

[komalg1]

Purpose

• Related to #321
• Resolves #753
• This PR updates QuestionAnswerTool.py to work with Integrated Vectorization. It adds a new field 'chunk_id' to the lang chain SourceDocument.py class to be able to map it in UI.
• Added corresponding unit tests

Does this introduce a breaking change?

[x] Yes
[ ] No

Pull Request Type

What kind of change does this Pull Request introduce?

[ ] Bugfix
[x] Feature
[ ] Code style update (formatting, local variables)
[ ] Refactoring (no functional changes, no api changes)
[ ] Documentation content changes
[ ] Other... Please describe:

How to Test

• Get the code

git clone [repo-address]
cd [repo-name]
git checkout [branch-name]
npm install

• Test the code

  The Web chat application should be able to return results along with citations for the ingested documents.

[github-actions[bot]]

Coverage Report

File	Stmts	Miss	Cover	Missing
code
app.py	14	14	0%	1–4, 6–7, 9, 12–14, 16, 18, 20–21
create_app.py	148	3	97%	199, 204, 327
code/backend
Admin.py	23	23	0%	1–6, 9, 11, 13–14, 16, 19–20, 22–23, 26, 33, 40, 43–45, 47, 49
code/backend/batch
AddURLEmbeddings.py	29	2	93%	37–38
BatchPushResults.py	31	1	96%	53
BatchStartProcessing.py	18	0	100%
GetConversationResponse.py	32	3	90%	63–65
function_app.py	16	16	0%	1–8, 10, 12–13, 15, 18–21
code/backend/batch/utilities/common
Answer.py	24	1	95%	39
SourceDocument.py	59	4	93%	33, 37, 41, 130
code/backend/batch/utilities/document_chunking
DocumentChunkingBase.py	10	2	80%	10, 16
FixedSizeOverlap.py	19	0	100%
Layout.py	19	0	100%
Page.py	17	0	100%
Paragraph.py	9	9	0%	1–4, 7–9, 12, 15
Strategies.py	29	5	82%	24–25, 27, 29, 46
__init__.py	7	0	100%
code/backend/batch/utilities/document_loading
DocumentLoadingBase.py	9	1	88%	13
Layout.py	12	12	0%	1–4, 7–9, 11–13, 16, 25
Read.py	12	12	0%	1–4, 7–9, 11–13, 16, 25
Strategies.py	20	8	60%	13, 15, 17, 19, 24–25, 27, 29
Web.py	19	1	94%	23
WordDocument.py	25	25	0%	1–6, 9–12, 21–24, 26–27, 29–30, 32–37, 45
__init__.py	15	1	93%	16
code/backend/batch/utilities/helpers
AzureBlobStorageHelper.py	72	33	54%	20–22, 30, 50, 53–54, 59, 63, 88–89, 91, 95, 106, 110, 116, 131, 134, 153, 156, 158, 166–170, 193, 197–201, 203
AzureFormRecognizerHelper.py	81	81	0%	1–6, 9–11, 13, 16–17, 25, 27, 35, 43–45, 52–55, 60–68, 70, 73–75, 77–78, 81, 84–86, 88–90, 93, 97–98, 105–109, 111–114, 117–131, 133, 135–137, 139–140, 143, 145–147
AzureSearchHelper.py	20	0	100%
ConfigHelper.py	112	0	100%
DocumentChunkingHelper.py	12	1	91%	21
DocumentLoadingHelper.py	12	1	91%	14
DocumentProcessorHelper.py	60	16	73%	40, 52–59, 63–66, 86–88
EnvHelper.py	127	10	92%	208, 213–214, 217–219, 228, 232–234
LLMHelper.py	33	20	39%	11–13, 15–16, 22, 28–29, 34, 37–38, 47, 58–59, 71, 83–84, 91, 101, 109
OrchestratorHelper.py	12	4	66%	20–22, 25
code/backend/batch/utilities/integrated_vectorization
AzureSearchDatasource.py	19	0	100%
AzureSearchIndex.py	35	0	100%
AzureSearchIndexer.py	20	2	90%	47–48
AzureSearchSkillset.py	20	0	100%
code/backend/batch/utilities/loggers
ConversationLogger.py	36	28	22%	8, 11–12, 15–24, 27–30, 33–42, 46
TokenLogger.py	9	4	55%	7–8, 11, 15
code/backend/batch/utilities/orchestrator
LangChainAgent.py	72	29	59%	23–28, 30, 65–66, 71–73, 78, 98–101, 118–119, 122–125, 132–133, 138–140, 143
OpenAIFunctions.py	66	66	0%	1–3, 5–12, 14, 17–21, 56, 59, 62–64, 69–71, 76, 79, 81, 87–90, 92, 95, 102–106, 110–111, 113, 119–123, 127–129, 132, 135–136, 139, 144–146, 149–151, 156–158, 161, 164, 169
OrchestratorBase.py	32	15	53%	14–20, 31, 40–42, 49–51, 61
Strategies.py	12	7	41%	10–11, 13–15, 17, 19
__init__.py	11	0	100%
code/backend/batch/utilities/parser
OutputParserTool.py	39	0	100%
ParserBase.py	9	2	77%	9, 19
__init__.py	7	2	71%	7, 11
code/backend/batch/utilities/search
AzureSearchHandler.py	40	1	97%	13
IntegratedVectorizationSearchHandler.py	43	0	100%
Search.py	32	3	90%	15, 20–21
SearchHandlerBase.py	29	8	72%	11, 15, 19, 23, 27, 31, 35, 39
code/backend/batch/utilities/tools
AnswerProcessingBase.py	8	2	75%	8, 12
AnsweringToolBase.py	9	2	77%	9, 15
ContentSafetyChecker.py	41	25	39%	16, 18–19, 24, 30–32, 35–36, 42–43, 49–54, 57–59, 61, 65–67, 69
PostPromptTool.py	22	13	40%	11, 14–15, 17–18, 22, 29, 36–37, 45, 51–52, 60
QuestionAnswerTool.py	62	0	100%
TextProcessingTool.py	16	9	43%	9, 12–15, 19, 21, 28, 35
code/backend/pages
01_Ingest_Data.py	118	118	0%	1–12, 18–22, 24–26, 28, 34, 41, 44, 48–49, 51, 56, 59–60, 63–66, 68–71, 75–77, 80–83, 85, 88–98, 101–108, 111–113, 115, 118, 120–123, 128–133, 136, 139–140, 143, 149, 162–165, 168–169, 173, 177, 184, 198–201, 204, 209–210, 212–213, 215–217, 221–223, 228–231, 238–239, 244, 246–247
02_Explore_Data.py	26	26	0%	1–7, 9–10, 12, 18, 25, 28, 36, 38–39, 41–44, 46–49, 52–53
03_Delete_Data.py	37	37	0%	1–7, 9–11, 13, 19, 26, 29, 37, 39–41, 43–46, 48, 50–51, 55, 59–63, 65, 68–69, 71–73
04_Configuration.py	125	125	0%	1–9, 11, 13, 15, 22, 29, 31, 36–45, 48–49, 52–63, 65–66, 76–80, 83–84, 88–90, 93–94, 97–98, 101–102, 125, 127–128, 130–134, 136–139, 142–146, 153–154, 164–166, 168, 188–189, 191, 193, 199, 207, 215, 222–223, 230, 232–233, 237, 245, 251, 258, 276–277, 294–295, 299, 301–302, 319, 348–349, 351–352, 355–356, 359–362, 364–365, 367–369, 371–374, 376–377
TOTAL	2152	833	61%

Tests	Skipped	Failures	Errors	Time
140	0 :zzz:	0 :x:	0 :fire:	7.346s :stopwatch:

[ross-p-smith]

Thank you for persisting with this - I love how the QuestionAnswerTool is slimmer now!! 💖 I can approve when the tests pass

[superhindupur]

LGTM too. Will wait for you to fix the unit tests, and I can approve. Thanks Komal!