[DERCBOT-1168] Indexing improvements

[assouktim]

This pull request includes several changes to the gen-ai/orchestrator-server project, focusing on updating metadata keys, improving the indexing tool, and enhancing logging capabilities. The most important changes include renaming metadata keys, modifying the indexing tool to handle new arguments, and updating documentation accordingly.

Metadata key updates:

• gen-ai/orchestrator-server/src/main/python/server/src/gen_ai_orchestrator/services/langchain/qa_chain.py: Changed the metadata key from url to source in the execute_qa_chain function.
• gen-ai/orchestrator-server/src/main/python/server/tests/services/test_qa_chain.py: Updated tests to reflect the change from url to source in metadata. [1] [2]

Indexing tool improvements:

• gen-ai/orchestrator-server/src/main/python/tock-llm-indexing-tools/index_documents.py: Added ignore_source argument to handle cases where sources aren't valid URLs, and improved handling of CSV input and logging. [1] [2] [3] [4] [5] [6] [7] [8]

Documentation updates:

• gen-ai/orchestrator-server/src/main/python/tock-llm-indexing-tools/README.md: Updated documentation to reflect the change from url to source in CSV columns and other relevant sections. [1] [2] [3] [4]

Logging enhancements:

• gen-ai/orchestrator-server/src/main/python/tock-llm-indexing-tools/index_documents.py: Enhanced logging setup with file and console handlers, and added detailed logging for the indexing process. [1] [2]