Transcription - Create a test suite to perform e2e tests

[suyashgautam]

Task: Create E2E Test Suite for WebSocket Connection and Audio Transcription

Description

We need to create an end-to-end (E2E) test suite that verifies the complete flow of our transcription service, starting from establishing a WebSocket connection, passing audio to the connection, and receiving the transcription. We currently have a server class test suite in the tests folder and integration tests with Faster-Whisper. This issue aims to extend the current setup to support E2E tests for both Faster-Whisper and Bhashini ASR services.

Requirements

1. WebSocket Connection:
   • Establish a WebSocket connection with the server.
2. Audio Passing:
   • Pass audio files through the WebSocket connection.
3. Transcription Reception:
   • Receive the transcription results from the server.
4. Audio and Annotations:
   • Add audio files and their corresponding annotations in the test/audio_files folder.

Current Setup

• We already have a test suite for the server class located in the tests folder. Which can perform E2E test for Faster-Whisper.

Steps to Complete

1. Add Audio Files and Annotations:
   • Place the necessary audio files and their annotations in the test/audio_files folder.
2. Develop WebSocket Connection Test:
   • Write tests to establish and verify a WebSocket connection.
3. Implement Audio Passing Test:
   • Develop tests to pass audio data through the WebSocket connection.
4. Verify Transcription Reception:
   • Write tests to ensure the correct transcription results are received.
5. Support Multiple ASR Services:
   • Update the test suite to support both Faster-Whisper and Bhashini ASR services.
   • Ensure the setup can dynamically switch between ASR services based on configuration or test parameters.

Additional Notes

• Ensure that all tests are integrated seamlessly with the existing test suite in the tests folder.
• Document any new dependencies or setup instructions required for running the E2E tests.

Acceptance Criteria

• [ ] Tests should successfully establish a WebSocket connection.
• [ ] Tests should be able to send audio files from test/audio_files over the WebSocket connection.
• [ ] Tests should receive and verify transcriptions against expected annotations.
• [ ] The test suite should be capable of running E2E tests with both Faster-Whisper and Bhashini ASR services.
• [ ] Documentation is updated to reflect how to run the new E2E tests.

[suyashgautam]

@SarveshAtawane Can you please take this up? Let me know if you face any issue