merged the logs summarization functions

[Ishankoradia]

• Webhook not configured. Its an overkill at the moment, we will continue with polling.
• Have merged the two big function for log summarization.
• Also made some minor changes to the way we store store responses in our table
• Some migration changes

[codecov[bot]]

Codecov Report

Attention: Patch coverage is 29.62963% with 38 lines in your changes missing coverage. Please review.

Project coverage is 69.75%. Comparing base (48176c9) to head (50d7acf). Report is 66 commits behind head on main.

:exclamation: Current head 50d7acf differs from pull request most recent head ca5a6ca

Please upload reports for the commit ca5a6ca to get more accurate results.

Files	Patch %	Lines
ddpui/celeryworkers/tasks.py	5.40%	35 Missing :warning:
ddpui/api/airbyte_api.py	50.00%	1 Missing :warning:
ddpui/api/pipeline_api.py	80.00%	1 Missing :warning:
ddpui/core/llm_service.py	0.00%	1 Missing :warning:

Additional details and impacted files

```diff @@ Coverage Diff @@ ## main #737 +/- ## ========================================== - Coverage 70.08% 69.75% -0.34% ========================================== Files 153 155 +2 Lines 6135 6192 +57 ========================================== + Hits 4300 4319 +19 - Misses 1835 1873 +38 ```

:umbrella: View full report in Codecov by Sentry.
:loudspeaker: Have feedback on the report? Share it here.