feat: DIA-953: Stream results from adala inference server into LSE - Githubissues

HumanSignal / Adala

Adala: Autonomous DAta (Labeling) Agent framework

https://humansignal.github.io/Adala/

Apache License 2.0

979 stars 77 forks source link

feat: DIA-953: Stream results from adala inference server into LSE #75

Closed matt-bernstein closed 7 months ago

matt-bernstein commented 8 months ago

add Label Studio SDK as a dependency (should be an optional dependency for the server only, but there's no clean way to do this in poetry)
switch ResultHandlers from an enum whitelist of functions to a registry of Pydantic models, same implementation as Environment/Skill/Runtime
add LSEHandler that pushes predictions to an LS project using an LS SDK Client
change celery worker functions to use pickle serialization, removing manual step of de/serializing objects on each worker call from an API endpoint
change utils and handlers import paths to be usable from both main app and celery workers
make AsyncKafkaEnvironment instantiable as prep for post-streaming refactoring

robot-ci-heartex commented 8 months ago

Commit https://github.com/HumanSignal/infra/commit/238ab7aec7347515c1884fcdf05fd4e0c8f42fb5 is created.

codecov-commenter commented 7 months ago

Codecov Report

Attention: Patch coverage is 5.74713% with 82 lines in your changes are missing coverage. Please review.

Project coverage is 46.28%. Comparing base (d668350) to head (64e174a). Report is 12 commits behind head on master.

Files	Patch %	Lines
server/handlers/result_handlers.py	0.00%	39 Missing :warning:
server/app.py	0.00%	19 Missing :warning:
server/tasks/process_file.py	0.00%	18 Missing :warning:
adala/environments/kafka.py	50.00%	5 Missing :warning:
server/utils.py	0.00%	1 Missing :warning:

Additional details and impacted files

```diff @@ Coverage Diff @@ ## master #75 +/- ## ========================================== - Coverage 50.28% 46.28% -4.01% ========================================== Files 37 39 +2 Lines 1587 1735 +148 ========================================== + Hits 798 803 +5 - Misses 789 932 +143 ```

:umbrella: View full report in Codecov by Sentry.
:loudspeaker: Have feedback on the report? Share it here.

robot-ci-heartex commented 7 months ago

Commit https://github.com/HumanSignal/infra/commit/b2bfdf902e0ae4de1a982c0df2d2a9ab7b9e7f39 is created.

robot-ci-heartex commented 7 months ago

Commit https://github.com/HumanSignal/infra/commit/b668edb3077cce97ab683b5403e76f487cddb71c is created.

robot-ci-heartex commented 7 months ago

Commit https://github.com/HumanSignal/infra/commit/c1af6af17ba4e651c381949fc84f9bdf63c7a6a8 is created.

robot-ci-heartex commented 7 months ago

Commit https://github.com/HumanSignal/infra/commit/1c46440bbbffeb6bf70512eea7b866416043dd97 is created.

robot-ci-heartex commented 7 months ago

Commit https://github.com/HumanSignal/infra/commit/7f8ed35f3d2a4aba8cadbb77d7580b3a70bf8156 is created.

robot-ci-heartex commented 7 months ago

Commit https://github.com/HumanSignal/infra/commit/498c5f3874f6e3c547d4b249ca54da37ec5f72aa is created.

robot-ci-heartex commented 7 months ago

Commit https://github.com/HumanSignal/infra/commit/d39c739ae520ab4c5d6f458a8fefd708642c3364 is created.

robot-ci-heartex commented 7 months ago

Commit https://github.com/HumanSignal/infra/commit/213f6be9d555b89326e785176cd5868822373c3b is created.

robot-ci-heartex commented 7 months ago

Commit https://github.com/HumanSignal/infra/commit/94e05369684d77d67e9d9d05c89f22246a4f716a is created.

robot-ci-heartex commented 7 months ago

Commit https://github.com/HumanSignal/infra/commit/b77f2e94ce7c1819695b1861e8003cf30fda2477 is created.

robot-ci-heartex commented 7 months ago

Commit https://github.com/HumanSignal/infra/commit/1eded78f5a409ab4f4df576a70a83f357dbb8998 is created.

robot-ci-heartex commented 7 months ago

Commit https://github.com/HumanSignal/infra/commit/365a3ddae8da0b48a740b3c3d81e1bb221d59ae6 is created.

robot-ci-heartex commented 7 months ago

Commit https://github.com/HumanSignal/infra/commit/c0064cad2e6c81b0d19aeefdb2ab075f46a061d2 is created.

robot-ci-heartex commented 7 months ago

Commit https://github.com/HumanSignal/infra/commit/615b23cfe0dbc264c05ac75dc65c0f5167f04e42 is created.

robot-ci-heartex commented 7 months ago

Commit https://github.com/HumanSignal/infra/commit/c9346087596750e3b7d39b65c0e6a89af37a5630 is created.

robot-ci-heartex commented 7 months ago

Commit https://github.com/HumanSignal/infra/commit/eb59d320ef9195f0f906191fd53a675cb1025676 is created.

robot-ci-heartex commented 7 months ago

Commit https://github.com/HumanSignal/infra/commit/ddb98da4b602997a18a3c9de533ffe06bb31b315 is created.

robot-ci-heartex commented 7 months ago

Commit https://github.com/HumanSignal/infra/commit/5cdb8cc9cf96bed8806cb5146f3ae63c3e916b51 is created.

robot-ci-heartex commented 7 months ago

Commit https://github.com/HumanSignal/infra/commit/e237f95346f9730228de3c51c43f5bfc644885f8 is created.

robot-ci-heartex commented 7 months ago

Commit https://github.com/HumanSignal/infra/commit/6c4c37af796fa35dfdf5eb22d87e5297c978750a is created.

robot-ci-heartex commented 7 months ago

Commit https://github.com/HumanSignal/infra/commit/0230dc1458e908afafa2b20fd3c12ef5748d996b is created.