epwalsh batched-fn issues

epwalsh / batched-fn

🦀 Rust server plugin for deploying deep learning models with batched prediction

https://crates.io/crates/batched-fn

Apache License 2.0

19 stars 2 forks source link

issues

Newest

Newest Most commented Recently updated Oldest Least commented Least recently updated

Fix thread crash on disconnect

#26 Weshnaw closed 8 months ago
0
Channel is disconnected if requests are canceled

#25 Weshnaw closed 8 months ago
3
Update flume requirement from 0.10.0 to 0.11.0

#24 dependabot[bot] opened 1 year ago
0
Loading models in the runtime

#23 diptanu opened 1 year ago
1
remove unnecessary Mutex

#22 epwalsh closed 2 years ago
0
Return `BatchedFn` instance from `batched_fn!` macro instead of closure to avoid requiring static parameters

#21 epwalsh closed 2 years ago
0
[Question] How to make `max_batch_size` configurable?

#20 Yevgnen opened 2 years ago
3
add more documentation about "channel_cap"

#19 epwalsh closed 2 years ago
0
Improve CI

#18 epwalsh closed 2 years ago
0
[Question] How to benchmark the execution?

#17 Yevgnen closed 2 years ago
6
How to use in an actix server?

#16 failable closed 2 years ago
5
how does this map between request source and response?

#15 avnerbarr opened 2 years ago
3
Awaiting inside the closure

#14 RohanGautam opened 3 years ago
1
Update tokio requirement from 0.3.0 to 1.0.1

#13 dependabot[bot] closed 3 years ago
0
Update tokio requirement from 0.3.0 to 1.0.0

#12 dependabot[bot] closed 3 years ago
1
Update flume requirement from 0.9.0 to 0.10.0

#11 dependabot[bot] closed 3 years ago
0
Update tokio requirement from 0.2.13 to 0.3.0

#10 dependabot[bot] closed 4 years ago
0
Update flume requirement from 0.7.1 to 0.9.0

#9 dependabot[bot] closed 4 years ago
0
actions workflow updates

#8 epwalsh closed 4 years ago
0
Rename "delay" to "max_delay"

#7 epwalsh closed 4 years ago
0
Back pressure

#6 epwalsh closed 4 years ago
0
switch to flume channels

#5 epwalsh closed 4 years ago
0
big improvements

#4 epwalsh closed 4 years ago
0
Big improvements

#3 epwalsh closed 4 years ago
0
Improve macro and docs

#2 epwalsh closed 4 years ago
0
clean up

#1 epwalsh closed 4 years ago
0