ShannonAI service-streamer issues

ShannonAI / service-streamer

Boosting your Web Services of Deep Learning Applications.

Apache License 2.0

1.22k stars 187 forks source link

issues

Newest

Newest Most commented Recently updated Oldest Least commented Least recently updated

请问是否支持流式输出 Is it support stream output by GPT model?

#101 c66w opened 10 months ago
0
当模型predict参数为ndarray的时候会将参数修改成list

#100 danerlt opened 11 months ago
1
分布式问题

#99 ZTurboX opened 1 year ago
0
There seems to be a problem with multithreading operations inside the model

#98 ZQFORWARD closed 1 year ago
0
Returning dictionary instead of a list in provided callback to ThreadedStreamer

#97 cgr71ii opened 1 year ago
0
基于paddle训练出的模型基于steamer进行处理报错

#96 XavierWonderful opened 1 year ago
0
为什么我的batch_size无论设多大，处理时一次最多就接收10个

#95 Kuzhuahu closed 1 year ago
2
某个worker死掉后，mp.Queue() get获取输入数据，锁无法释放bug

#94 lxsyz opened 1 year ago
0
does service streamer support cpu deploy?

#93 zhanghaoie opened 2 years ago
1
Worker_timeout

#92 MuhammadKhalid3975 opened 2 years ago
2
关于 streamer = Streamer(... cuda_devices=(0,1,2,3))时，gpu 0不被使用的问题

#91 WuZifan opened 2 years ago
0
关于 (fastapi) 推理会阻塞（block）的解决方法

#90 yangtianyu92 opened 2 years ago
0
Is this project still active? Will a new version past 0.1.2 be published?

#89 LeBaronDean opened 2 years ago
3
future won't be free in future_cache_ref when TimeoutError occurred

#88 Dwan-g opened 2 years ago
1
请问如果我在服务器启动过程中想要实时修改batchsize和max latency要怎么做？

#87 Homura2333 opened 3 years ago
0
Correct typos in README.md

#86 skydice opened 3 years ago
0
Detectron2 DefaultPredictor

#85 neerajvashistha opened 3 years ago
0
Error on multi-threading !!!

#84 marcusau opened 3 years ago
2
关于redis+multi_gpu

#83 syyuan14 opened 3 years ago
0
try add model_init_args & model_init_kwargs

#82 yangtianyu92 opened 3 years ago
2
可以配合tornado使用么?

#81 tengmao opened 3 years ago
3
Timeout errors (with GPT2 and simple 'return' model)

#80 m4gr4th34 opened 3 years ago
7
请问有遇到过ValueError: Layer sequential expects 1 inputs, but it received 64 input tensors 的问题吗？

#79 LCG22 closed 3 years ago
1
self._task_id 问题

#78 yongzhuo opened 3 years ago
0
improve redis worker stability

#77 starplanet opened 4 years ago
0
Configurable WORKER_TIMEOUT

#76 yohokuno closed 4 years ago
1
Configurable WORKER_TIMEOUT

#75 yohokuno closed 4 years ago
0
Streamer worker没有正确分配到多台gpu上

#74 rubby33 closed 4 years ago
2
wrk压测时候，发生timeout 之后服务卡死

#73 rubby33 closed 4 years ago
4
fix redis worker hang when redis connection is lost or redis server is restarted

#72 starplanet closed 4 years ago
1
RuntimeError when using ManagedModel and TensorFlow

#71 yohokuno closed 4 years ago
6
Question about System architect and design

#70 VJAYSLN closed 4 years ago
2
TypeError: can't pickle _thread.RLock objects

#69 c0derm4n opened 4 years ago
1
Could U please give a TensorFlow model example?

#68 yjiangling closed 4 years ago
0
RedisStreamer如何配置batch_size&max_latency

#67 c0derm4n opened 4 years ago
6
服务卡死现象

#66 caseware66 opened 4 years ago
3
redis.exceptions.Connectionerror: error 110 connection to localhost:1234 connection timed out

#65 LiuHao-THU opened 4 years ago
3
Problem using flask_multigpu_example.py with gunicorn

#64 miangangzhen opened 4 years ago
1
Problem using service_streamer on gunicorn setup

#63 vijay-tp opened 4 years ago
1
if you keep insert task_id to input_queue, the system will never return...

#62 LiuHao-THU closed 4 years ago
0
超时后future_cache不能正确释放

#61 wykdg opened 4 years ago
10
Streamer Windows Support

#60 kogolobo opened 4 years ago
1
Redis with auth

#59 absaravanan opened 4 years ago
1
support single gpu multiple models loading

#58 Windrill closed 4 years ago
0
在cpu上能获得加速吗？

#57 gikerch closed 4 years ago
3
Passing additional arguments to predict function

#56 radao closed 4 years ago
1
tf.keras 1.15.0+Streamer+keras_bert报错

#55 yongzhuo closed 4 years ago
7
question about system design

#54 JuHyung-Son closed 3 weeks ago
0
多gpu设置时只设置cuda_devices=(2,3)不起作用，仍然使用0，1，2，3四块卡

#53 YiLing28 closed 4 years ago
1
python多线程问题again~

#52 hxyshare closed 4 years ago
5