issues
search
ShannonAI
/
service-streamer
Boosting your Web Services of Deep Learning Applications.
Apache License 2.0
1.23k
stars
187
forks
source link
issues
Newest
Newest
Most commented
Recently updated
Oldest
Least commented
Least recently updated
请问是否支持流式输出 Is it support stream output by GPT model?
#101
c66w
opened
1 year ago
0
当模型predict参数为ndarray的时候会将参数修改成list
#100
danerlt
opened
1 year ago
1
分布式问题
#99
ZTurboX
opened
1 year ago
0
There seems to be a problem with multithreading operations inside the model
#98
ZQFORWARD
closed
1 year ago
0
Returning dictionary instead of a list in provided callback to ThreadedStreamer
#97
cgr71ii
opened
1 year ago
0
基于paddle训练出的模型基于steamer进行处理报错
#96
XavierWonderful
opened
1 year ago
0
为什么我的batch_size无论设多大,处理时一次最多就接收10个
#95
Kuzhuahu
closed
2 years ago
2
某个worker死掉后,mp.Queue() get获取输入数据,锁无法释放bug
#94
lxsyz
opened
2 years ago
0
does service streamer support cpu deploy?
#93
zhanghaoie
opened
2 years ago
1
Worker_timeout
#92
MuhammadKhalid3975
opened
2 years ago
2
关于 streamer = Streamer(... cuda_devices=(0,1,2,3))时,gpu 0不被使用的问题
#91
WuZifan
opened
2 years ago
0
关于 (fastapi) 推理会阻塞(block)的解决方法
#90
yangtianyu92
opened
2 years ago
0
Is this project still active? Will a new version past 0.1.2 be published?
#89
LeBaronDean
opened
3 years ago
3
future won't be free in future_cache_ref when TimeoutError occurred
#88
Dwan-g
opened
3 years ago
1
请问如果我在服务器启动过程中想要实时修改batchsize和max latency要怎么做?
#87
Homura2333
opened
3 years ago
0
Correct typos in README.md
#86
skydice
opened
3 years ago
0
Detectron2 DefaultPredictor
#85
neerajvashistha
opened
3 years ago
0
Error on multi-threading !!!
#84
marcusau
opened
3 years ago
2
关于redis+multi_gpu
#83
syyuan14
opened
4 years ago
0
try add model_init_args & model_init_kwargs
#82
yangtianyu92
opened
4 years ago
2
可以配合tornado使用么?
#81
tengmao
opened
4 years ago
3
Timeout errors (with GPT2 and simple 'return' model)
#80
m4gr4th34
opened
4 years ago
7
请问有遇到过ValueError: Layer sequential expects 1 inputs, but it received 64 input tensors 的问题吗?
#79
LCG22
closed
4 years ago
1
self._task_id 问题
#78
yongzhuo
opened
4 years ago
0
improve redis worker stability
#77
starplanet
opened
4 years ago
0
Configurable WORKER_TIMEOUT
#76
yohokuno
closed
4 years ago
1
Configurable WORKER_TIMEOUT
#75
yohokuno
closed
4 years ago
0
Streamer worker没有正确分配到多台gpu上
#74
rubby33
closed
4 years ago
2
wrk压测时候,发生timeout 之后 服务卡死
#73
rubby33
closed
4 years ago
4
fix redis worker hang when redis connection is lost or redis server is restarted
#72
starplanet
closed
4 years ago
1
RuntimeError when using ManagedModel and TensorFlow
#71
yohokuno
closed
4 years ago
6
Question about System architect and design
#70
VJAYSLN
closed
4 years ago
2
TypeError: can't pickle _thread.RLock objects
#69
c0derm4n
opened
4 years ago
1
Could U please give a TensorFlow model example?
#68
yjiangling
closed
4 years ago
0
RedisStreamer如何配置batch_size&max_latency
#67
c0derm4n
opened
4 years ago
6
服务卡死现象
#66
caseware66
opened
4 years ago
3
redis.exceptions.Connectionerror: error 110 connection to localhost:1234 connection timed out
#65
LiuHao-THU
opened
4 years ago
3
Problem using flask_multigpu_example.py with gunicorn
#64
miangangzhen
opened
4 years ago
1
Problem using service_streamer on gunicorn setup
#63
vijay-tp
opened
4 years ago
1
if you keep insert task_id to input_queue, the system will never return...
#62
LiuHao-THU
closed
4 years ago
0
超时后future_cache不能正确释放
#61
wykdg
opened
4 years ago
10
Streamer Windows Support
#60
kogolobo
opened
4 years ago
1
Redis with auth
#59
absaravanan
opened
4 years ago
1
support single gpu multiple models loading
#58
Windrill
closed
4 years ago
0
在cpu上能获得加速吗?
#57
gikerch
closed
4 years ago
3
Passing additional arguments to predict function
#56
radao
closed
4 years ago
1
tf.keras 1.15.0+Streamer+keras_bert报错
#55
yongzhuo
closed
4 years ago
7
question about system design
#54
JuHyung-Son
closed
4 months ago
0
多gpu设置时只设置cuda_devices=(2,3)不起作用,仍然使用0,1,2,3四块卡
#53
YiLing28
closed
4 years ago
1
python多线程问题again~
#52
hxyshare
closed
4 years ago
5
Next