search

pytorch / serve

Serve, optimize and scale PyTorch models in production
https://pytorch.org/serve/
Apache License 2.0
4.17k stars 850 forks source link

code:405, type:"MethodNotAllowedException", message:"Requested method is not allowed, please refer to API document." #1110

Closed jigsawcoder closed 3 years ago

jigsawcoder commented 3 years ago

I am trying to deploy Scaled YOLOV4 object detection model. Below are the steps I followed: 1) Converted .pt model to .torchscript.pt model

2) Created new environment and installed all dependencies.

3) Converted torchscript model to mar model using the following code, torch-model-archiver --model-name scaled_yolov4_tablecell --version 1.0 --extra-files 'path to .torchscript file' --handler object_detector

4) Created model-store folder and pasted the mar file in it.

5) Stared torchserve using following command, torchserve --start --ncs --model-store /home/billion/47Billion/table_cell_detection/borderless_tablecell/model-server/model-store/ --models scaled_yolov4_tablecell.mar

6) Checked whether the model is registered or not and the status of the server curl -X GET http://127.0.0.1:8081/models

{ "models": [ { "modelName": "scaled_yolov4_tablecell", "modelUrl": "scaled_yolov4_tablecell.mar" } ] }

curl http://localhost:8080/ping

{ "status": "Healthy" }

I got the following log...

main org.pytorch.serve.servingsdk.impl.PluginsManager - Initializing plugins manager... 2021-06-07 00:02:18,418 [INFO ] main org.pytorch.serve.ModelServer - Torchserve version: 0.4.0 TS Home: /home/billion/47Billion/table_cell_detection/borderless_tablecell/yolo_torchserve/serving/lib/python3.8/site-packages Current directory: /home/billion/47Billion/table_cell_detection/borderless_tablecell/yolo_torchserve Temp directory: /tmp Number of GPUs: 0 Number of CPUs: 4 Max heap size: 3986 M Python executable: /home/billion/47Billion/table_cell_detection/borderless_tablecell/yolo_torchserve/serving/bin/python3 Config file: N/A Inference address: http://127.0.0.1:8080 Management address: http://127.0.0.1:8081 Metrics address: http://127.0.0.1:8082 Model Store: /home/billion/47Billion/table_cell_detection/borderless_tablecell/model-server/model-store Initial Models: N/A Log dir: /home/billion/47Billion/table_cell_detection/borderless_tablecell/yolo_torchserve/logs Metrics dir: /home/billion/47Billion/table_cell_detection/borderless_tablecell/yolo_torchserve/logs Netty threads: 0 Netty client threads: 0 Default workers per model: 4 Blacklist Regex: N/A Maximum Response Size: 6553500 Maximum Request Size: 6553500 Prefer direct buffer: false Allowed Urls: [file://.|http(s)?://.] Custom python dependency for model allowed: false Metrics report format: prometheus Enable metrics API: true Workflow Store: /home/billion/47Billion/table_cell_detection/borderless_tablecell/model-server/model-store 2021-06-07 00:02:18,436 [INFO ] main org.pytorch.serve.servingsdk.impl.PluginsManager - Loading snapshot serializer plugin... 2021-06-07 00:02:18,488 [INFO ] main org.pytorch.serve.ModelServer - Initialize Inference server with: EpollServerSocketChannel. 2021-06-07 00:02:18,630 [INFO ] main org.pytorch.serve.ModelServer - Inference API bind to: http://127.0.0.1:8080 2021-06-07 00:02:18,630 [INFO ] main org.pytorch.serve.ModelServer - Initialize Management server with: EpollServerSocketChannel. 2021-06-07 00:02:18,632 [INFO ] main org.pytorch.serve.ModelServer - Management API bind to: http://127.0.0.1:8081 2021-06-07 00:02:18,632 [INFO ] main org.pytorch.serve.ModelServer - Initialize Metrics server with: EpollServerSocketChannel. 2021-06-07 00:02:18,635 [INFO ] main org.pytorch.serve.ModelServer - Metrics API bind to: http://127.0.0.1:8082 Model server started. 2021-06-07 00:02:19,073 [INFO ] pool-2-thread-1 TS_METRICS - CPUUtilization.Percent:0.0|#Level:Host|#hostname:billion-Lenovo-B50-70,timestamp:1623004339 2021-06-07 00:02:19,075 [INFO ] pool-2-thread-1 TS_METRICS - DiskAvailable.Gigabytes:202.5420799255371|#Level:Host|#hostname:billion-Lenovo-B50-70,timestamp:1623004339 2021-06-07 00:02:19,075 [INFO ] pool-2-thread-1 TS_METRICS - DiskUsage.Gigabytes:231.13413619995117|#Level:Host|#hostname:billion-Lenovo-B50-70,timestamp:1623004339 2021-06-07 00:02:19,075 [INFO ] pool-2-thread-1 TS_METRICS - DiskUtilization.Percent:53.3|#Level:Host|#hostname:billion-Lenovo-B50-70,timestamp:1623004339 2021-06-07 00:02:19,076 [INFO ] pool-2-thread-1 TS_METRICS - MemoryAvailable.Megabytes:12359.21484375|#Level:Host|#hostname:billion-Lenovo-B50-70,timestamp:1623004339 2021-06-07 00:02:19,076 [INFO ] pool-2-thread-1 TS_METRICS - MemoryUsed.Megabytes:2626.8359375|#Level:Host|#hostname:billion-Lenovo-B50-70,timestamp:1623004339 2021-06-07 00:02:19,076 [INFO ] pool-2-thread-1 TS_METRICS - MemoryUtilization.Percent:22.5|#Level:Host|#hostname:billion-Lenovo-B50-70,timestamp:1623004339 2021-06-07 00:03:19,075 [INFO ] pool-2-thread-1 TS_METRICS - CPUUtilization.Percent:0.0|#Level:Host|#hostname:billion-Lenovo-B50-70,timestamp:1623004399 2021-06-07 00:03:19,076 [INFO ] pool-2-thread-1 TS_METRICS - DiskAvailable.Gigabytes:202.03667831420898|#Level:Host|#hostname:billion-Lenovo-B50-70,timestamp:1623004399 2021-06-07 00:03:19,076 [INFO ] pool-2-thread-1 TS_METRICS - DiskUsage.Gigabytes:231.63954162597656|#Level:Host|#hostname:billion-Lenovo-B50-70,timestamp:1623004399 2021-06-07 00:03:19,077 [INFO ] pool-2-thread-1 TS_METRICS - DiskUtilization.Percent:53.4|#Level:Host|#hostname:billion-Lenovo-B50-70,timestamp:1623004399 2021-06-07 00:03:19,077 [INFO ] pool-2-thread-1 TS_METRICS - MemoryAvailable.Megabytes:12335.22265625|#Level:Host|#hostname:billion-Lenovo-B50-70,timestamp:1623004399 2021-06-07 00:03:19,077 [INFO ] pool-2-thread-1 TS_METRICS - MemoryUsed.Megabytes:2666.046875|#Level:Host|#hostname:billion-Lenovo-B50-70,timestamp:1623004399 2021-06-07 00:03:19,078 [INFO ] pool-2-thread-1 TS_METRICS - MemoryUtilization.Percent:22.6|#Level:Host|#hostname:billion-Lenovo-B50-70,timestamp:1623004399 2021-06-07 00:03:33,334 [DEBUG] epollEventLoopGroup-3-1 org.pytorch.serve.wlm.ModelVersionedRefs - Adding new version 1 for model scaled_yolov4_tablecell 2021-06-07 00:03:33,335 [DEBUG] epollEventLoopGroup-3-1 org.pytorch.serve.wlm.ModelVersionedRefs - Setting default version to 1 for model scaled_yolov4_tablecell 2021-06-07 00:03:33,335 [INFO ] epollEventLoopGroup-3-1 org.pytorch.serve.wlm.ModelManager - Model scaled_yolov4_tablecell loaded. 2021-06-07 00:03:33,336 [DEBUG] epollEventLoopGroup-3-1 org.pytorch.serve.wlm.ModelManager - updateModel: scaled_yolov4_tablecell, count: 1 2021-06-07 00:03:34,083 [INFO ] W-9000-scaled_yolov4_tablecell_1-stdout MODEL_LOG - Listening on port: /tmp/.ts.sock.9000 2021-06-07 00:03:34,242 [INFO ] W-9000-scaled_yolov4_tablecell_1-stdout MODEL_LOG - [PID]11523 2021-06-07 00:03:34,243 [INFO ] W-9000-scaled_yolov4_tablecell_1-stdout MODEL_LOG - Torch worker started. 2021-06-07 00:03:34,243 [INFO ] W-9000-scaled_yolov4_tablecell_1-stdout MODEL_LOG - Python runtime: 3.8.5 2021-06-07 00:03:34,243 [DEBUG] W-9000-scaled_yolov4_tablecell_1 org.pytorch.serve.wlm.WorkerThread - W-9000-scaled_yolov4_tablecell_1 State change null -> WORKER_STARTED 2021-06-07 00:03:34,248 [INFO ] W-9000-scaled_yolov4_tablecell_1 org.pytorch.serve.wlm.WorkerThread - Connecting to: /tmp/.ts.sock.9000 2021-06-07 00:03:34,263 [INFO ] W-9000-scaled_yolov4_tablecell_1-stdout MODEL_LOG - Connection accepted: /tmp/.ts.sock.9000. 2021-06-07 00:03:36,586 [INFO ] W-9000-scaled_yolov4_tablecell_1-stdout MODEL_LOG - Missing the index_to_name.json file. Inference output will not include class name. 2021-06-07 00:03:36,587 [INFO ] W-9000-scaled_yolov4_tablecell_1 org.pytorch.serve.wlm.WorkerThread - Backend response time: 2292 2021-06-07 00:03:36,588 [DEBUG] W-9000-scaled_yolov4_tablecell_1 org.pytorch.serve.wlm.WorkerThread - W-9000-scaled_yolov4_tablecell_1 State change WORKER_STARTED -> WORKER_MODEL_LOADED 2021-06-07 00:03:36,588 [INFO ] W-9000-scaled_yolov4_tablecell_1 TS_METRICS - W-9000-scaled_yolov4_tablecell_1.ms:3247|#Level:Host|#hostname:billion-Lenovo-B50-70,timestamp:1623004416 2021-06-07 00:03:36,589 [INFO ] W-9000-scaled_yolov4_tablecell_1 TS_METRICS - WorkerThreadTime.ms:30|#Level:Host|#hostname:billion-Lenovo-B50-70,timestamp:null 2021-06-07 00:03:36,620 [INFO ] epollEventLoopGroup-3-1 ACCESS_LOG - /127.0.0.1:53270 "POST /models?initial_workers=1&synchronous=true&url=scaled_yolov4_tablecell.mar HTTP/1.1" 200 30063 2021-06-07 00:03:36,620 [INFO ] epollEventLoopGroup-3-1 TS_METRICS - Requests2XX.Count:1|#Level:Host|#hostname:billion-Lenovo-B50-70,timestamp:null 2021-06-07 00:04:09,195 [INFO ] epollEventLoopGroup-3-2 ACCESS_LOG - /127.0.0.1:53278 "PUT /models/foodnet?min_worker=3 HTTP/1.1" 404 2 2021-06-07 00:04:09,196 [INFO ] epollEventLoopGroup-3-2 TS_METRICS - Requests4XX.Count:1|#Level:Host|#hostname:billion-Lenovo-B50-70,timestamp:null 2021-06-07 00:04:19,066 [INFO ] pool-2-thread-1 TS_METRICS - CPUUtilization.Percent:0.0|#Level:Host|#hostname:billion-Lenovo-B50-70,timestamp:1623004459 2021-06-07 00:04:19,066 [INFO ] pool-2-thread-1 TS_METRICS - DiskAvailable.Gigabytes:201.47347259521484|#Level:Host|#hostname:billion-Lenovo-B50-70,timestamp:1623004459 2021-06-07 00:04:19,066 [INFO ] pool-2-thread-1 TS_METRICS - DiskUsage.Gigabytes:232.20274353027344|#Level:Host|#hostname:billion-Lenovo-B50-70,timestamp:1623004459 2021-06-07 00:04:19,067 [INFO ] pool-2-thread-1 TS_METRICS - DiskUtilization.Percent:53.5|#Level:Host|#hostname:billion-Lenovo-B50-70,timestamp:1623004459 2021-06-07 00:04:19,067 [INFO ] pool-2-thread-1 TS_METRICS - MemoryAvailable.Megabytes:11085.8125|#Level:Host|#hostname:billion-Lenovo-B50-70,timestamp:1623004459 2021-06-07 00:04:19,067 [INFO ] pool-2-thread-1 TS_METRICS - MemoryUsed.Megabytes:3906.17578125|#Level:Host|#hostname:billion-Lenovo-B50-70,timestamp:1623004459 2021-06-07 00:04:19,067 [INFO ] pool-2-thread-1 TS_METRICS - MemoryUtilization.Percent:30.5|#Level:Host|#hostname:billion-Lenovo-B50-70,timestamp:1623004459 2021-06-07 00:05:19,065 [INFO ] pool-2-thread-2 TS_METRICS - CPUUtilization.Percent:0.0|#Level:Host|#hostname:billion-Lenovo-B50-70,timestamp:1623004519 2021-06-07 00:05:19,066 [INFO ] pool-2-thread-2 TS_METRICS - DiskAvailable.Gigabytes:201.47345733642578|#Level:Host|#hostname:billion-Lenovo-B50-70,timestamp:1623004519 2021-06-07 00:05:19,066 [INFO ] pool-2-thread-2 TS_METRICS - DiskUsage.Gigabytes:232.2027587890625|#Level:Host|#hostname:billion-Lenovo-B50-70,timestamp:1623004519 2021-06-07 00:05:19,066 [INFO ] pool-2-thread-2 TS_METRICS - DiskUtilization.Percent:53.5|#Level:Host|#hostname:billion-Lenovo-B50-70,timestamp:1623004519 2021-06-07 00:05:19,066 [INFO ] pool-2-thread-2 TS_METRICS - MemoryAvailable.Megabytes:11087.11328125|#Level:Host|#hostname:billion-Lenovo-B50-70,timestamp:1623004519 2021-06-07 00:05:19,067 [INFO ] pool-2-thread-2 TS_METRICS - MemoryUsed.Megabytes:3905.21875|#Level:Host|#hostname:billion-Lenovo-B50-70,timestamp:1623004519 2021-06-07 00:05:19,067 [INFO ] pool-2-thread-2 TS_METRICS - MemoryUtilization.Percent:30.4|#Level:Host|#hostname:billion-Lenovo-B50-70,timestamp:1623004519 2021-06-07 00:06:19,064 [INFO ] pool-2-thread-2 TS_METRICS - CPUUtilization.Percent:0.0|#Level:Host|#hostname:billion-Lenovo-B50-70,timestamp:1623004579 2021-06-07 00:06:19,064 [INFO ] pool-2-thread-2 TS_METRICS - DiskAvailable.Gigabytes:201.4734649658203|#Level:Host|#hostname:billion-Lenovo-B50-70,timestamp:1623004579 2021-06-07 00:06:19,065 [INFO ] pool-2-thread-2 TS_METRICS - DiskUsage.Gigabytes:232.20275115966797|#Level:Host|#hostname:billion-Lenovo-B50-70,timestamp:1623004579 2021-06-07 00:06:19,065 [INFO ] pool-2-thread-2 TS_METRICS - DiskUtilization.Percent:53.5|#Level:Host|#hostname:billion-Lenovo-B50-70,timestamp:1623004579 2021-06-07 00:06:19,065 [INFO ] pool-2-thread-2 TS_METRICS - MemoryAvailable.Megabytes:11092.88671875|#Level:Host|#hostname:billion-Lenovo-B50-70,timestamp:1623004579 2021-06-07 00:06:19,066 [INFO ] pool-2-thread-2 TS_METRICS - MemoryUsed.Megabytes:3898.94921875|#Level:Host|#hostname:billion-Lenovo-B50-70,timestamp:1623004579 2021-06-07 00:06:19,066 [INFO ] pool-2-thread-2 TS_METRICS - MemoryUtilization.Percent:30.4|#Level:Host|#hostname:billion-Lenovo-B50-70,timestamp:1623004579 2021-06-07 00:06:42,299 [INFO ] epollEventLoopGroup-3-3 ACCESS_LOG - /127.0.0.1:53282 "PUT /models/scaled_yolov4_tabelcell?min_worker=3 HTTP/1.1" 404 0 2021-06-07 00:06:42,299 [INFO ] epollEventLoopGroup-3-3 TS_METRICS - Requests4XX.Count:1|#Level:Host|#hostname:billion-Lenovo-B50-70,timestamp:null 2021-06-07 00:07:19,064 [INFO ] pool-2-thread-1 TS_METRICS - CPUUtilization.Percent:0.0|#Level:Host|#hostname:billion-Lenovo-B50-70,timestamp:1623004639 2021-06-07 00:07:19,065 [INFO ] pool-2-thread-1 TS_METRICS - DiskAvailable.Gigabytes:201.47344207763672|#Level:Host|#hostname:billion-Lenovo-B50-70,timestamp:1623004639 2021-06-07 00:07:19,065 [INFO ] pool-2-thread-1 TS_METRICS - DiskUsage.Gigabytes:232.20277404785156|#Level:Host|#hostname:billion-Lenovo-B50-70,timestamp:1623004639 2021-06-07 00:07:19,065 [INFO ] pool-2-thread-1 TS_METRICS - DiskUtilization.Percent:53.5|#Level:Host|#hostname:billion-Lenovo-B50-70,timestamp:1623004639 2021-06-07 00:07:19,066 [INFO ] pool-2-thread-1 TS_METRICS - MemoryAvailable.Megabytes:11083.26171875|#Level:Host|#hostname:billion-Lenovo-B50-70,timestamp:1623004639 2021-06-07 00:07:19,066 [INFO ] pool-2-thread-1 TS_METRICS - MemoryUsed.Megabytes:3908.7578125|#Level:Host|#hostname:billion-Lenovo-B50-70,timestamp:1623004639 2021-06-07 00:07:19,066 [INFO ] pool-2-thread-1 TS_METRICS - MemoryUtilization.Percent:30.5|#Level:Host|#hostname:billion-Lenovo-B50-70,timestamp:1623004639 2021-06-07 00:08:19,063 [INFO ] pool-2-thread-1 TS_METRICS - CPUUtilization.Percent:100.0|#Level:Host|#hostname:billion-Lenovo-B50-70,timestamp:1623004699 2021-06-07 00:08:19,064 [INFO ] pool-2-thread-1 TS_METRICS - DiskAvailable.Gigabytes:201.47357177734375|#Level:Host|#hostname:billion-Lenovo-B50-70,timestamp:1623004699 2021-06-07 00:08:19,064 [INFO ] pool-2-thread-1 TS_METRICS - DiskUsage.Gigabytes:232.20264434814453|#Level:Host|#hostname:billion-Lenovo-B50-70,timestamp:1623004699 2021-06-07 00:08:19,064 [INFO ] pool-2-thread-1 TS_METRICS - DiskUtilization.Percent:53.5|#Level:Host|#hostname:billion-Lenovo-B50-70,timestamp:1623004699 2021-06-07 00:08:19,064 [INFO ] pool-2-thread-1 TS_METRICS - MemoryAvailable.Megabytes:11079.484375|#Level:Host|#hostname:billion-Lenovo-B50-70,timestamp:1623004699 2021-06-07 00:08:19,065 [INFO ] pool-2-thread-1 TS_METRICS - MemoryUsed.Megabytes:3907.734375|#Level:Host|#hostname:billion-Lenovo-B50-70,timestamp:1623004699 2021-06-07 00:08:19,065 [INFO ] pool-2-thread-1 TS_METRICS - MemoryUtilization.Percent:30.5|#Level:Host|#hostname:billion-Lenovo-B50-70,timestamp:1623004699 2021-06-07 00:08:42,730 [INFO ] epollEventLoopGroup-3-4 ACCESS_LOG - /127.0.0.1:34728 "GET / HTTP/1.1" 405 1 2021-06-07 00:08:42,730 [INFO ] epollEventLoopGroup-3-4 TS_METRICS - Requests4XX.Count:1|#Level:Host|#hostname:billion-Lenovo-B50-70,timestamp:null 2021-06-07 00:09:19,062 [INFO ] pool-2-thread-1 TS_METRICS - CPUUtilization.Percent:0.0|#Level:Host|#hostname:billion-Lenovo-B50-70,timestamp:1623004759 2021-06-07 00:09:19,063 [INFO ] pool-2-thread-1 TS_METRICS - DiskAvailable.Gigabytes:201.47352981567383|#Level:Host|#hostname:billion-Lenovo-B50-70,timestamp:1623004759 2021-06-07 00:09:19,063 [INFO ] pool-2-thread-1 TS_METRICS - DiskUsage.Gigabytes:232.20268630981445|#Level:Host|#hostname:billion-Lenovo-B50-70,timestamp:1623004759 2021-06-07 00:09:19,064 [INFO ] pool-2-thread-1 TS_METRICS - DiskUtilization.Percent:53.5|#Level:Host|#hostname:billion-Lenovo-B50-70,timestamp:1623004759 2021-06-07 00:09:19,064 [INFO ] pool-2-thread-1 TS_METRICS - MemoryAvailable.Megabytes:11052.05078125|#Level:Host|#hostname:billion-Lenovo-B50-70,timestamp:1623004759 2021-06-07 00:09:19,064 [INFO ] pool-2-thread-1 TS_METRICS - MemoryUsed.Megabytes:3945.51171875|#Level:Host|#hostname:billion-Lenovo-B50-70,timestamp:1623004759 2021-06-07 00:09:19,064 [INFO ] pool-2-thread-1 TS_METRICS - MemoryUtilization.Percent:30.7|#Level:Host|#hostname:billion-Lenovo-B50-70,timestamp:1623004759 2021-06-07 00:10:19,065 [INFO ] pool-2-thread-2 TS_METRICS - CPUUtilization.Percent:0.0|#Level:Host|#hostname:billion-Lenovo-B50-70,timestamp:1623004819 2021-06-07 00:10:19,065 [INFO ] pool-2-thread-2 TS_METRICS - DiskAvailable.Gigabytes:201.47339630126953|#Level:Host|#hostname:billion-Lenovo-B50-70,timestamp:1623004819 2021-06-07 00:10:19,066 [INFO ] pool-2-thread-2 TS_METRICS - DiskUsage.Gigabytes:232.20281982421875|#Level:Host|#hostname:billion-Lenovo-B50-70,timestamp:1623004819 2021-06-07 00:10:19,067 [INFO ] pool-2-thread-2 TS_METRICS - DiskUtilization.Percent:53.5|#Level:Host|#hostname:billion-Lenovo-B50-70,timestamp:1623004819 2021-06-07 00:10:19,067 [INFO ] pool-2-thread-2 TS_METRICS - MemoryAvailable.Megabytes:11029.1875|#Level:Host|#hostname:billion-Lenovo-B50-70,timestamp:1623004819 2021-06-07 00:10:19,067 [INFO ] pool-2-thread-2 TS_METRICS - MemoryUsed.Megabytes:3967.6328125|#Level:Host|#hostname:billion-Lenovo-B50-70,timestamp:1623004819 2021-06-07 00:10:19,067 [INFO ] pool-2-thread-2 TS_METRICS - MemoryUtilization.Percent:30.8|#Level:Host|#hostname:billion-Lenovo-B50-70,timestamp:1623004819 2021-06-07 00:11:19,071 [INFO ] pool-2-thread-2 TS_METRICS - CPUUtilization.Percent:0.0|#Level:Host|#hostname:billion-Lenovo-B50-70,timestamp:1623004879 2021-06-07 00:11:19,071 [INFO ] pool-2-thread-2 TS_METRICS - DiskAvailable.Gigabytes:201.47330856323242|#Level:Host|#hostname:billion-Lenovo-B50-70,timestamp:1623004879 2021-06-07 00:11:19,072 [INFO ] pool-2-thread-2 TS_METRICS - DiskUsage.Gigabytes:232.20290756225586|#Level:Host|#hostname:billion-Lenovo-B50-70,timestamp:1623004879 2021-06-07 00:11:19,072 [INFO ] pool-2-thread-2 TS_METRICS - DiskUtilization.Percent:53.5|#Level:Host|#hostname:billion-Lenovo-B50-70,timestamp:1623004879 2021-06-07 00:11:19,072 [INFO ] pool-2-thread-2 TS_METRICS - MemoryAvailable.Megabytes:11012.90625|#Level:Host|#hostname:billion-Lenovo-B50-70,timestamp:1623004879 2021-06-07 00:11:19,072 [INFO ] pool-2-thread-2 TS_METRICS - MemoryUsed.Megabytes:3978.9375|#Level:Host|#hostname:billion-Lenovo-B50-70,timestamp:1623004879 2021-06-07 00:11:19,072 [INFO ] pool-2-thread-2 TS_METRICS - MemoryUtilization.Percent:30.9|#Level:Host|#hostname:billion-Lenovo-B50-70,timestamp:1623004879 2021-06-07 00:11:38,808 [INFO ] epollEventLoopGroup-3-5 ACCESS_LOG - /127.0.0.1:34754 "GET / HTTP/1.1" 405 0 2021-06-07 00:11:38,809 [INFO ] epollEventLoopGroup-3-5 TS_METRICS - Requests4XX.Count:1|#Level:Host|#hostname:billion-Lenovo-B50-70,timestamp:null 2021-06-07 00:12:19,067 [INFO ] pool-2-thread-1 TS_METRICS - CPUUtilization.Percent:100.0|#Level:Host|#hostname:billion-Lenovo-B50-70,timestamp:1623004939 2021-06-07 00:12:19,067 [INFO ] pool-2-thread-1 TS_METRICS - DiskAvailable.Gigabytes:201.4732780456543|#Level:Host|#hostname:billion-Lenovo-B50-70,timestamp:1623004939 2021-06-07 00:12:19,068 [INFO ] pool-2-thread-1 TS_METRICS - DiskUsage.Gigabytes:232.20293807983398|#Level:Host|#hostname:billion-Lenovo-B50-70,timestamp:1623004939 2021-06-07 00:12:19,068 [INFO ] pool-2-thread-1 TS_METRICS - DiskUtilization.Percent:53.5|#Level:Host|#hostname:billion-Lenovo-B50-70,timestamp:1623004939 2021-06-07 00:12:19,068 [INFO ] pool-2-thread-1 TS_METRICS - MemoryAvailable.Megabytes:10991.5234375|#Level:Host|#hostname:billion-Lenovo-B50-70,timestamp:1623004939 2021-06-07 00:12:19,069 [INFO ] pool-2-thread-1 TS_METRICS - MemoryUsed.Megabytes:4005.8203125|#Level:Host|#hostname:billion-Lenovo-B50-70,timestamp:1623004939 2021-06-07 00:12:19,069 [INFO ] pool-2-thread-1 TS_METRICS - MemoryUtilization.Percent:31.0|#Level:Host|#hostname:billion-Lenovo-B50-70,timestamp:1623004939 2021-06-07 00:13:19,066 [INFO ] pool-2-thread-1 TS_METRICS - CPUUtilization.Percent:0.0|#Level:Host|#hostname:billion-Lenovo-B50-70,timestamp:1623004999 2021-06-07 00:13:19,066 [INFO ] pool-2-thread-1 TS_METRICS - DiskAvailable.Gigabytes:201.47271728515625|#Level:Host|#hostname:billion-Lenovo-B50-70,timestamp:1623004999 2021-06-07 00:13:19,066 [INFO ] pool-2-thread-1 TS_METRICS - DiskUsage.Gigabytes:232.20349884033203|#Level:Host|#hostname:billion-Lenovo-B50-70,timestamp:1623004999 2021-06-07 00:13:19,066 [INFO ] pool-2-thread-1 TS_METRICS - DiskUtilization.Percent:53.5|#Level:Host|#hostname:billion-Lenovo-B50-70,timestamp:1623004999 2021-06-07 00:13:19,067 [INFO ] pool-2-thread-1 TS_METRICS - MemoryAvailable.Megabytes:10965.4765625|#Level:Host|#hostname:billion-Lenovo-B50-70,timestamp:1623004999 2021-06-07 00:13:19,067 [INFO ] pool-2-thread-1 TS_METRICS - MemoryUsed.Megabytes:4026.4375|#Level:Host|#hostname:billion-Lenovo-B50-70,timestamp:1623004999 2021-06-07 00:13:19,067 [INFO ] pool-2-thread-1 TS_METRICS - MemoryUtilization.Percent:31.2|#Level:Host|#hostname:billion-Lenovo-B50-70,timestamp:1623004999 2021-06-07 00:13:30,128 [INFO ] epollEventLoopGroup-3-6 ACCESS_LOG - /127.0.0.1:53346 "GET /models HTTP/1.1" 200 26 2021-06-07 00:13:30,128 [INFO ] epollEventLoopGroup-3-6 TS_METRICS - Requests2XX.Count:1|#Level:Host|#hostname:billion-Lenovo-B50-70,timestamp:null 2021-06-07 00:14:19,064 [INFO ] pool-2-thread-1 TS_METRICS - CPUUtilization.Percent:0.0|#Level:Host|#hostname:billion-Lenovo-B50-70,timestamp:1623005059 2021-06-07 00:14:19,065 [INFO ] pool-2-thread-1 TS_METRICS - DiskAvailable.Gigabytes:201.47271728515625|#Level:Host|#hostname:billion-Lenovo-B50-70,timestamp:1623005059 2021-06-07 00:14:19,065 [INFO ] pool-2-thread-1 TS_METRICS - DiskUsage.Gigabytes:232.20349884033203|#Level:Host|#hostname:billion-Lenovo-B50-70,timestamp:1623005059 2021-06-07 00:14:19,065 [INFO ] pool-2-thread-1 TS_METRICS - DiskUtilization.Percent:53.5|#Level:Host|#hostname:billion-Lenovo-B50-70,timestamp:1623005059 2021-06-07 00:14:19,065 [INFO ] pool-2-thread-1 TS_METRICS - MemoryAvailable.Megabytes:10990.5|#Level:Host|#hostname:billion-Lenovo-B50-70,timestamp:1623005059 2021-06-07 00:14:19,065 [INFO ] pool-2-thread-1 TS_METRICS - MemoryUsed.Megabytes:4009.8203125|#Level:Host|#hostname:billion-Lenovo-B50-70,timestamp:1623005059 2021-06-07 00:14:19,066 [INFO ] pool-2-thread-1 TS_METRICS - MemoryUtilization.Percent:31.1|#Level:Host|#hostname:billion-Lenovo-B50-70,timestamp:1623005059 2021-06-07 00:14:27,983 [DEBUG] epollEventLoopGroup-3-7 org.pytorch.serve.wlm.ModelManager - updateModel: scaled_yolov4_tablecell, count: 3 2021-06-07 00:14:27,988 [INFO ] epollEventLoopGroup-3-7 ACCESS_LOG - /127.0.0.1:53350 "PUT /models/scaled_yolov4_tablecell?min_worker=3 HTTP/1.1" 202 5 2021-06-07 00:14:27,988 [INFO ] epollEventLoopGroup-3-7 TS_METRICS - Requests2XX.Count:1|#Level:Host|#hostname:billion-Lenovo-B50-70,timestamp:null 2021-06-07 00:14:28,881 [INFO ] W-9001-scaled_yolov4_tablecell_1-stdout MODEL_LOG - Listening on port: /tmp/.ts.sock.9001 2021-06-07 00:14:28,882 [INFO ] W-9001-scaled_yolov4_tablecell_1-stdout MODEL_LOG - [PID]11794 2021-06-07 00:14:28,882 [INFO ] W-9001-scaled_yolov4_tablecell_1-stdout MODEL_LOG - Torch worker started. 2021-06-07 00:14:28,882 [DEBUG] W-9001-scaled_yolov4_tablecell_1 org.pytorch.serve.wlm.WorkerThread - W-9001-scaled_yolov4_tablecell_1 State change null -> WORKER_STARTED 2021-06-07 00:14:28,883 [INFO ] W-9001-scaled_yolov4_tablecell_1 org.pytorch.serve.wlm.WorkerThread - Connecting to: /tmp/.ts.sock.9001 2021-06-07 00:14:28,884 [INFO ] W-9001-scaled_yolov4_tablecell_1-stdout MODEL_LOG - Python runtime: 3.8.5 2021-06-07 00:14:28,885 [INFO ] W-9001-scaled_yolov4_tablecell_1-stdout MODEL_LOG - Connection accepted: /tmp/.ts.sock.9001. 2021-06-07 00:14:28,902 [INFO ] W-9002-scaled_yolov4_tablecell_1-stdout MODEL_LOG - Listening on port: /tmp/.ts.sock.9002 2021-06-07 00:14:28,902 [INFO ] W-9002-scaled_yolov4_tablecell_1-stdout MODEL_LOG - [PID]11797 2021-06-07 00:14:28,903 [INFO ] W-9002-scaled_yolov4_tablecell_1-stdout MODEL_LOG - Torch worker started. 2021-06-07 00:14:28,903 [DEBUG] W-9002-scaled_yolov4_tablecell_1 org.pytorch.serve.wlm.WorkerThread - W-9002-scaled_yolov4_tablecell_1 State change null -> WORKER_STARTED 2021-06-07 00:14:28,903 [INFO ] W-9002-scaled_yolov4_tablecell_1-stdout MODEL_LOG - Python runtime: 3.8.5 2021-06-07 00:14:28,903 [INFO ] W-9002-scaled_yolov4_tablecell_1 org.pytorch.serve.wlm.WorkerThread - Connecting to: /tmp/.ts.sock.9002 2021-06-07 00:14:28,905 [INFO ] W-9002-scaled_yolov4_tablecell_1-stdout MODEL_LOG - Connection accepted: /tmp/.ts.sock.9002. 2021-06-07 00:14:31,637 [INFO ] W-9001-scaled_yolov4_tablecell_1-stdout MODEL_LOG - Missing the index_to_name.json file. Inference output will not include class name. 2021-06-07 00:14:31,637 [INFO ] W-9001-scaled_yolov4_tablecell_1 org.pytorch.serve.wlm.WorkerThread - Backend response time: 2738 2021-06-07 00:14:31,638 [DEBUG] W-9001-scaled_yolov4_tablecell_1 org.pytorch.serve.wlm.WorkerThread - W-9001-scaled_yolov4_tablecell_1 State change WORKER_STARTED -> WORKER_MODEL_LOADED 2021-06-07 00:14:31,638 [INFO ] W-9001-scaled_yolov4_tablecell_1 TS_METRICS - W-9001-scaled_yolov4_tablecell_1.ms:3654|#Level:Host|#hostname:billion-Lenovo-B50-70,timestamp:1623005071 2021-06-07 00:14:31,638 [INFO ] W-9001-scaled_yolov4_tablecell_1 TS_METRICS - WorkerThreadTime.ms:15|#Level:Host|#hostname:billion-Lenovo-B50-70,timestamp:null 2021-06-07 00:14:31,639 [INFO ] W-9002-scaled_yolov4_tablecell_1-stdout MODEL_LOG - Missing the index_to_name.json file. Inference output will not include class name. 2021-06-07 00:14:31,639 [INFO ] W-9002-scaled_yolov4_tablecell_1 org.pytorch.serve.wlm.WorkerThread - Backend response time: 2733 2021-06-07 00:14:31,640 [DEBUG] W-9002-scaled_yolov4_tablecell_1 org.pytorch.serve.wlm.WorkerThread - W-9002-scaled_yolov4_tablecell_1 State change WORKER_STARTED -> WORKER_MODEL_LOADED 2021-06-07 00:14:31,640 [INFO ] W-9002-scaled_yolov4_tablecell_1 TS_METRICS - W-9002-scaled_yolov4_tablecell_1.ms:3656|#Level:Host|#hostname:billion-Lenovo-B50-70,timestamp:1623005071 2021-06-07 00:14:31,640 [INFO ] W-9002-scaled_yolov4_tablecell_1 TS_METRICS - WorkerThreadTime.ms:2|#Level:Host|#hostname:billion-Lenovo-B50-70,timestamp:null 2021-06-07 00:15:19,064 [INFO ] pool-2-thread-1 TS_METRICS - CPUUtilization.Percent:0.0|#Level:Host|#hostname:billion-Lenovo-B50-70,timestamp:1623005119 2021-06-07 00:15:19,064 [INFO ] pool-2-thread-1 TS_METRICS - DiskAvailable.Gigabytes:201.47269821166992|#Level:Host|#hostname:billion-Lenovo-B50-70,timestamp:1623005119 2021-06-07 00:15:19,064 [INFO ] pool-2-thread-1 TS_METRICS - DiskUsage.Gigabytes:232.20351791381836|#Level:Host|#hostname:billion-Lenovo-B50-70,timestamp:1623005119 2021-06-07 00:15:19,065 [INFO ] pool-2-thread-1 TS_METRICS - DiskUtilization.Percent:53.5|#Level:Host|#hostname:billion-Lenovo-B50-70,timestamp:1623005119 2021-06-07 00:15:19,065 [INFO ] pool-2-thread-1 TS_METRICS - MemoryAvailable.Megabytes:8553.57421875|#Level:Host|#hostname:billion-Lenovo-B50-70,timestamp:1623005119 2021-06-07 00:15:19,065 [INFO ] pool-2-thread-1 TS_METRICS - MemoryUsed.Megabytes:6447.1015625|#Level:Host|#hostname:billion-Lenovo-B50-70,timestamp:1623005119 2021-06-07 00:15:19,065 [INFO ] pool-2-thread-1 TS_METRICS - MemoryUtilization.Percent:46.3|#Level:Host|#hostname:billion-Lenovo-B50-70,timestamp:1623005119 2021-06-07 00:16:15,828 [INFO ] epollEventLoopGroup-3-8 ACCESS_LOG - /127.0.0.1:34790 "GET / HTTP/1.1" 405 0 2021-06-07 00:16:15,828 [INFO ] epollEventLoopGroup-3-8 TS_METRICS - Requests4XX.Count:1|#Level:Host|#hostname:billion-Lenovo-B50-70,timestamp:null 2021-06-07 00:16:19,065 [INFO ] pool-2-thread-2 TS_METRICS - CPUUtilization.Percent:0.0|#Level:Host|#hostname:billion-Lenovo-B50-70,timestamp:1623005179 2021-06-07 00:16:19,066 [INFO ] pool-2-thread-2 TS_METRICS - DiskAvailable.Gigabytes:201.4727020263672|#Level:Host|#hostname:billion-Lenovo-B50-70,timestamp:1623005179 2021-06-07 00:16:19,066 [INFO ] pool-2-thread-2 TS_METRICS - DiskUsage.Gigabytes:232.2035140991211|#Level:Host|#hostname:billion-Lenovo-B50-70,timestamp:1623005179 2021-06-07 00:16:19,066 [INFO ] pool-2-thread-2 TS_METRICS - DiskUtilization.Percent:53.5|#Level:Host|#hostname:billion-Lenovo-B50-70,timestamp:1623005179 2021-06-07 00:16:19,066 [INFO ] pool-2-thread-2 TS_METRICS - MemoryAvailable.Megabytes:8553.015625|#Level:Host|#hostname:billion-Lenovo-B50-70,timestamp:1623005179 2021-06-07 00:16:19,066 [INFO ] pool-2-thread-2 TS_METRICS - MemoryUsed.Megabytes:6456.35546875|#Level:Host|#hostname:billion-Lenovo-B50-70,timestamp:1623005179 2021-06-07 00:16:19,066 [INFO ] pool-2-thread-2 TS_METRICS - MemoryUtilization.Percent:46.3|#Level:Host|#hostname:billion-Lenovo-B50-70,timestamp:1623005179 2021-06-07 00:16:28,039 [INFO ] epollEventLoopGroup-3-1 ACCESS_LOG - /127.0.0.1:34796 "GET / HTTP/1.1" 405 0 2021-06-07 00:16:28,040 [INFO ] epollEventLoopGroup-3-1 TS_METRICS - Requests4XX.Count:1|#Level:Host|#hostname:billion-Lenovo-B50-70,timestamp:null 2021-06-07 00:16:32,773 [INFO ] epollEventLoopGroup-3-2 ACCESS_LOG - /127.0.0.1:53368 "GET / HTTP/1.1" 405 0 2021-06-07 00:16:32,773 [INFO ] epollEventLoopGroup-3-2 TS_METRICS - Requests4XX.Count:1|#Level:Host|#hostname:billion-Lenovo-B50-70,timestamp:null 2021-06-07 00:16:34,892 [INFO ] epollEventLoopGroup-4-1 ACCESS_LOG - /127.0.0.1:45800 "GET / HTTP/1.1" 405 0 2021-06-07 00:16:34,892 [INFO ] epollEventLoopGroup-4-1 TS_METRICS - Requests4XX.Count:1|#Level:Host|#hostname:billion-Lenovo-B50-70,timestamp:null 2021-06-07 00:17:19,076 [INFO ] pool-2-thread-2 TS_METRICS - CPUUtilization.Percent:0.0|#Level:Host|#hostname:billion-Lenovo-B50-70,timestamp:1623005239 2021-06-07 00:17:19,076 [INFO ] pool-2-thread-2 TS_METRICS - DiskAvailable.Gigabytes:201.47254180908203|#Level:Host|#hostname:billion-Lenovo-B50-70,timestamp:1623005239 2021-06-07 00:17:19,076 [INFO ] pool-2-thread-2 TS_METRICS - DiskUsage.Gigabytes:232.20367431640625|#Level:Host|#hostname:billion-Lenovo-B50-70,timestamp:1623005239 2021-06-07 00:17:19,076 [INFO ] pool-2-thread-2 TS_METRICS - DiskUtilization.Percent:53.5|#Level:Host|#hostname:billion-Lenovo-B50-70,timestamp:1623005239 2021-06-07 00:17:19,077 [INFO ] pool-2-thread-2 TS_METRICS - MemoryAvailable.Megabytes:8561.828125|#Level:Host|#hostname:billion-Lenovo-B50-70,timestamp:1623005239 2021-06-07 00:17:19,078 [INFO ] pool-2-thread-2 TS_METRICS - MemoryUsed.Megabytes:6428.21484375|#Level:Host|#hostname:billion-Lenovo-B50-70,timestamp:1623005239 2021-06-07 00:17:19,083 [INFO ] pool-2-thread-2 TS_METRICS - MemoryUtilization.Percent:46.3|#Level:Host|#hostname:billion-Lenovo-B50-70,timestamp:1623005239 2021-06-07 00:18:19,070 [INFO ] pool-2-thread-1 TS_METRICS - CPUUtilization.Percent:0.0|#Level:Host|#hostname:billion-Lenovo-B50-70,timestamp:1623005299 2021-06-07 00:18:19,070 [INFO ] pool-2-thread-1 TS_METRICS - DiskAvailable.Gigabytes:201.4723892211914|#Level:Host|#hostname:billion-Lenovo-B50-70,timestamp:1623005299 2021-06-07 00:18:19,071 [INFO ] pool-2-thread-1 TS_METRICS - DiskUsage.Gigabytes:232.20382690429688|#Level:Host|#hostname:billion-Lenovo-B50-70,timestamp:1623005299 2021-06-07 00:18:19,071 [INFO ] pool-2-thread-1 TS_METRICS - DiskUtilization.Percent:53.5|#Level:Host|#hostname:billion-Lenovo-B50-70,timestamp:1623005299 2021-06-07 00:18:19,071 [INFO ] pool-2-thread-1 TS_METRICS - MemoryAvailable.Megabytes:8543.109375|#Level:Host|#hostname:billion-Lenovo-B50-70,timestamp:1623005299 2021-06-07 00:18:19,071 [INFO ] pool-2-thread-1 TS_METRICS - MemoryUsed.Megabytes:6452.421875|#Level:Host|#hostname:billion-Lenovo-B50-70,timestamp:1623005299 2021-06-07 00:18:19,071 [INFO ] pool-2-thread-1 TS_METRICS - MemoryUtilization.Percent:46.4|#Level:Host|#hostname:billion-Lenovo-B50-70,timestamp:1623005299 2021-06-07 00:19:19,066 [INFO ] pool-2-thread-1 TS_METRICS - CPUUtilization.Percent:0.0|#Level:Host|#hostname:billion-Lenovo-B50-70,timestamp:1623005359 2021-06-07 00:19:19,066 [INFO ] pool-2-thread-1 TS_METRICS - DiskAvailable.Gigabytes:201.4723243713379|#Level:Host|#hostname:billion-Lenovo-B50-70,timestamp:1623005359 2021-06-07 00:19:19,066 [INFO ] pool-2-thread-1 TS_METRICS - DiskUsage.Gigabytes:232.2038917541504|#Level:Host|#hostname:billion-Lenovo-B50-70,timestamp:1623005359 2021-06-07 00:19:19,067 [INFO ] pool-2-thread-1 TS_METRICS - DiskUtilization.Percent:53.5|#Level:Host|#hostname:billion-Lenovo-B50-70,timestamp:1623005359 2021-06-07 00:19:19,067 [INFO ] pool-2-thread-1 TS_METRICS - MemoryAvailable.Megabytes:8549.8671875|#Level:Host|#hostname:billion-Lenovo-B50-70,timestamp:1623005359 2021-06-07 00:19:19,067 [INFO ] pool-2-thread-1 TS_METRICS - MemoryUsed.Megabytes:6450.7578125|#Level:Host|#hostname:billion-Lenovo-B50-70,timestamp:1623005359 2021-06-07 00:19:19,067 [INFO ] pool-2-thread-1 TS_METRICS - MemoryUtilization.Percent:46.4|#Level:Host|#hostname:billion-Lenovo-B50-70,timestamp:1623005359 2021-06-07 00:20:19,069 [INFO ] pool-2-thread-2 TS_METRICS - CPUUtilization.Percent:0.0|#Level:Host|#hostname:billion-Lenovo-B50-70,timestamp:1623005419 2021-06-07 00:20:19,069 [INFO ] pool-2-thread-2 TS_METRICS - DiskAvailable.Gigabytes:201.47233200073242|#Level:Host|#hostname:billion-Lenovo-B50-70,timestamp:1623005419 2021-06-07 00:20:19,070 [INFO ] pool-2-thread-2 TS_METRICS - DiskUsage.Gigabytes:232.20388412475586|#Level:Host|#hostname:billion-Lenovo-B50-70,timestamp:1623005419 2021-06-07 00:20:19,070 [INFO ] pool-2-thread-2 TS_METRICS - DiskUtilization.Percent:53.5|#Level:Host|#hostname:billion-Lenovo-B50-70,timestamp:1623005419 2021-06-07 00:20:19,071 [INFO ] pool-2-thread-2 TS_METRICS - MemoryAvailable.Megabytes:8555.1484375|#Level:Host|#hostname:billion-Lenovo-B50-70,timestamp:1623005419 2021-06-07 00:20:19,071 [INFO ] pool-2-thread-2 TS_METRICS - MemoryUsed.Megabytes:6450.03515625|#Level:Host|#hostname:billion-Lenovo-B50-70,timestamp:1623005419 2021-06-07 00:20:19,071 [INFO ] pool-2-thread-2 TS_METRICS - MemoryUtilization.Percent:46.3|#Level:Host|#hostname:billion-Lenovo-B50-70,timestamp:1623005419 2021-06-07 00:21:19,078 [INFO ] pool-2-thread-1 TS_METRICS - CPUUtilization.Percent:0.0|#Level:Host|#hostname:billion-Lenovo-B50-70,timestamp:1623005479 2021-06-07 00:21:19,078 [INFO ] pool-2-thread-1 TS_METRICS - DiskAvailable.Gigabytes:201.4723014831543|#Level:Host|#hostname:billion-Lenovo-B50-70,timestamp:1623005479 2021-06-07 00:21:19,078 [INFO ] pool-2-thread-1 TS_METRICS - DiskUsage.Gigabytes:232.20391464233398|#Level:Host|#hostname:billion-Lenovo-B50-70,timestamp:1623005479 2021-06-07 00:21:19,079 [INFO ] pool-2-thread-1 TS_METRICS - DiskUtilization.Percent:53.5|#Level:Host|#hostname:billion-Lenovo-B50-70,timestamp:1623005479 2021-06-07 00:21:19,079 [INFO ] pool-2-thread-1 TS_METRICS - MemoryAvailable.Megabytes:8538.91796875|#Level:Host|#hostname:billion-Lenovo-B50-70,timestamp:1623005479 2021-06-07 00:21:19,079 [INFO ] pool-2-thread-1 TS_METRICS - MemoryUsed.Megabytes:6459.62890625|#Level:Host|#hostname:billion-Lenovo-B50-70,timestamp:1623005479 2021-06-07 00:21:19,079 [INFO ] pool-2-thread-1 TS_METRICS - MemoryUtilization.Percent:46.4|#Level:Host|#hostname:billion-Lenovo-B50-70,timestamp:1623005479 2021-06-07 00:22:19,066 [INFO ] pool-2-thread-1 TS_METRICS - CPUUtilization.Percent:0.0|#Level:Host|#hostname:billion-Lenovo-B50-70,timestamp:1623005539 2021-06-07 00:22:19,067 [INFO ] pool-2-thread-1 TS_METRICS - DiskAvailable.Gigabytes:201.47230911254883|#Level:Host|#hostname:billion-Lenovo-B50-70,timestamp:1623005539 2021-06-07 00:22:19,067 [INFO ] pool-2-thread-1 TS_METRICS - DiskUsage.Gigabytes:232.20390701293945|#Level:Host|#hostname:billion-Lenovo-B50-70,timestamp:1623005539 2021-06-07 00:22:19,067 [INFO ] pool-2-thread-1 TS_METRICS - DiskUtilization.Percent:53.5|#Level:Host|#hostname:billion-Lenovo-B50-70,timestamp:1623005539 2021-06-07 00:22:19,067 [INFO ] pool-2-thread-1 TS_METRICS - MemoryAvailable.Megabytes:8539.63671875|#Level:Host|#hostname:billion-Lenovo-B50-70,timestamp:1623005539 2021-06-07 00:22:19,067 [INFO ] pool-2-thread-1 TS_METRICS - MemoryUsed.Megabytes:6465.8515625|#Level:Host|#hostname:billion-Lenovo-B50-70,timestamp:1623005539 2021-06-07 00:22:19,067 [INFO ] pool-2-thread-1 TS_METRICS - MemoryUtilization.Percent:46.4|#Level:Host|#hostname:billion-Lenovo-B50-70,timest(serving) billion@billion-Lenovo-B50-70:~/47Billion/table_cell_detection/borderless_tablecell/yolo_torchserve$ 2021-06-07 00:23:19,079 [INFO ] pool-2-thread-1 TS_METRICS - CPUUtilization.Percent:0.0|#Level:Host|#hostname:billion-Lenovo-B50-70,timestamp:1623005599 2021-06-07 00:23:19,080 [INFO ] pool-2-thread-1 TS_METRICS - DiskAvailable.Gigabytes:201.47228622436523|#Level:Host|#hostname:billion-Lenovo-B50-70,timestamp:1623005599 2021-06-07 00:23:19,080 [INFO ] pool-2-thread-1 TS_METRICS - DiskUsage.Gigabytes:232.20392990112305|#Level:Host|#hostname:billion-Lenovo-B50-70,timestamp:1623005599 2021-06-07 00:23:19,080 [INFO ] pool-2-thread-1 TS_METRICS - DiskUtilization.Percent:53.5|#Level:Host|#hostname:billion-Lenovo-B50-70,timestamp:1623005599 2021-06-07 00:23:19,080 [INFO ] pool-2-thread-1 TS_METRICS - MemoryAvailable.Megabytes:8546.51171875|#Level:Host|#hostname:billion-Lenovo-B50-70,timestamp:1623005599 2021-06-07 00:23:19,080 [INFO ] pool-2-thread-1 TS_METRICS - MemoryUsed.Megabytes:6465.12890625|#Level:Host|#hostname:billion-Lenovo-B50-70,timestamp:1623005599 2021-06-07 00:23:19,080 [INFO ] pool-2-thread-1 TS_METRICS - MemoryUtilization.Percent:46.4|#Level:Host|#hostname:billion-Lenovo-B50-70,timestamp:1623005599 2021-06-07 00:24:19,065 [INFO ] pool-2-thread-2 TS_METRICS - CPUUtilization.Percent:0.0|#Level:Host|#hostname:billion-Lenovo-B50-70,timestamp:1623005659 2021-06-07 00:24:19,065 [INFO ] pool-2-thread-2 TS_METRICS - DiskAvailable.Gigabytes:201.47229766845703|#Level:Host|#hostname:billion-Lenovo-B50-70,timestamp:1623005659 2021-06-07 00:24:19,065 [INFO ] pool-2-thread-2 TS_METRICS - DiskUsage.Gigabytes:232.20391845703125|#Level:Host|#hostname:billion-Lenovo-B50-70,timestamp:1623005659 2021-06-07 00:24:19,065 [INFO ] pool-2-thread-2 TS_METRICS - DiskUtilization.Percent:53.5|#Level:Host|#hostname:billion-Lenovo-B50-70,timestamp:1623005659 2021-06-07 00:24:19,066 [INFO ] pool-2-thread-2 TS_METRICS - MemoryAvailable.Megabytes:8539.8671875|#Level:Host|#hostname:billion-Lenovo-B50-70,timestamp:1623005659 2021-06-07 00:24:19,066 [INFO ] pool-2-thread-2 TS_METRICS - MemoryUsed.Megabytes:6456.89453125|#Level:Host|#hostname:billion-Lenovo-B50-70,timestamp:1623005659 2021-06-07 00:24:19,066 [INFO ] pool-2-thread-2 TS_METRICS - MemoryUtilization.Percent:46.4|#Level:Host|#hostname:billion-Lenovo-B50-70,timestamp:1623005659 2021-06-07 00:25:19,064 [INFO ] pool-2-thread-2 TS_METRICS - CPUUtilization.Percent:0.0|#Level:Host|#hostname:billion-Lenovo-B50-70,timestamp:1623005719 2021-06-07 00:25:19,065 [INFO ] pool-2-thread-2 TS_METRICS - DiskAvailable.Gigabytes:201.47222518920898|#Level:Host|#hostname:billion-Lenovo-B50-70,timestamp:1623005719 2021-06-07 00:25:19,065 [INFO ] pool-2-thread-2 TS_METRICS - DiskUsage.Gigabytes:232.2039909362793|#Level:Host|#hostname:billion-Lenovo-B50-70,timestamp:1623005719 2021-06-07 00:25:19,065 [INFO ] pool-2-thread-2 TS_METRICS - DiskUtilization.Percent:53.5|#Level:Host|#hostname:billion-Lenovo-B50-70,timestamp:1623005719 2021-06-07 00:25:19,065 [INFO ] pool-2-thread-2 TS_METRICS - MemoryAvailable.Megabytes:8552.15234375|#Level:Host|#hostname:billion-Lenovo-B50-70,timestamp:1623005719 2021-06-07 00:25:19,065 [INFO ] pool-2-thread-2 TS_METRICS - MemoryUsed.Megabytes:6462.359375|#Level:Host|#hostname:billion-Lenovo-B50-70,timestamp:1623005719 2021-06-07 00:25:19,065 [INFO ] pool-2-thread-2 TS_METRICS - MemoryUtilization.Percent:46.4|#Level:Host|#hostname:billion-Lenovo-B50-70,timestamp:1623005719 2021-06-07 00:26:19,064 [INFO ] pool-2-thread-2 TS_METRICS - CPUUtilization.Percent:0.0|#Level:Host|#hostname:billion-Lenovo-B50-70,timestamp:1623005779 2021-06-07 00:26:19,064 [INFO ] pool-2-thread-2 TS_METRICS - DiskAvailable.Gigabytes:201.47223663330078|#Level:Host|#hostname:billion-Lenovo-B50-70,timestamp:1623005779 2021-06-07 00:26:19,064 [INFO ] pool-2-thread-2 TS_METRICS - DiskUsage.Gigabytes:232.2039794921875|#Level:Host|#hostname:billion-Lenovo-B50-70,timestamp:1623005779 2021-06-07 00:26:19,064 [INFO ] pool-2-thread-2 TS_METRICS - DiskUtilization.Percent:53.5|#Level:Host|#hostname:billion-Lenovo-B50-70,timestamp:1623005779 2021-06-07 00:26:19,065 [INFO ] pool-2-thread-2 TS_METRICS - MemoryAvailable.Megabytes:8549.703125|#Level:Host|#hostname:billion-Lenovo-B50-70,timestamp:1623005779 2021-06-07 00:26:19,065 [INFO ] pool-2-thread-2 TS_METRICS - MemoryUsed.Megabytes:6465.21875|#Level:Host|#hostname:billion-Lenovo-B50-70,timestamp:1623005779 2021-06-07 00:26:19,065 [INFO ] pool-2-thread-2 TS_METRICS - MemoryUtilization.Percent:46.4|#Level:Host|#hostname:billion-Lenovo-B50-70,timest(serving) billion@billion-Lenovo-B50-70:~/47Billion/table_cell_detection/borderless_tablecell/yolo_torchserve$ torchserve --start --ncs --model-store /home/billion/47Billion/table_cell_detection/borderless_tablecell/model-server/model-store/ --models scaled_yolov4_tablecell.mar2021-06-07 00:27:19,065 [INFO ] pool-2-thread-1 TS_METRICS - CPUUtilization.Percent:0.0|#Level:Host|#hostname:billion-Lenovo-B50-70,timestamp:1623005839 2021-06-07 00:27:19,066 [INFO ] pool-2-thread-1 TS_METRICS - DiskAvailable.Gigabytes:201.4721908569336|#Level:Host|#hostname:billion-Lenovo-B50-70,timestamp:1623005839 2021-06-07 00:27:19,066 [INFO ] pool-2-thread-1 TS_METRICS - DiskUsage.Gigabytes:232.2040252685547|#Level:Host|#hostname:billion-Lenovo-B50-70,timestamp:1623005839 2021-06-07 00:27:19,066 [INFO ] pool-2-thread-1 TS_METRICS - DiskUtilization.Percent:53.5|#Level:Host|#hostname:billion-Lenovo-B50-70,timestamp:1623005839 2021-06-07 00:27:19,066 [INFO ] pool-2-thread-1 TS_METRICS - MemoryAvailable.Megabytes:8535.28125|#Level:Host|#hostname:billion-Lenovo-B50-70,timestamp:1623005839 2021-06-07 00:27:19,066 [INFO ] pool-2-thread-1 TS_METRICS - MemoryUsed.Megabytes:6461.9140625|#Level:Host|#hostname:billion-Lenovo-B50-70,timestamp:1623005839 2021-06-07 00:27:19,066 [INFO ] pool-2-thread-1 TS_METRICS - MemoryUtilization.Percent:46.5|#Level:Host|#hostname:billion-Lenovo-B50-70,timestamp:1623005839 2021-06-07 00:28:19,068 [INFO ] pool-2-thread-1 TS_METRICS - CPUUtilization.Percent:0.0|#Level:Host|#hostname:billion-Lenovo-B50-70,timestamp:1623005899 2021-06-07 00:28:19,069 [INFO ] pool-2-thread-1 TS_METRICS - DiskAvailable.Gigabytes:201.47219467163086|#Level:Host|#hostname:billion-Lenovo-B50-70,timestamp:1623005899 2021-06-07 00:28:19,069 [INFO ] pool-2-thread-1 TS_METRICS - DiskUsage.Gigabytes:232.20402145385742|#Level:Host|#hostname:billion-Lenovo-B50-70,timestamp:1623005899 2021-06-07 00:28:19,069 [INFO ] pool-2-thread-1 TS_METRICS - DiskUtilization.Percent:53.5|#Level:Host|#hostname:billion-Lenovo-B50-70,timestamp:1623005899 2021-06-07 00:28:19,069 [INFO ] pool-2-thread-1 TS_METRICS - MemoryAvailable.Megabytes:8524.05078125|#Level:Host|#hostname:billion-Lenovo-B50-70,timestamp:1623005899 2021-06-07 00:28:19,069 [INFO ] pool-2-thread-1 TS_METRICS - MemoryUsed.Megabytes:6472.828125|#Level:Host|#hostname:billion-Lenovo-B50-70,timestamp:1623005899 2021-06-07 00:28:19,070 [INFO ] pool-2-thread-1 TS_METRICS - MemoryUtilization.Percent:46.5|#Level:Host|#hostname:billion-Lenovo-B50-70,timestamp:1623005899 2021-06-07 00:29:19,064 [INFO ] pool-2-thread-1 TS_METRICS - CPUUtilization.Percent:0.0|#Level:Host|#hostname:billion-Lenovo-B50-70,timestamp:1623005959 2021-06-07 00:29:19,065 [INFO ] pool-2-thread-1 TS_METRICS - DiskAvailable.Gigabytes:201.47217178344727|#Level:Host|#hostname:billion-Lenovo-B50-70,timestamp:1623005959 2021-06-07 00:29:19,065 [INFO ] pool-2-thread-1 TS_METRICS - DiskUsage.Gigabytes:232.20404434204102|#Level:Host|#hostname:billion-Lenovo-B50-70,timestamp:1623005959 2021-06-07 00:29:19,065 [INFO ] pool-2-thread-1 TS_METRICS - DiskUtilization.Percent:53.5|#Level:Host|#hostname:billion-Lenovo-B50-70,timestamp:1623005959 2021-06-07 00:29:19,065 [INFO ] pool-2-thread-1 TS_METRICS - MemoryAvailable.Megabytes:8532.93359375|#Level:Host|#hostname:billion-Lenovo-B50-70,timestamp:1623005959 2021-06-07 00:29:19,065 [INFO ] pool-2-thread-1 TS_METRICS - MemoryUsed.Megabytes:6473.6953125|#Level:Host|#hostname:billion-Lenovo-B50-70,timestamp:1623005959 2021-06-07 00:29:19,065 [INFO ] pool-2-thread-1 TS_METRICS - MemoryUtilization.Percent:46.5|#Level:Host|#hostname:billion-Lenovo-B50-70,timestamp:1623005959 2021-06-07 00:30:19,066 [INFO ] pool-2-thread-1 TS_METRICS - CPUUtilization.Percent:0.0|#Level:Host|#hostname:billion-Lenovo-B50-70,timestamp:1623006019 2021-06-07 00:30:19,067 [INFO ] pool-2-thread-1 TS_METRICS - DiskAvailable.Gigabytes:201.47218322753906|#Level:Host|#hostname:billion-Lenovo-B50-70,timestamp:1623006019 2021-06-07 00:30:19,067 [INFO ] pool-2-thread-1 TS_METRICS - DiskUsage.Gigabytes:232.20403289794922|#Level:Host|#hostname:billion-Lenovo-B50-70,timestamp:1623006019 2021-06-07 00:30:19,067 [INFO ] pool-2-thread-1 TS_METRICS - DiskUtilization.Percent:53.5|#Level:Host|#hostname:billion-Lenovo-B50-70,timestamp:1623006019 2021-06-07 00:30:19,067 [INFO ] pool-2-thread-1 TS_METRICS - MemoryAvailable.Megabytes:8525.44140625|#Level:Host|#hostname:billion-Lenovo-B50-70,timestamp:1623006019 2021-06-07 00:30:19,067 [INFO ] pool-2-thread-1 TS_METRICS - MemoryUsed.Megabytes:6472.1484375|#Level:Host|#hostname:billion-Lenovo-B50-70,timestamp:1623006019 2021-06-07 00:30:19,067 [INFO ] pool-2-thread-1 TS_METRICS - MemoryUtilization.Percent:46.5|#Level:Host|#hostname:billion-Lenovo-B50-70,timestamp:1623006019

And the when I opened the locahost in my browser, it showed:

{ "code": 405, "type": "MethodNotAllowedException", "message": "Requested method is not allowed, please refer to API document." }

Is there something I am missing or something I am doing wrong???

HamidShojanazeri commented 3 years ago

@jigsawcoder seems its missing the index_to_name.json (search in the log for it) during archiving the mar file, please refer to the example. Also, I believe "path to .torchscript file" needs to be passed to --serialized-file?