-
### Your current environment
```text
The output of `python collect_env.py`
Collecting environment information...
WARNING 07-15 19:13:04 _custom_ops.py:14] Failed to import from vllm._C with Mo…
-
**What is the bug?**
Frequent Torch errors in the OpenSearch log during bulk upload while using `distiluse-base-multilingual-cased-v1`
The weird thing is that I'm seeing different dimensions in th…
-
I propose to add the following (type based) semantic token modifiers:
- nullable
- unknown-type (or maybe just "any-type")
Nullable would indicate that an expression is nullable.
Unknown-type …
-
Originally reported by: **Claudiu Popa (BitBucket: [PCManticore](http://bitbucket.org/PCManticore), GitHub: [PCManticore](http://github.com/PCManticore))**
---
We can do something similar for Genera…
-
Currently I'm testing mimalloc for our internal neural network inference engine. I'm using the overriding method (linking mimalloc-override.lib). Error 0xC000005 is reported by MSVC.
Our engine use…
-
Does the definition of the temporal or spatial region affect the outcome? I.e., will the result be different if I choose another spatial subset or start and ending times in my configuration? I would l…
-
Huge fan of machinethink.net. Sorry to ask you this here, but wasn't sure of the best way to do so - you'd recently mentioned that you noticed CoreML inference falls back to GPU if there's a custom la…
-
现在的profile,看不到OP的统计信息,分析起来不方便,可以直接用inference里面的profile,
先在Paddle/paddle/fluid/jit/engine/predictor_engine.h中增加如下配置:
然后paddle_build/test/u2/decoder_main.cc中关闭USE_PROFILING宏。
然后运行时就会有如下的统计信息:
![…
-
## Problem
Unable to run pre-trained RoboThor model checkpoint
## Steps to reproduce
Followed all instructions at https://allenact.org/tutorials/running-inference-on-a-pretrained-model/
Then r…
-
Traceback (most recent call last):
File "S:\i2vgen-xl\inference.py", line 18, in
INFER_ENGINE.build(dict(type=cfg_update.TASK_TYPE), cfg_update=cfg_update.cfg_dict)
File "S:\i2vgen-xl\util…