-
Today if we have a query that needs latest info that the model might not have
```js
const session = await ai.languageModel.create();
console.log(await session.prompt("NASDAQ: GOOG price today?"));
…
-
In the markdown file, the grounding dataset can be defined as follows: {"query": "Find ", "response": "", "images": ["/coco2014/train2014/COCO_train2014_000000001507.jpg"], "objects": "[{\"caption\": …
-
### Feature request
I found that the Gounding DINO model `IDEA-Research/grounding-dino-base` cann't be compiled.
When I use `torch.comple()`, it raises many error, such as `TypeError: unhashable typ…
-
hi dear authors! i am digging into the codebase as we want to run some evals on current SoTA models.
while doing this, i wanted to better understand the proposal of the "Grounding Module" (mentione…
-
I would like to format both VQA and Grounding Object detection. How should I format the dataset for finetuning ? Should I generate json like the following ?
{"query": "How many apples ?", "respon…
-
InvernVl-8B, use prompt
"Please provide the bounding box coordinates of the region this sentence describes: human"?
to get bbox. However, the output of model is
"The bounding box coordinates of…
-
Hi GUICourse Team,
I’m testing GUICourse on **ScreenSpot** (a grounding benchmark) with this prompt, which is from the paper: `Please give me the grounding box of the "{element_description}".`
I…
-
### Branch
main branch https://mmdetection3d.readthedocs.io/en/latest/
### 📚 The doc issue
In the 3D Grounding task, your model loads a pre-trained 3Ddet model. When I don't load it, the accuracy …
-
1. agent_s/GraphSearchAgent.py
Ln80: "self.grounding_agent = OpenACIGroundingAgent()"
but openaci/ubuntu/Grounding.py: "def __init__(self, obs, top_app=None)", required parameter “obs”
…
-
关于学习率，config文件里是auto_scale_lr = dict(base_batch_size=64) ，但是usage中提到的使用的32gpus x 4 bs，请问以哪个为准。在训练时需要打开auto-scale-lr吗？