kerrj / lerf

Code for LERF: Language Embedded Radiance Fields
https://www.lerf.io/
MIT License
668 stars 65 forks source link

No textbox in viewer #5

Closed jiadingfang closed 1 year ago

jiadingfang commented 1 year ago

Hi Justin,

Thanks for the great work and the code release for LERF!

I tried to follow the instructions in this repo to run lerf and have successfully trained a lerf-lite model on my custom data. However, even if I build custom viewer as you suggested and use yarn start to launch and connect it with my local training port, when I open the viewer, it looks like a regular nerfstudio viewer and I cannot find a text box as you showed in the demo to search even I selected relevancy_0 field. The following is a screenshot (the resolution is pretty low, I'll use a better machine to render later)

image

Can you kindly suggest where could I did wrong here?

Best, JD

chungmin99 commented 1 year ago

Hi! Thanks for your interest in the project.

The textbox is located here, at clip_pos_word (in red circle):

image

Let us know if that works!

chungmin99 commented 1 year ago

P.S. we're also working on integrating the new nerfstudio viewer with this codebase (hopefully by tomorrow), which should make the viewer more user-friendly. :)

jiadingfang commented 1 year ago

Exciting, looking forward to the full integration!

anas-zafar commented 1 year ago

Hi @jiadingfang , could you please list down the steps you followed to run the above? I downloaded the dataset from here and when I run the training command; ns-train lerf --data /data/lerf/lerf/data/book_store

I get the following error:

Traceback (most recent call last):
  File "/usr/bin/ns-train", line 5, in <module>
    from nerfstudio.scripts.train import entrypoint
  File "/usr/lib/python3.9/site-packages/nerfstudio/scripts/train.py", line 62, in <module>
    from nerfstudio.configs.method_configs import AnnotatedBaseConfigUnion
  File "/usr/lib/python3.9/site-packages/nerfstudio/configs/method_configs.py", line 53, in <module>
    from nerfstudio.models.depth_nerfacto import DepthNerfactoModelConfig
  File "/usr/lib/python3.9/site-packages/nerfstudio/models/depth_nerfacto.py", line 30, in <module>
    from nerfstudio.models.nerfacto import NerfactoModel, NerfactoModelConfig
  File "/usr/lib/python3.9/site-packages/nerfstudio/models/nerfacto.py", line 27, in <module>
    from torchmetrics.functional import structural_similarity_index_measure
  File "/usr/lib/python3.9/site-packages/torchmetrics/__init__.py", line 14, in <module>
    from torchmetrics import functional  # noqa: E402
  File "/usr/lib/python3.9/site-packages/torchmetrics/functional/__init__.py", line 120, in <module>
    from torchmetrics.functional.text._deprecated import _bleu_score as bleu_score
  File "/usr/lib/python3.9/site-packages/torchmetrics/functional/text/__init__.py", line 18, in <module>
    from torchmetrics.functional.text.edit import edit_distance
  File "<frozen importlib._bootstrap>", line 1007, in _find_and_load
  File "<frozen importlib._bootstrap>", line 986, in _find_and_load_unlocked
  File "<frozen importlib._bootstrap>", line 680, in _load_unlocked
  File "<frozen importlib._bootstrap_external>", line 846, in exec_module
  File "<frozen importlib._bootstrap_external>", line 978, in get_code
  File "<frozen importlib._bootstrap_external>", line 647, in _compile_bytecode
EOFError: marshal data too short
zijianh4 commented 5 months ago

Hi, It seems that the nerfstudio is updated. Could you please tell me where is the textbox now? Thanks!

image