search

Significant-Gravitas / AutoGPT

AutoGPT is the vision of accessible AI for everyone, to use and to build on. Our mission is to provide the tools, so that you can focus on what matters.
https://agpt.co
Other
168.08k stars 44.35k forks source link

Prompt overflows aren't handled gracefully #1841

Closed tony163163 closed 1 year ago

tony163163 commented 1 year ago

Duplicates

Steps to reproduce 🕹

No response

Current behavior 😯

When using Chinese text, the length increases after encoding, which may cause the number of tokens to exceed 8191 and result in the following error：

Traceback (most recent call last): File "C:\Users\tony1\AppData\Local\Programs\Python\Python310\lib\runpy.py", line 196, in _run_module_as_main return _run_code(code, main_globals, None, File "C:\Users\tony1\AppData\Local\Programs\Python\Python310\lib\runpy.py", line 86, in _run_code exec(code, run_globals) File "E:\openai\git\Auto-GPT\autogpt__main.py", line 53, in main() File "E:\openai\git\Auto-GPT\autogpt\main__.py", line 49, in main agent.start_interaction_loop() File "E:\openai\git\Auto-GPT\autogpt\agent\agent.py", line 65, in start_interaction_loop assistant_reply = chat_with_ai( File "E:\openai\git\Auto-GPT\autogpt\chat.py", line 85, in chat_with_ai else permanent_memory.get_relevant(str(full_message_history[-9:]), 10) File "E:\openai\git\Auto-GPT\autogpt\memory\local.py", line 122, in get_relevant embedding = create_embedding_with_ada(text) File "E:\openai\git\Auto-GPT\autogpt\llm_utils.py", line 136, in create_embedding_with_ada return openai.Embedding.create( File "C:\Users\tony1\AppData\Local\Programs\Python\Python310\lib\site-packages\openai\api_resources\embedding.py", line 33, in create response = super().create(*args, **kwargs) File "C:\Users\tony1\AppData\Local\Programs\Python\Python310\lib\site-packages\openai\api_resources\abstract\engine_apiresource.py", line 153, in create response, , api_key = requestor.request( File "C:\Users\tony1\AppData\Local\Programs\Python\Python310\lib\site-packages\openai\api_requestor.py", line 226, in request resp, got_stream = self._interpret_response(result, stream) File "C:\Users\tony1\AppData\Local\Programs\Python\Python310\lib\site-packages\openai\api_requestor.py", line 619, in _interpret_response self._interpret_response_line( File "C:\Users\tony1\AppData\Local\Programs\Python\Python310\lib\site-packages\openai\api_requestor.py", line 682, in _interpret_response_line raise self.handle_error_response( openai.error.InvalidRequestError: This model's maximum context length is 8191 tokens, however you requested 10681 tokens (10681 in your prompt; 0 for the completion). Please reduce your prompt; or completion length.

Expected behavior 🤔

If not encoded, there will be no problem:

autogpt\app.py

130: google_result = google_search(arguments["input"]) 131: #safe_message = google_result.encode("utf-8", "ignore") 132: return str(google_result)

Your prompt 📝

# Paste your prompt here
gaoqing commented 1 year ago

same same, it run a long time, and then suddenly it kill itself due to number of tokens to exceed 8191

  1. why it run so long and never summarize a report
  2. why it cannot handle to split the tokens to send gpt
artis101 commented 1 year ago

I am facing the same issue. It gets to a certain point and dies when it tries to list directory contents of a project that I cloned. AutoGPT should batch requests itself

Aricept094 commented 1 year ago

same here

FakeSnake618 commented 1 year ago

same here

BorisMolch commented 1 year ago

same here. trying to read a folder with lots of files. would be great to have some paging for the requests

BorisMolch commented 1 year ago

Goal 1: Search_files and make a descriptions of all files. Goal 2: be aware that you cannot send long requests to the api. i think max is 8k tokens. Goal 3: Using memory of type: LocalCache Using Browser: chrome THOUGHTS: I suggest we start by searching for the files in the current directory using the 'search_files' command. REASONING: Before we can work on any files, we need to know what files are available in the current directory. This will help us plan our next steps. PLAN:

(base) C:\Users\mcbub\Auto-GPT\Auto-GPT>

zky001 commented 1 year ago

NEXT ACTION: COMMAND = clone_repository ARGUMENTS = {'repository_url': 'https://github.com/loli/medpy.git', 'clone_path': '/media/Data/data/aneurysm_evaluate/Auto-GPT/auto_gpt_workspace/medpy'} SYSTEM: Command clone_repository returned: Cloned https://github.com/loli/medpy.git to /media/Data/data/aneurysm_evaluate/Auto-GPT/auto_gpt_workspace/medpy THOUGHTS: Now that I have downloaded an alternative package, I need to review its documentation and source code to find ways to optimize our own implementation of the LabelSetDilate method. I should also run some tests to compare its performance with our current implementation. REASONING: Cloning the medpy repository is only the first step in finding an optimized method to replace LabelSetDilate. I need to evaluate the package's source code and documentation to gain insights into how they've approached the problem. Additionally, it's important to assess the medpy package's performance relative to our current implementation. PLAN:

SpaceTTAngel commented 1 year ago

I experienced the same issue : openai.error.InvalidRequestError: This model's maximum context length is 8191 tokens

goo00d commented 1 year ago

Same issue when use Google search and processing.

GabrielBarberini commented 1 year ago 
NEXT ACTION:  COMMAND = clone_repository ARGUMENTS = {'repository_url': 'https://github.com/USER_NAME/mnist_analysis.git', 'clone_path': '/local/directory/path/mnist_analysis'}

SYSTEM:  Command clone_repository returned: Error: Attempted to access path '/local/directory/path/mnist_analysis' outside of working directory '/Users/gabriel.barberini/Documents/Auto-Faust/faustAI/auto_gpt_workspace'.

 THOUGHTS:  The clone_repository command thrown an error, indicating that the specified local directory path is outside the current working directory. For the clone_repository command, the local directory must be within or relative to the working directory, so I will use the 'search_files' command to find a location within the working directory for the local directory.

REASONING:  The error indicated that the local directory for cloning the 'mnist_analysis' repository needs to be within the working directory. I will use the 'search_files' command to identify a local directory that exists within and is relative to the current working directory.

PLAN:

-  I will use the 'search_files' command to search the current working directory for any directories that contain selectable files, and then I will select a directory within those results as the new path to clone the repository. Once I have the new path, I can enter it into the 'clone_repository' command and run it again.

CRITICISM:  I should have spent more time checking that the target directory was within the correct scope before running the initial clone_repository command. This time spent checking would have saved me from having to run the cloning command multiple times to finally succeed.

NEXT ACTION:  COMMAND = search_files ARGUMENTS = {'directory': '.'}

Traceback (most recent call last):
  File "/usr/local/Cellar/python@3.10/3.10.9/Frameworks/Python.framework/Versions/3.10/lib/python3.10/runpy.py", line 196, in _run_module_as_main
    return _run_code(code, main_globals, None,
  File "/usr/local/Cellar/python@3.10/3.10.9/Frameworks/Python.framework/Versions/3.10/lib/python3.10/runpy.py", line 86, in _run_code
    exec(code, run_globals)
  File "/Users/gabriel.barberini/Documents/Auto-Faust/faustAI/autogpt/__main__.py", line 52, in <module>
    main()
  File "/Users/gabriel.barberini/Documents/Auto-Faust/faustAI/autogpt/__main__.py", line 49, in main
    agent.start_interaction_loop()
  File "/Users/gabriel.barberini/Documents/Auto-Faust/faustAI/autogpt/agent/agent.py", line 184, in start_interaction_loop
    self.memory.add(memory_to_add)
  File "/Users/gabriel.barberini/Documents/Auto-Faust/faustAI/autogpt/memory/local.py", line 76, in add
    embedding = create_embedding_with_ada(text)
  File "/Users/gabriel.barberini/Documents/Auto-Faust/faustAI/autogpt/llm_utils.py", line 155, in create_embedding_with_ada
    return openai.Embedding.create(
  File "/usr/local/lib/python3.10/site-packages/openai/api_resources/embedding.py", line 33, in create
    response = super().create(*args, **kwargs)
  File "/usr/local/lib/python3.10/site-packages/openai/api_resources/abstract/engine_api_resource.py", line 153, in create
    response, _, api_key = requestor.request(
  File "/usr/local/lib/python3.10/site-packages/openai/api_requestor.py", line 226, in request
    resp, got_stream = self._interpret_response(result, stream)
  File "/usr/local/lib/python3.10/site-packages/openai/api_requestor.py", line 619, in _interpret_response
    self._interpret_response_line(
  File "/usr/local/lib/python3.10/site-packages/openai/api_requestor.py", line 682, in _interpret_response_line
    raise self.handle_error_response(
openai.error.InvalidRequestError: This model's maximum context length is 8191 tokens, however you requested 161294 tokens (161294 in your prompt; 0 for the completion). Please reduce your prompt; or completion length.
Pwuts commented 1 year ago

Related: #2088

Fadude commented 1 year ago

It seems like the problem has been fixed for browse_website command (according to the test under #2542 ). However I'm still having the same error when using search_files command - 

NEXT ACTION:  COMMAND = search_files ARGUMENTS = {'directory': 'my/path/to-dir/'}
Enter 'y' to authorise command, 'y -N' to run N continuous commands, 'n' to exit program, or enter feedback for ...
Input:y
-=-=-=-=-=-=-= COMMAND AUTHORISED BY USER -=-=-=-=-=-=-= 
Traceback (most recent call last):
  File "/opt/homebrew/Cellar/python@3.10/3.10.7/Frameworks/Python.framework/Versions/3.10/lib/python3.10/runpy.py", line 196, in _run_module_as_main
    return _run_code(code, main_globals, None,
  File "/opt/homebrew/Cellar/python@3.10/3.10.7/Frameworks/Python.framework/Versions/3.10/lib/python3.10/runpy.py", line 86, in _run_code
    exec(code, run_globals)
  File "/Users/fadude/lab/autogpt/__main__.py", line 5, in <module>
    autogpt.cli.main()
  File "/opt/homebrew/lib/python3.10/site-packages/click/core.py", line 1130, in __call__
    return self.main(*args, **kwargs)
  File "/opt/homebrew/lib/python3.10/site-packages/click/core.py", line 1055, in main
    rv = self.invoke(ctx)
  File "/opt/homebrew/lib/python3.10/site-packages/click/core.py", line 1635, in invoke
    rv = super().invoke(ctx)
  File "/opt/homebrew/lib/python3.10/site-packages/click/core.py", line 1404, in invoke
    return ctx.invoke(self.callback, **ctx.params)
  File "/opt/homebrew/lib/python3.10/site-packages/click/core.py", line 760, in invoke
    return __callback(*args, **kwargs)
  File "/opt/homebrew/lib/python3.10/site-packages/click/decorators.py", line 26, in new_func
    return f(get_current_context(), *args, **kwargs)
  File "/Users/fadude/lab/autogpt/cli.py", line 151, in main
    agent.start_interaction_loop()
  File "/Users/fadude/lab/autogpt/agent/agent.py", line 184, in start_interaction_loop
    self.memory.add(memory_to_add)
  File "/Users/fadude/lab/autogpt/memory/milvus.py", line 66, in add
    embedding = get_ada_embedding(data)
  File "/Users/fadude/lab/autogpt/memory/base.py", line 19, in get_ada_embedding
    return openai.Embedding.create(input=[text], model="text-embedding-ada-002")[
  File "/opt/homebrew/lib/python3.10/site-packages/openai/api_resources/embedding.py", line 33, in create
    response = super().create(*args, **kwargs)
  File "/opt/homebrew/lib/python3.10/site-packages/openai/api_resources/abstract/engine_api_resource.py", line 153, in create
    response, _, api_key = requestor.request(
  File "/opt/homebrew/lib/python3.10/site-packages/openai/api_requestor.py", line 226, in request
    resp, got_stream = self._interpret_response(result, stream)
  File "/opt/homebrew/lib/python3.10/site-packages/openai/api_requestor.py", line 619, in _interpret_response
    self._interpret_response_line(
  File "/opt/homebrew/lib/python3.10/site-packages/openai/api_requestor.py", line 682, in _interpret_response_line
    raise self.handle_error_response(
openai.error.InvalidRequestError: This model's maximum context length is 8191 tokens, however you requested 236485 tokens (236485 in your prompt; 0 for the completion). Please reduce your prompt; or completion length.
Pwuts commented 1 year ago

@Fadude can you run this for me and post the output?

python -c 'from autogpt.commands.file_operations import search_files; print(search_files("my/path/to-dir/"))'
Volkopat commented 1 year ago

@Pwuts I am too getting the same error:

NEXT ACTION:  COMMAND = search_files ARGUMENTS = {'directory': '.', 'keywords': 'zero-shot learning, medical imaging segmentation'}
Traceback (most recent call last):
  File "/Library/Frameworks/Python.framework/Versions/3.10/lib/python3.10/runpy.py", line 196, in _run_module_as_main
    return _run_code(code, main_globals, None,
  File "/Library/Frameworks/Python.framework/Versions/3.10/lib/python3.10/runpy.py", line 86, in _run_code
    exec(code, run_globals)
  File "/Users/volkopat/Downloads/Auto-GPT/autogpt/__main__.py", line 5, in <module>
    autogpt.cli.main()
  File "/Users/volkopat/Downloads/Auto-GPT/venv/lib/python3.10/site-packages/click/core.py", line 1130, in __call__
    return self.main(*args, **kwargs)
  File "/Users/volkopat/Downloads/Auto-GPT/venv/lib/python3.10/site-packages/click/core.py", line 1055, in main
    rv = self.invoke(ctx)
  File "/Users/volkopat/Downloads/Auto-GPT/venv/lib/python3.10/site-packages/click/core.py", line 1635, in invoke
    rv = super().invoke(ctx)
  File "/Users/volkopat/Downloads/Auto-GPT/venv/lib/python3.10/site-packages/click/core.py", line 1404, in invoke
    return ctx.invoke(self.callback, **ctx.params)
  File "/Users/volkopat/Downloads/Auto-GPT/venv/lib/python3.10/site-packages/click/core.py", line 760, in invoke
    return __callback(*args, **kwargs)
  File "/Users/volkopat/Downloads/Auto-GPT/venv/lib/python3.10/site-packages/click/decorators.py", line 26, in new_func
    return f(get_current_context(), *args, **kwargs)
  File "/Users/volkopat/Downloads/Auto-GPT/autogpt/cli.py", line 151, in main
    agent.start_interaction_loop()
  File "/Users/volkopat/Downloads/Auto-GPT/autogpt/agent/agent.py", line 184, in start_interaction_loop
    self.memory.add(memory_to_add)
  File "/Users/volkopat/Downloads/Auto-GPT/autogpt/memory/local.py", line 76, in add
    embedding = create_embedding_with_ada(text)
  File "/Users/volkopat/Downloads/Auto-GPT/autogpt/llm_utils.py", line 155, in create_embedding_with_ada
    return openai.Embedding.create(
  File "/Users/volkopat/Downloads/Auto-GPT/venv/lib/python3.10/site-packages/openai/api_resources/embedding.py", line 33, in create
    response = super().create(*args, **kwargs)
  File "/Users/volkopat/Downloads/Auto-GPT/venv/lib/python3.10/site-packages/openai/api_resources/abstract/engine_api_resource.py", line 153, in create
    response, _, api_key = requestor.request(
  File "/Users/volkopat/Downloads/Auto-GPT/venv/lib/python3.10/site-packages/openai/api_requestor.py", line 226, in request
    resp, got_stream = self._interpret_response(result, stream)
  File "/Users/volkopat/Downloads/Auto-GPT/venv/lib/python3.10/site-packages/openai/api_requestor.py", line 619, in _interpret_response
    self._interpret_response_line(
  File "/Users/volkopat/Downloads/Auto-GPT/venv/lib/python3.10/site-packages/openai/api_requestor.py", line 682, in _interpret_response_line
    raise self.handle_error_response(
openai.error.InvalidRequestError: This model's maximum context length is 8191 tokens, however you requested 16941 tokens (16941 in your prompt; 0 for the completion). Please reduce your prompt; or completion length.

After running your command:

['zero_shot_learning_healthcare_summary.txt', 'ZSL_Medical_Imaging.txt', 'file_logger.txt', 'zero_shot_learning_medical_diagnosis.txt', 'Zero Shot Segmentation Research/zero_shot_apps.txt', 'segment_anything/LICENSE', 'segment_anything/INSTALL.md', 'segment_anything/README.md', 'segment_anything/GETTING_STARTED.md', 'segment_anything/setup.py', 'segment_anything/setup.cfg', 'segment_anything/MODEL_ZOO.md', 'segment_anything/demo/predictor.py', 'segment_anything/demo/README.md', 'segment_anything/demo/demo.py', 'segment_anything/tools/lightning_train_net.py', 'segment_anything/tools/convert-torchvision-to-d2.py', 'segment_anything/tools/benchmark.py', 'segment_anything/tools/visualize_data.py', 'segment_anything/tools/plain_train_net.py', 'segment_anything/tools/__init__.py', 'segment_anything/tools/README.md', 'segment_anything/tools/visualize_json_results.py', 'segment_anything/tools/analyze_model.py', 'segment_anything/tools/lazyconfig_train_net.py', 'segment_anything/tools/train_net.py', 'segment_anything/tools/deploy/export_model.py', 'segment_anything/tools/deploy/CMakeLists.txt', 'segment_anything/tools/deploy/torchscript_mask_rcnn.cpp', 'segment_anything/tools/deploy/README.md', 'segment_anything/docker/Dockerfile', 'segment_anything/docker/README.md', 'segment_anything/docker/deploy.Dockerfile', 'segment_anything/docker/docker-compose.yml', 'segment_anything/projects/README.md', 'segment_anything/projects/MViTv2/README.md', 'segment_anything/projects/MViTv2/configs/cascade_mask_rcnn_mvitv2_s_3x.py', 'segment_anything/projects/MViTv2/configs/cascade_mask_rcnn_mvitv2_t_3x.py', 'segment_anything/projects/MViTv2/configs/cascade_mask_rcnn_mvitv2_b_in21k_3x.py', 'segment_anything/projects/MViTv2/configs/mask_rcnn_mvitv2_t_3x.py', 'segment_anything/projects/MViTv2/configs/cascade_mask_rcnn_mvitv2_h_in21k_lsj_3x.py', 'segment_anything/projects/MViTv2/configs/cascade_mask_rcnn_mvitv2_l_in21k_lsj_50ep.py', 'segment_anything/projects/MViTv2/configs/cascade_mask_rcnn_mvitv2_b_3x.py', 'segment_anything/projects/MViTv2/configs/common/coco_loader_lsj.py', 'segment_anything/projects/MViTv2/configs/common/coco_loader.py', 'segment_anything/projects/TridentNet/README.md', 'segment_anything/projects/TridentNet/train_net.py', 'segment_anything/projects/TridentNet/tridentnet/trident_rpn.py', 'segment_anything/projects/TridentNet/tridentnet/config.py', 'segment_anything/projects/TridentNet/tridentnet/trident_backbone.py', 'segment_anything/projects/TridentNet/tridentnet/__init__.py', 'segment_anything/projects/TridentNet/tridentnet/trident_rcnn.py', 'segment_anything/projects/TridentNet/tridentnet/trident_conv.py', 'segment_anything/projects/TridentNet/configs/Base-TridentNet-Fast-C4.yaml', 'segment_anything/projects/TridentNet/configs/tridentnet_fast_R_50_C4_3x.yaml', 'segment_anything/projects/TridentNet/configs/tridentnet_fast_R_50_C4_1x.yaml', 'segment_anything/projects/TridentNet/configs/tridentnet_fast_R_101_C4_3x.yaml', 'segment_anything/projects/DensePose/query_db.py', 'segment_anything/projects/DensePose/apply_net.py', 'segment_anything/projects/DensePose/README.md', 'segment_anything/projects/DensePose/setup.py', 'segment_anything/projects/DensePose/train_net.py', 'segment_anything/projects/DensePose/densepose/config.py', 'segment_anything/projects/DensePose/densepose/__init__.py', 'segment_anything/projects/DensePose/densepose/structures/data_relative.py', 'segment_anything/projects/DensePose/densepose/structures/list.py', 'segment_anything/projects/DensePose/densepose/structures/chart_confidence.py', 'segment_anything/projects/DensePose/densepose/structures/chart_result.py', 'segment_anything/projects/DensePose/densepose/structures/cse_confidence.py', 'segment_anything/projects/DensePose/densepose/structures/__init__.py', 'segment_anything/projects/DensePose/densepose/structures/chart.py', 'segment_anything/projects/DensePose/densepose/structures/mesh.py', 'segment_anything/projects/DensePose/densepose/structures/transform_data.py', 'segment_anything/projects/DensePose/densepose/structures/cse.py', 'segment_anything/projects/DensePose/densepose/converters/to_mask.py', 'segment_anything/projects/DensePose/densepose/converters/chart_output_to_chart_result.py', 'segment_anything/projects/DensePose/densepose/converters/to_chart_result.py', 'segment_anything/projects/DensePose/densepose/converters/__init__.py', 'segment_anything/projects/DensePose/densepose/converters/chart_output_hflip.py', 'segment_anything/projects/DensePose/densepose/converters/hflip.py', 'segment_anything/projects/DensePose/densepose/converters/segm_to_mask.py', 'segment_anything/projects/DensePose/densepose/converters/builtin.py', 'segment_anything/projects/DensePose/densepose/converters/base.py', 'segment_anything/projects/DensePose/densepose/utils/__init__.py', 'segment_anything/projects/DensePose/densepose/utils/logger.py', 'segment_anything/projects/DensePose/densepose/utils/dbhelper.py', 'segment_anything/projects/DensePose/densepose/utils/transform.py', 'segment_anything/projects/DensePose/densepose/modeling/build.py', 'segment_anything/projects/DensePose/densepose/modeling/hrnet.py', 'segment_anything/projects/DensePose/densepose/modeling/test_time_augmentation.py', 'segment_anything/projects/DensePose/densepose/modeling/confidence.py', 'segment_anything/projects/DensePose/densepose/modeling/densepose_checkpoint.py', 'segment_anything/projects/DensePose/densepose/modeling/hrfpn.py', 'segment_anything/projects/DensePose/densepose/modeling/__init__.py', 'segment_anything/projects/DensePose/densepose/modeling/utils.py', 'segment_anything/projects/DensePose/densepose/modeling/inference.py', 'segment_anything/projects/DensePose/densepose/modeling/filter.py', 'segment_anything/projects/DensePose/densepose/modeling/losses/mask.py', 'segment_anything/projects/DensePose/densepose/modeling/losses/embed_utils.py', 'segment_anything/projects/DensePose/densepose/modeling/losses/soft_embed.py', 'segment_anything/projects/DensePose/densepose/modeling/losses/segm.py', 'segment_anything/projects/DensePose/densepose/modeling/losses/embed.py', 'segment_anything/projects/DensePose/densepose/modeling/losses/mask_or_segm.py', 'segment_anything/projects/DensePose/densepose/modeling/losses/registry.py', 'segment_anything/projects/DensePose/densepose/modeling/losses/cycle_shape2shape.py', 'segment_anything/projects/DensePose/densepose/modeling/losses/cycle_pix2shape.py', 'segment_anything/projects/DensePose/densepose/modeling/losses/__init__.py', 'segment_anything/projects/DensePose/densepose/modeling/losses/chart.py', 'segment_anything/projects/DensePose/densepose/modeling/losses/chart_with_confidences.py', 'segment_anything/projects/DensePose/densepose/modeling/losses/utils.py', 'segment_anything/projects/DensePose/densepose/modeling/losses/cse.py', 'segment_anything/projects/DensePose/densepose/modeling/predictors/chart_confidence.py', 'segment_anything/projects/DensePose/densepose/modeling/predictors/registry.py', 'segment_anything/projects/DensePose/densepose/modeling/predictors/cse_confidence.py', 'segment_anything/projects/DensePose/densepose/modeling/predictors/chart_with_confidence.py', 'segment_anything/projects/DensePose/densepose/modeling/predictors/__init__.py', 'segment_anything/projects/DensePose/densepose/modeling/predictors/chart.py', 'segment_anything/projects/DensePose/densepose/modeling/predictors/cse_with_confidence.py', 'segment_anything/projects/DensePose/densepose/modeling/predictors/cse.py', 'segment_anything/projects/DensePose/densepose/modeling/cse/__init__.py', 'segment_anything/projects/DensePose/densepose/modeling/cse/utils.py', 'segment_anything/projects/DensePose/densepose/modeling/cse/embedder.py', 'segment_anything/projects/DensePose/densepose/modeling/cse/vertex_direct_embedder.py', 'segment_anything/projects/DensePose/densepose/modeling/cse/vertex_feature_embedder.py', 'segment_anything/projects/DensePose/densepose/modeling/roi_heads/roi_head.py', 'segment_anything/projects/DensePose/densepose/modeling/roi_heads/deeplab.py', 'segment_anything/projects/DensePose/densepose/modeling/roi_heads/registry.py', 'segment_anything/projects/DensePose/densepose/modeling/roi_heads/__init__.py', 'segment_anything/projects/DensePose/densepose/modeling/roi_heads/v1convx.py', 'segment_anything/projects/DensePose/densepose/vis/densepose_results.py', 'segment_anything/projects/DensePose/densepose/vis/densepose_data_points.py', 'segment_anything/projects/DensePose/densepose/vis/__init__.py', 'segment_anything/projects/DensePose/densepose/vis/densepose_outputs_iuv.py', 'segment_anything/projects/DensePose/densepose/vis/extractor.py', 'segment_anything/projects/DensePose/densepose/vis/bounding_box.py', 'segment_anything/projects/DensePose/densepose/vis/densepose_outputs_vertex.py', 'segment_anything/projects/DensePose/densepose/vis/densepose_results_textures.py', 'segment_anything/projects/DensePose/densepose/vis/base.py', 'segment_anything/projects/DensePose/densepose/evaluation/mesh_alignment_evaluator.py', 'segment_anything/projects/DensePose/densepose/evaluation/tensor_storage.py', 'segment_anything/projects/DensePose/densepose/evaluation/__init__.py', 'segment_anything/projects/DensePose/densepose/evaluation/d2_evaluator_adapter.py', 'segment_anything/projects/DensePose/densepose/evaluation/densepose_coco_evaluation.py', 'segment_anything/projects/DensePose/densepose/evaluation/evaluator.py', 'segment_anything/projects/DensePose/densepose/data/build.py', 'segment_anything/projects/DensePose/densepose/data/image_list_dataset.py', 'segment_anything/projects/DensePose/densepose/data/inference_based_loader.py', 'segment_anything/projects/DensePose/densepose/data/__init__.py', 'segment_anything/projects/DensePose/densepose/data/dataset_mapper.py', 'segment_anything/projects/DensePose/densepose/data/utils.py', 'segment_anything/projects/DensePose/densepose/data/combined_loader.py', 'segment_anything/projects/DensePose/densepose/data/video/__init__.py', 'segment_anything/projects/DensePose/densepose/data/video/video_keyframe_dataset.py', 'segment_anything/projects/DensePose/densepose/data/video/frame_selector.py', 'segment_anything/projects/DensePose/densepose/data/datasets/chimpnsee.py', 'segment_anything/projects/DensePose/densepose/data/datasets/coco.py', 'segment_anything/projects/DensePose/densepose/data/datasets/__init__.py', 'segment_anything/projects/DensePose/densepose/data/datasets/lvis.py', 'segment_anything/projects/DensePose/densepose/data/datasets/dataset_type.py', 'segment_anything/projects/DensePose/densepose/data/datasets/builtin.py', 'segment_anything/projects/DensePose/densepose/data/meshes/catalog.py', 'segment_anything/projects/DensePose/densepose/data/meshes/__init__.py', 'segment_anything/projects/DensePose/densepose/data/meshes/builtin.py', 'segment_anything/projects/DensePose/densepose/data/samplers/mask_from_densepose.py', 'segment_anything/projects/DensePose/densepose/data/samplers/prediction_to_gt.py', 'segment_anything/projects/DensePose/densepose/data/samplers/__init__.py', 'segment_anything/projects/DensePose/densepose/data/samplers/densepose_cse_uniform.py', 'segment_anything/projects/DensePose/densepose/data/samplers/densepose_base.py', 'segment_anything/projects/DensePose/densepose/data/samplers/densepose_uniform.py', 'segment_anything/projects/DensePose/densepose/data/samplers/densepose_cse_confidence_based.py', 'segment_anything/projects/DensePose/densepose/data/samplers/densepose_confidence_based.py', 'segment_anything/projects/DensePose/densepose/data/samplers/densepose_cse_base.py', 'segment_anything/projects/DensePose/densepose/data/transform/__init__.py', 'segment_anything/projects/DensePose/densepose/data/transform/image.py', 'segment_anything/projects/DensePose/densepose/engine/__init__.py', 'segment_anything/projects/DensePose/densepose/engine/trainer.py', 'segment_anything/projects/DensePose/tests/test_frame_selector.py', 'segment_anything/projects/DensePose/tests/test_setup.py', 'segment_anything/projects/DensePose/tests/test_structures.py', 'segment_anything/projects/DensePose/tests/test_model_e2e.py', 'segment_anything/projects/DensePose/tests/test_video_keyframe_dataset.py', 'segment_anything/projects/DensePose/tests/test_combine_data_loader.py', 'segment_anything/projects/DensePose/tests/test_chart_based_annotations_accumulator.py', 'segment_anything/projects/DensePose/tests/test_cse_annotations_accumulator.py', 'segment_anything/projects/DensePose/tests/test_image_list_dataset.py', 'segment_anything/projects/DensePose/tests/common.py', 'segment_anything/projects/DensePose/tests/test_image_resize_transform.py', 'segment_anything/projects/DensePose/tests/test_tensor_storage.py', 'segment_anything/projects/DensePose/tests/test_dataset_loaded_annotations.py', 'segment_anything/projects/DensePose/configs/densepose_rcnn_R_101_FPN_DL_s1x.yaml', 'segment_anything/projects/DensePose/configs/densepose_rcnn_R_101_FPN_DL_WC2_s1x.yaml', 'segment_anything/projects/DensePose/configs/densepose_rcnn_R_101_FPN_WC2_s1x.yaml', 'segment_anything/projects/DensePose/configs/densepose_rcnn_R_50_FPN_WC1_s1x.yaml', 'segment_anything/projects/DensePose/configs/densepose_rcnn_R_50_FPN_WC2M_s1x.yaml', 'segment_anything/projects/DensePose/configs/densepose_rcnn_R_101_FPN_WC1M_s1x.yaml', 'segment_anything/projects/DensePose/configs/densepose_rcnn_R_50_FPN_DL_s1x.yaml', 'segment_anything/projects/DensePose/configs/densepose_rcnn_R_101_FPN_s1x_legacy.yaml', 'segment_anything/projects/DensePose/configs/densepose_rcnn_R_101_FPN_DL_WC2M_s1x.yaml', 'segment_anything/projects/DensePose/configs/densepose_rcnn_R_50_FPN_DL_WC2M_s1x.yaml', 'segment_anything/projects/DensePose/configs/Base-DensePose-RCNN-FPN.yaml', 'segment_anything/projects/DensePose/configs/densepose_rcnn_R_50_FPN_DL_WC1_s1x.yaml', 'segment_anything/projects/DensePose/configs/densepose_rcnn_R_50_FPN_s1x.yaml', 'segment_anything/projects/DensePose/configs/densepose_rcnn_R_101_FPN_s1x.yaml', 'segment_anything/projects/DensePose/configs/densepose_rcnn_R_101_FPN_WC1_s1x.yaml', 'segment_anything/projects/DensePose/configs/densepose_rcnn_R_50_FPN_WC2_s1x.yaml', 'segment_anything/projects/DensePose/configs/densepose_rcnn_R_101_FPN_DL_WC1_s1x.yaml', 'segment_anything/projects/DensePose/configs/densepose_rcnn_R_50_FPN_DL_WC2_s1x.yaml', 'segment_anything/projects/DensePose/configs/densepose_rcnn_R_101_FPN_WC2M_s1x.yaml', 'segment_anything/projects/DensePose/configs/densepose_rcnn_R_50_FPN_WC1M_s1x.yaml', 'segment_anything/projects/DensePose/configs/densepose_rcnn_R_101_FPN_DL_WC1M_s1x.yaml', 'segment_anything/projects/DensePose/configs/densepose_rcnn_R_50_FPN_DL_WC1M_s1x.yaml', 'segment_anything/projects/DensePose/configs/densepose_rcnn_R_50_FPN_s1x_legacy.yaml', 'segment_anything/projects/DensePose/configs/HRNet/densepose_rcnn_HRFPN_HRNet_w32_s1x.yaml', 'segment_anything/projects/DensePose/configs/HRNet/densepose_rcnn_HRFPN_HRNet_w48_s1x.yaml', 'segment_anything/projects/DensePose/configs/HRNet/densepose_rcnn_HRFPN_HRNet_w40_s1x.yaml', 'segment_anything/projects/DensePose/configs/evolution/Base-RCNN-FPN-Atop10P_CA.yaml', 'segment_anything/projects/DensePose/configs/evolution/densepose_R_50_FPN_DL_WC1M_3x_Atop10P_CA_B_uniform.yaml', 'segment_anything/projects/DensePose/configs/evolution/densepose_R_50_FPN_DL_WC1M_3x_Atop10P_CA_B_finesegm.yaml', 'segment_anything/projects/DensePose/configs/evolution/densepose_R_50_FPN_DL_WC1M_3x_Atop10P_CA.yaml', 'segment_anything/projects/DensePose/configs/evolution/densepose_R_50_FPN_DL_WC1M_3x_Atop10P_CA_B_uv.yaml', 'segment_anything/projects/DensePose/configs/evolution/densepose_R_50_FPN_DL_WC1M_3x_Atop10P_CA_B_coarsesegm.yaml', 'segment_anything/projects/DensePose/configs/cse/densepose_rcnn_R_101_FPN_DL_s1x.yaml', 'segment_anything/projects/DensePose/configs/cse/densepose_rcnn_R_50_FPN_DL_s1x.yaml', 'segment_anything/projects/DensePose/configs/cse/densepose_rcnn_R_101_FPN_soft_s1x.yaml', 'segment_anything/projects/DensePose/configs/cse/densepose_rcnn_R_50_FPN_soft_chimps_finetune_4k.yaml', 'segment_anything/projects/DensePose/configs/cse/densepose_rcnn_R_50_FPN_soft_animals_finetune_16k.yaml', 'segment_anything/projects/DensePose/configs/cse/densepose_rcnn_R_50_FPN_soft_animals_finetune_4k.yaml', 'segment_anything/projects/DensePose/configs/cse/densepose_rcnn_R_50_FPN_soft_animals_I0_finetune_i2m_16k.yaml', 'segment_anything/projects/DensePose/configs/cse/Base-DensePose-RCNN-FPN.yaml', 'segment_anything/projects/DensePose/configs/cse/densepose_rcnn_R_50_FPN_s1x.yaml', 'segment_anything/projects/DensePose/configs/cse/densepose_rcnn_R_50_FPN_soft_s1x.yaml', 'segment_anything/projects/DensePose/configs/cse/densepose_rcnn_R_101_FPN_s1x.yaml', 'segment_anything/projects/DensePose/configs/cse/densepose_rcnn_R_50_FPN_soft_animals_finetune_maskonly_24k.yaml', 'segment_anything/projects/DensePose/configs/cse/densepose_rcnn_R_50_FPN_soft_animals_CA_finetune_4k.yaml', 'segment_anything/projects/DensePose/configs/cse/Base-DensePose-RCNN-FPN-Human.yaml', 'segment_anything/projects/DensePose/configs/cse/densepose_rcnn_R_50_FPN_DL_soft_s1x.yaml', 'segment_anything/projects/DensePose/configs/cse/densepose_rcnn_R_50_FPN_soft_animals_CA_finetune_16k.yaml', 'segment_anything/projects/DensePose/configs/cse/densepose_rcnn_R_101_FPN_DL_soft_s1x.yaml', 'segment_anything/projects/DensePose/configs/cse/densepose_rcnn_R_50_FPN_soft_animals_I0_finetune_16k.yaml', 'segment_anything/projects/DensePose/configs/cse/densepose_rcnn_R_50_FPN_soft_animals_I0_finetune_m2m_16k.yaml', 'segment_anything/projects/DensePose/configs/quick_schedules/densepose_rcnn_R_50_FPN_WC1_instant_test.yaml', 'segment_anything/projects/DensePose/configs/quick_schedules/densepose_rcnn_R_50_FPN_WC2_instant_test.yaml', 'segment_anything/projects/DensePose/configs/quick_schedules/densepose_rcnn_R_50_FPN_training_acc_test.yaml', 'segment_anything/projects/DensePose/configs/quick_schedules/densepose_rcnn_R_50_FPN_DL_instant_test.yaml', 'segment_anything/projects/DensePose/configs/quick_schedules/densepose_rcnn_R_50_FPN_instant_test.yaml', 'segment_anything/projects/DensePose/configs/quick_schedules/densepose_rcnn_R_50_FPN_TTA_inference_acc_test.yaml', 'segment_anything/projects/DensePose/configs/quick_schedules/densepose_rcnn_R_50_FPN_inference_acc_test.yaml', 'segment_anything/projects/DensePose/configs/quick_schedules/densepose_rcnn_HRFPN_HRNet_w32_instant_test.yaml', 'segment_anything/projects/DensePose/configs/quick_schedules/cse/densepose_rcnn_R_50_FPN_DL_instant_test.yaml', 'segment_anything/projects/DensePose/configs/quick_schedules/cse/densepose_rcnn_R_50_FPN_soft_animals_finetune_instant_test.yaml', 'segment_anything/projects/DensePose/dev/run_instant_tests.sh', 'segment_anything/projects/DensePose/dev/README.md', 'segment_anything/projects/DensePose/dev/run_inference_tests.sh', 'segment_anything/projects/DensePose/doc/TOOL_APPLY_NET.md', 'segment_anything/projects/DensePose/doc/RELEASE_2021_03.md', 'segment_anything/projects/DensePose/doc/BOOTSTRAPPING_PIPELINE.md', 'segment_anything/projects/DensePose/doc/RELEASE_2021_06.md', 'segment_anything/projects/DensePose/doc/DENSEPOSE_IUV.md', 'segment_anything/projects/DensePose/doc/DENSEPOSE_CSE.md', 'segment_anything/projects/DensePose/doc/GETTING_STARTED.md', 'segment_anything/projects/DensePose/doc/TOOL_QUERY_DB.md', 'segment_anything/projects/DensePose/doc/RELEASE_2020_04.md', 'segment_anything/projects/DensePose/doc/DENSEPOSE_DATASETS.md', 'segment_anything/projects/Panoptic-DeepLab/README.md', 'segment_anything/projects/Panoptic-DeepLab/train_net.py', 'segment_anything/projects/Panoptic-DeepLab/panoptic_deeplab/config.py', 'segment_anything/projects/Panoptic-DeepLab/panoptic_deeplab/__init__.py', 'segment_anything/projects/Panoptic-DeepLab/panoptic_deeplab/dataset_mapper.py', 'segment_anything/projects/Panoptic-DeepLab/panoptic_deeplab/panoptic_seg.py', 'segment_anything/projects/Panoptic-DeepLab/panoptic_deeplab/post_processing.py', 'segment_anything/projects/Panoptic-DeepLab/panoptic_deeplab/target_generator.py', 'segment_anything/projects/Panoptic-DeepLab/configs/Cityscapes-PanopticSegmentation/panoptic_deeplab_R_52_os16_mg124_poly_90k_bs32_crop_512_1024.yaml', 'segment_anything/projects/Panoptic-DeepLab/configs/Cityscapes-PanopticSegmentation/panoptic_deeplab_R_52_os16_mg124_poly_90k_bs32_crop_512_1024_dsconv.yaml', 'segment_anything/projects/Panoptic-DeepLab/configs/Cityscapes-PanopticSegmentation/Base-PanopticDeepLab-OS16.yaml', 'segment_anything/projects/Panoptic-DeepLab/configs/COCO-PanopticSegmentation/panoptic_deeplab_R_52_os16_mg124_poly_200k_bs64_crop_640_640_coco_dsconv.yaml', 'segment_anything/projects/PointSup/README.md', 'segment_anything/projects/PointSup/train_net.py', 'segment_anything/projects/PointSup/tools/prepare_coco_point_annotations_without_masks.py', 'segment_anything/projects/PointSup/point_sup/mask_head.py', 'segment_anything/projects/PointSup/point_sup/config.py', 'segment_anything/projects/PointSup/point_sup/__init__.py', 'segment_anything/projects/PointSup/point_sup/detection_utils.py', 'segment_anything/projects/PointSup/point_sup/dataset_mapper.py', 'segment_anything/projects/PointSup/point_sup/point_utils.py', 'segment_anything/projects/PointSup/point_sup/register_point_annotations.py', 'segment_anything/projects/PointSup/configs/implicit_pointrend_R_50_FPN_3x_point_sup_point_aug_coco.yaml', 'segment_anything/projects/PointSup/configs/mask_rcnn_R_50_FPN_3x_point_sup_point_aug_coco.yaml', 'segment_anything/projects/PointSup/configs/mask_rcnn_R_50_FPN_3x_point_sup_coco.yaml', 'segment_anything/projects/Rethinking-BatchNorm/retinanet-eval-domain-specific.py', 'segment_anything/projects/Rethinking-BatchNorm/README.md', 'segment_anything/projects/Rethinking-BatchNorm/configs/mask_rcnn_BNhead_shuffle.py', 'segment_anything/projects/Rethinking-BatchNorm/configs/mask_rcnn_BNhead.py', 'segment_anything/projects/Rethinking-BatchNorm/configs/mask_rcnn_SyncBNhead.py', 'segment_anything/projects/Rethinking-BatchNorm/configs/mask_rcnn_BNhead_batch_stats.py', 'segment_anything/projects/Rethinking-BatchNorm/configs/retinanet_SyncBNhead_SharedTraining.py', 'segment_anything/projects/Rethinking-BatchNorm/configs/retinanet_SyncBNhead.py', 'segment_anything/projects/ViTDet/README.md', 'segment_anything/projects/ViTDet/configs/LVIS/mask_rcnn_vitdet_l_100ep.py', 'segment_anything/projects/ViTDet/configs/LVIS/cascade_mask_rcnn_vitdet_b_100ep.py', 'segment_anything/projects/ViTDet/configs/LVIS/cascade_mask_rcnn_vitdet_h_100ep.py', 'segment_anything/projects/ViTDet/configs/LVIS/cascade_mask_rcnn_mvitv2_b_in21k_100ep.py', 'segment_anything/projects/ViTDet/configs/LVIS/cascade_mask_rcnn_mvitv2_l_in21k_50ep.py', 'segment_anything/projects/ViTDet/configs/LVIS/cascade_mask_rcnn_mvitv2_h_in21k_50ep.py', 'segment_anything/projects/ViTDet/configs/LVIS/cascade_mask_rcnn_swin_b_in21k_50ep.py', 'segment_anything/projects/ViTDet/configs/LVIS/mask_rcnn_vitdet_b_100ep.py', 'segment_anything/projects/ViTDet/configs/LVIS/cascade_mask_rcnn_swin_l_in21k_50ep.py', 'segment_anything/projects/ViTDet/configs/LVIS/mask_rcnn_vitdet_h_100ep.py', 'segment_anything/projects/ViTDet/configs/LVIS/cascade_mask_rcnn_vitdet_l_100ep.py', 'segment_anything/projects/ViTDet/configs/COCO/mask_rcnn_vitdet_l_100ep.py', 'segment_anything/projects/ViTDet/configs/COCO/cascade_mask_rcnn_vitdet_b_100ep.py', 'segment_anything/projects/ViTDet/configs/COCO/cascade_mask_rcnn_vitdet_h_75ep.py', 'segment_anything/projects/ViTDet/configs/COCO/cascade_mask_rcnn_mvitv2_b_in21k_100ep.py', 'segment_anything/projects/ViTDet/configs/COCO/cascade_mask_rcnn_mvitv2_l_in21k_50ep.py', 'segment_anything/projects/ViTDet/configs/COCO/cascade_mask_rcnn_swin_b_in21k_50ep.py', 'segment_anything/projects/ViTDet/configs/COCO/mask_rcnn_vitdet_b_100ep.py', 'segment_anything/projects/ViTDet/configs/COCO/mask_rcnn_vitdet_h_75ep.py', 'segment_anything/projects/ViTDet/configs/COCO/cascade_mask_rcnn_swin_l_in21k_50ep.py', 'segment_anything/projects/ViTDet/configs/COCO/cascade_mask_rcnn_mvitv2_h_in21k_36ep.py', 'segment_anything/projects/ViTDet/configs/COCO/cascade_mask_rcnn_vitdet_l_100ep.py', 'segment_anything/projects/ViTDet/configs/common/coco_loader_lsj.py', 'segment_anything/projects/TensorMask/README.md', 'segment_anything/projects/TensorMask/setup.py', 'segment_anything/projects/TensorMask/train_net.py', 'segment_anything/projects/TensorMask/tests/__init__.py', 'segment_anything/projects/TensorMask/tests/test_swap_align2nat.py', 'segment_anything/projects/TensorMask/configs/tensormask_R_50_FPN_1x.yaml', 'segment_anything/projects/TensorMask/configs/tensormask_R_50_FPN_6x.yaml', 'segment_anything/projects/TensorMask/configs/Base-TensorMask.yaml', 'segment_anything/projects/TensorMask/tensormask/config.py', 'segment_anything/projects/TensorMask/tensormask/arch.py', 'segment_anything/projects/TensorMask/tensormask/__init__.py', 'segment_anything/projects/TensorMask/tensormask/layers/swap_align2nat.py', 'segment_anything/projects/TensorMask/tensormask/layers/__init__.py', 'segment_anything/projects/TensorMask/tensormask/layers/csrc/vision.cpp', 'segment_anything/projects/TensorMask/tensormask/layers/csrc/SwapAlign2Nat/SwapAlign2Nat_cuda.cu', 'segment_anything/projects/TensorMask/tensormask/layers/csrc/SwapAlign2Nat/SwapAlign2Nat.h', 'segment_anything/projects/DeepLab/README.md', 'segment_anything/projects/DeepLab/train_net.py', 'segment_anything/projects/DeepLab/configs/Cityscapes-SemanticSegmentation/Base-DeepLabV3-OS16-Semantic.yaml', 'segment_anything/projects/DeepLab/configs/Cityscapes-SemanticSegmentation/deeplab_v3_R_103_os16_mg124_poly_90k_bs16.yaml', 'segment_anything/projects/DeepLab/configs/Cityscapes-SemanticSegmentation/deeplab_v3_plus_R_103_os16_mg124_poly_90k_bs16.yaml', 'segment_anything/projects/DeepLab/deeplab/lr_scheduler.py', 'segment_anything/projects/DeepLab/deeplab/config.py', 'segment_anything/projects/DeepLab/deeplab/__init__.py', 'segment_anything/projects/DeepLab/deeplab/loss.py', 'segment_anything/projects/DeepLab/deeplab/resnet.py', 'segment_anything/projects/DeepLab/deeplab/build_solver.py', 'segment_anything/projects/DeepLab/deeplab/semantic_seg.py', 'segment_anything/projects/PointRend/README.md', 'segment_anything/projects/PointRend/train_net.py', 'segment_anything/projects/PointRend/point_rend/point_features.py', 'segment_anything/projects/PointRend/point_rend/mask_head.py', 'segment_anything/projects/PointRend/point_rend/config.py', 'segment_anything/projects/PointRend/point_rend/__init__.py', 'segment_anything/projects/PointRend/point_rend/point_head.py', 'segment_anything/projects/PointRend/point_rend/roi_heads.py', 'segment_anything/projects/PointRend/point_rend/color_augmentation.py', 'segment_anything/projects/PointRend/point_rend/semantic_seg.py', 'segment_anything/projects/PointRend/configs/SemanticSegmentation/Base-PointRend-Semantic-FPN.yaml', 'segment_anything/projects/PointRend/configs/SemanticSegmentation/pointrend_semantic_R_101_FPN_1x_cityscapes.yaml', 'segment_anything/projects/PointRend/configs/InstanceSegmentation/pointrend_rcnn_R_50_FPN_3x_coco.yaml', 'segment_anything/projects/PointRend/configs/InstanceSegmentation/pointrend_rcnn_R_50_FPN_1x_cityscapes.yaml', 'segment_anything/projects/PointRend/configs/InstanceSegmentation/pointrend_rcnn_R_50_FPN_1x_coco.yaml', 'segment_anything/projects/PointRend/configs/InstanceSegmentation/implicit_pointrend_R_50_FPN_3x_coco.yaml', 'segment_anything/projects/PointRend/configs/InstanceSegmentation/Base-PointRend-RCNN-FPN.yaml', 'segment_anything/projects/PointRend/configs/InstanceSegmentation/pointrend_rcnn_R_101_FPN_3x_coco.yaml', 'segment_anything/projects/PointRend/configs/InstanceSegmentation/implicit_pointrend_R_50_FPN_1x_coco.yaml', 'segment_anything/projects/PointRend/configs/InstanceSegmentation/pointrend_rcnn_X_101_32x8d_FPN_3x_coco.yaml', 'segment_anything/projects/PointRend/configs/InstanceSegmentation/Base-Implicit-PointRend.yaml', 'segment_anything/datasets/prepare_cocofied_lvis.py', 'segment_anything/datasets/prepare_panoptic_fpn.py', 'segment_anything/datasets/prepare_for_tests.sh', 'segment_anything/datasets/prepare_ade20k_sem_seg.py', 'segment_anything/datasets/README.md', 'segment_anything/tests/test_registry.py', 'segment_anything/tests/test_engine.py', 'segment_anything/tests/test_visualizer.py', 'segment_anything/tests/test_packaging.py', 'segment_anything/tests/test_model_analysis.py', 'segment_anything/tests/__init__.py', 'segment_anything/tests/test_scheduler.py', 'segment_anything/tests/README.md', 'segment_anything/tests/test_solver.py', 'segment_anything/tests/test_export_caffe2.py', 'segment_anything/tests/test_events.py', 'segment_anything/tests/test_export_torchscript.py', 'segment_anything/tests/test_export_onnx.py', 'segment_anything/tests/test_model_zoo.py', 'segment_anything/tests/test_checkpoint.py', 'segment_anything/tests/layers/test_nms.py', 'segment_anything/tests/layers/test_losses.py', 'segment_anything/tests/layers/test_blocks.py', 'segment_anything/tests/layers/__init__.py', 'segment_anything/tests/layers/test_roi_align.py', 'segment_anything/tests/layers/test_deformable.py', 'segment_anything/tests/layers/test_mask_ops.py', 'segment_anything/tests/layers/test_roi_align_rotated.py', 'segment_anything/tests/layers/test_nms_rotated.py', 'segment_anything/tests/structures/test_imagelist.py', 'segment_anything/tests/structures/test_keypoints.py', 'segment_anything/tests/structures/test_masks.py', 'segment_anything/tests/structures/__init__.py', 'segment_anything/tests/structures/test_rotated_boxes.py', 'segment_anything/tests/structures/test_boxes.py', 'segment_anything/tests/structures/test_instances.py', 'segment_anything/tests/config/test_instantiate_config.py', 'segment_anything/tests/config/root_cfg.py', 'segment_anything/tests/config/test_yacs_config.py', 'segment_anything/tests/config/test_lazy_config.py', 'segment_anything/tests/config/dir1/bad_import2.py', 'segment_anything/tests/config/dir1/dir1_a.py', 'segment_anything/tests/config/dir1/load_rel.py', 'segment_anything/tests/config/dir1/bad_import.py', 'segment_anything/tests/config/dir1/dir1_b.py', 'segment_anything/tests/utils/test_tensorboardx.py', 'segment_anything/tests/modeling/test_backbone.py', 'segment_anything/tests/modeling/test_matcher.py', 'segment_anything/tests/modeling/test_roi_pooler.py', 'segment_anything/tests/modeling/test_mmdet.py', 'segment_anything/tests/modeling/test_model_e2e.py', 'segment_anything/tests/modeling/test_anchor_generator.py', 'segment_anything/tests/modeling/test_roi_heads.py', 'segment_anything/tests/modeling/test_rpn.py', 'segment_anything/tests/modeling/__init__.py', 'segment_anything/tests/modeling/test_fast_rcnn.py', 'segment_anything/tests/modeling/test_box2box_transform.py', 'segment_anything/tests/tracking/test_vanilla_hungarian_bbox_iou_tracker.py', 'segment_anything/tests/tracking/__init__.py', 'segment_anything/tests/tracking/test_hungarian_tracker.py', 'segment_anything/tests/tracking/test_iou_weighted_hungarian_bbox_iou_tracker.py', 'segment_anything/tests/tracking/test_bbox_iou_tracker.py', 'segment_anything/tests/export/test_c10.py', 'segment_anything/tests/data/test_coco.py', 'segment_anything/tests/data/__init__.py', 'segment_anything/tests/data/test_rotation_transform.py', 'segment_anything/tests/data/test_dataset.py', 'segment_anything/tests/data/test_transforms.py', 'segment_anything/tests/data/test_detection_utils.py', 'segment_anything/tests/data/test_coco_evaluation.py', 'segment_anything/tests/data/test_sampler.py', 'segment_anything/docs/index.rst', 'segment_anything/docs/requirements.txt', 'segment_anything/docs/Makefile', 'segment_anything/docs/conf.py', 'segment_anything/docs/README.md', 'segment_anything/docs/_static/css/custom.css', 'segment_anything/docs/notes/index.rst', 'segment_anything/docs/notes/changelog.md', 'segment_anything/docs/notes/benchmarks.md', 'segment_anything/docs/notes/contributing.md', 'segment_anything/docs/notes/compatibility.md', 'segment_anything/docs/tutorials/lazyconfig.jpg', 'segment_anything/docs/tutorials/index.rst', 'segment_anything/docs/tutorials/training.md', 'segment_anything/docs/tutorials/install.md', 'segment_anything/docs/tutorials/README.md', 'segment_anything/docs/tutorials/getting_started.md', 'segment_anything/docs/tutorials/configs.md', 'segment_anything/docs/tutorials/data_loading.md', 'segment_anything/docs/tutorials/deployment.md', 'segment_anything/docs/tutorials/models.md', 'segment_anything/docs/tutorials/write-models.md', 'segment_anything/docs/tutorials/datasets.md', 'segment_anything/docs/tutorials/extend.md', 'segment_anything/docs/tutorials/builtin_datasets.md', 'segment_anything/docs/tutorials/lazyconfigs.md', 'segment_anything/docs/tutorials/evaluation.md', 'segment_anything/docs/tutorials/augmentation.md', 'segment_anything/docs/modules/checkpoint.rst', 'segment_anything/docs/modules/evaluation.rst', 'segment_anything/docs/modules/index.rst', 'segment_anything/docs/modules/solver.rst', 'segment_anything/docs/modules/layers.rst', 'segment_anything/docs/modules/engine.rst', 'segment_anything/docs/modules/config.rst', 'segment_anything/docs/modules/modeling.rst', 'segment_anything/docs/modules/export.rst', 'segment_anything/docs/modules/data.rst', 'segment_anything/docs/modules/fvcore.rst', 'segment_anything/docs/modules/structures.rst', 'segment_anything/docs/modules/data_transforms.rst', 'segment_anything/docs/modules/utils.rst', 'segment_anything/docs/modules/model_zoo.rst', 'segment_anything/configs/Base-RetinaNet.yaml', 'segment_anything/configs/Base-RCNN-FPN.yaml', 'segment_anything/configs/Base-RCNN-C4.yaml', 'segment_anything/configs/Base-RCNN-DilatedC5.yaml', 'segment_anything/configs/Misc/scratch_mask_rcnn_R_50_FPN_9x_syncbn.yaml', 'segment_anything/configs/Misc/mask_rcnn_R_50_FPN_3x_dconv_c3-c5.yaml', 'segment_anything/configs/Misc/semantic_R_50_FPN_1x.yaml', 'segment_anything/configs/Misc/scratch_mask_rcnn_R_50_FPN_3x_gn.yaml', 'segment_anything/configs/Misc/panoptic_fpn_R_101_dconv_cascade_gn_3x.yaml', 'segment_anything/configs/Misc/scratch_mask_rcnn_R_50_FPN_9x_gn.yaml', 'segment_anything/configs/Misc/mask_rcnn_R_50_FPN_3x_gn.yaml', 'segment_anything/configs/Misc/mmdet_mask_rcnn_R_50_FPN_1x.py', 'segment_anything/configs/Misc/mask_rcnn_R_50_FPN_1x_dconv_c3-c5.yaml', 'segment_anything/configs/Misc/cascade_mask_rcnn_R_50_FPN_1x.yaml', 'segment_anything/configs/Misc/cascade_mask_rcnn_X_152_32x8d_FPN_IN5k_gn_dconv.yaml', 'segment_anything/configs/Misc/mask_rcnn_R_50_FPN_1x_cls_agnostic.yaml', 'segment_anything/configs/Misc/cascade_mask_rcnn_R_50_FPN_3x.yaml', 'segment_anything/configs/Misc/torchvision_imagenet_R_50.py', 'segment_anything/configs/Misc/mask_rcnn_R_50_FPN_3x_syncbn.yaml', 'segment_anything/configs/COCO-Keypoints/keypoint_rcnn_X_101_32x8d_FPN_3x.yaml', 'segment_anything/configs/COCO-Keypoints/keypoint_rcnn_R_50_FPN_1x.yaml', 'segment_anything/configs/COCO-Keypoints/keypoint_rcnn_R_50_FPN_1x.py', 'segment_anything/configs/COCO-Keypoints/keypoint_rcnn_R_50_FPN_3x.yaml', 'segment_anything/configs/COCO-Keypoints/Base-Keypoint-RCNN-FPN.yaml', 'segment_anything/configs/COCO-Keypoints/keypoint_rcnn_R_101_FPN_3x.yaml', 'segment_anything/configs/PascalVOC-Detection/faster_rcnn_R_50_FPN.yaml', 'segment_anything/configs/PascalVOC-Detection/faster_rcnn_R_50_C4.yaml', 'segment_anything/configs/Detectron1-Comparisons/mask_rcnn_R_50_FPN_noaug_1x.yaml', 'segment_anything/configs/Detectron1-Comparisons/keypoint_rcnn_R_50_FPN_1x.yaml', 'segment_anything/configs/Detectron1-Comparisons/README.md', 'segment_anything/configs/Detectron1-Comparisons/faster_rcnn_R_50_FPN_noaug_1x.yaml', 'segment_anything/configs/COCO-Detection/faster_rcnn_X_101_32x8d_FPN_3x.yaml', 'segment_anything/configs/COCO-Detection/rpn_R_50_C4_1x.yaml', 'segment_anything/configs/COCO-Detection/rpn_R_50_FPN_1x.yaml', 'segment_anything/configs/COCO-Detection/faster_rcnn_R_101_C4_3x.yaml', 'segment_anything/configs/COCO-Detection/retinanet_R_101_FPN_3x.yaml', 'segment_anything/configs/COCO-Detection/faster_rcnn_R_101_FPN_3x.yaml', 'segment_anything/configs/COCO-Detection/fcos_R_50_FPN_1x.py', 'segment_anything/configs/COCO-Detection/faster_rcnn_R_50_DC5_3x.yaml', 'segment_anything/configs/COCO-Detection/faster_rcnn_R_50_DC5_1x.yaml', 'segment_anything/configs/COCO-Detection/faster_rcnn_R_50_C4_1x.yaml', 'segment_anything/configs/COCO-Detection/faster_rcnn_R_50_C4_3x.yaml', 'segment_anything/configs/COCO-Detection/fast_rcnn_R_50_FPN_1x.yaml', 'segment_anything/configs/COCO-Detection/faster_rcnn_R_50_FPN_1x.yaml', 'segment_anything/configs/COCO-Detection/retinanet_R_50_FPN_1x.py', 'segment_anything/configs/COCO-Detection/faster_rcnn_R_50_FPN_3x.yaml', 'segment_anything/configs/COCO-Detection/retinanet_R_50_FPN_3x.yaml', 'segment_anything/configs/COCO-Detection/faster_rcnn_R_101_DC5_3x.yaml', 'segment_anything/configs/COCO-Detection/retinanet_R_50_FPN_1x.yaml', 'segment_anything/configs/common/coco_schedule.py', 'segment_anything/configs/common/README.md', 'segment_anything/configs/common/train.py', 'segment_anything/configs/common/optim.py', 'segment_anything/configs/common/models/panoptic_fpn.py', 'segment_anything/configs/common/models/keypoint_rcnn_fpn.py', 'segment_anything/configs/common/models/mask_rcnn_vitdet.py', 'segment_anything/configs/common/models/fcos.py', 'segment_anything/configs/common/models/mask_rcnn_c4.py', 'segment_anything/configs/common/models/retinanet.py', 'segment_anything/configs/common/models/cascade_rcnn.py', 'segment_anything/configs/common/models/mask_rcnn_fpn.py', 'segment_anything/configs/common/data/coco.py', 'segment_anything/configs/common/data/constants.py', 'segment_anything/configs/common/data/coco_panoptic_separated.py', 'segment_anything/configs/common/data/coco_keypoint.py', 'segment_anything/configs/COCO-PanopticSegmentation/panoptic_fpn_R_101_3x.yaml', 'segment_anything/configs/COCO-PanopticSegmentation/panoptic_fpn_R_50_1x.py', 'segment_anything/configs/COCO-PanopticSegmentation/Base-Panoptic-FPN.yaml', 'segment_anything/configs/COCO-PanopticSegmentation/panoptic_fpn_R_50_1x.yaml', 'segment_anything/configs/COCO-PanopticSegmentation/panoptic_fpn_R_50_3x.yaml', 'segment_anything/configs/LVISv1-InstanceSegmentation/mask_rcnn_R_101_FPN_1x.yaml', 'segment_anything/configs/LVISv1-InstanceSegmentation/mask_rcnn_R_50_FPN_1x.yaml', 'segment_anything/configs/LVISv1-InstanceSegmentation/mask_rcnn_X_101_32x8d_FPN_1x.yaml', 'segment_anything/configs/LVISv0.5-InstanceSegmentation/mask_rcnn_R_101_FPN_1x.yaml', 'segment_anything/configs/LVISv0.5-InstanceSegmentation/mask_rcnn_R_50_FPN_1x.yaml', 'segment_anything/configs/LVISv0.5-InstanceSegmentation/mask_rcnn_X_101_32x8d_FPN_1x.yaml', 'segment_anything/configs/quick_schedules/keypoint_rcnn_R_50_FPN_inference_acc_test.yaml', 'segment_anything/configs/quick_schedules/mask_rcnn_R_50_FPN_training_acc_test.yaml', 'segment_anything/configs/quick_schedules/mask_rcnn_R_50_C4_training_acc_test.yaml', 'segment_anything/configs/quick_schedules/cascade_mask_rcnn_R_50_FPN_inference_acc_test.yaml', 'segment_anything/configs/quick_schedules/mask_rcnn_R_50_C4_GCV_instant_test.yaml', 'segment_anything/configs/quick_schedules/mask_rcnn_R_50_C4_instant_test.yaml', 'segment_anything/configs/quick_schedules/mask_rcnn_R_50_FPN_instant_test.yaml', 'segment_anything/configs/quick_schedules/panoptic_fpn_R_50_instant_test.yaml', 'segment_anything/configs/quick_schedules/retinanet_R_50_FPN_inference_acc_test.yaml', 'segment_anything/configs/quick_schedules/mask_rcnn_R_50_DC5_inference_acc_test.yaml', 'segment_anything/configs/quick_schedules/retinanet_R_50_FPN_instant_test.yaml', 'segment_anything/configs/quick_schedules/README.md', 'segment_anything/configs/quick_schedules/mask_rcnn_R_50_FPN_pred_boxes_training_acc_test.yaml', 'segment_anything/configs/quick_schedules/panoptic_fpn_R_50_training_acc_test.yaml', 'segment_anything/configs/quick_schedules/rpn_R_50_FPN_instant_test.yaml', 'segment_anything/configs/quick_schedules/semantic_R_50_FPN_training_acc_test.yaml', 'segment_anything/configs/quick_schedules/keypoint_rcnn_R_50_FPN_normalized_training_acc_test.yaml', 'segment_anything/configs/quick_schedules/panoptic_fpn_R_50_inference_acc_test.yaml', 'segment_anything/configs/quick_schedules/cascade_mask_rcnn_R_50_FPN_instant_test.yaml', 'segment_anything/configs/quick_schedules/fast_rcnn_R_50_FPN_inference_acc_test.yaml', 'segment_anything/configs/quick_schedules/semantic_R_50_FPN_inference_acc_test.yaml', 'segment_anything/configs/quick_schedules/rpn_R_50_FPN_inference_acc_test.yaml', 'segment_anything/configs/quick_schedules/keypoint_rcnn_R_50_FPN_instant_test.yaml', 'segment_anything/configs/quick_schedules/keypoint_rcnn_R_50_FPN_training_acc_test.yaml', 'segment_anything/configs/quick_schedules/mask_rcnn_R_50_C4_inference_acc_test.yaml', 'segment_anything/configs/quick_schedules/semantic_R_50_FPN_instant_test.yaml', 'segment_anything/configs/quick_schedules/mask_rcnn_R_50_FPN_inference_acc_test.yaml', 'segment_anything/configs/quick_schedules/fast_rcnn_R_50_FPN_instant_test.yaml', 'segment_anything/configs/Cityscapes/mask_rcnn_R_50_FPN.yaml', 'segment_anything/configs/new_baselines/mask_rcnn_R_101_FPN_200ep_LSJ.py', 'segment_anything/configs/new_baselines/mask_rcnn_R_50_FPN_50ep_LSJ.py', 'segment_anything/configs/new_baselines/mask_rcnn_regnetx_4gf_dds_FPN_100ep_LSJ.py', 'segment_anything/configs/new_baselines/mask_rcnn_regnetx_4gf_dds_FPN_400ep_LSJ.py', 'segment_anything/configs/new_baselines/mask_rcnn_regnety_4gf_dds_FPN_400ep_LSJ.py', 'segment_anything/configs/new_baselines/mask_rcnn_R_50_FPN_200ep_LSJ.py', 'segment_anything/configs/new_baselines/mask_rcnn_regnety_4gf_dds_FPN_100ep_LSJ.py', 'segment_anything/configs/new_baselines/mask_rcnn_R_50_FPN_100ep_LSJ.py', 'segment_anything/configs/new_baselines/mask_rcnn_regnety_4gf_dds_FPN_200ep_LSJ.py', 'segment_anything/configs/new_baselines/mask_rcnn_R_50_FPN_400ep_LSJ.py', 'segment_anything/configs/new_baselines/mask_rcnn_R_101_FPN_400ep_LSJ.py', 'segment_anything/configs/new_baselines/mask_rcnn_R_101_FPN_100ep_LSJ.py', 'segment_anything/configs/new_baselines/mask_rcnn_regnetx_4gf_dds_FPN_200ep_LSJ.py', 'segment_anything/configs/COCO-InstanceSegmentation/mask_rcnn_regnetx_4gf_dds_fpn_1x.py', 'segment_anything/configs/COCO-InstanceSegmentation/mask_rcnn_regnety_4gf_dds_fpn_1x.py', 'segment_anything/configs/COCO-InstanceSegmentation/mask_rcnn_R_50_FPN_1x.py', 'segment_anything/configs/COCO-InstanceSegmentation/mask_rcnn_R_101_FPN_3x.yaml', 'segment_anything/configs/COCO-InstanceSegmentation/mask_rcnn_R_50_FPN_1x_giou.yaml', 'segment_anything/configs/COCO-InstanceSegmentation/mask_rcnn_R_50_FPN_1x.yaml', 'segment_anything/configs/COCO-InstanceSegmentation/mask_rcnn_R_50_FPN_3x.yaml', 'segment_anything/configs/COCO-InstanceSegmentation/mask_rcnn_R_50_C4_1x.py', 'segment_anything/configs/COCO-InstanceSegmentation/mask_rcnn_R_101_C4_3x.yaml', 'segment_anything/configs/COCO-InstanceSegmentation/mask_rcnn_R_50_C4_3x.yaml', 'segment_anything/configs/COCO-InstanceSegmentation/mask_rcnn_R_50_C4_1x.yaml', 'segment_anything/configs/COCO-InstanceSegmentation/mask_rcnn_X_101_32x8d_FPN_3x.yaml', 'segment_anything/configs/COCO-InstanceSegmentation/mask_rcnn_R_50_DC5_3x.yaml', 'segment_anything/configs/COCO-InstanceSegmentation/mask_rcnn_R_50_DC5_1x.yaml', 'segment_anything/configs/COCO-InstanceSegmentation/mask_rcnn_R_101_DC5_3x.yaml', 'segment_anything/.github/CODE_OF_CONDUCT.md', 'segment_anything/.github/Detectron2-Logo-Horz.svg', 'segment_anything/.github/pull_request_template.md', 'segment_anything/.github/ISSUE_TEMPLATE.md', 'segment_anything/.github/CONTRIBUTING.md', 'segment_anything/.github/workflows/workflow.yml', 'segment_anything/.github/workflows/needs-reply.yml', 'segment_anything/.github/workflows/remove-needs-reply.yml', 'segment_anything/.github/workflows/levenshtein.js', 'segment_anything/.github/workflows/check-template.yml', 'segment_anything/.github/ISSUE_TEMPLATE/bugs.md', 'segment_anything/.github/ISSUE_TEMPLATE/feature-request.md', 'segment_anything/.github/ISSUE_TEMPLATE/unexpected-problems-bugs.md', 'segment_anything/.github/ISSUE_TEMPLATE/config.yml', 'segment_anything/.github/ISSUE_TEMPLATE/documentation.md', 'segment_anything/dev/run_instant_tests.sh', 'segment_anything/dev/linter.sh', 'segment_anything/dev/README.md', 'segment_anything/dev/parse_results.sh', 'segment_anything/dev/run_inference_tests.sh', 'segment_anything/dev/packaging/build_all_wheels.sh', 'segment_anything/dev/packaging/pkg_helpers.bash', 'segment_anything/dev/packaging/build_wheel.sh', 'segment_anything/dev/packaging/gen_wheel_index.sh', 'segment_anything/dev/packaging/gen_install_table.py', 'segment_anything/dev/packaging/README.md', 'segment_anything/detectron2/__init__.py', 'segment_anything/detectron2/checkpoint/catalog.py', 'segment_anything/detectron2/checkpoint/c2_model_loading.py', 'segment_anything/detectron2/checkpoint/__init__.py', 'segment_anything/detectron2/checkpoint/detection_checkpoint.py', 'segment_anything/detectron2/layers/deform_conv.py', 'segment_anything/detectron2/layers/shape_spec.py', 'segment_anything/detectron2/layers/roi_align.py', 'segment_anything/detectron2/layers/roi_align_rotated.py', 'segment_anything/detectron2/layers/nms.py', 'segment_anything/detectron2/layers/__init__.py', 'segment_anything/detectron2/layers/aspp.py', 'segment_anything/detectron2/layers/mask_ops.py', 'segment_anything/detectron2/layers/wrappers.py', 'segment_anything/detectron2/layers/losses.py', 'segment_anything/detectron2/layers/blocks.py', 'segment_anything/detectron2/layers/batch_norm.py', 'segment_anything/detectron2/layers/rotated_boxes.py', 'segment_anything/detectron2/layers/csrc/cuda_version.cu', 'segment_anything/detectron2/layers/csrc/README.md', 'segment_anything/detectron2/layers/csrc/vision.cpp', 'segment_anything/detectron2/layers/csrc/cocoeval/cocoeval.h', 'segment_anything/detectron2/layers/csrc/cocoeval/cocoeval.cpp', 'segment_anything/detectron2/layers/csrc/ROIAlignRotated/ROIAlignRotated_cuda.cu', 'segment_anything/detectron2/layers/csrc/ROIAlignRotated/ROIAlignRotated_cpu.cpp', 'segment_anything/detectron2/layers/csrc/ROIAlignRotated/ROIAlignRotated.h', 'segment_anything/detectron2/layers/csrc/box_iou_rotated/box_iou_rotated.h', 'segment_anything/detectron2/layers/csrc/box_iou_rotated/box_iou_rotated_utils.h', 'segment_anything/detectron2/layers/csrc/box_iou_rotated/box_iou_rotated_cpu.cpp', 'segment_anything/detectron2/layers/csrc/box_iou_rotated/box_iou_rotated_cuda.cu', 'segment_anything/detectron2/layers/csrc/deformable/deform_conv_cuda_kernel.cu', 'segment_anything/detectron2/layers/csrc/deformable/deform_conv_cuda.cu', 'segment_anything/detectron2/layers/csrc/deformable/deform_conv.h', 'segment_anything/detectron2/layers/csrc/nms_rotated/nms_rotated_cuda.cu', 'segment_anything/detectron2/layers/csrc/nms_rotated/nms_rotated_cpu.cpp', 'segment_anything/detectron2/layers/csrc/nms_rotated/nms_rotated.h', 'segment_anything/detectron2/structures/instances.py', 'segment_anything/detectron2/structures/__init__.py', 'segment_anything/detectron2/structures/boxes.py', 'segment_anything/detectron2/structures/keypoints.py', 'segment_anything/detectron2/structures/masks.py', 'segment_anything/detectron2/structures/image_list.py', 'segment_anything/detectron2/structures/rotated_boxes.py', 'segment_anything/detectron2/config/config.py', 'segment_anything/detectron2/config/compat.py', 'segment_anything/detectron2/config/__init__.py', 'segment_anything/detectron2/config/instantiate.py', 'segment_anything/detectron2/config/defaults.py', 'segment_anything/detectron2/config/lazy.py', 'segment_anything/detectron2/projects/__init__.py', 'segment_anything/detectron2/projects/README.md', 'segment_anything/detectron2/utils/serialize.py', 'segment_anything/detectron2/utils/colormap.py', 'segment_anything/detectron2/utils/tracing.py', 'segment_anything/detectron2/utils/env.py', 'segment_anything/detectron2/utils/analysis.py', 'segment_anything/detectron2/utils/comm.py', 'segment_anything/detectron2/utils/memory.py', 'segment_anything/detectron2/utils/video_visualizer.py', 'segment_anything/detectron2/utils/registry.py', 'segment_anything/detectron2/utils/events.py', 'segment_anything/detectron2/utils/collect_env.py', 'segment_anything/detectron2/utils/__init__.py', 'segment_anything/detectron2/utils/logger.py', 'segment_anything/detectron2/utils/README.md', 'segment_anything/detectron2/utils/file_io.py', 'segment_anything/detectron2/utils/develop.py', 'segment_anything/detectron2/utils/testing.py', 'segment_anything/detectron2/utils/visualizer.py', 'segment_anything/detectron2/solver/build.py', 'segment_anything/detectron2/solver/lr_scheduler.py', 'segment_anything/detectron2/solver/__init__.py', 'segment_anything/detectron2/model_zoo/model_zoo.py', 'segment_anything/detectron2/model_zoo/__init__.py', 'segment_anything/detectron2/modeling/test_time_augmentation.py', 'segment_anything/detectron2/modeling/poolers.py', 'segment_anything/detectron2/modeling/matcher.py', 'segment_anything/detectron2/modeling/__init__.py', 'segment_anything/detectron2/modeling/box_regression.py', 'segment_anything/detectron2/modeling/mmdet_wrapper.py', 'segment_anything/detectron2/modeling/anchor_generator.py', 'segment_anything/detectron2/modeling/sampling.py', 'segment_anything/detectron2/modeling/postprocessing.py', 'segment_anything/detectron2/modeling/meta_arch/build.py', 'segment_anything/detectron2/modeling/meta_arch/rcnn.py', 'segment_anything/detectron2/modeling/meta_arch/panoptic_fpn.py', 'segment_anything/detectron2/modeling/meta_arch/dense_detector.py', 'segment_anything/detectron2/modeling/meta_arch/__init__.py', 'segment_anything/detectron2/modeling/meta_arch/fcos.py', 'segment_anything/detectron2/modeling/meta_arch/retinanet.py', 'segment_anything/detectron2/modeling/meta_arch/semantic_seg.py', 'segment_anything/detectron2/modeling/proposal_generator/build.py', 'segment_anything/detectron2/modeling/proposal_generator/rpn.py', 'segment_anything/detectron2/modeling/proposal_generator/rrpn.py', 'segment_anything/detectron2/modeling/proposal_generator/__init__.py', 'segment_anything/detectron2/modeling/proposal_generator/proposal_utils.py', 'segment_anything/detectron2/modeling/roi_heads/mask_head.py', 'segment_anything/detectron2/modeling/roi_heads/fast_rcnn.py', 'segment_anything/detectron2/modeling/roi_heads/box_head.py', 'segment_anything/detectron2/modeling/roi_heads/keypoint_head.py', 'segment_anything/detectron2/modeling/roi_heads/__init__.py', 'segment_anything/detectron2/modeling/roi_heads/rotated_fast_rcnn.py', 'segment_anything/detectron2/modeling/roi_heads/cascade_rcnn.py', 'segment_anything/detectron2/modeling/roi_heads/roi_heads.py', 'segment_anything/detectron2/modeling/backbone/build.py', 'segment_anything/detectron2/modeling/backbone/fpn.py', 'segment_anything/detectron2/modeling/backbone/regnet.py', 'segment_anything/detectron2/modeling/backbone/swin.py', 'segment_anything/detectron2/modeling/backbone/backbone.py', 'segment_anything/detectron2/modeling/backbone/__init__.py', 'segment_anything/detectron2/modeling/backbone/vit.py', 'segment_anything/detectron2/modeling/backbone/resnet.py', 'segment_anything/detectron2/modeling/backbone/utils.py', 'segment_anything/detectron2/modeling/backbone/mvit.py', 'segment_anything/detectron2/evaluation/fast_eval_api.py', 'segment_anything/detectron2/evaluation/panoptic_evaluation.py', 'segment_anything/detectron2/evaluation/__init__.py', 'segment_anything/detectron2/evaluation/cityscapes_evaluation.py', 'segment_anything/detectron2/evaluation/coco_evaluation.py', 'segment_anything/detectron2/evaluation/sem_seg_evaluation.py', 'segment_anything/detectron2/evaluation/pascal_voc_evaluation.py', 'segment_anything/detectron2/evaluation/lvis_evaluation.py', 'segment_anything/detectron2/evaluation/testing.py', 'segment_anything/detectron2/evaluation/evaluator.py', 'segment_anything/detectron2/evaluation/rotated_coco_evaluation.py', 'segment_anything/detectron2/tracking/bbox_iou_tracker.py', 'segment_anything/detectron2/tracking/vanilla_hungarian_bbox_iou_tracker.py', 'segment_anything/detectron2/tracking/hungarian_tracker.py', 'segment_anything/detectron2/tracking/base_tracker.py', 'segment_anything/detectron2/tracking/__init__.py', 'segment_anything/detectron2/tracking/utils.py', 'segment_anything/detectron2/tracking/iou_weighted_hungarian_bbox_iou_tracker.py', 'segment_anything/detectron2/export/c10.py', 'segment_anything/detectron2/export/caffe2_export.py', 'segment_anything/detectron2/export/flatten.py', 'segment_anything/detectron2/export/caffe2_patch.py', 'segment_anything/detectron2/export/caffe2_modeling.py', 'segment_anything/detectron2/export/__init__.py', 'segment_anything/detectron2/export/shared.py', 'segment_anything/detectron2/export/README.md', 'segment_anything/detectron2/export/api.py', 'segment_anything/detectron2/export/caffe2_inference.py', 'segment_anything/detectron2/export/torchscript_patch.py', 'segment_anything/detectron2/export/torchscript.py', 'segment_anything/detectron2/data/catalog.py', 'segment_anything/detectron2/data/build.py', 'segment_anything/detectron2/data/benchmark.py', 'segment_anything/detectron2/data/__init__.py', 'segment_anything/detectron2/data/detection_utils.py', 'segment_anything/detectron2/data/dataset_mapper.py', 'segment_anything/detectron2/data/common.py', 'segment_anything/detectron2/data/datasets/coco.py', 'segment_anything/detectron2/data/datasets/register_coco.py', 'segment_anything/detectron2/data/datasets/cityscapes.py', 'segment_anything/detectron2/data/datasets/cityscapes_panoptic.py', 'segment_anything/detectron2/data/datasets/lvis_v1_categories.py', 'segment_anything/detectron2/data/datasets/__init__.py', 'segment_anything/detectron2/data/datasets/lvis.py', 'segment_anything/detectron2/data/datasets/README.md', 'segment_anything/detectron2/data/datasets/coco_panoptic.py', 'segment_anything/detectron2/data/datasets/builtin.py', 'segment_anything/detectron2/data/datasets/lvis_v1_category_image_count.py', 'segment_anything/detectron2/data/datasets/pascal_voc.py', 'segment_anything/detectron2/data/datasets/lvis_v0_5_categories.py', 'segment_anything/detectron2/data/datasets/builtin_meta.py', 'segment_anything/detectron2/data/transforms/augmentation_impl.py', 'segment_anything/detectron2/data/transforms/augmentation.py', 'segment_anything/detectron2/data/transforms/__init__.py', 'segment_anything/detectron2/data/transforms/transform.py', 'segment_anything/detectron2/data/samplers/__init__.py', 'segment_anything/detectron2/data/samplers/grouped_batch_sampler.py', 'segment_anything/detectron2/data/samplers/distributed_sampler.py', 'segment_anything/detectron2/engine/hooks.py', 'segment_anything/detectron2/engine/__init__.py', 'segment_anything/detectron2/engine/train_loop.py', 'segment_anything/detectron2/engine/launch.py', 'segment_anything/detectron2/engine/defaults.py', 'segment_anything/.git/config', 'segment_anything/.git/HEAD', 'segment_anything/.git/description', 'segment_anything/.git/index', 'segment_anything/.git/packed-refs', 'segment_anything/.git/objects/pack/pack-2fc243023b0ed077d23a1f16fcbfe8c9caacb7ab.pack', 'segment_anything/.git/objects/pack/pack-2fc243023b0ed077d23a1f16fcbfe8c9caacb7ab.idx', 'segment_anything/.git/info/exclude', 'segment_anything/.git/logs/HEAD', 'segment_anything/.git/logs/refs/heads/main', 'segment_anything/.git/logs/refs/remotes/origin/HEAD', 'segment_anything/.git/hooks/commit-msg.sample', 'segment_anything/.git/hooks/pre-rebase.sample', 'segment_anything/.git/hooks/pre-commit.sample', 'segment_anything/.git/hooks/applypatch-msg.sample', 'segment_anything/.git/hooks/fsmonitor-watchman.sample', 'segment_anything/.git/hooks/pre-receive.sample', 'segment_anything/.git/hooks/prepare-commit-msg.sample', 'segment_anything/.git/hooks/post-update.sample', 'segment_anything/.git/hooks/pre-merge-commit.sample', 'segment_anything/.git/hooks/pre-applypatch.sample', 'segment_anything/.git/hooks/pre-push.sample', 'segment_anything/.git/hooks/update.sample', 'segment_anything/.git/hooks/push-to-checkout.sample', 'segment_anything/.git/refs/heads/main', 'segment_anything/.git/refs/remotes/origin/HEAD', 'segment_anything/.circleci/import-tests.sh', 'segment_anything/.circleci/config.yml', 'Zero-Shot-Learning/LICENSE', 'Zero-Shot-Learning/requirements.txt', 'Zero-Shot-Learning/README.md', 'Zero-Shot-Learning/Preprocessing Scripts/Alphabet-w_alphabet.csv', 'Zero-Shot-Learning/Preprocessing Scripts/createS.py', 'Zero-Shot-Learning/Preprocessing Scripts/Alphabet.csv', 'Zero-Shot-Learning/Preprocessing Scripts/createS-4Split.py', 'Zero-Shot-Learning/.git/config', 'Zero-Shot-Learning/.git/HEAD', 'Zero-Shot-Learning/.git/description', 'Zero-Shot-Learning/.git/index', 'Zero-Shot-Learning/.git/packed-refs', 'Zero-Shot-Learning/.git/objects/pack/pack-7c53b9f8b8d84ac8564629bee2e12683768e66fe.pack', 'Zero-Shot-Learning/.git/objects/pack/pack-7c53b9f8b8d84ac8564629bee2e12683768e66fe.idx', 'Zero-Shot-Learning/.git/info/exclude', 'Zero-Shot-Learning/.git/logs/HEAD', 'Zero-Shot-Learning/.git/logs/refs/heads/master', 'Zero-Shot-Learning/.git/logs/refs/remotes/origin/HEAD', 'Zero-Shot-Learning/.git/hooks/commit-msg.sample', 'Zero-Shot-Learning/.git/hooks/pre-rebase.sample', 'Zero-Shot-Learning/.git/hooks/pre-commit.sample', 'Zero-Shot-Learning/.git/hooks/applypatch-msg.sample', 'Zero-Shot-Learning/.git/hooks/fsmonitor-watchman.sample', 'Zero-Shot-Learning/.git/hooks/pre-receive.sample', 'Zero-Shot-Learning/.git/hooks/prepare-commit-msg.sample', 'Zero-Shot-Learning/.git/hooks/post-update.sample', 'Zero-Shot-Learning/.git/hooks/pre-merge-commit.sample', 'Zero-Shot-Learning/.git/hooks/pre-applypatch.sample', 'Zero-Shot-Learning/.git/hooks/pre-push.sample', 'Zero-Shot-Learning/.git/hooks/update.sample', 'Zero-Shot-Learning/.git/hooks/push-to-checkout.sample', 'Zero-Shot-Learning/.git/refs/heads/master', 'Zero-Shot-Learning/.git/refs/remotes/origin/HEAD', 'Zero-Shot-Learning/src/Run.py', 'Zero-Shot-Learning/src/zeroshot/ExperimentData.py', 'Zero-Shot-Learning/src/zeroshot/__init__.py', 'Zero-Shot-Learning/src/zeroshot/ZSL.py', 'Zero-Shot-Learning/src/zeroshot/CalculationData.py', 'Zero-Shot-Learning/src/zeroshot/TrainData.py', 'Zero-Shot-Learning/src/zeroshot/Parameters.py', 'Zero-Shot-Learning/src/zeroshot/ExperimentResults.py']

The likely issue occurs when the search space is huge especially when you are searching within a codebase.

Pwuts commented 1 year ago

Yeah that explains the error :')

Fadude commented 1 year ago

@Pwuts any suggestions of how to solve this issue? Its the same usecase on my end - scanning a source-base

Pwuts commented 1 year ago

@Fadude working on it

sidewaysthought commented 1 year ago

I've drafted code that chunks, combines by averaging, then returning that combined embedding. I won't do anything with it if you've already done all the things @Pwuts.

bassie661 commented 1 year ago

getting the same at command: get_hyperlinks

error: NEXT ACTION: COMMAND = get_hyperlinks ARGUMENTS = {'url': 'https://www.coindesk.com/'} Traceback (most recent call last): File "", line 198, in _run_module_as_main File "", line 88, in _run_code File "/_auto-GPT2/agent/autogpt/main.py", line 5, in autogpt.cli.main() File "/usr/local/lib/python3.11/site-packages/click/core.py", line 1130, in call return self.main(args, kwargs) ^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/click/core.py", line 1055, in main rv = self.invoke(ctx) ^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/click/core.py", line 1635, in invoke rv = super().invoke(ctx) ^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/click/core.py", line 1404, in invoke return ctx.invoke(self.callback, ctx.params) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/click/core.py", line 760, in invoke return __callback(args, kwargs) ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/click/decorators.py", line 26, in new_func return f(get_current_context(), *args, *kwargs) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/_auto-GPT2/agent/autogpt/cli.py", line 90, in main run_auto_gpt( File "/_auto-GPT2/agent/autogpt/main.py", line 154, in run_auto_gpt agent.start_interaction_loop() File "/_auto-GPT2/agent/autogpt/agent/agent.py", line 241, in start_interaction_loop self.memory.add(memory_to_add) File "/_auto-GPT2/agent/autogpt/memory/local.py", line 66, in add embedding = create_embedding_with_ada(text) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/_auto-GPT2/agent/autogpt/llm_utils.py", line 170, in create_embedding_with_ada return api_manager.embedding_create( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/_auto-GPT2/agent/autogpt/api_manager.py", line 89, in embedding_create response = openai.Embedding.create(input=text_list, model=model) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/openai/api_resources/embedding.py", line 33, in create response = super().create(args, kwargs) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/openai/api_resources/abstract/engine_apiresource.py", line 153, in create response, , api_key = requestor.request( ^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/openai/api_requestor.py", line 226, in request resp, got_stream = self._interpret_response(result, stream) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/openai/api_requestor.py", line 619, in _interpret_response self._interpret_response_line( File "/usr/local/lib/python3.11/site-packages/openai/api_requestor.py", line 682, in _interpret_response_line raise self.handle_error_response( openai.error.InvalidRequestError: This model's maximum context length is 8191 tokens, however you requested 18318 tokens (18318 in your prompt; 0 for the completion). Please reduce your prompt; or completion length. Press any key to continue...

xain commented 1 year ago

I've drafted code that chunks, combines by averaging, then returning that combined embedding. I won't do anything with it if you've already done all the things @Pwuts.

could you share your modification?

Pwuts commented 1 year ago

I've drafted code that chunks, combines by averaging, then returning that combined embedding. I won't do anything with it if you've already done all the things @Pwuts.

I have a PR in my review-inbox that should fix all of these issues. :)

iadnanmalik commented 1 year ago

Same issue

perrosnk commented 1 year ago

Got the same error with COMMAND = search_files in the workspace directory

Pwuts commented 1 year ago

@perrosnk that's #2801

bassie661 commented 1 year ago

I checked this PR #2542 and it works, had no more "maximum context length" issues since

ancoleman commented 1 year ago

I've pulled the latest updates and I'm experiencing this issue still: 

SYSTEM:  Command browse_website returned: ("Answer gathered from website: To use the 'openapi-python-client' library to parse OpenAPI Spec files, you can run the following commands:\n\n1. To generate a new OpenAPI Client library:\n```\n$ openapi-python-client generate [OPTIONS]\n```\nOptions include:\n- --url TEXT: A URL to read the JSON from\n- --path PATH: A path to the JSON file\n- --custom-template-path DIRECTORY: A path to a directory containing custom template(s)\n- --meta [none|poetry|setup]: The type of metadata you want to generate (default: poetry)\n- --file-encoding TEXT: Encoding used when writing generated files (default: utf-8)\n- --config PATH: Path to the config file to use\n\n2. To update an existing OpenAPI Client library:\n```\n$ openapi-python-client update [OPTIONS]\n```\nOptions are the same as for the generate command.\n\nNote that the update command does not overwrite specific metadata for the generated client, such as the README.md, .gitignore, and pyproject.toml. \n \n Links: ['Skip to content (https://github.com/openapi-generators/openapi-python-client/blob/main/usage.md#start-of-content)', '\\n\\n\\n\\n (https://github.com/)', '\\n Sign\\xa0up\\n (https://github.com/signup?ref_cta=Sign+up&ref_loc=header+logged+out&ref_page=%2F%3Cuser-name%3E%2F%3Crepo-name%3E%2Fblob%2Fshow&source=header-repo)', '\\n\\n\\n\\n\\nActions\\n Automate any workflow\\n \\n (https://github.com/features/actions)', '\\n\\n\\n\\n\\nPackages\\n Host and manage packages\\n \\n (https://github.com/features/packages)']", <selenium.webdriver.chrome.webdriver.WebDriver (session="ca00dc99970ac2d55b4bc8c7d9b5dfe2")>)
Traceback (most recent call last):
  File "/usr/local/lib/python3.10/runpy.py", line 196, in _run_module_as_main
    return _run_code(code, main_globals, None,
  File "/usr/local/lib/python3.10/runpy.py", line 86, in _run_code
    exec(code, run_globals)
  File "/app/autogpt/__main__.py", line 5, in <module>
    autogpt.cli.main()
  File "/usr/local/lib/python3.10/site-packages/click/core.py", line 1130, in __call__
    return self.main(*args, **kwargs)
  File "/usr/local/lib/python3.10/site-packages/click/core.py", line 1055, in main
    rv = self.invoke(ctx)
  File "/usr/local/lib/python3.10/site-packages/click/core.py", line 1635, in invoke
    rv = super().invoke(ctx)
  File "/usr/local/lib/python3.10/site-packages/click/core.py", line 1404, in invoke
    return ctx.invoke(self.callback, **ctx.params)
  File "/usr/local/lib/python3.10/site-packages/click/core.py", line 760, in invoke
    return __callback(*args, **kwargs)
  File "/usr/local/lib/python3.10/site-packages/click/decorators.py", line 26, in new_func
    return f(get_current_context(), *args, **kwargs)
  File "/app/autogpt/cli.py", line 90, in main
    run_auto_gpt(
  File "/app/autogpt/main.py", line 186, in run_auto_gpt
    agent.start_interaction_loop()
  File "/app/autogpt/agent/agent.py", line 112, in start_interaction_loop
    assistant_reply = chat_with_ai(
  File "/app/autogpt/llm/chat.py", line 165, in chat_with_ai
    agent.summary_memory = update_running_summary(
  File "/app/autogpt/memory_management/summary_memory.py", line 123, in update_running_summary
    current_memory = create_chat_completion(messages, cfg.fast_llm_model)
  File "/app/autogpt/llm/llm_utils.py", line 158, in create_chat_completion
    response = api_manager.create_chat_completion(
  File "/app/autogpt/llm/api_manager.py", line 46, in create_chat_completion
    response = openai.ChatCompletion.create(
  File "/usr/local/lib/python3.10/site-packages/openai/api_resources/chat_completion.py", line 25, in create
    return super().create(*args, **kwargs)
  File "/usr/local/lib/python3.10/site-packages/openai/api_resources/abstract/engine_api_resource.py", line 153, in create
    response, _, api_key = requestor.request(
  File "/usr/local/lib/python3.10/site-packages/openai/api_requestor.py", line 226, in request
    resp, got_stream = self._interpret_response(result, stream)
  File "/usr/local/lib/python3.10/site-packages/openai/api_requestor.py", line 619, in _interpret_response
    self._interpret_response_line(
  File "/usr/local/lib/python3.10/site-packages/openai/api_requestor.py", line 682, in _interpret_response_line
    raise self.handle_error_response(
openai.error.InvalidRequestError: This model's maximum context length is 8193 tokens. However, your messages resulted in 12223 tokens. Please reduce the length of the messages.
digitalsolana commented 1 year ago

I've drafted code that chunks, combines by averaging, then returning that combined embedding. I won't do anything with it if you've already done all the things @Pwuts.

I have a PR in my review-inbox that should fix all of these issues. :)

Can we have access to it?

Pwuts commented 1 year ago

Patched in #3646, with better fixes in the works.