microsoft / pylance-release

Documentation and issues for Pylance
Creative Commons Attribution 4.0 International
1.69k stars 769 forks source link

Autocompletion is slow in huggingface/transformers #1258

Closed Syndorik closed 3 years ago

Syndorik commented 3 years ago

Environment data

Actual behaviour

It has been a week that Pylance seems to be very slow. It takes around 10 seconds to have the autocompletions. However it depends on which way you import the library. For instance

import pandas as pd

pd.e

The auto completion is instantaneous. However with this

from transformers import AutoTokenizer
AutoTokenizer.from

The autocompletion will take 6-7 seconds

Logs

Logs on https://pastebin.com/9cpHJ8SS (The logs was too long to put it there)

Syndorik commented 3 years ago

Ok I think the transformers library might be the cause of this. When i'm importing classes/function that don't import transformers, everything runs correctly. Is it possilbe to exclude the transformers library form the analysis?

jakebailey commented 3 years ago

Is this code available somewhere? Lines like:

[BG(1)]   checking: /path-to-project/lib/model/contextual/preprocessing/formatedDataset.py (5856ms)
[Info  - 11:48:08 AM] [BG(1)] Long operation: checking: /path-to-project/lib/model/contextual/preprocessing/formatedDataset.py (5856ms)
[BG(1)] analyzing: /path-to-project/lib/model/contextual/preprocessing/formatedDataset.py (5862ms)
[Info  - 11:48:08 AM] [BG(1)] Long operation: analyzing: /path-to-project/lib/model/contextual/preprocessing/formatedDataset.py (5862ms)

Are concerning; 6 seconds to check a file is pretty large, and it'd be helpful to be able to see if there's something to optimize here.

Syndorik commented 3 years ago

I have reinstalled the transformers package from hugging face (https://huggingface.co/transformers/index.html) using conda which installs it with an egg file. As for now pylance is not slow anymore since it can't parse this library.

I don't know why it was so slow though.

Syndorik commented 3 years ago

Hi again, Since egg files are now supported, I came accross the same problem from huggingface transformers library

Logs

Logs Pylance

```log Background analysis message: getSemanticTokens delta [BG(1)] getSemanticTokens delta previousResultId:1622801530449 at /home/alexa/torm.py ... [BG(1)] parsing: /home/alexa/torm.py (1ms) [BG(1)] binding: /home/alexa/torm.py (0ms) [BG(1)] getSemanticTokens delta previousResultId:1622801530449 at /home/alexa/torm.py (5ms) Background analysis message: setFileOpened Background analysis message: markFilesDirty Background analysis message: setFileOpened Background analysis message: markFilesDirty Background analysis message: getSemanticTokens delta [BG(1)] getSemanticTokens delta previousResultId:1622801530808 at /home/alexa/torm.py ... [BG(1)] parsing: /home/alexa/torm.py (3ms) [BG(1)] binding: /home/alexa/torm.py (0ms) [BG(1)] getSemanticTokens delta previousResultId:1622801530808 at /home/alexa/torm.py (6ms) Background analysis message: setFileOpened Background analysis message: markFilesDirty [FG] completion at /home/alexa/torm.py:1:16 ... [FG] parsing: /home/alexa/torm.py (0ms) [FG] binding: /home/alexa/torm.py (0ms) [FG] completion at /home/alexa/torm.py:1:16 (1567ms) Background analysis message: analyze [BG(1)] analyzing: /home/alexa/torm.py ... [BG(1)] parsing: /home/alexa/torm.py (0ms) [BG(1)] binding: /home/alexa/torm.py (0ms) [FG] parsing: /home/alexa/torm.py (0ms) [FG] binding: /home/alexa/torm.py (0ms) [FG] completion at /home/alexa/torm.py:1:20 [found 40 items] (5151ms) [Info - 12:12:18 PM] [FG] Long operation: completion at /home/alexa/torm.py:1:20 (5151ms) [BG(1)] checking: /home/alexa/torm.py (1ms) [BG(1)] analyzing: /home/alexa/torm.py (1ms) Background analysis message: setFileOpened Background analysis message: markFilesDirty Background analysis message: getSemanticTokens delta [BG(1)] getSemanticTokens delta previousResultId:1622801531186 at /home/alexa/torm.py ... [BG(1)] parsing: /home/alexa/torm.py (0ms) [BG(1)] binding: /home/alexa/torm.py (0ms) [BG(1)] getSemanticTokens delta previousResultId:1622801531186 at /home/alexa/torm.py (1ms) Background analysis message: setFileOpened Background analysis message: markFilesDirty Background analysis message: setFileOpened Background analysis message: markFilesDirty Background analysis message: setFileOpened Background analysis message: markFilesDirty Background analysis message: analyze [BG(1)] analyzing: /home/alexa/torm.py ... [BG(1)] parsing: /home/alexa/torm.py (0ms) [BG(1)] binding: /home/alexa/torm.py (0ms) [BG(1)] checking: /home/alexa/torm.py (1ms) [BG(1)] analyzing: /home/alexa/torm.py (2ms) Background analysis message: resumeAnalysis Background analysis message: resumeAnalysis Background analysis message: getSemanticTokens delta [BG(1)] getSemanticTokens delta previousResultId:1622801532852 at /home/alexa/torm.py (0ms) ```

torm.py file

```python from transformers import AutoTokenizer AutoTokenizer. from ``` Do you know if there's a solution or if I could remove transformers library from Pylance check?

jakebailey commented 3 years ago

Yes, transformers on conda was unfortunately one of the main reasons to add support (so I was waiting for you to re-report this, sorry).

Can you create trace logs again so we can pin down which files may be problematic in transformers?

Syndorik commented 3 years ago

How can I do that? I mean, the logs I have linked are Python language server's log when autocompletion is slow on my torm.py file. I did not see any reference to what blocks in transformers library

jakebailey commented 3 years ago

I was comparing it to the logs that you had pasted in your original issue; the new logs are much, much shorter and don't show any of the analysis work. You're definitely using the "Trace" log level, right?

Syndorik commented 3 years ago

Oh sorry, I was logged onto another server and forgot to switch to Trace log level Here is the trace I'm getting

Logs

```logs Background analysis message: setFileOpened Background analysis message: markFilesDirty Background analysis message: getDiagnosticsForRange Background analysis message: getDiagnosticsForRange [FG] parsing: /home/alexa/torm.py (1ms) [FG] binding: /home/alexa/torm.py (0ms) Background analysis message: getSemanticTokens delta [BG(1)] getSemanticTokens delta previousResultId:1623335181792 at /home/alexa/torm.py ... [BG(1)] parsing: /home/alexa/torm.py (1ms) [BG(1)] binding: /home/alexa/torm.py (0ms) [BG(1)] getSemanticTokens delta previousResultId:1623335181792 at /home/alexa/torm.py (5ms) Background analysis message: setFileOpened Background analysis message: markFilesDirty [FG] completion at /home/alexa/torm.py:1:14 ... [FG] parsing: /home/alexa/torm.py (0ms) [FG] binding: /home/alexa/torm.py (0ms) [FG] parsing: /home/alexa/.vscode-server-insiders/extensions/ms-python.vscode-pylance-2021.6.2-pre.1/dist/typeshed-fallback/stdlib/typing.pyi [fs read 1ms] (36ms) [FG] binding: /home/alexa/.vscode-server-insiders/extensions/ms-python.vscode-pylance-2021.6.2-pre.1/dist/typeshed-fallback/stdlib/typing.pyi (9ms) [FG] parsing: /home/alexa/.vscode-server-insiders/extensions/ms-python.vscode-pylance-2021.6.2-pre.1/dist/typeshed-fallback/stdlib/_typeshed/__init__.pyi [fs read 0ms] (7ms) [FG] binding: /home/alexa/.vscode-server-insiders/extensions/ms-python.vscode-pylance-2021.6.2-pre.1/dist/typeshed-fallback/stdlib/_typeshed/__init__.pyi (2ms) [FG] parsing: /home/alexa/.vscode-server-insiders/extensions/ms-python.vscode-pylance-2021.6.2-pre.1/dist/typeshed-fallback/stdlib/typing_extensions.pyi [fs read 0ms] (2ms) [FG] binding: /home/alexa/.vscode-server-insiders/extensions/ms-python.vscode-pylance-2021.6.2-pre.1/dist/typeshed-fallback/stdlib/typing_extensions.pyi (1ms) [FG] parsing: /home/alexa/miniconda3/envs/arg/lib/python3.9/site-packages/transformers-4.6.1-py3.8.egg/transformers/__init__.py [fs read 6ms] (60ms) [FG] binding: /home/alexa/miniconda3/envs/arg/lib/python3.9/site-packages/transformers-4.6.1-py3.8.egg/transformers/__init__.py ... [FG] parsing: /home/alexa/miniconda3/envs/arg/lib/python3.9/site-packages/transformers-4.6.1-py3.8.egg/transformers/utils/dummy_sentencepiece_objects.py [fs read 0ms] (4ms) [FG] binding: /home/alexa/miniconda3/envs/arg/lib/python3.9/site-packages/transformers-4.6.1-py3.8.egg/transformers/utils/dummy_sentencepiece_objects.py (1ms) [FG] parsing: /home/alexa/miniconda3/envs/arg/lib/python3.9/site-packages/transformers-4.6.1-py3.8.egg/transformers/utils/dummy_tokenizers_objects.py [fs read 0ms] (7ms) [FG] binding: /home/alexa/miniconda3/envs/arg/lib/python3.9/site-packages/transformers-4.6.1-py3.8.egg/transformers/utils/dummy_tokenizers_objects.py (4ms) [FG] parsing: /home/alexa/miniconda3/envs/arg/lib/python3.9/site-packages/transformers-4.6.1-py3.8.egg/transformers/utils/dummy_speech_objects.py [fs read 0ms] (1ms) [FG] binding: /home/alexa/miniconda3/envs/arg/lib/python3.9/site-packages/transformers-4.6.1-py3.8.egg/transformers/utils/dummy_speech_objects.py (0ms) [FG] parsing: /home/alexa/miniconda3/envs/arg/lib/python3.9/site-packages/transformers-4.6.1-py3.8.egg/transformers/utils/dummy_sentencepiece_and_speech_objects.py [fs read 0ms] (0ms) [FG] binding: /home/alexa/miniconda3/envs/arg/lib/python3.9/site-packages/transformers-4.6.1-py3.8.egg/transformers/utils/dummy_sentencepiece_and_speech_objects.py (0ms) [FG] parsing: /home/alexa/miniconda3/envs/arg/lib/python3.9/site-packages/transformers-4.6.1-py3.8.egg/transformers/utils/dummy_vision_objects.py [fs read 0ms] (0ms) [FG] binding: /home/alexa/miniconda3/envs/arg/lib/python3.9/site-packages/transformers-4.6.1-py3.8.egg/transformers/utils/dummy_vision_objects.py (0ms) [FG] parsing: /home/alexa/miniconda3/envs/arg/lib/python3.9/site-packages/transformers-4.6.1-py3.8.egg/transformers/utils/dummy_pt_objects.py [fs read 0ms] (47ms) [FG] binding: /home/alexa/miniconda3/envs/arg/lib/python3.9/site-packages/transformers-4.6.1-py3.8.egg/transformers/utils/dummy_pt_objects.py (23ms) [FG] parsing: /home/alexa/miniconda3/envs/arg/lib/python3.9/site-packages/transformers-4.6.1-py3.8.egg/transformers/utils/dummy_tf_objects.py [fs read 0ms] (15ms) [FG] binding: /home/alexa/miniconda3/envs/arg/lib/python3.9/site-packages/transformers-4.6.1-py3.8.egg/transformers/utils/dummy_tf_objects.py (6ms) [FG] parsing: /home/alexa/miniconda3/envs/arg/lib/python3.9/site-packages/transformers-4.6.1-py3.8.egg/transformers/utils/dummy_flax_objects.py [fs read 0ms] (7ms) [FG] binding: /home/alexa/miniconda3/envs/arg/lib/python3.9/site-packages/transformers-4.6.1-py3.8.egg/transformers/utils/dummy_flax_objects.py (0ms) [FG] binding: /home/alexa/miniconda3/envs/arg/lib/python3.9/site-packages/transformers-4.6.1-py3.8.egg/transformers/__init__.py (134ms) [FG] parsing: /home/alexa/miniconda3/envs/arg/lib/python3.9/site-packages/transformers-4.6.1-py3.8.egg/transformers/models/auto/__init__.py [fs read 0ms] (2ms) [FG] binding: /home/alexa/miniconda3/envs/arg/lib/python3.9/site-packages/transformers-4.6.1-py3.8.egg/transformers/models/auto/__init__.py (1ms) [FG] parsing: /home/alexa/miniconda3/envs/arg/lib/python3.9/site-packages/transformers-4.6.1-py3.8.egg/transformers/models/auto/tokenization_auto.py [fs read 0ms] (7ms) [FG] binding: /home/alexa/miniconda3/envs/arg/lib/python3.9/site-packages/transformers-4.6.1-py3.8.egg/transformers/models/auto/tokenization_auto.py (3ms) [FG] completion at /home/alexa/torm.py:1:14 (297ms) Background analysis message: analyze [BG(1)] analyzing: /home/alexa/torm.py ... [BG(1)] parsing: /home/alexa/torm.py (1ms) [BG(1)] binding: /home/alexa/torm.py (0ms) [FG] completion at /home/alexa/torm.py:1:14 ... [FG] parsing: /home/alexa/miniconda3/envs/arg/lib/python3.9/site-packages/transformers-4.6.1-py3.8.egg/transformers/models/auto/configuration_auto.py [fs read 0ms] (17ms) [FG] binding: /home/alexa/miniconda3/envs/arg/lib/python3.9/site-packages/transformers-4.6.1-py3.8.egg/transformers/models/auto/configuration_auto.py (3ms) [FG] parsing: /home/alexa/.vscode-server-insiders/extensions/ms-python.vscode-pylance-2021.6.2-pre.1/dist/typeshed-fallback/stdlib/collections/__init__.pyi [fs read 1ms] (13ms) [FG] binding: /home/alexa/.vscode-server-insiders/extensions/ms-python.vscode-pylance-2021.6.2-pre.1/dist/typeshed-fallback/stdlib/collections/__init__.pyi ... [FG] parsing: /home/alexa/.vscode-server-insiders/extensions/ms-python.vscode-pylance-2021.6.2-pre.1/dist/typeshed-fallback/stdlib/_collections_abc.pyi [fs read 0ms] (1ms) [FG] binding: /home/alexa/.vscode-server-insiders/extensions/ms-python.vscode-pylance-2021.6.2-pre.1/dist/typeshed-fallback/stdlib/_collections_abc.pyi (0ms) [FG] binding: /home/alexa/.vscode-server-insiders/extensions/ms-python.vscode-pylance-2021.6.2-pre.1/dist/typeshed-fallback/stdlib/collections/__init__.pyi (5ms) [FG] parsing: /home/alexa/miniconda3/envs/arg/lib/python3.9/site-packages/transformers-4.6.1-py3.8.egg/transformers/utils/__init__.py [fs read 0ms] (2ms) [FG] binding: /home/alexa/miniconda3/envs/arg/lib/python3.9/site-packages/transformers-4.6.1-py3.8.egg/transformers/utils/__init__.py (1ms) [FG] parsing: /home/alexa/miniconda3/envs/arg/lib/python3.9/site-packages/transformers-4.6.1-py3.8.egg/transformers/utils/logging.py [fs read 0ms] (5ms) [FG] binding: /home/alexa/miniconda3/envs/arg/lib/python3.9/site-packages/transformers-4.6.1-py3.8.egg/transformers/utils/logging.py (2ms) [FG] parsing: /home/alexa/.vscode-server-insiders/extensions/ms-python.vscode-pylance-2021.6.2-pre.1/dist/typeshed-fallback/stdlib/logging/__init__.pyi [fs read 0ms] (25ms) [FG] binding: /home/alexa/.vscode-server-insiders/extensions/ms-python.vscode-pylance-2021.6.2-pre.1/dist/typeshed-fallback/stdlib/logging/__init__.pyi (4ms) [FG] parsing: /home/alexa/.vscode-server-insiders/extensions/ms-python.vscode-pylance-2021.6.2-pre.1/dist/typeshed-fallback/stdlib/threading.pyi [fs read 0ms] (3ms) [FG] binding: /home/alexa/.vscode-server-insiders/extensions/ms-python.vscode-pylance-2021.6.2-pre.1/dist/typeshed-fallback/stdlib/threading.pyi (3ms) [FG] parsing: /home/alexa/miniconda3/envs/arg/lib/python3.9/site-packages/transformers-4.6.1-py3.8.egg/transformers/file_utils.py [fs read 0ms] (49ms) [FG] binding: /home/alexa/miniconda3/envs/arg/lib/python3.9/site-packages/transformers-4.6.1-py3.8.egg/transformers/file_utils.py (12ms) [FG] parsing: /home/alexa/.vscode-server-insiders/extensions/ms-python.vscode-pylance-2021.6.2-pre.1/dist/typeshed-fallback/stdlib/importlib/util.pyi [fs read 0ms] (3ms) [FG] binding: /home/alexa/.vscode-server-insiders/extensions/ms-python.vscode-pylance-2021.6.2-pre.1/dist/typeshed-fallback/stdlib/importlib/util.pyi (0ms) [FG] parsing: /home/alexa/.vscode-server-insiders/extensions/ms-python.vscode-pylance-2021.6.2-pre.1/dist/typeshed-fallback/stdlib/importlib/abc.pyi [fs read 0ms] (2ms) [FG] binding: /home/alexa/.vscode-server-insiders/extensions/ms-python.vscode-pylance-2021.6.2-pre.1/dist/typeshed-fallback/stdlib/importlib/abc.pyi (1ms) [FG] parsing: /home/alexa/.vscode-server-insiders/extensions/ms-python.vscode-pylance-2021.6.2-pre.1/dist/typeshed-fallback/stdlib/importlib/machinery.pyi [fs read 0ms] (1ms) [FG] binding: /home/alexa/.vscode-server-insiders/extensions/ms-python.vscode-pylance-2021.6.2-pre.1/dist/typeshed-fallback/stdlib/importlib/machinery.pyi (1ms) [FG] parsing: /home/alexa/miniconda3/envs/arg/lib/python3.9/site-packages/transformers-4.6.1-py3.8.egg/transformers/models/retribert/configuration_retribert.py [fs read 0ms] (1ms) [FG] binding: /home/alexa/miniconda3/envs/arg/lib/python3.9/site-packages/transformers-4.6.1-py3.8.egg/transformers/models/retribert/configuration_retribert.py (0ms) [FG] parsing: /home/alexa/miniconda3/envs/arg/lib/python3.9/site-packages/transformers-4.6.1-py3.8.egg/transformers/configuration_utils.py [fs read 1ms] (6ms) [FG] binding: /home/alexa/miniconda3/envs/arg/lib/python3.9/site-packages/transformers-4.6.1-py3.8.egg/transformers/configuration_utils.py (2ms) [FG] parsing: /home/alexa/miniconda3/envs/arg/lib/python3.9/site-packages/transformers-4.6.1-py3.8.egg/transformers/models/retribert/tokenization_retribert.py [fs read 0ms] (1ms) [FG] binding: /home/alexa/miniconda3/envs/arg/lib/python3.9/site-packages/transformers-4.6.1-py3.8.egg/transformers/models/retribert/tokenization_retribert.py (0ms) [FG] parsing: /home/alexa/miniconda3/envs/arg/lib/python3.9/site-packages/transformers-4.6.1-py3.8.egg/transformers/models/bert/tokenization_bert.py [fs read 0ms] (8ms) [FG] binding: /home/alexa/miniconda3/envs/arg/lib/python3.9/site-packages/transformers-4.6.1-py3.8.egg/transformers/models/bert/tokenization_bert.py (2ms) [FG] parsing: /home/alexa/miniconda3/envs/arg/lib/python3.9/site-packages/transformers-4.6.1-py3.8.egg/transformers/tokenization_utils.py [fs read 0ms] (10ms) [FG] binding: /home/alexa/miniconda3/envs/arg/lib/python3.9/site-packages/transformers-4.6.1-py3.8.egg/transformers/tokenization_utils.py (4ms) [FG] parsing: /home/alexa/miniconda3/envs/arg/lib/python3.9/site-packages/transformers-4.6.1-py3.8.egg/transformers/tokenization_utils_base.py [fs read 1ms] (28ms) [FG] binding: /home/alexa/miniconda3/envs/arg/lib/python3.9/site-packages/transformers-4.6.1-py3.8.egg/transformers/tokenization_utils_base.py (14ms) [FG] parsing: /home/alexa/.vscode-server-insiders/extensions/ms-python.vscode-pylance-2021.6.2-pre.1/dist/typeshed-fallback/stdlib/dataclasses.pyi [fs read 0ms] (3ms) [FG] binding: /home/alexa/.vscode-server-insiders/extensions/ms-python.vscode-pylance-2021.6.2-pre.1/dist/typeshed-fallback/stdlib/dataclasses.pyi (1ms) [FG] parsing: /home/alexa/miniconda3/envs/arg/lib/python3.9/site-packages/transformers-4.6.1-py3.8.egg/transformers/models/retribert/tokenization_retribert_fast.py [fs read 1ms] (1ms) [FG] binding: /home/alexa/miniconda3/envs/arg/lib/python3.9/site-packages/transformers-4.6.1-py3.8.egg/transformers/models/retribert/tokenization_retribert_fast.py (0ms) [FG] parsing: /home/alexa/miniconda3/envs/arg/lib/python3.9/site-packages/transformers-4.6.1-py3.8.egg/transformers/models/bert/tokenization_bert_fast.py [fs read 1ms] (2ms) [FG] binding: /home/alexa/miniconda3/envs/arg/lib/python3.9/site-packages/transformers-4.6.1-py3.8.egg/transformers/models/bert/tokenization_bert_fast.py (0ms) [FG] parsing: /home/alexa/miniconda3/envs/arg/lib/python3.9/site-packages/transformers-4.6.1-py3.8.egg/transformers/tokenization_utils_fast.py [fs read 1ms] (5ms) [FG] binding: /home/alexa/miniconda3/envs/arg/lib/python3.9/site-packages/transformers-4.6.1-py3.8.egg/transformers/tokenization_utils_fast.py (4ms) [FG] parsing: /home/alexa/miniconda3/envs/arg/lib/python3.9/site-packages/transformers-4.6.1-py3.8.egg/transformers/models/t5/configuration_t5.py [fs read 0ms] (1ms) [FG] binding: /home/alexa/miniconda3/envs/arg/lib/python3.9/site-packages/transformers-4.6.1-py3.8.egg/transformers/models/t5/configuration_t5.py (0ms) [FG] parsing: /home/alexa/miniconda3/envs/arg/lib/python3.9/site-packages/transformers-4.6.1-py3.8.egg/transformers/models/t5/tokenization_t5.py [fs read 1ms] (4ms) [FG] binding: /home/alexa/miniconda3/envs/arg/lib/python3.9/site-packages/transformers-4.6.1-py3.8.egg/transformers/models/t5/tokenization_t5.py (1ms) [FG] parsing: /home/alexa/miniconda3/envs/arg/lib/python3.9/site-packages/transformers-4.6.1-py3.8.egg/transformers/models/t5/tokenization_t5_fast.py [fs read 0ms] (3ms) [FG] binding: /home/alexa/miniconda3/envs/arg/lib/python3.9/site-packages/transformers-4.6.1-py3.8.egg/transformers/models/t5/tokenization_t5_fast.py (1ms) [FG] parsing: /home/alexa/miniconda3/envs/arg/lib/python3.9/site-packages/transformers-4.6.1-py3.8.egg/transformers/models/mt5/configuration_mt5.py [fs read 1ms] (1ms) [FG] binding: /home/alexa/miniconda3/envs/arg/lib/python3.9/site-packages/transformers-4.6.1-py3.8.egg/transformers/models/mt5/configuration_mt5.py (1ms) [FG] parsing: /home/alexa/miniconda3/envs/arg/lib/python3.9/site-packages/transformers-4.6.1-py3.8.egg/transformers/models/mt5/__init__.py [fs read 0ms] (1ms) [FG] binding: /home/alexa/miniconda3/envs/arg/lib/python3.9/site-packages/transformers-4.6.1-py3.8.egg/transformers/models/mt5/__init__.py (0ms) [FG] parsing: /home/alexa/miniconda3/envs/arg/lib/python3.9/site-packages/transformers-4.6.1-py3.8.egg/transformers/models/mobilebert/configuration_mobilebert.py [fs read 1ms] (1ms) [FG] binding: /home/alexa/miniconda3/envs/arg/lib/python3.9/site-packages/transformers-4.6.1-py3.8.egg/transformers/models/mobilebert/configuration_mobilebert.py (1ms) [FG] parsing: /home/alexa/miniconda3/envs/arg/lib/python3.9/site-packages/transformers-4.6.1-py3.8.egg/transformers/models/mobilebert/tokenization_mobilebert.py [fs read 0ms] (0ms) [FG] binding: /home/alexa/miniconda3/envs/arg/lib/python3.9/site-packages/transformers-4.6.1-py3.8.egg/transformers/models/mobilebert/tokenization_mobilebert.py (0ms) [FG] parsing: /home/alexa/miniconda3/envs/arg/lib/python3.9/site-packages/transformers-4.6.1-py3.8.egg/transformers/models/mobilebert/tokenization_mobilebert_fast.py [fs read 0ms] (1ms) [FG] binding: /home/alexa/miniconda3/envs/arg/lib/python3.9/site-packages/transformers-4.6.1-py3.8.egg/transformers/models/mobilebert/tokenization_mobilebert_fast.py (0ms) [FG] parsing: /home/alexa/miniconda3/envs/arg/lib/python3.9/site-packages/transformers-4.6.1-py3.8.egg/transformers/models/distilbert/configuration_distilbert.py [fs read 0ms] (1ms) [FG] binding: /home/alexa/miniconda3/envs/arg/lib/python3.9/site-packages/transformers-4.6.1-py3.8.egg/transformers/models/distilbert/configuration_distilbert.py (0ms) [FG] parsing: /home/alexa/miniconda3/envs/arg/lib/python3.9/site-packages/transformers-4.6.1-py3.8.egg/transformers/models/distilbert/tokenization_distilbert.py [fs read 1ms] (1ms) [FG] binding: /home/alexa/miniconda3/envs/arg/lib/python3.9/site-packages/transformers-4.6.1-py3.8.egg/transformers/models/distilbert/tokenization_distilbert.py (0ms) [FG] parsing: /home/alexa/miniconda3/envs/arg/lib/python3.9/site-packages/transformers-4.6.1-py3.8.egg/transformers/models/distilbert/tokenization_distilbert_fast.py [fs read 0ms] (0ms) [FG] binding: /home/alexa/miniconda3/envs/arg/lib/python3.9/site-packages/transformers-4.6.1-py3.8.egg/transformers/models/distilbert/tokenization_distilbert_fast.py (0ms) [FG] parsing: /home/alexa/miniconda3/envs/arg/lib/python3.9/site-packages/transformers-4.6.1-py3.8.egg/transformers/models/albert/configuration_albert.py [fs read 0ms] (0ms) [FG] binding: /home/alexa/miniconda3/envs/arg/lib/python3.9/site-packages/transformers-4.6.1-py3.8.egg/transformers/models/albert/configuration_albert.py (0ms) [FG] parsing: /home/alexa/miniconda3/envs/arg/lib/python3.9/site-packages/transformers-4.6.1-py3.8.egg/transformers/models/albert/tokenization_albert.py [fs read 0ms] (4ms) [FG] binding: /home/alexa/miniconda3/envs/arg/lib/python3.9/site-packages/transformers-4.6.1-py3.8.egg/transformers/models/albert/tokenization_albert.py (2ms) [FG] parsing: /home/alexa/miniconda3/envs/arg/lib/python3.9/site-packages/transformers-4.6.1-py3.8.egg/transformers/models/albert/tokenization_albert_fast.py [fs read 0ms] (2ms) [FG] binding: /home/alexa/miniconda3/envs/arg/lib/python3.9/site-packages/transformers-4.6.1-py3.8.egg/transformers/models/albert/tokenization_albert_fast.py (0ms) [FG] parsing: /home/alexa/miniconda3/envs/arg/lib/python3.9/site-packages/transformers-4.6.1-py3.8.egg/transformers/models/camembert/configuration_camembert.py [fs read 0ms] (0ms) [FG] binding: /home/alexa/miniconda3/envs/arg/lib/python3.9/site-packages/transformers-4.6.1-py3.8.egg/transformers/models/camembert/configuration_camembert.py (0ms) [FG] parsing: /home/alexa/miniconda3/envs/arg/lib/python3.9/site-packages/transformers-4.6.1-py3.8.egg/transformers/models/roberta/configuration_roberta.py [fs read 1ms] (1ms) [FG] binding: /home/alexa/miniconda3/envs/arg/lib/python3.9/site-packages/transformers-4.6.1-py3.8.egg/transformers/models/roberta/configuration_roberta.py (0ms) [FG] parsing: /home/alexa/miniconda3/envs/arg/lib/python3.9/site-packages/transformers-4.6.1-py3.8.egg/transformers/models/bert/configuration_bert.py [fs read 0ms] (2ms) [FG] binding: /home/alexa/miniconda3/envs/arg/lib/python3.9/site-packages/transformers-4.6.1-py3.8.egg/transformers/models/bert/configuration_bert.py (0ms) [FG] parsing: /home/alexa/miniconda3/envs/arg/lib/python3.9/site-packages/transformers-4.6.1-py3.8.egg/transformers/models/camembert/tokenization_camembert.py [fs read 0ms] (2ms) [FG] binding: /home/alexa/miniconda3/envs/arg/lib/python3.9/site-packages/transformers-4.6.1-py3.8.egg/transformers/models/camembert/tokenization_camembert.py (1ms) [FG] parsing: /home/alexa/miniconda3/envs/arg/lib/python3.9/site-packages/transformers-4.6.1-py3.8.egg/transformers/models/camembert/tokenization_camembert_fast.py [fs read 1ms] (2ms) [FG] binding: /home/alexa/miniconda3/envs/arg/lib/python3.9/site-packages/transformers-4.6.1-py3.8.egg/transformers/models/camembert/tokenization_camembert_fast.py (1ms) [FG] parsing: /home/alexa/miniconda3/envs/arg/lib/python3.9/site-packages/transformers-4.6.1-py3.8.egg/transformers/models/pegasus/configuration_pegasus.py [fs read 1ms] (1ms) [FG] binding: /home/alexa/miniconda3/envs/arg/lib/python3.9/site-packages/transformers-4.6.1-py3.8.egg/transformers/models/pegasus/configuration_pegasus.py (2ms) [FG] parsing: /home/alexa/miniconda3/envs/arg/lib/python3.9/site-packages/transformers-4.6.1-py3.8.egg/transformers/models/pegasus/tokenization_pegasus.py [fs read 0ms] (2ms) [FG] binding: /home/alexa/miniconda3/envs/arg/lib/python3.9/site-packages/transformers-4.6.1-py3.8.egg/transformers/models/pegasus/tokenization_pegasus.py (1ms) [FG] parsing: /home/alexa/miniconda3/envs/arg/lib/python3.9/site-packages/transformers-4.6.1-py3.8.egg/transformers/models/pegasus/tokenization_pegasus_fast.py [fs read 0ms] (2ms) [FG] binding: /home/alexa/miniconda3/envs/arg/lib/python3.9/site-packages/transformers-4.6.1-py3.8.egg/transformers/models/pegasus/tokenization_pegasus_fast.py (1ms) [FG] parsing: /home/alexa/miniconda3/envs/arg/lib/python3.9/site-packages/transformers-4.6.1-py3.8.egg/transformers/models/mbart/configuration_mbart.py [fs read 0ms] (1ms) [FG] binding: /home/alexa/miniconda3/envs/arg/lib/python3.9/site-packages/transformers-4.6.1-py3.8.egg/transformers/models/mbart/configuration_mbart.py (0ms) [FG] parsing: /home/alexa/miniconda3/envs/arg/lib/python3.9/site-packages/transformers-4.6.1-py3.8.egg/transformers/models/mbart/tokenization_mbart.py [fs read 0ms] (2ms) [FG] binding: /home/alexa/miniconda3/envs/arg/lib/python3.9/site-packages/transformers-4.6.1-py3.8.egg/transformers/models/mbart/tokenization_mbart.py (0ms) [FG] parsing: /home/alexa/miniconda3/envs/arg/lib/python3.9/site-packages/transformers-4.6.1-py3.8.egg/transformers/models/xlm_roberta/tokenization_xlm_roberta.py [fs read 0ms] (4ms) [FG] binding: /home/alexa/miniconda3/envs/arg/lib/python3.9/site-packages/transformers-4.6.1-py3.8.egg/transformers/models/xlm_roberta/tokenization_xlm_roberta.py (1ms) [FG] parsing: /home/alexa/miniconda3/envs/arg/lib/python3.9/site-packages/transformers-4.6.1-py3.8.egg/transformers/models/mbart/tokenization_mbart_fast.py [fs read 1ms] (2ms) [FG] binding: /home/alexa/miniconda3/envs/arg/lib/python3.9/site-packages/transformers-4.6.1-py3.8.egg/transformers/models/mbart/tokenization_mbart_fast.py (1ms) [FG] parsing: /home/alexa/miniconda3/envs/arg/lib/python3.9/site-packages/transformers-4.6.1-py3.8.egg/transformers/models/xlm_roberta/tokenization_xlm_roberta_fast.py [fs read 0ms] (2ms) [FG] binding: /home/alexa/miniconda3/envs/arg/lib/python3.9/site-packages/transformers-4.6.1-py3.8.egg/transformers/models/xlm_roberta/tokenization_xlm_roberta_fast.py (2ms) [FG] parsing: /home/alexa/miniconda3/envs/arg/lib/python3.9/site-packages/transformers-4.6.1-py3.8.egg/transformers/models/xlm_roberta/configuration_xlm_roberta.py [fs read 0ms] (3ms) [FG] binding: /home/alexa/miniconda3/envs/arg/lib/python3.9/site-packages/transformers-4.6.1-py3.8.egg/transformers/models/xlm_roberta/configuration_xlm_roberta.py (0ms) [FG] parsing: /home/alexa/miniconda3/envs/arg/lib/python3.9/site-packages/transformers-4.6.1-py3.8.egg/transformers/models/marian/configuration_marian.py [fs read 0ms] (1ms) [FG] binding: /home/alexa/miniconda3/envs/arg/lib/python3.9/site-packages/transformers-4.6.1-py3.8.egg/transformers/models/marian/configuration_marian.py (1ms) [FG] parsing: /home/alexa/miniconda3/envs/arg/lib/python3.9/site-packages/transformers-4.6.1-py3.8.egg/transformers/models/marian/tokenization_marian.py [fs read 0ms] (4ms) [FG] binding: /home/alexa/miniconda3/envs/arg/lib/python3.9/site-packages/transformers-4.6.1-py3.8.egg/transformers/models/marian/tokenization_marian.py (1ms) [FG] parsing: /home/alexa/miniconda3/envs/arg/lib/python3.9/site-packages/transformers-4.6.1-py3.8.egg/transformers/models/blenderbot_small/configuration_blenderbot_small.py [fs read 0ms] (2ms) [FG] binding: /home/alexa/miniconda3/envs/arg/lib/python3.9/site-packages/transformers-4.6.1-py3.8.egg/transformers/models/blenderbot_small/configuration_blenderbot_small.py (0ms) [FG] parsing: /home/alexa/miniconda3/envs/arg/lib/python3.9/site-packages/transformers-4.6.1-py3.8.egg/transformers/models/blenderbot_small/tokenization_blenderbot_small.py [fs read 0ms] (3ms) [FG] binding: /home/alexa/miniconda3/envs/arg/lib/python3.9/site-packages/transformers-4.6.1-py3.8.egg/transformers/models/blenderbot_small/tokenization_blenderbot_small.py (1ms) [FG] parsing: /home/alexa/miniconda3/envs/arg/lib/python3.9/site-packages/transformers-4.6.1-py3.8.egg/transformers/models/blenderbot/configuration_blenderbot.py [fs read 0ms] (1ms) [FG] binding: /home/alexa/miniconda3/envs/arg/lib/python3.9/site-packages/transformers-4.6.1-py3.8.egg/transformers/models/blenderbot/configuration_blenderbot.py (0ms) [FG] parsing: /home/alexa/miniconda3/envs/arg/lib/python3.9/site-packages/transformers-4.6.1-py3.8.egg/transformers/models/blenderbot/tokenization_blenderbot.py [fs read 0ms] (2ms) [FG] binding: /home/alexa/miniconda3/envs/arg/lib/python3.9/site-packages/transformers-4.6.1-py3.8.egg/transformers/models/blenderbot/tokenization_blenderbot.py (0ms) [FG] parsing: /home/alexa/miniconda3/envs/arg/lib/python3.9/site-packages/transformers-4.6.1-py3.8.egg/transformers/models/roberta/tokenization_roberta.py [fs read 0ms] (2ms) [FG] binding: /home/alexa/miniconda3/envs/arg/lib/python3.9/site-packages/transformers-4.6.1-py3.8.egg/transformers/models/roberta/tokenization_roberta.py (0ms) [FG] parsing: /home/alexa/miniconda3/envs/arg/lib/python3.9/site-packages/transformers-4.6.1-py3.8.egg/transformers/models/gpt2/tokenization_gpt2.py [fs read 1ms] (4ms) [FG] binding: /home/alexa/miniconda3/envs/arg/lib/python3.9/site-packages/transformers-4.6.1-py3.8.egg/transformers/models/gpt2/tokenization_gpt2.py (1ms) [FG] parsing: /home/alexa/.vscode-server-insiders/extensions/ms-python.vscode-pylance-2021.6.2-pre.1/dist/typeshed-fallback/stdlib/functools.pyi [fs read 0ms] (2ms) [FG] binding: /home/alexa/.vscode-server-insiders/extensions/ms-python.vscode-pylance-2021.6.2-pre.1/dist/typeshed-fallback/stdlib/functools.pyi (2ms) [FG] parsing: /home/alexa/miniconda3/envs/arg/lib/python3.9/site-packages/transformers-4.6.1-py3.8.egg/transformers/models/bart/configuration_bart.py [fs read 0ms] (1ms) [FG] binding: /home/alexa/miniconda3/envs/arg/lib/python3.9/site-packages/transformers-4.6.1-py3.8.egg/transformers/models/bart/configuration_bart.py (1ms) [FG] parsing: /home/alexa/miniconda3/envs/arg/lib/python3.9/site-packages/transformers-4.6.1-py3.8.egg/transformers/models/bart/tokenization_bart.py [fs read 0ms] (0ms) [FG] binding: /home/alexa/miniconda3/envs/arg/lib/python3.9/site-packages/transformers-4.6.1-py3.8.egg/transformers/models/bart/tokenization_bart.py (1ms) [FG] parsing: /home/alexa/miniconda3/envs/arg/lib/python3.9/site-packages/transformers-4.6.1-py3.8.egg/transformers/models/bart/tokenization_bart_fast.py [fs read 0ms] (1ms) [FG] binding: /home/alexa/miniconda3/envs/arg/lib/python3.9/site-packages/transformers-4.6.1-py3.8.egg/transformers/models/bart/tokenization_bart_fast.py (0ms) [FG] parsing: /home/alexa/miniconda3/envs/arg/lib/python3.9/site-packages/transformers-4.6.1-py3.8.egg/transformers/models/roberta/tokenization_roberta_fast.py [fs read 0ms] (1ms) [FG] binding: /home/alexa/miniconda3/envs/arg/lib/python3.9/site-packages/transformers-4.6.1-py3.8.egg/transformers/models/roberta/tokenization_roberta_fast.py (1ms) [FG] parsing: /home/alexa/miniconda3/envs/arg/lib/python3.9/site-packages/transformers-4.6.1-py3.8.egg/transformers/models/gpt2/tokenization_gpt2_fast.py [fs read 0ms] (1ms) [FG] binding: /home/alexa/miniconda3/envs/arg/lib/python3.9/site-packages/transformers-4.6.1-py3.8.egg/transformers/models/gpt2/tokenization_gpt2_fast.py (2ms) [FG] parsing: /home/alexa/miniconda3/envs/arg/lib/python3.9/site-packages/transformers-4.6.1-py3.8.egg/transformers/models/longformer/configuration_longformer.py [fs read 0ms] (1ms) [FG] binding: /home/alexa/miniconda3/envs/arg/lib/python3.9/site-packages/transformers-4.6.1-py3.8.egg/transformers/models/longformer/configuration_longformer.py (0ms) [FG] parsing: /home/alexa/miniconda3/envs/arg/lib/python3.9/site-packages/transformers-4.6.1-py3.8.egg/transformers/models/longformer/tokenization_longformer.py [fs read 0ms] (1ms) [FG] binding: /home/alexa/miniconda3/envs/arg/lib/python3.9/site-packages/transformers-4.6.1-py3.8.egg/transformers/models/longformer/tokenization_longformer.py (0ms) [FG] parsing: /home/alexa/miniconda3/envs/arg/lib/python3.9/site-packages/transformers-4.6.1-py3.8.egg/transformers/models/longformer/tokenization_longformer_fast.py [fs read 0ms] (1ms) [FG] binding: /home/alexa/miniconda3/envs/arg/lib/python3.9/site-packages/transformers-4.6.1-py3.8.egg/transformers/models/longformer/tokenization_longformer_fast.py (0ms) [FG] parsing: /home/alexa/miniconda3/envs/arg/lib/python3.9/site-packages/transformers-4.6.1-py3.8.egg/transformers/models/reformer/configuration_reformer.py [fs read 1ms] (2ms) [FG] binding: /home/alexa/miniconda3/envs/arg/lib/python3.9/site-packages/transformers-4.6.1-py3.8.egg/transformers/models/reformer/configuration_reformer.py (3ms) [FG] parsing: /home/alexa/miniconda3/envs/arg/lib/python3.9/site-packages/transformers-4.6.1-py3.8.egg/transformers/models/reformer/tokenization_reformer.py [fs read 0ms] (2ms) [FG] binding: /home/alexa/miniconda3/envs/arg/lib/python3.9/site-packages/transformers-4.6.1-py3.8.egg/transformers/models/reformer/tokenization_reformer.py (1ms) [FG] parsing: /home/alexa/miniconda3/envs/arg/lib/python3.9/site-packages/transformers-4.6.1-py3.8.egg/transformers/models/reformer/tokenization_reformer_fast.py [fs read 0ms] (2ms) [FG] binding: /home/alexa/miniconda3/envs/arg/lib/python3.9/site-packages/transformers-4.6.1-py3.8.egg/transformers/models/reformer/tokenization_reformer_fast.py (1ms) [FG] parsing: /home/alexa/miniconda3/envs/arg/lib/python3.9/site-packages/transformers-4.6.1-py3.8.egg/transformers/models/electra/configuration_electra.py [fs read 0ms] (2ms) [FG] binding: /home/alexa/miniconda3/envs/arg/lib/python3.9/site-packages/transformers-4.6.1-py3.8.egg/transformers/models/electra/configuration_electra.py (1ms) [FG] parsing: /home/alexa/miniconda3/envs/arg/lib/python3.9/site-packages/transformers-4.6.1-py3.8.egg/transformers/models/electra/tokenization_electra.py [fs read 0ms] (1ms) [FG] binding: /home/alexa/miniconda3/envs/arg/lib/python3.9/site-packages/transformers-4.6.1-py3.8.egg/transformers/models/electra/tokenization_electra.py (0ms) [FG] parsing: /home/alexa/miniconda3/envs/arg/lib/python3.9/site-packages/transformers-4.6.1-py3.8.egg/transformers/models/electra/tokenization_electra_fast.py [fs read 0ms] (1ms) [FG] binding: /home/alexa/miniconda3/envs/arg/lib/python3.9/site-packages/transformers-4.6.1-py3.8.egg/transformers/models/electra/tokenization_electra_fast.py (0ms) [FG] parsing: /home/alexa/miniconda3/envs/arg/lib/python3.9/site-packages/transformers-4.6.1-py3.8.egg/transformers/models/funnel/configuration_funnel.py [fs read 0ms] (2ms) [FG] binding: /home/alexa/miniconda3/envs/arg/lib/python3.9/site-packages/transformers-4.6.1-py3.8.egg/transformers/models/funnel/configuration_funnel.py (0ms) [FG] parsing: /home/alexa/miniconda3/envs/arg/lib/python3.9/site-packages/transformers-4.6.1-py3.8.egg/transformers/models/funnel/tokenization_funnel.py [fs read 1ms] (1ms) [FG] binding: /home/alexa/miniconda3/envs/arg/lib/python3.9/site-packages/transformers-4.6.1-py3.8.egg/transformers/models/funnel/tokenization_funnel.py (1ms) [FG] parsing: /home/alexa/miniconda3/envs/arg/lib/python3.9/site-packages/transformers-4.6.1-py3.8.egg/transformers/models/funnel/tokenization_funnel_fast.py [fs read 0ms] (1ms) [FG] binding: /home/alexa/miniconda3/envs/arg/lib/python3.9/site-packages/transformers-4.6.1-py3.8.egg/transformers/models/funnel/tokenization_funnel_fast.py (0ms) [FG] parsing: /home/alexa/miniconda3/envs/arg/lib/python3.9/site-packages/transformers-4.6.1-py3.8.egg/transformers/models/lxmert/configuration_lxmert.py [fs read 0ms] (0ms) [FG] binding: /home/alexa/miniconda3/envs/arg/lib/python3.9/site-packages/transformers-4.6.1-py3.8.egg/transformers/models/lxmert/configuration_lxmert.py (1ms) [FG] parsing: /home/alexa/miniconda3/envs/arg/lib/python3.9/site-packages/transformers-4.6.1-py3.8.egg/transformers/models/lxmert/tokenization_lxmert.py [fs read 0ms] (0ms) [FG] binding: /home/alexa/miniconda3/envs/arg/lib/python3.9/site-packages/transformers-4.6.1-py3.8.egg/transformers/models/lxmert/tokenization_lxmert.py (0ms) [FG] parsing: /home/alexa/miniconda3/envs/arg/lib/python3.9/site-packages/transformers-4.6.1-py3.8.egg/transformers/models/lxmert/tokenization_lxmert_fast.py [fs read 0ms] (0ms) [FG] binding: /home/alexa/miniconda3/envs/arg/lib/python3.9/site-packages/transformers-4.6.1-py3.8.egg/transformers/models/lxmert/tokenization_lxmert_fast.py (0ms) [FG] parsing: /home/alexa/miniconda3/envs/arg/lib/python3.9/site-packages/transformers-4.6.1-py3.8.egg/transformers/models/layoutlm/configuration_layoutlm.py [fs read 1ms] (1ms) [FG] binding: /home/alexa/miniconda3/envs/arg/lib/python3.9/site-packages/transformers-4.6.1-py3.8.egg/transformers/models/layoutlm/configuration_layoutlm.py (0ms) [FG] parsing: /home/alexa/miniconda3/envs/arg/lib/python3.9/site-packages/transformers-4.6.1-py3.8.egg/transformers/models/layoutlm/tokenization_layoutlm.py [fs read 1ms] (1ms) [FG] binding: /home/alexa/miniconda3/envs/arg/lib/python3.9/site-packages/transformers-4.6.1-py3.8.egg/transformers/models/layoutlm/tokenization_layoutlm.py (0ms) [FG] parsing: /home/alexa/miniconda3/envs/arg/lib/python3.9/site-packages/transformers-4.6.1-py3.8.egg/transformers/models/layoutlm/tokenization_layoutlm_fast.py [fs read 1ms] (1ms) [FG] binding: /home/alexa/miniconda3/envs/arg/lib/python3.9/site-packages/transformers-4.6.1-py3.8.egg/transformers/models/layoutlm/tokenization_layoutlm_fast.py (0ms) [FG] parsing: /home/alexa/miniconda3/envs/arg/lib/python3.9/site-packages/transformers-4.6.1-py3.8.egg/transformers/models/dpr/configuration_dpr.py [fs read 1ms] (1ms) [FG] binding: /home/alexa/miniconda3/envs/arg/lib/python3.9/site-packages/transformers-4.6.1-py3.8.egg/transformers/models/dpr/configuration_dpr.py (0ms) [FG] parsing: /home/alexa/miniconda3/envs/arg/lib/python3.9/site-packages/transformers-4.6.1-py3.8.egg/transformers/models/dpr/tokenization_dpr.py [fs read 1ms] (3ms) [FG] binding: /home/alexa/miniconda3/envs/arg/lib/python3.9/site-packages/transformers-4.6.1-py3.8.egg/transformers/models/dpr/tokenization_dpr.py (1ms) [FG] parsing: /home/alexa/miniconda3/envs/arg/lib/python3.9/site-packages/transformers-4.6.1-py3.8.egg/transformers/models/dpr/tokenization_dpr_fast.py [fs read 0ms] (3ms) [FG] binding: /home/alexa/miniconda3/envs/arg/lib/python3.9/site-packages/transformers-4.6.1-py3.8.egg/transformers/models/dpr/tokenization_dpr_fast.py (1ms) [FG] parsing: /home/alexa/miniconda3/envs/arg/lib/python3.9/site-packages/transformers-4.6.1-py3.8.egg/transformers/models/squeezebert/configuration_squeezebert.py [fs read 0ms] (1ms) [FG] binding: /home/alexa/miniconda3/envs/arg/lib/python3.9/site-packages/transformers-4.6.1-py3.8.egg/transformers/models/squeezebert/configuration_squeezebert.py (0ms) [FG] parsing: /home/alexa/miniconda3/envs/arg/lib/python3.9/site-packages/transformers-4.6.1-py3.8.egg/transformers/models/squeezebert/tokenization_squeezebert.py [fs read 0ms] (0ms) [FG] binding: /home/alexa/miniconda3/envs/arg/lib/python3.9/site-packages/transformers-4.6.1-py3.8.egg/transformers/models/squeezebert/tokenization_squeezebert.py (0ms) [FG] parsing: /home/alexa/miniconda3/envs/arg/lib/python3.9/site-packages/transformers-4.6.1-py3.8.egg/transformers/models/squeezebert/tokenization_squeezebert_fast.py [fs read 0ms] (0ms) [FG] binding: /home/alexa/miniconda3/envs/arg/lib/python3.9/site-packages/transformers-4.6.1-py3.8.egg/transformers/models/squeezebert/tokenization_squeezebert_fast.py (0ms) [FG] parsing: /home/alexa/miniconda3/envs/arg/lib/python3.9/site-packages/transformers-4.6.1-py3.8.egg/transformers/models/openai/configuration_openai.py [fs read 0ms] (1ms) [FG] binding: /home/alexa/miniconda3/envs/arg/lib/python3.9/site-packages/transformers-4.6.1-py3.8.egg/transformers/models/openai/configuration_openai.py (0ms) [FG] parsing: /home/alexa/miniconda3/envs/arg/lib/python3.9/site-packages/transformers-4.6.1-py3.8.egg/transformers/models/openai/tokenization_openai.py [fs read 0ms] (3ms) [FG] binding: /home/alexa/miniconda3/envs/arg/lib/python3.9/site-packages/transformers-4.6.1-py3.8.egg/transformers/models/openai/tokenization_openai.py (3ms) [FG] parsing: /home/alexa/miniconda3/envs/arg/lib/python3.9/site-packages/transformers-4.6.1-py3.8.egg/transformers/models/openai/tokenization_openai_fast.py [fs read 0ms] (1ms) [FG] binding: /home/alexa/miniconda3/envs/arg/lib/python3.9/site-packages/transformers-4.6.1-py3.8.egg/transformers/models/openai/tokenization_openai_fast.py (0ms) [FG] parsing: /home/alexa/miniconda3/envs/arg/lib/python3.9/site-packages/transformers-4.6.1-py3.8.egg/transformers/models/gpt2/configuration_gpt2.py [fs read 0ms] (1ms) [FG] binding: /home/alexa/miniconda3/envs/arg/lib/python3.9/site-packages/transformers-4.6.1-py3.8.egg/transformers/models/gpt2/configuration_gpt2.py (1ms) [FG] parsing: /home/alexa/miniconda3/envs/arg/lib/python3.9/site-packages/transformers-4.6.1-py3.8.egg/transformers/models/transfo_xl/configuration_transfo_xl.py [fs read 1ms] (5ms) [FG] binding: /home/alexa/miniconda3/envs/arg/lib/python3.9/site-packages/transformers-4.6.1-py3.8.egg/transformers/models/transfo_xl/configuration_transfo_xl.py (1ms) [FG] parsing: /home/alexa/miniconda3/envs/arg/lib/python3.9/site-packages/transformers-4.6.1-py3.8.egg/transformers/models/transfo_xl/tokenization_transfo_xl.py [fs read 0ms] (7ms) [FG] binding: /home/alexa/miniconda3/envs/arg/lib/python3.9/site-packages/transformers-4.6.1-py3.8.egg/transformers/models/transfo_xl/tokenization_transfo_xl.py (4ms) [FG] parsing: /home/alexa/miniconda3/envs/arg/lib/python3.9/site-packages/transformers-4.6.1-py3.8.egg/transformers/models/xlnet/configuration_xlnet.py [fs read 1ms] (4ms) [FG] binding: /home/alexa/miniconda3/envs/arg/lib/python3.9/site-packages/transformers-4.6.1-py3.8.egg/transformers/models/xlnet/configuration_xlnet.py (0ms) [FG] parsing: /home/alexa/miniconda3/envs/arg/lib/python3.9/site-packages/transformers-4.6.1-py3.8.egg/transformers/models/xlnet/tokenization_xlnet.py [fs read 0ms] (2ms) [FG] binding: /home/alexa/miniconda3/envs/arg/lib/python3.9/site-packages/transformers-4.6.1-py3.8.egg/transformers/models/xlnet/tokenization_xlnet.py (3ms) [FG] parsing: /home/alexa/miniconda3/envs/arg/lib/python3.9/site-packages/transformers-4.6.1-py3.8.egg/transformers/models/xlnet/tokenization_xlnet_fast.py [fs read 0ms] (2ms) [FG] binding: /home/alexa/miniconda3/envs/arg/lib/python3.9/site-packages/transformers-4.6.1-py3.8.egg/transformers/models/xlnet/tokenization_xlnet_fast.py (1ms) [FG] parsing: /home/alexa/miniconda3/envs/arg/lib/python3.9/site-packages/transformers-4.6.1-py3.8.egg/transformers/models/flaubert/configuration_flaubert.py [fs read 0ms] (1ms) [FG] binding: /home/alexa/miniconda3/envs/arg/lib/python3.9/site-packages/transformers-4.6.1-py3.8.egg/transformers/models/flaubert/configuration_flaubert.py (0ms) [FG] parsing: /home/alexa/miniconda3/envs/arg/lib/python3.9/site-packages/transformers-4.6.1-py3.8.egg/transformers/models/xlm/configuration_xlm.py [fs read 0ms] (3ms) [FG] binding: /home/alexa/miniconda3/envs/arg/lib/python3.9/site-packages/transformers-4.6.1-py3.8.egg/transformers/models/xlm/configuration_xlm.py (1ms) [FG] parsing: /home/alexa/miniconda3/envs/arg/lib/python3.9/site-packages/transformers-4.6.1-py3.8.egg/transformers/models/flaubert/tokenization_flaubert.py [fs read 1ms] (5ms) [FG] binding: /home/alexa/miniconda3/envs/arg/lib/python3.9/site-packages/transformers-4.6.1-py3.8.egg/transformers/models/flaubert/tokenization_flaubert.py (1ms) [FG] parsing: /home/alexa/miniconda3/envs/arg/lib/python3.9/site-packages/transformers-4.6.1-py3.8.egg/transformers/models/xlm/tokenization_xlm.py [fs read 0ms] (12ms) [FG] binding: /home/alexa/miniconda3/envs/arg/lib/python3.9/site-packages/transformers-4.6.1-py3.8.egg/transformers/models/xlm/tokenization_xlm.py (4ms) [FG] parsing: /home/alexa/miniconda3/envs/arg/lib/python3.9/site-packages/transformers-4.6.1-py3.8.egg/transformers/models/ctrl/configuration_ctrl.py [fs read 0ms] (1ms) [FG] binding: /home/alexa/miniconda3/envs/arg/lib/python3.9/site-packages/transformers-4.6.1-py3.8.egg/transformers/models/ctrl/configuration_ctrl.py (0ms) [FG] parsing: /home/alexa/miniconda3/envs/arg/lib/python3.9/site-packages/transformers-4.6.1-py3.8.egg/transformers/models/ctrl/tokenization_ctrl.py [fs read 0ms] (2ms) [FG] binding: /home/alexa/miniconda3/envs/arg/lib/python3.9/site-packages/transformers-4.6.1-py3.8.egg/transformers/models/ctrl/tokenization_ctrl.py (3ms) [FG] parsing: /home/alexa/miniconda3/envs/arg/lib/python3.9/site-packages/transformers-4.6.1-py3.8.egg/transformers/models/fsmt/configuration_fsmt.py [fs read 0ms] (1ms) [FG] binding: /home/alexa/miniconda3/envs/arg/lib/python3.9/site-packages/transformers-4.6.1-py3.8.egg/transformers/models/fsmt/configuration_fsmt.py (1ms) [FG] parsing: /home/alexa/miniconda3/envs/arg/lib/python3.9/site-packages/transformers-4.6.1-py3.8.egg/transformers/models/fsmt/tokenization_fsmt.py [fs read 0ms] (3ms) [FG] binding: /home/alexa/miniconda3/envs/arg/lib/python3.9/site-packages/transformers-4.6.1-py3.8.egg/transformers/models/fsmt/tokenization_fsmt.py (2ms) [FG] parsing: /home/alexa/miniconda3/envs/arg/lib/python3.9/site-packages/transformers-4.6.1-py3.8.egg/transformers/models/bert_generation/configuration_bert_generation.py [fs read 0ms] (0ms) [FG] binding: /home/alexa/miniconda3/envs/arg/lib/python3.9/site-packages/transformers-4.6.1-py3.8.egg/transformers/models/bert_generation/configuration_bert_generation.py (1ms) [FG] parsing: /home/alexa/miniconda3/envs/arg/lib/python3.9/site-packages/transformers-4.6.1-py3.8.egg/transformers/models/bert_generation/tokenization_bert_generation.py [fs read 0ms] (1ms) [FG] binding: /home/alexa/miniconda3/envs/arg/lib/python3.9/site-packages/transformers-4.6.1-py3.8.egg/transformers/models/bert_generation/tokenization_bert_generation.py (1ms) [FG] parsing: /home/alexa/miniconda3/envs/arg/lib/python3.9/site-packages/transformers-4.6.1-py3.8.egg/transformers/models/deberta/configuration_deberta.py [fs read 0ms] (1ms) [FG] binding: /home/alexa/miniconda3/envs/arg/lib/python3.9/site-packages/transformers-4.6.1-py3.8.egg/transformers/models/deberta/configuration_deberta.py (0ms) [FG] parsing: /home/alexa/miniconda3/envs/arg/lib/python3.9/site-packages/transformers-4.6.1-py3.8.egg/transformers/models/deberta/tokenization_deberta.py [fs read 0ms] (2ms) [FG] binding: /home/alexa/miniconda3/envs/arg/lib/python3.9/site-packages/transformers-4.6.1-py3.8.egg/transformers/models/deberta/tokenization_deberta.py (0ms) [FG] parsing: /home/alexa/miniconda3/envs/arg/lib/python3.9/site-packages/transformers-4.6.1-py3.8.egg/transformers/models/deberta/tokenization_deberta_fast.py [fs read 0ms] (1ms) [FG] binding: /home/alexa/miniconda3/envs/arg/lib/python3.9/site-packages/transformers-4.6.1-py3.8.egg/transformers/models/deberta/tokenization_deberta_fast.py (0ms) [FG] parsing: /home/alexa/miniconda3/envs/arg/lib/python3.9/site-packages/transformers-4.6.1-py3.8.egg/transformers/models/deberta_v2/configuration_deberta_v2.py [fs read 0ms] (0ms) [FG] binding: /home/alexa/miniconda3/envs/arg/lib/python3.9/site-packages/transformers-4.6.1-py3.8.egg/transformers/models/deberta_v2/configuration_deberta_v2.py (1ms) [FG] parsing: /home/alexa/miniconda3/envs/arg/lib/python3.9/site-packages/transformers-4.6.1-py3.8.egg/transformers/models/deberta_v2/tokenization_deberta_v2.py [fs read 0ms] (5ms) [FG] binding: /home/alexa/miniconda3/envs/arg/lib/python3.9/site-packages/transformers-4.6.1-py3.8.egg/transformers/models/deberta_v2/tokenization_deberta_v2.py (3ms) [FG] parsing: /home/alexa/miniconda3/envs/arg/lib/python3.9/site-packages/transformers-4.6.1-py3.8.egg/transformers/models/rag/configuration_rag.py [fs read 0ms] (1ms) [FG] binding: /home/alexa/miniconda3/envs/arg/lib/python3.9/site-packages/transformers-4.6.1-py3.8.egg/transformers/models/rag/configuration_rag.py (0ms) [FG] parsing: /home/alexa/miniconda3/envs/arg/lib/python3.9/site-packages/transformers-4.6.1-py3.8.egg/transformers/models/rag/tokenization_rag.py [fs read 0ms] (1ms) [FG] binding: /home/alexa/miniconda3/envs/arg/lib/python3.9/site-packages/transformers-4.6.1-py3.8.egg/transformers/models/rag/tokenization_rag.py (0ms) [FG] parsing: /home/alexa/miniconda3/envs/arg/lib/python3.9/site-packages/transformers-4.6.1-py3.8.egg/transformers/models/xlm_prophetnet/configuration_xlm_prophetnet.py [fs read 0ms] (0ms) [FG] binding: /home/alexa/miniconda3/envs/arg/lib/python3.9/site-packages/transformers-4.6.1-py3.8.egg/transformers/models/xlm_prophetnet/configuration_xlm_prophetnet.py (0ms) [FG] parsing: /home/alexa/miniconda3/envs/arg/lib/python3.9/site-packages/transformers-4.6.1-py3.8.egg/transformers/models/prophetnet/configuration_prophetnet.py [fs read 0ms] (2ms) [FG] binding: /home/alexa/miniconda3/envs/arg/lib/python3.9/site-packages/transformers-4.6.1-py3.8.egg/transformers/models/prophetnet/configuration_prophetnet.py (0ms) [FG] parsing: /home/alexa/miniconda3/envs/arg/lib/python3.9/site-packages/transformers-4.6.1-py3.8.egg/transformers/models/xlm_prophetnet/tokenization_xlm_prophetnet.py [fs read 0ms] (4ms) [FG] binding: /home/alexa/miniconda3/envs/arg/lib/python3.9/site-packages/transformers-4.6.1-py3.8.egg/transformers/models/xlm_prophetnet/tokenization_xlm_prophetnet.py (1ms) [FG] parsing: /home/alexa/miniconda3/envs/arg/lib/python3.9/site-packages/transformers-4.6.1-py3.8.egg/transformers/models/speech_to_text/configuration_speech_to_text.py [fs read 1ms] (2ms) [FG] binding: /home/alexa/miniconda3/envs/arg/lib/python3.9/site-packages/transformers-4.6.1-py3.8.egg/transformers/models/speech_to_text/configuration_speech_to_text.py (0ms) [FG] parsing: /home/alexa/miniconda3/envs/arg/lib/python3.9/site-packages/transformers-4.6.1-py3.8.egg/transformers/models/speech_to_text/__init__.py [fs read 0ms] (1ms) [FG] binding: /home/alexa/miniconda3/envs/arg/lib/python3.9/site-packages/transformers-4.6.1-py3.8.egg/transformers/models/speech_to_text/__init__.py (0ms) [FG] parsing: /home/alexa/miniconda3/envs/arg/lib/python3.9/site-packages/transformers-4.6.1-py3.8.egg/transformers/models/speech_to_text/tokenization_speech_to_text.py [fs read 0ms] (2ms) [FG] binding: /home/alexa/miniconda3/envs/arg/lib/python3.9/site-packages/transformers-4.6.1-py3.8.egg/transformers/models/speech_to_text/tokenization_speech_to_text.py (1ms) [FG] parsing: /home/alexa/miniconda3/envs/arg/lib/python3.9/site-packages/transformers-4.6.1-py3.8.egg/transformers/models/m2m_100/configuration_m2m_100.py [fs read 1ms] (1ms) [FG] binding: /home/alexa/miniconda3/envs/arg/lib/python3.9/site-packages/transformers-4.6.1-py3.8.egg/transformers/models/m2m_100/configuration_m2m_100.py (0ms) [FG] parsing: /home/alexa/miniconda3/envs/arg/lib/python3.9/site-packages/transformers-4.6.1-py3.8.egg/transformers/models/m2m_100/__init__.py [fs read 0ms] (0ms) [FG] binding: /home/alexa/miniconda3/envs/arg/lib/python3.9/site-packages/transformers-4.6.1-py3.8.egg/transformers/models/m2m_100/__init__.py (0ms) [FG] parsing: /home/alexa/miniconda3/envs/arg/lib/python3.9/site-packages/transformers-4.6.1-py3.8.egg/transformers/models/m2m_100/tokenization_m2m_100.py [fs read 0ms] (2ms) [FG] binding: /home/alexa/miniconda3/envs/arg/lib/python3.9/site-packages/transformers-4.6.1-py3.8.egg/transformers/models/m2m_100/tokenization_m2m_100.py (1ms) [FG] parsing: /home/alexa/miniconda3/envs/arg/lib/python3.9/site-packages/transformers-4.6.1-py3.8.egg/transformers/models/prophetnet/tokenization_prophetnet.py [fs read 0ms] (1ms) [FG] binding: /home/alexa/miniconda3/envs/arg/lib/python3.9/site-packages/transformers-4.6.1-py3.8.egg/transformers/models/prophetnet/tokenization_prophetnet.py (1ms) [FG] parsing: /home/alexa/miniconda3/envs/arg/lib/python3.9/site-packages/transformers-4.6.1-py3.8.egg/transformers/models/mpnet/configuration_mpnet.py [fs read 1ms] (1ms) [FG] binding: /home/alexa/miniconda3/envs/arg/lib/python3.9/site-packages/transformers-4.6.1-py3.8.egg/transformers/models/mpnet/configuration_mpnet.py (0ms) [FG] parsing: /home/alexa/miniconda3/envs/arg/lib/python3.9/site-packages/transformers-4.6.1-py3.8.egg/transformers/models/mpnet/tokenization_mpnet.py [fs read 1ms] (3ms) [FG] binding: /home/alexa/miniconda3/envs/arg/lib/python3.9/site-packages/transformers-4.6.1-py3.8.egg/transformers/models/mpnet/tokenization_mpnet.py (2ms) [FG] parsing: /home/alexa/miniconda3/envs/arg/lib/python3.9/site-packages/transformers-4.6.1-py3.8.egg/transformers/models/mpnet/tokenization_mpnet_fast.py [fs read 1ms] (1ms) [FG] binding: /home/alexa/miniconda3/envs/arg/lib/python3.9/site-packages/transformers-4.6.1-py3.8.egg/transformers/models/mpnet/tokenization_mpnet_fast.py (1ms) [FG] parsing: /home/alexa/miniconda3/envs/arg/lib/python3.9/site-packages/transformers-4.6.1-py3.8.egg/transformers/models/tapas/configuration_tapas.py [fs read 0ms] (1ms) [FG] binding: /home/alexa/miniconda3/envs/arg/lib/python3.9/site-packages/transformers-4.6.1-py3.8.egg/transformers/models/tapas/configuration_tapas.py (0ms) [FG] parsing: /home/alexa/miniconda3/envs/arg/lib/python3.9/site-packages/transformers-4.6.1-py3.8.egg/transformers/models/tapas/tokenization_tapas.py [fs read 1ms] (20ms) [FG] binding: /home/alexa/miniconda3/envs/arg/lib/python3.9/site-packages/transformers-4.6.1-py3.8.egg/transformers/models/tapas/tokenization_tapas.py (7ms) [FG] parsing: /home/alexa/miniconda3/envs/arg/lib/python3.9/site-packages/transformers-4.6.1-py3.8.egg/transformers/models/led/configuration_led.py [fs read 0ms] (1ms) [FG] binding: /home/alexa/miniconda3/envs/arg/lib/python3.9/site-packages/transformers-4.6.1-py3.8.egg/transformers/models/led/configuration_led.py (0ms) [FG] parsing: /home/alexa/miniconda3/envs/arg/lib/python3.9/site-packages/transformers-4.6.1-py3.8.egg/transformers/models/led/tokenization_led.py [fs read 0ms] (0ms) [FG] binding: /home/alexa/miniconda3/envs/arg/lib/python3.9/site-packages/transformers-4.6.1-py3.8.egg/transformers/models/led/tokenization_led.py (0ms) [FG] parsing: /home/alexa/miniconda3/envs/arg/lib/python3.9/site-packages/transformers-4.6.1-py3.8.egg/transformers/models/led/tokenization_led_fast.py [fs read 0ms] (1ms) [FG] binding: /home/alexa/miniconda3/envs/arg/lib/python3.9/site-packages/transformers-4.6.1-py3.8.egg/transformers/models/led/tokenization_led_fast.py (0ms) [FG] parsing: /home/alexa/miniconda3/envs/arg/lib/python3.9/site-packages/transformers-4.6.1-py3.8.egg/transformers/models/convbert/configuration_convbert.py [fs read 0ms] (1ms) [FG] binding: /home/alexa/miniconda3/envs/arg/lib/python3.9/site-packages/transformers-4.6.1-py3.8.egg/transformers/models/convbert/configuration_convbert.py (0ms) [FG] parsing: /home/alexa/miniconda3/envs/arg/lib/python3.9/site-packages/transformers-4.6.1-py3.8.egg/transformers/models/convbert/tokenization_convbert.py [fs read 0ms] (1ms) [FG] binding: /home/alexa/miniconda3/envs/arg/lib/python3.9/site-packages/transformers-4.6.1-py3.8.egg/transformers/models/convbert/tokenization_convbert.py (0ms) [FG] parsing: /home/alexa/miniconda3/envs/arg/lib/python3.9/site-packages/transformers-4.6.1-py3.8.egg/transformers/models/convbert/tokenization_convbert_fast.py [fs read 0ms] (0ms) [FG] binding: /home/alexa/miniconda3/envs/arg/lib/python3.9/site-packages/transformers-4.6.1-py3.8.egg/transformers/models/convbert/tokenization_convbert_fast.py (0ms) [FG] parsing: /home/alexa/miniconda3/envs/arg/lib/python3.9/site-packages/transformers-4.6.1-py3.8.egg/transformers/models/big_bird/configuration_big_bird.py [fs read 0ms] (1ms) [FG] binding: /home/alexa/miniconda3/envs/arg/lib/python3.9/site-packages/transformers-4.6.1-py3.8.egg/transformers/models/big_bird/configuration_big_bird.py (0ms) [FG] parsing: /home/alexa/miniconda3/envs/arg/lib/python3.9/site-packages/transformers-4.6.1-py3.8.egg/transformers/models/big_bird/tokenization_big_bird.py [fs read 0ms] (2ms) [FG] binding: /home/alexa/miniconda3/envs/arg/lib/python3.9/site-packages/transformers-4.6.1-py3.8.egg/transformers/models/big_bird/tokenization_big_bird.py (0ms) [FG] parsing: /home/alexa/miniconda3/envs/arg/lib/python3.9/site-packages/transformers-4.6.1-py3.8.egg/transformers/models/big_bird/tokenization_big_bird_fast.py [fs read 0ms] (4ms) [FG] binding: /home/alexa/miniconda3/envs/arg/lib/python3.9/site-packages/transformers-4.6.1-py3.8.egg/transformers/models/big_bird/tokenization_big_bird_fast.py (2ms) [FG] parsing: /home/alexa/miniconda3/envs/arg/lib/python3.9/site-packages/transformers-4.6.1-py3.8.egg/transformers/models/ibert/configuration_ibert.py [fs read 1ms] (1ms) [FG] binding: /home/alexa/miniconda3/envs/arg/lib/python3.9/site-packages/transformers-4.6.1-py3.8.egg/transformers/models/ibert/configuration_ibert.py (1ms) [FG] parsing: /home/alexa/miniconda3/envs/arg/lib/python3.9/site-packages/transformers-4.6.1-py3.8.egg/transformers/models/wav2vec2/configuration_wav2vec2.py [fs read 0ms] (1ms) [FG] binding: /home/alexa/miniconda3/envs/arg/lib/python3.9/site-packages/transformers-4.6.1-py3.8.egg/transformers/models/wav2vec2/configuration_wav2vec2.py (0ms) [FG] parsing: /home/alexa/miniconda3/envs/arg/lib/python3.9/site-packages/transformers-4.6.1-py3.8.egg/transformers/models/wav2vec2/tokenization_wav2vec2.py [fs read 1ms] (3ms) [FG] binding: /home/alexa/miniconda3/envs/arg/lib/python3.9/site-packages/transformers-4.6.1-py3.8.egg/transformers/models/wav2vec2/tokenization_wav2vec2.py (2ms) [FG] parsing: /home/alexa/miniconda3/envs/arg/lib/python3.9/site-packages/transformers-4.6.1-py3.8.egg/transformers/models/gpt_neo/__init__.py [fs read 0ms] (1ms) [FG] binding: /home/alexa/miniconda3/envs/arg/lib/python3.9/site-packages/transformers-4.6.1-py3.8.egg/transformers/models/gpt_neo/__init__.py (0ms) [FG] parsing: /home/alexa/miniconda3/envs/arg/lib/python3.9/site-packages/transformers-4.6.1-py3.8.egg/transformers/models/gpt_neo/configuration_gpt_neo.py [fs read 0ms] (1ms) [FG] binding: /home/alexa/miniconda3/envs/arg/lib/python3.9/site-packages/transformers-4.6.1-py3.8.egg/transformers/models/gpt_neo/configuration_gpt_neo.py (0ms) [FG] parsing: /home/alexa/miniconda3/envs/arg/lib/python3.9/site-packages/transformers-4.6.1-py3.8.egg/transformers/models/luke/configuration_luke.py [fs read 0ms] (1ms) [FG] binding: /home/alexa/miniconda3/envs/arg/lib/python3.9/site-packages/transformers-4.6.1-py3.8.egg/transformers/models/luke/configuration_luke.py (0ms) [FG] parsing: /home/alexa/miniconda3/envs/arg/lib/python3.9/site-packages/transformers-4.6.1-py3.8.egg/transformers/models/luke/tokenization_luke.py [fs read 1ms] (8ms) [FG] binding: /home/alexa/miniconda3/envs/arg/lib/python3.9/site-packages/transformers-4.6.1-py3.8.egg/transformers/models/luke/tokenization_luke.py (3ms) [FG] parsing: /home/alexa/miniconda3/envs/arg/lib/python3.9/site-packages/transformers-4.6.1-py3.8.egg/transformers/models/roberta/__init__.py [fs read 0ms] (1ms) [FG] binding: /home/alexa/miniconda3/envs/arg/lib/python3.9/site-packages/transformers-4.6.1-py3.8.egg/transformers/models/roberta/__init__.py (0ms) [FG] parsing: /home/alexa/miniconda3/envs/arg/lib/python3.9/site-packages/transformers-4.6.1-py3.8.egg/transformers/models/bigbird_pegasus/configuration_bigbird_pegasus.py [fs read 0ms] (1ms) [FG] binding: /home/alexa/miniconda3/envs/arg/lib/python3.9/site-packages/transformers-4.6.1-py3.8.egg/transformers/models/bigbird_pegasus/configuration_bigbird_pegasus.py (0ms) [FG] parsing: /home/alexa/.vscode-server-insiders/extensions/ms-python.vscode-pylance-2021.6.2-pre.1/dist/typeshed-fallback/stdlib/abc.pyi [fs read 0ms] (0ms) [FG] binding: /home/alexa/.vscode-server-insiders/extensions/ms-python.vscode-pylance-2021.6.2-pre.1/dist/typeshed-fallback/stdlib/abc.pyi (0ms) [FG] parsing: /home/alexa/.vscode-server-insiders/extensions/ms-python.vscode-pylance-2021.6.2-pre.1/dist/typeshed-fallback/stdlib/re.pyi [fs read 0ms] (1ms) [FG] binding: /home/alexa/.vscode-server-insiders/extensions/ms-python.vscode-pylance-2021.6.2-pre.1/dist/typeshed-fallback/stdlib/re.pyi (1ms) [FG] parsing: /home/alexa/.vscode-server-insiders/extensions/ms-python.vscode-pylance-2021.6.2-pre.1/dist/typeshed-fallback/stdlib/enum.pyi [fs read 0ms] (1ms) [FG] binding: /home/alexa/.vscode-server-insiders/extensions/ms-python.vscode-pylance-2021.6.2-pre.1/dist/typeshed-fallback/stdlib/enum.pyi (1ms) [FG] completion at /home/alexa/torm.py:1:14 [found 40 items] (6747ms) [Info - 4:28:42 PM] [FG] Long operation: completion at /home/alexa/torm.py:1:14 (6747ms) [BG(1)] checking: /home/alexa/torm.py (4ms) [BG(1)] analyzing: /home/alexa/torm.py (5ms) Background analysis message: getDiagnosticsForRange Background analysis message: resumeAnalysis Background analysis message: getDiagnosticsForRange Background analysis message: getSemanticTokens delta [BG(1)] getSemanticTokens delta previousResultId:1623335315444 at /home/alexa/torm.py (0ms) [FG] parsing: /tmp/pyright-19739-ojRnV9rxj4IB/builtins-19739-IJUPERToPuvQ-.py [fs read 0ms] (34ms) [FG] binding: /tmp/pyright-19739-ojRnV9rxj4IB/builtins-19739-IJUPERToPuvQ-.py (17ms) Background analysis message: getDiagnosticsForRange Background analysis message: getDiagnosticsForRange ```

jakebailey commented 3 years ago

Thanks, I can reproduce this.

heejaechang commented 3 years ago

since we can repro, with this hidden option

python.analysis.logLevel: "Trace"
python.analysis.logTypeEvaluationTime: true
python.analysis.typeEvaluationTimeThreshold: 200

we probably can find which type is taking a long time in type evaluation and fix it by either adding partial type stub or improve type evaluation code around it.

heejaechang commented 3 years ago

fixed in 2021.8.0 release.

tshu-w commented 3 years ago

@heejaechang Hi, I'm using pyright and facing this issue. Can I get partial stubs somewhere?

bschnurr commented 3 years ago

you can generate your own stub.

add a strict comment to a file

#pyright: strict
from transformers import AutoTokenizer

then a code action should appear on transformers to generate a stub

i'll add them here tmr https://github.com/microsoft/python-type-stubs

or you can install pylance and manually look for the bundled stub folder

bschnurr commented 3 years ago

i'll add them here tmr https://github.com/microsoft/python-type-stubs

bschnurr commented 3 years ago

updated