search

cognitivecomputations / laserRMT

This is our own implementation of 'Layer Selective Rank Reduction'
Apache License 2.0
227 stars 27 forks source link

Dataset pattern - Invalid pattern: '**' can only be an entire path component - traindata = load_dataset #15

Open corticalstack opened 4 months ago

corticalstack commented 4 months ago

Hey,

First time trying https://github.com/cognitivecomputations/laserRMT/blob/main/rmt_laser_snr_math.py.

After seemingly calculating all Calculating Signal to Noise Ratios after approx 2 hours (RTX03090), it dumped, see below, grateful for any guidance:

---------------------------------------------------------------------------
ValueError                                Traceback (most recent call last)
Cell In[4], [line 16](vscode-notebook-cell:?execution_count=4&line=16)
     [13](vscode-notebook-cell:?execution_count=4&line=13) top_k_layers = modifier.select_layers_for_modification(15)  # Select top 15 layers
     [14](vscode-notebook-cell:?execution_count=4&line=14) print(top_k_layers, flush=True)
---> [16](vscode-notebook-cell:?execution_count=4&line=16) modifier.test_and_modify_layers(top_k_layers)
     [17](vscode-notebook-cell:?execution_count=4&line=17) # %%

Cell In[3], [line 150](vscode-notebook-cell:?execution_count=3&line=150)
    [149](vscode-notebook-cell:?execution_count=3&line=149) def test_and_modify_layers(self, candidate_layers):
--> [150](vscode-notebook-cell:?execution_count=3&line=150)     initial_perplexity = self.calculate_model_perplexity()
    [151](vscode-notebook-cell:?execution_count=3&line=151)     print(f"Initial Model Perplexity: {initial_perplexity}")
    [153](vscode-notebook-cell:?execution_count=3&line=153)     for layer in candidate_layers:
    [154](vscode-notebook-cell:?execution_count=3&line=154)         # Modify the layer

Cell In[3], [line 100](vscode-notebook-cell:?execution_count=3&line=100)
     [97](vscode-notebook-cell:?execution_count=3&line=97) total_samples = 0
     [99](vscode-notebook-cell:?execution_count=3&line=99) for dataset in datasets:
--> [100](vscode-notebook-cell:?execution_count=3&line=100)     input_tok = gptq_data_utils_math.get_test_tokens(dataset, seed=0, seqlen=seqlen, model=model_str)
    [101](vscode-notebook-cell:?execution_count=3&line=101)     total_length = input_tok.size(0)
    [102](vscode-notebook-cell:?execution_count=3&line=102)     nsamples = total_length // seqlen

File /mnt/samssd/developments/genai-playground/language/08-laser/lib/utils/gptq_data_utils_math.py:68, in get_test_tokens(name, seed, seqlen, model)
     [66](https://vscode-remote+ssh-002dremote-002b7b22686f73744e616d65223a22506f65227d.vscode-resource.vscode-cdn.net/mnt/samssd/developments/genai-playground/language/08-laser/lib/utils/gptq_data_utils_math.py:66) train_samples = 0
     [67](https://vscode-remote+ssh-002dremote-002b7b22686f73744e616d65223a22506f65227d.vscode-resource.vscode-cdn.net/mnt/samssd/developments/genai-playground/language/08-laser/lib/utils/gptq_data_utils_math.py:67) if name == 'gsm8k':
---> [68](https://vscode-remote+ssh-002dremote-002b7b22686f73744e616d65223a22506f65227d.vscode-resource.vscode-cdn.net/mnt/samssd/developments/genai-playground/language/08-laser/lib/utils/gptq_data_utils_math.py:68)     return get_gsm8k(train_samples, seed, seqlen, model)[1]['input_ids']

File /mnt/samssd/developments/genai-playground/language/08-laser/lib/utils/gptq_data_utils_math.py:17, in get_gsm8k(nsamples, seed, seqlen, model)
     [14](https://vscode-remote+ssh-002dremote-002b7b22686f73744e616d65223a22506f65227d.vscode-resource.vscode-cdn.net/mnt/samssd/developments/genai-playground/language/08-laser/lib/utils/gptq_data_utils_math.py:14) import random
     [16](https://vscode-remote+ssh-002dremote-002b7b22686f73744e616d65223a22506f65227d.vscode-resource.vscode-cdn.net/mnt/samssd/developments/genai-playground/language/08-laser/lib/utils/gptq_data_utils_math.py:16) # load gsm8k dataset
---> [17](https://vscode-remote+ssh-002dremote-002b7b22686f73744e616d65223a22506f65227d.vscode-resource.vscode-cdn.net/mnt/samssd/developments/genai-playground/language/08-laser/lib/utils/gptq_data_utils_math.py:17) traindata = load_dataset('gsm8k', 'main', split='train')
     [18](https://vscode-remote+ssh-002dremote-002b7b22686f73744e616d65223a22506f65227d.vscode-resource.vscode-cdn.net/mnt/samssd/developments/genai-playground/language/08-laser/lib/utils/gptq_data_utils_math.py:18) testdata = load_dataset('gsm8k', 'main', split='test')
     [20](https://vscode-remote+ssh-002dremote-002b7b22686f73744e616d65223a22506f65227d.vscode-resource.vscode-cdn.net/mnt/samssd/developments/genai-playground/language/08-laser/lib/utils/gptq_data_utils_math.py:20) # initialize tokenizer

File [~/.conda/envs/genaiplayground_laser/lib/python3.11/site-packages/datasets/load.py:1773](https://vscode-remote+ssh-002dremote-002b7b22686f73744e616d65223a22506f65227d.vscode-resource.vscode-cdn.net/mnt/samssd/developments/genai-playground/language/08-laser/~/.conda/envs/genaiplayground_laser/lib/python3.11/site-packages/datasets/load.py:1773), in load_dataset(path, name, data_dir, data_files, split, cache_dir, features, download_config, download_mode, verification_mode, ignore_verifications, keep_in_memory, save_infos, revision, use_auth_token, task, streaming, num_proc, storage_options, **config_kwargs)
   [1768](https://vscode-remote+ssh-002dremote-002b7b22686f73744e616d65223a22506f65227d.vscode-resource.vscode-cdn.net/mnt/samssd/developments/genai-playground/language/08-laser/~/.conda/envs/genaiplayground_laser/lib/python3.11/site-packages/datasets/load.py:1768) verification_mode = VerificationMode(
   [1769](https://vscode-remote+ssh-002dremote-002b7b22686f73744e616d65223a22506f65227d.vscode-resource.vscode-cdn.net/mnt/samssd/developments/genai-playground/language/08-laser/~/.conda/envs/genaiplayground_laser/lib/python3.11/site-packages/datasets/load.py:1769)     (verification_mode or VerificationMode.BASIC_CHECKS) if not save_infos else VerificationMode.ALL_CHECKS
   [1770](https://vscode-remote+ssh-002dremote-002b7b22686f73744e616d65223a22506f65227d.vscode-resource.vscode-cdn.net/mnt/samssd/developments/genai-playground/language/08-laser/~/.conda/envs/genaiplayground_laser/lib/python3.11/site-packages/datasets/load.py:1770) )
   [1772](https://vscode-remote+ssh-002dremote-002b7b22686f73744e616d65223a22506f65227d.vscode-resource.vscode-cdn.net/mnt/samssd/developments/genai-playground/language/08-laser/~/.conda/envs/genaiplayground_laser/lib/python3.11/site-packages/datasets/load.py:1772) # Create a dataset builder
-> [1773](https://vscode-remote+ssh-002dremote-002b7b22686f73744e616d65223a22506f65227d.vscode-resource.vscode-cdn.net/mnt/samssd/developments/genai-playground/language/08-laser/~/.conda/envs/genaiplayground_laser/lib/python3.11/site-packages/datasets/load.py:1773) builder_instance = load_dataset_builder(
   [1774](https://vscode-remote+ssh-002dremote-002b7b22686f73744e616d65223a22506f65227d.vscode-resource.vscode-cdn.net/mnt/samssd/developments/genai-playground/language/08-laser/~/.conda/envs/genaiplayground_laser/lib/python3.11/site-packages/datasets/load.py:1774)     path=path,
   [1775](https://vscode-remote+ssh-002dremote-002b7b22686f73744e616d65223a22506f65227d.vscode-resource.vscode-cdn.net/mnt/samssd/developments/genai-playground/language/08-laser/~/.conda/envs/genaiplayground_laser/lib/python3.11/site-packages/datasets/load.py:1775)     name=name,
   [1776](https://vscode-remote+ssh-002dremote-002b7b22686f73744e616d65223a22506f65227d.vscode-resource.vscode-cdn.net/mnt/samssd/developments/genai-playground/language/08-laser/~/.conda/envs/genaiplayground_laser/lib/python3.11/site-packages/datasets/load.py:1776)     data_dir=data_dir,
   [1777](https://vscode-remote+ssh-002dremote-002b7b22686f73744e616d65223a22506f65227d.vscode-resource.vscode-cdn.net/mnt/samssd/developments/genai-playground/language/08-laser/~/.conda/envs/genaiplayground_laser/lib/python3.11/site-packages/datasets/load.py:1777)     data_files=data_files,
   [1778](https://vscode-remote+ssh-002dremote-002b7b22686f73744e616d65223a22506f65227d.vscode-resource.vscode-cdn.net/mnt/samssd/developments/genai-playground/language/08-laser/~/.conda/envs/genaiplayground_laser/lib/python3.11/site-packages/datasets/load.py:1778)     cache_dir=cache_dir,
   [1779](https://vscode-remote+ssh-002dremote-002b7b22686f73744e616d65223a22506f65227d.vscode-resource.vscode-cdn.net/mnt/samssd/developments/genai-playground/language/08-laser/~/.conda/envs/genaiplayground_laser/lib/python3.11/site-packages/datasets/load.py:1779)     features=features,
   [1780](https://vscode-remote+ssh-002dremote-002b7b22686f73744e616d65223a22506f65227d.vscode-resource.vscode-cdn.net/mnt/samssd/developments/genai-playground/language/08-laser/~/.conda/envs/genaiplayground_laser/lib/python3.11/site-packages/datasets/load.py:1780)     download_config=download_config,
   [1781](https://vscode-remote+ssh-002dremote-002b7b22686f73744e616d65223a22506f65227d.vscode-resource.vscode-cdn.net/mnt/samssd/developments/genai-playground/language/08-laser/~/.conda/envs/genaiplayground_laser/lib/python3.11/site-packages/datasets/load.py:1781)     download_mode=download_mode,
   [1782](https://vscode-remote+ssh-002dremote-002b7b22686f73744e616d65223a22506f65227d.vscode-resource.vscode-cdn.net/mnt/samssd/developments/genai-playground/language/08-laser/~/.conda/envs/genaiplayground_laser/lib/python3.11/site-packages/datasets/load.py:1782)     revision=revision,
   [1783](https://vscode-remote+ssh-002dremote-002b7b22686f73744e616d65223a22506f65227d.vscode-resource.vscode-cdn.net/mnt/samssd/developments/genai-playground/language/08-laser/~/.conda/envs/genaiplayground_laser/lib/python3.11/site-packages/datasets/load.py:1783)     use_auth_token=use_auth_token,
   [1784](https://vscode-remote+ssh-002dremote-002b7b22686f73744e616d65223a22506f65227d.vscode-resource.vscode-cdn.net/mnt/samssd/developments/genai-playground/language/08-laser/~/.conda/envs/genaiplayground_laser/lib/python3.11/site-packages/datasets/load.py:1784)     storage_options=storage_options,
   [1785](https://vscode-remote+ssh-002dremote-002b7b22686f73744e616d65223a22506f65227d.vscode-resource.vscode-cdn.net/mnt/samssd/developments/genai-playground/language/08-laser/~/.conda/envs/genaiplayground_laser/lib/python3.11/site-packages/datasets/load.py:1785)     **config_kwargs,
   [1786](https://vscode-remote+ssh-002dremote-002b7b22686f73744e616d65223a22506f65227d.vscode-resource.vscode-cdn.net/mnt/samssd/developments/genai-playground/language/08-laser/~/.conda/envs/genaiplayground_laser/lib/python3.11/site-packages/datasets/load.py:1786) )
   [1788](https://vscode-remote+ssh-002dremote-002b7b22686f73744e616d65223a22506f65227d.vscode-resource.vscode-cdn.net/mnt/samssd/developments/genai-playground/language/08-laser/~/.conda/envs/genaiplayground_laser/lib/python3.11/site-packages/datasets/load.py:1788) # Return iterable dataset in case of streaming
   [1789](https://vscode-remote+ssh-002dremote-002b7b22686f73744e616d65223a22506f65227d.vscode-resource.vscode-cdn.net/mnt/samssd/developments/genai-playground/language/08-laser/~/.conda/envs/genaiplayground_laser/lib/python3.11/site-packages/datasets/load.py:1789) if streaming:

File [~/.conda/envs/genaiplayground_laser/lib/python3.11/site-packages/datasets/load.py:1502](https://vscode-remote+ssh-002dremote-002b7b22686f73744e616d65223a22506f65227d.vscode-resource.vscode-cdn.net/mnt/samssd/developments/genai-playground/language/08-laser/~/.conda/envs/genaiplayground_laser/lib/python3.11/site-packages/datasets/load.py:1502), in load_dataset_builder(path, name, data_dir, data_files, cache_dir, features, download_config, download_mode, revision, use_auth_token, storage_options, **config_kwargs)
   [1500](https://vscode-remote+ssh-002dremote-002b7b22686f73744e616d65223a22506f65227d.vscode-resource.vscode-cdn.net/mnt/samssd/developments/genai-playground/language/08-laser/~/.conda/envs/genaiplayground_laser/lib/python3.11/site-packages/datasets/load.py:1500)     download_config = download_config.copy() if download_config else DownloadConfig()
   [1501](https://vscode-remote+ssh-002dremote-002b7b22686f73744e616d65223a22506f65227d.vscode-resource.vscode-cdn.net/mnt/samssd/developments/genai-playground/language/08-laser/~/.conda/envs/genaiplayground_laser/lib/python3.11/site-packages/datasets/load.py:1501)     download_config.use_auth_token = use_auth_token
-> [1502](https://vscode-remote+ssh-002dremote-002b7b22686f73744e616d65223a22506f65227d.vscode-resource.vscode-cdn.net/mnt/samssd/developments/genai-playground/language/08-laser/~/.conda/envs/genaiplayground_laser/lib/python3.11/site-packages/datasets/load.py:1502) dataset_module = dataset_module_factory(
   [1503](https://vscode-remote+ssh-002dremote-002b7b22686f73744e616d65223a22506f65227d.vscode-resource.vscode-cdn.net/mnt/samssd/developments/genai-playground/language/08-laser/~/.conda/envs/genaiplayground_laser/lib/python3.11/site-packages/datasets/load.py:1503)     path,
   [1504](https://vscode-remote+ssh-002dremote-002b7b22686f73744e616d65223a22506f65227d.vscode-resource.vscode-cdn.net/mnt/samssd/developments/genai-playground/language/08-laser/~/.conda/envs/genaiplayground_laser/lib/python3.11/site-packages/datasets/load.py:1504)     revision=revision,
   [1505](https://vscode-remote+ssh-002dremote-002b7b22686f73744e616d65223a22506f65227d.vscode-resource.vscode-cdn.net/mnt/samssd/developments/genai-playground/language/08-laser/~/.conda/envs/genaiplayground_laser/lib/python3.11/site-packages/datasets/load.py:1505)     download_config=download_config,
   [1506](https://vscode-remote+ssh-002dremote-002b7b22686f73744e616d65223a22506f65227d.vscode-resource.vscode-cdn.net/mnt/samssd/developments/genai-playground/language/08-laser/~/.conda/envs/genaiplayground_laser/lib/python3.11/site-packages/datasets/load.py:1506)     download_mode=download_mode,
   [1507](https://vscode-remote+ssh-002dremote-002b7b22686f73744e616d65223a22506f65227d.vscode-resource.vscode-cdn.net/mnt/samssd/developments/genai-playground/language/08-laser/~/.conda/envs/genaiplayground_laser/lib/python3.11/site-packages/datasets/load.py:1507)     data_dir=data_dir,
   [1508](https://vscode-remote+ssh-002dremote-002b7b22686f73744e616d65223a22506f65227d.vscode-resource.vscode-cdn.net/mnt/samssd/developments/genai-playground/language/08-laser/~/.conda/envs/genaiplayground_laser/lib/python3.11/site-packages/datasets/load.py:1508)     data_files=data_files,
   [1509](https://vscode-remote+ssh-002dremote-002b7b22686f73744e616d65223a22506f65227d.vscode-resource.vscode-cdn.net/mnt/samssd/developments/genai-playground/language/08-laser/~/.conda/envs/genaiplayground_laser/lib/python3.11/site-packages/datasets/load.py:1509) )
   [1511](https://vscode-remote+ssh-002dremote-002b7b22686f73744e616d65223a22506f65227d.vscode-resource.vscode-cdn.net/mnt/samssd/developments/genai-playground/language/08-laser/~/.conda/envs/genaiplayground_laser/lib/python3.11/site-packages/datasets/load.py:1511) # Get dataset builder class from the processing script
   [1512](https://vscode-remote+ssh-002dremote-002b7b22686f73744e616d65223a22506f65227d.vscode-resource.vscode-cdn.net/mnt/samssd/developments/genai-playground/language/08-laser/~/.conda/envs/genaiplayground_laser/lib/python3.11/site-packages/datasets/load.py:1512) builder_cls = import_main_class(dataset_module.module_path)

File [~/.conda/envs/genaiplayground_laser/lib/python3.11/site-packages/datasets/load.py:1219](https://vscode-remote+ssh-002dremote-002b7b22686f73744e616d65223a22506f65227d.vscode-resource.vscode-cdn.net/mnt/samssd/developments/genai-playground/language/08-laser/~/.conda/envs/genaiplayground_laser/lib/python3.11/site-packages/datasets/load.py:1219), in dataset_module_factory(path, revision, download_config, download_mode, dynamic_modules_path, data_dir, data_files, **download_kwargs)
   [1214](https://vscode-remote+ssh-002dremote-002b7b22686f73744e616d65223a22506f65227d.vscode-resource.vscode-cdn.net/mnt/samssd/developments/genai-playground/language/08-laser/~/.conda/envs/genaiplayground_laser/lib/python3.11/site-packages/datasets/load.py:1214)             if isinstance(e1, FileNotFoundError):
   [1215](https://vscode-remote+ssh-002dremote-002b7b22686f73744e616d65223a22506f65227d.vscode-resource.vscode-cdn.net/mnt/samssd/developments/genai-playground/language/08-laser/~/.conda/envs/genaiplayground_laser/lib/python3.11/site-packages/datasets/load.py:1215)                 raise FileNotFoundError(
   [1216](https://vscode-remote+ssh-002dremote-002b7b22686f73744e616d65223a22506f65227d.vscode-resource.vscode-cdn.net/mnt/samssd/developments/genai-playground/language/08-laser/~/.conda/envs/genaiplayground_laser/lib/python3.11/site-packages/datasets/load.py:1216)                     f"Couldn't find a dataset script at {relative_to_absolute_path(combined_path)} or any data file in the same directory. "
   [1217](https://vscode-remote+ssh-002dremote-002b7b22686f73744e616d65223a22506f65227d.vscode-resource.vscode-cdn.net/mnt/samssd/developments/genai-playground/language/08-laser/~/.conda/envs/genaiplayground_laser/lib/python3.11/site-packages/datasets/load.py:1217)                     f"Couldn't find '{path}' on the Hugging Face Hub either: {type(e1).__name__}: {e1}"
   [1218](https://vscode-remote+ssh-002dremote-002b7b22686f73744e616d65223a22506f65227d.vscode-resource.vscode-cdn.net/mnt/samssd/developments/genai-playground/language/08-laser/~/.conda/envs/genaiplayground_laser/lib/python3.11/site-packages/datasets/load.py:1218)                 ) from None
-> [1219](https://vscode-remote+ssh-002dremote-002b7b22686f73744e616d65223a22506f65227d.vscode-resource.vscode-cdn.net/mnt/samssd/developments/genai-playground/language/08-laser/~/.conda/envs/genaiplayground_laser/lib/python3.11/site-packages/datasets/load.py:1219)             raise e1 from None
   [1220](https://vscode-remote+ssh-002dremote-002b7b22686f73744e616d65223a22506f65227d.vscode-resource.vscode-cdn.net/mnt/samssd/developments/genai-playground/language/08-laser/~/.conda/envs/genaiplayground_laser/lib/python3.11/site-packages/datasets/load.py:1220) else:
   [1221](https://vscode-remote+ssh-002dremote-002b7b22686f73744e616d65223a22506f65227d.vscode-resource.vscode-cdn.net/mnt/samssd/developments/genai-playground/language/08-laser/~/.conda/envs/genaiplayground_laser/lib/python3.11/site-packages/datasets/load.py:1221)     raise FileNotFoundError(
   [1222](https://vscode-remote+ssh-002dremote-002b7b22686f73744e616d65223a22506f65227d.vscode-resource.vscode-cdn.net/mnt/samssd/developments/genai-playground/language/08-laser/~/.conda/envs/genaiplayground_laser/lib/python3.11/site-packages/datasets/load.py:1222)         f"Couldn't find a dataset script at {relative_to_absolute_path(combined_path)} or any data file in the same directory."
   [1223](https://vscode-remote+ssh-002dremote-002b7b22686f73744e616d65223a22506f65227d.vscode-resource.vscode-cdn.net/mnt/samssd/developments/genai-playground/language/08-laser/~/.conda/envs/genaiplayground_laser/lib/python3.11/site-packages/datasets/load.py:1223)     )

File [~/.conda/envs/genaiplayground_laser/lib/python3.11/site-packages/datasets/load.py:1203](https://vscode-remote+ssh-002dremote-002b7b22686f73744e616d65223a22506f65227d.vscode-resource.vscode-cdn.net/mnt/samssd/developments/genai-playground/language/08-laser/~/.conda/envs/genaiplayground_laser/lib/python3.11/site-packages/datasets/load.py:1203), in dataset_module_factory(path, revision, download_config, download_mode, dynamic_modules_path, data_dir, data_files, **download_kwargs)
   [1188](https://vscode-remote+ssh-002dremote-002b7b22686f73744e616d65223a22506f65227d.vscode-resource.vscode-cdn.net/mnt/samssd/developments/genai-playground/language/08-laser/~/.conda/envs/genaiplayground_laser/lib/python3.11/site-packages/datasets/load.py:1188)         return HubDatasetModuleFactoryWithScript(
   [1189](https://vscode-remote+ssh-002dremote-002b7b22686f73744e616d65223a22506f65227d.vscode-resource.vscode-cdn.net/mnt/samssd/developments/genai-playground/language/08-laser/~/.conda/envs/genaiplayground_laser/lib/python3.11/site-packages/datasets/load.py:1189)             path,
   [1190](https://vscode-remote+ssh-002dremote-002b7b22686f73744e616d65223a22506f65227d.vscode-resource.vscode-cdn.net/mnt/samssd/developments/genai-playground/language/08-laser/~/.conda/envs/genaiplayground_laser/lib/python3.11/site-packages/datasets/load.py:1190)             revision=revision,
   (...)
   [1193](https://vscode-remote+ssh-002dremote-002b7b22686f73744e616d65223a22506f65227d.vscode-resource.vscode-cdn.net/mnt/samssd/developments/genai-playground/language/08-laser/~/.conda/envs/genaiplayground_laser/lib/python3.11/site-packages/datasets/load.py:1193)             dynamic_modules_path=dynamic_modules_path,
   [1194](https://vscode-remote+ssh-002dremote-002b7b22686f73744e616d65223a22506f65227d.vscode-resource.vscode-cdn.net/mnt/samssd/developments/genai-playground/language/08-laser/~/.conda/envs/genaiplayground_laser/lib/python3.11/site-packages/datasets/load.py:1194)         ).get_module()
   [1195](https://vscode-remote+ssh-002dremote-002b7b22686f73744e616d65223a22506f65227d.vscode-resource.vscode-cdn.net/mnt/samssd/developments/genai-playground/language/08-laser/~/.conda/envs/genaiplayground_laser/lib/python3.11/site-packages/datasets/load.py:1195)     else:
   [1196](https://vscode-remote+ssh-002dremote-002b7b22686f73744e616d65223a22506f65227d.vscode-resource.vscode-cdn.net/mnt/samssd/developments/genai-playground/language/08-laser/~/.conda/envs/genaiplayground_laser/lib/python3.11/site-packages/datasets/load.py:1196)         return HubDatasetModuleFactoryWithoutScript(
   [1197](https://vscode-remote+ssh-002dremote-002b7b22686f73744e616d65223a22506f65227d.vscode-resource.vscode-cdn.net/mnt/samssd/developments/genai-playground/language/08-laser/~/.conda/envs/genaiplayground_laser/lib/python3.11/site-packages/datasets/load.py:1197)             path,
   [1198](https://vscode-remote+ssh-002dremote-002b7b22686f73744e616d65223a22506f65227d.vscode-resource.vscode-cdn.net/mnt/samssd/developments/genai-playground/language/08-laser/~/.conda/envs/genaiplayground_laser/lib/python3.11/site-packages/datasets/load.py:1198)             revision=revision,
   [1199](https://vscode-remote+ssh-002dremote-002b7b22686f73744e616d65223a22506f65227d.vscode-resource.vscode-cdn.net/mnt/samssd/developments/genai-playground/language/08-laser/~/.conda/envs/genaiplayground_laser/lib/python3.11/site-packages/datasets/load.py:1199)             data_dir=data_dir,
   [1200](https://vscode-remote+ssh-002dremote-002b7b22686f73744e616d65223a22506f65227d.vscode-resource.vscode-cdn.net/mnt/samssd/developments/genai-playground/language/08-laser/~/.conda/envs/genaiplayground_laser/lib/python3.11/site-packages/datasets/load.py:1200)             data_files=data_files,
   [1201](https://vscode-remote+ssh-002dremote-002b7b22686f73744e616d65223a22506f65227d.vscode-resource.vscode-cdn.net/mnt/samssd/developments/genai-playground/language/08-laser/~/.conda/envs/genaiplayground_laser/lib/python3.11/site-packages/datasets/load.py:1201)             download_config=download_config,
   [1202](https://vscode-remote+ssh-002dremote-002b7b22686f73744e616d65223a22506f65227d.vscode-resource.vscode-cdn.net/mnt/samssd/developments/genai-playground/language/08-laser/~/.conda/envs/genaiplayground_laser/lib/python3.11/site-packages/datasets/load.py:1202)             download_mode=download_mode,
-> [1203](https://vscode-remote+ssh-002dremote-002b7b22686f73744e616d65223a22506f65227d.vscode-resource.vscode-cdn.net/mnt/samssd/developments/genai-playground/language/08-laser/~/.conda/envs/genaiplayground_laser/lib/python3.11/site-packages/datasets/load.py:1203)         ).get_module()
   [1204](https://vscode-remote+ssh-002dremote-002b7b22686f73744e616d65223a22506f65227d.vscode-resource.vscode-cdn.net/mnt/samssd/developments/genai-playground/language/08-laser/~/.conda/envs/genaiplayground_laser/lib/python3.11/site-packages/datasets/load.py:1204) except (
   [1205](https://vscode-remote+ssh-002dremote-002b7b22686f73744e616d65223a22506f65227d.vscode-resource.vscode-cdn.net/mnt/samssd/developments/genai-playground/language/08-laser/~/.conda/envs/genaiplayground_laser/lib/python3.11/site-packages/datasets/load.py:1205)     Exception
   [1206](https://vscode-remote+ssh-002dremote-002b7b22686f73744e616d65223a22506f65227d.vscode-resource.vscode-cdn.net/mnt/samssd/developments/genai-playground/language/08-laser/~/.conda/envs/genaiplayground_laser/lib/python3.11/site-packages/datasets/load.py:1206) ) as e1:  # noqa: all the attempts failed, before raising the error we should check if the module is already cached.
   [1207](https://vscode-remote+ssh-002dremote-002b7b22686f73744e616d65223a22506f65227d.vscode-resource.vscode-cdn.net/mnt/samssd/developments/genai-playground/language/08-laser/~/.conda/envs/genaiplayground_laser/lib/python3.11/site-packages/datasets/load.py:1207)     try:

File [~/.conda/envs/genaiplayground_laser/lib/python3.11/site-packages/datasets/load.py:769](https://vscode-remote+ssh-002dremote-002b7b22686f73744e616d65223a22506f65227d.vscode-resource.vscode-cdn.net/mnt/samssd/developments/genai-playground/language/08-laser/~/.conda/envs/genaiplayground_laser/lib/python3.11/site-packages/datasets/load.py:769), in HubDatasetModuleFactoryWithoutScript.get_module(self)
    [759](https://vscode-remote+ssh-002dremote-002b7b22686f73744e616d65223a22506f65227d.vscode-resource.vscode-cdn.net/mnt/samssd/developments/genai-playground/language/08-laser/~/.conda/envs/genaiplayground_laser/lib/python3.11/site-packages/datasets/load.py:759) def get_module(self) -> DatasetModule:
    [760](https://vscode-remote+ssh-002dremote-002b7b22686f73744e616d65223a22506f65227d.vscode-resource.vscode-cdn.net/mnt/samssd/developments/genai-playground/language/08-laser/~/.conda/envs/genaiplayground_laser/lib/python3.11/site-packages/datasets/load.py:760)     hfh_dataset_info = HfApi(config.HF_ENDPOINT).dataset_info(
    [761](https://vscode-remote+ssh-002dremote-002b7b22686f73744e616d65223a22506f65227d.vscode-resource.vscode-cdn.net/mnt/samssd/developments/genai-playground/language/08-laser/~/.conda/envs/genaiplayground_laser/lib/python3.11/site-packages/datasets/load.py:761)         self.name,
    [762](https://vscode-remote+ssh-002dremote-002b7b22686f73744e616d65223a22506f65227d.vscode-resource.vscode-cdn.net/mnt/samssd/developments/genai-playground/language/08-laser/~/.conda/envs/genaiplayground_laser/lib/python3.11/site-packages/datasets/load.py:762)         revision=self.revision,
    [763](https://vscode-remote+ssh-002dremote-002b7b22686f73744e616d65223a22506f65227d.vscode-resource.vscode-cdn.net/mnt/samssd/developments/genai-playground/language/08-laser/~/.conda/envs/genaiplayground_laser/lib/python3.11/site-packages/datasets/load.py:763)         token=self.download_config.use_auth_token,
    [764](https://vscode-remote+ssh-002dremote-002b7b22686f73744e616d65223a22506f65227d.vscode-resource.vscode-cdn.net/mnt/samssd/developments/genai-playground/language/08-laser/~/.conda/envs/genaiplayground_laser/lib/python3.11/site-packages/datasets/load.py:764)         timeout=100.0,
    [765](https://vscode-remote+ssh-002dremote-002b7b22686f73744e616d65223a22506f65227d.vscode-resource.vscode-cdn.net/mnt/samssd/developments/genai-playground/language/08-laser/~/.conda/envs/genaiplayground_laser/lib/python3.11/site-packages/datasets/load.py:765)     )
    [766](https://vscode-remote+ssh-002dremote-002b7b22686f73744e616d65223a22506f65227d.vscode-resource.vscode-cdn.net/mnt/samssd/developments/genai-playground/language/08-laser/~/.conda/envs/genaiplayground_laser/lib/python3.11/site-packages/datasets/load.py:766)     patterns = (
    [767](https://vscode-remote+ssh-002dremote-002b7b22686f73744e616d65223a22506f65227d.vscode-resource.vscode-cdn.net/mnt/samssd/developments/genai-playground/language/08-laser/~/.conda/envs/genaiplayground_laser/lib/python3.11/site-packages/datasets/load.py:767)         sanitize_patterns(self.data_files)
    [768](https://vscode-remote+ssh-002dremote-002b7b22686f73744e616d65223a22506f65227d.vscode-resource.vscode-cdn.net/mnt/samssd/developments/genai-playground/language/08-laser/~/.conda/envs/genaiplayground_laser/lib/python3.11/site-packages/datasets/load.py:768)         if self.data_files is not None
--> [769](https://vscode-remote+ssh-002dremote-002b7b22686f73744e616d65223a22506f65227d.vscode-resource.vscode-cdn.net/mnt/samssd/developments/genai-playground/language/08-laser/~/.conda/envs/genaiplayground_laser/lib/python3.11/site-packages/datasets/load.py:769)         else get_data_patterns_in_dataset_repository(hfh_dataset_info, self.data_dir)
    [770](https://vscode-remote+ssh-002dremote-002b7b22686f73744e616d65223a22506f65227d.vscode-resource.vscode-cdn.net/mnt/samssd/developments/genai-playground/language/08-laser/~/.conda/envs/genaiplayground_laser/lib/python3.11/site-packages/datasets/load.py:770)     )
    [771](https://vscode-remote+ssh-002dremote-002b7b22686f73744e616d65223a22506f65227d.vscode-resource.vscode-cdn.net/mnt/samssd/developments/genai-playground/language/08-laser/~/.conda/envs/genaiplayground_laser/lib/python3.11/site-packages/datasets/load.py:771)     data_files = DataFilesDict.from_hf_repo(
    [772](https://vscode-remote+ssh-002dremote-002b7b22686f73744e616d65223a22506f65227d.vscode-resource.vscode-cdn.net/mnt/samssd/developments/genai-playground/language/08-laser/~/.conda/envs/genaiplayground_laser/lib/python3.11/site-packages/datasets/load.py:772)         patterns,
    [773](https://vscode-remote+ssh-002dremote-002b7b22686f73744e616d65223a22506f65227d.vscode-resource.vscode-cdn.net/mnt/samssd/developments/genai-playground/language/08-laser/~/.conda/envs/genaiplayground_laser/lib/python3.11/site-packages/datasets/load.py:773)         dataset_info=hfh_dataset_info,
    [774](https://vscode-remote+ssh-002dremote-002b7b22686f73744e616d65223a22506f65227d.vscode-resource.vscode-cdn.net/mnt/samssd/developments/genai-playground/language/08-laser/~/.conda/envs/genaiplayground_laser/lib/python3.11/site-packages/datasets/load.py:774)         base_path=self.data_dir,
    [775](https://vscode-remote+ssh-002dremote-002b7b22686f73744e616d65223a22506f65227d.vscode-resource.vscode-cdn.net/mnt/samssd/developments/genai-playground/language/08-laser/~/.conda/envs/genaiplayground_laser/lib/python3.11/site-packages/datasets/load.py:775)         allowed_extensions=ALL_ALLOWED_EXTENSIONS,
    [776](https://vscode-remote+ssh-002dremote-002b7b22686f73744e616d65223a22506f65227d.vscode-resource.vscode-cdn.net/mnt/samssd/developments/genai-playground/language/08-laser/~/.conda/envs/genaiplayground_laser/lib/python3.11/site-packages/datasets/load.py:776)     )
    [777](https://vscode-remote+ssh-002dremote-002b7b22686f73744e616d65223a22506f65227d.vscode-resource.vscode-cdn.net/mnt/samssd/developments/genai-playground/language/08-laser/~/.conda/envs/genaiplayground_laser/lib/python3.11/site-packages/datasets/load.py:777)     split_modules = {
    [778](https://vscode-remote+ssh-002dremote-002b7b22686f73744e616d65223a22506f65227d.vscode-resource.vscode-cdn.net/mnt/samssd/developments/genai-playground/language/08-laser/~/.conda/envs/genaiplayground_laser/lib/python3.11/site-packages/datasets/load.py:778)         split: infer_module_for_data_files(data_files_list, use_auth_token=self.download_config.use_auth_token)
    [779](https://vscode-remote+ssh-002dremote-002b7b22686f73744e616d65223a22506f65227d.vscode-resource.vscode-cdn.net/mnt/samssd/developments/genai-playground/language/08-laser/~/.conda/envs/genaiplayground_laser/lib/python3.11/site-packages/datasets/load.py:779)         for split, data_files_list in data_files.items()
    [780](https://vscode-remote+ssh-002dremote-002b7b22686f73744e616d65223a22506f65227d.vscode-resource.vscode-cdn.net/mnt/samssd/developments/genai-playground/language/08-laser/~/.conda/envs/genaiplayground_laser/lib/python3.11/site-packages/datasets/load.py:780)     }

File [~/.conda/envs/genaiplayground_laser/lib/python3.11/site-packages/datasets/data_files.py:662](https://vscode-remote+ssh-002dremote-002b7b22686f73744e616d65223a22506f65227d.vscode-resource.vscode-cdn.net/mnt/samssd/developments/genai-playground/language/08-laser/~/.conda/envs/genaiplayground_laser/lib/python3.11/site-packages/datasets/data_files.py:662), in get_data_patterns_in_dataset_repository(dataset_info, base_path)
    [660](https://vscode-remote+ssh-002dremote-002b7b22686f73744e616d65223a22506f65227d.vscode-resource.vscode-cdn.net/mnt/samssd/developments/genai-playground/language/08-laser/~/.conda/envs/genaiplayground_laser/lib/python3.11/site-packages/datasets/data_files.py:660) resolver = partial(_resolve_single_pattern_in_dataset_repository, dataset_info, base_path=base_path)
    [661](https://vscode-remote+ssh-002dremote-002b7b22686f73744e616d65223a22506f65227d.vscode-resource.vscode-cdn.net/mnt/samssd/developments/genai-playground/language/08-laser/~/.conda/envs/genaiplayground_laser/lib/python3.11/site-packages/datasets/data_files.py:661) try:
--> [662](https://vscode-remote+ssh-002dremote-002b7b22686f73744e616d65223a22506f65227d.vscode-resource.vscode-cdn.net/mnt/samssd/developments/genai-playground/language/08-laser/~/.conda/envs/genaiplayground_laser/lib/python3.11/site-packages/datasets/data_files.py:662)     return _get_data_files_patterns(resolver)
    [663](https://vscode-remote+ssh-002dremote-002b7b22686f73744e616d65223a22506f65227d.vscode-resource.vscode-cdn.net/mnt/samssd/developments/genai-playground/language/08-laser/~/.conda/envs/genaiplayground_laser/lib/python3.11/site-packages/datasets/data_files.py:663) except FileNotFoundError:
    [664](https://vscode-remote+ssh-002dremote-002b7b22686f73744e616d65223a22506f65227d.vscode-resource.vscode-cdn.net/mnt/samssd/developments/genai-playground/language/08-laser/~/.conda/envs/genaiplayground_laser/lib/python3.11/site-packages/datasets/data_files.py:664)     raise EmptyDatasetError(
    [665](https://vscode-remote+ssh-002dremote-002b7b22686f73744e616d65223a22506f65227d.vscode-resource.vscode-cdn.net/mnt/samssd/developments/genai-playground/language/08-laser/~/.conda/envs/genaiplayground_laser/lib/python3.11/site-packages/datasets/data_files.py:665)         f"The dataset repository at '{dataset_info.id}' doesn't contain any data files"
    [666](https://vscode-remote+ssh-002dremote-002b7b22686f73744e616d65223a22506f65227d.vscode-resource.vscode-cdn.net/mnt/samssd/developments/genai-playground/language/08-laser/~/.conda/envs/genaiplayground_laser/lib/python3.11/site-packages/datasets/data_files.py:666)     ) from None

File [~/.conda/envs/genaiplayground_laser/lib/python3.11/site-packages/datasets/data_files.py:223](https://vscode-remote+ssh-002dremote-002b7b22686f73744e616d65223a22506f65227d.vscode-resource.vscode-cdn.net/mnt/samssd/developments/genai-playground/language/08-laser/~/.conda/envs/genaiplayground_laser/lib/python3.11/site-packages/datasets/data_files.py:223), in _get_data_files_patterns(pattern_resolver)
    [221](https://vscode-remote+ssh-002dremote-002b7b22686f73744e616d65223a22506f65227d.vscode-resource.vscode-cdn.net/mnt/samssd/developments/genai-playground/language/08-laser/~/.conda/envs/genaiplayground_laser/lib/python3.11/site-packages/datasets/data_files.py:221) try:
    [222](https://vscode-remote+ssh-002dremote-002b7b22686f73744e616d65223a22506f65227d.vscode-resource.vscode-cdn.net/mnt/samssd/developments/genai-playground/language/08-laser/~/.conda/envs/genaiplayground_laser/lib/python3.11/site-packages/datasets/data_files.py:222)     for pattern in patterns:
--> [223](https://vscode-remote+ssh-002dremote-002b7b22686f73744e616d65223a22506f65227d.vscode-resource.vscode-cdn.net/mnt/samssd/developments/genai-playground/language/08-laser/~/.conda/envs/genaiplayground_laser/lib/python3.11/site-packages/datasets/data_files.py:223)         data_files = pattern_resolver(pattern)
    [224](https://vscode-remote+ssh-002dremote-002b7b22686f73744e616d65223a22506f65227d.vscode-resource.vscode-cdn.net/mnt/samssd/developments/genai-playground/language/08-laser/~/.conda/envs/genaiplayground_laser/lib/python3.11/site-packages/datasets/data_files.py:224)         if len(data_files) > 0:
    [225](https://vscode-remote+ssh-002dremote-002b7b22686f73744e616d65223a22506f65227d.vscode-resource.vscode-cdn.net/mnt/samssd/developments/genai-playground/language/08-laser/~/.conda/envs/genaiplayground_laser/lib/python3.11/site-packages/datasets/data_files.py:225)             non_empty_splits.append(split)

File [~/.conda/envs/genaiplayground_laser/lib/python3.11/site-packages/datasets/data_files.py:473](https://vscode-remote+ssh-002dremote-002b7b22686f73744e616d65223a22506f65227d.vscode-resource.vscode-cdn.net/mnt/samssd/developments/genai-playground/language/08-laser/~/.conda/envs/genaiplayground_laser/lib/python3.11/site-packages/datasets/data_files.py:473), in _resolve_single_pattern_in_dataset_repository(dataset_info, pattern, base_path, allowed_extensions)
    [471](https://vscode-remote+ssh-002dremote-002b7b22686f73744e616d65223a22506f65227d.vscode-resource.vscode-cdn.net/mnt/samssd/developments/genai-playground/language/08-laser/~/.conda/envs/genaiplayground_laser/lib/python3.11/site-packages/datasets/data_files.py:471) else:
    [472](https://vscode-remote+ssh-002dremote-002b7b22686f73744e616d65223a22506f65227d.vscode-resource.vscode-cdn.net/mnt/samssd/developments/genai-playground/language/08-laser/~/.conda/envs/genaiplayground_laser/lib/python3.11/site-packages/datasets/data_files.py:472)     base_path = "/"
--> [473](https://vscode-remote+ssh-002dremote-002b7b22686f73744e616d65223a22506f65227d.vscode-resource.vscode-cdn.net/mnt/samssd/developments/genai-playground/language/08-laser/~/.conda/envs/genaiplayground_laser/lib/python3.11/site-packages/datasets/data_files.py:473) glob_iter = [PurePath(filepath) for filepath in fs.glob(PurePath(pattern).as_posix()) if fs.isfile(filepath)]
    [474](https://vscode-remote+ssh-002dremote-002b7b22686f73744e616d65223a22506f65227d.vscode-resource.vscode-cdn.net/mnt/samssd/developments/genai-playground/language/08-laser/~/.conda/envs/genaiplayground_laser/lib/python3.11/site-packages/datasets/data_files.py:474) matched_paths = [
    [475](https://vscode-remote+ssh-002dremote-002b7b22686f73744e616d65223a22506f65227d.vscode-resource.vscode-cdn.net/mnt/samssd/developments/genai-playground/language/08-laser/~/.conda/envs/genaiplayground_laser/lib/python3.11/site-packages/datasets/data_files.py:475)     filepath
    [476](https://vscode-remote+ssh-002dremote-002b7b22686f73744e616d65223a22506f65227d.vscode-resource.vscode-cdn.net/mnt/samssd/developments/genai-playground/language/08-laser/~/.conda/envs/genaiplayground_laser/lib/python3.11/site-packages/datasets/data_files.py:476)     for filepath in glob_iter
   (...)
    [483](https://vscode-remote+ssh-002dremote-002b7b22686f73744e616d65223a22506f65227d.vscode-resource.vscode-cdn.net/mnt/samssd/developments/genai-playground/language/08-laser/~/.conda/envs/genaiplayground_laser/lib/python3.11/site-packages/datasets/data_files.py:483)     )
    [484](https://vscode-remote+ssh-002dremote-002b7b22686f73744e616d65223a22506f65227d.vscode-resource.vscode-cdn.net/mnt/samssd/developments/genai-playground/language/08-laser/~/.conda/envs/genaiplayground_laser/lib/python3.11/site-packages/datasets/data_files.py:484) ]  # ignore .ipynb and __pycache__, but keep /../
    [485](https://vscode-remote+ssh-002dremote-002b7b22686f73744e616d65223a22506f65227d.vscode-resource.vscode-cdn.net/mnt/samssd/developments/genai-playground/language/08-laser/~/.conda/envs/genaiplayground_laser/lib/python3.11/site-packages/datasets/data_files.py:485) if allowed_extensions is not None:

File [~/.conda/envs/genaiplayground_laser/lib/python3.11/site-packages/fsspec/spec.py:606](https://vscode-remote+ssh-002dremote-002b7b22686f73744e616d65223a22506f65227d.vscode-resource.vscode-cdn.net/mnt/samssd/developments/genai-playground/language/08-laser/~/.conda/envs/genaiplayground_laser/lib/python3.11/site-packages/fsspec/spec.py:606), in AbstractFileSystem.glob(self, path, maxdepth, **kwargs)
    [602](https://vscode-remote+ssh-002dremote-002b7b22686f73744e616d65223a22506f65227d.vscode-resource.vscode-cdn.net/mnt/samssd/developments/genai-playground/language/08-laser/~/.conda/envs/genaiplayground_laser/lib/python3.11/site-packages/fsspec/spec.py:602)         depth = None
    [604](https://vscode-remote+ssh-002dremote-002b7b22686f73744e616d65223a22506f65227d.vscode-resource.vscode-cdn.net/mnt/samssd/developments/genai-playground/language/08-laser/~/.conda/envs/genaiplayground_laser/lib/python3.11/site-packages/fsspec/spec.py:604) allpaths = self.find(root, maxdepth=depth, withdirs=True, detail=True, **kwargs)
--> [606](https://vscode-remote+ssh-002dremote-002b7b22686f73744e616d65223a22506f65227d.vscode-resource.vscode-cdn.net/mnt/samssd/developments/genai-playground/language/08-laser/~/.conda/envs/genaiplayground_laser/lib/python3.11/site-packages/fsspec/spec.py:606) pattern = glob_translate(path + ("/" if ends_with_sep else ""))
    [607](https://vscode-remote+ssh-002dremote-002b7b22686f73744e616d65223a22506f65227d.vscode-resource.vscode-cdn.net/mnt/samssd/developments/genai-playground/language/08-laser/~/.conda/envs/genaiplayground_laser/lib/python3.11/site-packages/fsspec/spec.py:607) pattern = re.compile(pattern)
    [609](https://vscode-remote+ssh-002dremote-002b7b22686f73744e616d65223a22506f65227d.vscode-resource.vscode-cdn.net/mnt/samssd/developments/genai-playground/language/08-laser/~/.conda/envs/genaiplayground_laser/lib/python3.11/site-packages/fsspec/spec.py:609) out = {
    [610](https://vscode-remote+ssh-002dremote-002b7b22686f73744e616d65223a22506f65227d.vscode-resource.vscode-cdn.net/mnt/samssd/developments/genai-playground/language/08-laser/~/.conda/envs/genaiplayground_laser/lib/python3.11/site-packages/fsspec/spec.py:610)     p: info
    [611](https://vscode-remote+ssh-002dremote-002b7b22686f73744e616d65223a22506f65227d.vscode-resource.vscode-cdn.net/mnt/samssd/developments/genai-playground/language/08-laser/~/.conda/envs/genaiplayground_laser/lib/python3.11/site-packages/fsspec/spec.py:611)     for p, info in sorted(allpaths.items())
   (...)
    [618](https://vscode-remote+ssh-002dremote-002b7b22686f73744e616d65223a22506f65227d.vscode-resource.vscode-cdn.net/mnt/samssd/developments/genai-playground/language/08-laser/~/.conda/envs/genaiplayground_laser/lib/python3.11/site-packages/fsspec/spec.py:618)     )
    [619](https://vscode-remote+ssh-002dremote-002b7b22686f73744e616d65223a22506f65227d.vscode-resource.vscode-cdn.net/mnt/samssd/developments/genai-playground/language/08-laser/~/.conda/envs/genaiplayground_laser/lib/python3.11/site-packages/fsspec/spec.py:619) }

File [~/.conda/envs/genaiplayground_laser/lib/python3.11/site-packages/fsspec/utils.py:734](https://vscode-remote+ssh-002dremote-002b7b22686f73744e616d65223a22506f65227d.vscode-resource.vscode-cdn.net/mnt/samssd/developments/genai-playground/language/08-laser/~/.conda/envs/genaiplayground_laser/lib/python3.11/site-packages/fsspec/utils.py:734), in glob_translate(pat)
    [732](https://vscode-remote+ssh-002dremote-002b7b22686f73744e616d65223a22506f65227d.vscode-resource.vscode-cdn.net/mnt/samssd/developments/genai-playground/language/08-laser/~/.conda/envs/genaiplayground_laser/lib/python3.11/site-packages/fsspec/utils.py:732)     continue
    [733](https://vscode-remote+ssh-002dremote-002b7b22686f73744e616d65223a22506f65227d.vscode-resource.vscode-cdn.net/mnt/samssd/developments/genai-playground/language/08-laser/~/.conda/envs/genaiplayground_laser/lib/python3.11/site-packages/fsspec/utils.py:733) elif "**" in part:
--> [734](https://vscode-remote+ssh-002dremote-002b7b22686f73744e616d65223a22506f65227d.vscode-resource.vscode-cdn.net/mnt/samssd/developments/genai-playground/language/08-laser/~/.conda/envs/genaiplayground_laser/lib/python3.11/site-packages/fsspec/utils.py:734)     raise ValueError(
    [735](https://vscode-remote+ssh-002dremote-002b7b22686f73744e616d65223a22506f65227d.vscode-resource.vscode-cdn.net/mnt/samssd/developments/genai-playground/language/08-laser/~/.conda/envs/genaiplayground_laser/lib/python3.11/site-packages/fsspec/utils.py:735)         "Invalid pattern: '**' can only be an entire path component"
    [736](https://vscode-remote+ssh-002dremote-002b7b22686f73744e616d65223a22506f65227d.vscode-resource.vscode-cdn.net/mnt/samssd/developments/genai-playground/language/08-laser/~/.conda/envs/genaiplayground_laser/lib/python3.11/site-packages/fsspec/utils.py:736)     )
    [737](https://vscode-remote+ssh-002dremote-002b7b22686f73744e616d65223a22506f65227d.vscode-resource.vscode-cdn.net/mnt/samssd/developments/genai-playground/language/08-laser/~/.conda/envs/genaiplayground_laser/lib/python3.11/site-packages/fsspec/utils.py:737) if part:
    [738](https://vscode-remote+ssh-002dremote-002b7b22686f73744e616d65223a22506f65227d.vscode-resource.vscode-cdn.net/mnt/samssd/developments/genai-playground/language/08-laser/~/.conda/envs/genaiplayground_laser/lib/python3.11/site-packages/fsspec/utils.py:738)     results.extend(_translate(part, f"{not_sep}*", not_sep))

ValueError: Invalid pattern: '**' can only be an entire path component
fernando-neto-ai commented 2 months ago

Hi! sorry for the delayed response. Can you send a copy of your environment to try to reproduce it? Btw, could you try it again with the newer versions?