Open michaelbenayoun opened 2 months ago
Thank for the fix. I tried the fix and I dont see above errors anymore which is a great. But I encounter a new error now as below.
No input shapes provided, using default shapes, {'batch_size': 1, 'sequence_length': 128}
_______________________________________________ test_export_no_parameters[feature-extraction-hf-internal-testing/tiny-random-XLMModel] _______________________________________________
self = <optimum.neuron.utils.hub_neuronx_cache.CompileCacheHfProxy object at 0x7f0d8009f850>, repo_id = 'optimum-internal-testing/optimum-neuron-cache-for-testing'
default_cache = <libneuronxla.neuron_cc_cache.CompileCacheFs object at 0x7f0f393d7c70>, endpoint = None, token = None
def __init__(
self, repo_id: str, default_cache: CompileCache, endpoint: Optional[str] = None, token: Optional[str] = None
):
# Initialize the proxy cache as expected by the parent class
super().__init__(default_cache.cache_url)
self.cache_path = default_cache.cache_path
# Initialize specific members
self.default_cache = default_cache
self.api = HfApi(endpoint=endpoint, token=token, library_name="optimum-neuron", library_version=__version__)
# Check if the HF cache id is valid
try:
if not self.api.repo_exists(repo_id):
> raise ValueError(f"The {repo_id} repository does not exist or you don't have access to it.")
E ValueError: The optimum-internal-testing/optimum-neuron-cache-for-testing repository does not exist or you don't have access to it.
optimum/neuron/utils/hub_neuronx_cache.py:116: ValueError
This issue has been automatically marked as stale because it has not had recent activity. If you think this still needs to be addressed please comment on this thread. Thank you!
That is because you do not have access to this repo, and this is the one used by default for the test. To be able to run the test on your side:
CUSTOM_CACHE_REPO=the-name-of-your-model-repo
HF_TOKEN=your-hf-token-that-provides-access-to-the-repo
This issue has been automatically marked as stale because it has not had recent activity. If you think this still needs to be addressed please comment on this thread. Thank you!
What does this PR do?
As per title. Fixes: #571