huggingface / optimum-neuron

Easy, fast and very cheap training and inference on AWS Trainium and Inferentia chips.
Apache License 2.0
176 stars 51 forks source link

Fixes `test_examples.py` tests collection #578

Open michaelbenayoun opened 2 months ago

michaelbenayoun commented 2 months ago

What does this PR do?

As per title. Fixes: #571

musunita commented 2 months ago

Thank for the fix. I tried the fix and I dont see above errors anymore which is a great. But I encounter a new error now as below.

No input shapes provided, using default shapes, {'batch_size': 1, 'sequence_length': 128}
_______________________________________________ test_export_no_parameters[feature-extraction-hf-internal-testing/tiny-random-XLMModel] _______________________________________________

self = <optimum.neuron.utils.hub_neuronx_cache.CompileCacheHfProxy object at 0x7f0d8009f850>, repo_id = 'optimum-internal-testing/optimum-neuron-cache-for-testing'
default_cache = <libneuronxla.neuron_cc_cache.CompileCacheFs object at 0x7f0f393d7c70>, endpoint = None, token = None

    def __init__(
        self, repo_id: str, default_cache: CompileCache, endpoint: Optional[str] = None, token: Optional[str] = None
    ):
        # Initialize the proxy cache as expected by the parent class
        super().__init__(default_cache.cache_url)
        self.cache_path = default_cache.cache_path
        # Initialize specific members
        self.default_cache = default_cache
        self.api = HfApi(endpoint=endpoint, token=token, library_name="optimum-neuron", library_version=__version__)
        # Check if the HF cache id is valid
        try:
            if not self.api.repo_exists(repo_id):
>               raise ValueError(f"The {repo_id} repository does not exist or you don't have access to it.")
E               ValueError: The optimum-internal-testing/optimum-neuron-cache-for-testing repository does not exist or you don't have access to it.

optimum/neuron/utils/hub_neuronx_cache.py:116: ValueError
HuggingFaceDocBuilderDev commented 1 month ago

This issue has been automatically marked as stale because it has not had recent activity. If you think this still needs to be addressed please comment on this thread. Thank you!

michaelbenayoun commented 1 month ago

That is because you do not have access to this repo, and this is the one used by default for the test. To be able to run the test on your side:

HuggingFaceDocBuilderDev commented 1 week ago

This issue has been automatically marked as stale because it has not had recent activity. If you think this still needs to be addressed please comment on this thread. Thank you!