Kaggle / kaggle-api

Official Kaggle API
Apache License 2.0
6.01k stars 1.06k forks source link

competition_list_files returns incomplete list of competition files #511

Open sergii-bond opened 8 months ago

sergii-bond commented 8 months ago

I wanted to list the files for the competition called "UBC-OCEAN", https://www.kaggle.com/competitions/UBC-OCEAN/data. Here is a simple code:

import os
from kaggle.api.kaggle_api_extended import KaggleApi
import csv

api = KaggleApi()
api.authenticate()

res_list = api.competition_list_files("UBC-OCEAN")
print(len(res_list))

I got 45 items in the list, but the web page shows it has 1056 files.

The same result is obtained by running the cmd line kaggle competitions files "UBC-OCEAN".

kaggle pip version 1.5.16.

Nuisal commented 7 months ago

I have the same problem. I got 46 items in the list. kaggle-api version 1.5.16. Here is my file list. [test_thumbnails/41_thumbnail.png, test_images/41.png, train_images/10246.png, train_images/10800.png, train_images/11557.png, train_images/10252.png, train_images/12159.png, train_images/11431.png, train_images/1101.png, train_images/11263.png, train_images/10896.png, train_images/10642.png, train_images/10143.png, train_images/1080.png, train_images/10077.png, train_images/11559.png, train_images/11417.png, train_images/12244.png, train_images/12222.png, train_images/10548.png, train_images/1020.png, train_images/10469.png, train_thumbnails/10246_thumbnail.png, train_thumbnails/12159_thumbnail.png, train_thumbnails/10077_thumbnail.png, train_thumbnails/1080_thumbnail.png, train_thumbnails/12244_thumbnail.png, train_thumbnails/10252_thumbnail.png, train_thumbnails/11431_thumbnail.png, train_thumbnails/10143_thumbnail.png, train_thumbnails/11557_thumbnail.png, train_thumbnails/1020_thumbnail.png, train_thumbnails/1101_thumbnail.png, train_thumbnails/10469_thumbnail.png, train_thumbnails/10642_thumbnail.png, train_thumbnails/10896_thumbnail.png, train_thumbnails/11417_thumbnail.png, train_thumbnails/10800_thumbnail.png, train_thumbnails/11559_thumbnail.png, train_thumbnails/12222_thumbnail.png, train_thumbnails/10548_thumbnail.png, train_thumbnails/11263_thumbnail.png, test.csv, updated_image_ids.json, train.csv, sample_submission.csv]

batubb commented 3 weeks ago

This api is now paginated, see for the PR: https://github.com/Kaggle/kaggle-api/pull/572