Handling http 429, error on multiple files uploads

[alexbourret]

[sc-86553]

[shortcut-integration[bot]]

This pull request has been linked to Shortcut Story #86553: 429 error on upload of multiple files on SP online.

[JaneBellaiche]

Recipe script finished successfully, the retries of 503 requests has been done correctly. But there is an error at the folder opening :

/data/home/abourret/dss/dataiku-dss-10.0.7/python/dataiku/fsprovider/server.py:61: DeprecationWarning: inspect.getargspec() is deprecated since Python 3.0, use inspect.signature() or inspect.getfullargspec()
  arg_count = len(inspect.getargspec(clazz.__init__).args)
sharepoint-online plugin INFO - SharePoint Online plugin fs v1.0.10
sharepoint-online plugin INFO - init:root=BLANK/TvMJIbFj
sharepoint-online plugin INFO - Init RobustSession
sharepoint-online plugin INFO - sharepoint-online plugin - SharePointClient:sharepoint_oauth
sharepoint-online plugin INFO - sharepoint-online plugin - SharePointClient:sharepoint_site=sites/dssplugin
sharepoint-online plugin INFO - sharepoint-online plugin - SharePointClient:sharepoint_root=Shared Documents
sharepoint-online plugin INFO - sharepoint-online plugin - SharePointClient:sharepoint_tenant=ikuiku, url=ikuiku.sharepoint.com, origin=https://ikuiku.sharepoint.com
sharepoint-online plugin INFO - sharepoint-online plugin - Getting form digest value
sharepoint-online plugin INFO - Init RobustSession
sharepoint-online plugin INFO - RobustSession:retry:attempt <function post at 0x7ff1f55ace18> #1
sharepoint-online plugin INFO - RobustSession:retry:Response=<Response [200]>
sharepoint-online plugin INFO - sharepoint-online plugin - Form digest value 0x500C2A0066FFA1E687EA7BEECDEEE7D72219CDC099FC66A75C026960538264850592DFAF7DC74EDF4CDB69FFD97C1184C13088755E4CF049429C128B927A094A,10 Jun 2022 15:05:50 -0000
sharepoint-online plugin INFO - browse:path="folder", full_path="/BLANK/TvMJIbFj/folder"
sharepoint-online plugin INFO - RobustSession:retry:attempt <bound method SharePointSession.get of <sharepoint_client.SharePointSession object at 0x7ff1f4d1f828>> #1
sharepoint-online plugin INFO - RobustSession:retry:Response=<Response [500]>
sharepoint-online plugin ERROR - sharepoint-online plugin - Error 500 in method get_folders
Traceback (most recent call last):
  File "/data/home/abourret/dss/dataiku-dss-10.0.7/python/dataiku/fsprovider/server.py", line 84, in serve
    closed, response = handle_request(request, fsprovider, closed)
  File "/data/home/abourret/dss/dataiku-dss-10.0.7/python/dataiku/fsprovider/server.py", line 24, in handle_request
    response = fsprovider.browse(request.get('path', '/'))
  File "/tmp/tmp_folder_hWQvPwim/dku_code.py", line 96, in browse
  File "/data/home/abourret/dss/home_10/plugins/dev/sharepoint-online/python-lib/sharepoint_client.py", line 146, in get_folders
    self.assert_response_ok(response, calling_method="get_folders")
  File "/data/home/abourret/dss/home_10/plugins/dev/sharepoint-online/python-lib/sharepoint_client.py", line 701, in assert_response_ok
    raise SharePointClientError("Error ({}): {}".format(calling_method, enriched_error_message))
sharepoint_client.SharePointClientError: Error (get_folders): The attempted operation is prohibited because it exceeds the list view threshold.
sharepoint-online plugin INFO - Client closed