File upload failed even after retry

jeffschwMSFT commented 9 months ago

Build

https://dev.azure.com/dnceng/internal/_build/results?buildId=2365835

Error:

Fail to upload '/mnt/vss/_work/1/a/IntermediateArtifacts/MonoRuntimePacks/Shipping/Microsoft.NETCore.App.Ref.9.0.0-preview.2.24080.4.symbols.nupkg' due to 'Bad Request'.
Microsoft.VisualStudio.Services.WebApi.VssServiceResponseException: Bad Request
   at Microsoft.VisualStudio.Services.WebApi.VssHttpClientBase.HandleResponseAsync(HttpResponseMessage response, CancellationToken cancellationToken)
   at Microsoft.VisualStudio.Services.WebApi.VssHttpClientBase.SendAsync(HttpRequestMessage message, HttpCompletionOption completionOption, Object userState, CancellationToken cancellationToken)
   at Microsoft.VisualStudio.Services.FileContainer.Client.FileContainerHttpClient.UploadFileAsync(Int64 containerId, String itemPath, Stream fileStream, Byte[] contentId, Int64 fileLength, Boolean isGzipped, Guid scopeIdentifier, CancellationToken cancellationToken, Int32 chunkSize, Int32 chunkRetryTimes, Boolean uploadFirstChunk, Object userState)
   at Microsoft.VisualStudio.Services.FileContainer.Client.FileContainerHttpClient.UploadFileAsync(Int64 containerId, String itemPath, Stream fileStream, Guid scopeIdentifier, CancellationToken cancellationToken, Int32 chunkSize, Boolean uploadFirstChunk, Object userState, Boolean compressStream)
   at Microsoft.VisualStudio.Services.Agent.Worker.Build.FileContainerServer.UploadAsync(IAsyncCommandContext context, Int32 uploaderId, CancellationToken token) in /home/vsts/work/1/s/src/Agent.Worker/Build/FileContainerServer.cs:line 250
Detail upload trace for file that fail to upload: IntermediateArtifacts/MonoRuntimePacks/Shipping/Microsoft.NETCore.App.Ref.9.0.0-preview.2.24080.4.symbols.nupkg

Chunk '2' attempt '1' of file 'IntermediateArtifacts/MonoRuntimePacks/Shipping/Microsoft.NETCore.App.Ref.9.0.0-preview.2.24080.4.symbols.nupkg' fail to send request to server. Error: Microsoft.VisualStudio.Services.Common.VssServiceException: TF203009: The size of the file that you uploaded does not match the size that the client computer provided.
   at Microsoft.VisualStudio.Services.WebApi.VssHttpClientBase.HandleResponseAsync(HttpResponseMessage response, CancellationToken cancellationToken)
   at Microsoft.VisualStudio.Services.WebApi.VssHttpClientBase.SendAsync(HttpRequestMessage message, HttpCompletionOption completionOption, Object userState, CancellationToken cancellationToken)
   at Microsoft.VisualStudio.Services.FileContainer.Client.FileContainerHttpClient.UploadFileAsync(Int64 containerId, String itemPath, Stream fileStream, Byte[] contentId, Int64 fileLength, Boolean isGzipped, Guid scopeIdentifier, CancellationToken cancellationToken, Int32 chunkSize, Int32 chunkRetryTimes, Boolean uploadFirstChunk, Object userState).

##[error]File upload failed even after retry.

Build leg reported

No response

Pull Request

No response

Known issue core information

Fill out the known issue JSON section by following the step by step documentation on how to create a known issue

 {
    "ErrorMessage" : "##[error]File upload failed even after retry",
    "BuildRetry": false,
    "ExcludeConsoleLog": false
 }

@dotnet/dnceng

Release Note Category

[ ] Feature changes/additions
[ ] Bug fixes
[ ] Internal Infrastructure Improvements
Release Note Description

Additional information about the issue reported

No response

Report

Build	Definition	Step Name	Console log	Pull Request
2575423	dotnet-runtime	🔒 Publish intermediate artifacts	Log
2575262	dotnet-runtime	🔒 Publish intermediate artifacts	Log
2575057	dotnet-runtime	🔒 Publish intermediate artifacts	Log
2571829	dotnet-runtime	🔒 Publish intermediate artifacts	Log
2569879	dotnet-winforms	Pack, Sign, and Publish	Log
2568336	dotnet-runtime	🔒 Publish intermediate artifacts	Log
2568205	dotnet-runtime	🔒 Publish intermediate artifacts	Log
2568045	dotnet-runtime	🔒 Publish intermediate artifacts	Log
2566528	dotnet-runtime	🔒 Publish intermediate artifacts	Log
2566517	dotnet-runtime	🔒 Publish intermediate artifacts	Log
2565858	dotnet-runtime	🔒 Publish intermediate artifacts	Log
2565754	dotnet-runtime	🔒 Publish intermediate artifacts	Log
2565694	dotnet-runtime	🔒 Publish intermediate artifacts	Log
2565672	dotnet-runtime	🔒 Publish intermediate artifacts	Log
2564285	dotnet-runtime	🔒 Publish intermediate artifacts	Log
2564273	dotnet-runtime	🔒 Publish intermediate artifacts	Log
2563217	dotnet-runtime	🔒 Publish intermediate artifacts	Log
2562281	dotnet-runtime	🔒 Publish intermediate artifacts	Log
2560644	dotnet-runtime	🔒 Publish intermediate artifacts	Log
2560449	dotnet-runtime	🔒 Publish intermediate artifacts	Log
2560241	dotnet-runtime	🔒 Publish intermediate artifacts	Log
2558406	dotnet-runtime	🔒 Publish intermediate artifacts	Log
839764	dotnet/runtime	Publish Test Assets	Log	dotnet/runtime#107828
2557767	dotnet-runtime	🔒 Publish intermediate artifacts	Log
2555434	dotnet-runtime	🔒 Publish intermediate artifacts	Log
2555043	dotnet-runtime	🔒 Publish intermediate artifacts	Log

Summary

24-Hour Hit Count	7-Day Hit Count	1-Month Count
3	4	26

Known issue validation

Build: :mag_right: https://dev.azure.com/dnceng/internal/_build/results?buildId=2365835 Error message validated: [##[error]File upload failed even after retry] Result validation: :white_check_mark: Known issue matched with the provided build. Validation performed at: 2/7/2024 2:03:27 AM UTC

lewing commented 8 months ago

This is often an from multiple lanes attempting to upload the same artifact

markwilkie commented 7 months ago

@lewing is right - there's usually not a whole lot dnceng can do to help.

dotnet / dnceng