search

microsoft / artifacts-credprovider

The Azure Artifacts Credential Provider enables dotnet, NuGet.exe, and MSBuild to interactively acquire credentials for Azure Artifacts feeds.
MIT License
785 stars 706 forks source link

error NU1301: Unable to load the service index for source Failed to restore (in 6.21 sec). #531

Open UriZafrir opened 3 days ago

UriZafrir commented 3 days ago

Describe the bug

posted here also https://github.com/dotnet/dotnet-docker/issues/6046#issue-2652208048, ive seen them pointing to this repo, so i post here also.

in on prem Azure Devops, using azure artifacts, i try to run dotnet restore in a docker container. It results in the error below. When running on the linux hosting the container, it works. Image

error NU1301: Unable to load the service index for source 
  Failed to restore  (in 6.21 sec).

The error:

root@d553c5d80b84:/src/Common# dotnet add package curl
  Determining projects to restore...
  Writing /tmp/tmpXB2IXF.tmp
info : X.509 certificate chain validation will use the fallback certificate bundle at '/usr/share/dotnet/sdk/8.0.403/trustedroots/codesignctl.pem'.
info : X.509 certificate chain validation will use the fallback certificate bundle at '/usr/share/dotnet/sdk/8.0.403/trustedroots/timestampctl.pem'.
info : Adding PackageReference for package 'curl' into project '/src/Common/Common.csproj'.
error: Unable to load the service index for source https://<url>/<etc>/_packaging/feed/nuget/v3/index.json.
error:   The SSL connection could not be established, see inner exception.
error:   The remote certificate is invalid because of errors in the certificate chain: PartialChain

I've tried supplying the credentials in three ways, one is using commands, the other using a nuget.config file, the third with VSS_NUGET_EXTERNAL_FEED_ENDPOINTS, all fail:

dotnet nuget add source -name feed dotnet nuget update source feed --valid-authentication-types basic --username "feed" --password xxxxx --store-password-in-clear-text dotnet nuget list source

 dotnet nuget list source
Registered Sources:
  1.  <feed>-feed [Enabled]
      <url>/feed/nuget/v3/index.json
<?xml version="1.0" encoding="utf-8"?>
<configuration>
  <packageSources>
    <clear />
    <add key="feed" value="<url>/feed/nuget/v3/index.json" />
  </packageSources>
  <packageSourceCredentials>
    <feed>
      <add key="Username" value="feed" />
      <add key="ClearTextPassword" value="xxxxxxxxxxxx" />
    </feed>
  </packageSourceCredentials>
</configuration>
export VSS_NUGET_EXTERNAL_FEED_ENDPOINTS="{\"endpointCredentials\": [{\"endpoint\":\"<url>/feed/nuget/v3/index.json\", \"username\":\"feed\", \"password\":\"xxxx\"}]}"
dotnet restore --configfile /root/.nuget/NuGet/NuGet.Config
  Determining projects to restore...
/src/Common.csproj : error NU1301: Unable to load the service index for source h<url>/feed/nuget/v3/index.json.

dotnet  add package nuget
  Determining projects to restore...
  Writing /tmp/tmpDytL4u.tmp
info : X.509 certificate chain validation will use the fallback certificate bundle at '/usr/share/dotnet/sdk/8.0.403/trustedroots/codesignctl.pem'.
info : X.509 certificate chain validation will use the fallback certificate bundle at '/usr/share/dotnet/sdk/8.0.403/trustedroots/timestampctl.pem'.
info : Adding PackageReference for package 'nuget' into project '/src/Common.csproj'.
error: Unable to load the service index for source <url>/feed/nuget/v3/index.json.
error:   The SSL connection could not be established, see inner exception.
error:   The remote certificate is invalid because of errors in the certificate chain: PartialChain

more details:

when i run with disableTLSCertificateValidation="true":

root@82398c569468:/src/Common# cat nuget.config
<?xml version="1.0" encoding="utf-8"?>
<configuration>
  <packageSources>
    <clear />
    <add key="feed" value="<url>/feed/nuget/v3/index.json" disableTLSCertificateValidation="true" />
  </packageSources>
</configuration>

i get

error NU1202: Package Microsoft.AspNetCore.Grpc.Swagger 0.9.0 is not compatible with net8.0 (.NETCoreApp,Version=v8.0). Package Microsoft.AspNetCore.Grpc.Swagger 0.9.0 supports: net9.0 (.NETCoreApp,Version=v9.0)
root@82398c569468:/src/Common# dotnet restore
  Determining projects to restore...
/src/Common/Common.csproj : error NU1202: Package Microsoft.AspNetCore.Grpc.Swagger 0.9.0 is not compatible with net8.0 (.NETCoreApp,Version=v8.0). Package Microsoft.AspNetCore.Grpc.Swagger 0.9.0 supports: net9.0 (.NETCoreApp,Version=v9.0)
  Failed to restore /src/Common/Common.csproj (in 8.33 min).

when i run

dotnet restore --configfile nuget.config --verbosity detailed

it just gets stuck like this:

         Assembly loaded during TaskRun (NuGet.Build.Tasks.RestoreTask): NuGet.Packaging, Version=6.11.1.2, Culture=neutral, PublicKeyToken=31bf3856ad364e35 (location: /usr/share/dotnet/sdk/8.0.403/NuGet.Packaging.dll, MVID: c3569465-2284-4cdc-80fa-53f23ad5a901, AssemblyLoadContext: MSBuild plugin /usr/share/dotnet/sdk/8.0.403/NuGet.Build.Tasks.dll)
         Assembly loaded during TaskRun (NuGet.Build.Tasks.RestoreTask): NuGet.LibraryModel, Version=6.11.1.2, Culture=neutral, PublicKeyToken=31bf3856ad364e35 (location: /usr/share/dotnet/sdk/8.0.403/NuGet.LibraryModel.dll, MVID: 9c74e240-a36b-4261-ae2d-466984d97095, AssemblyLoadContext: MSBuild plugin /usr/share/dotnet/sdk/8.0.403/NuGet.Build.Tasks.dll)
         Assembly loaded during TaskRun (NuGet.Build.Tasks.RestoreTask): NuGet.Versioning, Version=6.11.1.2, Culture=neutral, PublicKeyToken=31bf3856ad364e35 (location: /usr/share/dotnet/sdk/8.0.403/NuGet.Versioning.dll, MVID: 0ff30a8a-7983-4ede-bc2f-f9d2f526b309, AssemblyLoadContext: MSBuild plugin /usr/share/dotnet/sdk/8.0.403/NuGet.Build.Tasks.dll)
         Assembly loaded during TaskRun (NuGet.Build.Tasks.RestoreTask): NuGet.Frameworks, Version=6.11.1.2, Culture=neutral, PublicKeyToken=31bf3856ad364e35 (location: /usr/share/dotnet/sdk/8.0.403/NuGet.Frameworks.dll, MVID: 36fa17a1-abb6-4cce-b85c-dd32a6dcc45f, AssemblyLoadContext: MSBuild plugin /usr/share/dotnet/sdk/8.0.403/NuGet.Build.Tasks.dll)
         Assembly loaded during TaskRun (NuGet.Build.Tasks.RestoreTask): NuGet.Protocol, Version=6.11.1.2, Culture=neutral, PublicKeyToken=31bf3856ad364e35 (location: /usr/share/dotnet/sdk/8.0.403/NuGet.Protocol.dll, MVID: 65288774-e726-408e-8bb6-d22100f75eed, AssemblyLoadContext: MSBuild plugin /usr/share/dotnet/sdk/8.0.403/NuGet.Build.Tasks.dll)
         Assembly loaded during TaskRun (NuGet.Build.Tasks.RestoreTask): NuGet.Credentials, Version=6.11.1.2, Culture=neutral, PublicKeyToken=31bf3856ad364e35 (location: /usr/share/dotnet/sdk/8.0.403/NuGet.Credentials.dll, MVID: 07a91a3f-265a-4226-985e-876d1036d338, AssemblyLoadContext: MSBuild plugin /usr/share/dotnet/sdk/8.0.403/NuGet.Build.Tasks.dll)
         Assembly loaded during TaskRun (NuGet.Build.Tasks.RestoreTask): System.Security.Cryptography.X509Certificates, Version=8.0.0.0, Culture=neutral, PublicKeyToken=b03f5f7f11d50a3a (location: /usr/share/dotnet/shared/Microsoft.NETCore.App/8.0.10/System.Security.Cryptography.X509Certificates.dll, MVID: babd25b1-dd98-4c86-b2b5-fa9a5f94ffc1, AssemblyLoadContext: Default)
         Assembly loaded during TaskRun (NuGet.Build.Tasks.RestoreTask): System.Formats.Asn1, Version=8.0.0.0, Culture=neutral, PublicKeyToken=cc7b13ffcd2ddd51 (location: /usr/share/dotnet/shared/Microsoft.NETCore.App/8.0.10/System.Formats.Asn1.dll, MVID: 4f606ed3-8b57-4dbe-8e7a-4ec241436b9b, AssemblyLoadContext: Default)
         Assembly loaded during TaskRun (NuGet.Build.Tasks.RestoreTask): System.Runtime.Numerics, Version=8.0.0.0, Culture=neutral, PublicKeyToken=b03f5f7f11d50a3a (location: /usr/share/dotnet/shared/Microsoft.NETCore.App/8.0.10/System.Runtime.Numerics.dll, MVID: 12ecf9da-16be-489d-b9c2-184fdd323547, AssemblyLoadContext: Default)
         X.509 certificate chain validation will use the fallback certificate bundle at '/usr/share/dotnet/sdk/8.0.403/trustedroots/codesignctl.pem'.
         X.509 certificate chain validation will use the fallback certificate bundle at '/usr/share/dotnet/sdk/8.0.403/trustedroots/timestampctl.pem'.
         Assembly loaded during TaskRun (NuGet.Build.Tasks.RestoreTask): NuGet.DependencyResolver.Core, Version=6.11.1.2, Culture=neutral, PublicKeyToken=31bf3856ad364e35 (location: /usr/share/dotnet/sdk/8.0.403/NuGet.DependencyResolver.Core.dll, MVID: 70f2641a-4895-4758-a37b-70be48187b22, AssemblyLoadContext: MSBuild plugin /usr/share/dotnet/sdk/8.0.403/NuGet.Build.Tasks.dll)
         Running restore with 2 concurrent jobs.
         Reading project file /src/Common/Common.csproj.
         Assembly loaded during TaskRun (NuGet.Build.Tasks.RestoreTask): Newtonsoft.Json, Version=13.0.0.0, Culture=neutral, PublicKeyToken=30ad4fe6b2a6aeed (location: /usr/share/dotnet/sdk/8.0.403/Newtonsoft.Json.dll, MVID: 7e62198b-eab2-4380-bbac-29171862d1d8, AssemblyLoadContext: MSBuild plugin /usr/share/dotnet/sdk/8.0.403/NuGet.Build.Tasks.dll)
         Assembly loaded during TaskRun (NuGet.Build.Tasks.RestoreTask): System.Runtime.Serialization.Primitives, Version=8.0.0.0, Culture=neutral, PublicKeyToken=b03f5f7f11d50a3a (location: /usr/share/dotnet/shared/Microsoft.NETCore.App/8.0.10/System.Runtime.Serialization.Primitives.dll, MVID: 8be68a72-9db8-4eb5-9241-92109545e51d, AssemblyLoadContext: Default)
         Restoring packages for /src/Common/Common.csproj...
         Restoring packages for .NETCoreApp,Version=v8.0...
         Assembly loaded during TaskRun (NuGet.Build.Tasks.RestoreTask): System.Security.Cryptography.Algorithms, Version=8.0.0.0, Culture=neutral, PublicKeyToken=b03f5f7f11d50a3a (location: /usr/share/dotnet/shared/Microsoft.NETCore.App/8.0.10/System.Security.Cryptography.Algorithms.dll, MVID: b2d08e03-619c-4317-8587-9ac3f8a7b71e, AssemblyLoadContext: Default)
         Assembly loaded during TaskRun (NuGet.Build.Tasks.RestoreTask): System.Security.Cryptography.Primitives, Version=8.0.0.0, Culture=neutral, PublicKeyToken=b03f5f7f11d50a3a (location: /usr/share/dotnet/shared/Microsoft.NETCore.App/8.0.10/System.Security.Cryptography.Primitives.dll, MVID: 0117ccad-7047-48e5-9ddb-84d8ee641a37, AssemblyLoadContext: Default)

I would appreciate any assistance.

Which .NET image(s) are you using?

mcr.microsoft.com/dotnet/sdk:8.0

Steps to reproduce

FROM mcr.microsoft.com/dotnet/sdk:8.0 AS build ARG BUILD_CONFIGURATION=Release

WORKDIR /src COPY ["Common/", "Common/"]

RUN dotnet nuget add source /nuget/v3/index.json --name feed RUN dotnet nuget update source feed --valid-authentication-types basic --username "-feed" --password xxx --store-password-in-clear-text RUN dotnet nuget list source RUN dotnet restore "./Common/Common.csproj"

Other information

No response

Output of docker version

docker version
Client:
 Version:           25.0.5
 API version:       1.44
 Go version:        go1.22.5
 Git commit:        5dc9bcc
 Built:             Wed Aug 21 00:00:00 2024
 OS/Arch:           linux/amd64
 Context:           default

Server:
 Engine:
  Version:          25.0.6
  API version:      1.44 (minimum version 1.24)
  Go version:       go1.22.5
  Git commit:       b08a51f
  Built:            Wed Aug 21 00:00:00 2024
  OS/Arch:          linux/amd64
  Experimental:     false
 containerd:
  Version:          1.7.22
  GitCommit:        7f7fdf5fed64eb6a7caf99b3e12efcf9d60e311c
 runc:
  Version:          1.1.14
  GitCommit:        2c9f5602f0ba3d9da1c2596322dfc4e156844890
 docker-init:
  Version:          0.19.0
  GitCommit:        de40ad0

Output of docker info

docker info
Client:
 Version:    25.0.5
 Context:    default
 Debug Mode: false
 Plugins:
  buildx: Docker Buildx (Docker Inc.)
    Version:  v0.0.0+unknown
    Path:     /usr/libexec/docker/cli-plugins/docker-buildx

Server:
 Containers: 81
  Running: 0
  Paused: 0
  Stopped: 81
 Images: 123
 Server Version: 25.0.6
 Storage Driver: overlay2
  Backing Filesystem: xfs
  Supports d_type: true
  Using metacopy: false
  Native Overlay Diff: true
  userxattr: false
 Logging Driver: json-file
 Cgroup Driver: systemd
 Cgroup Version: 2
 Plugins:
  Volume: local
  Network: bridge host ipvlan macvlan null overlay
  Log: awslogs fluentd gcplogs gelf journald json-file local splunk syslog
 Swarm: inactive
 Runtimes: io.containerd.runc.v2 runc
 Default Runtime: runc
 Init Binary: docker-init
 containerd version: 7f7fdf5fed64eb6a7caf99b3e12efcf9d60e311c
 runc version: 2c9f5602f0ba3d9da1c2596322dfc4e156844890
 init version: de40ad0
 Security Options:
  seccomp
   Profile: builtin
  cgroupns
 Kernel Version: 6.1.112-122.189.amzn2023.x86_64
 Operating System: Amazon Linux 2023.6.20241010
 OSType: linux
 Architecture: x86_64
 CPUs: 2
 Total Memory: 7.629GiB
 Name: ip-10-18-8-203.il-central-1.compute.internal
 ID: f06a87e8-e7bb-4174-b68a-40dcbfa93d67
 Docker Root Dir: /var/lib/docker
 Debug Mode: false
 Experimental: false
 Insecure Registries:
  127.0.0.0/8
 Live Restore Enabled: false
embetten commented 1 day ago 
root@82398c569468:/src/Common# dotnet restore
  Determining projects to restore...
/src/Common/Common.csproj : error NU1202: Package Microsoft.AspNetCore.Grpc.Swagger 0.9.0 is not compatible with net8.0 (.NETCoreApp,Version=v8.0). Package Microsoft.AspNetCore.Grpc.Swagger 0.9.0 supports: net9.0 (.NETCoreApp,Version=v9.0)
  Failed to restore /src/Common/Common.csproj (in 8.33 min).

Is Microsoft.AspNetCore.Grpc.Swagger a dependency of your Common.csproj ? From the error message it looks like you need to be using dotnet 9 sdk instead of dotnet 8 to use this package. The fact that you got past the Unable to load the service index for source makes me think this isn't an authentication issue.

UriZafrir commented 1 day ago

I got past this error by downgrading the swagger to 8.11. and I still get the Unable to load the service index for source. what can i do?

embetten commented 22 hours ago

If adding the password directly to the nuget.config with the add source command didn't work, using this cred provider with the external endpoints variable would not be expected to work either. I would recommend looking at the password.   Are there any exception or error messages from the credprovider in the detailed logs after downgrading and with disableTLSCertificateValidation="true"? If so, please add them here and we can investigate further.