`%!v(PANIC=String method: reflect.Value.Bytes of non-byte slice)`

jsoref commented 1 year ago

Checklist:

[x] I've searched in the docs and FAQ for my answer: https://bit.ly/argocd-faq.
[x] I've included steps to reproduce the bug.
[x] I've pasted the output of argocd version.

Describe the bug

Logs show a PANIC
Logs show a suspicious %!v
Logs may include something that looks suspiciously like credentials (yes, I'm running at info level, so this might be on me, but ArgoCD does try to avoid leaking credentials into logs, so...)

To Reproduce

Sorry, I don't really know what triggered it. I did switch the branch for my applications (including cascades at times)...

Expected behavior

None of the items in the bug section

Screenshots

Version

{
    "Version": "v2.6.0+584428e",
    "BuildDate": "2023-01-19T17:14:49Z",
    "GitCommit": "584428edaf535258924912a191a97dde8a5c5d3d",
    "GitTreeState": "clean",
    "GoVersion": "go1.18.10",
    "Compiler": "gc",
    "Platform": "linux/amd64",
    "KustomizeVersion": "v4.5.7 2022-08-02T16:35:54Z",
    "HelmVersion": "v3.10.3+g835b733",
    "KubectlVersion": "v0.24.2",
    "JsonnetVersion": "v0.19.1"
}

Logs

time="2023-01-26T05:46:37Z" level=info msg="received unary call /application.ApplicationService/Update" grpc.method=Update grpc.request.claims="{\"at_hash\":\"......................\",\"aud\":\"argo-cd\",\"c_hash\":\"......................\",\"email\":\"jsoref@.........\",\"email_verified\":true,\"exp\":1674765211,\"groups\":[\"................\",\"................\",\"................\"],\"iat\":1674678811,\"iss\":\"https://argocd.internal/api/dex\",\"name\":\"Josh Soref\",\"preferred_username\":\"jsoref\",\"sub\":\".......................\"}" grpc.request.content="%!v(PANIC=String method: reflect.Value.Bytes of non-byte slice)" grpc.service=application.ApplicationService grpc.start_time="2023-01-26T05:46:37Z" span.kind=server system=grpc
...
time="2023-01-26T05:46:39Z" level=info msg="jsoref@gmail.com updated application spec" application=single-internal-test dest-namespace=test dest-server="https://kubernetes.default.svc" reason=ResourceUpdated type=Normal

vozerov commented 1 year ago

Hey there! Found the same issue when trying to update application parameters.

Running command under local admin account:

argocd app set app --kustomize-image=registry.gl.com/app:test

Logs:

time="2023-05-13T15:49:53Z" level=info msg="received unary call /application.ApplicationService/Get" grpc.method=Get grpc.request.content="name:\"app\" appNamespace:\"\" " grpc.service=application.ApplicationService grpc.start_time="2023-05-13T15:49:53Z" span.kind=server system=grpc time="2023-05-13T15:49:53Z" level=info msg="finished unary call with code OK" grpc.code=OK grpc.method=Get grpc.service=application.ApplicationService grpc.start_time="2023-05-13T15:49:53Z" grpc.time_ms=13.529 span.kind=server system=grpc time="2023-05-13T15:49:53Z" level=info msg="received unary call /application.ApplicationService/UpdateSpec" grpc.method=UpdateSpec grpc.request.content="%!v(PANIC=String method: reflect.Value.Bytes of non-byte slice)" grpc.service=application.ApplicationService grpc.start_time="2023-05-13T15:49:53Z" span.kind=server system=grpc time="2023-05-13T15:49:54Z" level=info msg="admin updated application spec" application=app dest-namespace=test dest-server="https://1.1.1.1" reason=ResourceUpdated type=Normal user=admin time="2023-05-13T15:49:54Z" level=info msg="finished unary call with code OK" grpc.code=OK grpc.method=UpdateSpec grpc.service=application.ApplicationService grpc.start_time="2023-05-13T15:49:53Z" grpc.time_ms=598.103 span.kind=server system=grpc

vozerov commented 1 year ago

I believe it relates to ApplicationSet. When i had app-root -> appset -> app, trying to set image parameter in latest app led me to the logs mentioned above. Also I tried to get logs from applicationset controller with no luck - no errors were there.

When i changed to schema to app-root -> app everything started to work as expected.

Maybe it could help. Thanks.

tooptoop4 commented 1 year ago

argocd-server in v.2.7.11 also getting:

time="2023-08-15T00:12:33Z" level=info msg="received unary call /repository.RepositoryService/GetAppDetails" grpc.method=GetAppDetails grpc.request.claims="{\"at_hash\":\"redact\",\"aud\":\"argo-cd\",\"c_hash\":\"redact\",\"email\":\"redact\",\"email_verified\":true,\"exp\":1692144683,\"iat\":1692058283,\"iss\":\"https://redact/api/dex\",\"name\":\"redact\",\"sub\":\"redact\"}" grpc.request.content="%!v(PANIC=String method: reflect.Value.Bytes of non-byte slice)" grpc.service=repository.RepositoryService grpc.start_time="2023-08-15T00:12:33Z" span.kind=server system=grpc

vanerac commented 11 months ago

Any updates on this issue ? Facing the same error when updating and creating an app with parameters in v2.9.1

jcrood commented 4 weeks ago

This issue seems slighly more pervasive, as I've also had it pop up when creating a new project through argocd proj create (on v2.12.3):

time="2024-09-26T07:38:33Z" level=info msg="received unary call /project.ProjectService/Create" grpc.method=Create grpc.request.claims="{ ...authstuffhere... }" grpc.request.content="%!v(PANIC=String method: reflect.Value.Bytes of non-byte slice)" grpc.service=project.ProjectService grpc.start_time="2024-09-26T07:38:33Z" span.kind=server system=grpc time="2024-09-26T07:38:33Z" level=info msg="admin created project" project=cheese-dev reason=ResourceCreated type=Normal

argoproj / argo-cd

`%!v(PANIC=String method: reflect.Value.Bytes of non-byte slice)` #12151