getsentry / snuba

Search the seas for your lost treasure.
Other
339 stars 56 forks source link

Unsupported type for timedelta days component in snuba-consumer #2780

Closed pierresebastien closed 2 years ago

pierresebastien commented 2 years ago

Environment

How do you use Sentry? self-hosted/on-premise (22.5.0)

Steps to Reproduce

Upgrade sentry from 22.4.0 to 22.5.0

Expected Result

snuba-consumer to process events without errors

Actual Result

snuba-consumer is unable to process because it crash at startup

2022-06-02 19:19:29,992 Consumer Starting
2022-06-02 19:19:29,993 librdkafka log level: 6
2022-06-02 19:19:32,800 New partitions assigned: {Partition(topic=Topic(name='events'), index=0): 2082906}
2022-06-02 19:19:32,802 Caught TypeError('unsupported type for timedelta days component: str'), shutting down...
2022-06-02 19:19:32,802 Closing <snuba.utils.streams.kafka_consumer_with_commit_log.KafkaConsumerWithCommitLog object at 0x7fec0f842a00>...
2022-06-02 19:19:32,803 Partitions revoked: [Partition(topic=Topic(name='events'), index=0)]
2022-06-02 19:19:32,803 Processor terminated
Traceback (most recent call last):
  File "/usr/local/bin/snuba", line 33, in <module>
    sys.exit(load_entry_point('snuba', 'console_scripts', 'snuba')())
  File "/usr/local/lib/python3.8/site-packages/click/core.py", line 1128, in __call__
    return self.main(*args, **kwargs)
  File "/usr/local/lib/python3.8/site-packages/click/core.py", line 1053, in main
    rv = self.invoke(ctx)
  File "/usr/local/lib/python3.8/site-packages/click/core.py", line 1659, in invoke
    return _process_result(sub_ctx.command.invoke(sub_ctx))
  File "/usr/local/lib/python3.8/site-packages/click/core.py", line 1395, in invoke
    return ctx.invoke(self.callback, **ctx.params)
  File "/usr/local/lib/python3.8/site-packages/click/core.py", line 754, in invoke
    return __callback(*args, **kwargs)
  File "/usr/src/snuba/snuba/cli/consumer.py", line 188, in consumer
    consumer.run()
  File "/usr/local/lib/python3.8/site-packages/arroyo/processing/processor.py", line 121, in run
    self._run_once()
  File "/usr/local/lib/python3.8/site-packages/arroyo/processing/processor.py", line 159, in _run_once
    self.__processing_strategy.submit(self.__message)
  File "/usr/local/lib/python3.8/site-packages/arroyo/processing/strategies/streaming/filter.py", line 32, in submit
    self.__next_step.submit(message)
  File "/usr/local/lib/python3.8/site-packages/arroyo/processing/strategies/streaming/transform.py", line 72, in submit
    self.__transform_function(message),
  File "/usr/src/snuba/snuba/consumers/consumer.py", line 607, in process_message
    result = processor.process_message(
  File "/usr/src/snuba/snuba/datasets/events_processor_base.py", line 178, in process_message
    row = self.process_insert(event, metadata)
  File "/usr/src/snuba/snuba/datasets/events_processor_base.py", line 201, in process_insert
    processed["retention_days"] = override_and_enforce_retention(
  File "/usr/src/snuba/snuba/datasets/events_format.py", line 113, in override_and_enforce_retention
    return enforce_retention(retention_days, timestamp)
  File "/usr/src/snuba/snuba/datasets/events_format.py", line 137, in enforce_retention
    datetime.utcnow() - timedelta(days=retention_days)
TypeError: unsupported type for timedelta days component: str
nikhars commented 2 years ago

Hi @pierresebastien Could you provide the message which is being processed by the consumer. Feel free to redact any sensitive information as needed. You could use the following command to retrieve the message or use kafka-cat or kcat kafka-console-consumer.sh --bootstrap-server localhost:9092 --topic events

pierresebastien commented 2 years ago

Hello, I execute the following command in the kafka container :

root@e2f9e198454b:/# kafka-console-consumer --bootstrap-server localhost:9092 --topic events

Then I generate an error in one of our applications tracked in Sentry and I had the following output (I replaced the domain and IP by dummy values):

[
    2,
    "insert",
    {
        "group_id": 232,
        "event_id": "429b37d852ce4b32a5d60ef0d0ffa502",
        "organization_id": 1,
        "project_id": 19,
        "message": "Error while executing GET request on MVC Page: 'http://dummy.domain.com/wp-login.php', UserAgent: 'Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:101.0) Gecko/20100101 Firefox/101.0' Instance with name 'wp-login.php' not found DepFac.ProPilot.Core.Exceptions.NotFoundException GetInstanceByName False DepFac.ProPilot.Core.Global.Repositories.InstanceRepository in GetInstanceByName",
        "platform": "csharp",
        "datetime": "2022-06-03T08:19:52.112150Z",
        "data": {
            "event_id": "429b37d852ce4b32a5d60ef0d0ffa502",
            "level": "error",
            "version": "7",
            "type": "error",
            "logentry": {
                "formatted": "Error while executing GET request on MVC Page: 'http://dummy.domain.com/wp-login.php', UserAgent: 'Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:101.0) Gecko/20100101 Firefox/101.0'",
                "message": null,
                "params": null
            },
            "logger": "DepFac.ProPilot.ASP.Common.Controllers.Global.BaseController",
            "modules": {
                "ASK.ServEasy": "4.0.1.0",
                "ASK.ServEasy.Windows": "4.0.1.0",
                "AjaxMin": "5.14.5506.26196",
                "AntiXssLibrary": "4.3.0.0",
                "App_Web_2332hona": "0.0.0.0",
                "App_Web_amvgtgl2": "0.0.0.0",
                "App_Web_frs2jr1v": "0.0.0.0",
                "App_Web_iousqpvw": "0.0.0.0",
                "App_global.asax.qeeq7hzx": "0.0.0.0",
                "Atlassian.Jira": "11.2.0.0",
                "Autofac": "4.0.1.0",
                "Autofac.Integration.Mvc": "4.0.0.0",
                "Autofac.Integration.Mvc.Owin": "4.0.0.0",
                "Autofac.Integration.Owin": "4.2.0.0",
                "Autofac.Integration.WebApi": "4.3.1.0",
                "Autofac.Integration.WebApi.Owin": "4.0.0.0",
                "BouncyCastle": "1.8.5811.20889",
                "CommonMark": "0.1.0.0",
                "CookComputing.XmlRpcV2": "2.5.0.0",
                "DataAnnotationsExtensions": "1.1.0.0",
                "DataAnnotationsExtensions.ClientValidation": "1.1.0.0",
                "DepFac.ProPilot.ASP": "3.20.10.0",
                "DepFac.ProPilot.ASP.Common": "3.20.10.0",
                "DepFac.ProPilot.Client": "1.0.0.0",
                "DepFac.ProPilot.Core": "3.20.10.0",
                "DepFac.ProPilot.ExtractReader": "1.1.63.0",
                "DotLiquid": "1.8.0.0",
                "DotNetZip": "1.15.0.0",
                "EPPlus": "4.1.0.0",
                "EntityFramework": "6.0.0.0",
                "EntityFramework.SqlServer": "6.0.0.0",
                "HtmlAgilityPack": "1.4.9.0",
                "ICSharpCode.SharpZipLib": "0.86.0.518",
                "IdentityModel": "1.0.0.0",
                "IdentityServer3": "2.6.0.0",
                "IdentityServer3.AccessTokenValidation": "1.0.0.0",
                "Ionic.Zip": "1.9.1.8",
                "Lucene.Net": "3.0.3.0",
                "MailKit": "1.2.0.0",
                "Microsoft.Build.Framework": "4.0.0.0",
                "Microsoft.Build.Utilities.v4.0": "4.0.0.0",
                "Microsoft.CSharp": "4.0.0.0",
                "Microsoft.IdentityModel.JsonWebTokens": "6.8.0.0",
                "Microsoft.IdentityModel.Logging": "6.8.0.0",
                "Microsoft.IdentityModel.Protocol.Extensions": "1.0.40306.1554",
                "Microsoft.IdentityModel.Protocols": "6.8.0.0",
                "Microsoft.IdentityModel.Protocols.OpenIdConnect": "6.8.0.0",
                "Microsoft.IdentityModel.Tokens": "6.8.0.0",
                "Microsoft.JScript": "10.0.0.0",
                "Microsoft.Owin": "4.1.1.0",
                "Microsoft.Owin.Host.SystemWeb": "4.1.1.0",
                "Microsoft.Owin.Security": "4.1.1.0",
                "Microsoft.Owin.Security.Cookies": "4.1.1.0",
                "Microsoft.Owin.Security.Jwt": "4.1.1.0",
                "Microsoft.Owin.Security.OAuth": "4.1.1.0",
                "Microsoft.Owin.Security.OpenIdConnect": "4.1.1.0",
                "Microsoft.VisualBasic.Activities.Compiler": "10.0.0.0",
                "Microsoft.Web.Infrastructure": "1.0.0.0",
                "MimeKit": "1.2.0.0",
                "MiniProfiler": "3.1.1.140",
                "Mono.Cecil": "0.9.5.0",
                "Mono.Cecil.Rocks": "0.9.5.0",
                "Mono.Security": "2.0.0.0",
                "MySql.Data": "6.9.6.0",
                "NCrontab": "3.3.1.0",
                "Newtonsoft.Json": "12.0.0.0",
                "NotFoundMvc": "1.2.0.0",
                "Npgsql": "2.0.11.0",
                "Owin": "1.0.0.0",
                "PagedList": "1.17.0.0",
                "PagedList.Mvc": "4.5.0.0",
                "RestSharp": "106.2.2.0",
                "SMDiagnostics": "4.0.0.0",
                "Sentry": "2.1.8.0",
                "Sentry.Log4Net": "2.1.8.0",
                "Sentry.PlatformAbstractions": "1.1.1.0",
                "Sentry.Protocol": "2.1.8.0",
                "ServiceStack": "3.9.71.0",
                "ServiceStack.Common": "3.9.71.0",
                "ServiceStack.FluentValidation.Mvc3": "3.9.71.0",
                "ServiceStack.Interfaces": "1.0.0.0",
                "ServiceStack.OrmLite": "3.9.71.0",
                "ServiceStack.OrmLite.MySql": "3.9.71.0",
                "ServiceStack.OrmLite.PostgreSQL": "3.9.71.0",
                "ServiceStack.OrmLite.SqlServer": "3.9.71.0",
                "ServiceStack.OrmLite.SqliteNET": "3.9.71.0",
                "ServiceStack.Redis": "3.9.71.0",
                "ServiceStack.ServiceInterface": "3.9.71.0",
                "ServiceStack.Text": "3.9.71.0",
                "System": "4.0.0.0",
                "System.Activities": "4.0.0.0",
                "System.ComponentModel.DataAnnotations": "4.0.0.0",
                "System.Configuration": "4.0.0.0",
                "System.Configuration.Install": "4.0.0.0",
                "System.Core": "4.0.0.0",
                "System.Data": "4.0.0.0",
                "System.Data.DataSetExtensions": "4.0.0.0",
                "System.Data.Entity": "4.0.0.0",
                "System.Data.Linq": "4.0.0.0",
                "System.Data.SQLite": "1.0.96.0",
                "System.Data.SQLite.EF6": "1.0.113.0",
                "System.Data.SQLite.Linq": "1.0.113.0",
                "System.Data.SqlXml": "4.0.0.0",
                "System.Design": "4.0.0.0",
                "System.Drawing": "4.0.0.0",
                "System.Dynamic": "4.0.0.0",
                "System.EnterpriseServices": "4.0.0.0",
                "System.IdentityModel": "4.0.0.0",
                "System.IdentityModel.Tokens.Jwt": "6.8.0.0",
                "System.Json": "4.0.0.0",
                "System.Management": "4.0.0.0",
                "System.Net.Http": "4.0.0.0",
                "System.Net.Http.Formatting": "5.2.7.0",
                "System.Numerics": "4.0.0.0",
                "System.Runtime.Caching": "4.0.0.0",
                "System.Runtime.DurableInstancing": "4.0.0.0",
                "System.Runtime.InteropServices.RuntimeInformation": "4.0.0.0",
                "System.Runtime.Serialization": "4.0.0.0",
                "System.Security": "4.0.0.0",
                "System.ServiceModel": "4.0.0.0",
                "System.ServiceModel.Activation": "4.0.0.0",
                "System.ServiceModel.Activities": "4.0.0.0",
                "System.ServiceModel.Internals": "4.0.0.0",
                "System.ServiceModel.Web": "4.0.0.0",
                "System.ServiceProcess": "4.0.0.0",
                "System.Transactions": "4.0.0.0",
                "System.Web": "4.0.0.0",
                "System.Web.Abstractions": "4.0.0.0",
                "System.Web.ApplicationServices": "4.0.0.0",
                "System.Web.Cors": "5.2.7.0",
                "System.Web.DataVisualization": "4.0.0.0",
                "System.Web.DynamicData": "4.0.0.0",
                "System.Web.Extensions": "4.0.0.0",
                "System.Web.Helpers": "3.0.0.0",
                "System.Web.Http": "5.2.7.0",
                "System.Web.Http.Cors": "5.2.7.0",
                "System.Web.Http.Owin": "5.2.7.0",
                "System.Web.Http.WebHost": "5.2.7.0",
                "System.Web.Mobile": "4.0.0.0",
                "System.Web.Mvc": "5.2.7.0",
                "System.Web.Razor": "3.0.0.0",
                "System.Web.RegularExpressions": "4.0.0.0",
                "System.Web.Services": "4.0.0.0",
                "System.Web.WebPages": "3.0.0.0",
                "System.Web.WebPages.Deployment": "3.0.0.0",
                "System.Web.WebPages.Razor": "3.0.0.0",
                "System.Windows.Forms": "4.0.0.0",
                "System.Workflow.Activities": "4.0.0.0",
                "System.Workflow.ComponentModel": "4.0.0.0",
                "System.Workflow.Runtime": "4.0.0.0",
                "System.WorkflowServices": "4.0.0.0",
                "System.Xaml": "4.0.0.0",
                "System.Xaml.Hosting": "4.0.0.0",
                "System.Xml": "4.0.0.0",
                "System.Xml.Linq": "4.0.0.0",
                "Thinktecture.IdentityModel.Client.Net45": "1.0.0.0",
                "Weavers": "1.0.0.0",
                "WebActivator": "1.5.3.0",
                "WeifenLuo.WinFormsUI.Docking": "2.9.0.0",
                "dFakto.Tools": "2.0.13.0",
                "dFakto.Tools.Excel": "2.0.13.0",
                "hbehr.recaptcha": "1.1.0.0",
                "log4net": "2.0.12.0",
                "mscorlib": "4.0.0.0",
                "netstandard": "2.0.0.0"
            },
            "platform": "csharp",
            "timestamp": 1654244392.11215,
            "received": 1654244392.139693,
            "release": "propilot@3.20.10",
            "environment": "Acceptance",
            "request": {
                "url": "http://dummy.domain.com/wp-login.php",
                "method": "GET",
                "headers": [
                    [
                        "Accept",
                        "text/html,application/xhtml+xml,application/xml;q=0.9,image/avif,image/webp,*/*;q=0.8"
                    ],
                    [
                        "Accept-Encoding",
                        "gzip, deflate, br"
                    ],
                    [
                        "Accept-Language",
                        "en-US,en;q=0.5"
                    ],
                    [
                        "Connection",
                        "close"
                    ],
                    [
                        "Host",
                        "dummy.domain.com"
                    ],
                    [
                        "Sec-Fetch-Dest",
                        "document"
                    ],
                    [
                        "Sec-Fetch-Mode",
                        "navigate"
                    ],
                    [
                        "Sec-Fetch-Site",
                        "none"
                    ],
                    [
                        "Sec-Fetch-User",
                        "?1"
                    ],
                    [
                        "Upgrade-Insecure-Requests",
                        "1"
                    ],
                    [
                        "User-Agent",
                        "Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:101.0) Gecko/20100101 Firefox/101.0"
                    ],
                    [
                        "X-Forwarded-For",
                        "0.0.0.0"
                    ],
                    [
                        "X-Forwarded-Proto",
                        "https"
                    ],
                    [
                        "X-Real-IP",
                        "0.0.0.0"
                    ]
                ],
                "query_string": [],
                "fragment": null,
                "cookies": null,
                "data": null,
                "env": null,
                "inferred_content_type": null
            },
            "contexts": {
                "CurrentCulture": {
                    "Calendar": "GregorianCalendar",
                    "DisplayName": "English (United States)",
                    "Name": "en-US",
                    "type": "CurrentCulture"
                },
                "CurrentUICulture": {
                    "Calendar": "GregorianCalendar",
                    "DisplayName": "English (United States)",
                    "Name": "en-US",
                    "type": "CurrentUICulture"
                },
                "browser": {
                    "name": "Firefox",
                    "version": "101.0",
                    "type": "browser"
                },
                "client_os": {
                    "name": "Windows",
                    "version": "10",
                    "type": "os"
                },
                "device": {
                    "timezone": "Romance Standard Time",
                    "timezone_display_name": "(UTC+01:00) Brussels, Copenhagen, Madrid, Paris",
                    "type": "device"
                },
                "server-os": {
                    "name": "Windows",
                    "version": "10",
                    "build": "17763",
                    "raw_description": "Microsoft Windows 10.0.17763 ",
                    "type": "os"
                },
                "server-runtime": {
                    "name": ".NET Framework",
                    "version": "4.8",
                    "raw_description": ".NET Framework 4.8.4510.0",
                    "type": "runtime"
                }
            },
            "exception": {
                "values": [
                    {
                        "type": "DepFac.ProPilot.Core.Exceptions.NotFoundException",
                        "value": "Instance with name 'wp-login.php' not found",
                        "module": "DepFac.ProPilot.Core, Version=3.20.10.0, Culture=neutral, PublicKeyToken=null",
                        "stacktrace": {
                            "frames": [
                                {
                                    "function": "InvokeAction",
                                    "module": "System.Web.Mvc.ControllerActionInvoker",
                                    "package": "System.Web.Mvc, Version=5.2.7.0, Culture=neutral, PublicKeyToken=31bf3856ad364e35",
                                    "in_app": false,
                                    "abs_path": null,
                                    "colno": null,
                                    "context_line": null,
                                    "data": null,
                                    "errors": null,
                                    "filename": null,
                                    "raw_function": null,
                                    "image_addr": null,
                                    "instruction_addr": null,
                                    "addr_mode": null,
                                    "lineno": null,
                                    "platform": null,
                                    "post_context": null,
                                    "pre_context": null,
                                    "symbol": null,
                                    "symbol_addr": null,
                                    "trust": null,
                                    "vars": null,
                                    "snapshot": null
                                },
                                {
                                    "function": "InvokeAuthorizationFilters",
                                    "module": "System.Web.Mvc.ControllerActionInvoker",
                                    "package": "System.Web.Mvc, Version=5.2.7.0, Culture=neutral, PublicKeyToken=31bf3856ad364e35",
                                    "in_app": false,
                                    "abs_path": null,
                                    "colno": null,
                                    "context_line": null,
                                    "data": null,
                                    "errors": null,
                                    "filename": null,
                                    "raw_function": null,
                                    "image_addr": null,
                                    "instruction_addr": null,
                                    "addr_mode": null,
                                    "lineno": null,
                                    "platform": null,
                                    "post_context": null,
                                    "pre_context": null,
                                    "symbol": null,
                                    "symbol_addr": null,
                                    "trust": null,
                                    "vars": null,
                                    "snapshot": null
                                },
                                {
                                    "function": "OnAuthorization",
                                    "module": "DepFac.ProPilot.ASP.Common.Controllers.Global.BaseController",
                                    "package": "DepFac.ProPilot.ASP.Common, Version=3.20.10.0, Culture=neutral, PublicKeyToken=null",
                                    "in_app": true,
                                    "abs_path": null,
                                    "colno": null,
                                    "context_line": null,
                                    "data": null,
                                    "errors": null,
                                    "filename": null,
                                    "raw_function": null,
                                    "image_addr": null,
                                    "instruction_addr": null,
                                    "addr_mode": null,
                                    "lineno": null,
                                    "platform": null,
                                    "post_context": null,
                                    "pre_context": null,
                                    "symbol": null,
                                    "symbol_addr": null,
                                    "trust": null,
                                    "vars": null,
                                    "snapshot": null
                                },
                                {
                                    "function": "SwitchInstance",
                                    "module": "DepFac.ProPilot.Core.Global.GlobalContext",
                                    "package": "DepFac.ProPilot.Core, Version=3.20.10.0, Culture=neutral, PublicKeyToken=null",
                                    "in_app": true,
                                    "abs_path": null,
                                    "colno": null,
                                    "context_line": null,
                                    "data": null,
                                    "errors": null,
                                    "filename": null,
                                    "raw_function": null,
                                    "image_addr": null,
                                    "instruction_addr": null,
                                    "addr_mode": null,
                                    "lineno": null,
                                    "platform": null,
                                    "post_context": null,
                                    "pre_context": null,
                                    "symbol": null,
                                    "symbol_addr": null,
                                    "trust": null,
                                    "vars": null,
                                    "snapshot": null
                                },
                                {
                                    "function": ".ctor",
                                    "module": "DepFac.ProPilot.Core.Instances.ProPilotContext",
                                    "package": "DepFac.ProPilot.Core, Version=3.20.10.0, Culture=neutral, PublicKeyToken=null",
                                    "in_app": true,
                                    "abs_path": null,
                                    "colno": null,
                                    "context_line": null,
                                    "data": null,
                                    "errors": null,
                                    "filename": null,
                                    "raw_function": null,
                                    "image_addr": null,
                                    "instruction_addr": null,
                                    "addr_mode": null,
                                    "lineno": null,
                                    "platform": null,
                                    "post_context": null,
                                    "pre_context": null,
                                    "symbol": null,
                                    "symbol_addr": null,
                                    "trust": null,
                                    "vars": null,
                                    "snapshot": null
                                },
                                {
                                    "function": "RetrieveInstanceContainer",
                                    "module": "DepFac.ProPilot.Core.Global.Repositories.InstanceRepository",
                                    "package": "DepFac.ProPilot.Core, Version=3.20.10.0, Culture=neutral, PublicKeyToken=null",
                                    "in_app": true,
                                    "abs_path": null,
                                    "colno": null,
                                    "context_line": null,
                                    "data": null,
                                    "errors": null,
                                    "filename": null,
                                    "raw_function": null,
                                    "image_addr": null,
                                    "instruction_addr": null,
                                    "addr_mode": null,
                                    "lineno": null,
                                    "platform": null,
                                    "post_context": null,
                                    "pre_context": null,
                                    "symbol": null,
                                    "symbol_addr": null,
                                    "trust": null,
                                    "vars": null,
                                    "snapshot": null
                                },
                                {
                                    "function": "GetInstanceByName",
                                    "module": "DepFac.ProPilot.Core.Global.Repositories.InstanceRepository",
                                    "package": "DepFac.ProPilot.Core, Version=3.20.10.0, Culture=neutral, PublicKeyToken=null",
                                    "in_app": true,
                                    "abs_path": null,
                                    "colno": null,
                                    "context_line": null,
                                    "data": null,
                                    "errors": null,
                                    "filename": null,
                                    "raw_function": null,
                                    "image_addr": null,
                                    "instruction_addr": null,
                                    "addr_mode": null,
                                    "lineno": null,
                                    "platform": null,
                                    "post_context": null,
                                    "pre_context": null,
                                    "symbol": null,
                                    "symbol_addr": null,
                                    "trust": null,
                                    "vars": null,
                                    "snapshot": null
                                }
                            ]
                        },
                        "thread_id": 47
                    }
                ]
            },
            "tags": [
                [
                    "server_name",
                    "UAT-PPL"
                ],
                [
                    "level",
                    "error"
                ],
                [
                    "logger",
                    "DepFac.ProPilot.ASP.Common.Controllers.Global.BaseController"
                ],
                [
                    "environment",
                    "Acceptance"
                ],
                [
                    "sentry:release",
                    "propilot@3.20.10"
                ],
                [
                    "url",
                    "http://dummy.domain.com/wp-login.php"
                ],
                [
                    "browser",
                    "Firefox 101.0"
                ],
                [
                    "browser.name",
                    "Firefox"
                ],
                [
                    "client_os",
                    "Windows 10"
                ],
                [
                    "client_os.name",
                    "Windows"
                ],
                [
                    "server-os",
                    "Windows 10"
                ],
                [
                    "server-os.name",
                    "Windows"
                ],
                [
                    "server-runtime",
                    ".NET Framework 4.8"
                ],
                [
                    "server-runtime.name",
                    ".NET Framework"
                ]
            ],
            "extra": {
                "ClassName": "DepFac.ProPilot.ASP.Common.Controllers.Global.BaseController",
                "Core_Version": "3.20.10.0",
                "Domain": "/LM/W3SVC/1/ROOT-1-132987040413368077",
                "MethodName": "OnException",
                "ThreadName": "47",
                "log4net-level": "ERROR"
            },
            "sdk": {
                "name": "sentry.dotnet.log4net",
                "version": "2.1.8",
                "packages": [
                    {
                        "name": "nuget:Sentry",
                        "version": "2.1.8"
                    },
                    {
                        "name": "nuget:Sentry.Log4Net",
                        "version": "2.1.8"
                    }
                ],
                "integrations": null
            },
            "key_id": "19",
            "project": 19,
            "grouping_config": {
                "enhancements": "eJybzDRxY3J-bm5-npWRgaGlroGxrpHxBABcYgcZ",
                "id": "newstyle:2019-10-29"
            },
            "_metrics": {
                "bytes.ingested.event": 9496,
                "bytes.stored.event": 13130
            },
            "fingerprint": [
                "{{ default }}"
            ],
            "hashes": [
                "95d88c342428afbe17a37158c7bbe30f",
                "f2db7aee511f144691883bff5018ffc3"
            ],
            "culprit": "DepFac.ProPilot.Core.Global.Repositories.InstanceRepository in GetInstanceByName",
            "metadata": {
                "value": "Instance with name 'wp-login.php' not found",
                "type": "DepFac.ProPilot.Core.Exceptions.NotFoundException",
                "function": "GetInstanceByName",
                "display_title_with_tree_label": false
            },
            "title": "DepFac.ProPilot.Core.Exceptions.NotFoundException: Instance with name 'wp-login.php' not found",
            "location": null,
            "_ref": 19,
            "_ref_version": 2,
            "nodestore_insert": 1654244393.185044
        },
        "primary_hash": "95d88c342428afbe17a37158c7bbe30f",
        "retention_days": null
    },
    {
        "is_new": false,
        "is_regression": null,
        "is_new_group_environment": false,
        "skip_consume": false
    }
]

To give more context, we see that sentry continue to receive errors in the Usage Stats view but issues does not appear in project views since the update for all our projects (we have several projects using different SDK : .NET (core), angular, python, ruby).

nikhars commented 2 years ago

Hello, I execute the following command in the kafka container :

root@e2f9e198454b:/# kafka-console-consumer --bootstrap-server localhost:9092 --topic events

Then I generate an error in one of our applications tracked in Sentry and I had the following output (I replaced the domain and IP by dummy values):

[
    2,
    "insert",
    {
        "group_id": 232,
        "event_id": "429b37d852ce4b32a5d60ef0d0ffa502",
        "organization_id": 1,
        "project_id": 19,
        "message": "Error while executing GET request on MVC Page: 'http://dummy.domain.com/wp-login.php', UserAgent: 'Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:101.0) Gecko/20100101 Firefox/101.0' Instance with name 'wp-login.php' not found DepFac.ProPilot.Core.Exceptions.NotFoundException GetInstanceByName False DepFac.ProPilot.Core.Global.Repositories.InstanceRepository in GetInstanceByName",
        "platform": "csharp",
        "datetime": "2022-06-03T08:19:52.112150Z",
        "data": {
            "event_id": "429b37d852ce4b32a5d60ef0d0ffa502",
            "level": "error",
            "version": "7",
            "type": "error",
            "logentry": {
                "formatted": "Error while executing GET request on MVC Page: 'http://dummy.domain.com/wp-login.php', UserAgent: 'Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:101.0) Gecko/20100101 Firefox/101.0'",
                "message": null,
                "params": null
            },
            "logger": "DepFac.ProPilot.ASP.Common.Controllers.Global.BaseController",
            "modules": {
                "ASK.ServEasy": "4.0.1.0",
                "ASK.ServEasy.Windows": "4.0.1.0",
                "AjaxMin": "5.14.5506.26196",
                "AntiXssLibrary": "4.3.0.0",
                "App_Web_2332hona": "0.0.0.0",
                "App_Web_amvgtgl2": "0.0.0.0",
                "App_Web_frs2jr1v": "0.0.0.0",
                "App_Web_iousqpvw": "0.0.0.0",
                "App_global.asax.qeeq7hzx": "0.0.0.0",
                "Atlassian.Jira": "11.2.0.0",
                "Autofac": "4.0.1.0",
                "Autofac.Integration.Mvc": "4.0.0.0",
                "Autofac.Integration.Mvc.Owin": "4.0.0.0",
                "Autofac.Integration.Owin": "4.2.0.0",
                "Autofac.Integration.WebApi": "4.3.1.0",
                "Autofac.Integration.WebApi.Owin": "4.0.0.0",
                "BouncyCastle": "1.8.5811.20889",
                "CommonMark": "0.1.0.0",
                "CookComputing.XmlRpcV2": "2.5.0.0",
                "DataAnnotationsExtensions": "1.1.0.0",
                "DataAnnotationsExtensions.ClientValidation": "1.1.0.0",
                "DepFac.ProPilot.ASP": "3.20.10.0",
                "DepFac.ProPilot.ASP.Common": "3.20.10.0",
                "DepFac.ProPilot.Client": "1.0.0.0",
                "DepFac.ProPilot.Core": "3.20.10.0",
                "DepFac.ProPilot.ExtractReader": "1.1.63.0",
                "DotLiquid": "1.8.0.0",
                "DotNetZip": "1.15.0.0",
                "EPPlus": "4.1.0.0",
                "EntityFramework": "6.0.0.0",
                "EntityFramework.SqlServer": "6.0.0.0",
                "HtmlAgilityPack": "1.4.9.0",
                "ICSharpCode.SharpZipLib": "0.86.0.518",
                "IdentityModel": "1.0.0.0",
                "IdentityServer3": "2.6.0.0",
                "IdentityServer3.AccessTokenValidation": "1.0.0.0",
                "Ionic.Zip": "1.9.1.8",
                "Lucene.Net": "3.0.3.0",
                "MailKit": "1.2.0.0",
                "Microsoft.Build.Framework": "4.0.0.0",
                "Microsoft.Build.Utilities.v4.0": "4.0.0.0",
                "Microsoft.CSharp": "4.0.0.0",
                "Microsoft.IdentityModel.JsonWebTokens": "6.8.0.0",
                "Microsoft.IdentityModel.Logging": "6.8.0.0",
                "Microsoft.IdentityModel.Protocol.Extensions": "1.0.40306.1554",
                "Microsoft.IdentityModel.Protocols": "6.8.0.0",
                "Microsoft.IdentityModel.Protocols.OpenIdConnect": "6.8.0.0",
                "Microsoft.IdentityModel.Tokens": "6.8.0.0",
                "Microsoft.JScript": "10.0.0.0",
                "Microsoft.Owin": "4.1.1.0",
                "Microsoft.Owin.Host.SystemWeb": "4.1.1.0",
                "Microsoft.Owin.Security": "4.1.1.0",
                "Microsoft.Owin.Security.Cookies": "4.1.1.0",
                "Microsoft.Owin.Security.Jwt": "4.1.1.0",
                "Microsoft.Owin.Security.OAuth": "4.1.1.0",
                "Microsoft.Owin.Security.OpenIdConnect": "4.1.1.0",
                "Microsoft.VisualBasic.Activities.Compiler": "10.0.0.0",
                "Microsoft.Web.Infrastructure": "1.0.0.0",
                "MimeKit": "1.2.0.0",
                "MiniProfiler": "3.1.1.140",
                "Mono.Cecil": "0.9.5.0",
                "Mono.Cecil.Rocks": "0.9.5.0",
                "Mono.Security": "2.0.0.0",
                "MySql.Data": "6.9.6.0",
                "NCrontab": "3.3.1.0",
                "Newtonsoft.Json": "12.0.0.0",
                "NotFoundMvc": "1.2.0.0",
                "Npgsql": "2.0.11.0",
                "Owin": "1.0.0.0",
                "PagedList": "1.17.0.0",
                "PagedList.Mvc": "4.5.0.0",
                "RestSharp": "106.2.2.0",
                "SMDiagnostics": "4.0.0.0",
                "Sentry": "2.1.8.0",
                "Sentry.Log4Net": "2.1.8.0",
                "Sentry.PlatformAbstractions": "1.1.1.0",
                "Sentry.Protocol": "2.1.8.0",
                "ServiceStack": "3.9.71.0",
                "ServiceStack.Common": "3.9.71.0",
                "ServiceStack.FluentValidation.Mvc3": "3.9.71.0",
                "ServiceStack.Interfaces": "1.0.0.0",
                "ServiceStack.OrmLite": "3.9.71.0",
                "ServiceStack.OrmLite.MySql": "3.9.71.0",
                "ServiceStack.OrmLite.PostgreSQL": "3.9.71.0",
                "ServiceStack.OrmLite.SqlServer": "3.9.71.0",
                "ServiceStack.OrmLite.SqliteNET": "3.9.71.0",
                "ServiceStack.Redis": "3.9.71.0",
                "ServiceStack.ServiceInterface": "3.9.71.0",
                "ServiceStack.Text": "3.9.71.0",
                "System": "4.0.0.0",
                "System.Activities": "4.0.0.0",
                "System.ComponentModel.DataAnnotations": "4.0.0.0",
                "System.Configuration": "4.0.0.0",
                "System.Configuration.Install": "4.0.0.0",
                "System.Core": "4.0.0.0",
                "System.Data": "4.0.0.0",
                "System.Data.DataSetExtensions": "4.0.0.0",
                "System.Data.Entity": "4.0.0.0",
                "System.Data.Linq": "4.0.0.0",
                "System.Data.SQLite": "1.0.96.0",
                "System.Data.SQLite.EF6": "1.0.113.0",
                "System.Data.SQLite.Linq": "1.0.113.0",
                "System.Data.SqlXml": "4.0.0.0",
                "System.Design": "4.0.0.0",
                "System.Drawing": "4.0.0.0",
                "System.Dynamic": "4.0.0.0",
                "System.EnterpriseServices": "4.0.0.0",
                "System.IdentityModel": "4.0.0.0",
                "System.IdentityModel.Tokens.Jwt": "6.8.0.0",
                "System.Json": "4.0.0.0",
                "System.Management": "4.0.0.0",
                "System.Net.Http": "4.0.0.0",
                "System.Net.Http.Formatting": "5.2.7.0",
                "System.Numerics": "4.0.0.0",
                "System.Runtime.Caching": "4.0.0.0",
                "System.Runtime.DurableInstancing": "4.0.0.0",
                "System.Runtime.InteropServices.RuntimeInformation": "4.0.0.0",
                "System.Runtime.Serialization": "4.0.0.0",
                "System.Security": "4.0.0.0",
                "System.ServiceModel": "4.0.0.0",
                "System.ServiceModel.Activation": "4.0.0.0",
                "System.ServiceModel.Activities": "4.0.0.0",
                "System.ServiceModel.Internals": "4.0.0.0",
                "System.ServiceModel.Web": "4.0.0.0",
                "System.ServiceProcess": "4.0.0.0",
                "System.Transactions": "4.0.0.0",
                "System.Web": "4.0.0.0",
                "System.Web.Abstractions": "4.0.0.0",
                "System.Web.ApplicationServices": "4.0.0.0",
                "System.Web.Cors": "5.2.7.0",
                "System.Web.DataVisualization": "4.0.0.0",
                "System.Web.DynamicData": "4.0.0.0",
                "System.Web.Extensions": "4.0.0.0",
                "System.Web.Helpers": "3.0.0.0",
                "System.Web.Http": "5.2.7.0",
                "System.Web.Http.Cors": "5.2.7.0",
                "System.Web.Http.Owin": "5.2.7.0",
                "System.Web.Http.WebHost": "5.2.7.0",
                "System.Web.Mobile": "4.0.0.0",
                "System.Web.Mvc": "5.2.7.0",
                "System.Web.Razor": "3.0.0.0",
                "System.Web.RegularExpressions": "4.0.0.0",
                "System.Web.Services": "4.0.0.0",
                "System.Web.WebPages": "3.0.0.0",
                "System.Web.WebPages.Deployment": "3.0.0.0",
                "System.Web.WebPages.Razor": "3.0.0.0",
                "System.Windows.Forms": "4.0.0.0",
                "System.Workflow.Activities": "4.0.0.0",
                "System.Workflow.ComponentModel": "4.0.0.0",
                "System.Workflow.Runtime": "4.0.0.0",
                "System.WorkflowServices": "4.0.0.0",
                "System.Xaml": "4.0.0.0",
                "System.Xaml.Hosting": "4.0.0.0",
                "System.Xml": "4.0.0.0",
                "System.Xml.Linq": "4.0.0.0",
                "Thinktecture.IdentityModel.Client.Net45": "1.0.0.0",
                "Weavers": "1.0.0.0",
                "WebActivator": "1.5.3.0",
                "WeifenLuo.WinFormsUI.Docking": "2.9.0.0",
                "dFakto.Tools": "2.0.13.0",
                "dFakto.Tools.Excel": "2.0.13.0",
                "hbehr.recaptcha": "1.1.0.0",
                "log4net": "2.0.12.0",
                "mscorlib": "4.0.0.0",
                "netstandard": "2.0.0.0"
            },
            "platform": "csharp",
            "timestamp": 1654244392.11215,
            "received": 1654244392.139693,
            "release": "propilot@3.20.10",
            "environment": "Acceptance",
            "request": {
                "url": "http://dummy.domain.com/wp-login.php",
                "method": "GET",
                "headers": [
                    [
                        "Accept",
                        "text/html,application/xhtml+xml,application/xml;q=0.9,image/avif,image/webp,*/*;q=0.8"
                    ],
                    [
                        "Accept-Encoding",
                        "gzip, deflate, br"
                    ],
                    [
                        "Accept-Language",
                        "en-US,en;q=0.5"
                    ],
                    [
                        "Connection",
                        "close"
                    ],
                    [
                        "Host",
                        "dummy.domain.com"
                    ],
                    [
                        "Sec-Fetch-Dest",
                        "document"
                    ],
                    [
                        "Sec-Fetch-Mode",
                        "navigate"
                    ],
                    [
                        "Sec-Fetch-Site",
                        "none"
                    ],
                    [
                        "Sec-Fetch-User",
                        "?1"
                    ],
                    [
                        "Upgrade-Insecure-Requests",
                        "1"
                    ],
                    [
                        "User-Agent",
                        "Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:101.0) Gecko/20100101 Firefox/101.0"
                    ],
                    [
                        "X-Forwarded-For",
                        "0.0.0.0"
                    ],
                    [
                        "X-Forwarded-Proto",
                        "https"
                    ],
                    [
                        "X-Real-IP",
                        "0.0.0.0"
                    ]
                ],
                "query_string": [],
                "fragment": null,
                "cookies": null,
                "data": null,
                "env": null,
                "inferred_content_type": null
            },
            "contexts": {
                "CurrentCulture": {
                    "Calendar": "GregorianCalendar",
                    "DisplayName": "English (United States)",
                    "Name": "en-US",
                    "type": "CurrentCulture"
                },
                "CurrentUICulture": {
                    "Calendar": "GregorianCalendar",
                    "DisplayName": "English (United States)",
                    "Name": "en-US",
                    "type": "CurrentUICulture"
                },
                "browser": {
                    "name": "Firefox",
                    "version": "101.0",
                    "type": "browser"
                },
                "client_os": {
                    "name": "Windows",
                    "version": "10",
                    "type": "os"
                },
                "device": {
                    "timezone": "Romance Standard Time",
                    "timezone_display_name": "(UTC+01:00) Brussels, Copenhagen, Madrid, Paris",
                    "type": "device"
                },
                "server-os": {
                    "name": "Windows",
                    "version": "10",
                    "build": "17763",
                    "raw_description": "Microsoft Windows 10.0.17763 ",
                    "type": "os"
                },
                "server-runtime": {
                    "name": ".NET Framework",
                    "version": "4.8",
                    "raw_description": ".NET Framework 4.8.4510.0",
                    "type": "runtime"
                }
            },
            "exception": {
                "values": [
                    {
                        "type": "DepFac.ProPilot.Core.Exceptions.NotFoundException",
                        "value": "Instance with name 'wp-login.php' not found",
                        "module": "DepFac.ProPilot.Core, Version=3.20.10.0, Culture=neutral, PublicKeyToken=null",
                        "stacktrace": {
                            "frames": [
                                {
                                    "function": "InvokeAction",
                                    "module": "System.Web.Mvc.ControllerActionInvoker",
                                    "package": "System.Web.Mvc, Version=5.2.7.0, Culture=neutral, PublicKeyToken=31bf3856ad364e35",
                                    "in_app": false,
                                    "abs_path": null,
                                    "colno": null,
                                    "context_line": null,
                                    "data": null,
                                    "errors": null,
                                    "filename": null,
                                    "raw_function": null,
                                    "image_addr": null,
                                    "instruction_addr": null,
                                    "addr_mode": null,
                                    "lineno": null,
                                    "platform": null,
                                    "post_context": null,
                                    "pre_context": null,
                                    "symbol": null,
                                    "symbol_addr": null,
                                    "trust": null,
                                    "vars": null,
                                    "snapshot": null
                                },
                                {
                                    "function": "InvokeAuthorizationFilters",
                                    "module": "System.Web.Mvc.ControllerActionInvoker",
                                    "package": "System.Web.Mvc, Version=5.2.7.0, Culture=neutral, PublicKeyToken=31bf3856ad364e35",
                                    "in_app": false,
                                    "abs_path": null,
                                    "colno": null,
                                    "context_line": null,
                                    "data": null,
                                    "errors": null,
                                    "filename": null,
                                    "raw_function": null,
                                    "image_addr": null,
                                    "instruction_addr": null,
                                    "addr_mode": null,
                                    "lineno": null,
                                    "platform": null,
                                    "post_context": null,
                                    "pre_context": null,
                                    "symbol": null,
                                    "symbol_addr": null,
                                    "trust": null,
                                    "vars": null,
                                    "snapshot": null
                                },
                                {
                                    "function": "OnAuthorization",
                                    "module": "DepFac.ProPilot.ASP.Common.Controllers.Global.BaseController",
                                    "package": "DepFac.ProPilot.ASP.Common, Version=3.20.10.0, Culture=neutral, PublicKeyToken=null",
                                    "in_app": true,
                                    "abs_path": null,
                                    "colno": null,
                                    "context_line": null,
                                    "data": null,
                                    "errors": null,
                                    "filename": null,
                                    "raw_function": null,
                                    "image_addr": null,
                                    "instruction_addr": null,
                                    "addr_mode": null,
                                    "lineno": null,
                                    "platform": null,
                                    "post_context": null,
                                    "pre_context": null,
                                    "symbol": null,
                                    "symbol_addr": null,
                                    "trust": null,
                                    "vars": null,
                                    "snapshot": null
                                },
                                {
                                    "function": "SwitchInstance",
                                    "module": "DepFac.ProPilot.Core.Global.GlobalContext",
                                    "package": "DepFac.ProPilot.Core, Version=3.20.10.0, Culture=neutral, PublicKeyToken=null",
                                    "in_app": true,
                                    "abs_path": null,
                                    "colno": null,
                                    "context_line": null,
                                    "data": null,
                                    "errors": null,
                                    "filename": null,
                                    "raw_function": null,
                                    "image_addr": null,
                                    "instruction_addr": null,
                                    "addr_mode": null,
                                    "lineno": null,
                                    "platform": null,
                                    "post_context": null,
                                    "pre_context": null,
                                    "symbol": null,
                                    "symbol_addr": null,
                                    "trust": null,
                                    "vars": null,
                                    "snapshot": null
                                },
                                {
                                    "function": ".ctor",
                                    "module": "DepFac.ProPilot.Core.Instances.ProPilotContext",
                                    "package": "DepFac.ProPilot.Core, Version=3.20.10.0, Culture=neutral, PublicKeyToken=null",
                                    "in_app": true,
                                    "abs_path": null,
                                    "colno": null,
                                    "context_line": null,
                                    "data": null,
                                    "errors": null,
                                    "filename": null,
                                    "raw_function": null,
                                    "image_addr": null,
                                    "instruction_addr": null,
                                    "addr_mode": null,
                                    "lineno": null,
                                    "platform": null,
                                    "post_context": null,
                                    "pre_context": null,
                                    "symbol": null,
                                    "symbol_addr": null,
                                    "trust": null,
                                    "vars": null,
                                    "snapshot": null
                                },
                                {
                                    "function": "RetrieveInstanceContainer",
                                    "module": "DepFac.ProPilot.Core.Global.Repositories.InstanceRepository",
                                    "package": "DepFac.ProPilot.Core, Version=3.20.10.0, Culture=neutral, PublicKeyToken=null",
                                    "in_app": true,
                                    "abs_path": null,
                                    "colno": null,
                                    "context_line": null,
                                    "data": null,
                                    "errors": null,
                                    "filename": null,
                                    "raw_function": null,
                                    "image_addr": null,
                                    "instruction_addr": null,
                                    "addr_mode": null,
                                    "lineno": null,
                                    "platform": null,
                                    "post_context": null,
                                    "pre_context": null,
                                    "symbol": null,
                                    "symbol_addr": null,
                                    "trust": null,
                                    "vars": null,
                                    "snapshot": null
                                },
                                {
                                    "function": "GetInstanceByName",
                                    "module": "DepFac.ProPilot.Core.Global.Repositories.InstanceRepository",
                                    "package": "DepFac.ProPilot.Core, Version=3.20.10.0, Culture=neutral, PublicKeyToken=null",
                                    "in_app": true,
                                    "abs_path": null,
                                    "colno": null,
                                    "context_line": null,
                                    "data": null,
                                    "errors": null,
                                    "filename": null,
                                    "raw_function": null,
                                    "image_addr": null,
                                    "instruction_addr": null,
                                    "addr_mode": null,
                                    "lineno": null,
                                    "platform": null,
                                    "post_context": null,
                                    "pre_context": null,
                                    "symbol": null,
                                    "symbol_addr": null,
                                    "trust": null,
                                    "vars": null,
                                    "snapshot": null
                                }
                            ]
                        },
                        "thread_id": 47
                    }
                ]
            },
            "tags": [
                [
                    "server_name",
                    "UAT-PPL"
                ],
                [
                    "level",
                    "error"
                ],
                [
                    "logger",
                    "DepFac.ProPilot.ASP.Common.Controllers.Global.BaseController"
                ],
                [
                    "environment",
                    "Acceptance"
                ],
                [
                    "sentry:release",
                    "propilot@3.20.10"
                ],
                [
                    "url",
                    "http://dummy.domain.com/wp-login.php"
                ],
                [
                    "browser",
                    "Firefox 101.0"
                ],
                [
                    "browser.name",
                    "Firefox"
                ],
                [
                    "client_os",
                    "Windows 10"
                ],
                [
                    "client_os.name",
                    "Windows"
                ],
                [
                    "server-os",
                    "Windows 10"
                ],
                [
                    "server-os.name",
                    "Windows"
                ],
                [
                    "server-runtime",
                    ".NET Framework 4.8"
                ],
                [
                    "server-runtime.name",
                    ".NET Framework"
                ]
            ],
            "extra": {
                "ClassName": "DepFac.ProPilot.ASP.Common.Controllers.Global.BaseController",
                "Core_Version": "3.20.10.0",
                "Domain": "/LM/W3SVC/1/ROOT-1-132987040413368077",
                "MethodName": "OnException",
                "ThreadName": "47",
                "log4net-level": "ERROR"
            },
            "sdk": {
                "name": "sentry.dotnet.log4net",
                "version": "2.1.8",
                "packages": [
                    {
                        "name": "nuget:Sentry",
                        "version": "2.1.8"
                    },
                    {
                        "name": "nuget:Sentry.Log4Net",
                        "version": "2.1.8"
                    }
                ],
                "integrations": null
            },
            "key_id": "19",
            "project": 19,
            "grouping_config": {
                "enhancements": "eJybzDRxY3J-bm5-npWRgaGlroGxrpHxBABcYgcZ",
                "id": "newstyle:2019-10-29"
            },
            "_metrics": {
                "bytes.ingested.event": 9496,
                "bytes.stored.event": 13130
            },
            "fingerprint": [
                "{{ default }}"
            ],
            "hashes": [
                "95d88c342428afbe17a37158c7bbe30f",
                "f2db7aee511f144691883bff5018ffc3"
            ],
            "culprit": "DepFac.ProPilot.Core.Global.Repositories.InstanceRepository in GetInstanceByName",
            "metadata": {
                "value": "Instance with name 'wp-login.php' not found",
                "type": "DepFac.ProPilot.Core.Exceptions.NotFoundException",
                "function": "GetInstanceByName",
                "display_title_with_tree_label": false
            },
            "title": "DepFac.ProPilot.Core.Exceptions.NotFoundException: Instance with name 'wp-login.php' not found",
            "location": null,
            "_ref": 19,
            "_ref_version": 2,
            "nodestore_insert": 1654244393.185044
        },
        "primary_hash": "95d88c342428afbe17a37158c7bbe30f",
        "retention_days": null
    },
    {
        "is_new": false,
        "is_regression": null,
        "is_new_group_environment": false,
        "skip_consume": false
    }
]

To give more context, we see that sentry continue to receive errors in the Usage Stats view but issues does not appear in project views since the update for all our projects (we have several projects using different SDK : .NET (core), angular, python, ruby).

Thanks for providing the additional information. I have added a bug label to the issue and we will work on the fix on our end.

pierresebastien commented 2 years ago

I tried to update my on premise sentry to version 22.6.0 but the issue remains. I check the version used for snuba and it was also version 22.6.0 which should contains your commit according the commit history of this repository.

Like described in the sdk section of the event that I posted earlier, I'm using a quite old version of Sentry.Log4Net package (late 2020 version). Do you think that the error may disappear if I update the library ? If not, could you give me some hint to try to gather more information on my side?

Many thanks in advance

larsnystrom commented 2 years ago

I'm also still having this issue on 22.6.0 and can also confirm it contains the change from #2809. I'm not using Sentry.Log4Net so I don't think the issue is there. I'm not a Python developer but I assume either settings.DEFAULT_RETENTION_DAYS or settings.LOWER_RETENTION_DAYS is a string and not an int.

https://github.com/getsentry/snuba/blob/28891df3665989ec10e051362dbb84f94aea2f1a/snuba/datasets/events_format.py#L116-L127

Edit: Solution: I started a shell in the snuba-consumer container with docker-compose exec -u root snuba-consumer bash -l, installed nano and then edited snuba/datasets/events_format.py adding the line retention_days = int(retention_days) after line 127 and can confirm that this solves the issue for me.

pierresebastien commented 2 years ago

Hello, I just update my on premise Sentry to version 22.7.0 and the issue is still present. Could you consider applying the solution provided by @larsnystrom ? I can apply it myself on my instance but I would have to do it after each upgrade of Sentry (so each month)

ethanhs commented 1 year ago

Hey @MeredithAnya it seems that #2809 did not completely fix the retention days variable not always being an integer :/

It seems people are still hitting issues on the latest version of self-hosted Sentry.. Perhaps we can re-open this to track further issues? Let me know if I can be of help in fixing these issues.