github-copilot-resources / copilot-metrics-viewer

Tool to visualize the Copilot metrics provided via the Copilot Business Metrics API (current in public beta)
https://ashy-sky-02a7d0403.5.azurestaticapps.net/
MIT License
215 stars 99 forks source link

NaNs from the usage API not returning totals for the last day #16

Closed raynervintervoll closed 2 months ago

raynervintervoll commented 2 months ago

Cumulatives / totals are giving not-a-number on our metric data. It seems to be due to the Usage API not returning totals for the last day in the extract. Not sure why not, I guess that might be a community question. Example:

{
        "day": "2024-04-23",
        "breakdown": [
            {
                "language": "java",
                "editor": "jetbrains",
                "suggestions_count": 56,
                "acceptances_count": 16,
                "lines_suggested": 99,
                "lines_accepted": 20,
                "active_users": 2
            },
            {
                "language": "kotlin",
                "editor": "jetbrains",
                "suggestions_count": 27,
                "acceptances_count": 8,
                "lines_suggested": 41,
                "lines_accepted": 7,
                "active_users": 2
            },
martedesco commented 2 months ago

Thanks for reporting it @raynervintervoll ! I am following this one up with the Engineering team.

raynervintervoll commented 2 months ago

Thanks a lot for following up. Perhaps worth mentioning that our org is also returning 0 for all days and fields related to Chat, which I am pretty sure isn't correct either.

martedesco commented 2 months ago

@raynervintervoll , the team has acknowledged the issue and has already fixed it. 🎉

Perhaps worth mentioning that our org is also returning 0 for all days and fields related to Chat, which I am pretty sure isn't correct either.

We only backfilled Chat data for the 23rd April, so historical Chat data won't be available.

I will close this issue meanwhile, feel free to re-open it if issue persists. 🙏🏼

raynervintervoll commented 2 months ago

@martedesco Thanks for your help, Marcio. The issue still persists due to the 23rd of April still missing the totals, the 24th is however fine. I am not able to re-open since I am not a collaborator.

{ "day": "2024-04-23", "breakdown": [ {

martedesco commented 2 months ago

@raynervintervoll , in this case it is better to create a support ticket as my colleagues from support will be able to check on this data for your organization.