danniehansen / activity-timer

Activity timer powerup for Trello
MIT License
44 stars 9 forks source link

Unable to Export Data #138

Closed LightJordan closed 2 months ago

LightJordan commented 2 months ago

Hi, I'm unable to export the time-tracking data on Trello. It keeps asking me to authorize, and then it brings me back the same message. I've attached a screenshot of the message. I've done it so many times, even cleared my cache but to no avail. My team wants to switch to this powerup but this is a major issue. Any help?

Screenshot 2024-04-12 at 11 40 55
danniehansen commented 2 months ago

Hi @LightJordan,

I'll try to look into this issue on Monday. For the time being, would you be able to share with me which OS and version you're running? As well as browser and browser version? This will greatly increase my ability to investigate this issue.

LightJordan commented 2 months ago

Hi @danniehansen if you could fix it on Monday that would be amazing.

My OS is MacOS Ventura Version 13.3.1 and I open Trello on my Chrome browser, version 123.0.6312.124

Would be looking forward to updates please

LightJordan commented 2 months ago

Hi @danniehansen Are there any updates here, please?

danniehansen commented 2 months ago

@LightJordan No update yet. Monday is not over just yet :) At least not in Europe where I'm situated.

LightJordan commented 2 months ago

Haha sorry! Just a little under pressure and I reallyyyyy want this to be the powerup we need 😅

I'm in Europe as well - I'll wait!

danniehansen commented 2 months ago

@LightJordan I've tested the production version in a similar setup without any issues.

Have you tested the export functionality on a different device? Or in incognito? Or a third option a different browser?

Please try the above 3 and let me know the outcome.

I've seen anything from extensions to cause issues, internal firewalls to anti virus programs interrupting network requests. So the best chance to get clarity here is to narrow down the problem by trying all of the above 3 items.

Please let me know your findings. If the above 3 items does not work, then if you could do the following:

  1. Navigate to your board
  2. Right click and select 'Inspect'
  3. In the tabs within the developer window that opens you then select 'Console'.
  4. Now try and open the exporter, authorize and then take a screenshot of the developer console.

This will help me investigate the problem if none of the 3 alternative methods work.

LightJordan commented 2 months ago
Screenshot 2024-04-15 at 16 22 52 Screenshot 2024-04-15 at 16 23 10

Hi @danniehansen so I tried my Safari and Incognito but none of those worked. I've done the inspect bit and taken a screenshot for you to see the error message. I'll try a different device in a little bit

danniehansen commented 2 months ago

@LightJordan Can you, after you've tested on a different device, try to click "Clear RESTApi access" as shown in the below screen shot and then try again?

image

LightJordan commented 2 months ago

@danniehansen I just tried with another laptop, same issue.

Also I don't seem to have that option on mine, please see screenshot

Screenshot 2024-04-15 at 17 40 12
danniehansen commented 2 months ago

@LightJordan Alrighty. Looking at the docs it may be related to user access. Could you try to create a new workspace that is private to you, add the powerup and check there if it works? If it does, then It's most likely a user access configuration problem.

LightJordan commented 2 months ago

@danniehansen looks like we found the problem - it worked!

Now how do we fix this on the workspace with everybody?

danniehansen commented 2 months ago

@LightJordan Great news.

If you're the only one that needs access to this, then you could try and hear your Trello admin if your privileges can be increased to admin.

I'm not sure which configuration options are available for pro/enterprise Trello subscriptions as I'm only running on the free version. I could help analyse the problem further if you would be able to get a Trello workspace created separate with me invited to where i have the same privileges as you on your other workspace. This would allow me to investigate which permission issue is getting thrown.

My theory is that it's because this particular Trello powerup requires read-access to all of the cards on the workspace. Depending on which access control that there are in place on it, it could be problematic. But without a place to test this myself, i cannot know for sure and i cannot add support for it (if possible).

Let me know if you're able to provide such environment. Then I'd gladly look into it :+1:

LightJordan commented 2 months ago

@danniehansen I do have admin rights already so I'm not sure what the problem is.

It works in the workspace I've created, so I don't know if adding you there would be of any benefit. Would it?

If that's not possible, would you be able to show me where to look for the permission issues?

danniehansen commented 2 months ago

@LightJordan Under the same developer console as you found the "Console" tab there is also a "Network" tab. Here-under you'll find a sub-filter called "XHR". From there you'll find one or more red items listed after pressing the "Authorize" button. Clicking these to check their "Response" may yield more information for what went wrong.

Alternatively, I'll add a new release tomorrow that will help me retrieve this information in version 2.8.1. This will at the very least report this problem to my error tracking software and from there i may be able to see this information.

Manually locating it may provide with useful information that my error tracking tool cannot see. So that may still be a good choice.

LightJordan commented 2 months ago
Screenshot 2024-04-15 at 23 53 08

@danniehansen followed the steps, here's what I found

danniehansen commented 2 months ago

Ah that explains it! It appears i need to traverse the cards in chunks.

Give me a few hours and a solution should be in place

On Tue, Apr 16, 2024, 12:53 AM LightJordan @.***> wrote:

Screenshot.2024-04-15.at.23.53.08.png (view on web) https://github.com/danniehansen/activity-timer/assets/166816888/a9d89f5d-dcd3-4a40-ad36-338b6e0d3732

@danniehansen https://github.com/danniehansen followed the steps, here's what I found

— Reply to this email directly, view it on GitHub https://github.com/danniehansen/activity-timer/issues/138#issuecomment-2057945007, or unsubscribe https://github.com/notifications/unsubscribe-auth/AAI4JRF3HQUKHH5ANMVVSITY5RLAPAVCNFSM6AAAAABGD5CKBKVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMZDANJXHE2DKMBQG4 . You are receiving this because you were mentioned.Message ID: @.***>

LightJordan commented 2 months ago

@danniehansen alrighty! Please let me know when you have a solution :)

danniehansen commented 2 months ago

Waiting for a response from Trello on https://community.atlassian.com/t5/Trello-questions/Traverse-all-cards-in-board-through-RESTapi/qaq-p/2672212#M92227 as it appears that there is no documented way of traversing over all cards when you hit the limits from Trello. Let's see what they respond with :)

LightJordan commented 2 months ago

Right, okay. In the meantime, I can now see the “Clear RestAPI Access” option. Would that help at all?

On Tue, 16 Apr 2024 at 9:38 am, Dannie Hansen @.***> wrote:

Waiting for a response from Trello on https://community.atlassian.com/t5/Trello-questions/Traverse-all-cards-in-board-through-RESTapi/qaq-p/2672212#M92227 as it appears that there is no documented way of traversing over all cards when you hit the limits from Trello. Let's see what they respond with :)

— Reply to this email directly, view it on GitHub https://github.com/danniehansen/activity-timer/issues/138#issuecomment-2058549199, or unsubscribe https://github.com/notifications/unsubscribe-auth/BHYWY6H345AJPXI6NP5CE3LY5TPP7AVCNFSM6AAAAABGD5CKBKVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMZDANJYGU2DSMJZHE . You are receiving this because you were mentioned.Message ID: @.***>

--

Light Jordan-Akintoye

Senior Account Manager at Fame

https://www.fame.so/

Earn up to $5,000 per referral through the Fame Referral Program https://www.fame.so/referrals [image: 🎤]

danniehansen commented 2 months ago

@LightJordan That wouldn't help in this case no. We will have to wait what Trello answers :+1:

danniehansen commented 2 months ago

If Trello comes back and says there is no way to paginate the results of all cards on the board. Then i will add filtering such that you can choose to traverse all (open, closed, archived etc) which is the current default. or to only traverse those which is "open" and displayed on the board. By design, it traverses all as else you may lose cards for reporting if you close or archive cards that has technically had work done on them at intervals.

But let's see what they say.

LightJordan commented 2 months ago

@danniehansen I hope there's a way to fix it! We do need to be able to access archived cards. But if there's absolutely no way around that, then fine. We'll tweak our internal processes to work around that

LightJordan commented 2 months ago

Hi @danniehansen have you heard back yet?

LightJordan commented 2 months ago

Hey @danniehansen? Could I please get some sort of response today? I need to have this resolved by end of this week. I need to know if we've made any sort of progress please.

danniehansen commented 2 months ago

@LightJordan This is a spare-time project that I'm authoring for free with limitless usage. Please don't hold any expectations towards response times or turnovers for resolving issues or adding new features. I work on this in my spare time as I'm full-time employed elsewhere.

The project is OpenSource, so if you experience any problems or wish to request new features, you're more than welcome to contribute.

I have not yet had the time to digest the response i got on the community post on Trello. There are some news, but not the kind of news that will make this a suitable powerup for boards with 1000+ cards if mission critical data exists in archived cards. I will update this issue once i know more and have had the time to properly plan out how we want to support this with the limitations of Trello's API.

danniehansen commented 2 months ago

I'm out most of today, and my evening is planned out for another project. So i will at the earliest be able to see what can be done tomorrow. I will follow up tomorrow with my findings and plan for what we can do to help resolve this problem.

LightJordan commented 2 months ago

@danniehansen Okay, thank you.

We could work around the archived cards if there's no other option, so we don't need to place too much pressure on that.

Thank you for checking :)

danniehansen commented 2 months ago

@LightJordan Alrighty. Then it shouldn't be much of a problem with the solution that i have in mind. My idea is simply to catch the error that we've now seeing with fetching all across archived, closed and open cards, to then instead fetch them separately and just use those that it can find. That would make the upper limit 1000 entries for archived, closed or open cards. Once either of them exceed that limit, that "category" will then be ignored.

I'll follow up once the solution is planned :+1:

LightJordan commented 2 months ago

@danniehansen That could work, I think. Our plan is to do weekly reports of time logged, so I could do that report on Monday for the previous week, then move all done cards to archive. That way we have the data before archiving and that should keep us under the 1000 entry threshold.

Thank you

danniehansen commented 2 months ago

@LightJordan I've just now published some changes that for data exporters will fallback to fetch closed, open and visible cards separately when it reaches the 1.000 card limit. Can you try and see if it works for you now?

LightJordan commented 2 months ago

It works! @danniehansen ! Thank you so much!

When it hits 1,000 would we be able to filter between open and archived chats?

danniehansen commented 2 months ago

@LightJordan There are currently no filtering. It uses different APIs to scrape data. The intend is to fetch every possible card, and then based on the supplied filter narrow it down.

In your cause you could simply use the date range filtering as that is made based on the timestamps of the trackings. E.g. if you filter out 2024.03.01 - 2024.03.07, then it would only include all the cards that had trackings in this period, and only the individual trackings that overlapped with this date range.

LightJordan commented 2 months ago

Oh that's perfect, thank you so much!

danniehansen commented 2 months ago

No problem :) I will close this issue for now. Feel free to reopen if there are any issues with this :+1: