Closed rbutterworth closed 2 years ago
rajyraman
commented
2 years ago @rbutterworth - This is the second report I am getting regarding the slow export. The main logic that exports records has not changed. So, I am wondering how it is slow. I changed the framework version, but it should not impact this. I will try to repro this. Are you in Online/OnPrem?
rbutterworth
commented
2 years ago We set it up as not IFD, as it is hosted in Azure by our provider, so it is like on-prem (but not).
Rob Butterworth Head of IT
Amadeus Capital Partners
-
T: +44 1223 707035
L: https://www.linkedin.com/in/robbutterworth/
W: https://www.amadeuscapital.com/
Insurtech Sprout.ai raises £8m Series A to help insurance companies settle claims within 24 hours (https://www.amadeuscapital.com/insurtech-sprout-ai-raises-8m-11m-to-respond-to-the-global-market-demand-for-their-solution/)
Amadeus Capital Partners Ltd is authorised and regulated by the Financial Conduct Authority. Registered office: Suite 1, 2nd Floor, 2 Quayside, Cambridge, CB5 8AB, UK. Registered in England no: 3392685. This message, together with any associated files, is confidential and only for the use of the intended addressee(s). If you are not the intended recipient, you must not disseminate, copy, distribute or use the information contained in this message, or any files associated with this message, as this is strictly prohibited and may be illegal. If you have received this message in error, please notify us at once by email to: @.*** and delete it from your system. Any views or opinions expressed by an individual within this email are the views and opinions of that individual and do not necessarily reflect the views or opinions of the company.
From: Natraj Yegnaraman @.> Sent: 13 November 2021 05:36 To: rajyraman/mscrmexporttoexcel @.> Cc: Rob Butterworth @.>; Mention @.> Subject: [External] Re: [rajyraman/mscrmexporttoexcel] Entities with large number of records takes too long (Issue #27)
@rbutterworthhttps://github.com/rbutterworth - This is the second report I am getting regarding the slow export. The main logic that exports records has not changed. So, I am wondering how it is slow. I changed the framework version, but it should not impact this. I will try to repro this. Are you in Online/OnPrem?
— You are receiving this because you were mentioned. Reply to this email directly, view it on GitHubhttps://github.com/rajyraman/mscrmexporttoexcel/issues/27#issuecomment-967786264, or unsubscribehttps://github.com/notifications/unsubscribe-auth/ABTE467T5WPYRKDYTLMAKMTULX2LBANCNFSM5H4LPSRQ. Triage notifications on the go with GitHub Mobile for iOShttps://apps.apple.com/app/apple-store/id1477376905?ct=notification-email&mt=8&pt=524675 or Androidhttps://play.google.com/store/apps/details?id=com.github.android&referrer=utm_campaign%3Dnotification-email%26utm_medium%3Demail%26utm_source%3Dgithub.
rajyraman
commented
2 years ago @rbutterworth - I pushed out a new version which is basically the old version which used to work. Please update and check.
rbutterworth
commented
2 years ago That works as before and is much quicker. I did a 20K record export in a couple of hours this morning, whereas the 34K record export I started yesterday on a machine running the new version (v3.0.1) is still running now, 24 hours later.
Rob
Rob Butterworth Head of IT
Amadeus Capital Partners , Cambridge, CB5 8AB
T: +44 1223 707035
L: https://www.linkedin.com/in/robbutterworth/
W: https://www.amadeuscapital.com/
Charco Neurotech raises $10m for non-invasive wearable device designed to ease Parkinson’s symptoms (https://www.amadeuscapital.com/charco-raises-10m-for-wearable-device-that-could-ease-parkinsons-symptoms-announces-european-parkinsons-disease-association-partnership/)
Amadeus Capital Partners Ltd is authorised and regulated by the Financial Conduct Authority. Registered office: Suite 1, 2nd Floor, 2 Quayside, Cambridge, CB5 8AB, UK. Registered in England no: 3392685. This message, together with any associated files, is confidential and only for the use of the intended addressee(s). If you are not the intended recipient, you must not disseminate, copy, distribute or use the information contained in this message, or any files associated with this message, as this is strictly prohibited and may be illegal. If you have received this message in error, please notify us at once by email to: @.*** and delete it from your system. Any views or opinions expressed by an individual within this email are the views and opinions of that individual and do not necessarily reflect the views or opinions of the company.
From: Natraj Yegnaraman @.> Sent: 23 November 2021 04:35 To: rajyraman/mscrmexporttoexcel @.> Cc: Rob Butterworth @.>; Mention @.> Subject: [External] Re: [rajyraman/mscrmexporttoexcel] Entities with large number of records takes too long (Issue #27)
@rbutterworthhttps://github.com/rbutterworth - I pushed out a new version which is basically the old version which used to work. Please update and check.
— You are receiving this because you were mentioned. Reply to this email directly, view it on GitHubhttps://github.com/rajyraman/mscrmexporttoexcel/issues/27#issuecomment-976162024, or unsubscribehttps://github.com/notifications/unsubscribe-auth/ABTE467D6O2DEZVVMY752GLUNMKVNANCNFSM5H4LPSRQ. Triage notifications on the go with GitHub Mobile for iOShttps://apps.apple.com/app/apple-store/id1477376905?ct=notification-email&mt=8&pt=524675 or Androidhttps://play.google.com/store/apps/details?id=com.github.android&referrer=utm_campaign%3Dnotification-email%26utm_medium%3Demail%26utm_source%3Dgithub.
rajyraman
commented
2 years ago @rbutterworth - Is the new version slower?
rbutterworth
commented
2 years ago The new ‘old style’ version is fine. I had left an export running using 3.0.1 (the last ‘new style’ version) and it was still sat there 2 days later. I am rerunning the same export in the latest (old style) version now, and will see if it completes in a couple of hours (which it looks like it will based on current progress)
Rob Butterworth Head of IT
Amadeus Capital Partners Suite 1, 2nd Floor, 2 Quayside, Cambridge, CB5 8AB
T: +44 1223 707035
L: https://www.linkedin.com/in/robbutterworth/
W: https://www.amadeuscapital.com/
Charco Neurotech raises $10m for non-invasive wearable device designed to ease Parkinson’s symptoms (https://www.amadeuscapital.com/charco-raises-10m-for-wearable-device-that-could-ease-parkinsons-symptoms-announces-european-parkinsons-disease-association-partnership/)
Amadeus Capital Partners Ltd is authorised and regulated by the Financial Conduct Authority. Registered office: Suite 1, 2nd Floor, 2 Quayside, Cambridge, CB5 8AB, UK. Registered in England no: 3392685. This message, together with any associated files, is confidential and only for the use of the intended addressee(s). If you are not the intended recipient, you must not disseminate, copy, distribute or use the information contained in this message, or any files associated with this message, as this is strictly prohibited and may be illegal. If you have received this message in error, please notify us at once by email to: @.*** and delete it from your system. Any views or opinions expressed by an individual within this email are the views and opinions of that individual and do not necessarily reflect the views or opinions of the company.
From: Natraj Yegnaraman @.> Sent: 24 November 2021 10:24 To: rajyraman/mscrmexporttoexcel @.> Cc: Rob Butterworth @.>; Mention @.> Subject: [External] Re: [rajyraman/mscrmexporttoexcel] Entities with large number of records takes too long (Issue #27)
@rbutterworthhttps://github.com/rbutterworth - Is the new version slower?
— You are receiving this because you were mentioned. Reply to this email directly, view it on GitHubhttps://github.com/rajyraman/mscrmexporttoexcel/issues/27#issuecomment-977738029, or unsubscribehttps://github.com/notifications/unsubscribe-auth/ABTE467GBCJ2NGQBRYYZ3HLUNS4MHANCNFSM5H4LPSRQ. Triage notifications on the go with GitHub Mobile for iOShttps://apps.apple.com/app/apple-store/id1477376905?ct=notification-email&mt=8&pt=524675 or Androidhttps://play.google.com/store/apps/details?id=com.github.android&referrer=utm_campaign%3Dnotification-email%26utm_medium%3Demail%26utm_source%3Dgithub.
rajyraman
commented
2 years ago @rbutterworth - In that case, I will try to go back to the old version of EPPlus and see if that improves the performance. The code that exports has not changed.
rajyraman
commented
2 years ago @rbutterworth - Tracked down the issue to a PR that I merged. The issue is caused due to Optionset value not cached. Fixed the issue in 3.0.3.
rbutterworth
commented
2 years ago Excellent, that’s great. Thanks
Rob Butterworth Head of IT
Amadeus Capital Partners Suite 1, 2nd Floor, 2 Quayside, Cambridge, CB5 8AB
T: +44 1223 707035
L: https://www.linkedin.com/in/robbutterworth/
W: https://www.amadeuscapital.com/
Charco Neurotech raises $10m for non-invasive wearable device designed to ease Parkinson’s symptoms (https://www.amadeuscapital.com/charco-raises-10m-for-wearable-device-that-could-ease-parkinsons-symptoms-announces-european-parkinsons-disease-association-partnership/)
Amadeus Capital Partners Ltd is authorised and regulated by the Financial Conduct Authority. Registered office: Suite 1, 2nd Floor, 2 Quayside, Cambridge, CB5 8AB, UK. Registered in England no: 3392685. This message, together with any associated files, is confidential and only for the use of the intended addressee(s). If you are not the intended recipient, you must not disseminate, copy, distribute or use the information contained in this message, or any files associated with this message, as this is strictly prohibited and may be illegal. If you have received this message in error, please notify us at once by email to: @.*** and delete it from your system. Any views or opinions expressed by an individual within this email are the views and opinions of that individual and do not necessarily reflect the views or opinions of the company.
From: Natraj Yegnaraman @.> Sent: Tuesday, November 30, 2021 9:34:23 PM To: rajyraman/mscrmexporttoexcel @.> Cc: Rob Butterworth @.>; Mention @.> Subject: [External] Re: [rajyraman/mscrmexporttoexcel] Entities with large number of records takes too long (Issue #27)
Closed #27https://github.com/rajyraman/mscrmexporttoexcel/issues/27.
— You are receiving this because you were mentioned. Reply to this email directly, view it on GitHubhttps://github.com/rajyraman/mscrmexporttoexcel/issues/27#event-5694886443, or unsubscribehttps://github.com/notifications/unsubscribe-auth/ABTE463H2MEFSXJMDFD2X4DUOU7N7ANCNFSM5H4LPSRQ. Triage notifications on the go with GitHub Mobile for iOShttps://apps.apple.com/app/apple-store/id1477376905?ct=notification-email&mt=8&pt=524675 or Androidhttps://play.google.com/store/apps/details?id=com.github.android&referrer=utm_campaign%3Dnotification-email%26utm_medium%3Demail%26utm_source%3Dgithub.
We are unable to get entities with lots of records to work since the last few updates. It used to take us 15 mins to export all the key entities from our entire system, it now takes hours, and the larger entities don't seem to ever complete...