DawidPotgieter / Dynamics-CRM-Binary-Storage-Options

A Dynamics CRM plugin to transparently store attachment binaries outside CRM database. Azure Blob or File storage for instance.
GNU Affero General Public License v3.0
34 stars 15 forks source link

Question with Dynamics 365 and checking CRM storage #10

Closed IT-NCSBE closed 6 years ago

IT-NCSBE commented 6 years ago

I've been testing your plug-in in our Sandbox instance and was wondering if there as a way to check that the documents aren't being stored in the CRM storage?

I've checked the Service Health tab for the instances and also tried the Advanced Find for Notes with a File Size (Bytes) filter and both seem to show that CRM storage is being used.

DawidPotgieter commented 6 years ago

Hi there,

Unfortunately, if you are using dynamics 365 version and you donโ€™t have access to the database, Iโ€™m not sure how you will check this.

However, you can rest assured that new (or migrated) attachments are stored in azure blob storage (or what you have configured) if you see the files appear in blob storage. The binary portion of the records (activitymimeannotation,attachment) are replaced with 3 character placeholder in CRM db.

You would need db access (look at MS sync plug in) or some number of documents to test with to see the effect where you are looking I think...

Incidentally.. The file size filter in advanced find will show you the file sizes as in blob storage. Wouldn't be a good plug in if it didn't redirect file size queries too ๐Ÿ˜Š

It is a good question though, I will see if I can find a better answer for you.

Sent from my Windows 10 phone


From: IT-NCSBE notifications@github.com Sent: Tuesday, May 8, 2018 2:25:28 AM To: DawidPotgieter/Dynamics-CRM-Binary-Storage-Options Cc: Subscribed Subject: [DawidPotgieter/Dynamics-CRM-Binary-Storage-Options] Question with Dynamics 365 and checking CRM storage (#10)

I've been testing your plug-in in our Sandbox instance and was wondering if there as a way to check that the documents aren't being stored in the CRM storage?

I've checked the Service Health tab for the instances and also tried the Advanced Find for Notes with a File Size (Bytes) filter and both seem to show that CRM storage is being used.

โ€” You are receiving this because you are subscribed to this thread. Reply to this email directly, view it on GitHubhttps://eur01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2FDawidPotgieter%2FDynamics-CRM-Binary-Storage-Options%2Fissues%2F10&data=02%7C01%7C%7C208ca398ed204764aa7a08d5b42662ee%7C84df9e7fe9f640afb435aaaaaaaaaaaa%7C1%7C0%7C636612999311961217&sdata=LsqhSj8De9o9y0vbu%2FE0gKFVRQerPhFHfObnMd%2BAAIA%3D&reserved=0, or mute the threadhttps://eur01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2Fnotifications%2Funsubscribe-auth%2FATktwE1r73xGeesuXLsVNyL5o2vvs4m3ks5twFlYgaJpZM4T1EAY&data=02%7C01%7C%7C208ca398ed204764aa7a08d5b42662ee%7C84df9e7fe9f640afb435aaaaaaaaaaaa%7C1%7C0%7C636612999311961217&sdata=w4jQXAhiFvNm%2FKeguXUIdQ1MCtlGtsbW%2BSc7RdNLiWY%3D&reserved=0.

IT-NCSBE commented 6 years ago

Thanks for the response, the whole "nobody will know" seems to be very well done. Gives it kind of a whole "don't look behind the curtain" kind of feeling to it. ๐Ÿ˜ƒ

davidbrabant commented 6 years ago

The two ways you can check are

  1. Use XRM Toolbox Use the FetchXML builder and look for the annotation entity. Query where the attribute isdocument = 1. Successful moves have a filesize of 3 if you selected it.
  2. Install Organisation Insights You can see all the table sizes and where the majority of space is being used. You can watch it go down as you move files
DawidPotgieter commented 6 years ago

Thanks David,

That helps a lot :) I will add this to the FAQ when I get a chance.

davidbrabant commented 6 years ago

Not a problem. We've now had the plugin running for a few months. Moved 400gb to Azure Blob using the migration tool which worked great. We spent a good 4months playing and trying scenarios and what could go wrong. Organisation Insights also gives you a good view into any Plug-in Failures too. One challenge we encountered was the tool moved the attachments using the account you logged in with to migrate. This meant all attachments were updated with today's date and my account. Didn't attempt to solve that but maybe another item for your FAQ.

DawidPotgieter commented 6 years ago

Cool, great to hear feedback :)

The account is the easiest thing to fix :) You just "Run As" the migration tool. Or hard code credentials if you're so inclined :0 Can't do anything about the auditing though.

P.S. Just checked the FetchXML in XRMToolbox option you mentioned.

So basically, what you will see :

The file size is the most annoying thing, because CRM puts 3 in there for email attachments regardless of what you specify. Regardless though, FileSize comes from the size of file in blob storage.