Downloaded everything but crashes my arcpro

hmd2380 commented 2 years ago

I am looking to use the deep learning package for building footprints so I downloaded this framework as well, as instructed. I followed each step correctly but now when I go to run the package and load it into "detect objects using deep learning" it completely crashes my arcpro. I don't even have an option to report it. Any ideas why this is happening?

cleebp commented 2 years ago

Sorry to hear that, could you provide more information about your system like what version of arcgis pro you have installed?

scdub commented 2 years ago

@hmd2380 If you're still having issues, can you provide some information as @cleebp had requested, or let us know if you've been able to address this problem already? Thanks!

cleebp commented 2 years ago

Closing as non-repo, @hmd2380 if you can provide any steps or further information we can take a look.

johnsonc-EsriCA commented 1 year ago

I am encountering the same issue. Fresh install of Pro 3.1 and associated version of the deep learning libraries. Trying to run "Detect Objects with Deep Learning" and Pro crashes out/shuts down almost right away. I am wondering if it's because my CPU is AMD instead of Intel. My specs:

OS: Windows 11 CPU: AMD Ryzen 7 3700X RAM: 32GB GPU: NVIDIA GeForce RTX 3060 Ti

Any advise would be appreciated!

scdub commented 1 year ago

@johnsonc-EsriCA Are the crashes detected by the application and are you creating crash dumps? If so, please make sure you include your email address in the submission and I can look them up. I'm not aware of anything known currently which would cause this immediate crash.

ecodynlab commented 1 year ago

Same problem here. Fresh install of ArGISPro 3.1 and dependencies. The application crashes the moment the .dlpk is specified. No dialog or crash dump in C:\Users\\AppData\Local\ESRI\ErrorReports.

johnsonc-EsriCA commented 1 year ago

@scdub, I've emailed your Esri Inc email with a couple of crash dump files last week (from my Esri Canada email). Would you please confirm if you have received them? Thanks for looking into this issue.

scdub commented 1 year ago

@johnsonc-EsriCA Based on your crashdump, it looks like there is an invalid interaction with the Python GIL that is occurring causing the crash. Could you confirm you're using the building footprints USA DLPK? Could you try a couple of things to help isolate this issue? Could you see if it reproduces outside of the Pro application (e.g. running from standalone Python or a Notebook). Secondarily, could you see if temporarily removing data interoperability has any effect on the output?

johnsonc-EsriCA commented 1 year ago

Hi Shaun,

Yes I am using the Building Footprints USA DLPK. I did another test on an internal testing VM and it looks like I was able to load the model definition successfully:

@.***

The Pro here is 3.1.1 and has Data Interop installed as well. So it appears something on my own machine is causing the invalidity with the Python GIL.

Johnson

From: Shaun Walbridge @.> Sent: April 24, 2023 20:35 To: Esri/deep-learning-frameworks @.> Cc: Johnson Chan @.>; Mention @.> Subject: Re: [Esri/deep-learning-frameworks] Downloaded everything but crashes my arcpro (Issue #46)

EXTERNAL

@johnsonc-EsriCAhttps://urldefense.com/v3/__https:/github.com/johnsonc-EsriCA__;!!G_POQyfmwzJ5ZCxH!HXPfAUG_mvT7423iRy5Lo-CbCAMHx46SCT3QrFSWUKJyOVgls-4RuebcsmS3J1eeuAjG2fuBmyQ00w_hEnS326U$ Based on your crashdump, it looks like there is an invalid interaction with the Python GIL that is occurring causing the crash. Could you confirm you're using the building footprints USA DLPK? Could you try a couple of things to help isolate this issue? Could you see if it reproduces outside of the Pro application (e.g. running from standalone Python or a Notebook). Secondarily, could you see if temporarily removing data interoperability has any effect on the output?

— Reply to this email directly, view it on GitHubhttps://urldefense.com/v3/__https:/github.com/Esri/deep-learning-frameworks/issues/46*issuecomment-1521111824__;Iw!!G_POQyfmwzJ5ZCxH!HXPfAUG_mvT7423iRy5Lo-CbCAMHx46SCT3QrFSWUKJyOVgls-4RuebcsmS3J1eeuAjG2fuBmyQ00w_hKtPf0hE$, or unsubscribehttps://urldefense.com/v3/__https:/github.com/notifications/unsubscribe-auth/A4GSBE2VHNGOFI4GCEORFG3XC5A7LANCNFSM5RJTHWGQ__;!!G_POQyfmwzJ5ZCxH!HXPfAUG_mvT7423iRy5Lo-CbCAMHx46SCT3QrFSWUKJyOVgls-4RuebcsmS3J1eeuAjG2fuBmyQ00w_hPT1F6dE$. You are receiving this because you were mentioned.Message ID: @.**@.>>

Confidentiality Notice: This message may be confidential and is intended only for the named recipients. If you received this in error, please notify the sender and delete the message.

Avis de confidentialité: Ce message peut être confidentiel ; il est destiné uniquement pour les destinataires qui y sont désignés. Si vous avez reçu un message par erreur, nous vous prions d'en aviser l'expéditeur et d’effacer le message.

If you no longer wish to receive emails from Esri Canada, unsubscribe herehttps://www.esri.ca/en-ca/communications/unsubscribe. Privacy Policyhttps://www.esri.ca/en-ca/legal/privacy

Si vous ne désirez plus recevoir de courriels d’Esri Canada, veuillez vous désinscrire icihttps://www.esri.ca/fr-ca/communications/unsubscribe. Politique de confidentialitéhttps://www.esri.ca/fr-ca/legal/privacy

Esri Canada | 12 Concorde Place | Suite 900 | Toronto, ON | M3C 3R8

johnsonc-EsriCA commented 1 year ago

Any advice would be appreciated.

Thanks,

Johnson

From: Johnson Chan Sent: April 25, 2023 10:31 To: Esri/deep-learning-frameworks @.>; Esri/deep-learning-frameworks @.> Cc: Mention @.***> Subject: RE: [Esri/deep-learning-frameworks] Downloaded everything but crashes my arcpro (Issue #46)

Hi Shaun,

Yes I am using the Building Footprints USA DLPK. I did another test on an internal testing VM and it looks like I was able to load the model definition successfully:

@.***

The Pro here is 3.1.1 and has Data Interop installed as well. So it appears something on my own machine is causing the invalidity with the Python GIL.

Johnson

From: Shaun Walbridge @.**@.>> Sent: April 24, 2023 20:35 To: Esri/deep-learning-frameworks @.**@.>> Cc: Johnson Chan @.**@.>>; Mention @.**@.>> Subject: Re: [Esri/deep-learning-frameworks] Downloaded everything but crashes my arcpro (Issue #46)

EXTERNAL

@johnsonc-EsriCAhttps://urldefense.com/v3/__https:/github.com/johnsonc-EsriCA__;!!G_POQyfmwzJ5ZCxH!HXPfAUG_mvT7423iRy5Lo-CbCAMHx46SCT3QrFSWUKJyOVgls-4RuebcsmS3J1eeuAjG2fuBmyQ00w_hEnS326U$ Based on your crashdump, it looks like there is an invalid interaction with the Python GIL that is occurring causing the crash. Could you confirm you're using the building footprints USA DLPK? Could you try a couple of things to help isolate this issue? Could you see if it reproduces outside of the Pro application (e.g. running from standalone Python or a Notebook). Secondarily, could you see if temporarily removing data interoperability has any effect on the output?

— Reply to this email directly, view it on GitHubhttps://urldefense.com/v3/__https:/github.com/Esri/deep-learning-frameworks/issues/46*issuecomment-1521111824__;Iw!!G_POQyfmwzJ5ZCxH!HXPfAUG_mvT7423iRy5Lo-CbCAMHx46SCT3QrFSWUKJyOVgls-4RuebcsmS3J1eeuAjG2fuBmyQ00w_hKtPf0hE$, or unsubscribehttps://urldefense.com/v3/__https:/github.com/notifications/unsubscribe-auth/A4GSBE2VHNGOFI4GCEORFG3XC5A7LANCNFSM5RJTHWGQ__;!!G_POQyfmwzJ5ZCxH!HXPfAUG_mvT7423iRy5Lo-CbCAMHx46SCT3QrFSWUKJyOVgls-4RuebcsmS3J1eeuAjG2fuBmyQ00w_hPT1F6dE$. You are receiving this because you were mentioned.Message ID: @.**@.>>

Confidentiality Notice: This message may be confidential and is intended only for the named recipients. If you received this in error, please notify the sender and delete the message.

Avis de confidentialité: Ce message peut être confidentiel ; il est destiné uniquement pour les destinataires qui y sont désignés. Si vous avez reçu un message par erreur, nous vous prions d'en aviser l'expéditeur et d’effacer le message.

If you no longer wish to receive emails from Esri Canada, unsubscribe herehttps://www.esri.ca/en-ca/communications/unsubscribe. Privacy Policyhttps://www.esri.ca/en-ca/legal/privacy

Si vous ne désirez plus recevoir de courriels d’Esri Canada, veuillez vous désinscrire icihttps://www.esri.ca/fr-ca/communications/unsubscribe. Politique de confidentialitéhttps://www.esri.ca/fr-ca/legal/privacy

Esri Canada | 12 Concorde Place | Suite 900 | Toronto, ON | M3C 3R8

johnsonc-EsriCA commented 1 year ago

Good day,

Just would like to see if you’ve had time to take a further look at this issue.

Thanks!

Johnson

From: Johnson Chan Sent: April 27, 2023 14:55 To: Esri/deep-learning-frameworks @.>; Esri/deep-learning-frameworks @.> Cc: Mention @.***> Subject: RE: [Esri/deep-learning-frameworks] Downloaded everything but crashes my arcpro (Issue #46)

Any advice would be appreciated.

Thanks,

Johnson

From: Johnson Chan Sent: April 25, 2023 10:31 To: Esri/deep-learning-frameworks @.**@.>>; Esri/deep-learning-frameworks @.**@.>> Cc: Mention @.**@.>> Subject: RE: [Esri/deep-learning-frameworks] Downloaded everything but crashes my arcpro (Issue #46)

Hi Shaun,

Yes I am using the Building Footprints USA DLPK. I did another test on an internal testing VM and it looks like I was able to load the model definition successfully:

@.***

The Pro here is 3.1.1 and has Data Interop installed as well. So it appears something on my own machine is causing the invalidity with the Python GIL.

Johnson

From: Shaun Walbridge @.**@.>> Sent: April 24, 2023 20:35 To: Esri/deep-learning-frameworks @.**@.>> Cc: Johnson Chan @.**@.>>; Mention @.**@.>> Subject: Re: [Esri/deep-learning-frameworks] Downloaded everything but crashes my arcpro (Issue #46)

EXTERNAL

@johnsonc-EsriCAhttps://urldefense.com/v3/__https:/github.com/johnsonc-EsriCA__;!!G_POQyfmwzJ5ZCxH!HXPfAUG_mvT7423iRy5Lo-CbCAMHx46SCT3QrFSWUKJyOVgls-4RuebcsmS3J1eeuAjG2fuBmyQ00w_hEnS326U$ Based on your crashdump, it looks like there is an invalid interaction with the Python GIL that is occurring causing the crash. Could you confirm you're using the building footprints USA DLPK? Could you try a couple of things to help isolate this issue? Could you see if it reproduces outside of the Pro application (e.g. running from standalone Python or a Notebook). Secondarily, could you see if temporarily removing data interoperability has any effect on the output?

— Reply to this email directly, view it on GitHubhttps://urldefense.com/v3/__https:/github.com/Esri/deep-learning-frameworks/issues/46*issuecomment-1521111824__;Iw!!G_POQyfmwzJ5ZCxH!HXPfAUG_mvT7423iRy5Lo-CbCAMHx46SCT3QrFSWUKJyOVgls-4RuebcsmS3J1eeuAjG2fuBmyQ00w_hKtPf0hE$, or unsubscribehttps://urldefense.com/v3/__https:/github.com/notifications/unsubscribe-auth/A4GSBE2VHNGOFI4GCEORFG3XC5A7LANCNFSM5RJTHWGQ__;!!G_POQyfmwzJ5ZCxH!HXPfAUG_mvT7423iRy5Lo-CbCAMHx46SCT3QrFSWUKJyOVgls-4RuebcsmS3J1eeuAjG2fuBmyQ00w_hPT1F6dE$. You are receiving this because you were mentioned.Message ID: @.**@.>>

Confidentiality Notice: This message may be confidential and is intended only for the named recipients. If you received this in error, please notify the sender and delete the message.

Avis de confidentialité: Ce message peut être confidentiel ; il est destiné uniquement pour les destinataires qui y sont désignés. Si vous avez reçu un message par erreur, nous vous prions d'en aviser l'expéditeur et d’effacer le message.

If you no longer wish to receive emails from Esri Canada, unsubscribe herehttps://www.esri.ca/en-ca/communications/unsubscribe. Privacy Policyhttps://www.esri.ca/en-ca/legal/privacy

Si vous ne désirez plus recevoir de courriels d’Esri Canada, veuillez vous désinscrire icihttps://www.esri.ca/fr-ca/communications/unsubscribe. Politique de confidentialitéhttps://www.esri.ca/fr-ca/legal/privacy

Esri Canada | 12 Concorde Place | Suite 900 | Toronto, ON | M3C 3R8

scdub commented 1 year ago

@johnsonc-EsriCA I was able to look at the crash dumps, but unfortunately they don't contain enough information to isolate the cause of the issue. Could you help isolate causes by trying these things on the affected machine?

Could you see if it reproduces outside of the Pro application (e.g. running from standalone Python or a Notebook). Secondarily, could you see if temporarily removing data interoperability has any effect on the output?

Thanks! Shaun

johnsonc-EsriCA commented 1 year ago

Hi Shaun,

Yes I am using the Building Footprints USA DLPK. I did another test on an internal testing VM and it looks like I was able to load the model definition successfully:

@.***

The Pro here on the VM is 3.1.1 and has Data Interop installed as well. So it appears something on my own machine is causing the invalidity with the Python GIL. So I am trying to figure out what it is on my machine that is causing this. I’ve tried other dlpks and they seem to load just fine without crashing on my machine. To give more info, I do have the latest Python installed on my machine (3.11.3) and I am not sure if it is conflicting with the Python version that comes with Pro, although since the Pro version of Python is in a conda-based read-only environment, it shouldn’t matter.

Johnson

From: Shaun Walbridge @.> Sent: May 5, 2023 16:18 To: Esri/deep-learning-frameworks @.> Cc: Johnson Chan @.>; Mention @.> Subject: Re: [Esri/deep-learning-frameworks] Downloaded everything but crashes my arcpro (Issue #46)

EXTERNAL

@johnsonc-EsriCAhttps://urldefense.com/v3/__https:/github.com/johnsonc-EsriCA__;!!G_POQyfmwzJ5ZCxH!D5MVGrcUVSjQbvLIzLN4Nq9HqF9ptcBLgop07d4bS5JQFPQjnW6E4GVbrGLL3CoBqMc0tiFuiuUTF7GVbvcalhE$ I was able to look at the crash dumps, but unfortunately they don't contain enough information to isolate the cause of the issue. Could you help isolate causes by trying these things on the affected machine?

Could you see if it reproduces outside of the Pro application (e.g. running from standalone Python or a Notebook). Secondarily, could you see if temporarily removing data interoperability has any effect on the output?

Thanks! Shaun

— Reply to this email directly, view it on GitHubhttps://urldefense.com/v3/__https:/github.com/Esri/deep-learning-frameworks/issues/46*issuecomment-1536892925__;Iw!!G_POQyfmwzJ5ZCxH!D5MVGrcUVSjQbvLIzLN4Nq9HqF9ptcBLgop07d4bS5JQFPQjnW6E4GVbrGLL3CoBqMc0tiFuiuUTF7GVTOJuEqc$, or unsubscribehttps://urldefense.com/v3/__https:/github.com/notifications/unsubscribe-auth/A4GSBE47PUBHMLHAT7PBAZ3XEWDAVANCNFSM5RJTHWGQ__;!!G_POQyfmwzJ5ZCxH!D5MVGrcUVSjQbvLIzLN4Nq9HqF9ptcBLgop07d4bS5JQFPQjnW6E4GVbrGLL3CoBqMc0tiFuiuUTF7GVZMsec4M$. You are receiving this because you were mentioned.Message ID: @.**@.>>

Confidentiality Notice: This message may be confidential and is intended only for the named recipients. If you received this in error, please notify the sender and delete the message.

Avis de confidentialité: Ce message peut être confidentiel ; il est destiné uniquement pour les destinataires qui y sont désignés. Si vous avez reçu un message par erreur, nous vous prions d'en aviser l'expéditeur et d’effacer le message.

If you no longer wish to receive emails from Esri Canada, unsubscribe herehttps://www.esri.ca/en-ca/communications/unsubscribe. Privacy Policyhttps://www.esri.ca/en-ca/legal/privacy

Si vous ne désirez plus recevoir de courriels d’Esri Canada, veuillez vous désinscrire icihttps://www.esri.ca/fr-ca/communications/unsubscribe. Politique de confidentialitéhttps://www.esri.ca/fr-ca/legal/privacy

Esri Canada | 12 Concorde Place | Suite 900 | Toronto, ON | M3C 3R8

scdub commented 1 year ago

I wouldn't expect an issue with a separate Python installation, especially of a different version. Could you try to reproduce the issue outside of the Pro application? I know its a pain, but separately it also is worth trying to temporarily uninstall DI to see if there is any effect, independently of it executing correctly on your other machine.

johnsonc-EsriCA commented 1 year ago

Sounds good Shaun I can try to do it outside of my Pro for testing. Do you happened to have a sample notebook/script that I can use to test run the Building Footprints USA model in Jypyter?

Thanks!

Johnson

From: Shaun Walbridge @.> Sent: Friday, May 5, 2023 4:39 PM To: Esri/deep-learning-frameworks @.> Cc: Johnson Chan @.>; Mention @.> Subject: Re: [Esri/deep-learning-frameworks] Downloaded everything but crashes my arcpro (Issue #46)

EXTERNAL

I wouldn't expect an issue with a separate Python installation, especially of a different version. Could you try to reproduce the issue outside of the Pro application? I know its a pain, but separately it also is worth trying to temporarily uninstall DI to see if there is any effect, independently of it executing correctly on your other machine.

— Reply to this email directly, view it on GitHubhttps://urldefense.com/v3/__https:/github.com/Esri/deep-learning-frameworks/issues/46*issuecomment-1536907085__;Iw!!G_POQyfmwzJ5ZCxH!DC_dnYjUcoIPShmlwdLgZfPcaQ7k_bCxct6WF8Vysmy6YCbsFwK10jDGn5K3XvFq7mcLy8Rj_YzF8B_BkLL0dTM$, or unsubscribehttps://urldefense.com/v3/__https:/github.com/notifications/unsubscribe-auth/A4GSBE2OXSPWYIKGORZ7LOTXEWFQJANCNFSM5RJTHWGQ__;!!G_POQyfmwzJ5ZCxH!DC_dnYjUcoIPShmlwdLgZfPcaQ7k_bCxct6WF8Vysmy6YCbsFwK10jDGn5K3XvFq7mcLy8Rj_YzF8B_BKPhEWzY$. You are receiving this because you were mentioned.Message ID: @.**@.>>

Confidentiality Notice: This message may be confidential and is intended only for the named recipients. If you received this in error, please notify the sender and delete the message.

Avis de confidentialité: Ce message peut être confidentiel ; il est destiné uniquement pour les destinataires qui y sont désignés. Si vous avez reçu un message par erreur, nous vous prions d'en aviser l'expéditeur et d’effacer le message.

If you no longer wish to receive emails from Esri Canada, unsubscribe herehttps://www.esri.ca/en-ca/communications/unsubscribe. Privacy Policyhttps://www.esri.ca/en-ca/legal/privacy

Si vous ne désirez plus recevoir de courriels d’Esri Canada, veuillez vous désinscrire icihttps://www.esri.ca/fr-ca/communications/unsubscribe. Politique de confidentialitéhttps://www.esri.ca/fr-ca/legal/privacy

Esri Canada | 12 Concorde Place | Suite 900 | Toronto, ON | M3C 3R8

scdub commented 1 year ago

You can take one of the failed runs from the History pane, and export it to a Python command:

From that, you can paste that command into a standalone Notebook or Python session and it should execute the same model analysis without Pro.

johnsonc-EsriCA commented 1 year ago

Hi Shaun,

The problem is that when I tried to add in the dlpk into the Detect Objects tool, it crashed out of Pro. So there was no failed run.

Thanks,

Johnson

From: Shaun Walbridge @.> Sent: Friday, May 19, 2023 8:55 AM To: Esri/deep-learning-frameworks @.> Cc: Johnson Chan @.>; Mention @.> Subject: Re: [Esri/deep-learning-frameworks] Downloaded everything but crashes my arcpro (Issue #46)

EXTERNAL

You can take one of the failed runs from the History pane, and export it to a Python command:

[image]https://urldefense.com/v3/__https:/user-images.githubusercontent.com/46331011/239578531-bb9dc717-28d2-4702-8884-f5f998f24100.png__;!!G_POQyfmwzJ5ZCxH!Cbt8KIBJ8L_wbDdsEdewA3lPXnQ7eutRMuvNMLuASm8dcddB1Y2ludPjoch8hrl5QJ-5PXR4jTimzDpMbo8JytM$

From that, you can paste that command into a standalone Notebook or Python session and it should execute the same model analysis without Pro.

— Reply to this email directly, view it on GitHubhttps://urldefense.com/v3/__https:/github.com/Esri/deep-learning-frameworks/issues/46*issuecomment-1554783674__;Iw!!G_POQyfmwzJ5ZCxH!Cbt8KIBJ8L_wbDdsEdewA3lPXnQ7eutRMuvNMLuASm8dcddB1Y2ludPjoch8hrl5QJ-5PXR4jTimzDpM0LIYHCk$, or unsubscribehttps://urldefense.com/v3/__https:/github.com/notifications/unsubscribe-auth/A4GSBE7NYD7LDSJ52QH4D2LXG6JTZANCNFSM5RJTHWGQ__;!!G_POQyfmwzJ5ZCxH!Cbt8KIBJ8L_wbDdsEdewA3lPXnQ7eutRMuvNMLuASm8dcddB1Y2ludPjoch8hrl5QJ-5PXR4jTimzDpMlpLhJAs$. You are receiving this because you were mentioned.Message ID: @.**@.>>

Confidentiality Notice: This message may be confidential and is intended only for the named recipients. If you received this in error, please notify the sender and delete the message.

Avis de confidentialité: Ce message peut être confidentiel ; il est destiné uniquement pour les destinataires qui y sont désignés. Si vous avez reçu un message par erreur, nous vous prions d'en aviser l'expéditeur et d’effacer le message.

If you no longer wish to receive emails from Esri Canada, unsubscribe herehttps://www.esri.ca/en-ca/communications/unsubscribe. Privacy Policyhttps://www.esri.ca/en-ca/legal/privacy

Si vous ne désirez plus recevoir de courriels d’Esri Canada, veuillez vous désinscrire icihttps://www.esri.ca/fr-ca/communications/unsubscribe. Politique de confidentialitéhttps://www.esri.ca/fr-ca/legal/privacy

Esri Canada | 12 Concorde Place | Suite 900 | Toronto, ON | M3C 3R8

scdub commented 1 year ago

OK — if you look at the code examples on the tool, you should be able to get a gist of how to make it into a Python script by changing the relevant paths to your own locations.

Esri / deep-learning-frameworks

Downloaded everything but crashes my arcpro #46