KingdomFirst / Excavator

We have now released Bulldozer on GitHub. Bulldozer is the super-powerful big brother to Excavator. Because Bulldozer is now published on GitHub we will no longer be supporting Excavator. Thank you for all the support here!
https://github.com/KingdomFirst/Bulldozer
19 stars 20 forks source link

CSV: Server 2012 R2 preventing plugins loading #111

Closed keithjbell closed 9 years ago

keithjbell commented 9 years ago

I have been unable to run excavator to do our first import of data to Rock. It keeps crashing. screenshot 2

dcs619 commented 9 years ago

That's actually a Windows permissions issue on the files. Can you set read/write folder permissions on the download and run it as administrator?

If the top bar is whited out, Windows is preventing the necessary plugins from being loaded.

keithjbell commented 9 years ago

I'm still missing something I guess. I download the "master-zip" file. Inside that folder what am I suppose to set the permissions on? I did try to run the "excavator application" as administrator but had the same results.

dcs619 commented 9 years ago

Can you right-click the unzipped folder and remove the Read-Only property? Windows sets this property by default for any downloaded files.
screenshot 2015-01-21 10 19 17

You might also need to set Execute permissions to Everyone on the Security tab.

keithjbell commented 9 years ago

It's still happening. I did notice that I uncheck the "read-only" and hit apply, then rechecking it after I close the dialog box it is rechecked.

dcs619 commented 9 years ago

What OS are you running?

On Wed, Jan 21, 2015 at 10:33 AM, keithjbell notifications@github.com wrote:

It's still happening. I did notice that I uncheck the "read-only" and hit apply, then rechecking it after I close the dialog box it is rechecked.

— Reply to this email directly or view it on GitHub https://github.com/NewSpring/Excavator/issues/111#issuecomment-70858144.

keithjbell commented 9 years ago

Server 2012 R2 Standard

dcs619 commented 9 years ago

Ok. I have a Server 2012 setup but I'll have to build a new version and test.

keithjbell commented 9 years ago

Ok. I didn't realize I was trying something this wasn't ready for. No worries. I've got a few weeks to get this import and training done. Keep me or this thread posted if possible. I don't want to hassle you unnecessarily. I appreciate your hard work. :) Thanks for the immediate responses

dcs619 commented 9 years ago

No worries...Excavator maintenance is a nights/weekends thing right now so it's a challenge to keep up with the pace of Rock releases and test against each one.

keithjbell commented 9 years ago

Any release plan for this yet? Just checking in... Thanks for the extra time and work to make this click. :)

dcs619 commented 9 years ago

@keithjbell I just pushed a new zip file, can you try it and see? I wasn't able to reproduce the permissions issue on my server.

dcs619 commented 9 years ago

@keithjbell Any further updates?

keithjbell commented 9 years ago

i tried very quickly the other day to do it but I may have missed a crucial step in opening up and launching it correctly. My plan is to try again tomorrow. I’m slammed with a couple video projects today. Thanks for your help and for checking in with me.

Keith Bell. Creative Arts Minister

Office: 417.673.1245 - ext.18

Cell: 1.918.919.2076

Email: keith@cartervillechristian.com

Twitter: keithjbell

Blog: Real-Time Tech

Watch Sermons Online

On Feb 24, 2015, at 12:31 PM, David Stevens notifications@github.com wrote:

@keithjbell Any further updates?

— Reply to this email directly or view it on GitHub.

keithjbell commented 9 years ago

I'm still having the same results. I followed the previous directions of taking "read only" permissions off of the downloaded folder. Any thoughts?

dcs619 commented 9 years ago

Does it look the same as the above screenshot?

keithjbell commented 9 years ago

ok... I just tried a couple steps that I believe may have got me somewhere. I right clicked on the zipped folder and chose properties. Then there was an "unblock" option in the lower corner of the dialog box. I clicked on that. Extracted folder. Right clicked on "excavator" extracted folder, properties. Unchecked "read only", apply. Right clicked on "excavator" application, "run as administrator" and it seems to be running ok. I'll let you know if I get snagged somewhere else. Thanks!

keithjbell commented 9 years ago

I spoke to soon... It crashed as soon as I tried to "connect" to the database server. I'm going to keep messing with it for the next 30 minutes or so.

dcs619 commented 9 years ago

Awesome!

The User Account Control (UAC) in Win7+ has been the biggest frustration running Excavator on other systems. I don't have a MS-signed security certificate so I'm guessing that's why it's blocked.

On Mon, Mar 2, 2015 at 9:40 AM, Keith Bell notifications@github.com wrote:

ok... I just tried a couple steps that I believe may have got me somewhere. I right clicked on the zipped folder and chose properties. Then there was an "unblock" option in the lower corner of the dialog box. I clicked on that. Extracted folder. Right clicked on "excavator" extracted folder, properties. Unchecked "read only", apply. Right clicked on "excavator" application, "run as administrator" and it seems to be running ok. I'll let you know if I get snagged somewhere else. Thanks!

— Reply to this email directly or view it on GitHub https://github.com/NewSpring/Excavator/issues/111#issuecomment-76722452.

dcs619 commented 9 years ago

You can set the database connection via the .config file for now -- the Connect button just makes it easier for non-technical users.

On Mon, Mar 2, 2015 at 9:43 AM, David Stevens david.stevens@newspring.cc wrote:

Awesome!

The User Account Control (UAC) in Win7+ has been the biggest frustration running Excavator on other systems. I don't have a MS-signed security certificate so I'm guessing that's why it's blocked.

On Mon, Mar 2, 2015 at 9:40 AM, Keith Bell notifications@github.com wrote:

ok... I just tried a couple steps that I believe may have got me somewhere. I right clicked on the zipped folder and chose properties. Then there was an "unblock" option in the lower corner of the dialog box. I clicked on that. Extracted folder. Right clicked on "excavator" extracted folder, properties. Unchecked "read only", apply. Right clicked on "excavator" application, "run as administrator" and it seems to be running ok. I'll let you know if I get snagged somewhere else. Thanks!

— Reply to this email directly or view it on GitHub https://github.com/NewSpring/Excavator/issues/111#issuecomment-76722452 .

keithjbell commented 9 years ago

With skipping the "connect" button I successfully can navigate to my CSV however when I click "next" it crashes as well.

keithjbell commented 9 years ago

Im currently uploading a small video of me going through the steps. Hopefully it's just me doing something wrong. I'll send you a link shortly.

keithjbell commented 9 years ago

Check this out and let me know if I'm missing a step. https://dl.dropboxusercontent.com/u/2678595/excavator_rockissue.mp4

dcs619 commented 9 years ago

It sounds like the SQL connector is still blocked.

On Mon, Mar 2, 2015 at 9:48 AM, Keith Bell notifications@github.com wrote:

With skipping the "connect" button I successfully can navigate to my CSV however when I click "next" it crashes as well.

— Reply to this email directly or view it on GitHub https://github.com/NewSpring/Excavator/issues/111#issuecomment-76724011.

keithjbell commented 9 years ago

Is that something that I've got wrong on my end?

bperreault commented 9 years ago

Hi, Keith I wonder if your CSV file is formatted to the specifications. On the video, after you upload your CSV you should see a message in Green that says Successfully Read the Import File. I can't tell what it says, but the message is in yellow which means it was not successful. But I'll see what else I can find.

bperreault commented 9 years ago

It looks like the source .csv file needs to be somewhere other than the desktop. Have you tried placing "people list data grid.csv" into the Documents folder?

dcs619 commented 9 years ago

The source CSV needs to start with Individual or Family in the name to be matched. Also, if the file is open during the import it will be locked meaning Excavator can't access it.

dcs619 commented 9 years ago

@keithjbell I watched the video and your CSV file needs to start with "Individual" or "Family" in the name so that Excavator can parse it. Check the documentation for details: https://github.com/NewSpring/Excavator/wiki/3.-CSV-Import#IndividualInformation

That won't fix the DLL blocking that's going on but I'll try unpackaging them and see if that works.

keithjbell commented 9 years ago

I'm spending a couple hours this morning on this. I guess I'm missing where to find the specs for the csv are. I've wandered around your excavator github page and I'm not having any luck finding a readme or some other "formatting" requirements for the csv. Also, the yellow warning that comes up is "could not open the source file. Please make sure the file is not in use"

I don't have it open or anything so I'm not sure why I'm getting that message. I moved it to the documents folder and still am not having any luck. Thoughts?

dcs619 commented 9 years ago

Documentation is on the wiki: https://github.com/NewSpring/Excavator/wiki/3.-CSV-Import

The biggest issue seemed like your source file has to start with "Individual" or "Family" in the name or Excavator will not recognize it.

keithjbell commented 9 years ago

Thank you!!! I'll check back in after a thorough check of all this.

keithjbell commented 9 years ago

ok. I've successfully formatted the csv's to spec. My problem now is connecting to the database server. Each time I click the "connect" button Excavator crashes. Thoughts?

arranf commented 9 years ago

Right click on all the files and click unblock. On 26 Mar 2015 21:06, "Keith Bell" notifications@github.com wrote:

ok. I've successfully formatted the csv's to spec. My problem now is connecting to the database server. Each time I click the "connect" button Excavator crashes. Thoughts?

— Reply to this email directly or view it on GitHub https://github.com/NewSpring/Excavator/issues/111#issuecomment-86718048.

Sylhos commented 9 years ago

Hello guys. I am having a very similar issue, and I have not found a workaround for mine either. My crash occurs even if I click the "upload" button (the "connect" crashes also). I have checked the folder permissions and everything is read/write. I even placed the code on a d: drive folder to avoid c: restrictions. I am running the exe as administrator on an 64 bit version of 2012 R2 trying to import a FellowshipOne mdb file. Any suggestion is much appreciated.

arranf commented 9 years ago

@Sylhos Just to double check (you didn't mention this in your post) have you clicked 'unblock' on the .exe and .dll files

Sylhos commented 9 years ago

@arranf Sorry I missed that. It worked after I unblocked each dll/exe's. Now I am getting Houshold_ID does not exist message, but I believe is related to the MDF file. Thanks!

dcs619 commented 9 years ago

@Sylhos Did you mean Household_ID or Houshold_ID? Houshold_ID is a misspelling but if that's the error you're getting that should be fixed in code.

dcs619 commented 9 years ago

@keithjbell @Sylhos I did a fair amount of research this weekend + tried refactoring Excavator to get rid of this problem. Unfortunately the blocking is part of security auditing introduced in Windows 7 and Server 2012. You can read more about the issue here and here.

The only thing I found that helps is to open the properties on Excavator.zip immediately after download -- clicking Unblock on the .zip before extracting keeps the extracted files from being blocked.

I'm closing this issue as there's nothing else I can do to prevent the files from blocking. The SQL Connect button is a valid bug that I still need to fix here. However, you can set the database connection manually via Excavator.exe.config and start your import.