Closed RussellButson closed 5 years ago
Hi Russell,
I was able to install it without an internet connection by following these steps:
You can also run the application without installing, by going into the module folder, then Application Files/SwarmSight.... and running the application .exe file directly.
One issue you may run into with the offline method is missing dependencies that get automatically installed with the online installer. You may need to install .Net Framework 4.5 first (if your OS doesn't have it already): https://www.microsoft.com/en-us/download/details.aspx?id=42642
Let me know if this helps.
Best regards,
Justas
Hi Justas,
We have had success with the installation, but now find we are able to run our video clips.
Is there a file limit? Our footage is in the range of 1-2 GB.
Any guidance on this greatly appreciated.
Russell
Hi Russell,
I was able to install it without an internet connection by following these steps:
You can also run the application without installing, by going into the module folder, then Application Files/SwarmSight.... and running the application .exe file directly.
One issue you may run into with the offline method is missing dependencies that get automatically installed with the online installer. You may need to install .Net Framework 4.5 first (if your OS doesn't have it already): https://www.microsoft.com/en-us/download/details.aspx?id=42642
Let me know if this helps.
Best regards,
Justas
— You are receiving this because you authored the thread. Reply to this email directly, view it on GitHubhttps://github.com/JustasB/SwarmSight/issues/9#issuecomment-392116399, or mute the threadhttps://github.com/notifications/unsubscribe-auth/AcKY-P3x5mV0QMMAU22cEpNblATcW70zks5t2DWigaJpZM4UNTRQ.
Hi Russell, is there a message or an error that you encounter when you try to use the files?
Hi Justas,
I have reload but still same issue – copy of error message attached.
Russell
From: Justas Birgiolas notifications@github.com Sent: Wednesday, 18 July 2018 7:39 AM To: JustasB/SwarmSight SwarmSight@noreply.github.com Cc: Russell Butson russell.butson@otago.ac.nz; Author author@noreply.github.com Subject: Re: [JustasB/SwarmSight] Stand-alone version (#9)
Hi Russell, is there a message or an error that you encounter when you try to use the files?
— You are receiving this because you authored the thread. Reply to this email directly, view it on GitHubhttps://github.com/JustasB/SwarmSight/issues/9#issuecomment-405702767, or mute the threadhttps://github.com/notifications/unsubscribe-auth/AcKY-As6Fkt2vUM4XJSKXfz6jfn2gD6bks5uHj0-gaJpZM4UNTRQ.
Hi Russel, I don't see the attachment here. Can you attach it to the github issue (https://github.com/JustasB/SwarmSight/issues/9) or email it directly to me (justas AT asu.edu)?
Hi Justas,
I believe we found the issue occurred as a result of us using MKV file format.
We are currently converting our files to MP4. However, while swarmsight is now working correctly, it takes many hours to process with the software often freezing at completion.
We are operating with large files – 1 GB (4-9 hours of recording)
We are on a tight timeline – any help would be greatly appreciated – love the software, it produces exactly what we want.
Regards,
Russell
Russell Butson Senior Lecturer in Higher Education Higher Education Development Centre 65-75 Union Place West University of Otago P O Box 56 Dunedin New Zealand
Ph 64 3 479 5789 Fax 64 3 479 8362 E: russell.butson@otago.ac.nzmailto:russell.butson@otago.ac.nz W: http://hedc.otago.ac.nz/ [cid:image001.jpg@01D3A740.ED205120]
From: Justas Birgiolas notifications@github.com Sent: Thursday, 26 July 2018 5:31 AM To: JustasB/SwarmSight SwarmSight@noreply.github.com Cc: Russell Butson russell.butson@otago.ac.nz; Author author@noreply.github.com Subject: Re: [JustasB/SwarmSight] Stand-alone version (#9)
Hi Russel, I don't see the attachment here. Can you attach it to the github issue (#9https://github.com/JustasB/SwarmSight/issues/9) or email it directly to me (justas AT asu.edu)?
— You are receiving this because you authored the thread. Reply to this email directly, view it on GitHubhttps://github.com/JustasB/SwarmSight/issues/9#issuecomment-407834208, or mute the threadhttps://github.com/notifications/unsubscribe-auth/AcKY-FPr-JPyKHaxDXgagYfqdl4yalt_ks5uKKtpgaJpZM4UNTRQ.
Hi Russell,
I would recommend splitting the large files into smaller ones first to see if you're getting the results you want. Then increase the file sizes gradually and check for any issues related to file size.
The software can process the files at 30-60 frames per second depending on your hardware, so a 9 hr video would take about 4.5-9 hours to process. Furthermore, a 9 hr video recorded at 30 FPS would have ~1 million frames, and so the resulting CSV file would have ~1 million rows. The freezing might be happening if the computer's RAM is used up during the processing or if the disk to which the CSV files are saved runs out of space. Of course, it could also be some bug in the software.
I use ffmpeg software to split large files and convert files between video formats.
If possible, can you upload one of the problematic files to Google Drive or Dropbox and share it with me? With the file in hand, I could diagnose the problem better.
If you find that smaller files still result in crashes/freezing/errors please let me know, and share the file if possible.
Best regards,
Justas
Hi Justas,
I have meetings all morning, but could upload a file later today – in say 5 hours.
Splitting is possible… but takes more time.
PROCESS…
· Convert to mp4 = 1:30 hour 30fps per file/clip
· File splitting - ??
· Swarmsight threshold-35 | motion contrast x1 | speed high with accuracy at 25% | storage to external HD – 9TB (80% free space) – 6 hours
· = 8-9 hours I have 60 video clips to process ☺
I have tested on three different configuration including SSD – but same issue fast for the first 40% then progressively slower. The main computer specs: Intel(R) Core(TM) i7-6820HQ CPU @ 2.70GHz so computation power shouldn’t be an issue.
I am pretty sure the problem is caused by the file size.
Were we correct that swarmsight doesn’t recognise mkv files?
Russell
From: Justas Birgiolas notifications@github.com Sent: Thursday, 26 July 2018 9:14 AM To: JustasB/SwarmSight SwarmSight@noreply.github.com Cc: Russell Butson russell.butson@otago.ac.nz; Author author@noreply.github.com Subject: Re: [JustasB/SwarmSight] Stand-alone version (#9)
Hi Russell,
I would recommend splitting the large files into smaller ones first to see if you're getting the results you want. Then increase the file sizes gradually and check for any issues related to file size.
The software can process the files at 30-60 frames per second depending on your hardware, so a 9 hr video would take about 4.5-9 hours to process. Furthermore, a 9 hr video recorded at 30 FPS would have ~1 million frames, and so the resulting CSV file would have ~1 million rows. The freezing might be happening if the computer's RAM is used up during the processing or if the disk to which the CSV files are saved runs out of space. Of course, it could also be some bug in the software.
I use ffmpeg https://ffmpeg.org/ software to split large files and convert files between video formats.
If possible, can you upload one of the problematic files to Google Drive or Dropbox and share it with me? With the file in hand, I could diagnose the problem better.
If you find that smaller files still result in crashes/freezing/errors please let me know, and share the file if possible.
Best regards,
Justas
— You are receiving this because you authored the thread. Reply to this email directly, view it on GitHubhttps://github.com/JustasB/SwarmSight/issues/9#issuecomment-407897908, or mute the threadhttps://github.com/notifications/unsubscribe-auth/AcKY-FPozyji3hLoiixgRKTvxFQfE6DIks5uKN-QgaJpZM4UNTRQ.
Hi Justas,
Here is the error message we received when using mkv files.
R
From: Russell Butson Sent: Monday, 23 July 2018 4:51 AM To: 'JustasB/SwarmSight' reply@reply.github.com Subject: RE: [JustasB/SwarmSight] Stand-alone version (#9)
Hi Justas,
I have reload but still same issue – copy of error message attached.
Russell
From: Justas Birgiolas notifications@github.com<mailto:notifications@github.com> Sent: Wednesday, 18 July 2018 7:39 AM To: JustasB/SwarmSight SwarmSight@noreply.github.com<mailto:SwarmSight@noreply.github.com> Cc: Russell Butson russell.butson@otago.ac.nz<mailto:russell.butson@otago.ac.nz>; Author author@noreply.github.com<mailto:author@noreply.github.com> Subject: Re: [JustasB/SwarmSight] Stand-alone version (#9)
Hi Russell, is there a message or an error that you encounter when you try to use the files?
— You are receiving this because you authored the thread. Reply to this email directly, view it on GitHubhttps://github.com/JustasB/SwarmSight/issues/9#issuecomment-405702767, or mute the threadhttps://github.com/notifications/unsubscribe-auth/AcKY-As6Fkt2vUM4XJSKXfz6jfn2gD6bks5uHj0-gaJpZM4UNTRQ.
I've shared an item with you:
Dp-3 10-20.m4v https://drive.google.com/file/d/1fsAdhhNBMiGs-1KvJnJYZxeQBq8AL3zJ/view?usp=sharing&ts=5b5cdabc
It's not an attachment – it's stored online. To open this item, just click
the link above.
Hi Justas,
Re: splitting - I would have to split the files into 8-10 sections – very time consuming + I would then need to merge all of the csv files – again very time consuming.
I can’t seem to see a pattern in the slowing down behaviour. Therefore, I am not really sure what is happening.
I have upload a portion of a file for you to test to a google drive – you should have received a url link.
As you can see on the attached image – SS slows down in the final 3rd – no errors + still processing – cpu/memory – but very very slow. This image is of a SS process that has been running for 12 hours. The first 1 hour was processed in less than 10mins.
Any help ready appreciated – desperate to get access to these frequencies graphs for our study – they are absolutely perfect! for our analysis.
Hope you can help.
Russell
From: Justas Birgiolas notifications@github.com Sent: Thursday, 26 July 2018 9:14 AM To: JustasB/SwarmSight SwarmSight@noreply.github.com Cc: Russell Butson russell.butson@otago.ac.nz; Author author@noreply.github.com Subject: Re: [JustasB/SwarmSight] Stand-alone version (#9)
Hi Russell,
I would recommend splitting the large files into smaller ones first to see if you're getting the results you want. Then increase the file sizes gradually and check for any issues related to file size.
The software can process the files at 30-60 frames per second depending on your hardware, so a 9 hr video would take about 4.5-9 hours to process. Furthermore, a 9 hr video recorded at 30 FPS would have ~1 million frames, and so the resulting CSV file would have ~1 million rows. The freezing might be happening if the computer's RAM is used up during the processing or if the disk to which the CSV files are saved runs out of space. Of course, it could also be some bug in the software.
I use ffmpeg https://ffmpeg.org/ software to split large files and convert files between video formats.
If possible, can you upload one of the problematic files to Google Drive or Dropbox and share it with me? With the file in hand, I could diagnose the problem better.
If you find that smaller files still result in crashes/freezing/errors please let me know, and share the file if possible.
Best regards,
Justas
— You are receiving this because you authored the thread. Reply to this email directly, view it on GitHubhttps://github.com/JustasB/SwarmSight/issues/9#issuecomment-407897908, or mute the threadhttps://github.com/notifications/unsubscribe-auth/AcKY-FPozyji3hLoiixgRKTvxFQfE6DIks5uKN-QgaJpZM4UNTRQ.
Hi Russel, I've received the video file and will be looking into the issue you described. Will let you know what I find, Justas
Excellent. I really appreciate you help on this.
Russell
From: Justas Birgiolas notifications@github.com Sent: Tuesday, 31 July 2018 3:29 AM To: JustasB/SwarmSight SwarmSight@noreply.github.com Cc: Russell Butson russell.butson@otago.ac.nz; Author author@noreply.github.com Subject: Re: [JustasB/SwarmSight] Stand-alone version (#9)
Hi Russel, I've received the video file and will be looking into the issue you described. Will let you know what I find, Justas
— You are receiving this because you authored the thread. Reply to this email directly, view it on GitHubhttps://github.com/JustasB/SwarmSight/issues/9#issuecomment-408904630, or mute the threadhttps://github.com/notifications/unsubscribe-auth/AcKY-IgbR66rW9qlo0SikB2O8nrF-aLsks5uLyYmgaJpZM4UNTRQ.
Hi Russel,
I was able to reproduce the slow-down issue and was able to find a solution. The problem was the combination of a long video and updating the activity plot. Once there are enough points, the plot library would spend more and more time updating the activity plot and thus you would see the slowdown after a while.
As a fix, I added a checkbox "Update Plot" to control the plot updating. Before starting the analysis, clear the checkbox and this will not add new points to the activity plot and the frame rate should not slow down. It will still record the changes and you should see them in the Changed Pixels label.
Furthermore, I added an option to chose the file name to the Save functionality. Now, clicking "Save.." will open a dialog to select a file destination.
Finally, I've updated the video decoder library to the latest version. I don't know for sure, but you should try running one of the ealier MKV files to see if the updated version is able to open it. If not, the MP4 method should still work.
You can follow the steps I described earlier to download the updated version: https://github.com/JustasB/SwarmSight/issues/9#issuecomment-392116399
Let me how it goes,
Justas
This is perfect timing – I will try now.
Thank you so much for doing this.
Russell
From: Justas Birgiolas notifications@github.com Sent: Tuesday, 31 July 2018 1:45 PM To: JustasB/SwarmSight SwarmSight@noreply.github.com Cc: Russell Butson russell.butson@otago.ac.nz; Author author@noreply.github.com Subject: Re: [JustasB/SwarmSight] Stand-alone version (#9)
Hi Russel,
I was able to reproduce the slow-down issue and was able to find a solution. The problem was the combination of a long video and updating the activity plot. Once there are enough points, the plot library would spend more and more time updating the activity plot and thus you would see the slowdown after a while.
As a fix, I added a checkbox "Update Plot" to control the plot updating. Before starting the analysis, clear the checkbox and this will not add new points to the activity plot and the frame rate should not slow down. It will still record the changes and you should see them in the Changed Pixels label.
[image]https://user-images.githubusercontent.com/10732358/43432391-7a18aaa4-9427-11e8-8db6-bc6fae552ca6.png
Furthermore, I added an option to chose the file name to the Save functionality. Now, clicking "Save.." will open a dialog to select a file destination.
Finally, I've updated the video decoder library to the latest version. I don't know for sure, but you should try running one of the ealier MKV files to see if the updated version is able to open it. If not, the MP4 method should still work.
You can follow the steps I described earlier to download the updated version: #9 (comment)https://github.com/JustasB/SwarmSight/issues/9#issuecomment-392116399
Let me how it goes,
Justas
— You are receiving this because you authored the thread. Reply to this email directly, view it on GitHubhttps://github.com/JustasB/SwarmSight/issues/9#issuecomment-409066529, or mute the threadhttps://github.com/notifications/unsubscribe-auth/AcKY-E8tMHkOckdzf9qwDKB3b8JPXyKKks5uL7a3gaJpZM4UNTRQ.
No luck with the mkv – same error message as before, but worked fine with m4v
Thank you so much! Off to analyse 50 hours of video.
R
From: Justas Birgiolas notifications@github.com Sent: Tuesday, 31 July 2018 1:45 PM To: JustasB/SwarmSight SwarmSight@noreply.github.com Cc: Russell Butson russell.butson@otago.ac.nz; Author author@noreply.github.com Subject: Re: [JustasB/SwarmSight] Stand-alone version (#9)
Hi Russel,
I was able to reproduce the slow-down issue and was able to find a solution. The problem was the combination of a long video and updating the activity plot. Once there are enough points, the plot library would spend more and more time updating the activity plot and thus you would see the slowdown after a while.
As a fix, I added a checkbox "Update Plot" to control the plot updating. Before starting the analysis, clear the checkbox and this will not add new points to the activity plot and the frame rate should not slow down. It will still record the changes and you should see them in the Changed Pixels label.
[image]https://user-images.githubusercontent.com/10732358/43432391-7a18aaa4-9427-11e8-8db6-bc6fae552ca6.png
Furthermore, I added an option to chose the file name to the Save functionality. Now, clicking "Save.." will open a dialog to select a file destination.
Finally, I've updated the video decoder library to the latest version. I don't know for sure, but you should try running one of the ealier MKV files to see if the updated version is able to open it. If not, the MP4 method should still work.
You can follow the steps I described earlier to download the updated version: #9 (comment)https://github.com/JustasB/SwarmSight/issues/9#issuecomment-392116399
Let me how it goes,
Justas
— You are receiving this because you authored the thread. Reply to this email directly, view it on GitHubhttps://github.com/JustasB/SwarmSight/issues/9#issuecomment-409066529, or mute the threadhttps://github.com/notifications/unsubscribe-auth/AcKY-E8tMHkOckdzf9qwDKB3b8JPXyKKks5uL7a3gaJpZM4UNTRQ.
Glad to hear it's working.
For the MKV issue, I've been able to open a few MKV files with the software without errors. It makes me think that there is something specific about the files you have and the way the software reads them.
If possible, can you upload a small MKV clip that produces the error?
Hi Juatas,
I have upload a MKV file to the same folder as before
R
From: Justas Birgiolas notifications@github.com Sent: Wednesday, 1 August 2018 9:34 AM To: JustasB/SwarmSight SwarmSight@noreply.github.com Cc: Russell Butson russell.butson@otago.ac.nz; Author author@noreply.github.com Subject: Re: [JustasB/SwarmSight] Stand-alone version (#9)
Glad to hear it's working.
For the MKV issue, I've been able to open a few MKV files with the software without errors. It makes me think that there is something specific about the files you have and the way the software reads them.
If possible, can you upload a small MKV clip that produces the error?
— You are receiving this because you authored the thread. Reply to this email directly, view it on GitHubhttps://github.com/JustasB/SwarmSight/issues/9#issuecomment-409375443, or mute the threadhttps://github.com/notifications/unsubscribe-auth/AcKY-HNOGy1egchI-nLKziMunEP2QXtWks5uMM1kgaJpZM4UNTRQ.
Hi Russel,
The link I have:
https://drive.google.com/file/d/1fsAdhhNBMiGs-1KvJnJYZxeQBq8AL3zJ/view?usp=sharing&ts=5b5cdabc
shows the m4p file. But, I don't see any other files.
Can you resend a link to the folder?
Upload failed…. Try now.
R
From: Justas Birgiolas notifications@github.com Sent: Thursday, 2 August 2018 6:27 AM To: JustasB/SwarmSight SwarmSight@noreply.github.com Cc: Russell Butson russell.butson@otago.ac.nz; Author author@noreply.github.com Subject: Re: [JustasB/SwarmSight] Stand-alone version (#9)
Hi Russel,
The link I have:
https://drive.google.com/file/d/1fsAdhhNBMiGs-1KvJnJYZxeQBq8AL3zJ/view?usp=sharing&ts=5b5cdabc
shows the m4p file. But, I don't see any other files.
Can you resend a link to the folder?
— You are receiving this because you authored the thread. Reply to this email directly, view it on GitHubhttps://github.com/JustasB/SwarmSight/issues/9#issuecomment-409675071, or mute the threadhttps://github.com/notifications/unsubscribe-auth/AcKY-IkY6se9HOnfrbkbaxrPEvXlHeQCks5uMfMCgaJpZM4UNTRQ.
When I click on the link
https://drive.google.com/file/d/1fsAdhhNBMiGs-1KvJnJYZxeQBq8AL3zJ/view?usp=sharing&ts=5b5cdabc
this is what I see:
Do you have a setup file for installing on a non-networked computer? The current setup file requires access to the internet for verification.
Regards,
Russell