search

Esri / OptimizeRasters

OptimizeRasters is a set of tools for converting raster data to optimized Tiled TIF or MRF files, moving data to cloud storage, and creating Raster Proxies.
Apache License 2.0
126 stars 49 forks source link

Linux Install #110

Closed niwacolours closed 3 years ago

niwacolours commented 3 years ago

We would like to run OptimizeRasters on our supercomputer, in a Linux environment. How does that get installed and configured?

I've successfully used it for 'manual' conversion of large volumes of NetCDF (nc) files to MRF, including LERC compression, using an install and the command line on my Windows PC. Here, I use a Python2.7 which came with my ArcMap.

The installation instructions provide a link to an .exe installer and nothing for Linux, although, under the Requirements section, it says that it can be used on Linux. How?

There is the "Lambda" function installer available under https://github.com/Esri/OptimizeRasters/blob/master/Setup/Lambda/OptimizeRastersLambdaFX.zip - would I be using the contents of this zip file? is it as easy as unzipping it on my Linux target and scheduling the process to run with my configuration?

Thank you for any help on this -

Tilmann

Chamlika commented 3 years ago

@niwacolours I could provide an OR docker image, will that make things easier on your side?

niwacolours commented 3 years ago

Thanks Chamlika,

That would be a great solution! What other ways are there to install it on Linux? Is that documented somewhere?

Tilmann

From: Chamlika Wickramasinghe notifications@github.com Sent: Tuesday, 15 December 2020 10:38 PM To: Esri/OptimizeRasters OptimizeRasters@noreply.github.com Cc: Tilmann Steinmetz Tilmann.Steinmetz@niwa.co.nz; Mention mention@noreply.github.com Subject: Re: [Esri/OptimizeRasters] Linux Install (#110)

@niwacolourshttps://aus01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2Fniwacolours&data=04%7C01%7Ctilmann.steinmetz%40niwa.co.nz%7C74bddba257654099d51f08d8a0dd2ad4%7C41caed736a0c468aba499ff6aafd1c77%7C0%7C0%7C637436219065038358%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C1000&sdata=BGk6P5JIk0J00GDodD8CwZD6QeVnT7Pt7TYLyiqujkc%3D&reserved=0 I could provide an OR docker image, will that make things easier on your side?

- You are receiving this because you were mentioned. Reply to this email directly, view it on GitHubhttps://aus01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2FEsri%2FOptimizeRasters%2Fissues%2F110%23issuecomment-745170636&data=04%7C01%7Ctilmann.steinmetz%40niwa.co.nz%7C74bddba257654099d51f08d8a0dd2ad4%7C41caed736a0c468aba499ff6aafd1c77%7C0%7C0%7C637436219065048355%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C1000&sdata=lkfs1s%2BpSpNnO2pqumj8Jux27GI51U%2FHCBJddL11nyU%3D&reserved=0, or unsubscribehttps://aus01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2Fnotifications%2Funsubscribe-auth%2FAMX4K5SM5ZO4JPJ5DQPM2V3SU4VAZANCNFSM4URFXIEA&data=04%7C01%7Ctilmann.steinmetz%40niwa.co.nz%7C74bddba257654099d51f08d8a0dd2ad4%7C41caed736a0c468aba499ff6aafd1c77%7C0%7C0%7C637436219065048355%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C1000&sdata=EKmX2J7QCWej50cyJx6KnmDKn9hSfw6X4L3OzJhK8Cs%3D&reserved=0.

[https://www.niwa.co.nz/static/niwa-2018-horizontal-180.png]https://www.niwa.co.nz Dr Tilmann Steinmetz GIS Data Analyst & Administrator

+64-4-386-0535 | National Institute of Water & Atmospheric Research Ltd (NIWA) 301 Evans Bay Parade Hataitai Wellington New Zealand Connect with NIWA: niwa.co.nzhttps://www.niwa.co.nz Facebookhttps://www.facebook.com/nzniwa LinkedInhttps://www.linkedin.com/company/niwa Twitterhttps://twitter.com/niwa_nz Instagramhttps://www.instagram.com/niwa_science To ensure compliance with legal requirements and to maintain cyber security standards, NIWA's IT systems are subject to ongoing monitoring, activity logging and auditing. This monitoring and auditing service may be provided by third parties. Such third parties can access information transmitted to, processed by and stored on NIWA's IT systems

Chamlika commented 3 years ago

@niwacolours There's a slim version of OR Linux setup made available for you to download and test. The setup link/info at https://github.com/Esri/OptimizeRasters/blob/master/Setup/Linux/readme-info.txt

niwacolours commented 3 years ago

That's very helpful - thanks a lot for sending that through Chamlika!

Cheers, Tilmann

From: Chamlika Wickramasinghe notifications@github.com Sent: Monday, 21 December 2020 8:53 AM To: Esri/OptimizeRasters OptimizeRasters@noreply.github.com Cc: Tilmann Steinmetz Tilmann.Steinmetz@niwa.co.nz; Mention mention@noreply.github.com Subject: Re: [Esri/OptimizeRasters] Linux Install (#110)

@niwacolourshttps://aus01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2Fniwacolours&data=04%7C01%7Ctilmann.steinmetz%40niwa.co.nz%7C27aa8bd4d2c649037c8208d8a520e42f%7C41caed736a0c468aba499ff6aafd1c77%7C0%7C0%7C637440908028312191%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C1000&sdata=xrBlQoDl%2Bm24bI9AY9Rjw8Sfl9x%2BFDeCZU6mjrAerKI%3D&reserved=0 There's a slim version of OR Linux setup made available for you to download and test. The setup link/info at https://github.com/Esri/OptimizeRasters/blob/master/Setup/Linux/readme-info.txthttps://aus01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2FEsri%2FOptimizeRasters%2Fblob%2Fmaster%2FSetup%2FLinux%2Freadme-info.txt&data=04%7C01%7Ctilmann.steinmetz%40niwa.co.nz%7C27aa8bd4d2c649037c8208d8a520e42f%7C41caed736a0c468aba499ff6aafd1c77%7C0%7C0%7C637440908028322177%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C1000&sdata=tVBNLqoZPwQ6INoUkR1OwTQwxs1sCkGIcrUYqeDulDs%3D&reserved=0

- You are receiving this because you were mentioned. Reply to this email directly, view it on GitHubhttps://aus01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2FEsri%2FOptimizeRasters%2Fissues%2F110%23issuecomment-748655056&data=04%7C01%7Ctilmann.steinmetz%40niwa.co.nz%7C27aa8bd4d2c649037c8208d8a520e42f%7C41caed736a0c468aba499ff6aafd1c77%7C0%7C0%7C637440908028322177%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C1000&sdata=CvuAKsq%2BI9yYSVSz1pUqmpNQXBL0WWvgCy8dZ2xgZJA%3D&reserved=0, or unsubscribehttps://aus01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2Fnotifications%2Funsubscribe-auth%2FAMX4K5XKNVHFD5IMUX5R3UTSVZI2RANCNFSM4URFXIEA&data=04%7C01%7Ctilmann.steinmetz%40niwa.co.nz%7C27aa8bd4d2c649037c8208d8a520e42f%7C41caed736a0c468aba499ff6aafd1c77%7C0%7C0%7C637440908028332168%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C1000&sdata=sNCbfa0MQq80S8pUcydwUGG%2BvDl05M9H3JTLjF1E%2F20%3D&reserved=0.

[https://www.niwa.co.nz/static/niwa-2018-horizontal-180.png]https://www.niwa.co.nz Dr Tilmann Steinmetz GIS Data Analyst & Administrator

+64-4-386-0535 | National Institute of Water & Atmospheric Research Ltd (NIWA) 301 Evans Bay Parade Hataitai Wellington New Zealand Connect with NIWA: niwa.co.nzhttps://www.niwa.co.nz Facebookhttps://www.facebook.com/nzniwa LinkedInhttps://www.linkedin.com/company/niwa Twitterhttps://twitter.com/niwa_nz Instagramhttps://www.instagram.com/niwa_science To ensure compliance with legal requirements and to maintain cyber security standards, NIWA's IT systems are subject to ongoing monitoring, activity logging and auditing. This monitoring and auditing service may be provided by third parties. Such third parties can access information transmitted to, processed by and stored on NIWA's IT systems