deptofdefense / AndroidTacticalAssaultKit-CIV

Other
0 stars 2 forks source link

Bug: DTED data package processing #278

Open rick51231 opened 1 year ago

rick51231 commented 1 year ago

Hello

There is some bug in processing data packages with zipped DTED data. I think the problem is that file DTED0-World-v3.zip (contains zipped DTED0 data in format ABBB/CDDD.dt0) is being moved instead of importing. I don't have access to the latest ATAK sources, so a possible fix is:

Use destination file for the import source. But I don't know how to manage file deletion File: ImportDTEDZSort.java Change line 176 from installDTED(src); to installDTED(dst);

or

Don't move the file and use the original file location (import in place). But I don't know about affection on another types of import File: MissionPackageExtractor.java Change line 80 from true, false, false, false); to true, false, true, false);

DTED0-World-v3_dp.zip manifest:

<MissionPackageManifest version="2">
   <Configuration>
      <Parameter name="uid" value="5bd1f315-584b-4453-83c7-07c10b6d2423"/>
      <Parameter name="name" value="DTED0-World-v3_dp.zip"/>
   </Configuration>
   <Contents>
      <Content ignore="false" zipEntry="14d3f2f87320668f002bd77e4b690f99/DTED0-World-v3.zip"/>
   </Contents>
</MissionPackageManifest>

DTED0-World-v3_dp.zip contents:

MANIFEST/manifest.xml
14d3f2f87320668f002bd77e4b690f99/DTED0-World-v3.zip
ATAK v4.8.1.6-79017e13 (CIV playstore) app log ``` 2023-02-12 18:57:46.466 28867-29285 HashingUtils com.atakmap.app.civ V Computing SHA256 for: /storage/emulated/0/atak/tools/datapackage/incoming/762f868985853fd0bfc60df3772410a10cbf8f48de589462b187ad2d1fcf9886 2023-02-12 18:57:46.806 28867-29285 MissionPac...torFactory com.atakmap.app.civ D valid manifest found in: /storage/emulated/0/atak/tools/datapackage/incoming/762f868985853fd0bfc60df3772410a10cbf8f48de589462b187ad2d1fcf9886 2023-02-12 18:57:46.810 28867-29285 MissionPac...torFactory com.atakmap.app.civ D valid manifest found in: /storage/emulated/0/atak/tools/datapackage/incoming/762f868985853fd0bfc60df3772410a10cbf8f48de589462b187ad2d1fcf9886 2023-02-12 18:57:46.813 28867-29285 MissionPac...torFactory com.atakmap.app.civ D valid manifest found in: /storage/emulated/0/atak/tools/datapackage/incoming/762f868985853fd0bfc60df3772410a10cbf8f48de589462b187ad2d1fcf9886 2023-02-12 18:57:46.817 28867-29285 MissionPac...torFactory com.atakmap.app.civ D valid manifest found in: /storage/emulated/0/atak/tools/datapackage/incoming/762f868985853fd0bfc60df3772410a10cbf8f48de589462b187ad2d1fcf9886 2023-02-12 18:57:46.828 28867-29285 ImportFilesTask com.atakmap.app.civ D Adding Import Resolver of type: com.atakmap.android.video.c 2023-02-12 18:57:46.828 28867-29285 ImportFilesTask com.atakmap.app.civ D Adding Import Resolver of type: com.atakmap.android.importfiles.resource.RemoteResourceImporter 2023-02-12 18:57:46.828 28867-29285 ImportFilesTask com.atakmap.app.civ D Adding Import Resolver of type: com.atakmap.android.gpkg.c$c 2023-02-12 18:57:46.828 28867-29285 ImportFilesTask com.atakmap.app.civ D Adding Import Resolver of type: atak.core.ku$1 2023-02-12 18:57:46.828 28867-29285 ImportFilesTask com.atakmap.app.civ D Adding Import Resolver of type: atak.core.ku$1 2023-02-12 18:57:46.828 28867-29285 MissionPackageExtractor com.atakmap.app.civ D Extracting 1 contents from Manifest: DTED0-World-v3_dp.zip, /storage/emulated/0/atak/tools/datapackage/incoming/762f868985853fd0bfc60df3772410a10cbf8f48de589462b187ad2d1fcf9886, 1 Files, 0 Map Items 2023-02-12 18:57:46.833 28867-29285 MissionPackageExtractor com.atakmap.app.civ D Unzipping file to: /storage/emulated/0/atak/tools/datapackage/files/5bd1f315-584b-4453-83c7-07c10b6d2423/14d3f2f87320668f002bd77e4b690f99/DTED0-World-v3.zip 2023-02-12 18:57:48.166 28867-29285 MissionPac...entHandler com.atakmap.app.civ D Importing file: /storage/emulated/0/atak/tools/datapackage/files/5bd1f315-584b-4453-83c7-07c10b6d2423/14d3f2f87320668f002bd77e4b690f99/DTED0-World-v3.zip 2023-02-12 18:57:48.223 28867-29285 MissionPac...torFactory com.atakmap.app.civ E Manifest does not exist: /storage/emulated/0/atak/tools/datapackage/files/5bd1f315-584b-4453-83c7-07c10b6d2423/14d3f2f87320668f002bd77e4b690f99/DTED0-World-v3.zip 2023-02-12 18:57:48.269 28867-29285 ImportUserIconSetSort com.atakmap.app.civ W Invalid iconset (no image): /storage/emulated/0/atak/tools/datapackage/files/5bd1f315-584b-4453-83c7-07c10b6d2423/14d3f2f87320668f002bd77e4b690f99/DTED0-World-v3.zip 2023-02-12 18:57:48.454 28867-28875 atakmap.app.ci com.atakmap.app.civ I Background concurrent copying GC freed 422854(13MB) AllocSpace objects, 1(68KB) LOS objects, 33% free, 48MB/72MB, paused 58us,71us total 171.797ms 2023-02-12 18:57:48.467 28867-29285 ImportSHPSort com.atakmap.app.civ D No match: /storage/emulated/0/atak/tools/datapackage/files/5bd1f315-584b-4453-83c7-07c10b6d2423/14d3f2f87320668f002bd77e4b690f99/DTED0-World-v3.zip 2023-02-12 18:57:48.497 28867-29285 ImportSHPZSort com.atakmap.app.civ W Invalid archived Shapefile: /storage/emulated/0/atak/tools/datapackage/files/5bd1f315-584b-4453-83c7-07c10b6d2423/14d3f2f87320668f002bd77e4b690f99/DTED0-World-v3.zip 2023-02-12 18:57:48.497 28867-29285 ImportGMLSort com.atakmap.app.civ D No match: /storage/emulated/0/atak/tools/datapackage/files/5bd1f315-584b-4453-83c7-07c10b6d2423/14d3f2f87320668f002bd77e4b690f99/DTED0-World-v3.zip 2023-02-12 18:57:48.548 28867-29285 ImportDTEDZSort com.atakmap.app.civ D Matched archived DTED: /storage/emulated/0/atak/tools/datapackage/files/5bd1f315-584b-4453-83c7-07c10b6d2423/14d3f2f87320668f002bd77e4b690f99/DTED0-World-v3.zip 2023-02-12 18:57:48.571 28867-29285 FileSystemUtils com.atakmap.app.civ D Successfully renamed: /storage/emulated/0/atak/DTED/DTED0-World-v3.zip 2023-02-12 18:57:48.580 28867-29285 ImportDTEDZSort com.atakmap.app.civ E error java.io.FileNotFoundException: /storage/emulated/0/atak/tools/datapackage/files/5bd1f315-584b-4453-83c7-07c10b6d2423/14d3f2f87320668f002bd77e4b690f99/DTED0-World-v3.zip: open failed: ENOENT (No such file or directory) at libcore.io.IoBridge.open(IoBridge.java:575) at java.io.FileInputStream.(FileInputStream.java:160) at com.atakmap.app.system.a.getInputStream(SourceFile:55) at com.atakmap.coremap.io.IOProviderFactory.getInputStream(SourceFile:137) at atak.core.kn.b(SourceFile:196) at atak.core.kn.onFileSorted(SourceFile:176) at atak.core.kv.beginImport(SourceFile:114) at atak.core.ku.beginImport(SourceFile:76) at atak.core.ms.a(SourceFile:180) at atak.core.ms.a(SourceFile:120) at atak.core.mt.a(SourceFile:79) at com.atakmap.android.missionpackage.file.MissionPackageExtractor.extract(SourceFile:129) at com.atakmap.android.missionpackage.file.MissionPackageExtractorFactory.Extract(SourceFile:49) at com.atakmap.android.missionpackage.http.rest.GetFileTransferOperation.execute(SourceFile:307) at com.foxykeep.datadroid.service.RequestService.a(SourceFile:147) at com.foxykeep.datadroid.service.MultiThreadedIntentService$a.run(SourceFile:173) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:462) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1167) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:641) at java.lang.Thread.run(Thread.java:920) Caused by: android.system.ErrnoException: open failed: ENOENT (No such file or directory) at libcore.io.Linux.open(Native Method) at libcore.io.ForwardingOs.open(ForwardingOs.java:567) at libcore.io.BlockGuardOs.open(BlockGuardOs.java:273) at libcore.io.ForwardingOs.open(ForwardingOs.java:567) at android.app.ActivityThread$AndroidOs.open(ActivityThread.java:8611) at libcore.io.IoBridge.open(IoBridge.java:561) at java.io.FileInputStream.(FileInputStream.java:160)  at com.atakmap.app.system.a.getInputStream(SourceFile:55)  at com.atakmap.coremap.io.IOProviderFactory.getInputStream(SourceFile:137)  at atak.core.kn.b(SourceFile:196)  at atak.core.kn.onFileSorted(SourceFile:176)  at atak.core.kv.beginImport(SourceFile:114)  at atak.core.ku.beginImport(SourceFile:76)  at atak.core.ms.a(SourceFile:180)  at atak.core.ms.a(SourceFile:120)  at atak.core.mt.a(SourceFile:79)  at com.atakmap.android.missionpackage.file.MissionPackageExtractor.extract(SourceFile:129)  at com.atakmap.android.missionpackage.file.MissionPackageExtractorFactory.Extract(SourceFile:49)  at com.atakmap.android.missionpackage.http.rest.GetFileTransferOperation.execute(SourceFile:307)  at com.foxykeep.datadroid.service.RequestService.a(SourceFile:147)  at com.foxykeep.datadroid.service.MultiThreadedIntentService$a.run(SourceFile:173)  at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:462)  at java.util.concurrent.FutureTask.run(FutureTask.java:266)  at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1167)  at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:641)  at java.lang.Thread.run(Thread.java:920)  2023-02-12 18:57:48.584 28867-29285 MissionPac...entHandler com.atakmap.app.civ D Sorting .zip, to DTED, Sorted: /storage/emulated/0/atak/tools/datapackage/files/5bd1f315-584b-4453-83c7-07c10b6d2423/14d3f2f87320668f002bd77e4b690f99/DTED0-World-v3.zip to /storage/emulated/0/atak/DTED/DTED0-World-v3.zip 2023-02-12 18:57:48.584 28867-29285 MissionPac...entHandler com.atakmap.app.civ D Imported Supported File: /storage/emulated/0/atak/DTED/DTED0-World-v3.zip 2023-02-12 18:57:48.584 28867-29285 MissionPac...tProcessor com.atakmap.app.civ D atak.core.ms extracted: 14d3f2f87320668f002bd77e4b690f99/DTED0-World-v3.zip 2023-02-12 18:57:48.615 28867-29285 FileSystemUtils com.atakmap.app.civ D Successfully renamed: /storage/emulated/0/atak/tools/datapackage/DTED2-World-v3_dp.zip 2023-02-12 18:57:48.618 28867-29285 GetFileTra...rOperation com.atakmap.app.civ D Received Package has been saved: /storage/emulated/0/atak/tools/datapackage/DTED2-World-v3_dp.zip 2023-02-12 18:57:48.620 28867-28867 MissionPac...Downloader com.atakmap.app.civ D Not downloaded: DTED2-World-v3_dp,235967151,762f868985853fd0bfc60df3772410a10cbf8f48de589462b187ad2d1fcf9886,/storage/emulated/0/atak/tools/datapackage/incoming/DTED2-World-v3_dp,null,762f868985853fd0bfc60df3772410a10cbf8f48de589462b187ad2d1fcf9886 2023-02-12 18:57:48.623 28867-28867 MissionPac...Downloader com.atakmap.app.civ D Package received contents: DTED0-World-v3_dp.zip, /storage/emulated/0/atak/tools/datapackage/DTED2-World-v3_dp.zip, 1 Files, 0 Map Items 2023-02-12 18:57:48.625 28867-28867 MissionPac...MapOverlay com.atakmap.app.civ D Adding DTED0-World-v3_dp.zip, /storage/emulated/0/atak/tools/datapackage/DTED2-World-v3_dp.zip, 1 Files, 0 Map Items, false 2023-02-12 18:57:48.626 28867-28867 MissionPac...Downloader com.atakmap.app.civ D File Transfer Download Complete - Successfully downloaded file: DTED2-World-v3_dp /storage/emulated/0/atak/tools/datapackage/incoming/DTED2-World-v3_dp, tak.urpc.info:8089:ssl SHA256=762f868985853fd0bfc60df3772410a10cbf8f48de589462b187ad2d1fcf9886 from TAK Server to /storage/emulated/0/atak/tools/datapackage/DTED2-World-v3_dp.zip, number attempts: 1 2023-02-12 18:57:48.634 28867-28867 Toast com.atakmap.app.civ V show: caller = com.atakmap.android.missionpackage.ui.k$2.run:590 2023-02-12 18:57:48.813 28867-28875 atakmap.app.ci com.atakmap.app.civ I Background young concurrent copying GC freed 463594(14MB) AllocSpace objects, 6(120KB) LOS objects, 10% free, 64MB/72MB, paused 563us,71us total 124.775ms 2023-02-12 18:57:49.917 28867-28875 atakmap.app.ci com.atakmap.app.civ I Background concurrent copying GC freed 1156300(48MB) AllocSpace objects, 16(320KB) LOS objects, 47% free, 26MB/50MB, paused 51us,71us total 129.016ms 2023-02-12 18:57:52.799 28867-29110 DirectoryWatcher com.atakmap.app.civ D (DELETE) filtered by type on /storage/emulated/0/atak/tools/datapackage/incoming/762f868985853fd0bfc60df3772410a10cbf8f48de589462b187ad2d1fcf9886 2023-02-12 18:58:03.911 28867-29110 DirectoryWatcher com.atakmap.app.civ D /storage/emulated/0/atak/tools/datapackage/DTED2-World-v3_dp.zip already in FileInfo db 2023-02-12 18:58:03.912 28867-29110 DirectoryWatcher com.atakmap.app.civ D (CLOSE_WRITE) ignoring directory event for /storage/emulated/0/atak/tools/datapackage/files/5bd1f315-584b-4453-83c7-07c10b6d2423 2023-02-12 18:58:03.912 28867-29110 DirectoryWatcher com.atakmap.app.civ D (CLOSE_WRITE) ignoring directory event for /storage/emulated/0/atak/tools/datapackage/files/5bd1f315-584b-4453-83c7-07c10b6d2423/14d3f2f87320668f002bd77e4b690f99 2023-02-12 18:58:03.913 28867-29110 DirectoryWatcher com.atakmap.app.civ D (CLOSE_WRITE) ignoring directory event for /storage/emulated/0/atak/tools/datapackage/files 2023-02-12 18:58:03.913 28867-29110 DirectoryWatcher com.atakmap.app.civ D (CLOSE_WRITE) ignoring directory event for /storage/emulated/0/atak/tools/datapackage/incoming ```