Submit archives

[upintheairsheep]

Hello, may you please add the ability to submit custom archive.org links when it comes back up, plus a scrape of the internet archive’s IPA archive category? The Internet Archive’s auto generated torrents should additionally be linked. Additionally, can you add the ability to scrape open directories for IPA files for now, and open google drive folders via rclone technology? I think there’s a few other supported public folders as well. Also let us view the hashes and link the virustotal results as well for all links.

[CatsLover2006]

Custom archive.org links will be easy, I plan to have a list of archive.org xml file lists in a configuration file at some point. Other things will be more difficult with the way the program is currently implemented (especially anything involving Google Drive, as the server stores practically no data by itself)

[upintheairsheep]

The Google drive thing will be done by rclone.

On Sunday, October 20, 2024, CatsLover2006 @.***> wrote:

Custom archive.org links will be easy, I plan to have a list of archive.org xml file lists in a configuration file at some point. Other things will be more difficult with the way the program is currently implemented (especially anything involving Google Drive, as the server stores practically no data by itself)

— Reply to this email directly, view it on GitHub https://github.com/CatsLover2006/iOSobscuraServer/issues/1#issuecomment-2425236095, or unsubscribe https://github.com/notifications/unsubscribe-auth/AKNKRXF7C3PLULI56H7G6SLZ4QPILAVCNFSM6AAAAABQI3IYGCVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMZDIMRVGIZTMMBZGU . You are receiving this because you authored the thread.Message ID: @.***>

[upintheairsheep]

Custom archive.org links will be easy, I plan to have a list of archive.org xml file lists in a configuration file at some point. Other things will be more difficult with the way the program is currently implemented (especially anything involving Google Drive, as the server stores practically no data by itself)

But once rclone is supported, you could easily support crawling through FTPs that contain IPAs. Additionally, you will need to detect encrypted IPAs, which can be cracked through via a bug on iOS 6, but for IPAs that require iOS 7 or higher to run, the IPAs are unusable except for extracting assets out of them, unless someone finds a way to trick it to run on iOS 6, or if quantum computers become usable enough to be able to decrypt them.

[upintheairsheep]

Update: the internet archive has finally returned

On Sunday, October 20, 2024, The Mariocrafter @.***> wrote:

The Google drive thing will be done by rclone.

On Sunday, October 20, 2024, CatsLover2006 @.***> wrote:

Custom archive.org links will be easy, I plan to have a list of archive.org xml file lists in a configuration file at some point. Other things will be more difficult with the way the program is currently implemented (especially anything involving Google Drive, as the server stores practically no data by itself)

— Reply to this email directly, view it on GitHub https://github.com/CatsLover2006/iOSobscuraServer/issues/1#issuecomment-2425236095, or unsubscribe https://github.com/notifications/unsubscribe-auth/AKNKRXF7C3PLULI56H7G6SLZ4QPILAVCNFSM6AAAAABQI3IYGCVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMZDIMRVGIZTMMBZGU . You are receiving this because you authored the thread.Message ID: @.***>

[CatsLover2006]

In order to support rclone, I’d need a server which could take in rclone data, and either output an IPA file or a redirect to the IPA file, and it’d need to be accessible over HTTP or (preferably) HTTPS. While this isn’t impossible, it’d be a lot easier to create a separate server for that and point the existing systems to a URL on that server.

[upintheairsheep]

I only recently checked out the source of the system.

On Wednesday, October 23, 2024, CatsLover2006 @.***> wrote:

In order to support rclone, I’d need a server which could take in rclone data, and either output an IPA file or a redirect to the IPA file, and it’d need to be accessible over HTTP or (preferably) HTTPS. While this isn’t impossible, it’d be a lot easier to create a separate server for that and point the existing systems to the URL on that server.

— Reply to this email directly, view it on GitHub https://github.com/CatsLover2006/iOSobscuraServer/issues/1#issuecomment-2433526745, or unsubscribe https://github.com/notifications/unsubscribe-auth/AKNKRXBAP52F6P6BK623ZATZ5AKSBAVCNFSM6AAAAABQI3IYGCVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMZDIMZTGUZDMNZUGU . You are receiving this because you authored the thread.Message ID: @.***>

[upintheairsheep]

Nevermind, https://github.com/KoalaBear84/OpenDirectoryDownloader/ is a much better thing for open directories.

On Wednesday, October 23, 2024, CatsLover2006 @.***> wrote:

In order to support rclone, I’d need a server which could take in rclone data, and either output an IPA file or a redirect to the IPA file, and it’d need to be accessible over HTTP or (preferably) HTTPS. While this isn’t impossible, it’d be a lot easier to create a separate server for that and point the existing systems to the URL on that server.

— Reply to this email directly, view it on GitHub https://github.com/CatsLover2006/iOSobscuraServer/issues/1#issuecomment-2433526745, or unsubscribe https://github.com/notifications/unsubscribe-auth/AKNKRXBAP52F6P6BK623ZATZ5AKSBAVCNFSM6AAAAABQI3IYGCVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMZDIMZTGUZDMNZUGU . You are receiving this because you authored the thread.Message ID: @.***>

[CatsLover2006]

New archives (not archive groups, I'll figure that out soon) can be added using config.json.

[upintheairsheep]

I want the ability to submit links directly via the website.

On Wednesday, October 23, 2024, CatsLover2006 @.***> wrote:

New archives (not archive groups, I'll figure that out soon) can be added using config.json.

— Reply to this email directly, view it on GitHub https://github.com/CatsLover2006/iOSobscuraServer/issues/1#issuecomment-2434275124, or unsubscribe https://github.com/notifications/unsubscribe-auth/AKNKRXH4Z5BFJSC4WPTX633Z5B2OZAVCNFSM6AAAAABQI3IYGCVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMZDIMZUGI3TKMJSGQ . You are receiving this because you authored the thread.Message ID: @.***>

[upintheairsheep]

Submit either a direct ipa link, a website/directory that links to various IPAs (use the directory scrape tool or just extract the .ipa links on the page although it will not be recursive), or an internet archive item. When the IA becomes stable enough, we should scrape the archive.

[CatsLover2006]

I could add the ability to email the instance admin about the possibility of adding an archive or individual URL, but the idea of adding an IPA file directly via the website could be dangerous. Bad actors could very easily abuse it to flood an instance with viruses.

[upintheairsheep]

Integrate VirusTotal for this reason, and have a review system as well (you need to approve them first). Would fix the problem, also put a warning for user-submitted applications. Additionally, add hCaptia to prevent spam.

On Thursday, October 24, 2024, CatsLover2006 @.***> wrote:

I could add the ability to email the instance admin about the possibility of adding an archive or individual URL, but the idea of adding an IPA file directly via the website could be dangerous. Bad actors could very easily abuse it to flood an instance with viruses.

— Reply to this email directly, view it on GitHub https://github.com/CatsLover2006/iOSobscuraServer/issues/1#issuecomment-2436308523, or unsubscribe https://github.com/notifications/unsubscribe-auth/AKNKRXCW3A2GG37KUEG6I23Z5FMDPAVCNFSM6AAAAABQI3IYGCVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMZDIMZWGMYDQNJSGM . You are receiving this because you authored the thread.Message ID: @.***>

[upintheairsheep]

But except on the main instance, leave it disabled

Sent from my Apple Watch

[upintheairsheep]

The issue should be reopened, as I have put counter-abuse methods like hCaptia and manual review (you have to manually VirusTotal it)