Open FYNIXqwq opened 1 year ago
The whole crawling process including a web browser running MajSoul, MitProxy working as sniffer API transferring data from MajSoul API and offering licenses, and providing request-responce data to Redis, and Redis working as an analyzer. Amazon S3 is only the place where the data is saved.
Minio might help you. It works fine on my machines.
As the diagram shows, the AWS server mainly acts as a storage and a platform, where the local machine can replace.