search

google / cloud-forensics-utils

Python library to carry out DFIR analysis on the Cloud
Apache License 2.0
453 stars 89 forks source link

S3 E2E test #356

Closed ramo-j closed 3 years ago

ramo-j commented 3 years ago

Created an S3 E2E test. Required creation of some S3 rm functions.

Also, added a cleanupo to the EBS snapshot copy to S3 test.

E2E test run output:

$ python3 setup.py install --user && python3 tests/providers/aws/e2e.py
[2021-07-26 01:45:19,696] [libcloudforensics.providers.aws.forensics] INFO     No AMI provided, fetching one for Ubuntu 18.04
[2021-07-26 01:45:20,419] [libcloudforensics.providers.aws.forensics] INFO     Starting analysis VM new-vm-for-analysis
[2021-07-26 01:47:52,533] [libcloudforensics.providers.aws.forensics] INFO     VM started.
[2021-07-26 01:47:52,533] [libcloudforensics.providers.aws.forensics] INFO     VM ready.
[2021-07-26 01:47:53,113] [libcloudforensics.providers.aws.forensics] INFO     Volume copy of vol-017a715a3f77a0276 started...
[2021-07-26 01:48:23,742] [libcloudforensics.providers.aws.forensics] INFO     Created snapshot: snap-0fecb77383a387416
[2021-07-26 01:48:42,021] [libcloudforensics.providers.aws.forensics] INFO     Volume vol-017a715a3f77a0276 successfully copied to vol-0cc31f1da1e384344
[2021-07-26 01:48:42,021] [libcloudforensics.providers.aws.forensics] INFO     Cleaning up...
[2021-07-26 01:48:42,265] [libcloudforensics.providers.aws.forensics] INFO     Done
.[2021-07-26 01:48:42,337] [libcloudforensics.providers.aws.internal.iam] INFO     Creating IAM Instance Profile ebsCopy
[2021-07-26 01:48:43,417] [libcloudforensics.providers.aws.internal.iam] INFO     Creating IAM policy ebsCopy-policy
[2021-07-26 01:48:43,672] [libcloudforensics.providers.aws.internal.iam] INFO     Creating IAM Role ebsCopy-role
[2021-07-26 01:48:43,922] [libcloudforensics.providers.aws.internal.iam] INFO     Attaching policy arn:aws:iam::752954844773:policy/ebsCopy-policy to role ebsCopy-role
[2021-07-26 01:48:44,173] [libcloudforensics.providers.aws.internal.iam] INFO     Attaching role ebsCopy-role to instance profile ebsCopy
[2021-07-26 01:48:44,433] [libcloudforensics.providers.aws.forensics] INFO     Finding AMI
[2021-07-26 01:49:05,262] [libcloudforensics.providers.aws.forensics] INFO     Starting copy instance
[2021-07-26 01:49:06,585] [libcloudforensics.providers.aws.forensics] INFO     Checking for output files with exponential backoff
[2021-07-26 01:49:06,586] [libcloudforensics.providers.aws.forensics] INFO     Waiting 10 seconds
[2021-07-26 01:49:16,813] [libcloudforensics.providers.aws.forensics] INFO     Waiting 20 seconds
[2021-07-26 01:49:36,991] [libcloudforensics.providers.aws.forensics] INFO     Waiting 40 seconds
[2021-07-26 01:50:17,201] [libcloudforensics.providers.aws.forensics] INFO     Waiting 80 seconds
[2021-07-26 01:51:37,457] [libcloudforensics.providers.aws.forensics] INFO     Waiting 160 seconds
[2021-07-26 01:54:17,768] [libcloudforensics.providers.aws.internal.iam] INFO     Detaching role ebsCopy-role from instance profile ebsCopy
[2021-07-26 01:54:18,911] [libcloudforensics.providers.aws.internal.iam] INFO     Detaching policy arn:aws:iam::752954844773:policy/ebsCopy-policy from role ebsCopy-role
[2021-07-26 01:54:19,160] [libcloudforensics.providers.aws.internal.iam] INFO     Deleting instance profile ebsCopy
[2021-07-26 01:54:19,452] [libcloudforensics.providers.aws.internal.iam] INFO     Deleting IAM role ebsCopy-role
[2021-07-26 01:54:19,733] [libcloudforensics.providers.aws.internal.iam] INFO     Deleting IAM policy arn:aws:iam::752954844773:policy/ebsCopy-policy
[2021-07-26 01:54:20,030] [libcloudforensics.providers.aws.forensics] INFO     Image and hash copied to s3://ramoj-test-bucket/snapshots/snap-0aee13cd5485ba73f/
....[2021-07-26 01:54:21,603] [libcloudforensics.providers.aws.forensics] INFO     Volume copy of vol-017a715a3f77a0276 started...
[2021-07-26 01:54:52,045] [libcloudforensics.providers.aws.forensics] INFO     Created snapshot: snap-07185fc5c5c302476
[2021-07-26 01:55:10,445] [libcloudforensics.providers.aws.forensics] INFO     Volume vol-017a715a3f77a0276 successfully copied to vol-0ba9289906bc1ea93
[2021-07-26 01:55:10,446] [libcloudforensics.providers.aws.forensics] INFO     Cleaning up...
[2021-07-26 01:55:10,750] [libcloudforensics.providers.aws.forensics] INFO     Done
[2021-07-26 01:55:10,758] [libcloudforensics.providers.aws.forensics] INFO     No AMI provided, fetching one for Ubuntu 18.04
[2021-07-26 01:55:11,493] [libcloudforensics.providers.aws.forensics] INFO     Starting analysis VM new-vm-for-analysis
[2021-07-26 01:55:11,654] [libcloudforensics.providers.aws.forensics] INFO     VM started.
[2021-07-26 01:55:11,654] [libcloudforensics.providers.aws.forensics] INFO     Attaching volume vol-0ba9289906bc1ea93 to device /dev/sdp
[2021-07-26 01:55:12,130] [libcloudforensics.providers.aws.forensics] INFO     VM ready.
.[2021-07-26 01:55:12,579] [libcloudforensics.providers.aws.forensics] INFO     Volume copy of vol-017a715a3f77a0276 started...
[2021-07-26 01:56:13,062] [libcloudforensics.providers.aws.forensics] INFO     Created snapshot: snap-05e084dfc8713a9de
[2021-07-26 01:56:31,718] [libcloudforensics.providers.aws.forensics] INFO     Volume vol-017a715a3f77a0276 successfully copied to vol-04b47f3fde16c86e7
[2021-07-26 01:56:31,719] [libcloudforensics.providers.aws.forensics] INFO     Cleaning up...
[2021-07-26 01:56:31,950] [libcloudforensics.providers.aws.forensics] INFO     Done
.[2021-07-26 01:56:32,287] [libcloudforensics.providers.aws.forensics] INFO     Volume copy of vol-017a715a3f77a0276 started...
[2021-07-26 01:57:02,729] [libcloudforensics.providers.aws.forensics] INFO     Created snapshot: snap-081e055361fcae0ea
[2021-07-26 01:57:21,207] [libcloudforensics.providers.aws.forensics] INFO     Volume vol-017a715a3f77a0276 successfully copied to vol-0e46edd72761efda0
[2021-07-26 01:57:21,208] [libcloudforensics.providers.aws.forensics] INFO     Cleaning up...
[2021-07-26 01:57:21,430] [libcloudforensics.providers.aws.forensics] INFO     Done
.[2021-07-26 01:57:51,904] [__main__            ] INFO     Deleting volume: vol-0cc31f1da1e384344.
[2021-07-26 01:58:07,299] [__main__            ] INFO     Volume vol-0cc31f1da1e384344 successfully deleted.
[2021-07-26 01:58:07,299] [__main__            ] INFO     Deleting volume: vol-0ba9289906bc1ea93.
[2021-07-26 01:58:22,637] [__main__            ] INFO     Volume vol-0ba9289906bc1ea93 successfully deleted.
[2021-07-26 01:58:22,637] [__main__            ] INFO     Deleting volume: vol-04b47f3fde16c86e7.
[2021-07-26 01:58:37,998] [__main__            ] INFO     Volume vol-04b47f3fde16c86e7 successfully deleted.
[2021-07-26 01:58:37,998] [__main__            ] INFO     Deleting volume: vol-0e46edd72761efda0.
[2021-07-26 01:58:53,342] [__main__            ] INFO     Volume vol-0e46edd72761efda0 successfully deleted.
[2021-07-26 01:58:54,744] [libcloudforensics.providers.aws.internal.s3] INFO     Bucket successfully created
[2021-07-26 01:58:55,066] [libcloudforensics.providers.aws.internal.s3] INFO     Deleting bucket ramoj-test-bucket-e2e
.[2021-07-26 01:58:55,492] [libcloudforensics.providers.aws.internal.s3] INFO     Deleting bucket ramoj-test-bucket-e2e
codecov-commenter commented 3 years ago

Codecov Report

:exclamation: No coverage uploaded for pull request base (main@eb46a29). Click here to learn what that means. The diff coverage is n/a.

Impacted file tree graph

@@           Coverage Diff           @@
##             main     #356   +/-   ##
=======================================
  Coverage        ?   60.19%           
=======================================
  Files           ?       34           
  Lines           ?     2731           
  Branches        ?        0           
=======================================
  Hits            ?     1644           
  Misses          ?     1087           
  Partials        ?        0
Flag Coverage Δ
nosetests 60.19% <0.00%> (?)

Flags with carried forward coverage won't be shown. Click here to find out more.

Continue to review full report at Codecov.

Legend - Click here to learn more Δ = absolute <relative> (impact), ø = not affected, ? = missing data Powered by Codecov. Last update eb46a29...1a2f182. Read the comment docs.