refactor file path

[tinaok]

The file path today does not reflect the workflow thus not straight forward.

We will make new structure as follows.

institute - name_of_project - tag - formatted 
                                  - raw
                                  - tag related files (cf bar_flag_warm_plume.txt)
                            - run - user_name - experiment_name
                                              - ...
          - ref-data - institute specific reference data
                     - distance2coast.zarr
                     - nuclear_plant_loc.csv 
                     - ...

[tinaok]

Following commands worked

aws s3 mv s3://gfts-ifremer/tags/bargip/formatted s3://gfts-ifremer/bargip/tag/formatted --recursive
aws s3 mv s3://gfts-ifremer/tags/bargip/cleaned s3://gfts-ifremer/bargip/tag/formatted_bad --recursive
aws s3 mv s3://gfts-ifremer/tags/bargip/raw s3://gfts-ifremer/bargip/tag/raw --recursive

Following commands had err

aws s3 mv s3://gfts-ifremer/tags/bargip/bar_flag_warm_plume.txt s3://gfts-ifremer/bargip/bar_flag_warm_plume.txt 
aws s3 mv s3://gfts-ifremer/tags/bargip/nuclear_plant_loc.csv s3://gfts-ifremer/ref-data/nuclear_plant_loc.csv 
aws s3 mv s3://gfts-ifremer/tags/tracks/ s3://gfts-ifremer/tags/bargip/tracks-06-06 --recursive
aws s3 mv s3://gfts-ifremer/tags/bar_taos s3://gfts-ifremer/bar_taos --recursive
aws s3 mv s3://gfts-ifremer/tags/distance2coast.zarr s3://gfts-ifremer/ref-data/distance2coast.zarr  --recursive
aws s3 mv s3://gfts-ifremer/tags/distance2coast.nc s3://gfts-ifremer/ref-data/distance2coast.nc

Example of err message is

(notebook) jovyan@jupyter-tinaok:~$ aws s3 mv s3://gfts-ifremer/tags/distance2coast.nc s3://gfts-ifremer/ref-data/distance2coast.nc
fatal error: An error occurred (403) when calling the HeadObject operation: Forbidden
(notebook) jovyan@jupyter-tinaok:~$ 

Once above are moved, we will need to run following command.

aws s3 mv s3://gfts-ifremer/tags/bargip s3://gfts-ifremer/bargip/run/aderrien7 --recursive

[minrk]

I believe these permissions are fixed now, if you want to try running again

[tinaok]

Thank you, It works. I started last night the last step, it is still running.