search

awslabs / service-workbench-on-aws

A platform that provides researchers with one-click access to collaborative workspace environments operating across teams, universities, and datasets while enabling university IT stakeholders to manage, monitor, and control spending, apply security best practices, and comply with corporate governance.
Apache License 2.0
178 stars 119 forks source link

Errors running environment-deploy.sh #296

Closed zaro0508 closed 3 years ago

zaro0508 commented 3 years ago

I have deployed the SC workbench. The deployment seems to work and at the end it reports ENVIRONMENT DEPLOYED SUCCESSFULLY however I do see some "Invalid authentication credentials" errors during the "Deploying Go component" step. What do these errors mean? and should we be concerned about them?

➜ node --version v15.5.1

➜ pnpm --version 5.17.1

➜ go version go version go1.12.9 darwin/amd64

Deploying Go component step Deploying Go component: Environment-Tools ... [serverless-go-build-tools] build-go: Building package '@aws-ee/s3-synchronizer' in '/Users/zaro0508/work-github/service-workbench-on-aws/addons/addon-raas-s3-copy/packages/s3-synchronizer [serverless-go-build-tools] build-go: Building bin/s3-synchronizer-linux-amd64 go: finding github.com/aws/aws-sdk-go v1.35.15 go: finding github.com/mitchellh/go-homedir v1.1.0 go: finding github.com/orcaman/concurrent-map v0.0.0-20190826125027-8c72a8bb44f6 go: finding github.com/johannesboyne/gofakes3 v0.0.0-20200716060623-6b2b4cb092cc go: finding github.com/shabbyrobe/gocovmerge v0.0.0-20190829150210-3e036491d500 go: finding github.com/fsnotify/fsnotify v1.4.9 go: finding golang.org/x/tools v0.0.0-20201103190053-ac612affd56b go: finding golang.org/x/sys v0.0.0-20201026173827-119d4633e4d1 go: golang.org/x/tools@v0.0.0-20201103190053-ac612affd56b: git fetch -f https://go.googlesource.com/tools refs/heads/*:refs/heads/* refs/tags/*:refs/tags/* in /Users/zaro0508/.gvm/pkgsets/go1.12.9/global/pkg/mod/cache/vcs/b44680b3c3708a854d4c89f55aedda0b223beb8d9e30fba969cefb5bd9c1e843: exit status 128: remote: INVALID_ARGUMENT: Request contains an invalid argument remote: [type.googleapis.com/google.rpc.LocalizedMessage] remote: locale: "en-US" remote: message: "Invalid authentication credentials. Please generate a new identifier: https://go.googlesource.com/new-password" remote: remote: [type.googleapis.com/google.rpc.RequestInfo] remote: request_id: "73d4c1c43bc54c9685cf89dd7937c037" fatal: unable to access 'https://go.googlesource.com/tools/': The requested URL returned error: 400 go: golang.org/x/sys@v0.0.0-20201026173827-119d4633e4d1: git fetch -f origin refs/heads/*:refs/heads/* refs/tags/*:refs/tags/* in /Users/zaro0508/.gvm/pkgsets/go1.12.9/global/pkg/mod/cache/vcs/76a8992ccba6d77c6bcf031ff2b6d821cf232e4ad8d1f2362404fbd0a798d846: exit status 128: remote: INVALID_ARGUMENT: Request contains an invalid argument remote: [type.googleapis.com/google.rpc.LocalizedMessage] remote: locale: "en-US" remote: message: "Invalid authentication credentials. Please generate a new identifier: https://go.googlesource.com/new-password" remote: remote: [type.googleapis.com/google.rpc.RequestInfo] remote: request_id: "d7fe58992e674510a9f756bd792d8bf3" fatal: unable to access 'https://go.googlesource.com/sys/': The requested URL returned error: 400 go: error loading module requirements [serverless-go-build-tools] build-go: Error building bin/s3-synchronizer-linux-amd64: Error: Command failed: go build -ldflags="-s -w" -o bin/s3-synchronizer-linux-amd64 ./src go: finding github.com/aws/aws-sdk-go v1.35.15 go: finding github.com/mitchellh/go-homedir v1.1.0 go: finding github.com/orcaman/concurrent-map v0.0.0-20190826125027-8c72a8bb44f6 go: finding github.com/johannesboyne/gofakes3 v0.0.0-20200716060623-6b2b4cb092cc go: finding github.com/shabbyrobe/gocovmerge v0.0.0-20190829150210-3e036491d500 go: finding github.com/fsnotify/fsnotify v1.4.9 go: finding golang.org/x/tools v0.0.0-20201103190053-ac612affd56b go: finding golang.org/x/sys v0.0.0-20201026173827-119d4633e4d1 go: golang.org/x/tools@v0.0.0-20201103190053-ac612affd56b: git fetch -f https://go.googlesource.com/tools refs/heads/*:refs/heads/* refs/tags/*:refs/tags/* in /Users/zaro0508/.gvm/pkgsets/go1.12.9/global/pkg/mod/cache/vcs/b44680b3c3708a854d4c89f55aedda0b223beb8d9e30fba969cefb5bd9c1e843: exit status 128: remote: INVALID_ARGUMENT: Request contains an invalid argument remote: [type.googleapis.com/google.rpc.LocalizedMessage] remote: locale: "en-US" remote: message: "Invalid authentication credentials. Please generate a new identifier: https://go.googlesource.com/new-password" remote: remote: [type.googleapis.com/google.rpc.RequestInfo] remote: request_id: "73d4c1c43bc54c9685cf89dd7937c037" fatal: unable to access 'https://go.googlesource.com/tools/': The requested URL returned error: 400 go: golang.org/x/sys@v0.0.0-20201026173827-119d4633e4d1: git fetch -f origin refs/heads/*:refs/heads/* refs/tags/*:refs/tags/* in /Users/zaro0508/.gvm/pkgsets/go1.12.9/global/pkg/mod/cache/vcs/76a8992ccba6d77c6bcf031ff2b6d821cf232e4ad8d1f2362404fbd0a798d846: exit status 128: remote: INVALID_ARGUMENT: Request contains an invalid argument remote: [type.googleapis.com/google.rpc.LocalizedMessage] remote: locale: "en-US" remote: message: "Invalid authentication credentials. Please generate a new identifier: https://go.googlesource.com/new-password" remote: remote: [type.googleapis.com/google.rpc.RequestInfo] remote: request_id: "d7fe58992e674510a9f756bd792d8bf3" fatal: unable to access 'https://go.googlesource.com/sys/': The requested URL returned error: 400 go: error loading module requirements [serverless-go-build-tools] build-go: Building bin/s3-synchronizer-windows-amd64.exe go: finding github.com/shabbyrobe/gocovmerge v0.0.0-20180507124511-f6ea450bfb63 go: finding github.com/pkg/errors v0.9.1 go: finding github.com/jmespath/go-jmespath v0.4.0 go: finding github.com/boltdb/bolt v1.3.1 go: finding github.com/stretchr/testify v1.3.0 go: finding golang.org/x/tools v0.0.0-20201103190053-ac612affd56b go: finding golang.org/x/tools v0.0.0-20190829051458-42f498d34c4d go: finding golang.org/x/sys v0.0.0-20201026173827-119d4633e4d1 go: finding golang.org/x/sys v0.0.0-20191005200804-aed5e4c7ecf9 go: finding golang.org/x/net v0.0.0-20200202094626-16171245cfb2 go: finding github.com/spf13/afero v1.2.1 go: golang.org/x/sys@v0.0.0-20201026173827-119d4633e4d1: git fetch -f https://go.googlesource.com/sys refs/heads/*:refs/heads/* refs/tags/*:refs/tags/* in /Users/zaro0508/.gvm/pkgsets/go1.12.9/global/pkg/mod/cache/vcs/76a8992ccba6d77c6bcf031ff2b6d821cf232e4ad8d1f2362404fbd0a798d846: exit status 128: remote: INVALID_ARGUMENT: Request contains an invalid argument remote: [type.googleapis.com/google.rpc.LocalizedMessage] remote: locale: "en-US" remote: message: "Invalid authentication credentials. Please generate a new identifier: https://go.googlesource.com/new-password" remote: remote: [type.googleapis.com/google.rpc.RequestInfo] remote: request_id: "136be9b48ac44389afefac551a113875" fatal: unable to access 'https://go.googlesource.com/sys/': The requested URL returned error: 400 go: finding golang.org/x/sys v0.0.0-20190310054646-10058d7d4faa go: golang.org/x/sys@v0.0.0-20191005200804-aed5e4c7ecf9: unknown revision aed5e4c7ecf9 go: golang.org/x/sys@v0.0.0-20190310054646-10058d7d4faa: unknown revision 10058d7d4faa go: finding github.com/davecgh/go-spew v1.1.0 go: golang.org/x/tools@v0.0.0-20201103190053-ac612affd56b: git fetch -f https://go.googlesource.com/tools refs/heads/*:refs/heads/* refs/tags/*:refs/tags/* in /Users/zaro0508/.gvm/pkgsets/go1.12.9/global/pkg/mod/cache/vcs/b44680b3c3708a854d4c89f55aedda0b223beb8d9e30fba969cefb5bd9c1e843: exit status 128: remote: INVALID_ARGUMENT: Request contains an invalid argument remote: [type.googleapis.com/google.rpc.LocalizedMessage] remote: locale: "en-US" remote: message: "Invalid authentication credentials. Please generate a new identifier: https://go.googlesource.com/new-password" remote: remote: [type.googleapis.com/google.rpc.RequestInfo] remote: request_id: "0ade6b466f134dabbc0aabd1382b16c9" fatal: unable to access 'https://go.googlesource.com/tools/': The requested URL returned error: 400 go: golang.org/x/net@v0.0.0-20200202094626-16171245cfb2: git fetch -f origin refs/heads/*:refs/heads/* refs/tags/*:refs/tags/* in /Users/zaro0508/.gvm/pkgsets/go1.12.9/global/pkg/mod/cache/vcs/4a22365141bc4eea5d5ac4a1395e653f2669485db75ef119e7bbec8e19b12a21: exit status 128: remote: INVALID_ARGUMENT: Request contains an invalid argument remote: [type.googleapis.com/google.rpc.LocalizedMessage] remote: locale: "en-US" remote: message: "Invalid authentication credentials. Please generate a new identifier: https://go.googlesource.com/new-password" remote: remote: [type.googleapis.com/google.rpc.RequestInfo] remote: request_id: "9c21f572f78b48d3b0661345a1849511" fatal: unable to access 'https://go.googlesource.com/net/': The requested URL returned error: 400 go: finding golang.org/x/sync v0.0.0-20190423024810-112230192c58 go: finding github.com/ryszard/goskiplist v0.0.0-20150312221310-2dfbae5fcf46 go: finding gopkg.in/mgo.v2 v2.0.0-20180705113604-9856a29383ce go: golang.org/x/sync@v0.0.0-20190423024810-112230192c58: git fetch -f origin refs/heads/*:refs/heads/* refs/tags/*:refs/tags/* in /Users/zaro0508/.gvm/pkgsets/go1.12.9/global/pkg/mod/cache/vcs/55179c5d8c4db2eaed9fae4682d4c84a1fd3612df666b372bef3bbb997c9601f: exit status 128: remote: INVALID_ARGUMENT: Request contains an invalid argument remote: [type.googleapis.com/google.rpc.LocalizedMessage] remote: locale: "en-US" remote: message: "Invalid authentication credentials. Please generate a new identifier: https://go.googlesource.com/new-password" remote: remote: [type.googleapis.com/google.rpc.RequestInfo] remote: request_id: "cd732eb458c4481a9dbb28f5236c1df0" fatal: unable to access 'https://go.googlesource.com/sync/': The requested URL returned error: 400 go: finding golang.org/x/net v0.0.0-20190310074541-c10a0554eabf go: golang.org/x/net@v0.0.0-20190310074541-c10a0554eabf: unknown revision c10a0554eabf go: finding golang.org/x/net v0.0.0-20190620200207-3b0461eec859 go: golang.org/x/net@v0.0.0-20190620200207-3b0461eec859: unknown revision 3b0461eec859 go: finding golang.org/x/tools v0.0.0-20190308174544-00c44ba9c14f go: finding github.com/aws/aws-sdk-go v1.17.4 go: finding golang.org/x/xerrors v0.0.0-20190717185122-a985d3407aa7 go: finding gopkg.in/yaml.v2 v2.2.2 go: golang.org/x/xerrors@v0.0.0-20190717185122-a985d3407aa7: git fetch -f origin refs/heads/*:refs/heads/* refs/tags/*:refs/tags/* in /Users/zaro0508/.gvm/pkgsets/go1.12.9/global/pkg/mod/cache/vcs/3dae2e2383f75162530e523fa60c46a0150bec632a2a57ec3fee7fac3fc3648c: exit status 128: remote: INVALID_ARGUMENT: Request contains an invalid argument remote: [type.googleapis.com/google.rpc.LocalizedMessage] remote: locale: "en-US" remote: message: "Invalid authentication credentials. Please generate a new identifier: https://go.googlesource.com/new-password" remote: remote: [type.googleapis.com/google.rpc.RequestInfo] remote: request_id: "8f17c84a40cc46d59f23b301311b590e" fatal: unable to access 'https://go.googlesource.com/xerrors/': The requested URL returned error: 400 go: error loading module requirements [serverless-go-build-tools] build-go: Error building bin/s3-synchronizer-windows-amd64.exe: Error: Command failed: go build -ldflags="-s -w" -o bin/s3-synchronizer-windows-amd64.exe ./src go: finding github.com/shabbyrobe/gocovmerge v0.0.0-20180507124511-f6ea450bfb63 go: finding github.com/pkg/errors v0.9.1 go: finding github.com/jmespath/go-jmespath v0.4.0 go: finding github.com/boltdb/bolt v1.3.1 go: finding github.com/stretchr/testify v1.3.0 go: finding golang.org/x/tools v0.0.0-20201103190053-ac612affd56b go: finding golang.org/x/tools v0.0.0-20190829051458-42f498d34c4d go: finding golang.org/x/sys v0.0.0-20201026173827-119d4633e4d1 go: finding golang.org/x/sys v0.0.0-20191005200804-aed5e4c7ecf9 go: finding golang.org/x/net v0.0.0-20200202094626-16171245cfb2 go: finding github.com/spf13/afero v1.2.1 go: golang.org/x/sys@v0.0.0-20201026173827-119d4633e4d1: git fetch -f https://go.googlesource.com/sys refs/heads/*:refs/heads/* refs/tags/*:refs/tags/* in /Users/zaro0508/.gvm/pkgsets/go1.12.9/global/pkg/mod/cache/vcs/76a8992ccba6d77c6bcf031ff2b6d821cf232e4ad8d1f2362404fbd0a798d846: exit status 128: remote: INVALID_ARGUMENT: Request contains an invalid argument remote: [type.googleapis.com/google.rpc.LocalizedMessage] remote: locale: "en-US" remote: message: "Invalid authentication credentials. Please generate a new identifier: https://go.googlesource.com/new-password" remote: remote: [type.googleapis.com/google.rpc.RequestInfo] remote: request_id: "136be9b48ac44389afefac551a113875" fatal: unable to access 'https://go.googlesource.com/sys/': The requested URL returned error: 400 go: finding golang.org/x/sys v0.0.0-20190310054646-10058d7d4faa go: golang.org/x/sys@v0.0.0-20191005200804-aed5e4c7ecf9: unknown revision aed5e4c7ecf9 go: golang.org/x/sys@v0.0.0-20190310054646-10058d7d4faa: unknown revision 10058d7d4faa go: finding github.com/davecgh/go-spew v1.1.0 go: golang.org/x/tools@v0.0.0-20201103190053-ac612affd56b: git fetch -f https://go.googlesource.com/tools refs/heads/*:refs/heads/* refs/tags/*:refs/tags/* in /Users/zaro0508/.gvm/pkgsets/go1.12.9/global/pkg/mod/cache/vcs/b44680b3c3708a854d4c89f55aedda0b223beb8d9e30fba969cefb5bd9c1e843: exit status 128: remote: INVALID_ARGUMENT: Request contains an invalid argument remote: [type.googleapis.com/google.rpc.LocalizedMessage] remote: locale: "en-US" remote: message: "Invalid authentication credentials. Please generate a new identifier: https://go.googlesource.com/new-password" remote: remote: [type.googleapis.com/google.rpc.RequestInfo] remote: request_id: "0ade6b466f134dabbc0aabd1382b16c9" fatal: unable to access 'https://go.googlesource.com/tools/': The requested URL returned error: 400 go: golang.org/x/net@v0.0.0-20200202094626-16171245cfb2: git fetch -f origin refs/heads/*:refs/heads/* refs/tags/*:refs/tags/* in /Users/zaro0508/.gvm/pkgsets/go1.12.9/global/pkg/mod/cache/vcs/4a22365141bc4eea5d5ac4a1395e653f2669485db75ef119e7bbec8e19b12a21: exit status 128: remote: INVALID_ARGUMENT: Request contains an invalid argument remote: [type.googleapis.com/google.rpc.LocalizedMessage] remote: locale: "en-US" remote: message: "Invalid authentication credentials. Please generate a new identifier: https://go.googlesource.com/new-password" remote: remote: [type.googleapis.com/google.rpc.RequestInfo] remote: request_id: "9c21f572f78b48d3b0661345a1849511" fatal: unable to access 'https://go.googlesource.com/net/': The requested URL returned error: 400 go: finding golang.org/x/sync v0.0.0-20190423024810-112230192c58 go: finding github.com/ryszard/goskiplist v0.0.0-20150312221310-2dfbae5fcf46 go: finding gopkg.in/mgo.v2 v2.0.0-20180705113604-9856a29383ce go: golang.org/x/sync@v0.0.0-20190423024810-112230192c58: git fetch -f origin refs/heads/*:refs/heads/* refs/tags/*:refs/tags/* in /Users/zaro0508/.gvm/pkgsets/go1.12.9/global/pkg/mod/cache/vcs/55179c5d8c4db2eaed9fae4682d4c84a1fd3612df666b372bef3bbb997c9601f: exit status 128: remote: INVALID_ARGUMENT: Request contains an invalid argument remote: [type.googleapis.com/google.rpc.LocalizedMessage] remote: locale: "en-US" remote: message: "Invalid authentication credentials. Please generate a new identifier: https://go.googlesource.com/new-password" remote: remote: [type.googleapis.com/google.rpc.RequestInfo] remote: request_id: "cd732eb458c4481a9dbb28f5236c1df0" fatal: unable to access 'https://go.googlesource.com/sync/': The requested URL returned error: 400 go: finding golang.org/x/net v0.0.0-20190310074541-c10a0554eabf go: golang.org/x/net@v0.0.0-20190310074541-c10a0554eabf: unknown revision c10a0554eabf go: finding golang.org/x/net v0.0.0-20190620200207-3b0461eec859 go: golang.org/x/net@v0.0.0-20190620200207-3b0461eec859: unknown revision 3b0461eec859 go: finding golang.org/x/tools v0.0.0-20190308174544-00c44ba9c14f go: finding github.com/aws/aws-sdk-go v1.17.4 go: finding golang.org/x/xerrors v0.0.0-20190717185122-a985d3407aa7 go: finding gopkg.in/yaml.v2 v2.2.2 go: golang.org/x/xerrors@v0.0.0-20190717185122-a985d3407aa7: git fetch -f origin refs/heads/*:refs/heads/* refs/tags/*:refs/tags/* in /Users/zaro0508/.gvm/pkgsets/go1.12.9/global/pkg/mod/cache/vcs/3dae2e2383f75162530e523fa60c46a0150bec632a2a57ec3fee7fac3fc3648c: exit status 128: remote: INVALID_ARGUMENT: Request contains an invalid argument remote: [type.googleapis.com/google.rpc.LocalizedMessage] remote: locale: "en-US" remote: message: "Invalid authentication credentials. Please generate a new identifier: https://go.googlesource.com/new-password" remote: remote: [type.googleapis.com/google.rpc.RequestInfo] remote: request_id: "8f17c84a40cc46d59f23b301311b590e" fatal: unable to access 'https://go.googlesource.com/xerrors/': The requested URL returned error: 400 go: error loading module requirements [serverless-go-build-tools] build-go: Finished builds: @aws-ee/s3-synchronizer [serverless-go-build-tools] deploy-go: Finished deployment Deployed Go component: Environment-Tools successfully
nguyen102 commented 3 years ago

The Go component is used to set up Studies on Windows Workspaces. If the Go deployment steps failed, you might not be able to set up Window Workspaces with Studies. Does this use case apply to your situation? If not, you won't have to worry about the install errors listed. If you are using Window Workspace with Studies, please follow the debugging steps below.

The addons/addon-raas-s3-copy/packages/s3-synchronizer/go.mod file contains list of Go modules that the package depends on. It tries to load those modules from GitHub. If you do not have GitHub credentials configured you may be getting error when loading the Go dependencies. To verify this you can try building out the s3-synchronizer as follows

cd addons/addon-raas-s3-copy/packages/s3-synchronizer
./build.sh

Once that passes, the Go errors encountered via ./environment-deploy.sh will also clear up

Btw, for testing and proof of concepts, using the SWB Solutions might give you the best user experience. It'll automate the process of deploying SWB for you, so that you can quickly test it out.

For production use cases, you would want to use the latest release from our GH repo.

zaro0508 commented 3 years ago

The Go component is used to set up Studies on Windows Workspaces. If the Go deployment steps failed, you might not be able to set up Window Workspaces with Studies. Does this use case apply to your situation? If not, you won't have to worry about the install errors listed. If you are using Window Workspace with Studies, please follow the debugging steps below.

We are not using workspaces at all, at least not yet.

Btw, for testing and proof of concepts, using the Automated Cloudformation Template might give you the best user experience. It'll automate the process of deploying SWB for you, so that you can quickly test it out.

To install/deploy I used the directions from README in this repo which says to run environment-deploy.sh. Is that not equivalent to the cloudformation template(s) specified in the AWS docs?

nguyen102 commented 3 years ago

SWB can be deployed by following the instructions in the README of this repo or by using the SWB AWS Solutions. Both are the same code, except the code in this repo is more up to date than the code in AWS Solutions. We periodically update the code in AWS Solutions by porting the code in this repo to AWS Solutions.

The difference between deploying SWB with the code in this repo and using AWS Solutions is that AWS solutions simplify the deployment process. You won't have to download needed dependencies and run the deploy scripts from your local machine. Although, it looks like you might have successfully deployed the code to your AWS account already, so using AWS Solutions might be a mute point now.