github-actions[bot]
commented
1 year ago Search before asking
- [X] I had searched in the feature and found no similar feature requirement.
Description
Can it support AWS EKS and S3 as the resource storage of the entire platform, and at the same time reduce the authority dependence on AWS? (just some immature ideas)
- For example, datasophon can be deployed independently and separated from the deployed big data components. When there is a problem with datasophon, the deployed big data components can be used directly without affecting the business.
- For example, datasophon can be deployed to EKS, and at the same time, big data components can be deployed to EKS through datasophon.
- For example, all resource files of datasophon can be stored on S3 and provide management functions, which is somewhat similar to dolphin scheduling.
- It would be even better if all deployment operations can generate AWS native template language (JSON or YAML) files, and the files are automatically submitted to gitlab, and resource deployment is submitted to AWS through this file. (Manage deployment changes, and support version control of deployment at the same time, and can also be separated from datasophon)
- It would be even better if the permission dependence of EKS and S3 can be minimized at the same time. For example, as long as eks and s3 with specific permissions are created in aws, datasophone can be used after configuration. (Administrator-level permissions of eks are not required, because such permissions are managed by other teams, and sometimes it is difficult to obtain)
Usage Scenario
No response
Related issues
No response
Are you willing to submit a PR?
- [X] Yes I am willing to submit a PR!
Code of Conduct
- [X] I agree to follow this project's Code of Conduct
datasophon
Search before asking
Description
可以支持AWS EKS以及S3作为整个平台的资源存储，并同时降低对AWS的权限依赖吗？（仅仅是一些不成熟的想法） 1、比如可以将datasophon独立部署，与部署的大数据组件进行分割，当datasophon出现问题，可以直接使用已部署的大数据组件，不受影响业务。 2、比如datasophon可以部署到EKS上，同时可通过datasophon部署大数据组件到EKS上。 3、比如datasophon的所有资源文件可以可以存储到S3上，并提供管理功能，有点类似于海豚调度。 4、要是所有部署操作可以生成AWS原生的模板语言（JSON 或 YAML）文件，文件自动提交gitlab，并通过该文件向AWS提交资源部署就更好了。（管理部署变更，并同时支持部署的版本控制，还能与datasophon分离） 5、要是同时可以将EKS和S3的权限依赖降到最低就更好了，比如只要在aws创建特定权限的eks和s3, datasophone配置后，就可以使用。（不要求eks的管理员级的权限，因为有这类权限是属于其他团队管理，有时候很难拿到）
Usage Scenario
No response
Related issues
No response
Are you willing to submit a PR?
Code of Conduct