bitnami-labs / sealed-secrets

A Kubernetes controller and tool for one-way encrypted Secrets
Apache License 2.0
7.74k stars 687 forks source link

Status of the project and where it's going #165

Closed kaspernissen closed 2 years ago

kaspernissen commented 5 years ago

We (lunarway) are very interested in this project and would like to discuss its current state and progress.

It seems that there are some great ideas, and solutions in PR's to bring this project to the next level. Unfortunately, the momentum seems to have slowed down, and there hasn't been an official release in over a year. We know it can be time consuming running an open-source project by yourself, as it's presented in the quote from @anguslees from an earlier issue and would, therefore, like to discuss options for collaboration to get this project moving again.

sealed-secrets is not a commercial product for Bitnami, so it gets time from me when I find gaps around other priorities. I wish it were otherwise, but that's the reality at present.

Originally posted by @anguslees in https://github.com/bitnami-labs/sealed-secrets/issues/106#issuecomment-406193084

Possible solutions:

It would be very helpful to get an understanding of where this project is going. At least, it would be great to know how we can help as many in the community are either using this project or needs a solution like this in their kubernetes clusters.

olliebun commented 5 years ago

Thanks for opening this discussion, @kaspernissen.

We (greensync) are excited about Sealed Secrets too, and we're in the process of rolling it out internally. It solves some problems we have better than anything else we could find in the Kubernetes space, and the code base is small and simple enough for us to understand and work on.

At the moment we're using our own fork of the CLI tool which cleans up the UX a little; there has been some discussion of this work, and some positive feedback, but we're not sure how to push it forward.

We are willing to invest and commit some development time to Sealed Secrets, and I think we have the right mix of use case and Go experience to contribute meaningfully. We aren't particularly fussed about how this gets done, as long as we can be confident that the project can be maintained. Our own fork is possible, but it'd be a shame to go down that road when there's some real community interest in this as an open-source project.

kaspernissen commented 5 years ago

We are in a very similar situation. We are also rolling sealed-secrets out internally at the moment. We have made some workarounds for the limitations of the current implementation and was thinking of forking and invest some in our own fork. However, as @ceralena mentions, that would be a shame to go down that path, when there's real community interest. The UX clean up by @ceralena looks very promising and useful, and would love to see this merged.

Maybe yesterdays acquisition of bitnami could help get this project kickstarted?

cknowles commented 5 years ago

Just chipping in another view as I have been a contributor to this project as have some of my previous colleagues. I am not a user of this project at the moment so harder to spend the time on it but willing to contribute if others take ownership.

Historically myself and previous colleagues found it a bit difficult to get changes in so it’d be good if more people have access to help with PRs and issues. Not sure if there would be any blockers to that, presumably there wouldn’t be if it’s not a commercial product.

anguslees commented 5 years ago

Thanks for starting this discussion @kaspernissen. Yes, I think we can all see that we need to find a way for sealed-secrets not to have me/Bitnami in the critical path ;)

Just so everyone knows, part of the issue preventing new releases atm is a boring semi-technical one:

Because of this blockage, we haven't made any new releases since before #88, which is now a long time ago. In hindsight it would have been better just to release with the intervening schema, but of course I always intended to complete #129 in a timely fashion.


At this point, I'm going to openly do whatever I can to get out of the way: what do people want to do here?

I think we need:

This may or may not involve renaming the git repo away from bitnami-labs/ (but there is no need to do this just to have other people involved. I can add external admins to the existing github project). We could even move it into its own sealed-secrets/sealed-secrets github org if we wanted to have a stable future-proof home. A git rename involves trivially renaming all the golang imports (because golang), and optionally/less-trivially renaming the k8s apiGroup, I will support whatever people want to do here.

I still use this project everyday personally, and continue to care about it. So I am happy to (and would like to) continue to be involved - assuming that's ok with the new shepherds. We just need to find a way for me to transition to a "supporting" rather than "gatekeeper" role.

anguslees commented 5 years ago

Oh, and a massive :heart: to everyone who has contributed, in any capacity. @c-knowles deserves a particular mention for sustained code + user support contributions early in the project :)

demisx commented 5 years ago

After researching many offerings, I’d say this is indeed the best straightforward solution in Kubernetes world so far and would be awful not to see it getting its pulse back. Thank you @anguslees and the rest of the team for all your great work. We’ll be watching.

kaspernissen commented 5 years ago

Thank you for the detailed description and openness, @anguslees! It is highly appreciated and thank you very much for a great project.

Creating a separate org sealed-secrets/sealed-secrets sounds like a good idea. That would as you mention, create a future-proof home.

As mentioned in the initial post, we would love to help out, both @Crevil and myself. However, neither of us probably don't have the security/crypto skills needed to become shepherds for a project like this, but we could help out in other areas and assist as much as possible.

yob commented 5 years ago

I work with @ceralena and wanted to chime in.

It seems like there's a number of people willing to chip in on development, and some uncertainty about the best way to co-ordinate going forward. In the short term, I wonder if we can optimise for unblocking the release train for:

  1. bug fixes
  2. modest functional changes that @anguslees feels are aligned with the sealed-secrets vision

@anguslees, would you be open to something like this:

  1. Identifying (or creating) a few issues that describe the non-radical changes you'd like to see in the short term ( the template schema change, using kube events for debugging, etc)
  2. Adding a few extra committers
  3. Requesting that all committers contributions go via PR (for visibility)
  4. Asking that all PRs have a review from a second committer before being merged, and are either a bugfix or resolving an issue from (1)

Hopefully that will allow some of us to pickup development of the blocking work.

If we can get a few small and successful releases out, we'll be more familiar with eachother and may be in a better position to decide on an alternative collaborative style that is more sustainable long term

chrisharm commented 5 years ago

Hi all, Thanks for starting this conversation. My team is actively using the sealed-secrets project too, and we see the value in it's continued support. I am also willing to contribute to the project, but don't know the best way to move forward. @yob I like many of your suggestions.

I spent some time over the last two days trying to get familiar with the code base, and @anguslees changes in #129. I have attempted to finish this effort and have submitted #170. All of the integration test now pass locally, and I merged the other changes from master into my branch. I'll offer this up as a test to see if we can continue to move the project forward.

@anguslees How would you like to open up the project for new contributions? Who currently has access?

Thanks, Chris

monadic commented 5 years ago

@anguslees @kaspernissen we would love to shepherd this project, ideally long term towards the CNCF in some way shape or form. Perhaps we could all work on this together? Please let me know! Alexis @ Weaveworks.

kaspernissen commented 5 years ago

It sure sounds like there's a great interest in forming a new working group around this project. Thank you for pitching in @monadic. I think Weaveworks would be good shepherds as you have experience running open source projects, and this project fits right in the GitOps philosophy that you are promoting.

Agree with @yob we need to figure out what the next step is - and how we can start contributing to unblock the release train. Can we form a working group and discuss the next steps in a call?

Great work @chrisharm! This is a great step forward.

@anguslees how would you like to proceed?

olliebun commented 5 years ago

I just saw this comment from @mkmik:

https://github.com/bitnami-labs/sealed-secrets/pull/143#issuecomment-502734132

Sorry for the delay, bitnami went through an acquisition and we scrambled a bit. The original maintainer left the company; I'm going to fill that role.

Let me see if this branch is still clean and fully understand out the backward compat implications.

@mkmik - Hi there! Just wanting to make sure you're aware of this conversation.

victornoel commented 5 years ago

So, anything new on this? Has there been some working group spawned a @kaspernissen was proposing? @mkmik?

kaspernissen commented 5 years ago

Unfortunately not, we have been trying to reach out via e-mail as well. @monadic is trying to pull some strings in his network, to see if we can get a response.

mariusmarais commented 5 years ago

I realise this is bad style on my part, but I'm moving on to https://github.com/Soluto/kamus

It might be time to cut our losses and start looking at alternatives.

glerchundi commented 5 years ago

We're also interested in keeping this active and open to collaborate.

Now that It's been over a month since the former maintainer said something (👋 @anguslees) and the new one seems to be missing too (👋 @mkmik), perhaps it's time to think on a deadline to push this forward by creating a fork under a new organisation. WDYT?

In case this makes sense, a deadline for after holidays and before winter ones seems to be something reasonable to let current maintainers have enough time to self pronounce.

Although I think this should be last option.

lopezator commented 5 years ago

It seems that there is a lot of interested people on moving this forward, but it doesn't look this is moving anywhere (more than one month since the thread start).

Maybe time to start a fork?

mkmik commented 5 years ago

Hi. I've been traveling and now I'm back. Sorry for the chaos, acquisitions can disrupt your flow. I will resume active maintenance.

In the meantime we can talk about how to move forward to a more manageable model.

kaspernissen commented 5 years ago

@mkmik great to hear. What do you think of adding more contributors to be able to build up a momentum for this project again? And how can we help to get the project back on track, and get on a steady release cycle again?

Do you want to keep this project under the bitnami-labs org, or perhaps move it to it's own?

mkmik commented 5 years ago

@kaspernissen, I organised a small team here (this is no longer a one-man show of a small startup); I'd prefer to first go through the backlog and unblock the release cycle again and then we can reason about long term governance.

I'm really excited about the interest this project has generated and I'm committed to facilitate the community to come up with improvements and solutions to real-world problems we all have.

chrisharm commented 5 years ago

Let us know if there is anything that we can do to help.

zachaller commented 5 years ago

I see there has been a lot of work happening in the project again, thanks for all the work! I am wondering if there is any rough estimate or timeline for a .8 release really looking forward to template support and the ability of being able use different types. It's a bit of a blocker on our current rollout of kubeseal.

kbirger commented 5 years ago

I think there is a separate discussion on this one point, but since we are talking about regaining momentum, I think it's worth mentioning that a huge impediment for several people is the lack of an official windows distribution.

Yes, lots of people use Windows, and a lot of them work in the k8s space. There is an ad-hoc binary floating around this issue tracker, but it's not the same as an official build.

mkmik commented 5 years ago

@kbirger makes sense (tracked in #85)! I will include a windows build in the v0.8.0 (coming very soon)

mkmik commented 5 years ago

v0.8.0-rc.1 released. Early testers appreciated.

kbirger commented 5 years ago

Awesome. I'll give this a shot in our QA environment on Monday. Not sure if I have any use cases for the new features, but I'll do what I can.

Have a great weekend and thanks for the hard work.

zachaller commented 5 years ago

It seems like the tag in the yaml is missing from quay.io but the latest tag seems to have been updated might want to push a tag that matches the yaml. Again super excited for this release thanks for all the work!

glerchundi commented 5 years ago

Thanks for refloating the project @mkmik

On Sat, 20 Jul 2019 at 05:20, Zach Aller notifications@github.com wrote:

It seems like the tag in the yaml is missing from quay.io but the latest tag seems to have been updated might want to push a tag that matches the yaml. Again super excited for this release thanks for all the work!

— You are receiving this because you are subscribed to this thread. Reply to this email directly, view it on GitHub https://github.com/bitnami-labs/sealed-secrets/issues/165?email_source=notifications&email_token=AARA7FUVLPHRR4SLULXYPL3QAJ76JA5CNFSM4HLPPZD2YY3PNVWWK3TUL52HS4DFVREXG43VMVBW63LNMVXHJKTDN5WW2ZLOORPWSZGOD2NFNBI#issuecomment-513431173, or mute the thread https://github.com/notifications/unsubscribe-auth/AARA7FVCH4FWQYDCUU44CGTQAJ76JANCNFSM4HLPPZDQ .

mkmik commented 5 years ago

@zachaller sorry, third time's the charm: https://github.com/bitnami-labs/sealed-secrets/releases/tag/v0.8.0-rc.3

zachaller commented 5 years ago

@mkmik thanks!! I see it now and its been working great so far.

olliebun commented 5 years ago

Just wanted to drop in and highlight how great it is to see so much movement on this project. I'm sure it's a relief to many. @mkmik thank you for your pragmatic approach!

nrvnrvn commented 5 years ago

Hey everyone!

I am excited to introduce a new operator and CLI for managing and encrypting secrets: https://github.com/amaizfinance/secreter

Actually I had been considering using Sealed-secrets but after careful review of the features (as of early 2019) and issues it became clear that it is better to write a new one from scratch. This particular issue is one of the major issues why we decided to start from scratch instead of trying to contribute to this project. @mkmik thanks a lot for finally moving this project forward and all the work you are doing for the Sealed Secrets.

Please read through the Readme to learn about the features, overview of cryptography and security, give it a try and provide any feedback - the more the better. If I am not mistaken most of the open feature requests for Sealed Secrets are already implemented in Secreter.

We are currently evaluating secreter in our test and sandbox environments. I am going to take care of gcpkms integration shortly in order to be able to move to more production grade testing.

Ideally I would like Secreter to eventually become a CNCF project. The main reason for this is that I believe that handing over such a project to the community is a huge security benefit.

I thought it would be a good idea to put a notice here because most of the people caring about client side Kuberenetes secrets encryption are already here.

Thank you!

mkmik commented 5 years ago

This particular issue is one of the major issues why we decided to start from scratch instead of trying to contribute to this project.

Well, if this issue was the only problem you had the option to fork the project ;-) Creating one from scratch is also an option. I assume this means sealed-secrets internal design doesn't suite you well enough. If you believe that's the fastest way to solve your problems, feel free to pursue it.

I believe that handing over such a project to the community is a huge security benefit.

I also share that belief; I just wanted to actually fix blocker issues before engaging with bureaucracy.

jaygorrell commented 5 years ago

~I do like the idea of an operator~ (oops, blanked out on that one), but I feel like announcing a new project here after this is no longer inactive is a bit in bad taste.

mkmik commented 5 years ago

@jaygorrell fwiw sealed-secrets is an operator too

github-actions[bot] commented 2 years ago

This Issue has been automatically marked as "stale" because it has not had recent activity (for 15 days). It will be closed if no further activity occurs. Thanks for the feedback.

github-actions[bot] commented 2 years ago

Due to the lack of activity in the last 7 days since it was marked as "stale", we proceed to close this Issue. Do not hesitate to reopen it later if necessary.