search

kubernetes / community

Kubernetes community content
Apache License 2.0
11.93k stars 5.16k forks source link

retire wg-machine-learning #3396

Closed castrojo closed 4 years ago

castrojo commented 5 years ago

This WG hasn't met since last September, any one have any more information? From looking at the notes it was active about a year ago.

https://docs.google.com/document/d/1t2zTAehIEu3Xy8VJ6dc_cgODO4WGN-FDwpAfBjYCKc4/edit#

nikhita commented 5 years ago

/wg machine-learning /committee steering

nikhita commented 5 years ago

/cc @vishh @kow3ns @balajismaniam @ConnorDoyle wg-machine-learning organizers

nikhita commented 5 years ago

/kind cleanup

cc @kubernetes/steering-committee

balajismaniam commented 5 years ago

We have been on a hiatus due to dearth of topics. We had a meeting today. One of the topics we discussed was to change the ML WG meeting to monthly one. I'm not sure what it entails to be a user group. If there is less interest from participants in the working group, we can look into transitioning the WG to a user group. WDYT?

marpaia commented 5 years ago

If folks are open to it, I would be interested in participating in the ML WG's leadership and helping refocus a little bit. For the first time in a while, I won't be on the Release Team and I've been doing a lot of Machine Learning at work lately so this feels like an exciting intersection of interests for me.

Specifically, I think some concrete goals for the WG could be expanding the website documentation with answers to common questions about training and serving models with Kubernetes, both from the perspective of the cluster operator and the data scientist. References, happy paths, and comparisons between popular ecosystem tools might be helpful as well. I also think working with SIG Node to document GPU interactions and the configuration required might be useful for a certain demographic of ML engineer.

I'm really just spitballing here; K8s is already quite popular for training and serving. If this group continues on, I think we would be most impactful making sure the whole experience is well documented and well advertised.

bgrant0607 commented 5 years ago

If the group is not operating, I suggest discontinuing it. We're in the process of archiving inactive groups.

@marpaia Thanks for offering to help, but I don't think any type of official advice about other software should be offered on kubernetes.io. One simple reason is that in the past we've been unable to keep such documentation up to date (e.g., to ensure that any tutorials still worked). But I'd also like to avoid what happened with the CNCF landscape, where all projects and products wanted to be mentioned. Coming up with acceptance criteria and curating such documentation could easily become a full-time job. Offhand, I'm not sure what other places to suggest, though.

More general documentation would be fine and appreciated.

marpaia commented 5 years ago

SGTM @bgrant0607, that all sounds reasonable.

fejta-bot commented 5 years ago

Issues go stale after 90d of inactivity. Mark the issue as fresh with /remove-lifecycle stale. Stale issues rot after an additional 30d of inactivity and eventually close.

If this issue is safe to close now please do so with /close.

Send feedback to sig-testing, kubernetes/test-infra and/or fejta. /lifecycle stale

nikhita commented 5 years ago

/remove-lifecycle stale

bhack commented 5 years ago

What is the status?

vishh commented 5 years ago

+1 on discontinuing the group as there isn't critical momentum yet to improve k8s itself for the purpose of ML/data science. There are other communities like Spark & Kubeflow that are attempting to build around k8s which have sufficient momentum.

ConnorDoyle commented 5 years ago

+1 to disband. The group hasn’t met regularly for lack of interest / topics.

spiffxp commented 5 years ago

/retitle retire wg-machine-learning

spiffxp commented 5 years ago

/assign @ConnorDoyle @vishh Thanks for helping us reduce our wg sprawl!

https://github.com/kubernetes/community/blob/master/sig-wg-lifecycle.md#retirement says your first step is

Send an email to kubernetes-dev@googlegroups.com and community@kubernetes.io alerting the community of your intentions to disband or merge.

and folks can help you with the rest of the steps from there

k82cn commented 5 years ago

Sorry to have more comments at the last minutes :)

If we retire this WG only because of topics, I'd like to collect the requirements and be committed to pulling content together bi-weekly or monthly.

Some items in my pipeline:

  1. work with kubeflow/common for SchedulingPolicy, a scheduler CRD for ML workload (kf/common#46)
  2. GPU topology from kubeflow-cn forum
  3. CSI for local cache to speed up training
  4. GPU share + fair-sharing scheduling for inference workload
  5. ...

/cc @ConnorDoyle

nikhita commented 4 years ago

FYI it was mentioned in the Community Meeting on October 3 that WG Machine Learning will be sunset soon.

fejta-bot commented 4 years ago

Issues go stale after 90d of inactivity. Mark the issue as fresh with /remove-lifecycle stale. Stale issues rot after an additional 30d of inactivity and eventually close.

If this issue is safe to close now please do so with /close.

Send feedback to sig-testing, kubernetes/test-infra and/or fejta. /lifecycle stale

bhack commented 4 years ago

Check also https://github.com/kubeflow/community/issues/89

nikhita commented 4 years ago

xref https://github.com/kubernetes/community/pull/4287

/remove-lifecycle stale

bhack commented 4 years ago

/cc @ibrahimhaddad

spiffxp commented 4 years ago

Per @nikhita's comment, it looks like the group isn't retiring but instead rotating leadership

/remove-committee steering I'm taking this off of our radar as the WG is taking care of this

mrbobbytables commented 4 years ago

They have changed leadership 👍 @k82cn has been effectively leading it and there is now sign off from previous chairs. in https://github.com/kubernetes/community/pull/4287

With that I'm going to go ahead and close :) If there is an issue, please feel free to reopen.

/close

k8s-ci-robot commented 4 years ago

@mrbobbytables: Closing this issue.

In response to [this](https://github.com/kubernetes/community/issues/3396#issuecomment-576924841): >They have changed leadership 👍 >@k82cn has been effectively leading it and there is now sign off from previous chairs. in https://github.com/kubernetes/community/pull/4287 > >With that I'm going to go ahead and close :) If there is an issue, please feel free to reopen. > >/close Instructions for interacting with me using PR comments are available [here](https://git.k8s.io/community/contributors/guide/pull-requests.md). If you have questions or suggestions related to my behavior, please file an issue against the [kubernetes/test-infra](https://github.com/kubernetes/test-infra/issues/new?title=Prow%20issue:) repository.