search

Azure / AKS

Azure Kubernetes Service
https://azure.github.io/AKS/
1.95k stars 305 forks source link

Support for Kubernetes 1.9 #103

Closed pjbgf closed 6 years ago

pjbgf commented 6 years ago

Is there any ETA for when support for Kubernetes 1.9 will be added?

AceHack commented 6 years ago

The sooner the better :) Would love to see windows VMs come along with that too!!

Sleepy-GH commented 6 years ago

Very much looking forward to this. Especially the storage improvements for me personally.

AceHack commented 6 years ago

Any update? Thanks.

mboersma commented 6 years ago

AKS supports Kubernetes v1.9.0 and v1.9.1 with Linux nodes now, with v1.9.2 coming any day.

AceHack commented 6 years ago

Is there no upgrade path? I get the following

Name ResourceGroup MasterVersion MasterUpgrades NodePoolVersion NodePoolUpgrades

default rgp-use-arch-aks 1.8.6 None available 1.8.6 None available

derekperkins commented 6 years ago

Same here. My cluster is in centralus

AceHack commented 6 years ago

@derekperkins I just executed

az aks upgrade --name aks-use-arch-dev --resource-group rgp-use-arch-aks --kubernetes-version 1.9.1 --yes

and it worked and upgraded even though

az aks get-versions --name aks-use-arch-dev --resource-group rgp-use-arch-aks --output table

said there were no upgrades

vyadh commented 6 years ago

Is it possible to subscribe to an RSS feed or something that announces when new Kubernetes versions are supported in AKS?

AceHack commented 6 years ago

@derekperkins FYI, I'm getting the following error with any az aks command now after upgrading.

No Kubernetes access profiles found. Cluster provisioning state is "Succeeded".

AceHack commented 6 years ago

@mboersma I don't see 1.9.x in the Azure Portal UI, not sure why this was closed before it was there. I'll try from the command line, but I agree with @vyadh how do I know what's available?

AceHack commented 6 years ago

I tried running

az aks create --name aks-use-arch-dev --resource-group rgp-use-arch-aks --location eastus --kubernetes-version 1.9.1 --node-vm-size Standard_DS12_v2_Promo --node-osdisk-size 300 --node-count 5 --service-principal {GUID} --client-secret {GUID} --admin-username {user} --ssh-key-value "ssh-key"

It failed with

ERROR: Operation failed with status: 'Bad Request'. Details: The value of parameter orchestratorProfile.OrchestratorVersion is invalid.

I'm really not sure why this is closed, it seems in no way is 1.9 supported currently. Thanks.

derekperkins commented 6 years ago

@AceHack I forced the upgrade the same time as you, and though it didn't report a success originally, when I check my versions now with az aks get-versions, it shows me on 1.9.1.

Name     ResourceGroup    MasterVersion    MasterUpgrades    NodePoolVersion    NodePoolUpgrades
-------  ---------------  ---------------  ----------------  -----------------  ------------------
default  nozzle           1.9.1            None available    1.9.1              None available
pjbgf commented 6 years ago

@AceHack it worked for me by creating a cluster with the default 1.7.7. Once it was up and running, I executed the upgrade command to move it to 1.9.1:

az aks upgrade -n CLUSTER-NAME -g RESOURCE-GROUP -k 1.9.1 -y

AceHack commented 6 years ago

Yes, I did the same starting with 1.8.6 and it failed twice during the upgrade but then finally worked. I did notice the dashboard is still 1.8.x though. This seems a bit odd.

derekperkins commented 6 years ago

@AceHack The dashboard is on a separate release schedule from the main project. The current dashboard version is 1.8.2, and AKS is on 1.8.1. https://github.com/kubernetes/dashboard/releases

Sleepy-GH commented 6 years ago

Is this only working in specific locations? I just tried creating a new cluster with az aks create snip --kubernetes-version 1.9.0 --location westeurope and I get the following error: "Operation failed with status: 'Bad Request'. Details: The value of parameter orchestratorProfile.OrchestratorVersion is invalid."

seneccamiller commented 6 years ago

FYI,

I also had success updating to v1.9.1 using the command below as well in the East-US region

az aks upgrade --name myK8sCluster --resource-group myResourceGroup --kubernetes-version 1.9.1 --yes

joukojoutomies commented 6 years ago

I tried upgrade from version 1.8.1 to 1.9.1 and it failed. In portal It shows version 1.9.1 and "deployment status failed" (under resource group). Cluster still works and I can add nodes, services, deployments etc...

-Jouni

on win10 CLI (and on web portal bash cli as well) I have: C:>az aks show -g DemoGroup -n DemoCluster { "agentPoolProfiles": [ { "count": 2, "name": "nodepool1", "osType": "Linux", "storageProfile": "ManagedDisks", "vmSize": "Standard_D1_v2" } ], "dnsPrefix": "XXX", "fqdn": "XXX.hcp.eastus.azmk8s.io", "id": "/subscriptions/X/X/providers/Microsoft.ContainerService/managedClusters/AKSDemoCluster", "kubernetesVersion": "1.9.1", "linuxProfile": { "adminUsername": "XXX", "ssh": { "publicKeys": [ { "keyData": "ssh-rsa " } ] } }, "location": "eastus", "name": "DemoCluster", "provisioningState": "Failed", "resourceGroup": "DemoGroup", "servicePrincipalProfile": { "clientId": "XXX" }, "type": "Microsoft.ContainerService/ManagedClusters" }

chribsen commented 6 years ago

I was able to upgrade my AKS cluster in westeurope using:

az aks upgrade -n $CLUSTER_NAME -g $RESOURCE_GROUP -k 1.9.1 -y
liambarnett commented 6 years ago

I have executed the various above upgrade commands to no avail. Every time I receive this message -

Operation failed with status: 'Bad Request'. Details: The selected orchestrator version is not supported

I have checked the version with: az aks get-versions --name $ClusterName --resource-group $ResourceGroup --output table

but the version remains the same.

I have tested with 'East US' and 'West Europe' regions, created a 1.7 and 1.8 cluster and created a cluster via the GUI/console - none of these work!

Is there something I'm missing or have they put a stop to this in the last 48 hours?

liambarnett commented 6 years ago

@chribsen - which region did you use?

@AceHack, @derekperkins - Have you had any luck with this since?

As above, I cannot force the upgrade no matter how I set the initial cluster up.

derekperkins commented 6 years ago

@liambarnett I've been running 1.9.1 in centralus for almost 2 weeks without any problems.

liambarnett commented 6 years ago

@derekperkins thanks, just tested on centralus but receiving the same message. I'm assuming they've disabled the forced upgrade.

przemolb commented 6 years ago

Is there any way I can list available k8s versions ? I used az aks get-versions (in westeurope) but it tells me that the newest one is 1.8.7.

liambarnett commented 6 years ago

@przemolb I'm not sure this is possible, it will only list available versions to avoid confusion.

przemolb commented 6 years ago

@liambarnett hmm, in that case is there any web page with schedule where and when each k8s version will be available ?

liambarnett commented 6 years ago

@przemolb This might be what you're after - https://github.com/kubernetes/kubernetes/milestones

przemolb commented 6 years ago

@liambarnett I am sorry but I've just realized I asked the wrong question - I meant to ask where (region) and when each k8s version will be available on Azure ?

mimckitt commented 6 years ago

@mboersma Do you know if people are still able to force update to 1.9? @liambarnett looks like he is not able to even though he is running the same command as others.

dmitsh commented 6 years ago

We are planning start rolling out AKS with 1.9 support next week.

przemolb commented 6 years ago

In every region ?

liambarnett commented 6 years ago

@dmitsh Thanks - which regions will receive the update first?

indrayam commented 6 years ago

Any update on @liambarnett's question?

dmitsh commented 6 years ago

We are in the process of gradually rolling out and testing. There were a few issues that we have identified and addressing. I will update this thread as soon as we have the service rolled out (current estimate is early next week)

indrayam commented 6 years ago

Thanks @dmitsh

a3aanwisse commented 6 years ago

@dmitsh Since early next week has passed... any update?

giggio commented 6 years ago

I was able to upgrade to 1.8.7, but after that it would not allow me to upgrade to 1.9.1 or 1.9.2:

Operation failed with status: 'Bad Request'. Details: The selected orchestrator version is not supported

giggio commented 6 years ago

I just tried upgrading from 1.7.9 to 1.9.0, 1.9.1, 1.9.2, and none of them works. I always get

Operation failed with status: 'Bad Request'. Details: The selected orchestrator version is not supported

dmitsh commented 6 years ago

AKS supports incremental minor version upgrade. You should try upgrading 1.7.9 to 1.8. to 1.9.

Thanks, -Dmitry

From: Giovanni Bassi notifications@github.com Sent: Thursday, February 22, 2018 5:14 PM To: Azure/AKS AKS@noreply.github.com Cc: Dmitry Shmulevich dmitsh@microsoft.com; Mention mention@noreply.github.com Subject: Re: [Azure/AKS] Support for Kubernetes 1.9 (#103)

I just tried upgrading from 1.7.9 to 1.9.0, 1.9.1, 1.9.2, and none of them works. I always get

Operation failed with status: 'Bad Request'. Details: The selected orchestrator version is not supported

— You are receiving this because you were mentioned. Reply to this email directly, view it on GitHubhttps://na01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2FAzure%2FAKS%2Fissues%2F103%23issuecomment-367877886&data=04%7C01%7Cdmitsh%40microsoft.com%7C962e08e1b0384747d62208d57a5ac964%7C72f988bf86f141af91ab2d7cd011db47%7C1%7C0%7C636549452699642421%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwifQ%3D%3D%7C-1&sdata=eop49D6r5d%2F7KePujrMFJb8%2Bt2G7n7OWvIFd0PzeWYc%3D&reserved=0, or mute the threadhttps://na01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2Fnotifications%2Funsubscribe-auth%2FAQajETaE14M7AiH04M4GPfigFzJ4iQy7ks5tXhDzgaJpZM4RNiux&data=04%7C01%7Cdmitsh%40microsoft.com%7C962e08e1b0384747d62208d57a5ac964%7C72f988bf86f141af91ab2d7cd011db47%7C1%7C0%7C636549452699642421%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwifQ%3D%3D%7C-1&sdata=vcqV0bS0L4cBgQd9BSnAW2AveAKz4m7c9LY2LirMzqQ%3D&reserved=0.

giggio commented 6 years ago

It does not support incremental upgrades as well. I have just tried. I upgraded to 1.8.7 and then tried to upgrade to 1.9.0 and 1.9.1 and both fail with the same error as before.

dmitsh commented 6 years ago

Could you please send error messages?

From: Giovanni Bassi notifications@github.com Sent: Thursday, February 22, 2018 5:36 PM To: Azure/AKS AKS@noreply.github.com Cc: Dmitry Shmulevich dmitsh@microsoft.com; Mention mention@noreply.github.com Subject: Re: [Azure/AKS] Support for Kubernetes 1.9 (#103)

It does not support incremental upgrades as well. I have just tried. I upgraded to 1.8.7 and then tried to upgrade to 1.9.0 and 1.9.1 and both fail with the same error as before.

— You are receiving this because you were mentioned. Reply to this email directly, view it on GitHubhttps://na01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2FAzure%2FAKS%2Fissues%2F103%23issuecomment-367881712&data=04%7C01%7Cdmitsh%40microsoft.com%7Ccf702dbabb3f4f5879d208d57a5dbf74%7C72f988bf86f141af91ab2d7cd011db47%7C1%7C0%7C636549465417016095%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwifQ%3D%3D%7C-1&sdata=EIILRk%2BvhnfHyMNyBUL0xahAjrroSuDahK0PoVks71g%3D&reserved=0, or mute the threadhttps://na01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2Fnotifications%2Funsubscribe-auth%2FAQajETbFxwu0IhvD8gok601II1N4gJedks5tXhXrgaJpZM4RNiux&data=04%7C01%7Cdmitsh%40microsoft.com%7Ccf702dbabb3f4f5879d208d57a5dbf74%7C72f988bf86f141af91ab2d7cd011db47%7C1%7C0%7C636549465417016095%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwifQ%3D%3D%7C-1&sdata=fVbFblowKFvwhFKSQqBirLO6ZwxEs055AxrySqmyaD8%3D&reserved=0.

giggio commented 6 years ago

Here is the output:

~$ az aks upgrade -g $nomeDoGrupoDeRecursos -n $nomeCluster --kubernetes-version 1.9.0 --yes
Operation failed with status: 'Bad Request'. Details: The selected orchestrator version is not supported
dmitsh commented 6 years ago

To the best of my knowledge, AKS supports 1.9.1 and 1.9.2

You can check by running “az aks get-upgrades” or “az aks get-versions”

From: Giovanni Bassi notifications@github.com Sent: Thursday, February 22, 2018 5:45 PM To: Azure/AKS AKS@noreply.github.com Cc: Dmitry Shmulevich dmitsh@microsoft.com; Mention mention@noreply.github.com Subject: Re: [Azure/AKS] Support for Kubernetes 1.9 (#103)

Here is the output:

~$ az aks upgrade -g $nomeDoGrupoDeRecursos -n $nomeCluster --kubernetes-version 1.9.0 --yes

Operation failed with status: 'Bad Request'. Details: The selected orchestrator version is not supported

— You are receiving this because you were mentioned. Reply to this email directly, view it on GitHubhttps://na01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2FAzure%2FAKS%2Fissues%2F103%23issuecomment-367883397&data=04%7C01%7Cdmitsh%40microsoft.com%7C5041fd9aecef45b8de0208d57a5f037e%7C72f988bf86f141af91ab2d7cd011db47%7C1%7C0%7C636549470921719872%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwifQ%3D%3D%7C-1&sdata=sRKefa1Cv7VaSuxG43Wla8mFUU6O4Fz6v11GYepaH9s%3D&reserved=0, or mute the threadhttps://na01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2Fnotifications%2Funsubscribe-auth%2FAQajEYOpBSfYxbsq-q6krVPanYf6uH6eks5tXhgLgaJpZM4RNiux&data=04%7C01%7Cdmitsh%40microsoft.com%7C5041fd9aecef45b8de0208d57a5f037e%7C72f988bf86f141af91ab2d7cd011db47%7C1%7C0%7C636549470921719872%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwifQ%3D%3D%7C-1&sdata=T8dEW3SrnBEDLlY5TDQKOVcP2TF7nWOJ9hClS6FcOy8%3D&reserved=0.

tanaka-takayoshi commented 6 years ago

1.9 is still not available now?

$ az aks get-versions -l centralus  -o table
This command is deprecating and will be removed in future releases. Use 'az aks get-upgrades' instead.
KubernetesVersion    Upgrades
-------------------  -----------------------------------------
1.8.7                None available
1.8.6                1.8.7
1.8.2                1.8.6, 1.8.7
1.8.1                1.8.2, 1.8.6, 1.8.7
1.7.12               1.8.1, 1.8.2, 1.8.6, 1.8.7
1.7.9                1.7.12, 1.8.1, 1.8.2, 1.8.6, 1.8.7
1.7.7                1.7.9, 1.7.12, 1.8.1, 1.8.2, 1.8.6, 1.8.7

$ az aks get-upgrades -g aks-test -n aks-cluster2 -o table
Name     ResourceGroup    MasterVersion    NodePoolVersion    Upgrades
-------  ---------------  ---------------  -----------------  -----------------------------------------
default  aks-test         1.7.7            1.7.7              1.7.9, 1.7.12, 1.8.1, 1.8.2, 1.8.6, 1.8.7
giggio commented 6 years ago

I just tested it all. Creating a new cluster or updating. 1.9.x is not available.

joaocc commented 6 years ago

Same thing in westeurope. No upgrade path from 1.8.7 upwards.

mboersma commented 6 years ago

Kubernetes 1.9.x isn't yet available on AKS. As @dmitsh mentioned, we are still testing the necessary changes and will update here when it's rolled out.

hibri commented 6 years ago

Would these annotations make it into 1.9? https://github.com/kubernetes/kubernetes/blob/master/pkg/cloudprovider/providers/azure/azure_loadbalancer.go#L41

giggio commented 6 years ago

I just saw that 1.9.* are showing as available. I tried creating a 1.9.2 cluster but the deploy failed.

❯ az aks get-versions --location eastus -o table
KubernetesVersion    Upgrades
-------------------  -----------------------------------------
1.9.2                None available
1.9.1                1.9.2
1.8.7                1.9.1, 1.9.2
1.8.6                1.8.7, 1.9.1, 1.9.2
1.8.2                1.8.6, 1.8.7, 1.9.1, 1.9.2
1.8.1                1.8.2, 1.8.6, 1.8.7, 1.9.1, 1.9.2
1.7.12               1.8.1, 1.8.2, 1.8.6, 1.8.7
1.7.9                1.7.12, 1.8.1, 1.8.2, 1.8.6, 1.8.7
1.7.7                1.7.9, 1.7.12, 1.8.1, 1.8.2, 1.8.6, 1.8.7
dmitsh commented 6 years ago

Yes, we just rolled out new update. Could you provide error message?