microsoft / containerregistry

Microsoft Artifact Registry description and related FAQ
399 stars 90 forks source link

Can't list tags for various repos on MCR #57

Closed rcowsill closed 2 years ago

rcowsill commented 3 years ago

The repos listed below are included in https://mcr.microsoft.com/v2/_catalog, but the corresponding tags page is missing (error: BlobNotFound).

The tags page for (eg) mssql/tools is referenced from: https://hub.docker.com/_/microsoft-mssql-tools so I expect it should exist.

Repo Tags List URL
aks/hcp/nginx https://mcr.microsoft.com/v2/aks/hcp/nginx/tags/list
cosmosdb/winsrv2019lite/azure-cosmos-emulator https://mcr.microsoft.com/v2/cosmosdb/winsrv2019lite/azure-cosmos-emulator/tags/list
azuredefender/stable/pod-collector https://mcr.microsoft.com/v2/azuredefender/stable/pod-collector/tags/list
azuredefender/stage/pod-collector https://mcr.microsoft.com/v2/azuredefender/stage/pod-collector/tags/list
azuredevspaces/azds-build-service https://mcr.microsoft.com/v2/azuredevspaces/azds-build-service/tags/list
azuredevspaces/azds-image-prepull https://mcr.microsoft.com/v2/azuredevspaces/azds-image-prepull/tags/list
azuredevspaces/azds-proxy https://mcr.microsoft.com/v2/azuredevspaces/azds-proxy/tags/list
azuredevspaces/azds-proxy-init https://mcr.microsoft.com/v2/azuredevspaces/azds-proxy-init/tags/list
azuredevspaces/azds-webhook-service https://mcr.microsoft.com/v2/azuredevspaces/azds-webhook-service/tags/list
azuredevspaces/devhostagent https://mcr.microsoft.com/v2/azuredevspaces/devhostagent/tags/list
azuredevspaces/azds-vsdbg https://mcr.microsoft.com/v2/azuredevspaces/azds-vsdbg/tags/list
azuredevspaces/javadebug https://mcr.microsoft.com/v2/azuredevspaces/javadebug/tags/list
azure-functions/meshtest https://mcr.microsoft.com/v2/azure-functions/meshtest/tags/list
azureml/o16n-base/python https://mcr.microsoft.com/v2/azureml/o16n-base/python/tags/list
azureml/r-base https://mcr.microsoft.com/v2/azureml/r-base/tags/list
azureml/cmk8s/aml-addon-gateway https://mcr.microsoft.com/v2/azureml/cmk8s/aml-addon-gateway/tags/list
azureml/cmk8s/job-cleaner https://mcr.microsoft.com/v2/azureml/cmk8s/job-cleaner/tags/list
azureml-studio/base-gpu https://mcr.microsoft.com/v2/azureml-studio/base-gpu/tags/list
azuremonitor/containerinsights/citest https://mcr.microsoft.com/v2/azuremonitor/containerinsights/citest/tags/list
azuremonitor/containerinsights/prod4/preview/azuremonitor-containers https://mcr.microsoft.com/v2/azuremonitor/containerinsights/prod4/preview/azuremonitor-containers/tags/list
azuremonitor/containerinsights/prod5/preview/azuremonitor-containers https://mcr.microsoft.com/v2/azuremonitor/containerinsights/prod5/preview/azuremonitor-containers/tags/list
azuremonitor/containerinsights/prod6/preview/azuremonitor-containers https://mcr.microsoft.com/v2/azuremonitor/containerinsights/prod6/preview/azuremonitor-containers/tags/list
azuremonitor/containerinsights/prod6/stable/azuremonitor-containers https://mcr.microsoft.com/v2/azuremonitor/containerinsights/prod6/stable/azuremonitor-containers/tags/list
azure-stream-analytics/simulated-sensor https://mcr.microsoft.com/v2/azure-stream-analytics/simulated-sensor/tags/list
bioconductor/msgen_top30 https://mcr.microsoft.com/v2/bioconductor/msgen_top30/tags/list
azure-cognitive-services/form-recognizer/layout https://mcr.microsoft.com/v2/azure-cognitive-services/form-recognizer/layout/tags/list
azure-cognitive-services/vision/custom-image-analysis https://mcr.microsoft.com/v2/azure-cognitive-services/vision/custom-image-analysis/tags/list
csedevops/lucidity/eshoponweb https://mcr.microsoft.com/v2/csedevops/lucidity/eshoponweb/tags/list
iot/industrial-iot-users-service https://mcr.microsoft.com/v2/iot/industrial-iot-users-service/tags/list
iot/industrial-iot-auth-service https://mcr.microsoft.com/v2/iot/industrial-iot-auth-service/tags/list
k8s/genesys/manager https://mcr.microsoft.com/v2/k8s/genesys/manager/tags/list
k8se/containerapp-controller-api https://mcr.microsoft.com/v2/k8se/containerapp-controller-api/tags/list
mir/mir-base-image-win1809 https://mcr.microsoft.com/v2/mir/mir-base-image-win1809/tags/list
mir/mir-tokenrefresh-win1809 https://mcr.microsoft.com/v2/mir/mir-tokenrefresh-win1809/tags/list
robotics-ros/melodic-desktop_full https://mcr.microsoft.com/v2/robotics-ros/melodic-desktop_full/tags/list
mssql/tools https://mcr.microsoft.com/v2/mssql/tools/tags/list
mssql/rhel/ha https://mcr.microsoft.com/v2/mssql/rhel/ha/tags/list
arcdata/mssql-security-support https://mcr.microsoft.com/v2/arcdata/mssql-security-support/tags/list
terraform-on-azure/shell https://mcr.microsoft.com/v2/terraform-on-azure/shell/tags/list
vscode/devcontainers/powershell https://mcr.microsoft.com/v2/vscode/devcontainers/powershell/tags/list
vscode/devcontainers/dart https://mcr.microsoft.com/v2/vscode/devcontainers/dart/tags/list
vscode/devcontainers/swift https://mcr.microsoft.com/v2/vscode/devcontainers/swift/tags/list
bariscaglar commented 3 years ago

@rcowsill is there any tag that you can actually pull in any of those images? My guess is these images have no tags and somehow they are not removed from the catalog. Or it's quite possible that these images have manifests but only accessible by SHA (untagged).

rcowsill commented 3 years ago

is there any tag that you can actually pull in any of those images? My guess is these images have no tags and somehow they are not removed from the catalog. Or it's quite possible that these images have manifests but only accessible by SHA (untagged).

It's hard to prove otherwise without being able to list the tags :wink:

That said, I was able to pull mcr.microsoft.com/mssql-tools:latest, which is listed at https://hub.docker.com/_/microsoft-mssql-tools. That Docker Hub page links to https://mcr.microsoft.com/v2/mssql/tools/tags/list (BlobNotFound).

For most of the other repos I had no luck finding their corresponding Docker Hub page.

The few I did find gave "manifest unknown" errors when I tried to pull any of the tags listed: Repo Docker Hub URL Docker Hub tag list
https://hub.docker.com/_/microsoft-iot-industrial-iot-auth-service iot/industrial-iot-auth-service latest, preview
https://hub.docker.com/_/microsoft-iot-industrial-iot-users-service iot/industrial-iot-users-service latest, preview
https://hub.docker.com/_/microsoft-terraform-on-azure-shell terraform-on-azure/shell latest
rcowsill commented 3 years ago

Reported the missing IOT images here: Azure/Industrial-IoT#1226

The GitHub repo linked from https://hub.docker.com/_/microsoft-terraform-on-azure-shell (azure/terraform-cli) is 404, so I guess that needs cleaning up on Docker Hub.

alyssadecasa commented 3 years ago

@rcowsill The catalog list https://mcr.microsoft.com/v2/_catalog has been updated. Invalid repos such as the ones you reported have been removed.

Of the ones reported, four are currently valid repos with valid tags list pages:

We are currently looking into removing these invalid repos and their tag lists from DockerHub. Thank you for reporting this issue to us.

gldraphael commented 2 years ago

https://mcr.microsoft.com/v2/_catalog lists powershell and dotnet/sdk

But the following do not work:

They both have tags. Corresponding dockerhub links:

mthalman commented 2 years ago

https://mcr.microsoft.com/v2/_catalog lists powershell and dotnet/sdk

But the following do not work:

They both have tags. Corresponding dockerhub links:

@gldraphael - You need to remove the mcr portion from the URL. Example: https://mcr.microsoft.com/v2/dotnet/sdk/tags/list

gldraphael commented 2 years ago

Oh right! silly me. Thank you!

paule96 commented 2 years ago

@alyssadecasa I guess the cleaning goes here in the wrong direction at least for some images.

For example, the image mcr.microsoft.com/mssql-tools can be pulled as an image but is now not anymore in the catalog. And it would be really helpful to get the tags to the image.

Edit:

The SQL Team should be maybe also pinged to this issue: https://github.com/microsoft/mssql-docker/issues/650 The community tries to reach them 🤷‍♀️

alyssadecasa commented 2 years ago

There is a bug related to the mssql-tools image on the SQL team side. In our records, it is set to mssql/tools, but this image does not exist whereas mssql-tools does. I have reached out to the SQL team about this.

Thank you for bringing this to our attention.

vilmosnagy commented 1 year ago

@alyssadecasa any news on this? What docker image should I use to access an SQL Server? Thanks,

gldraphael commented 1 year ago

@vilmosnagy - mcr.microsoft.com/mssql/server:2022-latest

See: https://mcr.microsoft.com/en-us/product/mssql/server/about

vilmosnagy commented 1 year ago

@gldraphael thanks. I'd like to use sqlcmd, and it's not in mcr.microsoft.com/mssql/server:2022-latest, see:

❯ podman run -it --rm --entrypoint bash mcr.microsoft.com/mssql/server:2022-latest 
mssql@09ab3b3440e0:/$ sqlcmd
bash: sqlcmd: command not found
mssql@09ab3b3440e0:/$ 

but:

❯ podman run -it --rm --entrypoint bash mcr.microsoft.com/mssql-tools 
root@baacba0c5e31:/# sqlcmd
Microsoft (R) SQL Server Command Line Tool
Version 13.1.0007.0 Linux
Copyright (c) 2012 Microsoft. All rights reserved.

usage: sqlcmd            [-U login id]          [-P password]
  [-S server or Dsn if -D is provided] 
  [-H hostname]          [-E trusted connection]
  [-N Encrypt Connection][-C Trust Server Certificate]
  [-d use database name] [-l login timeout]     [-t query timeout]
  [-h headers]           [-s colseparator]      [-w screen width]
  [-a packetsize]        [-e echo input]        [-I Enable Quoted Identifiers]
  [-c cmdend]
  [-q "cmdline query"]   [-Q "cmdline query" and exit]
  [-m errorlevel]        [-V severitylevel]     [-W remove trailing spaces]
  [-u unicode output]    [-r[0|1] msgs to stderr]
  [-i inputfile]         [-o outputfile]
  [-k[1|2] remove[replace] control characters]
  [-y variable length type display width]
  [-Y fixed length type display width]
  [-p[1] print statistics[colon format]]
  [-R use client regional setting]
  [-K application intent]
  [-M multisubnet failover]
  [-b On error batch abort]
  [-D Dsn flag, indicate -S is Dsn] 
  [-X[1] disable commands, startup script, environment variables [and exit]]
  [-x disable variable substitution]
  [-? show syntax summary]
root@baacba0c5e31:/# exit
alyssadecasa commented 1 year ago

Hi @vilmosnagy, for more guided help on this please reach out for support through one of the SQL support channels detailed here.