Cannot disable reference inlay hints

[stefangstark]

I am using Lazyvim and am managing LSPs with Mason. I have the following config:

return {
  "neovim/nvim-lspconfig",
  opts = {
    servers = {
      texlab = {
        settings = {
          texlab = {
            inlayHints = {
              labelReferences = false,
            },
          },
        },
      },
    },
  },
}

But I still get in lay hints for references. FWIW I have confirmed that I can change other texlab settings in this way.

Any ideas what is going on? Happy to provide more details if needed.

[stefangstark]

Upon some more playing -- I am quite sure this is related to the lazy loading in lazyvim. The previews are present when the file is opened but removed once I interact with the \ref command. Feel free to delete!