September 24, 2024

[github-actions[bot]]

Feature

You can now use Cloud KMS Autokey to automate the creation and use of customer-managed encryption keys (CMEKs), including the Cloud HSM service. This feature is generally available (GA).

Feature

BigQuery ML now offers the following expanded embedding support features:

• Using the ML.GENERATE_EMBEDDING function with a remote model based on a Vertex AI multimodalembedding large language model (LLM) to create multimodal embeddings, which embed text, image, and video into the same semantic space.
• Using the ML.GENERATE_EMBEDDING function with a principal component analysis (PCA) model or autoencoder model to create embeddings for structured independent and identically distributed random variables (IID) data.
• Using the ML.GENERATE_EMBEDDING function with a matrix factorization model to create embeddings for user or item data.

Try these capabilities with the following tutorials:

• Generate image embeddings by using the ML.GENERATE_EMBEDDING function
• Generate video embeddings by using the ML.GENERATE_EMBEDDING function
• Generate text embeddings by using the ML.GENERATE_EMBEDDING function
• Generate and search multimodal embeddings

These features are generally available (GA).

Feature

BigQuery ML now offers the following AI features:

• You can process documents from BigQuery object tables by doing the following:

  1. Creating a remote model based on the Document AI API, including specifying a document processor to use.
  2. Using the ML.PROCESS_DOCUMENT function with a Document AI-based remote model to process the documents.

Try this feature with the Process documents with the ML.PROCESS_DOCUMENT function how-to.

• You can transcribe audio files from BigQuery object tables by doing the following:

  1. Creating a remote model based on the Speech-to-Text API, including specifying a speech recognizer to use.
  2. Using the ML.TRANSCRIBE function with a Speech-to-Text-based remote model to transcribe the audio files.

Try this feature with the Transcribe audio files with the ML.TRANSCRIBE function how-to.

These BigQuery ML feature are generally available (GA).

https://cloud.google.com/bigquery/docs/release-notes#September_24_2024