Typo in example

[dbalexp]

Typo in the example code for Step 4: Configure Auto Loader to ingest data to Unity Catalog

# Import functions
from pyspark.sql.functions import input_file_name, current_timestamp

# Configure Auto Loader to ingest JSON data to a Delta table
(spark.readStream
  .format("cloudFiles")
  .option("cloudFiles.format", "json")
  .option("cloudFiles.schemaLocation", checkpoint_path)
  .load(file_path)
  .select("*", input_file_name().alias("source_file"), current_timestamp().alias("processing_time"))
  .writeStream
  .option("checkpointLocation", checkpoint_path)
  .trigger(availableNow=True)
  .option("mergeSchema", "true")
  .toTable(table))

It should be this instead:

# Import functions
from pyspark.sql.functions import input_file_name, current_timestamp

# Configure Auto Loader to ingest JSON data to a Delta table
(spark.readStream
  .format("cloudFiles")
  .option("cloudFiles.format", "json")
  .option("cloudFiles.schemaLocation", checkpoint_path)
  .load(source)
  .select("*", input_file_name().alias("source_file"), current_timestamp().alias("processing_time"))
  .writeStream
  .option("checkpointLocation", checkpoint_path)
  .trigger(availableNow=True)
  .option("mergeSchema", "true")
  .toTable(table))

---

Document Details

⚠ Do not edit this section. It is required for learn.microsoft.com ➟ GitHub issue linking.

• ID: a9348436-7353-1cad-df4f-b86662792605
• Version Independent ID: a9348436-7353-1cad-df4f-b86662792605
• Content: Tutorial: Run an end-to-end lakehouse analytics pipeline - Azure Databricks
• Content Source: databricks/getting-started/lakehouse-e2e.md
• Service: azure-databricks
• GitHub Login: @mssaperla
• Microsoft Alias: saperla

[Naveenommi-MSFT]

@alexphu Thanks for your feedback! We will investigate and update as appropriate.

[RamanathanChinnappan-MSFT]

@alexphu

Thanks for reporting this! We have created a PR for this issue and the changes should go live soon.