In PR-1338, we added support for processing Photon event logs. It uses a JSON file to map Photon Nodes to their equivalent Spark Nodes. However, this mapping is currently based on Databricks version 13.3. In future, we should implement version-specific mapping files and dynamically select the appropriate file at runtime based on the Databricks version in use.
In PR-1338, we added support for processing Photon event logs. It uses a JSON file to map Photon Nodes to their equivalent Spark Nodes. However, this mapping is currently based on Databricks version 13.3. In future, we should implement version-specific mapping files and dynamically select the appropriate file at runtime based on the Databricks version in use.