Funcion get_executor_partition_info() arreglada

[JuanCaarPapers]

Añadida linea en Dockerfile de spark para exportar la variable de entorno y así poder obtenerla en jupyter This pull request includes updates to the Spark session Jupyter notebook to improve logging and execution metadata tracking, as well as a minor change to the Spark Dockerfile to set the SPARK_EXECUTOR_ID.

Jupyter Notebook Updates:

• Updated Spark UI link to reflect the new hostname. (jupyter/notebooks/spark/basics/01_spark_session.ipynb, jupyter/notebooks/spark/basics/01_spark_session.ipynbL51-R66)
• Added logging for environment variables to verify the presence of SPARK_EXECUTOR_ID. (jupyter/notebooks/spark/basics/01_spark_session.ipynb, jupyter/notebooks/spark/basics/01_spark_session.ipynbL264-R337)

Dockerfile Update:

• Set SPARK_EXECUTOR_ID to the hostname in the Spark environment configuration. (spark/Dockerfile, spark/DockerfileR49-R51)

[heirinsinho]

No sirve. Esto identifica el worker, que ya lo hicimos en clase, pero no al ejecutor