Closed ephraimbuddy closed 8 months ago
sorry, where can i pull airflow 2.8.1rc1 docker image? not found in dockerhub
https://hub.docker.com/r/apache/airflow/tags?page=1&name=2.8.1rc1
sorry, where can i pull airflow 2.8.1rc1 docker image? not found in dockerhub
https://hub.docker.com/r/apache/airflow/tags?page=1&name=2.8.1rc1
Sorry, I created this before the images were done pushing. Can you try again
Just checked my changes:
Both of these work as expected 🚢
Validate all non slim X86_64 images, the command python -c 'import MySQLdb; print("OK")'
do not throw any error
In addition validate custom docker build from the tag without specifying INSTALL_MYSQL_CLIENT_TYPE
build arg, everything works fine
❯ git checkout 2.8.1rc1
Note: switching to '2.8.1rc1'.
❯ docker build . \
--build-arg DOCKER_CONTEXT_FILES=./docker-context-files \
--build-arg INSTALL_MYSQL_CLIENT="true" \
--build-arg INSTALL_MSSQL_CLIENT="true" \
--build-arg INSTALL_POSTGRES_CLIENT="true" \
--tag "airflow-image:latest"
[+] Building 171.4s (68/68) FINISHED docker:default
❯ docker run -it --rm airflow-image:latest bash
airflow@ab694be6c26d:/opt/airflow$ apt list *maria*
Listing... Done
libmariadb3-compat/now 1:10.11.6+maria~deb12 amd64 [installed,local]
libmariadb3/now 1:10.11.6+maria~deb12 amd64 [installed,local]
mariadb-client-core/now 1:10.11.6+maria~deb12 amd64 [installed,local]
mariadb-client/now 1:10.11.6+maria~deb12 amd64 [installed,local]
mariadb-common/now 1:10.11.6+maria~deb12 all [installed,local]
airflow@ab694be6c26d:/opt/airflow$ python -c 'import MySQLdb; print("OK")'
OK
multiple_outputs
Tested, work as expected. No errors in case of Union typing annotation in Python 3.10+
Looks consistent to the latest docker and k8s providers
I checked my change:
It worked as expected. If a request larger than the "allowed_payload_size" specified in airflow.cfg is sent to the webserver, it returns the error page: "Request Entity Too Large".
Fix airflow-scheduler exiting with code 0 on exceptions (#36800): Confirmed that the scheduler is exiting with code 1 on exception:
Fix Callback exception when a removed task is the last one in the task instance list (#36693): Confirmed the callback ran without any issue when a removed task is the last one in the task list:
[2024-01-16, 13:55:20 UTC] {logging_mixin.py:188} INFO - Success callback triggered!
[2024-01-16, 13:55:20 UTC] {logging_mixin.py:188} INFO - Task Instance: [<TaskInstance: example_removed_task_dag.success_task scheduled__2024-01-15T00:00:00+00:00 [running]>, <TaskInstance: example_removed_task_dag.removed_task_2 scheduled__2024-01-15T00:00:00+00:00 [removed]>, <TaskInstance: example_removed_task_dag.removed_task scheduled__2024-01-15T00:00:00+00:00 [removed]>, <TaskInstance: example_removed_task_dag.failure_task scheduled__2024-01-15T00:00:00+00:00 [removed]>, <TaskInstance: example_removed_task_dag.start_task scheduled__2024-01-15T00:00:00+00:00 [removed]>, <TaskInstance: example_removed_task_dag.end_task scheduled__2024-01-15T00:00:00+00:00 [removed]>]
All good with #36522
All my changes are in and good !
Particularly happy with that one:
airflow@e6cddae1d57a:/opt/airflow$ AIRFLOW_HOME=./test airflow db init
Traceback (most recent call last):
File "/home/airflow/.local/bin/airflow", line 5, in <module>
from airflow.__main__ import main
File "/home/airflow/.local/lib/python3.8/site-packages/airflow/__init__.py", line 68, in <module>
settings.initialize()
File "/home/airflow/.local/lib/python3.8/site-packages/airflow/settings.py", line 538, in initialize
configure_vars()
File "/home/airflow/.local/lib/python3.8/site-packages/airflow/settings.py", line 198, in configure_vars
raise AirflowConfigException(
airflow.exceptions.AirflowConfigException: Cannot use relative path: `sqlite:///./test/airflow.db` to connect to sqlite. Please use absolute path such as `sqlite:////tmp/airflow.db`.
I've confirmed fix datetime reference in DAG.is_fixed_time_schedule (#36370) is good.
Check different component under pendulum 3
(default in constraints) and pendulum 2.1.2, can't find any noticeable side effects
Validated #36509 and #36518 - all looks good!
I tried to test https://github.com/apache/airflow/pull/36379, but it did not fix the issue as expected. I still need https://github.com/apache/airflow/pull/36363 to get it to work properly. It did not break anything, either, so it won't be a blocker. @hussein-awala, do you have the chance to test it on your side as well?
Airflow 2.8.1 has been released. Thank you all for testing this release candidate
All my changes are in and good !
Particularly happy with that one:
airflow@e6cddae1d57a:/opt/airflow$ AIRFLOW_HOME=./test airflow db init Traceback (most recent call last): File "/home/airflow/.local/bin/airflow", line 5, in <module> from airflow.__main__ import main File "/home/airflow/.local/lib/python3.8/site-packages/airflow/__init__.py", line 68, in <module> settings.initialize() File "/home/airflow/.local/lib/python3.8/site-packages/airflow/settings.py", line 538, in initialize configure_vars() File "/home/airflow/.local/lib/python3.8/site-packages/airflow/settings.py", line 198, in configure_vars raise AirflowConfigException( Please use absolute path such as sqlite:////tmp/airflow.db
hello! have you goes still facing something like that? i'm using windows 10.
[]'s
hello! have you goes still facing something like that? i'm using windows 10.
Yes. Because You need to use WSL2 if you want to run Airflow on Eindows. Read prerequisites.
Body
We are kindly requesting that contributors to Apache Airflow RC 2.8.1rc1 help test the RC.
Please let us know by commenting if the issue is addressed in the latest RC.
get_accessible_dag_ids
and useget_readable_dags
in get_dag_warnings (#36256): @hussein-awalapip
23.3.2 (#36271): @potiukbatch_is_authorized_dag
to check if user has permission to read DAGs (#36279): @hussein-awala @vincbeck Linked issues:MAX_CONTENT_LENGTH
(#36401): @yo1956kubernetes
decorator type annotation consistent with operator (#36405): @Taragolisdocker
decorator type annotations (#36406): @TaragolisDagRun
fails while runningdag test
(#36517): @kaxilgraphviz
dependency optional (#36647): @potiuk Linked issues:multiple_outputs
is inferred correctly even when usingTypedDict
(#36652): @noamcohen97concurrency
tomax active tasks
(#36691): @romsharon98pyarrow-hotfix
to mitigate CVE-2023-47248 (#35650)pyarrow-hotfix
to mitigate CVE-2023-47248 (#35650)mariadb
by default when build final prod image (#36716): @ant-bl @Taragolis Linked issues:typing.Union
in_infer_multiple_outputs
for Python 3.10+ (#36728): @TaragolisPytestDeprecationWarning
when create warnings_recorder (#36759): @TaragolisThanks to all who contributed to the release (probably not a complete list!): @joaopamaral @Lee-W @hussein-awala @amoghrajesh @fuatcakici @zachliu @llamageddon83 @dirrao @avkirilishin @uranusjr @dolfinus @yo1956 @ephraimbuddy @internetcoffeephone @BobDu @romsharon98 @Kache @kaxil @timonviola @potiuk @pateash @babinos87 @shohamy7 @tullis @HurSungYun @raphaelauv @ant-bl @csp33 @Taragolis @evgenyslab @joshowen @dstandish @noamcohen97 @ardubev16 @eliskovets @crabio @jscheffl @alephmelo @kacpermuda @vchiapaikeo @vincbeck
Committer