Open alsdud154 opened 4 months ago
This does seem to be a bug.
@alsdud154 Was the deployer property in question visible in the task execution view? Does your application include the spring cloud task dependency?
@corneil Thanks for your reply
task information executed by schedule[Job Exection Id 151]
task information for failed jobs using the restart button[Job Execution Id 152]
Spring batch applications running with k8s include org.springframework.cloud:spring-cloud-starter-task.
SCDF creates a task manifest when launching a task that stores the deployment properties. However, when SCDf schedules a task the deployment information is passed onto the cronjob but dataflow does not store the deployment information. Thus when the scheduled task is fails, and needs to be restarted, SCDF does not have the deployment information, because it does not have the manifest. SCDF needs to be updated to store this manifest (deployment information) for the schedule.
A possible workaround is to use the global properties (if your tasks use the same deployment properties: https://docs.spring.io/spring-cloud-dataflow/docs/current/reference/htmlsingle/#configuration-kubernetes-app-props
@cppwfs Is it correct that SCDF version up is needed after developing additional features to store manifest (deployment info)? I'll use the global properties for now, but I hope we've added a feature that's saved in manifest in the future.
thank you.
You are running DataFlow with Helm Chart version 26.8.1 [App version: 2.11.2]. You are using a data flow to make a spring batch a task. Run the task uses the schedule. Set the deployer volume in the scheduler.main.properties when you create the schedule. The operation was executed by the schedule, but the operation failed. The failed operation was re-run by pressing the Restart button. At this point, the newly executed task is executed by omitting the deployer volume value set in the schedule.
I think it's a bug. This problem does not occur if you run a failed job with "LAUCH TASK" instead of a schedule and then run it again.
Please let me know how to solve it.
Schedule information![iShot_2024-04-15_14 38 05](https://github.com/spring-cloud/spring-cloud-dataflow/assets/61396939/21c63a4e-9fa6-4e63-9940-c58bf89a7a53)
job information executed by schedule![iShot_2024-04-15_14 36 05](https://github.com/spring-cloud/spring-cloud-dataflow/assets/61396939/1af01a45-d305-431c-a787-5348b77e7b1d)
Run failed jobs with the Restart button![iShot_2024-04-15_14 36 47](https://github.com/spring-cloud/spring-cloud-dataflow/assets/61396939/b3ba6331-540b-4ef0-9c8e-682ae0aaa82b)
k8s pod information for job executed by schedule![iShot_2024-04-15_14 33 16](https://github.com/spring-cloud/spring-cloud-dataflow/assets/61396939/79c1b149-2d86-46a9-8813-b2a651dd3026)
k8s pod information for failed jobs using the restart button![iShot_2024-04-15_14 31 39](https://github.com/spring-cloud/spring-cloud-dataflow/assets/61396939/3be78e6a-5f77-4e91-92c5-27be87ceff44)
release version