apache / shardingsphere-elasticjob

Distributed scheduled job
Apache License 2.0
8.14k stars 3.28k forks source link

dataflowjob streaming read data does not take effect #2020

Open zzferTochen opened 2 years ago

zzferTochen commented 2 years ago

Dataflowjob streaming data is not effective, is my configuration wrong? The springboot version is 2.6.0. Below is my configuration file

elasticjob.jobs.my-dataflow-job.cron=*/10 * * * * ?
elasticjob.jobs.my-dataflow-job.elastic-job-class=com.example.demo.job.MyDataFlowJob
elasticjob.jobs.my-dataflow-job.sharding-total-count=1
elasticjob.jobs.my-dataflow-job.disabled=false
elasticjob.jobs.my-dataflow-job.overwrite=true
#elasticjob.jobs.my-dataflow-job.sharding-item-parameters=0=0,1=1
elasticjob.jobs.my-dataflow-job.streaming-process=true
  <dependency>
            <groupId>org.apache.shardingsphere.elasticjob</groupId>
            <artifactId>elasticjob-lite-spring-boot-starter</artifactId>
            <version>3.0.0</version>
        </dependency>
edwarddamon commented 2 years ago

I have the same question. According to my research,I found that it doesn't has streaming-process property(my dependency version is 3.0.0 too).

public final class ElasticJobConfigurationProperties {
    private Class<? extends ElasticJob> elasticJobClass;
    private String elasticJobType;
    private String cron;
    private String jobBootstrapBeanName;
    private int shardingTotalCount;
    private String shardingItemParameters;
    private String jobParameter;
    private boolean monitorExecution;
    private boolean failover;
    private boolean misfire;
    private int maxTimeDiffSeconds = -1;
    private int reconcileIntervalMinutes;
    private String jobShardingStrategyType;
    private String jobExecutorServiceHandlerType;
    private String jobErrorHandlerType;
    private Collection<String> jobListenerTypes = new LinkedList();
    private String description;
    private Properties props = new Properties();
    private boolean disabled;
    private boolean overwrite;
}
TeslaCN commented 2 years ago

try

elasticjob:
  jobs:
    my-dataflow-job:
      props:
        streaming.process: 'true'