I create my pipeline as shown
PipelineOptionsFactory.register(ClOptions.class); ClOptions options = PipelineOptionsFactory.fromArgs(args).withValidation().as(ClOptions.class); options.setRunner(BlockingDataflowPipelineRunner.class);
So, I try reading the file from command line args as shown
p.apply(TextIO.Read.named("Reading file schema").from(options.getSchema()).withoutValidation());
and I run the pipeline using following command
mvn compile exec:java -Dexec.mainClass=com.example.TupleNoTemplate -Dexec.args="--project=rwa-tooling \ --inputFile=gs://cdw-data/CUSTOMER_CDW_V1_20170101.csv \ --tableName=rwa-tooling:ZZZ_Team_Sandbox_Dataset.CDW_CUSTOMER2$\20170101 \ --columns=gs://rwa_bucket1/columns.txt --schema=gs://cdw-data/CUSTOMER_CDW_schema.txt "
After even using .withoutValidation() when using TextIO.Read, I get this error
InvocationTargetException: Filepattern cannot be empty.
I create my pipeline as shown
PipelineOptionsFactory.register(ClOptions.class); ClOptions options = PipelineOptionsFactory.fromArgs(args).withValidation().as(ClOptions.class); options.setRunner(BlockingDataflowPipelineRunner.class);So, I try reading the file from command line args as shown
p.apply(TextIO.Read.named("Reading file schema").from(options.getSchema()).withoutValidation());and I run the pipeline using following command
mvn compile exec:java -Dexec.mainClass=com.example.TupleNoTemplate -Dexec.args="--project=rwa-tooling \ --inputFile=gs://cdw-data/CUSTOMER_CDW_V1_20170101.csv \ --tableName=rwa-tooling:ZZZ_Team_Sandbox_Dataset.CDW_CUSTOMER2$\20170101 \ --columns=gs://rwa_bucket1/columns.txt --schema=gs://cdw-data/CUSTOMER_CDW_schema.txt "After even using .withoutValidation() when using TextIO.Read, I get this error
InvocationTargetException: Filepattern cannot be empty.