Read and process records from files available in processing folder and send successful records to done folder, others to error

[Jasleen1493]

Description: Read new files from processing folder every two hours.The processing must be on the basis of files naming convention, where xxxx denotes a integer and files having smallest number present in it's name must be processed first. If an issue occurs with record then file shall be sent to error folder with same file name with error appended, for example transactions0123-error.csv for file transactions0123.csv consisting of the error description, else call kafka publisher and move the record to done folder.

Acceptance Criteria:

Read files from processing folder and process them record by record Processing file must be able to call kafka publisher (subject to availability) Successful processed records pushed to done folder with correct naming convention Erroneous processed records pushed to done folder with correct naming convention

[arorakapil13990]

Kafka part is remaining.