search

slingr-stack / pepito-test

Repository to test pepito app
0 stars 0 forks source link

IP-4134. FTP endpoint > It stops working after some time #165

Open idea2-pepito opened 8 years ago

idea2-pepito commented 8 years ago

It seems like the FTP endpoint stops working after it is deployed without activity for some time. We don't see any error in the logs, but if you place new files those are not processed at all (not moved to the archive folder, not sent to the app).

At the time of writing this issue, the problem was happening on test4 with endpoint ftp.

Not sure what would be the way to handle this, but we should see if we can periodically check if the connection is working fine and restart it if there are issue. As there are no error message, I'm not sure how we can detect the connection.

lefunes added a comment - Tue Jul 26 2016 20:15:33 GMT-0000 (UTC)

Maybe these errors are related:

26 Jul 2016 17:12:52.926 2016-07-26 20:12:52.716 <ins>0000 comp=endpoint level=WARN app=test4 endpoint=ftp env=dev Consumer FtpConsumer<ftps://idea2-test@idea2.brickftp.com:21/input?binary=true&delay=30000&disconnect=true&flatten=false&localWorkDirectory=%2Ftmp%2FftpFtpTmp&maxMessagesPerPoll=1&maximumReconnectAttempts=10&passiveMode=true&password=xxxxxx&preMove=%2Farchived%2F%24%7Bdate%3Anow%3Ayyyy-MM%7D%2F%24%7Bdate%3Anow%3AyyyyMMddHHmmss%7D-%24%7Bfile%3Aonlyname%7D&readLock=changed&readLockCheckInterval=5000&readLockTimeout=30000&reconnectDelay=10000&recursive=false> failed polling endpoint: Endpoint[ftps://idea2-test@idea2.brickftp.com:21/input?binary=true&delay=30000&disconnect=true&flatten=false&localWorkDirectory=%2Ftmp%2FftpFtpTmp&maxMessagesPerPoll=1&maximumReconnectAttempts=10&passiveMode=true&password=xxxxxx&preMove=%2Farchived%2F%24%7Bdate%3Anow%3Ayyyy-MM%7D%2F%24%7Bdate%3Anow%3AyyyyMMddHHmmss%7D-%24%7Bfile%3Aonlyname%7D&readLock=changed&readLockCheckInterval=5000&readLockTimeout=30000&reconnectDelay=10000&recursive=false]. Will try again at next poll. Caused by: [org.apache.camel.component.file.GenericFileOperationFailedException - File operation failed: 550 No such directory. Cannot change directory to: input. Code: 550] , org.apache.camel.component.file.GenericFileOperationFailedException: File operation failed: 550 No such directory. Cannot change directory to: input. Code: 550 at org.apache.camel.component.file.remote.FtpOperations.doChangeDirectory(FtpOperations.java:773) at org.apache.camel.component.file.remote.FtpOperations.changeCurrentDirectory(FtpOperations.java:751) at org.apache.camel.component.file.remote.FtpConsumer.doPollDirectory(FtpConsumer.java:83) at org.apache.camel.component.file.remote.FtpConsumer.pollDirectory(FtpConsumer.java:54) at org.apache.camel.component.file.GenericFileConsumer.poll(GenericFileConsumer.java:119) at org.apache.camel.impl.ScheduledPollConsumer.doRun(ScheduledPollConsumer.java:174) at org.apache.camel.impl.ScheduledPollConsumer.run(ScheduledPollConsumer.java:101) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745) Context
» 26 Jul 2016 17:13:23.023 2016-07-26 20:13:22.813 </ins>0000 comp=endpoint level=WARN app=test4 endpoint=ftp env=dev Consumer FtpConsumer<ftps://idea2-test@idea2.brickftp.com:21/input?binary=true&delay=30000&disconnect=true&flatten=false&localWorkDirectory=%2Ftmp%2FftpFtpTmp&maxMessagesPerPoll=1&maximumReconnectAttempts=10&passiveMode=true&password=xxxxxx&preMove=%2Farchived%2F%24%7Bdate%3Anow%3Ayyyy-MM%7D%2F%24%7Bdate%3Anow%3AyyyyMMddHHmmss%7D-%24%7Bfile%3Aonlyname%7D&readLock=changed&readLockCheckInterval=5000&readLockTimeout=30000&reconnectDelay=10000&recursive=false> failed polling endpoint: Endpoint[ftps://idea2-test@idea2.brickftp.com:21/input?binary=true&delay=30000&disconnect=true&flatten=false&localWorkDirectory=%2Ftmp%2FftpFtpTmp&maxMessagesPerPoll=1&maximumReconnectAttempts=10&passiveMode=true&password=xxxxxx&preMove=%2Farchived%2F%24%7Bdate%3Anow%3Ayyyy-MM%7D%2F%24%7Bdate%3Anow%3AyyyyMMddHHmmss%7D-%24%7Bfile%3Aonlyname%7D&readLock=changed&readLockCheckInterval=5000&readLockTimeout=30000&reconnectDelay=10000&recursive=false]. Will try again at next poll. Caused by: [org.apache.camel.component.file.GenericFileOperationFailedException - File operation failed: 550 No such directory. Cannot change directory to: input. Code: 550] , org.apache.camel.component.file.GenericFileOperationFailedException: File operation failed: 550 No such directory. Cannot change directory to: input. Code: 550 at org.apache.camel.component.file.remote.FtpOperations.doChangeDirectory(FtpOperations.java:773) at org.apache.camel.component.file.remote.FtpOperations.changeCurrentDirectory(FtpOperations.java:751) at org.apache.camel.component.file.remote.FtpConsumer.doPollDirectory(FtpConsumer.java:83) at org.apache.camel.component.file.remote.FtpConsumer.pollDirectory(FtpConsumer.java:54) at org.apache.camel.component.file.GenericFileConsumer.poll(GenericFileConsumer.java:119) at org.apache.camel.impl.ScheduledPollConsumer.doRun(ScheduledPollConsumer.java:174) at org.apache.camel.impl.ScheduledPollConsumer.run(ScheduledPollConsumer.java:101) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745) Context
» 26 Jul 2016 17:13:53.116 2016-07-26 20:13:52.906 <ins>0000 comp=endpoint level=WARN app=test4 endpoint=ftp env=dev Consumer FtpConsumer<ftps://idea2-test@idea2.brickftp.com:21/input?binary=true&delay=30000&disconnect=true&flatten=false&localWorkDirectory=%2Ftmp%2FftpFtpTmp&maxMessagesPerPoll=1&maximumReconnectAttempts=10&passiveMode=true&password=xxxxxx&preMove=%2Farchived%2F%24%7Bdate%3Anow%3Ayyyy-MM%7D%2F%24%7Bdate%3Anow%3AyyyyMMddHHmmss%7D-%24%7Bfile%3Aonlyname%7D&readLock=changed&readLockCheckInterval=5000&readLockTimeout=30000&reconnectDelay=10000&recursive=false> failed polling endpoint: Endpoint[ftps://idea2-test@idea2.brickftp.com:21/input?binary=true&delay=30000&disconnect=true&flatten=false&localWorkDirectory=%2Ftmp%2FftpFtpTmp&maxMessagesPerPoll=1&maximumReconnectAttempts=10&passiveMode=true&password=xxxxxx&preMove=%2Farchived%2F%24%7Bdate%3Anow%3Ayyyy-MM%7D%2F%24%7Bdate%3Anow%3AyyyyMMddHHmmss%7D-%24%7Bfile%3Aonlyname%7D&readLock=changed&readLockCheckInterval=5000&readLockTimeout=30000&reconnectDelay=10000&recursive=false]. Will try again at next poll. Caused by: [org.apache.camel.component.file.GenericFileOperationFailedException - File operation failed: 550 No such directory. Cannot change directory to: input. Code: 550] , org.apache.camel.component.file.GenericFileOperationFailedException: File operation failed: 550 No such directory. Cannot change directory to: input. Code: 550 at org.apache.camel.component.file.remote.FtpOperations.doChangeDirectory(FtpOperations.java:773) at org.apache.camel.component.file.remote.FtpOperations.changeCurrentDirectory(FtpOperations.java:751) at org.apache.camel.component.file.remote.FtpConsumer.doPollDirectory(FtpConsumer.java:83) at org.apache.camel.component.file.remote.FtpConsumer.pollDirectory(FtpConsumer.java:54) at org.apache.camel.component.file.GenericFileConsumer.poll(GenericFileConsumer.java:119) at org.apache.camel.impl.ScheduledPollConsumer.doRun(ScheduledPollConsumer.java:174) at org.apache.camel.impl.ScheduledPollConsumer.run(ScheduledPollConsumer.java:101) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745) Context
» 26 Jul 2016 17:14:23.209 2016-07-26 20:14:22.998 </ins>0000 comp=endpoint level=WARN app=test4 endpoint=ftp env=dev Consumer FtpConsumer<ftps://idea2-test@idea2.brickftp.com:21/input?binary=true&delay=30000&disconnect=true&flatten=false&localWorkDirectory=%2Ftmp%2FftpFtpTmp&maxMessagesPerPoll=1&maximumReconnectAttempts=10&passiveMode=true&password=xxxxxx&preMove=%2Farchived%2F%24%7Bdate%3Anow%3Ayyyy-MM%7D%2F%24%7Bdate%3Anow%3AyyyyMMddHHmmss%7D-%24%7Bfile%3Aonlyname%7D&readLock=changed&readLockCheckInterval=5000&readLockTimeout=30000&reconnectDelay=10000&recursive=false> failed polling endpoint: Endpoint[ftps://idea2-test@idea2.brickftp.com:21/input?binary=true&delay=30000&disconnect=true&flatten=false&localWorkDirectory=%2Ftmp%2FftpFtpTmp&maxMessagesPerPoll=1&maximumReconnectAttempts=10&passiveMode=true&password=xxxxxx&preMove=%2Farchived%2F%24%7Bdate%3Anow%3Ayyyy-MM%7D%2F%24%7Bdate%3Anow%3AyyyyMMddHHmmss%7D-%24%7Bfile%3Aonlyname%7D&readLock=changed&readLockCheckInterval=5000&readLockTimeout=30000&reconnectDelay=10000&recursive=false]. Will try again at next poll. Caused by: [org.apache.camel.component.file.GenericFileOperationFailedException - File operation failed: 550 No such directory. Cannot change directory to: input. Code: 550] , org.apache.camel.component.file.GenericFileOperationFailedException: File operation failed: 550 No such directory. Cannot change directory to: input. Code: 550 at org.apache.camel.component.file.remote.FtpOperations.doChangeDirectory(FtpOperations.java:773) at org.apache.camel.component.file.remote.FtpOperations.changeCurrentDirectory(FtpOperations.java:751) at org.apache.camel.component.file.remote.FtpConsumer.doPollDirectory(FtpConsumer.java:83) at org.apache.camel.component.file.remote.FtpConsumer.pollDirectory(FtpConsumer.java:54) at org.apache.camel.component.file.GenericFileConsumer.poll(GenericFileConsumer.java:119) at org.apache.camel.impl.ScheduledPollConsumer.doRun(ScheduledPollConsumer.java:174) at org.apache.camel.impl.ScheduledPollConsumer.run(ScheduledPollConsumer.java:101) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745) Context

dgaviola added a comment - Tue Jul 26 2016 20:59:55 GMT-0000 (UTC)

Yes, that might be related. This morning when I looked at the logs there were no errors yet and the files were there. Maybe it takes some hours to start logging the error.

Anyway I think it is a problem on the endpoint, because restarting it fixes the issue.

On Tue, Jul 26, 2016 at 5:16 PM, Luis Enrique Funes (JIRA) <

kkrhdd commented 7 years ago

Hi Gents,

We are also facing exactly the same issues in our application. Do we have any fix for that?

Thanks.