pydio / pydio-sync-java

[DEPRECATED] Synchronization Client of the Pydio project. Based on the Java SDK.
GNU General Public License v3.0
35 stars 15 forks source link

Error when syncing lots of files says ":null" [Help] #15

Closed FingerlessGlov3s closed 11 years ago

FingerlessGlov3s commented 11 years ago

When I sync lots files that are on my repo i get this error http://i.imgur.com/l6IHveI.png but I can sync when ive got like 3-10 files Im running Centos, and i have install the rsync plugin# trying to sync with windows 8 64bit using java 32bit

[PHP Modules] bz2 calendar Core ctype curl date dom ereg exif fileinfo filter ftp gd gettext gmp hash iconv imap intl json libxml mbstring mcrypt mysql mysqli openssl pcntl pcre PDO pdo_mysql pdo_sqlite Phar readline Reflection rsync session shmop SimpleXML sockets SPL sqlite3 standard suhosin tokenizer wddx xml xmlreader xmlrpc xmlwriter xsl zip zlib

[Zend Modules] Suhosin

cdujeu commented 11 years ago

I'm testing with 5Gb of small files ... Maybe a memory issue on your side, or a specific file is creating the problem. Can you check the error.log file inside the program folder?

FingerlessGlov3s commented 11 years ago

ive set my php to 512mb memory. this log is from my other pc that runs ubuntu but it has the same issue

ajxp_errors.out is blank

ajxp_log.out 0 [main] INFO root - Rdiff Processor active? No 172 [main] INFO org.quartz.impl.StdSchedulerFactory - Using default implementation for ThreadExecutor 191 [main] INFO org.quartz.core.SchedulerSignalerImpl - Initialized Scheduler Signaller of type: class org.quartz.core.SchedulerSignalerImpl 192 [main] INFO org.quartz.core.QuartzScheduler - Quartz Scheduler v.2.1.3 created. 194 [main] INFO org.quartz.simpl.RAMJobStore - RAMJobStore initialized. 195 [main] INFO org.quartz.core.QuartzScheduler - Scheduler meta-data: Quartz Scheduler (v2.1.3) 'AjaXplorerScheduler' with instanceId 'NON_CLUSTERED' Scheduler class: 'org.quartz.core.QuartzScheduler' - running locally. NOT STARTED. Currently in standby mode. Number of jobs executed: 0 Using thread pool 'org.quartz.simpl.SimpleThreadPool' - with 1 threads. Using job-store 'org.quartz.simpl.RAMJobStore' - which does not support persistence. and is not clustered.

195 [main] INFO org.quartz.impl.StdSchedulerFactory - Quartz scheduler 'AjaXplorerScheduler' initialized from default resource file in Quartz package: 'quartz.properties' 195 [main] INFO org.quartz.impl.StdSchedulerFactory - Quartz scheduler version: 2.1.3 196 [main] INFO org.quartz.core.QuartzScheduler - Scheduler AjaXplorerScheduler_$_NON_CLUSTERED started. 5412 [AjaXplorerScheduler_Worker-1] INFO root - This pass took 3918 milliSeconds (Local : false) 6601 [AjaXplorerScheduler_Worker-1] INFO root - This pass took 1186 milliSeconds (Local : true)

cdujeu commented 11 years ago

I was thinking more of the client memory, not the server. Can you try to edit the AjaXplorerSynchronizer.ini file located inside the program folder? Inside you'll find the last line Virtual Machine Parameters=-Xms2M -Xmx16M Change it to Virtual Machine Parameters=-Xms12M -Xmx64M And see if it starts!

FingerlessGlov3s commented 11 years ago

cant find this AjaxplorerSynchronizer.ini. If thi helps i download the sync client from the nightly bullds http://ajaxplorer.info/download/

cant find it in the folder where i start the .jar or the .ajaxplorer fodler that would be in appdata on windows

FingerlessGlov3s commented 11 years ago

found a way still no luck

java -Xms12M -Xmx64M -jar AjaXplorerSynchro.jar 0 [main] INFO root - Rdiff Processor active? No 352 [main] INFO org.quartz.impl.StdSchedulerFactory - Using default implementation for ThreadExecutor 373 [main] INFO org.quartz.core.SchedulerSignalerImpl - Initialized Scheduler Signaller of type: class org.quartz.core.SchedulerSignalerImpl 375 [main] INFO org.quartz.core.QuartzScheduler - Quartz Scheduler v.2.1.3 created. 376 [main] INFO org.quartz.simpl.RAMJobStore - RAMJobStore initialized. 377 [main] INFO org.quartz.core.QuartzScheduler - Scheduler meta-data: Quartz Scheduler (v2.1.3) 'AjaXplorerScheduler' with instanceId 'NON_CLUSTERED' Scheduler class: 'org.quartz.core.QuartzScheduler' - running locally. NOT STARTED. Currently in standby mode. Number of jobs executed: 0 Using thread pool 'org.quartz.simpl.SimpleThreadPool' - with 1 threads. Using job-store 'org.quartz.simpl.RAMJobStore' - which does not support persistence. and is not clustered.

378 [main] INFO org.quartz.impl.StdSchedulerFactory - Quartz scheduler 'AjaXplorerScheduler' initialized from default resource file in Quartz package: 'quartz.properties' 378 [main] INFO org.quartz.impl.StdSchedulerFactory - Quartz scheduler version: 2.1.3 378 [main] INFO org.quartz.core.QuartzScheduler - Scheduler AjaXplorerScheduler_$_NON_CLUSTERED started. java.lang.UnsatisfiedLinkError: /tmp/sqlite-3.6.20-libsqlitejdbc.so: /tmp/sqlite-3.6.20-libsqlitejdbc.so: failed to map segment from shared object: Operation not permitted com.sun.org.apache.xerces.internal.impl.io.MalformedByteSequenceException: Invalid byte 2 of 3-byte UTF-8 sequence. at com.sun.org.apache.xerces.internal.impl.io.UTF8Reader.invalidByte(UTF8Reader.java:687) at com.sun.org.apache.xerces.internal.impl.io.UTF8Reader.read(UTF8Reader.java:408) at com.sun.org.apache.xerces.internal.impl.XMLEntityScanner.load(XMLEntityScanner.java:1753) at com.sun.org.apache.xerces.internal.impl.XMLEntityScanner.scanLiteral(XMLEntityScanner.java:1074) at com.sun.org.apache.xerces.internal.impl.XMLScanner.scanAttributeValue(XMLScanner.java:948) at com.sun.org.apache.xerces.internal.impl.XMLDocumentFragmentScannerImpl.scanAttribute(XMLDocumentFragmentScannerImpl.java:1507) at com.sun.org.apache.xerces.internal.impl.XMLDocumentFragmentScannerImpl.scanStartElement(XMLDocumentFragmentScannerImpl.java:1280) at com.sun.org.apache.xerces.internal.impl.XMLDocumentFragmentScannerImpl$FragmentContentDriver.next(XMLDocumentFragmentScannerImpl.java:2717) at com.sun.org.apache.xerces.internal.impl.XMLDocumentScannerImpl.next(XMLDocumentScannerImpl.java:607) at com.sun.org.apache.xerces.internal.impl.XMLDocumentFragmentScannerImpl.scanDocument(XMLDocumentFragmentScannerImpl.java:489) at com.sun.org.apache.xerces.internal.parsers.XML11Configuration.parse(XML11Configuration.java:835) at com.sun.org.apache.xerces.internal.parsers.XML11Configuration.parse(XML11Configuration.java:764) at com.sun.org.apache.xerces.internal.parsers.XMLParser.parse(XMLParser.java:123) at com.sun.org.apache.xerces.internal.parsers.DOMParser.parse(DOMParser.java:237) at com.sun.org.apache.xerces.internal.jaxp.DocumentBuilderImpl.parse(DocumentBuilderImpl.java:300) at javax.xml.parsers.DocumentBuilder.parse(DocumentBuilder.java:121) at info.ajaxplorer.client.http.XMLDocEntity.(XMLDocEntity.java:74) at info.ajaxplorer.client.http.RestRequest.isAuthenticationRequested(RestRequest.java:340) at info.ajaxplorer.client.http.RestRequest.issueRequest(RestRequest.java:240) at info.ajaxplorer.client.http.RestRequest.issueRequest(RestRequest.java:146) at info.ajaxplorer.client.http.RestRequest.getDocumentContent(RestRequest.java:460) at info.ajaxplorer.client.http.RestRequest.getDocumentContent(RestRequest.java:444) at info.ajaxplorer.synchro.SyncJob.takeRemoteSnapshot(SyncJob.java:1139) at info.ajaxplorer.synchro.SyncJob.loadRemoteChanges(SyncJob.java:1161) at info.ajaxplorer.synchro.SyncJob.run(SyncJob.java:325) at info.ajaxplorer.synchro.SyncJob.execute(SyncJob.java:163) at org.quartz.core.JobRunShell.run(JobRunShell.java:213) at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) java.lang.NullPointerException at info.ajaxplorer.synchro.SyncJob.takeRemoteSnapshot(SyncJob.java:1143) at info.ajaxplorer.synchro.SyncJob.loadRemoteChanges(SyncJob.java:1161) at info.ajaxplorer.synchro.SyncJob.run(SyncJob.java:325) at info.ajaxplorer.synchro.SyncJob.execute(SyncJob.java:163) at org.quartz.core.JobRunShell.run(JobRunShell.java:213) at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) 11388 [AjaXplorerScheduler_Worker-1] INFO root - This pass took 9386 milliSeconds (Local : false)

cdujeu commented 11 years ago

do you have special characters in your file names?

FingerlessGlov3s commented 11 years ago

does not look like it. what special characters does it not like?

FingerlessGlov3s commented 11 years ago

fixed it turned out i had a charter that my PHP script did not pick up had to delete it could not rename or move it

lamarios commented 11 years ago

I also have the same issue, I was hitting java heap space which i fixed by changing the virtual machine parameters so now i'm hitting the null error, but unfortunately, I don't have any logs coming out on the errors.out or even.out except:

1918339 [AjaXplorerScheduler_Worker-1] INFO root - This pass took 88081 milliSeconds (Local : true)

My client is on OSX 10.8.4, the folder I'm trying to synchronise is around 8 GB with 100 000 files, and is already on my server (was using btsync before, but my office blocked it, so i decided to use the Ajaxplorer client).

My server is an Ubuntu server running apache2 and I have the php rsync lib installed properly (appears in my phpinfo). And no error appears in server side logs.

I tried to find the night builds, but it seems not to be there anymore in the folder specified earlier in the topic.

Thanks