Can't initialize rdf file

isaaclw commented 5 years ago

I've tried creating the rdf file manually, and letting scrapbee create the file.

When I created the file, I tried it empty, and I tried it with: ``<?xml version="1.0" encoding="UTF-8"?>

`` When I don't create the file manually, no file is created. It's not an issue with permissions, because I've only ever tried creating it with my own user. Here's a very unhelpful log: `` [info] ScrapBee version = 1.7.8 [info] browser = Firefox 60.7.0 [info] platform = Linux x86_64 [info] start backend service on port 12345. [info] backend service started, version = 1.7.0 (wanted >= 1.7.0) [info] show rdf list [info] switch to rdf "test.rdf" [error] rdf have not been loaded [info] show rdf list [info] show rdf list [info] show rdf list [info] switch to rdf "other.rdf" [info] show rdf list [info] switch to rdf "other.rdf" [info] show rdf list [info] switch to rdf "other.rdf" [info] show rdf list [info] switch to rdf "asdf.rdf" [info] show rdf list [info] switch to rdf "/home/isaac/asdf.rdf" [info] show rdf list [info] switch to rdf "/home/isaac/asdf.rdf" [info] show rdf list [info] switch to rdf "/home/isaac/asdf.rdf" [info] switch to rdf "/home/isaac/other2.rdf" ``

isaaclw commented 5 years ago

I've also tried: changing the port, changing the path to be in the Downloads folder, or in the home folder.

I've tried creating folders while it says: "Loading..." in case that tricks it into starting the file initialization.

vctfence commented 5 years ago

Hi, ScrapBee only creates the file none exists, when you saw 'Rdf file **** does not exist, create it? ' in sidebar while you switch to that file and click on 'Yes' button. If you want to try to create the file manually, here's an example:

`<?xml version="1.0"?>

`

isaaclw commented 5 years ago

Ok, thanks.

I think it would be really helpful to have pictures of that whole step.

I saw that the guide was supposed to create the file for me, but I couldn't figure out why it wasn't creating the file.

Now I see that it was supposed to say: "The file doesn't exist, would you like to create it?: "

I got it to work on one computer, but it didn't work on the other, so I will see if I can get that dialog to show up over there.

isaaclw commented 5 years ago

I think my issue is with multiple profiles. I have a work profile, and a personal profile.

Now I'm getting: [error] backend disconnected due to an error: An unexpected error occurred

isaaclw commented 5 years ago

Ok, after a full restart, and making sure both profiles have different ports for scrapbee, one instance has a rdf session.

The other still says 'Loading...', and I'm sure that the rdf hasn't been created yet.

This is interestingly enough, the same one I had issues with yesterday. Both are Firefox version 60.7.0

isaaclw commented 5 years ago

Is there a way I can get more debugging information?

vctfence commented 5 years ago

Hi, I am guessing, the rdf was not loaded is created manually? there may be something wrong in it or current user has no read permission there.

isaaclw commented 5 years ago

[@pogo:~] $ ls -al /home/isaac_witmer/Downloads/other.rdf
-rw-r--r-- 1 isaac_witmer isaac_witmer 223 Jun 13 15:40 /home/isaac_witmer/Downloads/other.rdf
[@pogo:~] $ cat /home/isaac_witmer/Downloads/other.rdf
<?xml version="1.0"?> <RDF:RDF xmlns:NS1="scrapbee@163.com" xmlns:NC="http://home.netscape.com/NC-rdf#" xmlns:RDF="http://www.w3.org/1999/02/22-rdf-syntax-ns#"> <RDF:Seq RDF:about="urn:scrapbook:root"></RDF:Seq> </RDF:RDF>

Does it look ok? That's the rdf that's not loading.

If I tell it to create the file, it doesn't work that way either.

Is it a problem of having multiple profiles with scrapbee? Can you test that on your end?

vctfence commented 5 years ago

Sorry to be late, it works for me as my testing: 000 Can you try to provide steps to reproduce the problem you met? thanks.

isaaclw commented 5 years ago

I'm sorry. I haven't tested much.

Can you confirm the following:

That both profiles use different ports
That both profiles use different rdf files

That the same scrapbee_backend is running both?

isaac_w+ 27412  2438  7 12:16 tty2     00:04:38  \_ /usr/lib/firefox-esr/firefox-esr -P personal
...
isaac_w+ 32170 27412  0 12:35 tty2     00:00:00  |   \_ /home/isaac_witmer/Downloads/scrapbee/scrapbee_backend /home/isaac_witmer/.mozilla/native-messaging-hosts/scrapbee_backend.json scrapbee@scrapbee.org
isaac_w+ 11458  2438 15 13:18 tty2     00:00:06  \_ /usr/lib/firefox-esr/firefox-esr -P other
...
isaac_w+ 11695 11458  0 13:18 tty2     00:00:00      \_ /home/isaac_witmer/Downloads/scrapbee/scrapbee_backend /home/isaac_witmer/.mozilla/native-messaging-hosts/scrapbee_backend.json scrapbee@scrapbee.org

What version of firefox are you using?

I'm on 60.8.0esr

I'm not sure what to say about how to duplicate it. Clearly you're not hitting the same issue as I am. Is there some way you could add more debugging to the log?

isaaclw commented 5 years ago

Oh also, I added this script: watch() { ffpid=$(pgrep -f "firefox-esr -P other"); [ -z "$ffpid" ] && { echo "ff closed"; return; }; sbpid=$(pgrep scrapbee -P $ffpid); [ -z "$sbpid" ] && { echo "sb closed"; return; }; strace -p $sbpid; }

The command checks to see if there is a firefox process (other). If there is, it checks if a 'scrapbee' process has that as aparent. If it does, then it uses strace to attach and monitor it.

And then ran: while true; do watch; sleep 0.1; done Which basically continues checking every tenth of a second.

I got this output when I started up my 'other' profile, and opened up scrapbee:

strace: Process 11695 attached
strace: [ Process PID=11695 runs in 32 bit mode. ]
mprotect(0x828a000, 2734915, PROT_READ) = 0
mmap2(0x8526000, 199203, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_FIXED|MAP_ANONYMOUS, -1, 0) = 0x8526000
mprotect(0x8526000, 199200, PROT_READ|PROT_WRITE) = 0
mmap2(0x8557000, 86728, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_FIXED|MAP_ANONYMOUS, -1, 0) = 0x8557000
brk(0x856d000)                          = 0x915e000
mmap2(NULL, 4096, PROT_READ, MAP_PRIVATE, 4, 0) = 0xf7573000
close(4)                                = 0
munmap(0xf757a000, 2238044)             = 0
set_thread_area({entry_number:-1, base_addr:0x8558050, limit:1048575, seg_32bit:1, contents:0, read_exec_only:0, limit_in_pages:1, seg_not_present:0, useable:1}) = 0 (entry_number:12)
sched_getaffinity(0, 8192, [0, 1, 2, 3, 4, 5, 6, 7]) = 64
mmap2(NULL, 262144, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_ANONYMOUS, -1, 0) = 0xf775d000
mmap2(NULL, 270663680, PROT_NONE, MAP_PRIVATE|MAP_ANONYMOUS, -1, 0) = 0xe7353000
brk(NULL)                               = 0x915e000
mmap2(0x9400000, 541065216, PROT_NONE, MAP_PRIVATE|MAP_ANONYMOUS, -1, 0) = 0x9400000
mmap2(0x9400000, 4194304, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_FIXED|MAP_ANONYMOUS, -1, 0) = 0x9400000
mmap2(0xe7353000, 266240, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_FIXED|MAP_ANONYMOUS, -1, 0) = 0xe7353000
mmap2(NULL, 65536, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_ANONYMOUS, -1, 0) = 0xf774d000
mmap2(NULL, 65536, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_ANONYMOUS, -1, 0) = 0xf773d000
rt_sigprocmask(SIG_SETMASK, NULL, [], 8) = 0
sigaltstack(NULL, {ss_sp=NULL, ss_flags=SS_DISABLE, ss_size=0}) = 0
sigaltstack({ss_sp=0x9402000, ss_flags=0, ss_size=32768}, NULL) = 0
rt_sigprocmask(SIG_SETMASK, [], NULL, 8) = 0
gettid()                                = 11695
rt_sigaction(SIGHUP, NULL, {sa_handler=SIG_DFL, sa_mask=[], sa_flags=0}, 8) = 0
rt_sigaction(SIGHUP, {sa_handler=0x80979e0, sa_mask=~[], sa_flags=SA_RESTORER|SA_STACK|SA_RESTART|SA_SIGINFO, sa_restorer=0x8097a40}, NULL, 8) = 0
rt_sigaction(SIGINT, NULL, {sa_handler=SIG_DFL, sa_mask=[], sa_flags=0}, 8) = 0
rt_sigaction(SIGINT, {sa_handler=0x80979e0, sa_mask=~[], sa_flags=SA_RESTORER|SA_STACK|SA_RESTART|SA_SIGINFO, sa_restorer=0x8097a40}, NULL, 8) = 0
rt_sigaction(SIGQUIT, NULL, {sa_handler=SIG_DFL, sa_mask=[], sa_flags=0}, 8) = 0
rt_sigaction(SIGQUIT, {sa_handler=0x80979e0, sa_mask=~[], sa_flags=SA_RESTORER|SA_STACK|SA_RESTART|SA_SIGINFO, sa_restorer=0x8097a40}, NULL, 8) = 0
rt_sigaction(SIGILL, NULL, {sa_handler=SIG_DFL, sa_mask=[], sa_flags=0}, 8) = 0
rt_sigaction(SIGILL, {sa_handler=0x80979e0, sa_mask=~[], sa_flags=SA_RESTORER|SA_STACK|SA_RESTART|SA_SIGINFO, sa_restorer=0x8097a40}, NULL, 8) = 0
rt_sigaction(SIGTRAP, NULL, {sa_handler=SIG_DFL, sa_mask=[], sa_flags=0}, 8) = 0
rt_sigaction(SIGTRAP, {sa_handler=0x80979e0, sa_mask=~[], sa_flags=SA_RESTORER|SA_STACK|SA_RESTART|SA_SIGINFO, sa_restorer=0x8097a40}, NULL, 8) = 0
rt_sigaction(SIGABRT, NULL, {sa_handler=SIG_DFL, sa_mask=[], sa_flags=0}, 8) = 0
rt_sigaction(SIGABRT, {sa_handler=0x80979e0, sa_mask=~[], sa_flags=SA_RESTORER|SA_STACK|SA_RESTART|SA_SIGINFO, sa_restorer=0x8097a40}, NULL, 8) = 0
rt_sigaction(SIGBUS, NULL, {sa_handler=SIG_DFL, sa_mask=[], sa_flags=0}, 8) = 0
rt_sigaction(SIGBUS, {sa_handler=0x80979e0, sa_mask=~[], sa_flags=SA_RESTORER|SA_STACK|SA_RESTART|SA_SIGINFO, sa_restorer=0x8097a40}, NULL, 8) = 0
rt_sigaction(SIGFPE, NULL, {sa_handler=SIG_DFL, sa_mask=[], sa_flags=0}, 8) = 0
rt_sigaction(SIGFPE, {sa_handler=0x80979e0, sa_mask=~[], sa_flags=SA_RESTORER|SA_STACK|SA_RESTART|SA_SIGINFO, sa_restorer=0x8097a40}, NULL, 8) = 0
rt_sigaction(SIGUSR1, NULL, {sa_handler=SIG_DFL, sa_mask=[], sa_flags=0}, 8) = 0
rt_sigaction(SIGUSR1, {sa_handler=0x80979e0, sa_mask=~[], sa_flags=SA_RESTORER|SA_STACK|SA_RESTART|SA_SIGINFO, sa_restorer=0x8097a40}, NULL, 8) = 0
rt_sigaction(SIGSEGV, NULL, {sa_handler=SIG_DFL, sa_mask=[], sa_flags=0}, 8) = 0
rt_sigaction(SIGSEGV, {sa_handler=0x80979e0, sa_mask=~[], sa_flags=SA_RESTORER|SA_STACK|SA_RESTART|SA_SIGINFO, sa_restorer=0x8097a40}, NULL, 8) = 0
rt_sigaction(SIGUSR2, NULL, {sa_handler=SIG_DFL, sa_mask=[], sa_flags=0}, 8) = 0
rt_sigaction(SIGUSR2, {sa_handler=0x80979e0, sa_mask=~[], sa_flags=SA_RESTORER|SA_STACK|SA_RESTART|SA_SIGINFO, sa_restorer=0x8097a40}, NULL, 8) = 0
rt_sigaction(SIGPIPE, NULL, {sa_handler=SIG_IGN, sa_mask=[], sa_flags=0}, 8) = 0
rt_sigaction(SIGPIPE, {sa_handler=0x80979e0, sa_mask=~[], sa_flags=SA_RESTORER|SA_STACK|SA_RESTART|SA_SIGINFO, sa_restorer=0x8097a40}, NULL, 8) = 0
rt_sigaction(SIGALRM, NULL, {sa_handler=SIG_DFL, sa_mask=[], sa_flags=0}, 8) = 0
rt_sigaction(SIGALRM, {sa_handler=0x80979e0, sa_mask=~[], sa_flags=SA_RESTORER|SA_STACK|SA_RESTART|SA_SIGINFO, sa_restorer=0x8097a40}, NULL, 8) = 0
rt_sigaction(SIGTERM, NULL, {sa_handler=SIG_DFL, sa_mask=[], sa_flags=0}, 8) = 0
rt_sigaction(SIGTERM, {sa_handler=0x80979e0, sa_mask=~[], sa_flags=SA_RESTORER|SA_STACK|SA_RESTART|SA_SIGINFO, sa_restorer=0x8097a40}, NULL, 8) = 0
rt_sigaction(SIGSTKFLT, NULL, {sa_handler=SIG_DFL, sa_mask=[], sa_flags=0}, 8) = 0
rt_sigaction(SIGSTKFLT, {sa_handler=0x80979e0, sa_mask=~[], sa_flags=SA_RESTORER|SA_STACK|SA_RESTART|SA_SIGINFO, sa_restorer=0x8097a40}, NULL, 8) = 0
rt_sigaction(SIGCHLD, NULL, {sa_handler=SIG_DFL, sa_mask=[], sa_flags=0}, 8) = 0
rt_sigaction(SIGCHLD, {sa_handler=0x80979e0, sa_mask=~[], sa_flags=SA_RESTORER|SA_STACK|SA_RESTART|SA_SIGINFO, sa_restorer=0x8097a40}, NULL, 8) = 0
rt_sigaction(SIGURG, NULL, {sa_handler=SIG_DFL, sa_mask=[], sa_flags=0}, 8) = 0
rt_sigaction(SIGURG, {sa_handler=0x80979e0, sa_mask=~[], sa_flags=SA_RESTORER|SA_STACK|SA_RESTART|SA_SIGINFO, sa_restorer=0x8097a40}, NULL, 8) = 0
rt_sigaction(SIGXCPU, NULL, {sa_handler=SIG_DFL, sa_mask=[], sa_flags=0}, 8) = 0
rt_sigaction(SIGXCPU, {sa_handler=0x80979e0, sa_mask=~[], sa_flags=SA_RESTORER|SA_STACK|SA_RESTART|SA_SIGINFO, sa_restorer=0x8097a40}, NULL, 8) = 0
rt_sigaction(SIGXFSZ, NULL, {sa_handler=SIG_IGN, sa_mask=[], sa_flags=0}, 8) = 0
rt_sigaction(SIGXFSZ, {sa_handler=0x80979e0, sa_mask=~[], sa_flags=SA_RESTORER|SA_STACK|SA_RESTART|SA_SIGINFO, sa_restorer=0x8097a40}, NULL, 8) = 0
rt_sigaction(SIGVTALRM, NULL, {sa_handler=SIG_DFL, sa_mask=[], sa_flags=0}, 8) = 0
rt_sigaction(SIGVTALRM, {sa_handler=0x80979e0, sa_mask=~[], sa_flags=SA_RESTORER|SA_STACK|SA_RESTART|SA_SIGINFO, sa_restorer=0x8097a40}, NULL, 8) = 0
rt_sigaction(SIGPROF, NULL, {sa_handler=SIG_DFL, sa_mask=[], sa_flags=0}, 8) = 0
rt_sigaction(SIGPROF, {sa_handler=0x80979e0, sa_mask=~[], sa_flags=SA_RESTORER|SA_STACK|SA_RESTART|SA_SIGINFO, sa_restorer=0x8097a40}, NULL, 8) = 0
rt_sigaction(SIGWINCH, NULL, {sa_handler=SIG_DFL, sa_mask=[], sa_flags=0}, 8) = 0
rt_sigaction(SIGWINCH, {sa_handler=0x80979e0, sa_mask=~[], sa_flags=SA_RESTORER|SA_STACK|SA_RESTART|SA_SIGINFO, sa_restorer=0x8097a40}, NULL, 8) = 0
rt_sigaction(SIGIO, NULL, {sa_handler=SIG_DFL, sa_mask=[], sa_flags=0}, 8) = 0
rt_sigaction(SIGIO, {sa_handler=0x80979e0, sa_mask=~[], sa_flags=SA_RESTORER|SA_STACK|SA_RESTART|SA_SIGINFO, sa_restorer=0x8097a40}, NULL, 8) = 0
rt_sigaction(SIGPWR, NULL, {sa_handler=SIG_DFL, sa_mask=[], sa_flags=0}, 8) = 0
rt_sigaction(SIGPWR, {sa_handler=0x80979e0, sa_mask=~[], sa_flags=SA_RESTORER|SA_STACK|SA_RESTART|SA_SIGINFO, sa_restorer=0x8097a40}, NULL, 8) = 0
rt_sigaction(SIGSYS, NULL, {sa_handler=SIG_DFL, sa_mask=[], sa_flags=0}, 8) = 0
rt_sigaction(SIGSYS, {sa_handler=0x80979e0, sa_mask=~[], sa_flags=SA_RESTORER|SA_STACK|SA_RESTART|SA_SIGINFO, sa_restorer=0x8097a40}, NULL, 8) = 0
rt_sigaction(SIGRTMIN, NULL, {sa_handler=SIG_IGN, sa_mask=[], sa_flags=0}, 8) = 0
rt_sigaction(SIGRT_1, NULL, {sa_handler=SIG_IGN, sa_mask=[], sa_flags=0}, 8) = 0
rt_sigaction(SIGRT_2, NULL, {sa_handler=SIG_DFL, sa_mask=[], sa_flags=0}, 8) = 0
rt_sigaction(SIGRT_2, {sa_handler=0x80979e0, sa_mask=~[], sa_flags=SA_RESTORER|SA_STACK|SA_RESTART|SA_SIGINFO, sa_restorer=0x8097a40}, NULL, 8) = 0
rt_sigaction(SIGRT_3, NULL, {sa_handler=SIG_DFL, sa_mask=[], sa_flags=0}, 8) = 0
rt_sigaction(SIGRT_3, {sa_handler=0x80979e0, sa_mask=~[], sa_flags=SA_RESTORER|SA_STACK|SA_RESTART|SA_SIGINFO, sa_restorer=0x8097a40}, NULL, 8) = 0
rt_sigaction(SIGRT_4, NULL, {sa_handler=SIG_DFL, sa_mask=[], sa_flags=0}, 8) = 0
rt_sigaction(SIGRT_4, {sa_handler=0x80979e0, sa_mask=~[], sa_flags=SA_RESTORER|SA_STACK|SA_RESTART|SA_SIGINFO, sa_restorer=0x8097a40}, NULL, 8) = 0
rt_sigaction(SIGRT_5, NULL, {sa_handler=SIG_DFL, sa_mask=[], sa_flags=0}, 8) = 0
rt_sigaction(SIGRT_5, {sa_handler=0x80979e0, sa_mask=~[], sa_flags=SA_RESTORER|SA_STACK|SA_RESTART|SA_SIGINFO, sa_restorer=0x8097a40}, NULL, 8) = 0
rt_sigaction(SIGRT_6, NULL, {sa_handler=SIG_DFL, sa_mask=[], sa_flags=0}, 8) = 0
rt_sigaction(SIGRT_6, {sa_handler=0x80979e0, sa_mask=~[], sa_flags=SA_RESTORER|SA_STACK|SA_RESTART|SA_SIGINFO, sa_restorer=0x8097a40}, NULL, 8) = 0
rt_sigaction(SIGRT_7, NULL, {sa_handler=SIG_DFL, sa_mask=[], sa_flags=0}, 8) = 0
rt_sigaction(SIGRT_7, {sa_handler=0x80979e0, sa_mask=~[], sa_flags=SA_RESTORER|SA_STACK|SA_RESTART|SA_SIGINFO, sa_restorer=0x8097a40}, NULL, 8) = 0
rt_sigaction(SIGRT_8, NULL, {sa_handler=SIG_DFL, sa_mask=[], sa_flags=0}, 8) = 0
rt_sigaction(SIGRT_8, {sa_handler=0x80979e0, sa_mask=~[], sa_flags=SA_RESTORER|SA_STACK|SA_RESTART|SA_SIGINFO, sa_restorer=0x8097a40}, NULL, 8) = 0
rt_sigaction(SIGRT_9, NULL, {sa_handler=SIG_DFL, sa_mask=[], sa_flags=0}, 8) = 0
rt_sigaction(SIGRT_9, {sa_handler=0x80979e0, sa_mask=~[], sa_flags=SA_RESTORER|SA_STACK|SA_RESTART|SA_SIGINFO, sa_restorer=0x8097a40}, NULL, 8) = 0
rt_sigaction(SIGRT_10, NULL, {sa_handler=SIG_DFL, sa_mask=[], sa_flags=0}, 8) = 0
rt_sigaction(SIGRT_10, {sa_handler=0x80979e0, sa_mask=~[], sa_flags=SA_RESTORER|SA_STACK|SA_RESTART|SA_SIGINFO, sa_restorer=0x8097a40}, NULL, 8) = 0
rt_sigaction(SIGRT_11, NULL, {sa_handler=SIG_DFL, sa_mask=[], sa_flags=0}, 8) = 0
rt_sigaction(SIGRT_11, {sa_handler=0x80979e0, sa_mask=~[], sa_flags=SA_RESTORER|SA_STACK|SA_RESTART|SA_SIGINFO, sa_restorer=0x8097a40}, NULL, 8) = 0
rt_sigaction(SIGRT_12, NULL, {sa_handler=SIG_DFL, sa_mask=[], sa_flags=0}, 8) = 0
rt_sigaction(SIGRT_12, {sa_handler=0x80979e0, sa_mask=~[], sa_flags=SA_RESTORER|SA_STACK|SA_RESTART|SA_SIGINFO, sa_restorer=0x8097a40}, NULL, 8) = 0
rt_sigaction(SIGRT_13, NULL, {sa_handler=SIG_DFL, sa_mask=[], sa_flags=0}, 8) = 0
rt_sigaction(SIGRT_13, {sa_handler=0x80979e0, sa_mask=~[], sa_flags=SA_RESTORER|SA_STACK|SA_RESTART|SA_SIGINFO, sa_restorer=0x8097a40}, NULL, 8) = 0
rt_sigaction(SIGRT_14, NULL, {sa_handler=SIG_DFL, sa_mask=[], sa_flags=0}, 8) = 0
rt_sigaction(SIGRT_14, {sa_handler=0x80979e0, sa_mask=~[], sa_flags=SA_RESTORER|SA_STACK|SA_RESTART|SA_SIGINFO, sa_restorer=0x8097a40}, NULL, 8) = 0
rt_sigaction(SIGRT_15, NULL, {sa_handler=SIG_DFL, sa_mask=[], sa_flags=0}, 8) = 0
rt_sigaction(SIGRT_15, {sa_handler=0x80979e0, sa_mask=~[], sa_flags=SA_RESTORER|SA_STACK|SA_RESTART|SA_SIGINFO, sa_restorer=0x8097a40}, NULL, 8) = 0
rt_sigaction(SIGRT_16, NULL, {sa_handler=SIG_DFL, sa_mask=[], sa_flags=0}, 8) = 0
rt_sigaction(SIGRT_16, {sa_handler=0x80979e0, sa_mask=~[], sa_flags=SA_RESTORER|SA_STACK|SA_RESTART|SA_SIGINFO, sa_restorer=0x8097a40}, NULL, 8) = 0
rt_sigaction(SIGRT_17, NULL, {sa_handler=SIG_DFL, sa_mask=[], sa_flags=0}, 8) = 0
rt_sigaction(SIGRT_17, {sa_handler=0x80979e0, sa_mask=~[], sa_flags=SA_RESTORER|SA_STACK|SA_RESTART|SA_SIGINFO, sa_restorer=0x8097a40}, NULL, 8) = 0
rt_sigaction(SIGRT_18, NULL, {sa_handler=SIG_DFL, sa_mask=[], sa_flags=0}, 8) = 0
rt_sigaction(SIGRT_18, {sa_handler=0x80979e0, sa_mask=~[], sa_flags=SA_RESTORER|SA_STACK|SA_RESTART|SA_SIGINFO, sa_restorer=0x8097a40}, NULL, 8) = 0
rt_sigaction(SIGRT_19, NULL, {sa_handler=SIG_DFL, sa_mask=[], sa_flags=0}, 8) = 0
rt_sigaction(SIGRT_19, {sa_handler=0x80979e0, sa_mask=~[], sa_flags=SA_RESTORER|SA_STACK|SA_RESTART|SA_SIGINFO, sa_restorer=0x8097a40}, NULL, 8) = 0
rt_sigaction(SIGRT_20, NULL, {sa_handler=SIG_DFL, sa_mask=[], sa_flags=0}, 8) = 0
rt_sigaction(SIGRT_20, {sa_handler=0x80979e0, sa_mask=~[], sa_flags=SA_RESTORER|SA_STACK|SA_RESTART|SA_SIGINFO, sa_restorer=0x8097a40}, NULL, 8) = 0
rt_sigaction(SIGRT_21, NULL, {sa_handler=SIG_DFL, sa_mask=[], sa_flags=0}, 8) = 0
rt_sigaction(SIGRT_21, {sa_handler=0x80979e0, sa_mask=~[], sa_flags=SA_RESTORER|SA_STACK|SA_RESTART|SA_SIGINFO, sa_restorer=0x8097a40}, NULL, 8) = 0
rt_sigaction(SIGRT_22, NULL, {sa_handler=SIG_DFL, sa_mask=[], sa_flags=0}, 8) = 0
rt_sigaction(SIGRT_22, {sa_handler=0x80979e0, sa_mask=~[], sa_flags=SA_RESTORER|SA_STACK|SA_RESTART|SA_SIGINFO, sa_restorer=0x8097a40}, NULL, 8) = 0
rt_sigaction(SIGRT_23, NULL, {sa_handler=SIG_DFL, sa_mask=[], sa_flags=0}, 8) = 0
rt_sigaction(SIGRT_23, {sa_handler=0x80979e0, sa_mask=~[], sa_flags=SA_RESTORER|SA_STACK|SA_RESTART|SA_SIGINFO, sa_restorer=0x8097a40}, NULL, 8) = 0
rt_sigaction(SIGRT_24, NULL, {sa_handler=SIG_DFL, sa_mask=[], sa_flags=0}, 8) = 0
rt_sigaction(SIGRT_24, {sa_handler=0x80979e0, sa_mask=~[], sa_flags=SA_RESTORER|SA_STACK|SA_RESTART|SA_SIGINFO, sa_restorer=0x8097a40}, NULL, 8) = 0
rt_sigaction(SIGRT_25, NULL, {sa_handler=SIG_DFL, sa_mask=[], sa_flags=0}, 8) = 0
rt_sigaction(SIGRT_25, {sa_handler=0x80979e0, sa_mask=~[], sa_flags=SA_RESTORER|SA_STACK|SA_RESTART|SA_SIGINFO, sa_restorer=0x8097a40}, NULL, 8) = 0
rt_sigaction(SIGRT_26, NULL, {sa_handler=SIG_DFL, sa_mask=[], sa_flags=0}, 8) = 0
rt_sigaction(SIGRT_26, {sa_handler=0x80979e0, sa_mask=~[], sa_flags=SA_RESTORER|SA_STACK|SA_RESTART|SA_SIGINFO, sa_restorer=0x8097a40}, NULL, 8) = 0
rt_sigaction(SIGRT_27, NULL, {sa_handler=SIG_DFL, sa_mask=[], sa_flags=0}, 8) = 0
rt_sigaction(SIGRT_27, {sa_handler=0x80979e0, sa_mask=~[], sa_flags=SA_RESTORER|SA_STACK|SA_RESTART|SA_SIGINFO, sa_restorer=0x8097a40}, NULL, 8) = 0
rt_sigaction(SIGRT_28, NULL, {sa_handler=SIG_DFL, sa_mask=[], sa_flags=0}, 8) = 0
rt_sigaction(SIGRT_28, {sa_handler=0x80979e0, sa_mask=~[], sa_flags=SA_RESTORER|SA_STACK|SA_RESTART|SA_SIGINFO, sa_restorer=0x8097a40}, NULL, 8) = 0
rt_sigaction(SIGRT_29, NULL, {sa_handler=SIG_DFL, sa_mask=[], sa_flags=0}, 8) = 0
rt_sigaction(SIGRT_29, {sa_handler=0x80979e0, sa_mask=~[], sa_flags=SA_RESTORER|SA_STACK|SA_RESTART|SA_SIGINFO, sa_restorer=0x8097a40}, NULL, 8) = 0
rt_sigaction(SIGRT_30, NULL, {sa_handler=SIG_DFL, sa_mask=[], sa_flags=0}, 8) = 0
rt_sigaction(SIGRT_30, {sa_handler=0x80979e0, sa_mask=~[], sa_flags=SA_RESTORER|SA_STACK|SA_RESTART|SA_SIGINFO, sa_restorer=0x8097a40}, NULL, 8) = 0
rt_sigaction(SIGRT_31, NULL, {sa_handler=SIG_DFL, sa_mask=[], sa_flags=0}, 8) = 0
rt_sigaction(SIGRT_31, {sa_handler=0x80979e0, sa_mask=~[], sa_flags=SA_RESTORER|SA_STACK|SA_RESTART|SA_SIGINFO, sa_restorer=0x8097a40}, NULL, 8) = 0
rt_sigaction(SIGRT_32, NULL, {sa_handler=SIG_DFL, sa_mask=[], sa_flags=0}, 8) = 0
rt_sigaction(SIGRT_32, {sa_handler=0x80979e0, sa_mask=~[], sa_flags=SA_RESTORER|SA_STACK|SA_RESTART|SA_SIGINFO, sa_restorer=0x8097a40}, NULL, 8) = 0
rt_sigprocmask(SIG_SETMASK, ~[], [], 8) = 0
clone(child_stack=0x9447ff0, flags=CLONE_VM|CLONE_FS|CLONE_FILES|CLONE_SIGHAND|CLONE_THREAD|CLONE_SYSVSEM) = 11699
rt_sigprocmask(SIG_SETMASK, [], NULL, 8) = 0
rt_sigprocmask(SIG_SETMASK, ~[], [], 8) = 0
clone(child_stack=0x9449ff0, flags=CLONE_VM|CLONE_FS|CLONE_FILES|CLONE_SIGHAND|CLONE_THREAD|CLONE_SYSVSEM) = 11700
rt_sigprocmask(SIG_SETMASK, [], NULL, 8) = 0
futex(0x94382ac, FUTEX_WAKE_PRIVATE, 1) = 1
sched_yield()                           = 0
futex(0x855aee0, FUTEX_WAKE_PRIVATE, 1) = 0
futex(0x8557c30, FUTEX_WAKE_PRIVATE, 1) = 1
rt_sigprocmask(SIG_SETMASK, ~[], [], 8) = 0
clone(child_stack=0x946dff0, flags=CLONE_VM|CLONE_FS|CLONE_FILES|CLONE_SIGHAND|CLONE_THREAD|CLONE_SYSVSEM) = 11703
rt_sigprocmask(SIG_SETMASK, [], NULL, 8) = 0
readlinkat(AT_FDCWD, "/proc/self/exe", "/home/isaac_witmer/Downloads/scr"..., 128) = 54
fcntl(0, F_GETFL)                       = 0 (flags O_RDONLY)
futex(0x943848c, FUTEX_WAKE_PRIVATE, 1) = 1
mmap2(NULL, 262144, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_ANONYMOUS, -1, 0) = 0xf76fd000
fcntl(1, F_GETFL)                       = 0x1 (flags O_WRONLY)
fcntl(2, F_GETFL)                       = 0x1 (flags O_WRONLY)
openat(AT_FDCWD, "scrapbee_backend.log", O_RDWR|O_CREAT|O_APPEND|O_LARGEFILE|O_CLOEXEC, 0666) = 4
epoll_create1(EPOLL_CLOEXEC)            = 5
epoll_ctl(5, EPOLL_CTL_ADD, 4, {EPOLLIN|EPOLLOUT|EPOLLRDHUP|EPOLLET, {u32=4151320512, u64=4151320512}}) = -1 EPERM (Operation not permitted)
epoll_ctl(5, EPOLL_CTL_DEL, 4, 0x94a6e9c) = -1 EPERM (Operation not permitted)
openat(AT_FDCWD, "/etc//localtime", O_RDONLY|O_LARGEFILE) = 6
read(6, "TZif2\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\5\0\0\0\5\0\0\0\0"..., 4096) = 3545
read(6, "", 4096)                       = 0
close(6)                                = 0
write(4, "2019/07/24 13:18:45 scrapbee_bac"..., 60) = 60
futex(0x94700cc, FUTEX_WAKE_PRIVATE, 1) = 1
futex(0x8559f74, FUTEX_WAIT_PRIVATE, 0, {tv_sec=0, tv_nsec=999949538}) = -1 ETIMEDOUT (Connection timed out)
futex(0x8557cc8, FUTEX_WAKE_PRIVATE, 1) = 1
futex(0x94700cc, FUTEX_WAKE_PRIVATE, 1) = 1
read(0, "L\0\0\0\"{\\\"addr\\\":\\\"127.0.0.1:9900\\"..., 4096) = 80
write(4, "2019/07/24 13:18:46 scrapbee_bac"..., 64) = 64
futex(0x94700cc, FUTEX_WAKE_PRIVATE, 1) = 1
futex(0x943848c, FUTEX_WAKE_PRIVATE, 1) = 1
futex(0x8559fb4, FUTEX_WAIT_PRIVATE, 0, {tv_sec=0, tv_nsec=999997281}) = -1 ETIMEDOUT (Connection timed out)
futex(0x8557cc8, FUTEX_WAKE_PRIVATE, 1) = 1
futex(0x8557c30, FUTEX_WAKE_PRIVATE, 1) = 1
futex(0x94700cc, FUTEX_WAKE_PRIVATE, 1) = 1
futex(0x94540cc, FUTEX_WAKE_PRIVATE, 1) = 1
futex(0x8559fb4, FUTEX_WAIT_PRIVATE, 0, {tv_sec=0, tv_nsec=999613474}) = -1 ETIMEDOUT (Connection timed out)
futex(0x8557cc8, FUTEX_WAKE_PRIVATE, 1) = 1
futex(0x8557c30, FUTEX_WAKE_PRIVATE, 1) = 1
futex(0x94700cc, FUTEX_WAKE_PRIVATE, 1) = 1
write(1, "q\0\0\0", 4)                  = 4
write(1, "{\"Version\":\"1.7.1\",\"Rdfloaded\":\""..., 113) = 113
write(4, "2019/07/24 13:18:48 scrapbee_bac"..., 60) = 60
futex(0x85580cc, FUTEX_WAIT_PRIVATE, 0, NULL

gryffcom commented 5 years ago

I am trying to install scrapbee. The log before the reload of Firefox:

[info] ScrapBee version = 1.8.4
[info] browser = Firefox 68.0.1
[info] platform = FreeBSD amd64
[info] start backend service on port 9900.
[error] backend disconnected
[info] show rdf list
[info] switch to rdf "/home/gryff/scrapbee.rdf"

after reload:

[info] ScrapBee version = 1.8.4
[info] browser = Firefox 68.0.1
[info] platform = FreeBSD amd64
[info] start backend service on port 9900.
[error] backend disconnected

And there is no file /home/gryff/scrapbee.rdf I have in ~/.mozilla/native-messaging-hosts -rw-r--r-- 1 gryff wheel 207 12 авг. 20:48 scrapbee_backend.json In ScrapBee side panel: Starting...

When try to connect to the old ScrapBook file it doesn't see it. When try to import the ScrapBook file have message about wrond format of the rdf file.

If I create scrapbee.rdf manually scrapbee doesn't see one. What should I do to start scrapbee successfully?

vctfence commented 5 years ago

Hi, @gryffcom

ScrapBee supports only Linux/Mac/Win for now, it's important to have a backend running on your platform, that's why you saw "backend disconnected", you can try to compile backend (wrote in golang) for your platform, such as:

env GOOS=freebsd GOARCH=386 go build -o scrapbee_backend_bsd -ldflags '-s -w' scrapbee_backend.go

you can find the backend source code here: https://github.com/vctfence/scrapbee_backend

And there is also a backend bin I just compiled for FreeBSD named scrapbee_backend_bsd, but this is not tested, you can try to download and rename it to be scrapbee_backend manually as a test.

gryffcom commented 5 years ago

Great! Backend works. Thank you very much! First of all I tried to test compiled scrapbee_backend. It didn't work. I compiled one from the source code successfully. But there is some problem:

[info] ScrapBee version = 1.8.4
[info] browser = Firefox 68.0.1
[info] platform = FreeBSD amd64
[info] start backend service on port 9900.
[info] backend service started, version = 1.7.1 (wanted >= 1.7.0)
[info] show rdf list
[info] switch to rdf "/home/gryff/scrapbee/scrapbee.rdf"
[error] An attempt was made to create or change an object in a way which is incorrect with regard to namespaces

I don't know how to resolve it...

vctfence commented 5 years ago

@gryffcom Did you create rdf file manually? Please don't, ScrapBee will create it (inform you in sidebar) when it find it does not exist. If this is your scene, just delete the rdf you created and restart firefox.

gryffcom commented 5 years ago

No I didn't create the rdf file manually. I said "yes" for the automatic creation. Although I deleted the current rdf file and after firefox restarting get the request for creation a new rdf file.

As result I have the same log file as was before. There are some additional information about my system. May be something will be useful. dir drwxr-xr-x 2 gryff wheel 3 14 авг. 09:35 scrapbee file

~ % ls -la scrapbee
total 38
drwxr-xr-x   2 gryff  wheel    3 16 авг. 09:39 .
drwxr-xr-x  51 gryff  wheel   89 16 авг. 09:32 ..
-rw-r--r--   1 gryff  wheel  225 16 авг. 09:39 scrapbee.rdf

automatically created file

<?xml version="1.0"?>
<RDF:RDF xmlns:NS1="scrapbee@163.com" xmlns:NC="http://home.netscape.com/NC-rdf#" xmlns:RDF="http://www.w3.org/1999/02/22-rdf-syntax-ns#">
<RDF:Seq RDF:about="urn:scrapbook:root"></RDF:Seq>
</RDF:RDF>

process 1405 gryff 9 20 0 792M 6788K uwait 0 0:00 0.00% scrapbee_backend

~ % env
SHELL=/usr/local/bin/zsh
DISPLAY=:0
LC_TIME=C
EDITOR=vim
HOME=/home/gryff
SSH_AGENT_PID=890
_=/usr/bin/env
BLOCKSIZE=K
SHLVL=2
LC_NUMERIC=POSIX
LANG=C
LOGNAME=gryff
TERM=xterm
PAGER=most
LC_CTYPE=ru_RU.KOI8-R
WINDOWPATH=9
MAIL=/var/spool/mail/gryff
LESS=-cex3M
XAUTHORITY=/home/gryff/.Xauthority
HELPDIR=/usr/local/lib/zsh/help
SSH_AUTH_SOCK=/tmp/ssh-lLwA2u0VshOK/agent.889
OLDPWD=/home/gryff
PWD=/home/gryff
USER=gryff
PATH=/sbin:/bin:/usr/sbin:/usr/bin:/usr/local/sbin:/usr/local/bin:/home/gryff/bin
LC_COLLATE=ru_RU.KOI8-R
LC_ALL=ru_RU.UTF-8

~ % uname -a
FreeBSD india 11.2-RELEASE-p13 FreeBSD 11.2-RELEASE-p13 #0: Tue Aug  6 06:41:33 UTC 2019     root@amd64-builder.daemonology.net:/usr/obj/usr/src/sys/GENERIC  amd64

vctfence commented 5 years ago

Hi ,can you try to request the rdf by: curl http://localhost:9900/file-service/home/gryff/scrapbee/scrapbee.rdf And see what returned? @gryffcom

gryffcom commented 5 years ago

hi, ~ % curl http://localhost:9900/file-service/home/gryff/scrapbee/scrapbee.rdf 404 page not found

vctfence commented 5 years ago

Hi, please change this line if runtime.GOOS == "linux" || runtime.GOOS == "darwin"{ to be if runtime.GOOS != "windows" { in the backend source code, and compile/test again.

gryffcom commented 5 years ago

Hi vctfence, thank you! I have found the ready freebsd source code with required changes and compiled one. It works!!! Later I'll do detailed tests. I tried to check my old scrapbook. But there is some problem. Scrapbee see only first folder and its content as root node and nothing more. My old scrapbook has a lot of folders without the root folder. I used Pale Moon as my main browser before. The support of Pale Moon in freebsd was stopped and I lost access to scrapbook through Pale Moon and can't reorganize folders and create the root folder. What should I do to see all my folders in scrapbook?

vctfence commented 5 years ago

Hi, ScrapBee supports ScrapBook's rdf, at least, this works for most of users, but there are maybe something special have not been noticed, my suggestion is to make a copy of your rdf as a test, reduce content of rdf little by little (you need to understand the structure of rdf) and test to see what causes the problem. another way is compare your rdf with ScrapBee created rdf to see what's the difference. By the way, please notice on the log to see if there are errors reported.

Or, if you provide the rdf (can be minimized) I'll check for you.

gryffcom commented 5 years ago

Hi, My rdf file has the size 48 MB and I see only one the first big folder from scrapbook:root. When I change the order of folders I can see some other top smaller folders with its subfolders.

<RDF:Seq RDF:about="urn:scrapbook:root">
    <RDF:li RDF:resource="urn:scrapbook:item20101001091300"/>
    <RDF:li RDF:resource="urn:scrapbook:item20060727174508"/>
    <RDF:li RDF:resource="urn:scrapbook:item20070818162624"/>
    <RDF:li RDF:resource="urn:scrapbook:item20061203133808"/>
    <RDF:li RDF:resource="urn:scrapbook:item20080411141606"/>
    <RDF:li RDF:resource="urn:scrapbook:item20091217084118"/>
    <RDF:li RDF:resource="urn:scrapbook:item20070316064952"/>
    <RDF:li RDF:resource="urn:scrapbook:item20070131185129"/>
    <RDF:li RDF:resource="urn:scrapbook:item20071119193620"/>
    <RDF:li RDF:resource="urn:scrapbook:item20090906134253"/>
    <RDF:li RDF:resource="urn:scrapbook:item20090116091221"/>
    <RDF:li RDF:resource="urn:scrapbook:item20060928220622"/>
    <RDF:li RDF:resource="urn:scrapbook:item20141226205940"/>
    <RDF:li RDF:resource="urn:scrapbook:item20070830064213"/>
    <RDF:li RDF:resource="urn:scrapbook:item20060706223349"/>
    <RDF:li RDF:resource="urn:scrapbook:item20090413110922"/>
    <RDF:li RDF:resource="urn:scrapbook:item20151124214424"/>
    <RDF:li RDF:resource="urn:scrapbook:item20090202125527"/>
    <RDF:li RDF:resource="urn:scrapbook:item20080330183853"/>
    <RDF:li RDF:resource="urn:scrapbook:item20070627120314"/>
    <RDF:li RDF:resource="urn:scrapbook:item20080220185835"/>
    <RDF:li RDF:resource="urn:scrapbook:item20071113070737"/>
    <RDF:li RDF:resource="urn:scrapbook:item20170707111348"/>
    <RDF:li RDF:resource="urn:scrapbook:item20070217182501"/>
    <RDF:li RDF:resource="urn:scrapbook:item20100304171237"/>
    <RDF:li RDF:resource="urn:scrapbook:item20160428084321"/>
    <RDF:li RDF:resource="urn:scrapbook:item20180105191027"/>
    <RDF:li RDF:resource="urn:scrapbook:item20070517185433"/>
    <RDF:li RDF:resource="urn:scrapbook:item20060727175520"/>
    <RDF:li RDF:resource="urn:scrapbook:item20121202182433"/>
    <RDF:li RDF:resource="urn:scrapbook:item20090709092734"/>
    <RDF:li RDF:resource="urn:scrapbook:item20190309210321"/>
    <RDF:li RDF:resource="urn:scrapbook:item20190605181436"/>
  </RDF:Seq>

The link to the complete rdf file: https://1drv.ms/u/s!AsppYmrYVHPSgh-XezBCxjz-mYgo

vctfence commented 5 years ago

Hi, I downloaded and tested you 48M rdf file, and I have one good and one bad news.

The good one is it works for me, I see 20+ subfolders of the root, and lots of subfolders deeper. The bad one is it's really hard to know what happend to you now.

It takes really longer loading this file(for me, 5-6 seconds), it may takes more time or fails for you if it meets some kind of limitation of your box.

Any suggestions? Yes, you can uninstall ScrapBee and load ScrapBee from source code (download here) in about:debugging, and you can find more debug info by enable debug and click on debug button. There are maybe infomation valuable showed.

gryffcom commented 5 years ago

Hi vctfence, There is no link (download here). Or I need to get the same source that I got before? If so what way can I find about:debugging? May be require to do something with golang? Do I need to read and learn something special?

vctfence commented 5 years ago

Hi, it's not backend, but addon source code here, you can clone or download the repo as a zip package. When you are done, enter about:debugging into address bar of firefox to show debug tool, load addon from source code there.

aaa

gryffcom commented 5 years ago

hi vctfence, I made all as you said and started with debugging. And understand I need to look the last record when scrapbee stops. The last record was corrupted. I removed its RDF:Description block and seen some other folders. Totally I removed three bad blocks and got all my folders. The main problem has been resolved. I have some fewer lacks but its don't disturb me. Old scrapbook I'll use like reference only. For all new records I will use scrapbee. Thank you very much for your real help and friendly support!

vctfence commented 5 years ago

Hi gryffcom, glad to know it "partly" works for you, please feel free to discuss if you find more about this.

vctfence / scrapbee

Can't initialize rdf file #20