search

openlink / virtuoso-opensource

Virtuoso is a high-performance and scalable Multi-Model RDBMS, Data Integration Middleware, Linked Data Deployment, and HTTP Application Server Platform
https://vos.openlinksw.com
Other
863 stars 210 forks source link

Error S2801: [Virtuoso Driver]CL033: Connect failed to 1111 = 1111 #891

Open donttal opened 4 years ago

donttal commented 4 years ago

I execute the following command to run virtuoso

virtuoso-t +foreground +configfile /public/home/lihongjing/kbqa-ar-smcnn/freebase_data/dump_virtuoso_data/virtuoso.ini &

output:

[root@node10 database]# virtuoso-t +foreground +configfile /public/home/lihongjing/kbqa-ar-smcnn/freebase_data/dump_virtuoso_data/virtuoso.ini &
[1] 159232
[root@node10 database]# 
        Fri Jan 03 2020
17:09:13 { Loading plugin 1: Type `plain', file `wikiv' in `../hosting'
17:09:13   WikiV version 0.6 from OpenLink Software
17:09:13   Support functions for WikiV collaboration tool
17:09:13   SUCCESS plugin 1: loaded from ../hosting/wikiv.so }
17:09:13 { Loading plugin 2: Type `plain', file `mediawiki' in `../hosting'
17:09:13   MediaWiki version 0.1 from OpenLink Software
17:09:13   Support functions for MediaWiki collaboration tool
17:09:13   SUCCESS plugin 2: loaded from ../hosting/mediawiki.so }
17:09:13 { Loading plugin 3: Type `plain', file `creolewiki' in `../hosting'
17:09:13   CreoleWiki version 0.1 from OpenLink Software
17:09:13   Support functions for CreoleWiki collaboration tool
17:09:13   SUCCESS plugin 3: loaded from ../hosting/creolewiki.so }
17:09:13 { Loading plugin 4: Type `plain', file `im' in `../hosting'
17:09:13   IM version 0.62 from OpenLink Software
17:09:13   Support functions for Image Magick 6.9.9
17:09:13   SUCCESS plugin 4: loaded from ../hosting/im.so }
17:09:13 OpenLink Virtuoso Universal Server
17:09:13 Version 07.20.3229-pthreads for Linux as of Dec 30 2019
17:09:13 uses parts of OpenSSL, PCRE, Html Tidy
17:09:13 SQL Optimizer enabled (max 1000 layouts)
17:09:13 Compiler unit is timed at 0.000373 msec
17:09:17 Checkpoint started
17:09:17 Roll forward started
17:09:17 Roll forward complete
17:09:17 Checkpoint started
17:09:17 Checkpoint finished, log reused
17:09:17 Checkpoint started
17:09:17 Checkpoint finished, log reused
17:09:25 Checkpoint started
17:09:25 Checkpoint finished, log reused
17:09:28 Checkpoint started
17:09:28 Checkpoint finished, log reused
17:09:28 Checkpoint started
17:09:28 Checkpoint finished, log reused
17:09:28 PL LOG: Installing Virtuoso Conductor version 1.00.8783 (DAV)
17:09:28 PL LOG: Installing with dependencies Virtuoso Conductor version 1.00.8783/2018-08-15 20:02 (DAV)
17:09:28 Checkpoint started
17:09:28 Checkpoint finished, log reused
17:09:32 Checkpoint started
17:09:32 Checkpoint finished, log reused
17:09:32 PL LOG: Installation with dependencies complete
17:09:32 Checkpoint started
17:09:32 Checkpoint finished, log reused
17:09:32 HTTP/WebDAV server online at 8890
17:09:32 Server online at 1111 (pid 159232)

I think virtuoso has run successfully But when I execute the following script

echo "\n\nload data into knowledge base...\n"
# isql-vt 1111 dba dba exec="ld_dir_all('`pwd`/dump_virtuoso_data', '*', 'fb2m:');"
isql 1111 dba dba exec="ld_dir_all('`pwd`/dump_virtuoso_data', '*', 'fb2m:');"
pids=()
for i in `seq 1 4`; do
    isql 1111 dba dba exec="rdf_loader_run();" &
    pids+=($!)
done
for pid in ${pids[@]}; do
    wait $pid
done

output:

(base) [lihongjing@master kbqa-ar-smcnn]$ ./data_setup.sh 
\n\nload data into knowledge base...\n
OpenLink Virtuoso Interactive SQL (Virtuoso)
Version 07.20.3229 as of Aug 15 2018
Type HELP; for help and EXIT; to exit.

*** Error S2801: [Virtuoso Driver]CL033: Connect failed to 1111 = 1111.
at line 0 of Top-Level:

OpenLink Virtuoso Interactive SQL (Virtuoso)
Version 07.20.3229 as of Aug 15 2018
Type HELP; for help and EXIT; to exit.

*** Error S2801: [Virtuoso Driver]CL033: Connect failed to 1111 = 1111.
at line 0 of Top-Level:

OpenLink Virtuoso Interactive SQL (Virtuoso)
Version 07.20.3229 as of Aug 15 2018
Type HELP; for help and EXIT; to exit.

*** Error S2801: [Virtuoso Driver]CL033: Connect failed to 1111 = 1111.
at line 0 of Top-Level:

OpenLink Virtuoso Interactive SQL (Virtuoso)
Version 07.20.3229 as of Aug 15 2018
Type HELP; for help and EXIT; to exit.

*** Error S2801: [Virtuoso Driver]CL033: Connect failed to 1111 = 1111.
at line 0 of Top-Level:

OpenLink Virtuoso Interactive SQL (Virtuoso)
Version 07.20.3229 as of Aug 15 2018
Type HELP; for help and EXIT; to exit.

*** Error S2801: [Virtuoso Driver]CL033: Connect failed to 1111 = 1111.
at line 0 of Top-Level:

\n\nDONE!
HughWilliams commented 4 years ago

The log indicates the Virtuoso server did start successfully, but the question is whether it is actually still running at the point your script is run?

Does the following command list a virtuoso-t process running on the machine?

ps -ef | grep virtuoso-t

If it does, then can you make a basic connection to the Virtuoso server with the next command?

isql-vt 1111 dba dba

If it does connect, then run status(); command, and provide its output...

HughWilliams commented 4 years ago

Note also you don't have to use the & command to run the Virtuoso server as a background process, just remove the +foreground option ie

virtuoso-t +configfile /public/home/lihongjing/kbqa-ar-smcnn/freebase_data/dump_virtuoso_data/virtuoso.ini
donttal commented 4 years ago

The log indicates the Virtuoso server did start successfully, but the question is whether it is actually still run at the point your script is run ?

Does the following command list a virtuoso-t process running on the machine:

ps -ef | grep virtuoso-t

If it does then can you make a basic connection to the Virtuoso server with the command:

isql-vt 1111 dba dba

and if it does connect then run status(); command and prove the output of running it ...

If I execute isql-vt directly, it will show that there is no such command. I checked the relevant settings, and changed the isql in virtuoso-opensource/bin to isql-vt. Is this correct?

HughWilliams commented 4 years ago

Ah, I missed the isql-vt was commented out in the script, so just use isql if that is what is in your PATH ...

donttal commented 4 years ago

The log indicates the Virtuoso server did start successfully, but the question is whether it is actually still run at the point your script is run ?

Does the following command list a virtuoso-t process running on the machine:

ps -ef | grep virtuoso-t

If it does then can you make a basic connection to the Virtuoso server with the command:

isql-vt 1111 dba dba

and if it does connect then run status(); command and prove the output of running it ...

I run this command but there is no relevant output. I can't determine what caused the failure to open it.

virtuoso-t +configfile /public/home/lihongjing/kbqa-ar-smcnn/freebase_data/dump_virtuoso_data/virtuoso.ini

Output:

(base) [lihongjing@node10 ~]$ cd virtuoso-opensource/
(base) [lihongjing@node10 virtuoso-opensource]$ cd database/
(base) [lihongjing@node10 database]$ virtuoso-t +configfile /public/home/lihongjing/kbqa-ar-smcnn/freebase_data/dump_virtuoso_data/virtuoso.ini
(base) [lihongjing@node10 database]$ ps -ef | grep virtuoso-t
lihongj+ 354255 354080  0 09:43 pts/0    00:00:00 grep --color=auto virtuoso-t
(base) [lihongjing@node10 database]$ isql 1111 dba dba
OpenLink Virtuoso Interactive SQL (Virtuoso)
Version 07.20.3229 as of Aug 15 2018
Type HELP; for help and EXIT; to exit.

*** Error S2801: [Virtuoso Driver]CL033: Connect failed to 1111 = 1111.
at line 0 of Top-Level:
HughWilliams commented 4 years ago

I would suggest starting Virtuoso in foreground debug mode as you were doing previously to see if it might be shutting down post start for some reason, with the command:

virtuoso-t  -fd +configfile /public/home/lihongjing/kbqa-ar-smcnn/freebase_data/dump_virtuoso_data/virtuoso.ini

If the virtuoso server shuts down for any reason the cause should be written to the screen it is running in and return to the command prompt. If not then you should be able to make the isql 1111 dba dba connection to the server ...

donttal commented 4 years ago

virtuoso-t -fd +configfile /public/home/lihongjing/kbqa-ar-smcnn/freebase_data/dump_virtuoso_data/virtuoso.ini

here is the reason, how can i deal with it

Mon Jan 06 2020
11:48:59 INFO: { Loading plugin 1: Type `plain', file `wikiv' in `../hosting'
11:48:59 INFO:   WikiV version 0.6 from OpenLink Software
11:48:59 INFO:   Support functions for WikiV collaboration tool
11:48:59 INFO:   SUCCESS plugin 1: loaded from ../hosting/wikiv.so }
11:48:59 INFO: { Loading plugin 2: Type `plain', file `mediawiki' in `../hosting'
11:48:59 INFO:   MediaWiki version 0.1 from OpenLink Software
11:48:59 INFO:   Support functions for MediaWiki collaboration tool
11:48:59 INFO:   SUCCESS plugin 2: loaded from ../hosting/mediawiki.so }
11:48:59 INFO: { Loading plugin 3: Type `plain', file `creolewiki' in `../hosting'
11:48:59 INFO:   CreoleWiki version 0.1 from OpenLink Software
11:48:59 INFO:   Support functions for CreoleWiki collaboration tool
11:48:59 INFO:   SUCCESS plugin 3: loaded from ../hosting/creolewiki.so }
11:48:59 INFO: { Loading plugin 4: Type `plain', file `im' in `../hosting'
11:48:59 INFO:   IM version 0.62 from OpenLink Software
11:48:59 INFO:   Support functions for Image Magick 6.9.9
11:48:59 INFO:   SUCCESS plugin 4: loaded from ../hosting/im.so }
11:48:59 INFO: OpenLink Virtuoso Universal Server
11:48:59 INFO: Version 07.20.3229-pthreads for Linux as of Aug 15 2018
11:48:59 INFO: uses parts of OpenSSL, PCRE, Html Tidy
11:48:59 ERROR: Cannot open stripe on ../database/virtuoso.db (13)
11:48:59 INFO: Server exiting
imitko commented 4 years ago

Please check the file/directory permissions, because OS error code 13 is Permission denied.

HTH

HughWilliams commented 4 years ago

You should run Virtuoso as the same user as you were successfully running it as before, and/or check the permissions on the /public/home/lihongjing/kbqa-ar-smcnn/freebase_data/dump_virtuoso_data/vrtuoso.db file , assuming that is the virtuoso.db file your virtuoso.ini file references, to ensure that the user you are running Virtuoso as has read/write permission to run the database from that location ...

donttal commented 4 years ago

You should run Virtuoso as the same user as you were successfully running it as before, and/or check the permissions on the /public/home/lihongjing/kbqa-ar-smcnn/freebase_data/dump_virtuoso_data/vrtuoso.db file , assuming that is the virtuoso.db file your virtuoso.ini file references, to ensure that the user you are running Virtuoso as has read/write permission to run the database from that location ...

ok，this time I run test.sh as root here is content

cd /public/home/lihongjing/virtuoso-opensource/database
virtuoso-t -fd +configfile /public/home/lihongjing/kbqa-ar-smcnn/freebase_data/dump_virtuoso_data/virtuoso.ini
isql 1111 dba dba

output:

[root@master ~]# sh test.sh 

        Tue Jan 07 2020
20:57:09 INFO: { Loading plugin 1: Type `plain', file `wikiv' in `../hosting'
20:57:09 INFO:   WikiV version 0.6 from OpenLink Software
20:57:09 INFO:   Support functions for WikiV collaboration tool
20:57:09 ERROR:   FAILED  plugin 1: Loaded plugin requires core functionality not provided by main application }
20:57:09 INFO: { Loading plugin 2: Type `plain', file `mediawiki' in `../hosting'
20:57:09 INFO:   MediaWiki version 0.1 from OpenLink Software
20:57:09 INFO:   Support functions for MediaWiki collaboration tool
20:57:09 ERROR:   FAILED  plugin 2: Loaded plugin requires core functionality not provided by main application }
20:57:09 INFO: { Loading plugin 3: Type `plain', file `creolewiki' in `../hosting'
20:57:09 INFO:   CreoleWiki version 0.1 from OpenLink Software
20:57:09 INFO:   Support functions for CreoleWiki collaboration tool
20:57:09 ERROR:   FAILED  plugin 3: Loaded plugin requires core functionality not provided by main application }
20:57:09 INFO: { Loading plugin 4: Type `plain', file `im' in `../hosting'
20:57:09 INFO:   IM version 0.62 from OpenLink Software
20:57:09 INFO:   Support functions for Image Magick 6.9.9
20:57:09 ERROR:   FAILED  plugin 4: Loaded plugin requires core functionality not provided by main application }
20:57:09 INFO: OpenLink Virtuoso Universal Server
20:57:09 INFO: Version 06.01.3127-pthreads for Linux as of Jun  9 2014
20:57:09 INFO: uses parts of OpenSSL, PCRE, Html Tidy
20:57:09 INFO: Database version 3126
20:57:09 INFO: SQL Optimizer enabled (max 1000 layouts)
20:57:10 INFO: Compiler unit is timed at 0.000651 msec
20:57:11 INFO: virtuoso-t() [0x7a77cd]
20:57:11 INFO: virtuoso-t() [0x7a7848]
20:57:11 INFO: virtuoso-t() [0x461352]
20:57:11 INFO: virtuoso-t() [0x42a188]
20:57:11 INFO: virtuoso-t() [0x43b69d]
20:57:11 INFO: virtuoso-t() [0x43d156]
20:57:11 INFO: virtuoso-t() [0x4a65d2]
20:57:11 INFO: virtuoso-t() [0x4a6b29]
20:57:11 INFO: virtuoso-t() [0x4ee1fe]
20:57:11 INFO: virtuoso-t() [0x4f3d39]
20:57:11 INFO: virtuoso-t() [0x4f4d96]
20:57:11 INFO: virtuoso-t() [0x5060e5]
20:57:11 INFO: virtuoso-t() [0x506d5b]
20:57:11 INFO: virtuoso-t() [0x503426]
20:57:11 INFO: virtuoso-t() [0x503962]
20:57:11 INFO: virtuoso-t() [0x503b9e]
20:57:11 INFO: virtuoso-t() [0x5047fd]
20:57:11 INFO: virtuoso-t() [0x509234]
20:57:11 INFO: virtuoso-t() [0x509bed]
20:57:11 INFO: virtuoso-t() [0x50a8f6]
20:57:11 INFO: virtuoso-t() [0x4e83d1]
20:57:11 INFO: virtuoso-t() [0x4e9d72]
20:57:11 INFO: virtuoso-t() [0x59cfc7]
20:57:11 INFO: virtuoso-t() [0x59f3c5]
20:57:11 INFO: virtuoso-t() [0x59fe85]
20:57:11 INFO: virtuoso-t() [0x59c2fe]
20:57:11 INFO: virtuoso-t() [0x554518]
20:57:11 INFO: virtuoso-t() [0x40ed7b]
20:57:11 INFO: /lib64/libc.so.6(__libc_start_main+0xf5) [0x7f812582a445]
20:57:11 INFO: virtuoso-t() [0x40f325]
20:57:11 ERROR: GPF: insert.c:170 zero len on page, gap marker missing
GPF: insert.c:170 zero len on page, gap marker missing
test.sh: line 9:  7888 Segmentation fault      (core dumped) virtuoso-t -fd +configfile /public/home/lihongjing/kbqa-ar-smcnn/freebase_data/dump_virtuoso_data/virtuoso.ini
[ISQL]ERROR: Could not SQLConnect
[root@master ~]#
TallTed commented 4 years ago

There is apparently more than one virtuoso-t binary on this machine. The latest test launched an old version 6.1 binary --

20:57:09 INFO: Version 06.01.3127-pthreads for Linux as of Jun  9 2014

For best results, I suggest that the old Virtuoso (likely installed with the package manager) be entirely removed, and a fresh download of the latest Virtuoso 7 build, with all the latest VADs, be (manually) put in its place.

donttal commented 4 years ago

There is apparently more than one virtuoso-t binary on this machine. The latest test launched an old version 6.1 binary --

20:57:09 INFO: Version 06.01.3127-pthreads for Linux as of Jun  9 2014

For best results, I suggest that the old Virtuoso (likely installed with the package manager) be entirely removed, and a fresh download of the latest Virtuoso 7 build, with all the latest VADs, be (manually) put in its place.

I previously showed on #890 that I have successfully installed, why is it failing now?

Or the centos system can be installed as the homepage says link

TallTed commented 4 years ago

Linux package installs are often outdated, for various reasons. I do not know the exact version now installed by either yum (on CentOS) or apt (on Ubuntu), but when last I checked (roughly mid-2019), both of these were still delivering a very old version 6.x.

I cannot say with any certainty why the version 7 binary you had working in #890 did not launch for this test, nor can I say why that version 7 binary launched properly in #890. There are many variables in play, including

Given all this, I would suggest that all trace of Virtuoso -- both what was installed via apt/yum, and what was installed manually -- be removed. Then, start afresh, avoiding apt/yum, and see how things go with either a manual build from source, or a manual installation of pre-built binaries.

donttal commented 4 years ago

Linux package installs are often outdated, for various reasons. I do not know the exact version now installed by either yum (on CentOS) or apt (on Ubuntu), but when last I checked (roughly mid-2019), both of these were still delivering a very old version 6.x.

I cannot say with any certainty why the version 7 binary you had working in #890 did not launch for this test, nor can I say why that version 7 binary launched properly in #890. There are many variables in play, including

  • the user that tries to start Virtuoso
  • the environment settings for the active login session at launch time
  • the script(s) that are run from session start to Virtuoso launch -- including any that are not directly related to Virtuoso!

Given all this, I would suggest that all trace of Virtuoso -- both what was installed via apt/yum, and what was installed manually -- be removed. Then, start afresh, avoiding apt/yum, and see how things go with either a manual build from source, or a manual installation of pre-built binaries.

Thank you for your suggestion, I am currently running isql 1111 dba dba can connect, but when I execute the following command, I still get an error, what is the reason?

isql 1111 dba dba exec="ld_dir_all('`pwd`/dump_virtuoso_data', '*', 'fb2m:');"
pids=()
for i in `seq 1 4`; do
    isql 1111 dba dba exec="rdf_loader_run();" &
    pids+=($!)
done
for pid in ${pids[@]}; do
    wait $pid
done

output

(base) [lihj@localhost kbqa-ar-smcnn]$ ./data_setup.sh 
\n\nload data into knowledge base...\n
OpenLink Virtuoso Interactive SQL (Virtuoso)
Version 07.20.3229 as of Aug 15 2018
Type HELP; for help and EXIT; to exit.
Connected to OpenLink Virtuoso
Driver: 07.20.3229 OpenLink Virtuoso ODBC Driver

*** Error 42000: [Virtuoso Driver][Virtuoso Server]FA003: Access to '/home/lihj/kbqa-ar-smcnn/dump_virtuoso_data' is denied due to access control in ini file
at line 0 of Top-Level:
ld_dir_all('/home/lihj/kbqa-ar-smcnn/dump_virtuoso_data', '*', 'fb2m:')
OpenLink Virtuoso Interactive SQL (Virtuoso)
Version 07.20.3229 as of Aug 15 2018
Type HELP; for help and EXIT; to exit.
OpenLink Virtuoso Interactive SQL (Virtuoso)
Version 07.20.3229 as of Aug 15 2018
Type HELP; for help and EXIT; to exit.
OpenLink Virtuoso Interactive SQL (Virtuoso)
Version 07.20.3229 as of Aug 15 2018
OpenLink Virtuoso Interactive SQL (Virtuoso)
Type HELP; for help and EXIT; to exit.
Version 07.20.3229 as of Aug 15 2018
Type HELP; for help and EXIT; to exit.
Connected to OpenLink Virtuoso
Driver: 07.20.3229 OpenLink Virtuoso ODBC Driver
Connected to OpenLink Virtuoso
Driver: 07.20.3229 OpenLink Virtuoso ODBC Driver
Connected to OpenLink Virtuoso
Connected to OpenLink Virtuoso
Driver: 07.20.3229 OpenLink Virtuoso ODBC Driver
Driver: 07.20.3229 OpenLink Virtuoso ODBC Driver

Done. -- 1 msec.

Done. -- 0 msec.

Done. -- 1 msec.

Done. -- 40 msec.
\n\nDONE!
(base) [lihj@localhost kbqa-ar-smcnn]$
timhaynesopenlink commented 4 years ago

Hi,

On Thu, 9 Jan 2020 at 15:14, casper notifications@github.com wrote: [...]

*** Error 42000: [Virtuoso Driver][Virtuoso Server]FA003: Access to '/home/lihj/kbqa-ar-smcnn/dump_virtuoso_data' is denied due to access control in ini file

at line 0 of Top-Level: ld_dir_all('/home/lihj/kbqa-ar-smcnn/dump_virtuoso_data', '*', 'fb2m:'

[...]

Pleasantly easy: in your virtuoso.ini file there is a `DirsAllowed' directive. Any directories virtuoso is required to access need to be listed in there.

HTH,

~Tim -- Tim Haynes Product Development Consultant OpenLink Software http://www.openlinksw.com/ http://twitter.com/openlink

donttal commented 4 years ago

[...] Pleasantly easy: in your virtuoso.ini file there is a `DirsAllowed' directive. Any directories virtuoso is required to access need to be listed in there.

HTH,

~Tim -- Tim Haynes Product Development Consultant OpenLink Software http://www.openlinksw.com/ http://twitter.com/openlink

I know that and I have set it up before

SchedulerInterval               = 10
DirsAllowed                     = ., ../vad, /home/lihj/kbqa-ar-smcnn/freebase_data/dump_virtuoso_data
ThreadCleanupInterval           = 0
TallTed commented 4 years ago

The directory you're currently trying to load from --

/home/lihj/kbqa-ar-smcnn/dump_virtuoso_data

-- is not the same as the directory in the INI value --

/home/lihj/kbqa-ar-smcnn/freebase_data/dump_virtuoso_data
donttal commented 4 years ago

The directory you're currently trying to load from --

/home/lihj/kbqa-ar-smcnn/dump_virtuoso_data

-- is not the same as the directory in the INI value --

/home/lihj/kbqa-ar-smcnn/freebase_data/dump_virtuoso_data

This is so strange, my ini file settings are not consistent with what source want to load this is the datat I want to load

(base) [lihj@localhost dump_virtuoso_data]$ pwd
/home/lihj/kbqa-ar-smcnn/freebase_data/dump_virtuoso_data
(base) [lihj@localhost dump_virtuoso_data]$ ls -lh
总用量 1.2G
-rw-rw-r--. 1 lihj lihj 883M 1月   9 22:18 FB2M.core.txt
-rw-rw-r--. 1 lihj lihj 323M 1月   9 21:48 FB5M.name.txt
-rw-rw-r--. 1 lihj lihj 6.9K 1月   9 22:47 virtuoso.ini
(base) [lihj@localhost dump_virtuoso_data]$

Then I run as like

(base) [lihj@localhost database]$ pwd
/home/lihj/virtuoso-opensource/database
(base) [lihj@localhost database]$ ls -lh
总用量 69M
-rw-r--r--. 1 lihj lihj  66M 1月  10 10:31 virtuoso.db
-rwxrwxrwx. 1 lihj lihj 6.9K 1月   9 22:27 virtuoso.ini
-rwxrwxrwx. 1 lihj lihj 6.9K 1月   3 16:22 virtuoso.ini.sample
-rw-r--r--. 1 lihj lihj   16 1月   9 11:31 virtuoso.lck
-rw-r--r--. 1 lihj lihj 8.3K 1月  10 10:31 virtuoso.log
-rw-r--r--. 1 lihj lihj    0 1月   9 11:24 virtuoso.pxa
-rw-r--r--. 1 lihj lihj 2.0M 1月   9 11:31 virtuoso-temp.db
-rw-r--r--. 1 lihj lihj 2.3K 1月  10 10:43 virtuoso.trx
(base) [lihj@localhost database]$ virtuoso-t

Both virtuoso.ini are the same file

TallTed commented 4 years ago

First thing, delete this extraneous file, as it will cause confusion over time --

/home/lihj/kbqa-ar-smcnn/freebase_data/dump_virtuoso_data/virtuoso.ini

Your data loading script includes this line --

isql 1111 dba dba exec="ld_dir_all('`pwd`/dump_virtuoso_data', '*', 'fb2m:');"

Note that pwd will be interpreted based on where you are when you call this script -- which you clearly intended to be /home/lihj/kbqa-ar-smcnn/freebase_data. However, based on the error you got, you were actually in /home/lihj/kbqa-ar-smcnn/.

I would suggest that you change your script, making this dynamically interpreted line --

isql 1111 dba dba exec="ld_dir_all('`pwd`/dump_virtuoso_data', '*', 'fb2m:');"

-- into this hardcorded line --

isql 1111 dba dba exec="ld_dir_all('/home/lihj/kbqa-ar-smcnn/freebase_data/dump_virtuoso_data', '*', 'fb2m:');"
donttal commented 4 years ago

First thing, delete this extraneous file, as it will cause confusion over time --

/home/lihj/kbqa-ar-smcnn/freebase_data/dump_virtuoso_data/virtuoso.ini

Your data loading script includes this line --

isql 1111 dba dba exec="ld_dir_all('`pwd`/dump_virtuoso_data', '*', 'fb2m:');"

Note that pwd will be interpreted based on where you are when you call this script -- which you clearly intended to be /home/lihj/kbqa-ar-smcnn/freebase_data. However, based on the error you got, you were actually in /home/lihj/kbqa-ar-smcnn/.

I would suggest that you change your script, making this dynamically interpreted line --

isql 1111 dba dba exec="ld_dir_all('`pwd`/dump_virtuoso_data', '*', 'fb2m:');"

-- into this hardcorded line --

isql 1111 dba dba exec="ld_dir_all('/home/lihj/kbqa-ar-smcnn/freebase_data/dump_virtuoso_data', '*', 'fb2m:');"

Ok, I fix this error, but when I run the same command. It still show 

*** Error 42000: [Virtuoso Driver][Virtuoso Server]FA003: Access to '/home/lihj/kbqa-ar-smcnn/freebase_data/dump_virtuoso_data' is denied due to access control in ini file
at line 0 of Top-Level:

here is verbose output

(base) [lihj@localhost kbqa-ar-smcnn]$ ps -aux | grep virtuoso
lihj      70544  0.0  0.0 112724   996 pts/4    S+   15:41   0:00 grep --color=auto virtuoso
lihj     122376  0.0  0.0 1699172 185428 ?      Ssl  1月09   0:51 virtuoso-t
(base) [lihj@localhost kbqa-ar-smcnn]$ ./data_setup.sh 
\n\nload data into knowledge base...\n
OpenLink Virtuoso Interactive SQL (Virtuoso)
Version 07.20.3229 as of Aug 15 2018
Type HELP; for help and EXIT; to exit.
Connected to OpenLink Virtuoso
Driver: 07.20.3229 OpenLink Virtuoso ODBC Driver

*** Error 42000: [Virtuoso Driver][Virtuoso Server]FA003: Access to '/home/lihj/kbqa-ar-smcnn/freebase_data/dump_virtuoso_data' is denied due to access control in ini file
at line 0 of Top-Level:
ld_dir_all('/home/lihj/kbqa-ar-smcnn/freebase_data/dump_virtuoso_data', '*', 'fb2m:')
OpenLink Virtuoso Interactive SQL (Virtuoso)
Version 07.20.3229 as of Aug 15 2018
Type HELP; for help and EXIT; to exit.
OpenLink Virtuoso Interactive SQL (Virtuoso)
Version 07.20.3229 as of Aug 15 2018
Type HELP; for help and EXIT; to exit.
Connected to OpenLink Virtuoso
Driver: 07.20.3229 OpenLink Virtuoso ODBC Driver
Connected to OpenLink Virtuoso
Driver: 07.20.3229 OpenLink Virtuoso ODBC Driver
OpenLink Virtuoso Interactive SQL (Virtuoso)
Version 07.20.3229 as of Aug 15 2018
Type HELP; for help and EXIT; to exit.
Connected to OpenLink Virtuoso
Driver: 07.20.3229 OpenLink Virtuoso ODBC Driver
OpenLink Virtuoso Interactive SQL (Virtuoso)
Version 07.20.3229 as of Aug 15 2018
Type HELP; for help and EXIT; to exit.
Connected to OpenLink Virtuoso
Driver: 07.20.3229 OpenLink Virtuoso ODBC Driver

Done. -- 1 msec.

Done. -- 0 msec.

Done. -- 1 msec.

Done. -- 1 msec.
\n\nDONE!
(base) [lihj@localhost kbqa-ar-smcnn]$
TallTed commented 4 years ago

Unfortunately, verbose isql output doesn't show us everything that's happening in the server instance, and that's where the error is being triggered.

We definitely need to see the virtuoso.log corresponding to the script run above (starting with the virtuoso-t instance launch), and may need you to restart the instance with +foreground +debug to get the most detail possible when you re-attempt the load with the script as above.

I am wondering if there may be an error in the virtuoso.ini file that we've not seen, because you've only provided small snippets. Therefore, please attach the whole file to this issue (not as textual copy-paste, but as a file).

Also, at this phase in troubleshooting, it may make sense to run the commands from the script manually -- so you can stop at the first error -- rather than running the script every time.

donttal commented 4 years ago

here is the txt versionof virtuoso.ini file virtuoso.txt this time

Unfortunately, verbose isql output doesn't show us everything that's happening in the server instance, and that's where the error is being triggered.

We definitely need to see the virtuoso.log corresponding to the script run above (starting with the virtuoso-t instance launch), and may need you to restart the instance with +foreground +debug to get the most detail possible when you re-attempt the load with the script as above.

I am wondering if there may be an error in the virtuoso.ini file that we've not seen, because you've only provided small snippets. Therefore, please attach the whole file to this issue (not as textual copy-paste, but as a file).

Also, at this phase in troubleshooting, it may make sense to run the commands from the script manually -- so you can stop at the first error -- rather than running the script every time.

here is the txt version of virtuoso.ini file

virtuoso.txt this time I run the conmand in ~/virtuoso-opensource/bin

(base) [lihj@localhost bin]$ ./isql 1111 dba dba exec="ld_dir_all('/home/lihj/kbqa-ar-smcnn/freebase_data/dump_virtuoso_data', '*', 'fb2m:');"
OpenLink Virtuoso Interactive SQL (Virtuoso)
Version 07.20.3229 as of Aug 15 2018
Type HELP; for help and EXIT; to exit.
Connected to OpenLink Virtuoso
Driver: 07.20.3229 OpenLink Virtuoso ODBC Driver

Done. -- 3 msec.

But when I run the complete version

./isql 1111 dba dba exec="ld_dir_all('/home/lihj/kbqa-ar-smcnn/freebase_data/dump_virtuoso_data', '*', 'fb2m:');"
# isql 1111 dba dba exec="ld_dir_all('`pwd`/freebase_data/dump_virtuoso_data', '*', 'fb2m:');"
pids=()
for i in `seq 1 4`; do
        ./isql 1111 dba dba exec="rdf_loader_run();" &
        pids+=($!)
done
for pid in ${pids[@]}; do
        wait $pid
done

output

(base) [lihj@localhost bin]$ ./data_setup.sh 
load data into knowledge base...
OpenLink Virtuoso Interactive SQL (Virtuoso)
Version 07.20.3229 as of Aug 15 2018
Type HELP; for help and EXIT; to exit.
Connected to OpenLink Virtuoso
Driver: 07.20.3229 OpenLink Virtuoso ODBC Driver

Done. -- 1 msec.
OpenLink Virtuoso Interactive SQL (Virtuoso)
Version 07.20.3229 as of Aug 15 2018
Type HELP; for help and EXIT; to exit.
OpenLink Virtuoso Interactive SQL (Virtuoso)
Version 07.20.3229 as of Aug 15 2018
Type HELP; for help and EXIT; to exit.
OpenLink Virtuoso Interactive SQL (Virtuoso)
OpenLink Virtuoso Interactive SQL (Virtuoso)
Version 07.20.3229 as of Aug 15 2018
Version 07.20.3229 as of Aug 15 2018
Type HELP; for help and EXIT; to exit.
Type HELP; for help and EXIT; to exit.
Connected to OpenLink Virtuoso
Driver: 07.20.3229 OpenLink Virtuoso ODBC Driver
Connected to OpenLink Virtuoso
Driver: 07.20.3229 OpenLink Virtuoso ODBC Driver
Connected to OpenLink Virtuoso
Connected to OpenLink Virtuoso
Driver: 07.20.3229 OpenLink Virtuoso ODBC Driver
Driver: 07.20.3229 OpenLink Virtuoso ODBC Driver

Done. -- 1 msec.

Done. -- 42 msec.

And this time I can see the virtuoso-t -fd output

                Tue Jan 14 2020
18:23:09 INFO: { Loading plugin 1: Type `plain', file `wikiv' in `../hosting'
18:23:09 INFO:   WikiV version 0.6 from OpenLink Software
18:23:09 INFO:   Support functions for WikiV collaboration tool
18:23:09 INFO:   SUCCESS plugin 1: loaded from ../hosting/wikiv.so }
18:23:09 INFO: { Loading plugin 2: Type `plain', file `mediawiki' in `../hosting'
18:23:09 INFO:   MediaWiki version 0.1 from OpenLink Software
18:23:09 INFO:   Support functions for MediaWiki collaboration tool
18:23:09 INFO:   SUCCESS plugin 2: loaded from ../hosting/mediawiki.so }
18:23:09 INFO: { Loading plugin 3: Type `plain', file `creolewiki' in `../hosting'
18:23:09 INFO:   CreoleWiki version 0.1 from OpenLink Software
18:23:09 INFO:   Support functions for CreoleWiki collaboration tool
18:23:09 INFO:   SUCCESS plugin 3: loaded from ../hosting/creolewiki.so }
18:23:09 INFO: { Loading plugin 4: Type `plain', file `im' in `../hosting'
18:23:09 INFO:   IM version 0.62 from OpenLink Software
18:23:09 INFO:   Support functions for Image Magick 6.9.9
18:23:09 INFO:   SUCCESS plugin 4: loaded from ../hosting/im.so }
18:23:09 INFO: OpenLink Virtuoso Universal Server
18:23:09 INFO: Version 07.20.3229-pthreads for Linux as of Aug 15 2018
18:23:09 INFO: uses parts of OpenSSL, PCRE, Html Tidy
18:23:09 INFO: Database version 3126
18:23:09 INFO: SQL Optimizer enabled (max 1000 layouts)
18:23:10 INFO: Compiler unit is timed at 0.000132 msec
18:23:11 INFO: Roll forward started
18:23:11 INFO:     63 transactions, 5530 bytes replayed (100 %)
18:23:11 INFO: Roll forward complete
18:23:11 INFO: Checkpoint started
18:23:11 INFO: Checkpoint finished, log reused
18:23:13 INFO: HTTP/WebDAV server online at 8890
18:23:13 INFO: Server online at 1111 (pid 111621)

18:31:21 INFO: PL LOG: Loader started
18:31:21 INFO: PL LOG: Loader started
18:31:21 INFO: PL LOG: Loader started
18:31:21 INFO: PL LOG: No more files to load. Loader has finished,
18:31:21 INFO: PL LOG: Loader started
18:31:21 INFO: PL LOG: No more files to load. Loader has finished,
18:31:23 WARNING: * Monitor: Locks are held for a long time
18:31:38 ERROR: Write wait on column page 30952.  Waits should be on the index leaf page, except when col page is held for read by background write
18:31:38 ERROR: Write wait on column page 2524.  Waits should be on the index leaf page, except when col page is held for read by background write
18:31:39 ERROR: Write wait on column page 30510.  Waits should be on the index leaf page, except when col page is held for read by background write
18:31:39 ERROR: Write wait on column page 30676.  Waits should be on the index leaf page, except when col page is held for read by background write
18:31:39 ERROR: Write wait on column page 42759.  Waits should be on the index leaf page, except when col page is held for read by background write
18:31:39 ERROR: Write wait on column page 42753.  Waits should be on the index leaf page, except when col page is held for read by background write
18:31:41 ERROR: *** read-ahead of a free or out of range page dp L=14617, database not necessarily corrupted.
18:31:41 ERROR: *** read-ahead of a free or out of range page dp L=14618, database not necessarily corrupted.
18:31:41 ERROR: *** read-ahead of a free or out of range page dp L=14621, database not necessarily corrupted.
18:31:41 ERROR: *** read-ahead of a free or out of range page dp L=14622, database not necessarily corrupted.
18:31:41 ERROR: *** read-ahead of a free or out of range page dp L=14646, database not necessarily corrupted.
18:31:41 ERROR: *** read-ahead of a free or out of range page dp L=14671, database not necessarily corrupted.
18:31:41 ERROR: *** read-ahead of a free or out of range page dp L=14678, database not necessarily corrupted.
18:31:41 ERROR: *** read-ahead of a free or out of range page dp L=14679, database not necessarily corrupted.
18:31:41 ERROR: *** read-ahead of a free or out of range page dp L=14680, database not necessarily corrupted.
18:31:41 ERROR: *** read-ahead of a free or out of range page dp L=14682, database not necessarily corrupted.
18:31:41 ERROR: *** read-ahead of a free or out of range page dp L=14688, database not necessarily corrupted.
18:31:41 ERROR: *** read-ahead of a free or out of range page dp L=14689, database not necessarily corrupted.
18:31:41 ERROR: *** read-ahead of a free or out of range page dp L=14690, database not necessarily corrupted.
18:31:41 ERROR: *** read-ahead of a free or out of range page dp L=14691, database not necessarily corrupted.
18:31:41 ERROR: *** read-ahead of a free or out of range page dp L=14693, database not necessarily corrupted.
18:31:41 ERROR: *** read-ahead of a free or out of range page dp L=14694, database not necessarily corrupted.
18:31:41 ERROR: *** read-ahead of a free or out of range page dp L=14696, database not necessarily corrupted.
18:31:41 ERROR: *** read-ahead of a free or out of range page dp L=14697, database not necessarily corrupted.
18:31:41 ERROR: *** read-ahead of a free or out of range page dp L=14698, database not necessarily corrupted.
18:31:41 ERROR: *** read-ahead of a free or out of range page dp L=14704, database not necessarily corrupted.
18:31:41 ERROR: *** read-ahead of a free or out of range page dp L=14706, database not necessarily corrupted.
18:31:41 ERROR: *** read-ahead of a free or out of range page dp L=14708, database not necessarily corrupted.
18:31:41 ERROR: *** read-ahead of a free or out of range page dp L=14712, database not necessarily corrupted.
18:31:41 ERROR: *** read-ahead of a free or out of range page dp L=14714, database not necessarily corrupted.
18:31:41 ERROR: *** read-ahead of a free or out of range page dp L=14808, database not necessarily corrupted.
18:31:41 ERROR: *** read-ahead of a free or out of range page dp L=14809, database not necessarily corrupted.
18:31:41 ERROR: *** read-ahead of a free or out of range page dp L=14810, database not necessarily corrupted.
18:31:41 ERROR: *** read-ahead of a free or out of range page dp L=14812, database not necessarily corrupted.
18:31:41 ERROR: *** read-ahead of a free or out of range page dp L=14838, database not necessarily corrupted.
18:31:41 ERROR: *** read-ahead of a free or out of range page dp L=14841, database not necessarily corrupted.
18:31:41 ERROR: *** read-ahead of a free or out of range page dp L=14842, database not necessarily corrupted.
18:31:41 ERROR: *** read-ahead of a free or out of range page dp L=14843, database not necessarily corrupted.
18:31:41 ERROR: *** read-ahead of a free or out of range page dp L=14844, database not necessarily corrupted.
18:31:41 ERROR: *** read-ahead of a free or out of range page dp L=9530, database not necessarily corrupted.
18:31:41 ERROR: *** read-ahead of a free or out of range page dp L=9534, database not necessarily corrupted.
18:31:41 ERROR: *** read-ahead of a free or out of range page dp L=9610, database not necessarily corrupted.
18:31:41 ERROR: *** read-ahead of a free or out of range page dp L=9644, database not necessarily corrupted.
18:31:41 ERROR: *** read-ahead of a free or out of range page dp L=9665, database not necessarily corrupted.
18:31:41 ERROR: *** read-ahead of a free or out of range page dp L=9669, database not necessarily corrupted.
18:31:41 ERROR: *** read-ahead of a free or out of range page dp L=9672, database not necessarily corrupted.
18:31:41 ERROR: *** read-ahead of a free or out of range page dp L=9673, database not necessarily corrupted.
18:31:41 ERROR: *** read-ahead of a free or out of range page dp L=9678, database not necessarily corrupted.
18:31:41 ERROR: *** read-ahead of a free or out of range page dp L=9684, database not necessarily corrupted.
18:31:41 ERROR: *** read-ahead of a free or out of range page dp L=9685, database not necessarily corrupted.
18:31:41 ERROR: *** read-ahead of a free or out of range page dp L=9690, database not necessarily corrupted.
18:31:49 ERROR: Write wait on column page 5322.  Waits should be on the index leaf page, except when col page is held for read by background write
18:31:49 ERROR: Write wait on column page 5323.  Waits should be on the index leaf page, except when col page is held for read by background write
18:31:49 ERROR: Write wait on column page 11378.  Waits should be on the index leaf page, except when col page is held for read by background write
18:31:49 ERROR: Write wait on column page 11383.  Waits should be on the index leaf page, except when col page is held for read by background write
18:31:49 ERROR: Write wait on column page 3850.  Waits should be on the index leaf page, except when col page is held for read by background write
18:31:49 ERROR: Write wait on column page 27508.  Waits should be on the index leaf page, except when col page is held for read by background write
18:31:49 ERROR: Write wait on column page 4117.  Waits should be on the index leaf page, except when col page is held for read by background write
18:31:52 ERROR: *** read-ahead of a free or out of range page dp L=16610, database not necessarily corrupted.
18:31:52 ERROR: *** read-ahead of a free or out of range page dp L=16617, database not necessarily corrupted.
18:31:52 ERROR: *** read-ahead of a free or out of range page dp L=16621, database not necessarily corrupted.
18:31:52 ERROR: *** read-ahead of a free or out of range page dp L=16635, database not necessarily corrupted.
18:31:52 ERROR: *** read-ahead of a free or out of range page dp L=16636, database not necessarily corrupted.
18:31:52 ERROR: *** read-ahead of a free or out of range page dp L=16638, database not necessarily corrupted.
18:31:52 ERROR: *** read-ahead of a free or out of range page dp L=24129, database not necessarily corrupted.
18:31:52 ERROR: *** read-ahead of a free or out of range page dp L=24195, database not necessarily corrupted.
18:31:52 ERROR: *** read-ahead of a free or out of range page dp L=24215, database not necessarily corrupted.
18:31:55 DEBUG: missed delete of name id cache fb:m.026y2n0 0 (0xb6ec6a )
18:32:00 DEBUG: missed delete of name id cache fb:m.021qcq 0 (0x5b9aa8 )
18:32:05 WARNING: * Monitor: High disk read (1)
18:32:13 ERROR: Write wait on column page 55646.  Waits should be on the index leaf page, except when col page is held for read by background write
18:32:13 ERROR: Write wait on column page 31546.  Waits should be on the index leaf page, except when col page is held for read by background write
18:32:13 ERROR: Write wait on column page 26308.  Waits should be on the index leaf page, except when col page is held for read by background write
18:32:13 ERROR: Write wait on column page 56117.  Waits should be on the index leaf page, except when col page is held for read by background write
18:32:13 ERROR: Write wait on column page 55580.  Waits should be on the index leaf page, except when col page is held for read by background write
18:32:13 ERROR: Write wait on column page 75594.  Waits should be on the index leaf page, except when col page is held for read by background write
18:32:13 ERROR: Write wait on column page 2817.  Waits should be on the index leaf page, except when col page is held for read by background write
18:32:13 ERROR: Write wait on column page 75597.  Waits should be on the index leaf page, except when col page is held for read by background write
18:32:13 ERROR: Write wait on column page 49468.  Waits should be on the index leaf page, except when col page is held for read by background write
18:32:13 ERROR: Write wait on column page 75623.  Waits should be on the index leaf page, except when col page is held for read by background write
18:32:18 DEBUG: missed delete of name id cache fb:m.0gvv8ql 0 (0x7be512 )
18:32:21 ERROR: *** read-ahead of a free or out of range page dp L=39134, database not necessarily corrupted.
18:32:21 ERROR: *** read-ahead of a free or out of range page dp L=39135, database not necessarily corrupted.
18:32:21 ERROR: *** read-ahead of a free or out of range page dp L=39164, database not necessarily corrupted.
18:32:34 ERROR: *** read-ahead of a free or out of range page dp L=35715, database not necessarily corrupted.
18:32:34 ERROR: *** read-ahead of a free or out of range page dp L=35730, database not necessarily corrupted.
18:32:34 ERROR: *** read-ahead of a free or out of range page dp L=35735, database not necessarily corrupted.
18:32:34 ERROR: *** read-ahead of a free or out of range page dp L=35743, database not necessarily corrupted.
18:32:34 ERROR: *** read-ahead of a free or out of range page dp L=35817, database not necessarily corrupted.
18:32:34 ERROR: *** read-ahead of a free or out of range page dp L=35821, database not necessarily corrupted.
18:32:34 ERROR: *** read-ahead of a free or out of range page dp L=70700, database not necessarily corrupted.
18:32:34 ERROR: *** read-ahead of a free or out of range page dp L=70701, database not necessarily corrupted.
18:32:34 ERROR: *** read-ahead of a free or out of range page dp L=70702, database not necessarily corrupted.
18:32:34 ERROR: *** read-ahead of a free or out of range page dp L=64783, database not necessarily corrupted.
18:32:34 ERROR: *** read-ahead of a free or out of range page dp L=64798, database not necessarily corrupted.
18:32:34 ERROR: *** read-ahead of a free or out of range page dp L=60296, database not necessarily corrupted.
18:32:34 ERROR: *** read-ahead of a free or out of range page dp L=60297, database not necessarily corrupted.
18:32:34 ERROR: *** read-ahead of a free or out of range page dp L=60298, database not necessarily corrupted.
18:32:34 ERROR: *** read-ahead of a free or out of range page dp L=60299, database not necessarily corrupted.
18:32:34 ERROR: *** read-ahead of a free or out of range page dp L=60300, database not necessarily corrupted.
18:32:34 ERROR: *** read-ahead of a free or out of range page dp L=34650, database not necessarily corrupted.
18:32:34 ERROR: *** read-ahead of a free or out of range page dp L=34653, database not necessarily corrupted.
18:32:34 ERROR: *** read-ahead of a free or out of range page dp L=34736, database not necessarily corrupted.
18:32:34 ERROR: *** read-ahead of a free or out of range page dp L=34737, database not necessarily corrupted.
18:32:37 DEBUG: missed delete of name id cache fb:m.02qy79k 0 (0x3230 )
18:32:40 ERROR: Write wait on column page 3960.  Waits should be on the index leaf page, except when col page is held for read by background write
18:32:40 ERROR: Write wait on column page 30109.  Waits should be on the index leaf page, except when col page is held for read by background write
18:32:40 ERROR: Write wait on column page 48456.  Waits should be on the index leaf page, except when col page is held for read by background write
18:32:40 ERROR: Write wait on column page 76359.  Waits should be on the index leaf page, except when col page is held for read by background write
18:32:40 ERROR: Write wait on column page 2847.  Waits should be on the index leaf page, except when col page is held for read by background write
18:32:40 ERROR: Write wait on column page 48535.  Waits should be on the index leaf page, except when col page is held for read by background write
18:32:40 ERROR: Write wait on column page 30201.  Waits should be on the index leaf page, except when col page is held for read by background write
18:32:40 ERROR: Write wait on column page 88321.  Waits should be on the index leaf page, except when col page is held for read by background write
18:32:40 ERROR: Write wait on column page 30760.  Waits should be on the index leaf page, except when col page is held for read by background write
18:32:41 ERROR: Write wait on column page 30782.  Waits should be on the index leaf page, except when col page is held for read by background write
18:32:50 ERROR: *** read-ahead of a free or out of range page dp L=35635, database not necessarily corrupted.
18:32:50 ERROR: *** read-ahead of a free or out of range page dp L=16548, database not necessarily corrupted.
18:32:50 ERROR: *** read-ahead of a free or out of range page dp L=30225, database not necessarily corrupted.
18:32:50 ERROR: *** read-ahead of a free or out of range page dp L=30233, database not necessarily corrupted.
18:32:50 ERROR: *** read-ahead of a free or out of range page dp L=30255, database not necessarily corrupted.
18:32:50 ERROR: *** read-ahead of a free or out of range page dp L=30256, database not necessarily corrupted.
18:32:50 ERROR: *** read-ahead of a free or out of range page dp L=30264, database not necessarily corrupted.
18:32:50 ERROR: *** read-ahead of a free or out of range page dp L=30265, database not necessarily corrupted.
18:32:50 ERROR: *** read-ahead of a free or out of range page dp L=30295, database not necessarily corrupted.
18:32:50 ERROR: *** read-ahead of a free or out of range page dp L=30365, database not necessarily corrupted.
18:32:50 ERROR: *** read-ahead of a free or out of range page dp L=30371, database not necessarily corrupted.
18:32:50 ERROR: *** read-ahead of a free or out of range page dp L=30381, database not necessarily corrupted.
18:32:50 ERROR: *** read-ahead of a free or out of range page dp L=30385, database not necessarily corrupted.
18:32:50 ERROR: *** read-ahead of a free or out of range page dp L=30393, database not necessarily corrupted.
18:32:50 ERROR: *** read-ahead of a free or out of range page dp L=30398, database not necessarily corrupted.
18:32:50 ERROR: *** read-ahead of a free or out of range page dp L=30438, database not necessarily corrupted.
18:32:50 ERROR: *** read-ahead of a free or out of range page dp L=30460, database not necessarily corrupted.
18:33:06 ERROR: Write wait on column page 3308.  Waits should be on the index leaf page, except when col page is held for read by background write
18:33:07 ERROR: Write wait on column page 30568.  Waits should be on the index leaf page, except when col page is held for read by background write
18:33:07 ERROR: Write wait on column page 37754.  Waits should be on the index leaf page, except when col page is held for read by background write
18:33:07 ERROR: Write wait on column page 60764.  Waits should be on the index leaf page, except when col page is held for read by background write
18:33:07 ERROR: Write wait on column page 3331.  Waits should be on the index leaf page, except when col page is held for read by background write
18:33:07 ERROR: Write wait on column page 60698.  Waits should be on the index leaf page, except when col page is held for read by background write
18:33:07 ERROR: Write wait on column page 48529.  Waits should be on the index leaf page, except when col page is held for read by background write
18:33:07 ERROR: Write wait on column page 76388.  Waits should be on the index leaf page, except when col page is held for read by background write
18:33:07 ERROR: Write wait on column page 99101.  Waits should be on the index leaf page, except when col page is held for read by background write
18:33:07 ERROR: Write wait on column page 30604.  Waits should be on the index leaf page, except when col page is held for read by background write
18:33:07 ERROR: Write wait on column page 60672.  Waits should be on the index leaf page, except when col page is held for read by background write
18:33:07 ERROR: Write wait on column page 60998.  Waits should be on the index leaf page, except when col page is held for read by background write
18:33:07 ERROR: Write wait on column page 66352.  Waits should be on the index leaf page, except when col page is held for read by background write
18:33:07 ERROR: Write wait on column page 88322.  Waits should be on the index leaf page, except when col page is held for read by background write
18:33:07 ERROR: Write wait on column page 5136.  Waits should be on the index leaf page, except when col page is held for read by background write
18:33:07 ERROR: Write wait on column page 5397.  Waits should be on the index leaf page, except when col page is held for read by background write
18:33:07 ERROR: Write wait on column page 98564.  Waits should be on the index leaf page, except when col page is held for read by background write
18:33:07 ERROR: Write wait on column page 71218.  Waits should be on the index leaf page, except when col page is held for read by background write
18:33:07 ERROR: Write wait on column page 71405.  Waits should be on the index leaf page, except when col page is held for read by background write
18:33:07 ERROR: Write wait on column page 30686.  Waits should be on the index leaf page, except when col page is held for read by background write
18:33:07 ERROR: Write wait on column page 5625.  Waits should be on the index leaf page, except when col page is held for read by background write
18:33:17 ERROR: Write wait on column page 2346.  Waits should be on the index leaf page, except when col page is held for read by background write
18:33:17 ERROR: Write wait on column page 2428.  Waits should be on the index leaf page, except when col page is held for read by background write
18:33:17 ERROR: Write wait on column page 99104.  Waits should be on the index leaf page, except when col page is held for read by background write
18:33:18 ERROR: Write wait on column page 2580.  Waits should be on the index leaf page, except when col page is held for read by background write
18:33:18 ERROR: Write wait on column page 3848.  Waits should be on the index leaf page, except when col page is held for read by background write
18:33:18 ERROR: Write wait on column page 3329.  Waits should be on the index leaf page, except when col page is held for read by background write
18:33:18 ERROR: Write wait on column page 4203.  Waits should be on the index leaf page, except when col page is held for read by background write
18:33:33 ERROR: Write wait on column page 81431.  Waits should be on the index leaf page, except when col page is held for read by background write
18:33:33 ERROR: Write wait on column page 48449.  Waits should be on the index leaf page, except when col page is held for read by background write
18:33:33 ERROR: Write wait on column page 4652.  Waits should be on the index leaf page, except when col page is held for read by background write
18:33:33 ERROR: Write wait on column page 16787.  Waits should be on the index leaf page, except when col page is held for read by background write
18:33:51 ERROR: *** read-ahead of a free or out of range page dp L=40716, database not necessarily corrupted.
18:33:51 ERROR: *** read-ahead of a free or out of range page dp L=40732, database not necessarily corrupted.
18:33:51 ERROR: *** read-ahead of a free or out of range page dp L=40766, database not necessarily corrupted.
18:33:52 ERROR: Write wait on column page 16958.  Waits should be on the index leaf page, except when col page is held for read by background write
18:33:52 ERROR: Write wait on column page 30628.  Waits should be on the index leaf page, except when col page is held for read by background write
18:33:52 ERROR: Write wait on column page 82266.  Waits should be on the index leaf page, except when col page is held for read by background write
18:33:52 ERROR: Write wait on column page 17022.  Waits should be on the index leaf page, except when col page is held for read by background write
18:33:52 ERROR: Write wait on column page 27063.  Waits should be on the index leaf page, except when col page is held for read by background write
18:33:52 ERROR: Write wait on column page 27091.  Waits should be on the index leaf page, except when col page is held for read by background write
18:33:52 ERROR: Write wait on column page 3928.  Waits should be on the index leaf page, except when col page is held for read by background write
18:33:52 ERROR: Write wait on column page 48403.  Waits should be on the index leaf page, except when col page is held for read by background write
18:34:01 DEBUG: missed delete of name id cache fb:m.04b63wn 0 (0x1359f61 )
18:34:01 DEBUG: missed delete of name id cache fb:m.0f3b51 0 (0x1727a13 )
18:34:01 DEBUG: missed delete of name id cache fb:m.0b3j9h1 0 (0x116aa51 )
18:34:02 ERROR: Write wait on column page 37108.  Waits should be on the index leaf page, except when col page is held for read by background write
18:34:02 ERROR: Write wait on column page 94570.  Waits should be on the index leaf page, except when col page is held for read by background write
18:34:02 ERROR: Write wait on column page 30586.  Waits should be on the index leaf page, except when col page is held for read by background write
18:34:02 ERROR: Write wait on column page 38206.  Waits should be on the index leaf page, except when col page is held for read by background write
18:34:02 ERROR: Write wait on column page 99078.  Waits should be on the index leaf page, except when col page is held for read by background write
18:34:02 ERROR: Write wait on column page 94539.  Waits should be on the index leaf page, except when col page is held for read by background write
18:34:02 ERROR: Write wait on column page 3079.  Waits should be on the index leaf page, except when col page is held for read by background write
18:34:02 ERROR: Write wait on column page 30588.  Waits should be on the index leaf page, except when col page is held for read by background write
18:34:02 ERROR: Write wait on column page 3340.  Waits should be on the index leaf page, except when col page is held for read by background write
18:34:02 ERROR: Write wait on column page 3342.  Waits should be on the index leaf page, except when col page is held for read by background write
18:34:02 ERROR: Write wait on column page 99161.  Waits should be on the index leaf page, except when col page is held for read by background write
18:34:02 ERROR: Write wait on column page 99112.  Waits should be on the index leaf page, except when col page is held for read by background write
18:34:02 ERROR: Write wait on column page 3363.  Waits should be on the index leaf page, except when col page is held for read by background write
18:34:02 ERROR: Write wait on column page 18045.  Waits should be on the index leaf page, except when col page is held for read by background write
18:34:02 ERROR: Write wait on column page 88297.  Waits should be on the index leaf page, except when col page is held for read by background write
18:34:02 ERROR: Write wait on column page 30560.  Waits should be on the index leaf page, except when col page is held for read by background write
18:34:02 ERROR: Write wait on column page 2687.  Waits should be on the index leaf page, except when col page is held for read by background write
18:34:02 ERROR: Write wait on column page 31634.  Waits should be on the index leaf page, except when col page is held for read by background write
18:34:02 ERROR: Write wait on column page 99620.  Waits should be on the index leaf page, except when col page is held for read by background write
18:34:02 ERROR: Write wait on column page 38245.  Waits should be on the index leaf page, except when col page is held for read by background write
18:34:02 ERROR: Write wait on column page 99114.  Waits should be on the index leaf page, except when col page is held for read by background write
18:34:02 ERROR: Write wait on column page 88239.  Waits should be on the index leaf page, except when col page is held for read by background write
18:34:05 ERROR: Write wait on column page 51851.  Waits should be on the index leaf page, except when col page is held for read by background write
18:34:05 ERROR: Write wait on column page 60688.  Waits should be on the index leaf page, except when col page is held for read by background write
18:34:05 ERROR: Write wait on column page 39356.  Waits should be on the index leaf page, except when col page is held for read by background write
18:34:05 ERROR: Write wait on column page 80138.  Waits should be on the index leaf page, except when col page is held for read by background write
18:34:05 ERROR: Write wait on column page 88482.  Waits should be on the index leaf page, except when col page is held for read by background write
18:34:05 ERROR: Write wait on column page 112406.  Waits should be on the index leaf page, except when col page is held for read by background write
18:34:05 ERROR: Write wait on column page 12270.  Waits should be on the index leaf page, except when col page is held for read by background write
18:34:05 ERROR: Write wait on column page 47377.  Waits should be on the index leaf page, except when col page is held for read by background write
18:34:05 ERROR: Write wait on column page 82439.  Waits should be on the index leaf page, except when col page is held for read by background write
18:34:05 ERROR: Write wait on column page 4894.  Waits should be on the index leaf page, except when col page is held for read by background write
18:34:05 ERROR: Write wait on column page 47146.  Waits should be on the index leaf page, except when col page is held for read by background write
18:34:05 ERROR: Write wait on column page 67556.  Waits should be on the index leaf page, except when col page is held for read by background write
18:34:05 ERROR: Write wait on column page 112416.  Waits should be on the index leaf page, except when col page is held for read by background write
18:34:09 WARNING: * Monitor: High disk read (1)
18:34:21 ERROR: Write wait on column page 3593.  Waits should be on the index leaf page, except when col page is held for read by background write
18:34:21 ERROR: Write wait on column page 88372.  Waits should be on the index leaf page, except when col page is held for read by background write
18:34:21 ERROR: Write wait on column page 4927.  Waits should be on the index leaf page, except when col page is held for read by background write
18:34:21 ERROR: Write wait on column page 47113.  Waits should be on the index leaf page, except when col page is held for read by background write
18:34:22 ERROR: Write wait on column page 81472.  Waits should be on the index leaf page, except when col page is held for read by background write
18:34:22 ERROR: Write wait on column page 2858.  Waits should be on the index leaf page, except when col page is held for read by background write
18:34:22 ERROR: Write wait on column page 60730.  Waits should be on the index leaf page, except when col page is held for read by background write
18:34:22 ERROR: Write wait on column page 3407.  Waits should be on the index leaf page, except when col page is held for read by background write
18:34:22 ERROR: Write wait on column page 52417.  Waits should be on the index leaf page, except when col page is held for read by background write
18:34:22 ERROR: Write wait on column page 68489.  Waits should be on the index leaf page, except when col page is held for read by background write
18:34:22 ERROR: Write wait on column page 68576.  Waits should be on the index leaf page, except when col page is held for read by background write
18:34:22 ERROR: Write wait on column page 68589.  Waits should be on the index leaf page, except when col page is held for read by background write
18:34:22 ERROR: Write wait on column page 68598.  Waits should be on the index leaf page, except when col page is held for read by background write
18:34:22 ERROR: Write wait on column page 68602.  Waits should be on the index leaf page, except when col page is held for read by background write
18:34:22 ERROR: Write wait on column page 68605.  Waits should be on the index leaf page, except when col page is held for read by background write
18:34:22 ERROR: Write wait on column page 55589.  Waits should be on the index leaf page, except when col page is held for read by background write
18:34:22 ERROR: Write wait on column page 16645.  Waits should be on the index leaf page, except when col page is held for read by background write
18:34:22 ERROR: Write wait on column page 49251.  Waits should be on the index leaf page, except when col page is held for read by background write
18:34:22 ERROR: Write wait on column page 117514.  Waits should be on the index leaf page, except when col page is held for read by background write
18:34:22 ERROR: Write wait on column page 71245.  Waits should be on the index leaf page, except when col page is held for read by background write
18:34:22 ERROR: Write wait on column page 82694.  Waits should be on the index leaf page, except when col page is held for read by background write
18:34:22 ERROR: Write wait on column page 81524.  Waits should be on the index leaf page, except when col page is held for read by background write
18:34:22 ERROR: Write wait on column page 4222.  Waits should be on the index leaf page, except when col page is held for read by background write
18:34:22 ERROR: Write wait on column page 3212.  Waits should be on the index leaf page, except when col page is held for read by background write
18:34:22 ERROR: Write wait on column page 16746.  Waits should be on the index leaf page, except when col page is held for read by background write
18:34:31 ERROR: Write wait on column page 81550.  Waits should be on the index leaf page, except when col page is held for read by background write
18:34:31 ERROR: Write wait on column page 37846.  Waits should be on the index leaf page, except when col page is held for read by background write
18:34:31 ERROR: Write wait on column page 2823.  Waits should be on the index leaf page, except when col page is held for read by background write
18:34:31 ERROR: Write wait on column page 26947.  Waits should be on the index leaf page, except when col page is held for read by background write
18:34:31 ERROR: Write wait on column page 62241.  Waits should be on the index leaf page, except when col page is held for read by background write
18:34:31 ERROR: Write wait on column page 31566.  Waits should be on the index leaf page, except when col page is held for read by background write
18:34:31 ERROR: Write wait on column page 26949.  Waits should be on the index leaf page, except when col page is held for read by background write
18:34:31 ERROR: Write wait on column page 2689.  Waits should be on the index leaf page, except when col page is held for read by background write
18:34:31 ERROR: Write wait on column page 62244.  Waits should be on the index leaf page, except when col page is held for read by background write
18:34:31 ERROR: Write wait on column page 2724.  Waits should be on the index leaf page, except when col page is held for read by background write
18:34:31 ERROR: Write wait on column page 88327.  Waits should be on the index leaf page, except when col page is held for read by background write
18:34:31 ERROR: Write wait on column page 4030.  Waits should be on the index leaf page, except when col page is held for read by background write
18:34:31 ERROR: Write wait on column page 99616.  Waits should be on the index leaf page, except when col page is held for read by background write
18:34:31 ERROR: Write wait on column page 37853.  Waits should be on the index leaf page, except when col page is held for read by background write
18:34:31 ERROR: Write wait on column page 62256.  Waits should be on the index leaf page, except when col page is held for read by background write
18:34:36 ERROR: *** read-ahead of a free or out of range page dp L=22992, database not necessarily corrupted.
18:34:36 ERROR: *** read-ahead of a free or out of range page dp L=43604, database not necessarily corrupted.
18:34:36 ERROR: *** read-ahead of a free or out of range page dp L=43645, database not necessarily corrupted.
18:34:55 DEBUG: missed delete of name id cache fb:m.0pdkwhd 0 (0xf8c86d )
18:34:58 ERROR: Write wait on column page 4191.  Waits should be on the index leaf page, except when col page is held for read by background write
18:34:58 ERROR: Write wait on column page 88231.  Waits should be on the index leaf page, except when col page is held for read by background write
18:34:58 ERROR: Write wait on column page 101632.  Waits should be on the index leaf page, except when col page is held for read by background write
18:34:58 ERROR: Write wait on column page 101635.  Waits should be on the index leaf page, except when col page is held for read by background write
18:34:58 ERROR: Write wait on column page 101644.  Waits should be on the index leaf page, except when col page is held for read by background write
18:34:58 ERROR: Write wait on column page 101653.  Waits should be on the index leaf page, except when col page is held for read by background write
18:34:58 ERROR: Write wait on column page 101660.  Waits should be on the index leaf page, except when col page is held for read by background write
18:34:58 ERROR: Write wait on column page 101664.  Waits should be on the index leaf page, except when col page is held for read by background write
18:34:58 ERROR: Write wait on column page 101671.  Waits should be on the index leaf page, except when col page is held for read by background write
18:34:58 ERROR: Write wait on column page 101675.  Waits should be on the index leaf page, except when col page is held for read by background write
18:34:58 ERROR: Write wait on column page 101679.  Waits should be on the index leaf page, except when col page is held for read by background write
18:34:58 ERROR: Write wait on column page 101689.  Waits should be on the index leaf page, except when col page is held for read by background write
18:34:58 ERROR: Write wait on column page 101693.  Waits should be on the index leaf page, except when col page is held for read by background write
18:34:58 ERROR: Write wait on column page 101702.  Waits should be on the index leaf page, except when col page is held for read by background write
18:34:58 ERROR: Write wait on column page 101720.  Waits should be on the index leaf page, except when col page is held for read by background write
18:34:58 ERROR: Write wait on column page 101740.  Waits should be on the index leaf page, except when col page is held for read by background write
18:34:58 ERROR: Write wait on column page 101869.  Waits should be on the index leaf page, except when col page is held for read by background write
18:34:58 ERROR: Write wait on column page 101870.  Waits should be on the index leaf page, except when col page is held for read by background write
18:34:58 ERROR: Write wait on column page 129286.  Waits should be on the index leaf page, except when col page is held for read by background write
18:34:58 ERROR: Write wait on column page 129316.  Waits should be on the index leaf page, except when col page is held for read by background write
18:34:58 ERROR: Write wait on column page 129330.  Waits should be on the index leaf page, except when col page is held for read by background write
18:34:58 ERROR: Write wait on column page 4208.  Waits should be on the index leaf page, except when col page is held for read by background write
18:34:58 ERROR: Write wait on column page 3601.  Waits should be on the index leaf page, except when col page is held for read by background write
18:34:58 ERROR: Write wait on column page 88245.  Waits should be on the index leaf page, except when col page is held for read by background write
18:34:58 ERROR: Write wait on column page 127803.  Waits should be on the index leaf page, except when col page is held for read by background write
18:34:58 ERROR: Write wait on column page 101863.  Waits should be on the index leaf page, except when col page is held for read by background write
18:34:58 ERROR: Write wait on column page 129293.  Waits should be on the index leaf page, except when col page is held for read by background write
18:34:58 ERROR: Write wait on column page 4225.  Waits should be on the index leaf page, except when col page is held for read by background write
18:34:58 ERROR: Write wait on column page 96006.  Waits should be on the index leaf page, except when col page is held for read by background write
18:34:58 ERROR: Write wait on column page 127804.  Waits should be on the index leaf page, except when col page is held for read by background write
18:35:03 ERROR: Write wait on column page 52421.  Waits should be on the index leaf page, except when col page is held for read by background write
18:35:03 ERROR: Write wait on column page 52394.  Waits should be on the index leaf page, except when col page is held for read by background write
18:35:06 ERROR: *** read-ahead of a free or out of range page dp L=44204, database not necessarily corrupted.
18:35:06 ERROR: *** read-ahead of a free or out of range page dp L=44208, database not necessarily corrupted.
18:35:06 ERROR: *** read-ahead of a free or out of range page dp L=44221, database not necessarily corrupted.
18:35:15 ERROR: *** read-ahead of a free or out of range page dp L=86868, database not necessarily corrupted.
18:35:40 DEBUG: missed delete of name id cache fb:m.01nkx3q 0 (0xb6dceb )
18:35:42 ERROR: Write wait on column page 127888.  Waits should be on the index leaf page, except when col page is held for read by background write
18:35:42 ERROR: Write wait on column page 2521.  Waits should be on the index leaf page, except when col page is held for read by background write
18:35:42 ERROR: Write wait on column page 55577.  Waits should be on the index leaf page, except when col page is held for read by background write
18:35:42 ERROR: Write wait on column page 31698.  Waits should be on the index leaf page, except when col page is held for read by background write
18:35:42 ERROR: Write wait on column page 138796.  Waits should be on the index leaf page, except when col page is held for read by background write
18:35:42 ERROR: Write wait on column page 81486.  Waits should be on the index leaf page, except when col page is held for read by background write
18:35:42 ERROR: Write wait on column page 55578.  Waits should be on the index leaf page, except when col page is held for read by background write
18:35:42 ERROR: Write wait on column page 48616.  Waits should be on the index leaf page, except when col page is held for read by background write
18:35:42 ERROR: Write wait on column page 60726.  Waits should be on the index leaf page, except when col page is held for read by background write
18:35:43 ERROR: Write wait on column page 76430.  Waits should be on the index leaf page, except when col page is held for read by background write
18:35:43 ERROR: Write wait on column page 71313.  Waits should be on the index leaf page, except when col page is held for read by background write
18:35:43 ERROR: Write wait on column page 65884.  Waits should be on the index leaf page, except when col page is held for read by background write
18:35:43 ERROR: Write wait on column page 81494.  Waits should be on the index leaf page, except when col page is held for read by background write
18:35:43 ERROR: Write wait on column page 81495.  Waits should be on the index leaf page, except when col page is held for read by background write
18:35:43 ERROR: Write wait on column page 127892.  Waits should be on the index leaf page, except when col page is held for read by background write
18:35:43 ERROR: Write wait on column page 48639.  Waits should be on the index leaf page, except when col page is held for read by background write
18:35:43 ERROR: Write wait on column page 81513.  Waits should be on the index leaf page, except when col page is held for read by background write
18:35:43 ERROR: Write wait on column page 31733.  Waits should be on the index leaf page, except when col page is held for read by background write
18:35:43 ERROR: Write wait on column page 55462.  Waits should be on the index leaf page, except when col page is held for read by background write
18:35:43 ERROR: Write wait on column page 99617.  Waits should be on the index leaf page, except when col page is held for read by background write
18:35:43 ERROR: Write wait on column page 55469.  Waits should be on the index leaf page, except when col page is held for read by background write
18:35:43 ERROR: Write wait on column page 55472.  Waits should be on the index leaf page, except when col page is held for read by background write
18:35:43 ERROR: Write wait on column page 55479.  Waits should be on the index leaf page, except when col page is held for read by background write
18:35:43 ERROR: Write wait on column page 55481.  Waits should be on the index leaf page, except when col page is held for read by background write
18:35:43 ERROR: Write wait on column page 55485.  Waits should be on the index leaf page, except when col page is held for read by background write
18:35:43 ERROR: Write wait on column page 55489.  Waits should be on the index leaf page, except when col page is held for read by background write
18:35:43 ERROR: Write wait on column page 55493.  Waits should be on the index leaf page, except when col page is held for read by background write
18:35:43 ERROR: Write wait on column page 55503.  Waits should be on the index leaf page, except when col page is held for read by background write
18:35:43 ERROR: Write wait on column page 55511.  Waits should be on the index leaf page, except when col page is held for read by background write
18:35:43 ERROR: Write wait on column page 55522.  Waits should be on the index leaf page, except when col page is held for read by background write
18:35:43 ERROR: Write wait on column page 95873.  Waits should be on the index leaf page, except when col page is held for read by background write
18:35:43 ERROR: Write wait on column page 135431.  Waits should be on the index leaf page, except when col page is held for read by background write
18:35:43 ERROR: Write wait on column page 82801.  Waits should be on the index leaf page, except when col page is held for read by background write
18:35:43 ERROR: Write wait on column page 66014.  Waits should be on the index leaf page, except when col page is held for read by background write
18:35:43 ERROR: Write wait on column page 4640.  Waits should be on the index leaf page, except when col page is held for read by background write
18:35:47 ERROR: Write wait on column page 51911.  Waits should be on the index leaf page, except when col page is held for read by background write
18:35:47 ERROR: Write wait on column page 2828.  Waits should be on the index leaf page, except when col page is held for read by background write
18:35:47 ERROR: Write wait on column page 121603.  Waits should be on the index leaf page, except when col page is held for read by background write
18:35:47 ERROR: Write wait on column page 80181.  Waits should be on the index leaf page, except when col page is held for read by background write
18:35:59 ERROR: *** read-ahead of a free or out of range page dp L=25010, database not necessarily corrupted.
18:35:59 ERROR: *** read-ahead of a free or out of range page dp L=25063, database not necessarily corrupted.
18:36:09 WARNING: * Monitor: High disk read (1)

I want to load this data

(base) [lihj@localhost kbqa-ar-smcnn]$ cd freebase_data/dump_virtuoso_data/
(base) [lihj@localhost dump_virtuoso_data]$ ls -lh
总用量 1.2G
-rw-rw-r--. 1 lihj lihj 883M 1月   9 22:18 FB2M.core.txt
-rw-rw-r--. 1 lihj lihj 323M 1月   9 21:48 FB5M.name.txt
(base) [lihj@localhost dump_virtuoso_data]$ head -n 10 FB2M.core.txt 
<fb:m.01d_h8>   <fb:people.profession.people_with_this_profession>      <fb:m.0dm36vv>  .
<fb:m.01rtx2>   <fb:medicine.drug_ingredient.active_ingredient_of_formulation>  <fb:m.0hqtc1h>  .
<fb:m.01qkd8r>  <fb:music.artist.genre> <fb:m.03lty>    .
<fb:m.0g71r2>   <fb:common.topic.notable_types> <fb:m.01n7>     .
<fb:m.0c66m>    <fb:location.location.people_born_here> <fb:m.0fbkb2>   .
<fb:m.04n7nt2>  <fb:medicine.drug_administration_route.drug_formulations>       <fb:m.0hqrdns>  .
<fb:m.068bds>   <fb:people.person.gender>       <fb:m.05zppz>   .
<fb:m.0r3wm>    <fb:location.location.contains> <fb:m.048p6zy>  .
<fb:m.0lrq5kb>  <fb:music.release_track.release>        <fb:m.039dhhv>  .
<fb:m.01schvd>  <fb:music.artist.genre> <fb:m.016clz>   .
(base) [lihj@localhost dump_virtuoso_data]$ head -n 10 FB5M.name.txt 
<fb:m.0f8v12b>  <fb:type.object.name>   "blue christmas"        .
<fb:m.0f8vjgd>  <fb:type.object.name>   "skyshaper"     .
<fb:m.0f8vp8r>  <fb:type.object.name>   "collection"    .
<fb:m.0f8vt9>   <fb:type.object.name>   "gypsy 83"      .
<fb:m.0f8w8td>  <fb:type.object.name>   "show boat ( 1971 london revival cast )"        .
<fb:m.0f8xqp>   <fb:type.object.name>   "movie surfers" .
<fb:m.0f8y87p>  <fb:type.object.name>   "a headline"    .
<fb:m.0f92mnq>  <fb:type.object.name>   "swan lake , op. 20 : act iii , appendix 1 : pas de deux : moderato : andante"  .
<fb:m.0f92mnq>  <fb:common.topic.alias> "le lac des cygnes , acte 3 : i. moderato - andante"    .
<fb:m.0f966w9>  <fb:type.object.name>   "die winterreise"       .
HughWilliams commented 4 years ago

The Virtuoso log shows many errors accessing the database

.
.
.
18:35:15 ERROR: *** read-ahead of a free or out of range page dp L=86868, database not necessarily corrupted.
18:35:40 DEBUG: missed delete of name id cache fb:m.01nkx3q 0 (0xb6dceb )
18:35:42 ERROR: Write wait on column page 127888.  Waits should be on the index leaf page, except when col page is held for read by background write
.
.
.

Indicating possible corruption in the database, thus you should run a database integrity check:

 backup '/dev/null';

and if any corruption is found perform a crash dump and restore of the database as detailed in the documentation.

Also, as you have been start the with Virtuoso 6 & 7 binaries which have different internal structures for data storage, have you been starting the same database file with the different binaries, as I wonder if that might be part of the cause of the errors in the log ?

Please provide the output of running the command:

SELECT TOP 10 KEY_TABLE, sys_sql_val_print (KEY_OPTIONS)    FROM sys_keys    WHERE KEY_TABLE = 'DB.DBA.RDF_QUAD' ;

which will show whether the database is an original v6 row wise or v7 column wise storage database ?

donttal commented 4 years ago

The Virtuoso log shows many errors accessing the database

.
.
.
18:35:15 ERROR: *** read-ahead of a free or out of range page dp L=86868, database not necessarily corrupted.
18:35:40 DEBUG: missed delete of name id cache fb:m.01nkx3q 0 (0xb6dceb )
18:35:42 ERROR: Write wait on column page 127888.  Waits should be on the index leaf page, except when col page is held for read by background write
.
.
.

Indicating possible corruption in the database, thus you should run a database integrity check:

 backup '/dev/null';

and if any corruption is found perform a crash dump and restore of the database as detailed in the documentation.

Also, as you have been start the with Virtuoso 6 & 7 binaries which have different internal structures for data storage, have you been starting the same database file with the different binaries, as I wonder if that might be part of the cause of the errors in the log ?

Please provide the output of running the command:

SELECT TOP 10 KEY_TABLE, sys_sql_val_print (KEY_OPTIONS)    FROM sys_keys    WHERE KEY_TABLE = 'DB.DBA.RDF_QUAD' ;

which will show whether the database is an original v6 row wise or v7 column wise storage database ?

I try your advice . Here is the output.

(base) [lihj@localhost bin]$ ./isql 1111 dba dba
OpenLink Virtuoso Interactive SQL (Virtuoso)
Version 07.20.3229 as of Aug 15 2018
Type HELP; for help and EXIT; to exit.
Connected to OpenLink Virtuoso
Driver: 07.20.3229 OpenLink Virtuoso ODBC Driver
SQL> backup '/dev/null';

Done. -- 1098 msec.
SQL> SELECT TOP 10 KEY_TABLE, sys_sql_val_print (KEY_OPTIONS)    FROM sys_keys    WHERE KEY_TABLE = 'DB.DBA.RDF_QUAD' ;
KEY_TABLE                                                                         sys_sql_val_print
VARCHAR NOT NULL                                                                  LONG VARCHAR
_______________________________________________________________________________

DB.DBA.RDF_QUAD                                                                   vector ('column')
DB.DBA.RDF_QUAD                                                                   vector ('distinct', 'no_pk', 'column', vector (525, 0, 0, '__ALL', vector (vector (0, 'S', 1, 16776960, 0))))
DB.DBA.RDF_QUAD                                                                   vector ('distinct', 'no_pk', 'column', vector (525, 0, 0, '__ALL', vector (vector (0, 'O', 3, -1, 65535))))
DB.DBA.RDF_QUAD                                                                   vector ('column', vector (525, 0, 0, '__ALL', vector (vector (0, 'O', 3, -1, 65535))))
DB.DBA.RDF_QUAD                                                                   vector ('distinct', 'no_pk', 'column', vector (525, 0, 0, '__ALL', vector (vector (0, 'S', 1, 16776960, 0))))

5 Rows. -- 3 msec.
SQL>

And this is the virtuoso log

21:03:26 INFO:     36000 transactions, 247137881 bytes replayed (92 %)
21:03:34 INFO:     37000 transactions, 254198424 bytes replayed (94 %)
21:03:43 INFO:     38000 transactions, 261154640 bytes replayed (97 %)
21:03:52 INFO:     38945 transactions, 267667628 bytes replayed (100 %)
21:03:52 INFO: Roll forward complete
21:03:54 INFO: Checkpoint started
21:03:54 INFO: Checkpoint finished, log reused
21:03:56 INFO: HTTP/WebDAV server online at 8890
21:03:56 INFO: Server online at 1111 (pid 152105)
21:05:56 INFO: Backup to /dev/null started
21:05:56 DEBUG: Dumping the schema tables
21:05:56 DEBUG: Dumping the registry
21:05:56 DEBUG: Dumping the schema done
21:05:58 INFO: Backup to /dev/null complete, processed 17231 nodes on 3 levels