MrPowerScripts / reddit-karma-farming-bot

"Is karma really that important to you? Damn bro, you need a life" - YouTube Comment
https://mrpowerscripts.com
MIT License
295 stars 119 forks source link

Database disk image is malformed #97

Closed ghost closed 3 years ago

ghost commented 3 years ago

I always get this error while I let the but learning: database disk image is malformed

I never touched something in the source. I just edited the utils.py & settings.py

I just started in newly on Windows 10 Ubuntu TLS "sub-system" using via the cmd bash command

Error exactly:

`2020-12-24 00:06:16,376 INFO init(71) THE BOT IS WORKING. IT WILL TAKE ABOUT 8 HOURS FOR IT TO LEARN AND START COMMENTING.

2020-12-24 00:06:16,379 INFO init(72) fast learning 2020-12-24 00:06:16,379 INFO learn(63) checking submission 2020-12-24 00:06:16,381 INFO learn(13) trying to learn 2020-12-24 00:06:16,384 INFO learn(17) db size: 2.56640625 2020-12-24 00:06:16,386 INFO learn(35) SUBREDDIT_LIST is active 2020-12-24 00:06:16,388 INFO learn(36) learning from: comedyheaven 2020-12-24 00:06:16,389 INFO learn(54) active db : /mnt/c/Users/root/reddit-karma-farming-bot/src/brains/comedyheaven.db 2020-12-24 00:06:16,394 INFO learn(59) looping through submissions 2020-12-24 00:06:16,823 INFO learn(63) checking submission 2020-12-24 00:06:17,818 INFO learn(63) checking submission 2020-12-24 00:06:18,106 INFO learn(63) checking submission 2020-12-24 00:06:19,225 INFO learn(63) checking submission 2020-12-24 00:06:19,519 INFO learn(63) checking submission 2020-12-24 00:06:21,384 INFO learn(63) checking submission 2020-12-24 00:06:25,658 INFO learn(63) checking submission 2020-12-24 00:06:26,954 INFO learn(63) checking submission 2020-12-24 00:06:27,474 INFO learn(102) database disk image is malformed Traceback (most recent call last): File "/mnt/c/Users/root/reddit-karma-farming-bot/src/learn.py", line 92, in learn comment_body.encode("utf8") File "/mnt/c/Users/root/reddit-karma-farming-bot/venv/lib/python3.6/site-packages/cobe/brain.py", line 125, in learn self._learn_tokens(tokens) File "/mnt/c/Users/root/reddit-karma-farming-bot/venv/lib/python3.6/site-packages/cobe/brain.py", line 180, in _learn_tokens stemmer=self.stemmer) File "/mnt/c/Users/root/reddit-karma-farming-bot/venv/lib/python3.6/site-packages/cobe/brain.py", line 530, in get_token_by_text row = c.execute(q, (text,)).fetchone() sqlite3.DatabaseError: database disk image is malformed 2020-12-24 00:06:27,489 INFO init(75) new db size: 2.5234375 2020-12-24 00:06:27,495 INFO countdown(358) sleeping: 2 seconds 2020-12-24 00:06:27,543 INFO learn(63) checking submission 2020-12-24 00:06:27,864 INFO learn(99) done learning 2020-12-24 00:06:27,872 INFO init(75) new db size: 1.7265625 2020-12-24 00:06:27,882 INFO countdown(358) sleeping: 2 seconds`

ghost commented 3 years ago

New error after restart:

2020-12-24 00:39:35,910 INFO learn(102) disk I/O error

ghost commented 3 years ago

lol 3rd new error, now the db size is not going up

Traceback (most recent call last): File "/mnt/c/Users/root/reddit-karma-farming-bot/src/learn.py", line 92, in learn comment_body.encode("utf8") File "/mnt/c/Users/root/reddit-karma-farming-bot/venv/lib/python3.6/site-packages/cobe/brain.py", line 125, in learn self._learn_tokens(tokens) File "/mnt/c/Users/root/reddit-karma-farming-bot/venv/lib/python3.6/site-packages/cobe/brain.py", line 191, in _learn_tokens self.graph.add_edge(prev_id, next_id, has_space) File "/mnt/c/Users/root/reddit-karma-farming-bot/venv/lib/python3.6/site-packages/cobe/brain.py", line 648, in add_edge c.execute(update_q, args) sqlite3.IntegrityError: UNIQUE constraint failed: edges.next_node, edges.prev_node, edges.has_space, edges.count

kgbprofile commented 3 years ago

Try deleting it's /src/brains. Does the error go away?

ghost commented 3 years ago

Try deleting it's /src/brains. Does the error go away?

deleted, I will edit it if it works

the database is still broken, but the db size is rising O.o edit:

still broken:

`2020-12-29 14:45:04,302 INFO check_first_run(82) not first run ever 2020-12-29 14:45:04,312 INFO init(71) THE BOT IS WORKING. IT WILL TAKE ABOUT 8 HOURS FOR IT TO LEARN AND START COMMENTING.

2020-12-29 14:45:04,320 INFO init(72) fast learning 2020-12-29 14:45:04,323 INFO learn(13) trying to learn 2020-12-29 14:45:04,325 INFO learn(17) db size: 0.046875 2020-12-29 14:45:04,328 INFO learn(35) SUBREDDIT_LIST is active 2020-12-29 14:45:04,329 INFO learn(36) learning from: memes 2020-12-29 14:45:04,331 INFO learn(54) active db : /mnt/c/Users/root/reddit-karma-farming-bot/src/brains/memes.db 2020-12-29 14:45:04,437 INFO learn(59) looping through submissions 2020-12-29 14:45:05,751 INFO learn(63) checking submission 2020-12-29 14:45:07,202 INFO learn(63) checking submission 2020-12-29 14:45:08,296 INFO learn(63) checking submission 2020-12-29 14:45:09,650 INFO learn(63) checking submission 2020-12-29 14:45:10,176 INFO learn(63) checking submission 2020-12-29 14:45:10,477 INFO learn(102) database disk image is malformed Traceback (most recent call last): File "/mnt/c/Users/root/reddit-karma-farming-bot/src/learn.py", line 92, in learn comment_body.encode("utf8") File "/mnt/c/Users/root/reddit-karma-farming-bot/venv/lib/python3.6/site-packages/cobe/brain.py", line 125, in learn self._learn_tokens(tokens) File "/mnt/c/Users/root/reddit-karma-farming-bot/venv/lib/python3.6/site-packages/cobe/brain.py", line 180, in _learn_tokens stemmer=self.stemmer) File "/mnt/c/Users/root/reddit-karma-farming-bot/venv/lib/python3.6/site-packages/cobe/brain.py", line 530, in get_token_by_text row = c.execute(q, (text,)).fetchone() sqlite3.DatabaseError: database disk image is malformed 2020-12-29 14:45:10,500 INFO init(75) new db size: 0.046875 2020-12-29 14:45:10,506 INFO countdown(358) sleeping: 2 seconds 2020-12-29 14:45:10,894 INFO learn(63) checking submission 2020-12-29 14:45:11,974 INFO learn(63) checking submission 2020-12-29 14:45:14,444 INFO learn(63) checking submission 2020-12-29 14:45:15,718 INFO learn(63) checking submission 2020-12-29 14:45:16,509 INFO countdown(362) waking up 2020-12-29 14:45:16,514 INFO init(130) end main loop 2020-12-29 14:45:16,516 INFO init(71) THE BOT IS WORKING. IT WILL TAKE ABOUT 8 HOURS FOR IT TO LEARN AND START COMMENTING.

2020-12-29 14:45:16,525 INFO init(72) fast learning 2020-12-29 14:45:16,532 INFO learn(13) trying to learn 2020-12-29 14:45:16,535 INFO learn(17) db size: 0.20703125 2020-12-29 14:45:16,538 INFO learn(35) SUBREDDIT_LIST is active 2020-12-29 14:45:16,540 INFO learn(36) learning from: wholesomememes 2020-12-29 14:45:16,543 INFO learn(54) active db : /mnt/c/Users/root/reddit-karma-farming-bot/src/brains/wholesomememes.db 2020-12-29 14:45:16,641 INFO learn(59) looping through submissions 2020-12-29 14:45:16,705 INFO learn(63) checking submission 2020-12-29 14:45:17,088 INFO learn(63) checking submission 2020-12-29 14:45:18,090 INFO learn(63) checking submission 2020-12-29 14:45:18,807 INFO learn(63) checking submission 2020-12-29 14:45:18,993 INFO learn(63) checking submission 2020-12-29 14:45:19,206 INFO learn(63) checking submission 2020-12-29 14:45:19,587 INFO learn(63) checking submission 2020-12-29 14:45:19,862 INFO learn(102) database disk image is malformed Traceback (most recent call last): File "/mnt/c/Users/root/reddit-karma-farming-bot/src/learn.py", line 92, in learn comment_body.encode("utf8") File "/mnt/c/Users/root/reddit-karma-farming-bot/venv/lib/python3.6/site-packages/cobe/brain.py", line 125, in learn self._learn_tokens(tokens) File "/mnt/c/Users/root/reddit-karma-farming-bot/venv/lib/python3.6/site-packages/cobe/brain.py", line 180, in _learn_tokens stemmer=self.stemmer) File "/mnt/c/Users/root/reddit-karma-farming-bot/venv/lib/python3.6/site-packages/cobe/brain.py", line 530, in get_token_by_text row = c.execute(q, (text,)).fetchone() sqlite3.DatabaseError: database disk image is malformed 2020-12-29 14:45:19,878 INFO init(75) new db size: 0.15234375 2020-12-29 14:45:19,884 INFO countdown(358) sleeping: 2 seconds 2020-12-29 14:45:20,166 INFO learn(63) checking submission 2020-12-29 14:45:23,157 INFO learn(63) checking submission 2020-12-29 14:45:23,997 INFO learn(63) checking submission 2020-12-29 14:45:25,886 INFO countdown(362) waking up 2020-12-29 14:45:25,888 INFO init(130) end main loop 2020-12-29 14:45:25,888 INFO init(71) THE BOT IS WORKING. IT WILL TAKE ABOUT 8 HOURS FOR IT TO LEARN AND START COMMENTING.

2020-12-29 14:45:25,893 INFO init(72) fast learning 2020-12-29 14:45:25,894 INFO learn(13) trying to learn 2020-12-29 14:45:25,896 INFO learn(17) db size: 0.28515625 2020-12-29 14:45:25,897 INFO learn(35) SUBREDDIT_LIST is active 2020-12-29 14:45:25,899 INFO learn(36) learning from: comedyheaven 2020-12-29 14:45:25,900 INFO learn(54) active db : /mnt/c/Users/root/reddit-karma-farming-bot/src/brains/comedyheaven.db2020-12-29 14:45:25,976 INFO learn(59) looping through submissions 2020-12-29 14:45:27,813 INFO learn(63) checking submission 2020-12-29 14:45:28,481 INFO learn(63) checking submission 2020-12-29 14:45:28,876 INFO learn(63) checking submission 2020-12-29 14:45:29,290 INFO learn(63) checking submission 2020-12-29 14:45:29,593 INFO learn(63) checking submission 2020-12-29 14:45:30,242 INFO learn(63) checking submission 2020-12-29 14:45:30,357 INFO learn(63) checking submission 2020-12-29 14:45:30,808 INFO learn(63) checking submission 2020-12-29 14:45:31,462 INFO learn(63) checking submission 2020-12-29 14:45:33,041 INFO learn(63) checking submission 2020-12-29 14:45:33,344 INFO learn(63) checking submission 2020-12-29 14:45:33,830 INFO learn(102) database disk image is malformed Traceback (most recent call last): File "/mnt/c/Users/root/reddit-karma-farming-bot/src/learn.py", line 92, in learn comment_body.encode("utf8") File "/mnt/c/Users/root/reddit-karma-farming-bot/venv/lib/python3.6/site-packages/cobe/brain.py", line 125, in learn self._learn_tokens(tokens) File "/mnt/c/Users/root/reddit-karma-farming-bot/venv/lib/python3.6/site-packages/cobe/brain.py", line 180, in _learn_tokens stemmer=self.stemmer) File "/mnt/c/Users/root/reddit-karma-farming-bot/venv/lib/python3.6/site-packages/cobe/brain.py", line 530, in get_token_by_text row = c.execute(q, (text,)).fetchone() sqlite3.DatabaseError: database disk image is malformed 2020-12-29 14:45:33,852 INFO init(75) new db size: 0.23828125 2020-12-29 14:45:33,858 INFO countdown(358) sleeping: 2 seconds 2020-12-29 14:45:37,591 INFO learn(63) checking submission 2020-12-29 14:45:39,860 INFO countdown(362) waking up 2020-12-29 14:45:39,861 INFO init(130) end main loop 2020-12-29 14:45:39,862 INFO init(71) THE BOT IS WORKING. IT WILL TAKE ABOUT 8 HOURS FOR IT TO LEARN AND START COMMENTING.

2020-12-29 14:45:39,863 INFO init(72) fast learning 2020-12-29 14:45:39,864 INFO learn(13) trying to learn 2020-12-29 14:45:39,864 INFO learn(17) db size: 0.4140625 2020-12-29 14:45:39,865 INFO learn(35) SUBREDDIT_LIST is active 2020-12-29 14:45:39,865 INFO learn(36) learning from: wholesomememes 2020-12-29 14:45:39,866 INFO learn(54) active db : /mnt/c/Users/root/reddit-karma-farming-bot/src/brains/wholesomememes.db 2020-12-29 14:45:39,881 INFO learn(59) looping through submissions 2020-12-29 14:45:40,214 INFO learn(63) checking submission 2020-12-29 14:45:41,792 INFO learn(63) checking submission 2020-12-29 14:45:42,734 INFO learn(102) database disk image is malformed Traceback (most recent call last): File "/mnt/c/Users/root/reddit-karma-farming-bot/src/learn.py", line 92, in learn comment_body.encode("utf8") File "/mnt/c/Users/root/reddit-karma-farming-bot/venv/lib/python3.6/site-packages/cobe/brain.py", line 125, in learn self._learn_tokens(tokens) File "/mnt/c/Users/root/reddit-karma-farming-bot/venv/lib/python3.6/site-packages/cobe/brain.py", line 180, in _learn_tokens stemmer=self.stemmer) File "/mnt/c/Users/root/reddit-karma-farming-bot/venv/lib/python3.6/site-packages/cobe/brain.py", line 530, in get_token_by_text row = c.execute(q, (text,)).fetchone() sqlite3.DatabaseError: database disk image is malformed2020-12-29 14:45:42,902 INFO learn(63) checking submission

2020-12-29 14:45:52,105 INFO init(75) new db size: 0.359375 2020-12-29 14:45:52,111 INFO countdown(358) sleeping: 2 seconds 2020-12-29 14:45:52,869 INFO learn(63) checking submission 2020-12-29 14:45:53,283 INFO learn(63) checking submission 2020-12-29 14:45:54,188 INFO learn(63) checking submission 2020-12-29 14:45:54,800 INFO learn(63) checking submission 2020-12-29 14:45:56,085 INFO learn(63) checking submission 2020-12-29 14:45:56,590 INFO learn(63) checking submission `

and

2020-12-29 14:46:36,666 INFO learn(63) checking submission 2020-12-29 14:46:36,788 INFO learn(102) database disk image is malformed Traceback (most recent call last): File "/mnt/c/Users/root/reddit-karma-farming-bot/src/learn.py", line 92, in learn comment_body.encode("utf8") File "/mnt/c/Users/root/reddit-karma-farming-bot/venv/lib/python3.6/site-packages/cobe/brain.py", line 125, in learn self._learn_tokens(tokens) File "/mnt/c/Users/root/reddit-karma-farming-bot/venv/lib/python3.6/site-packages/cobe/brain.py", line 180, in _learn_tokens stemmer=self.stemmer) File "/mnt/c/Users/root/reddit-karma-farming-bot/venv/lib/python3.6/site-packages/cobe/brain.py", line 530, in get_token_by_text row = c.execute(q, (text,)).fetchone()

kgbprofile commented 3 years ago

Do you get the same result if you clone the project to another directory and start anew?

ghost commented 3 years ago

it worked now, but my db size is 0.046875 MB (got the information from localhost site). It started with the size of 0.046 but in the settings the minimum size is 50mb (standard)

MrPowerScripts commented 3 years ago

this should all be resolved in the upcoming 4.0 release. try the rkfb4 branch for a previewe