go-ego / riot

Go Open Source, Distributed, Simple and efficient Search Engine; Warning: This is V1 and beta version, because of big memory consume, and the V2 will be rewrite all code.
Apache License 2.0
6.11k stars 474 forks source link

out of memory #105

Open elvin-du opened 4 years ago

elvin-du commented 4 years ago

goroutine 133 [running]: runtime.systemstack_switch() /home/elvindu/go/src/runtime/asm_amd64.s:330 fp=0xc00cef1d50 sp=0xc00cef1d48 pc=0x45a720 runtime.mallocgc(0x1356c000, 0x0, 0xc09260a000, 0x1356b8f9) /home/elvindu/go/src/runtime/malloc.go:1032 +0x895 fp=0xc00cef1df0 sp=0xc00cef1d50 pc=0x40de55 runtime.growslice(0xb3d9c0, 0xc0b2da8000, 0x0, 0x2000, 0x1356b8f9, 0x18, 0x20, 0x1) /home/elvindu/go/src/runtime/slice.go:175 +0x14e fp=0xc00cef1e58 sp=0xc00cef1df0 pc=0x44548e github.com/syndtr/goleveldb/leveldb.(dbIter).next(0xc00ec32480, 0x1) /home/elvindu/mygo/pkg/mod/github.com/syndtr/goleveldb@v1.0.0/leveldb/db_iter.go:213 +0x40f fp=0xc00cef1f08 sp=0xc00cef1e58 pc=0xa6ed4f github.com/syndtr/goleveldb/leveldb.(dbIter).Next(0xc00ec32480, 0x18) /home/elvindu/mygo/pkg/mod/github.com/syndtr/goleveldb@v1.0.0/leveldb/db_iter.go:245 +0xd9 fp=0xc00cef1f28 sp=0xc00cef1f08 pc=0xa6ef09 github.com/go-ego/riot/store.(Leveldb).ForEach(0xc000176070, 0xc00ec794a0, 0x421bd6c2, 0xc008501cf0) /home/elvindu/mygo/pkg/mod/github.com/elvin-du/riot@v0.0.0-20200130090822-1a5b261ad5b5/store/ldb_store.go:90 +0x64 fp=0xc00cef1fa0 sp=0xc00cef1f28 pc=0xa8eb94 github.com/go-ego/riot.(Engine).storeInit(0x13d0500, 0x1) /home/elvindu/mygo/pkg/mod/github.com/elvin-du/riot@v0.0.0-20200130090822-1a5b261ad5b5/store_worker.go:74 +0x86 fp=0xc00cef1fd0 sp=0xc00cef1fa0 pc=0xabe6c6 runtime.goexit() /home/elvindu/go/src/runtime/asm_amd64.s:1357 +0x1 fp=0xc00cef1fd8 sp=0xc00cef1fd0 pc=0x45c7f1 created by github.com/go-ego/riot.(*Engine).Store /home/elvindu/mygo/pkg/mod/github.com/elvin-du/riot@v0.0.0-20200130090822-1a5b261ad5b5/engine.go:208 +0x379

Description

Database is leveldB, data size is about 140m, out of memory error. ...