search

OdyseeTeam / chainquery

Chainquery parses and syncs the LBRY blockchain data into structured SQL
https://lbry.tech
MIT License
2.25k stars 42 forks source link

[dev.sh] trying to run from source "fcntl: too many open files" error #150

Open gubatron opened 4 years ago

gubatron commented 4 years ago

I'm on macOS 10.15.4 (Catalina), golang 1.14.3 darwin/amd64

Cloned the repo and tried running ./dev.sh, it always stops here. I usually raise the number of file descriptors allowed to see if this goes away, but any clue why this happens? (and how many file descriptors/sockets does chainquery actually need?)

$./dev.sh 
Starting service
migration/bindata.go
fcntl: too many open files

Note: other than this, I already setup the mysql 'chainquery' database with user 'lbry' password 'lbry', however I did not install the blockchain server, it'd be great if I could point this chainquery to an existing node as I'm running low on space and wouldn't want to download a full blockchain to this laptop. Is that possible? running chainquery against a remote blockchain instance?

tiger5226 commented 4 years ago

Sorry for the late reply. @kauffj did flag this to me but I misread the flag. Chainquery db uses 55GB to store the data. If you are running low on space for a lbrycrd node(which needs 15GB approximately), then there will definitely be an issue with the chainquery structured data in the database.

I use macos Catalina as well and am using 1.14.2 of go. I dont recall ever seeing that message. I may have increased it years ago. Definitely try increasing it since its os specific. My current settings are:

maxfiles: 49152 maxfilesperproc:24576

kauffj commented 4 years ago

chainquery lite mode when :grin: