search

athensresearch / athens

Athens is no longer maintainted. Athens was an open-source, collaborative knowledge graph, backed by YC W21
https://athensresearch.github.io/athens
Other
6.31k stars 397 forks source link

Trouble importing large Roam graph #1711

Open mtravers opened 2 years ago

mtravers commented 2 years ago

Problem I'm trying to import a large Roam graph (20K blocks, 1100 pages). When I try, Athens sits there for awhile, then the screen goes blank. I tried it with a new empty Athens database, same results.

I'm running the packaged app but I'm perfectly happy to run from source if there's some way to make this work (increase memory eg).

Screenshots/Demo Screen went blank

Athens Version image

mtravers commented 2 years ago

Same as #1450 I guess, sorry for the duplication.

mtravers commented 2 years ago

Tried changing to the 1.0.0-beta version, same results.

tangjeff0 commented 2 years ago

Hi @mtravers , are you looking for help to debug this issue? Got your messages on Twitter and Discord.

mtravers commented 2 years ago

Hi @mtravers , are you looking for help to debug this issue? Got your messages on Twitter and Discord.

Well...I'd like to be able to use Athens and willing to help out fixing it. My first thought was that it should have more memory allocated, but I don't know the Electron environment so not sure how to do that.

tangjeff0 commented 2 years ago

@mtravers we don't have a ton of time to point you in the right direction. I recommend importing to Obsidian or LogSeq in the meantime while we hash out our backend :)

mtravers commented 2 years ago

Thanks, those probably won't work for me, I need block-level structure. But I will work something out.

Do you have some sense for what the current limits of Athens are in terms of content size?

sawhney17 commented 2 years ago

@mtravers Logseq primarily does use a block level structure via an in memory datascript DB, the DB is just stored as markdown files on the disk, all operations with the graph happen via a proper block level DB. Block References, embeds almost as well as roam. Aa signifiant step above obsidian in that regard.