bio4j / bio4j-titan

Titan-specific bio4j implementation
https://github.com/bio4j/bio4j
6 stars 2 forks source link

Help need to use local storage on AWS for the importing process #37

Closed pablopareja closed 9 years ago

pablopareja commented 9 years ago

Hi @eparejatobes

I would need some guidelines to know the best way to use several disks as just one drive on AWS so that all the files fits when importing Bio4j.

eparejatobes commented 9 years ago

I'm looking at it, a simple RAID0 conf should be pretty straightforward

laughedelic commented 9 years ago

How big is it expected to be?

pablopareja commented 9 years ago

About 1 TB, maybe a bit more... (the DB data would actually be less than 1TB but you need space for both the temporal data and at least the last XML that will be imported)

pablopareja commented 9 years ago

so?

eparejatobes commented 9 years ago

For one-off testing you can just set the right block device mapping when launching the instance (I mean get all the instance storage devices there) and then do something like

but for the instance storage devices

eparejatobes commented 9 years ago

@pablopareja could you document somewhere what you're doing exactly with this?

pablopareja commented 9 years ago

where should I write it?

eparejatobes commented 9 years ago

somewhere in docs

eparejatobes commented 9 years ago

@pablopareja is this done somewhere?

pablopareja commented 9 years ago

Yeah, I wrote a nice short description in some issue... let me look it up a second

eparejatobes commented 9 years ago

ping @pablopareja

pablopareja commented 9 years ago

Isn't this enough? https://github.com/bio4j/bio4j-titan/blob/master/docs/ImportingTitanBio4j.md

eparejatobes commented 9 years ago

yup @pablopareja thanks