search

HDFGroup / datacontainer

Data Container Study
Other
8 stars 1 forks source link

Measure Hyrax performance. #32

Open hyoklee opened 8 years ago

hyoklee commented 8 years ago
  1. Install server on OSDC instance.
    1. Install from source. apt-get doesn't work and packages are old versions.
    2. Copy the NCEP data file.
  2. Run summary.py with as many clients as possible..
    1. Install PyDAP.
    2. Run it with Nova.
jreadey commented 8 years ago

Let's use the aggregated NCEP file for this.

hyoklee commented 8 years ago

Which file should I use - chunked or no_chunked/compressed? If chunk, which chunk shape file are you interested in it?

ghost commented 8 years ago

How about the 25x20x20 one? The "general" chunking option.

jreadey commented 8 years ago

We can start with that and try the other in turn.

hyoklee commented 8 years ago

I've finished baseline testing with localhost and a client from network. Since I'm not familiar with iPython parallel and reached my allocated hours for this month, I'll leave it to @jready for parallel testing. I can't wait to see h5serv's performance results, too.

jreadey commented 8 years ago

@hyokleee - Can you create a snapshot with the Hyrax image? Then we can just launch that anytime we want to try out OpenDAP.

hyoklee commented 8 years ago

@jreadey I created snapshot, "Hyrax".