AccelerateWithOptane / lab

Request access to Optane powered bare metal infrastructure for performance-testing and analysis purposes
15 stars 3 forks source link

Request for Semester Research Project #22

Closed wyjw closed 3 years ago

wyjw commented 4 years ago

If you are interested in filing a request for access to the Accelerate With Optane Community Lab for performance testing, optimization, and analysis, please fill out the details below. Contact Avi Deitcher at avi@packet.net with questions.

Name, email, company, job title

Yu Jian Wu. MS student in Computer Science at Columbia University. yw3338@columbia.edu One partner who I will update with his info when details are finalized.

Taking a graduate seminar on Storage Systems (taught by Prof Asaf Cidon) and this will be the semester-long research project.

Note that projects with two or more participants are preferred.

Project Title and brief description

We want to run Spark workloads on NVM and compare that with workloads on DRAM.

How does the open source community benefit from your work?

Will open source code and describe our results.

Is the code that you’re going to run 100% open source? If so, what is the URL or URLs where it is located?

Spark is an open-source framework.

Does the infrastructure provided meet your testing needs (see: https://www.acceleratewithoptane.com/access/)?

Note that the configuration provided was created to enable testing flexibility across a range of potential use cases. Projects are expected to use one system due to limited supply. If additional resources are required, contact avi@packet.net

Yes.

What performance-focused articles has your project published before?

Is your project intensely interested in performance, especially where disk I/O is concerned? Have you written about it or shared results of testing? Please share anything that shows your focus.

Have done other research work on comparisons of performance of systems.

Please state your contributions to the open source community and any other relevant initiatives

Feel free to brag a little bit about yourself!

Would you be willing to share your analysis and results publicly?

We are interested in blog posts, meetups and conference presentations. Accelerate With Optane would be more than happy to host your blog posts or link to them, and may coordinate performance-oriented meetups and conferences. Are you open to sharing?

Sure.

Are you interested in testing Intel Optane SSDs with Intel Memory Drive Technology (IMDT)?

IMDT extends system memory transparently by integrating Intel Optane SSD capacity into the memory subsystem. The systems provided have 192GB of DRAM but can be enabled with 1.4TB of software-defined memory while leaving one Intel Optane SSD still available for fast storage/caching usage. Check here for more information on IMDT.

Sure.