AccelerateWithOptane / lab

Request access to Optane powered bare metal infrastructure for performance-testing and analysis purposes
15 stars 3 forks source link

Request access to an Optane SSD-powered bare metal server #17

Open shinji-incorta opened 5 years ago

shinji-incorta commented 5 years ago

If you are interested in filing a request for access to the Accelerate With Optane Community Lab for performance testing, optimization, and analysis, please fill out the details below. Contact Avi Deitcher at avi@packet.net with questions.

Name, email, company, job title

Shinji Yoshida, shinji.yoshida@incorta.com, Senior Director of Engineering Hidetoshi Futagawa, hidetoshi.futagawa@incorta.com, Principal member of Technical Staff Note that projects with two or more participants are preferred.

Project Title and brief description

Incorta Analytics Server benchmark testing with Optane and IMDT

How does the open source community benefit from your work?

Incorta is in-memory analytic engine to provide super fast queries for BI tools. We can test this technology and provide any feedbacks and issues to the community

Is the code that you’re going to run 100% open source? If so, what is the URL or URLs where it is located?

No. It is a commercial software, not open source.

Does the infrastructure provided meet your testing needs (see: https://www.acceleratewithoptane.com/access/)?

Note that the configuration provided was created to enable testing flexibility across a range of potential use cases. Projects are expected to use one system due to limited supply. If additional resources are required, contact avi@packet.net

Yes

What performance-focused articles has your project published before?

Is your project intensely interested in performance, especially where disk I/O is concerned? Have you written about it or shared results of testing? Please share anything that shows your focus.

Incorta has two engines, in-memory and Apache Spark to process queries. One is very memory intensive and the other is I/O intensive operations. We plan to run partial TPC-DS and TPC-H bench mark against 1TB scale data.

Please state your contributions to the open source community and any other relevant initiatives

Feel free to brag a little bit about yourself!

I've been in Enterprise Software development for 20+ years. I'm currently leading a performance team and DevOps team at Incorta.

Would you be willing to share your analysis and results publicly?

We are interested in blog posts, meetups and conference presentations. Accelerate With Optane would be more than happy to host your blog posts or link to them, and may coordinate performance-oriented meetups and conferences. Are you open to sharing?

It is not my priority. If we can find anything interesting to others, we might.

Are you interested in testing Intel Optane SSDs with Intel Memory Drive Technology (IMDT)?

IMDT extends system memory transparently by integrating Intel Optane SSD capacity into the memory subsystem. The systems provided have 192GB of DRAM but can be enabled with 1.4TB of software-defined memory while leaving one Intel Optane SSD still available for fast storage/caching usage. Check here for more information on IMDT.

Yes, this is a primary purpose of this request so that we can test our in-memory engine against 1TB+ data.