open-power / capiflash

Flash Acceleration with CAPI - The IBM Data Engine for NoSQL
22 stars 12 forks source link

How to enable NVMe drivers in this board? #24

Closed msharmavikram closed 6 years ago

msharmavikram commented 6 years ago

Hi there, I am using this system with 2 boards. I configured it to have a legacy mode and I see the devices getting configured as regular block sd* devices. How do I enable NVMe drivers for these SSDs/

Machine: IBM Minsky platform. OS: Ubuntu 16.04

vageline commented 6 years ago

I assume you have "FlashGT" cards, where each card has two M.2 NVMe sticks. Our capiflash software uses the scsi stack. An NVMe driver is not available. To use in legacy mode, mkfs to a /dev/sd device listed with cxlfstatus and mount the fs. We also have a "superpipe" block r/w interface which bypasses the kernel: cblk_open(/dev/sg), cblk_read(),cblk_write(),cblk_close()

msharmavikram commented 6 years ago

Thanks @vageline I was able to do the things you mentioned. Given that M.2 are NVMe compatible, I was wondering if there is a method to use NVMe.

vageline commented 6 years ago

for the best performance with legacy, use multi-queue with 40 queues