QUESTION: how to add a new type of gpu for roller?

microsoft / nnfusion

A flexible and efficient deep neural network (DNN) compiler that generates high-performance executable from a DNN model description.

MIT License

955 stars 159 forks source link

QUESTION: how to add a new type of gpu for roller? #517

Open cavalry-yu opened 1 year ago

cavalry-yu commented 1 year ago

Hi! I've seen that there are some config files in nnfusion/artifacs/roller/arch/ like V100, K80 and IPU. If I want to add a new GPU like 3090, how to set the config file? Which parameters are necessary？

xysmlx commented 1 year ago

Hi, sorry for late reply.

You can try this experimental RTX3090 config file. Roller requires the information (e.g., bandwidth, transaction size, etc) of each layer in the hardware to calculate proper tile configs for each layer. One of our on-going works is providing a set of micro-benchmarks to automatically provide such information.