databricks / megablocks

Apache License 2.0
1.22k stars 175 forks source link

Question on offsets in figures 5 #61

Closed DaehanKim closed 11 months ago

DaehanKim commented 11 months ago

image

Hi! I appreciate Mistral team for this amazing work. I was reading the paper and got stuck at what these offsets(row, column) mean in the figure 5. Can you elaborate please?

Thanks!

tgale96 commented 11 months ago

Hi! We don't work at Mistral, but thank you :)

The row/column offsets indicate the position where each row/column start in the compressed, nonzero data. You can learn more by reading about compressed sparse row/column sparse matrix formats!

yaof20 commented 4 months ago

image

Hi! I appreciate Mistral team for this amazing work. I was reading the paper and got stuck at what these offsets(row, column) mean in the figure 5. Can you elaborate please?

Thanks!

I would also suggest this blog post: https://www.geeksforgeeks.org/sparse-matrix-representations-set-3-csr/ which may be easier to understand. Hope this helps.