Explicit pointwise Conv1D implementation for "Latency" strategy

[jmduarte]

Description

This is mostly for discussion and to let others test it out like @Duchstf. This PR adds an explicit pointwise Conv1D implementation, where the reuse factor (RF) is used to split the layer execution and reuse the existing module RF times

Original pointwise Conv1D:

• (in_width, n_chan) -> (in_width, n_filt)

This PR splits it into RF calls of

• (in_width/RF, n_chan) -> (in_width/RF, n_filt)
• (in_width/RF, n_chan) -> (in_width/RF, n_filt)
• (in_width/RF, n_chan) -> (in_width/RF, n_filt)
• ...

The II ~ RF. To turn it on you have to configure ConvImplementation of the layer named <layer>

config["LayerName"]["<layer>"]["ConvImplementation"] = "Pointwise"

Limitations:

• Assumes in_width is divisible by RF
• Hardcoded explicit execution up to RF = 120. Could be automated with code generation.

Type of change

• [x] New feature (non-breaking change which adds functionality)
• [x] A new research paper code implementation

Tests

See test/pytest/test_pointwiseconv.py

Checklist

• [x] I have read the guidelines for contributing.
• [x] I have commented my code, particularly in hard-to-understand areas.
• [ ] I have made corresponding changes to the documentation.
• [ ] My changes generate no new warnings.
• [x] I have installed and run pre-commit on the files I edited or added.
• [x] I have added tests that prove my fix is effective or that my feature works.

[jmduarte]

pre-commit.ci autofix

[Duchstf]

@jmduarte Can you re-base this to the lastest changes from #815? I'd love to try this out after that!

[Duchstf]

@jmduarte I'm actually trying this out now, but I just realized it is in vivado, is it possible to update this to vitis?? I would be happy to contribute if you want!!

[jmduarte]

Superseded by #881