Open fulacse opened 4 days ago
It's on our roadmap to enable batch processing through the SDK. In the meanwhile, if you really need this, you can use the raw model forwards, here's an example. https://github.com/evolutionaryscale/esm/blob/main/examples/seqfun_struct.py
How to make a tensor shaping [batch_size, seq_length] as input?