Closed mryab closed 9 months ago
In https://github.com/huggingface/transformers/commit/a796f7eea6c86b54671a6f522cebbe41f630bb62, Falcon started supporting the position_ids argument and passing it to the model. The current code for DistributedFalconModel.forward does not handle this argument, which results in errors when running tests. This PR fixes the problem by handling position_ids similarly to the LLaMA model.
DistributedFalconModel.forward
position_ids
In https://github.com/huggingface/transformers/commit/a796f7eea6c86b54671a6f522cebbe41f630bb62, Falcon started supporting the position_ids argument and passing it to the model. The current code for
DistributedFalconModel.forwarddoes not handle this argument, which results in errors when running tests. This PR fixes the problem by handlingposition_idssimilarly to the LLaMA model.