swc-17 / SparseDrive

SparseDrive: End-to-End Autonomous Driving via Sparse Scene Representation
MIT License
318 stars 36 forks source link

Is clustering suitable for anchor polylines #2

Closed sunbin1357 closed 2 months ago

sunbin1357 commented 3 months ago

In sparsedrive, anchor polylines are obtained by K-Means clustering on the training set. However, polylines like pedestrian crossings are sparse. Is it possible that this might result in an inappropriate initial value?

swc-17 commented 3 months ago

You can visualize the initial predictions (before first decoder layer) in MapTR. The learned initial predictions are lines pointing in the longitudinal direction, which are dominated by divider and road boundary classes in the learning process. Still, after 6 decoder layers, these lines can be refined to the shape of ped crossing. We think that the influence of initial values is not significant.