search

carla-simulator / leaderboard

CARLA Autonomous Driving leaderboard
MIT License
156 stars 76 forks source link

Sensor limits. #175

Closed Kait0 closed 2 months ago

Kait0 commented 2 months ago

It appears to me from reading the code that this if statement is the wrong way around. The Qualifier limit is applied when not submitting to the qualifier.

if agent_track in (Track.SENSORS_QUALIFIER, Track.MAP_QUALIFIER):
        sensor_limits = SENSORS_LIMITS
else:
        sensor_limits = QUALIFIER_SENSORS_LIMITS

See here.

piqiuni commented 2 months ago

Got same error, the 2 limits maybe inverted in leaderboard/leaderboard/autoagents/agent_wrapper.py:

QUALIFIER_SENSORS_LIMITS = {
    'sensor.camera.rgb': 4,
    'sensor.lidar.ray_cast': 1,
    'sensor.other.radar': 2,
    'sensor.other.gnss': 1,
    'sensor.other.imu': 1,
    'sensor.opendrive_map': 1,
    'sensor.speedometer': 1
}
SENSORS_LIMITS = {
    'sensor.camera.rgb': 8,
    'sensor.lidar.ray_cast': 2,
    'sensor.other.radar': 4,
    'sensor.other.gnss': 1,
    'sensor.other.imu': 1,
    'sensor.opendrive_map': 1,
    'sensor.speedometer': 1
}
glopezdiest commented 2 months ago

Hello, yes, that is correct! Will fix it ASAP. Sorry about that