Should I expect the LBC agent code to run properly on CARLA 0.9.10.1? about 2020_carla_challenge HOT 6 CLOSED

i havent ported this to use 0.9.10.1 yet, but will be working on this in the coming week

from 2020_carla_challenge.

Hey Brady, thanks for the response.

I looked on the Leaderboard website recently and saw that LBC has results up for version 0.9.10.1 - are there plans to make that code publicly available?

from 2020_carla_challenge.

should be ready now! try the newest commit

from 2020_carla_challenge.

Thanks Brady! Will the team be providing updated weights for any of the networks?

from 2020_carla_challenge.

i won't be retraining this model using data collected in 0.9.10.1,
but our old model weights are public and you can try those!

from 2020_carla_challenge.

Just tried them out and ran the image agent on every route available in the data directory (mixed with the all scenarios json file) - there were only 4 routes where the RouteCompletion metric was not zero.

The results on the Leaderboard website indicate a 17% completion rate (I assume on some held-out test set), which is far higher than what I saw on the training + testing routes. Is this known behavior, or am I doing something wrong?

from 2020_carla_challenge.