Duckietown Challenges Home Challenges Submissions

Submission 17493

Submission17493
Competingyes
Challengeaido-LFV_multi-sim-validation
UserBea Baselines 🐤
Date submitted
Last status update
Completecomplete
DetailsEvaluation is complete.
Sisters
Result💔
Jobssim-0of4: 107655 sim-1of4: 107676 sim-2of4: 107666 sim-3of4: 107649
Next
User labelbaseline-dagger-pytorch
Admin priority50
Blessingn/a
User priority50

107666

Click the images to see detailed statistics about the episode.

loop-000

107655

Click the images to see detailed statistics about the episode.

loop2-000

107649

Click the images to see detailed statistics about the episode.

zigzag-000

Evaluation jobs for this submission

See previous jobs for previous versions of challenges
Job IDstepstatusup to datedate starteddate completeddurationmessage
107676sim-1of4failedyes0:00:59
The container "solut [...]
The container "solution-ego0" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
107672sim-1of4failedyes0:00:58
The container "solut [...]
The container "solution-ego0" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
107668sim-1of4failedyes0:01:05
The container "solut [...]
The container "solution-ego0" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
107666sim-2of4successyes0:12:24
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median2.7749999999999697
driven_lanedir_consec_median8.660576514705571
deviation-center-line_median2.842710207871604


other stats
deviation-center-line_max3.1991343833705717
deviation-center-line_mean2.7401664566000017
deviation-center-line_min2.0761110272862275
deviation-heading_max16.68498623931829
deviation-heading_mean14.824442384637424
deviation-heading_median15.485702203102282
deviation-heading_min11.641378893026848
distance-from-start_max3.2712070480133035
distance-from-start_mean2.7723108982228153
distance-from-start_median2.9209458767445367
distance-from-start_min1.9761447913888852
driven_any_max10.445907633304964
driven_any_mean9.996648554906578
driven_any_median9.938221761402442
driven_any_min9.664243063516464
driven_lanedir_consec_max10.16350516118358
driven_lanedir_consec_mean8.939036757736801
driven_lanedir_consec_min8.271488840352475
driven_lanedir_max10.16350516118358
driven_lanedir_mean8.939036757736801
driven_lanedir_median8.660576514705571
driven_lanedir_min8.271488840352475
in-drivable-lane_max4.349999999999926
in-drivable-lane_mean2.4749999999999663
in-drivable-lane_min0.0
per-episodes
details{"loop-000-ego0": {"driven_any": 10.445907633304964, "survival_time": 59.99999999999873, "driven_lanedir": 10.16350516118358, "in-drivable-lane": 0.0, "deviation-heading": 11.641378893026848, "distance-from-start": 1.9761447913888852, "deviation-center-line": 2.0761110272862275, "driven_lanedir_consec": 10.16350516118358}, "loop-000-ego1": {"driven_any": 9.664243063516464, "survival_time": 59.99999999999873, "driven_lanedir": 8.3710860251561, "in-drivable-lane": 3.399999999999909, "deviation-heading": 15.77165477718182, "distance-from-start": 3.2292335760264668, "deviation-center-line": 2.973463701460172, "driven_lanedir_consec": 8.3710860251561}, "loop-000-ego2": {"driven_any": 9.782402407839689, "survival_time": 59.99999999999873, "driven_lanedir": 8.271488840352475, "in-drivable-lane": 4.349999999999926, "deviation-heading": 15.199749629022742, "distance-from-start": 3.2712070480133035, "deviation-center-line": 2.711956714283035, "driven_lanedir_consec": 8.271488840352475}, "loop-000-ego3": {"driven_any": 10.094041114965195, "survival_time": 59.99999999999873, "driven_lanedir": 8.950067004255045, "in-drivable-lane": 2.1500000000000306, "deviation-heading": 16.68498623931829, "distance-from-start": 2.6126581774626065, "deviation-center-line": 3.1991343833705717, "driven_lanedir_consec": 8.950067004255045}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
107664sim-1of4failedyes0:01:06
The container "solut [...]
The container "solution-ego2" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
107663sim-2of4failedyes0:00:58
The container "solut [...]
The container "solution-ego0" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
107661sim-1of4failedyes0:01:02
The container "solut [...]
The container "solution-ego0" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
107655sim-0of4successyes0:06:47
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median28.674999999998924
driven_lanedir_consec_median4.95015380141164
deviation-center-line_median2.1626209603550643


other stats
deviation-center-line_max2.922336959713525
deviation-center-line_mean2.1626209603550643
deviation-center-line_min1.4029049609966031
deviation-heading_max17.084802488475987
deviation-heading_mean13.632297355911204
deviation-heading_median13.632297355911204
deviation-heading_min10.17979222334642
distance-from-start_max1.6249895773986731
distance-from-start_mean1.61418767403886
distance-from-start_median1.61418767403886
distance-from-start_min1.6033857706790464
driven_any_max11.424503653371923
driven_any_mean8.590480255337432
driven_any_median8.590480255337432
driven_any_min5.756456857302942
driven_lanedir_consec_max6.87633899689053
driven_lanedir_consec_mean4.95015380141164
driven_lanedir_consec_min3.02396860593275
driven_lanedir_max6.87633899689053
driven_lanedir_mean4.95015380141164
driven_lanedir_median4.95015380141164
driven_lanedir_min3.02396860593275
in-drivable-lane_max39.349999999998566
in-drivable-lane_mean28.674999999998924
in-drivable-lane_min17.999999999999282
per-episodes
details{"loop2-000-ego0": {"driven_any": 5.756456857302942, "survival_time": 59.99999999999873, "driven_lanedir": 3.02396860593275, "in-drivable-lane": 39.349999999998566, "deviation-heading": 10.17979222334642, "distance-from-start": 1.6033857706790464, "deviation-center-line": 1.4029049609966031, "driven_lanedir_consec": 3.02396860593275}, "loop2-000-ego1": {"driven_any": 11.424503653371923, "survival_time": 59.99999999999873, "driven_lanedir": 6.87633899689053, "in-drivable-lane": 17.999999999999282, "deviation-heading": 17.084802488475987, "distance-from-start": 1.6249895773986731, "deviation-center-line": 2.922336959713525, "driven_lanedir_consec": 6.87633899689053}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
107649sim-3of4successyes0:14:57
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median0.7250000000000103
driven_lanedir_consec_median8.92755177598239
deviation-center-line_median3.273075074097952


other stats
deviation-center-line_max3.826962493134712
deviation-center-line_mean3.280365800212508
deviation-center-line_min2.7483505595194155
deviation-heading_max14.840207949349368
deviation-heading_mean14.31057727878151
deviation-heading_median14.558295477144323
deviation-heading_min13.28551021148803
distance-from-start_max4.506909454899043
distance-from-start_mean3.8410931557107126
distance-from-start_median3.796640794609389
distance-from-start_min3.264181578725029
driven_any_max10.16919626260356
driven_any_mean9.571786345612338
driven_any_median9.458331195888302
driven_any_min9.201286728069189
driven_lanedir_consec_max9.661727839949425
driven_lanedir_consec_mean9.030248526766512
driven_lanedir_consec_min8.604162715151848
driven_lanedir_max9.661727839949425
driven_lanedir_mean9.030248526766512
driven_lanedir_median8.92755177598239
driven_lanedir_min8.604162715151848
in-drivable-lane_max1.599999999999909
in-drivable-lane_mean0.7624999999999824
in-drivable-lane_min0.0
per-episodes
details{"zigzag-000-ego0": {"driven_any": 10.16919626260356, "survival_time": 59.99999999999873, "driven_lanedir": 9.661727839949425, "in-drivable-lane": 0.0, "deviation-heading": 14.840207949349368, "distance-from-start": 3.83347292881979, "deviation-center-line": 2.958256059338183, "driven_lanedir_consec": 9.661727839949425}, "zigzag-000-ego1": {"driven_any": 9.361485880813836, "survival_time": 59.99999999999873, "driven_lanedir": 8.709544032993266, "in-drivable-lane": 1.599999999999909, "deviation-heading": 14.823489341628608, "distance-from-start": 3.264181578725029, "deviation-center-line": 3.587894088857721, "driven_lanedir_consec": 8.709544032993266}, "zigzag-000-ego2": {"driven_any": 9.555176510962768, "survival_time": 59.99999999999873, "driven_lanedir": 9.145559518971512, "in-drivable-lane": 0.0, "deviation-heading": 13.28551021148803, "distance-from-start": 3.759808660398989, "deviation-center-line": 2.7483505595194155, "driven_lanedir_consec": 9.145559518971512}, "zigzag-000-ego3": {"driven_any": 9.201286728069189, "survival_time": 59.99999999999873, "driven_lanedir": 8.604162715151848, "in-drivable-lane": 1.4500000000000206, "deviation-heading": 14.293101612660038, "distance-from-start": 4.506909454899043, "deviation-center-line": 3.826962493134712, "driven_lanedir_consec": 8.604162715151848}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible