Duckietown Challenges Home Challenges Submissions

Submission 4448

Submission4448
Competingyes
Challengeaido3-LFV-sim-validation
UserBea Baselines 🐤
Date submitted
Last status update
Completecomplete
DetailsEvaluation is complete.
Sisters
Result💚
Jobsstep1-simulation: 27505
Next
User labelchallenge-aido_LF-baseline-duckietown
Admin priority50
Blessingn/a
User priority50

27505

Click the images to see detailed statistics about the episode.

ETHZ_autolab_technical_track-0-0

ETHZ_autolab_technical_track-1-0

ETHZ_autolab_technical_track-2-0

ETHZ_autolab_technical_track-3-0

ETHZ_autolab_technical_track-4-0

Evaluation jobs for this submission

Show only up-to-date jobs
Job IDstepstatusup to datedate starteddate completeddurationmessage
27505step1-simulationsuccessyes0:10:53
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.6028475743001249
survival_time_median4.699999999999991
deviation-center-line_median0.1352199109716624
in-drivable-lane_median0.29999999999999893


other stats
agent_compute-ego_max0.057156499925550525
agent_compute-ego_mean0.048319615109820954
agent_compute-ego_median0.0569403332270933
agent_compute-ego_min0.028294887948543467
deviation-center-line_max0.35637049501919293
deviation-center-line_mean0.19770630419704327
deviation-center-line_min0.12419750681753255
deviation-heading_max1.5722458540281
deviation-heading_mean1.1776742996263716
deviation-heading_median1.1073800715233726
deviation-heading_min0.8210615280105624
driven_any_max1.3044020749939629
driven_any_mean0.8142823210412127
driven_any_median0.6940608313363241
driven_any_min0.6615160721897169
driven_lanedir_consec_max1.2649784517293112
driven_lanedir_consec_mean0.73965781967137
driven_lanedir_consec_min0.5420736860933055
driven_lanedir_max1.2649784517293112
driven_lanedir_mean0.73965781967137
driven_lanedir_median0.6028475743001249
driven_lanedir_min0.5420736860933055
in-drivable-lane_max0.3999999999999986
in-drivable-lane_mean0.20999999999999924
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.6940608313363241, "sim_physics": 0.19856052703045785, "survival_time": 4.699999999999991, "driven_lanedir": 0.6028475743001249, "sim_render-ego": 0.013036946032909636, "in-drivable-lane": 0.29999999999999893, "agent_compute-ego": 0.028294887948543467, "deviation-heading": 1.1073800715233726, "set_robot_commands": 0.01099270962654276, "deviation-center-line": 0.1352199109716624, "driven_lanedir_consec": 0.6028475743001249, "sim_compute_sim_state": 0.0048152411237676095, "sim_compute_performance-ego": 0.0075348894646827215, "sim_compute_robot_state-ego": 0.009094905345997911, "sim_compute_robot_state-npc0": 0.010016796436715634, "sim_compute_robot_state-npc1": 0.00904377724261994, "sim_compute_robot_state-npc2": 0.009057019619231528, "sim_compute_robot_state-npc3": 0.008441077901961956}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.7338406738122635, "sim_physics": 0.2073512685542204, "survival_time": 4.899999999999991, "driven_lanedir": 0.715037809936103, "sim_render-ego": 0.012917749735773826, "in-drivable-lane": 0, "agent_compute-ego": 0.04219796949503373, "deviation-heading": 0.8210615280105624, "set_robot_commands": 0.01086924513991998, "deviation-center-line": 0.24221303809300887, "driven_lanedir_consec": 0.715037809936103, "sim_compute_sim_state": 0.005389982340287189, "sim_compute_performance-ego": 0.007351094362687091, "sim_compute_robot_state-ego": 0.009706268505174288, "sim_compute_robot_state-npc0": 0.009802976433111696, "sim_compute_robot_state-npc1": 0.0094110868415054, "sim_compute_robot_state-npc2": 0.009169593149301956, "sim_compute_robot_state-npc3": 0.009272524288722448}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.3044020749939629, "sim_physics": 0.2353447428821812, "survival_time": 8.449999999999985, "driven_lanedir": 1.2649784517293112, "sim_render-ego": 0.013245650297085914, "in-drivable-lane": 0, "agent_compute-ego": 0.057008384952883746, "deviation-heading": 1.5722458540281, "set_robot_commands": 0.01162897482426209, "deviation-center-line": 0.35637049501919293, "driven_lanedir_consec": 1.2649784517293112, "sim_compute_sim_state": 0.005356018359844501, "sim_compute_performance-ego": 0.007665792160485623, "sim_compute_robot_state-ego": 0.009847023077970423, "sim_compute_robot_state-npc0": 0.00971287242054234, "sim_compute_robot_state-npc1": 0.009554565305540549, "sim_compute_robot_state-npc2": 0.009739458208253398, "sim_compute_robot_state-npc3": 0.009548909565400795}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.6775919528737955, "sim_physics": 0.26097930656684626, "survival_time": 4.549999999999992, "driven_lanedir": 0.5733515762980054, "sim_render-ego": 0.013769262439602024, "in-drivable-lane": 0.34999999999999876, "agent_compute-ego": 0.057156499925550525, "deviation-heading": 1.0929916538507043, "set_robot_commands": 0.011124576841081892, "deviation-center-line": 0.12419750681753255, "driven_lanedir_consec": 0.5733515762980054, "sim_compute_sim_state": 0.005640208066164792, "sim_compute_performance-ego": 0.00793258698432, "sim_compute_robot_state-ego": 0.010217923384446364, "sim_compute_robot_state-npc0": 0.009871126531244634, "sim_compute_robot_state-npc1": 0.00979506838452685, "sim_compute_robot_state-npc2": 0.010007153500567426, "sim_compute_robot_state-npc3": 0.009890013998681372}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.6615160721897169, "sim_physics": 0.23056062151876727, "survival_time": 4.449999999999992, "driven_lanedir": 0.5420736860933055, "sim_render-ego": 0.014508555444438806, "in-drivable-lane": 0.3999999999999986, "agent_compute-ego": 0.0569403332270933, "deviation-heading": 1.2946923907191177, "set_robot_commands": 0.010508623016014528, "deviation-center-line": 0.13053057008381952, "driven_lanedir_consec": 0.5420736860933055, "sim_compute_sim_state": 0.005596699339620183, "sim_compute_performance-ego": 0.007873446753855502, "sim_compute_robot_state-ego": 0.009924690375167333, "sim_compute_robot_state-npc0": 0.009714523058259086, "sim_compute_robot_state-npc1": 0.009467896450771377, "sim_compute_robot_state-npc2": 0.009295519818080944, "sim_compute_robot_state-npc3": 0.009364342421628116}}
set_robot_commands_max0.01162897482426209
set_robot_commands_mean0.011024825889564252
set_robot_commands_median0.01099270962654276
set_robot_commands_min0.010508623016014528
sim_compute_performance-ego_max0.00793258698432
sim_compute_performance-ego_mean0.007671561945206187
sim_compute_performance-ego_median0.007665792160485623
sim_compute_performance-ego_min0.007351094362687091
sim_compute_robot_state-ego_max0.010217923384446364
sim_compute_robot_state-ego_mean0.009758162137751266
sim_compute_robot_state-ego_median0.009847023077970423
sim_compute_robot_state-ego_min0.009094905345997911
sim_compute_robot_state-npc0_max0.010016796436715634
sim_compute_robot_state-npc0_mean0.00982365897597468
sim_compute_robot_state-npc0_median0.009802976433111696
sim_compute_robot_state-npc0_min0.00971287242054234
sim_compute_robot_state-npc1_max0.00979506838452685
sim_compute_robot_state-npc1_mean0.009454478844992825
sim_compute_robot_state-npc1_median0.009467896450771377
sim_compute_robot_state-npc1_min0.00904377724261994
sim_compute_robot_state-npc2_max0.010007153500567426
sim_compute_robot_state-npc2_mean0.009453748859087051
sim_compute_robot_state-npc2_median0.009295519818080944
sim_compute_robot_state-npc2_min0.009057019619231528
sim_compute_robot_state-npc3_max0.009890013998681372
sim_compute_robot_state-npc3_mean0.009303373635278936
sim_compute_robot_state-npc3_median0.009364342421628116
sim_compute_robot_state-npc3_min0.008441077901961956
sim_compute_sim_state_max0.005640208066164792
sim_compute_sim_state_mean0.005359629845936855
sim_compute_sim_state_median0.005389982340287189
sim_compute_sim_state_min0.0048152411237676095
sim_physics_max0.26097930656684626
sim_physics_mean0.2265592933104946
sim_physics_median0.23056062151876727
sim_physics_min0.19856052703045785
sim_render-ego_max0.014508555444438806
sim_render-ego_mean0.013495632789962042
sim_render-ego_median0.013245650297085914
sim_render-ego_min0.012917749735773826
simulation-passed1
survival_time_max8.449999999999985
survival_time_mean5.40999999999999
survival_time_min4.449999999999992
No reset possible
25614step1-simulationsuccessno0:08:17
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
25613step1-simulationsuccessno0:10:36
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
25612step1-simulationsuccessno0:11:46
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
25485step1-simulationsuccessno0:08:30
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
25484step1-simulationerrorno0:02:07
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible