Duckietown Challenges Home Challenges Submissions

Job 39997

Job ID39997
submission11233
userBea Baselines 🐤
user labelstraight
challengeaido5-LFV-sim-validation
stepLFVv-sim
statussuccess
up to date Note that this job is not up to date; the challenge has been changed.
evaluatormont04-ef63c33f6e8a-1
date started
date completed
duration0:30:42
message
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.6639449931352248
survival_time_median9.400000000000029
deviation-center-line_median0.3470210429522098
in-drivable-lane_median4.9000000000000234


other stats
agent_compute-ego_max0.0191670028368632
agent_compute-ego_mean0.01819861476939407
agent_compute-ego_median0.01830069092575958
agent_compute-ego_min0.01702607438919392
agent_compute-npc0_max0.0771472175916036
agent_compute-npc0_mean0.06950197823954785
agent_compute-npc0_median0.07021243944235728
agent_compute-npc0_min0.06043581648187323
agent_compute-npc1_max0.07039502072841564
agent_compute-npc1_mean0.06441830960515599
agent_compute-npc1_median0.06396533861227915
agent_compute-npc1_min0.05934754046765003
agent_compute-npc2_max0.0732926893234253
agent_compute-npc2_mean0.06745858414129832
agent_compute-npc2_median0.06820427187791107
agent_compute-npc2_min0.06013310348594582
agent_compute-npc3_max0.07659282445907593
agent_compute-npc3_mean0.0706098513687849
agent_compute-npc3_median0.07112499458570007
agent_compute-npc3_min0.06359659184466351
complete-iteration_max1.6362354493141174
complete-iteration_mean1.5077763329880542
complete-iteration_median1.4917255236580185
complete-iteration_min1.4114188353220622
deviation-center-line_max0.45136971736575104
deviation-center-line_mean0.3219267968163614
deviation-center-line_min0.14229538399527486
deviation-heading_max2.246665255347337
deviation-heading_mean1.154680829931011
deviation-heading_median1.126064733276421
deviation-heading_min0.1199285978238638
driven_any_max2.4120543386243787
driven_any_mean1.5261643706030776
driven_any_median1.4996280355628613
driven_any_min0.6933470726622096
driven_lanedir_consec_max0.7187118392311596
driven_lanedir_consec_mean0.6363049781990596
driven_lanedir_consec_min0.4986180872946296
driven_lanedir_max0.7187118392311596
driven_lanedir_mean0.6363049781990596
driven_lanedir_median0.6639449931352248
driven_lanedir_min0.4986180872946296
get_duckie_state_max3.429169350482048e-06
get_duckie_state_mean3.0026239539036345e-06
get_duckie_state_median2.8804173371805032e-06
get_duckie_state_min2.8204917907714844e-06
get_robot_state_max0.05585449606507689
get_robot_state_mean0.05474373098941002
get_robot_state_median0.05491535502968105
get_robot_state_min0.05328971783320109
get_state_dump_max0.032138989326801704
get_state_dump_mean0.031002124971615422
get_state_dump_median0.030878100667606687
get_state_dump_min0.030113309224446615
get_ui_image_max0.09074368794759116
get_ui_image_mean0.08672462671314617
get_ui_image_median0.0876951407878957
get_ui_image_min0.08076453732920218
in-drivable-lane_max10.150000000000077
in-drivable-lane_mean4.987500000000031
in-drivable-lane_min0.0
per-episodes
details{"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 0.7233042781247007, "get_ui_image": 0.08940238901909361, "step_physics": 0.8595031728135779, "survival_time": 4.699999999999991, "driven_lanedir": 0.7187118392311596, "get_state_dump": 0.032138989326801704, "sim_render-ego": 0.008346826472180956, "get_robot_state": 0.0556556798042135, "sim_render-npc0": 0.007718702580066438, "sim_render-npc1": 0.007946823505645103, "sim_render-npc2": 0.008119940757751465, "sim_render-npc3": 0.008233415319564496, "get_duckie_state": 3.429169350482048e-06, "in-drivable-lane": 0.0, "agent_compute-ego": 0.01702607438919392, "deviation-heading": 0.5272680007558433, "agent_compute-npc0": 0.06723975627980333, "agent_compute-npc1": 0.06310565420921813, "agent_compute-npc2": 0.06634759142043743, "agent_compute-npc3": 0.06635915218515599, "complete-iteration": 1.493538204659807, "set_robot_commands": 0.005688477069773572, "deviation-center-line": 0.3660354566930221, "driven_lanedir_consec": 0.7187118392311596, "sim_compute_sim_state": 0.07991899835302475, "sim_compute_performance-ego": 0.005561580049230698, "sim_compute_performance-npc0": 0.005369521201925075, "sim_compute_performance-npc1": 0.005528239493674421, "sim_compute_performance-npc2": 0.005448871470512228, "sim_compute_performance-npc3": 0.005754085297280169}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 0.6933470726622096, "get_ui_image": 0.08076453732920218, "step_physics": 0.8807642433669541, "survival_time": 4.549999999999992, "driven_lanedir": 0.6930967234667, "get_state_dump": 0.03025459195231343, "sim_render-ego": 0.008379021843711098, "get_robot_state": 0.05585449606507689, "sim_render-npc0": 0.007745541059053861, "sim_render-npc1": 0.008028693251557403, "sim_render-npc2": 0.007665765154492724, "sim_render-npc3": 0.0077001760294149214, "get_duckie_state": 2.9108026525476475e-06, "in-drivable-lane": 0.0, "agent_compute-ego": 0.01893761131789658, "deviation-heading": 0.1199285978238638, "agent_compute-npc0": 0.06043581648187323, "agent_compute-npc1": 0.05934754046765003, "agent_compute-npc2": 0.06013310348594582, "agent_compute-npc3": 0.06359659184466351, "complete-iteration": 1.4899128426562298, "set_robot_commands": 0.005735664577274532, "deviation-center-line": 0.14229538399527486, "driven_lanedir_consec": 0.6930967234667, "sim_compute_sim_state": 0.08408947567363362, "sim_compute_performance-ego": 0.005774380086542486, "sim_compute_performance-npc0": 0.005290673329279973, "sim_compute_performance-npc1": 0.005361716825883467, "sim_compute_performance-npc2": 0.005150058767297766, "sim_compute_performance-npc3": 0.005220871705275316}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 2.275951793001022, "get_ui_image": 0.08598789255669777, "step_physics": 0.7580342157512692, "survival_time": 14.100000000000064, "driven_lanedir": 0.4986180872946296, "get_state_dump": 0.03150160938289994, "sim_render-ego": 0.00839851680376851, "get_robot_state": 0.05417503025514859, "sim_render-npc0": 0.008243276717814994, "sim_render-npc1": 0.007752596909272756, "sim_render-npc2": 0.0079160970998994, "sim_render-npc3": 0.007751327034429456, "get_duckie_state": 2.850032021813359e-06, "in-drivable-lane": 9.800000000000049, "agent_compute-ego": 0.01766377053362258, "deviation-heading": 2.246665255347337, "agent_compute-npc0": 0.07318512260491121, "agent_compute-npc1": 0.07039502072841564, "agent_compute-npc2": 0.07006095233538472, "agent_compute-npc3": 0.07589083698624415, "complete-iteration": 1.4114188353220622, "set_robot_commands": 0.00551462765281082, "deviation-center-line": 0.45136971736575104, "driven_lanedir_consec": 0.4986180872946296, "sim_compute_sim_state": 0.07955054611179001, "sim_compute_performance-ego": 0.005356173143319204, "sim_compute_performance-npc0": 0.0053148210471403515, "sim_compute_performance-npc1": 0.005287654856418042, "sim_compute_performance-npc2": 0.005239911113224976, "sim_compute_performance-npc3": 0.005329636817282819}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 2.4120543386243787, "get_ui_image": 0.09074368794759116, "step_physics": 0.950917627811432, "survival_time": 14.950000000000076, "driven_lanedir": 0.6347932628037495, "get_state_dump": 0.030113309224446615, "sim_render-ego": 0.008227470715840658, "get_robot_state": 0.05328971783320109, "sim_render-npc0": 0.00814190944035848, "sim_render-npc1": 0.007992626031239828, "sim_render-npc2": 0.008102917671203613, "sim_render-npc3": 0.00799315849939982, "get_duckie_state": 2.8204917907714844e-06, "in-drivable-lane": 10.150000000000077, "agent_compute-ego": 0.0191670028368632, "deviation-heading": 1.724861465796999, "agent_compute-npc0": 0.0771472175916036, "agent_compute-npc1": 0.06482502301534017, "agent_compute-npc2": 0.0732926893234253, "agent_compute-npc3": 0.07659282445907593, "complete-iteration": 1.6362354493141174, "set_robot_commands": 0.0053403051694234215, "deviation-center-line": 0.3280066292113975, "driven_lanedir_consec": 0.6347932628037495, "sim_compute_sim_state": 0.1050535535812378, "sim_compute_performance-ego": 0.005193716684977214, "sim_compute_performance-npc0": 0.0052848903338114425, "sim_compute_performance-npc1": 0.005247395038604736, "sim_compute_performance-npc2": 0.005569460391998291, "sim_compute_performance-npc3": 0.005256594022115072}}
set_robot_commands_max0.005735664577274532
set_robot_commands_mean0.005569768617320586
set_robot_commands_median0.005601552361292197
set_robot_commands_min0.0053403051694234215
sim_compute_performance-ego_max0.005774380086542486
sim_compute_performance-ego_mean0.0054714624910174
sim_compute_performance-ego_median0.005458876596274951
sim_compute_performance-ego_min0.005193716684977214
sim_compute_performance-npc0_max0.005369521201925075
sim_compute_performance-npc0_mean0.005314976478039211
sim_compute_performance-npc0_median0.005302747188210163
sim_compute_performance-npc0_min0.0052848903338114425
sim_compute_performance-npc1_max0.005528239493674421
sim_compute_performance-npc1_mean0.005356251553645166
sim_compute_performance-npc1_median0.005324685841150754
sim_compute_performance-npc1_min0.005247395038604736
sim_compute_performance-npc2_max0.005569460391998291
sim_compute_performance-npc2_mean0.005352075435758315
sim_compute_performance-npc2_median0.005344391291868603
sim_compute_performance-npc2_min0.005150058767297766
sim_compute_performance-npc3_max0.005754085297280169
sim_compute_performance-npc3_mean0.005390296960488344
sim_compute_performance-npc3_median0.005293115419698945
sim_compute_performance-npc3_min0.005220871705275316
sim_compute_sim_state_max0.1050535535812378
sim_compute_sim_state_mean0.08715314342992155
sim_compute_sim_state_median0.08200423701332918
sim_compute_sim_state_min0.07955054611179001
sim_render-ego_max0.00839851680376851
sim_render-ego_mean0.008337958958875305
sim_render-ego_median0.008362924157946027
sim_render-ego_min0.008227470715840658
sim_render-npc0_max0.008243276717814994
sim_render-npc0_mean0.007962357449323443
sim_render-npc0_median0.007943725249706171
sim_render-npc0_min0.007718702580066438
sim_render-npc1_max0.008028693251557403
sim_render-npc1_mean0.007930184924428771
sim_render-npc1_median0.007969724768442465
sim_render-npc1_min0.007752596909272756
sim_render-npc2_max0.008119940757751465
sim_render-npc2_mean0.0079511801708368
sim_render-npc2_median0.008009507385551506
sim_render-npc2_min0.007665765154492724
sim_render-npc3_max0.008233415319564496
sim_render-npc3_mean0.007919519220702173
sim_render-npc3_median0.007872242766914637
sim_render-npc3_min0.0077001760294149214
simulation-passed1
step_physics_max0.950917627811432
step_physics_mean0.8623048149358082
step_physics_median0.870133708090266
step_physics_min0.7580342157512692
survival_time_max14.950000000000076
survival_time_mean9.575000000000031
survival_time_min4.549999999999992

Highlights

39997

Click the images to see detailed statistics about the episode.

ETHZ_autolab_technical_track-sc0-0

ETHZ_autolab_technical_track-sc1-0

ETHZ_autolab_technical_track-sc2-0

ETHZ_autolab_technical_track-sc3-0

Artifacts

The artifacts are hidden.

Container logs

The logs are hidden.