Duckietown Challenges Home Challenges Submissions

Submission 12703

Submission12703
Competingyes
Challengeaido5-LFV_multi-sim-validation
UserBea Baselines 🐤
Date submitted
Last status update
Completecomplete
DetailsEvaluation is complete.
Sisters
Result💚
JobsLFVmultibodyv-sim: 53773
Next
User labelbaseline-behavior-cloning
Admin priority50
Blessingn/a
User priority50

53773

Click the images to see detailed statistics about the episode.

LFV_multi-norm-loop-000

LFV_multi-norm-small_loop-000

LFV_multi-norm-techtrack-000

LFV_multi-norm-zigzag-000

Evaluation jobs for this submission

See previous jobs for previous versions of challenges
Job IDstepstatusup to datedate starteddate completeddurationmessage
53773LFVmultibodyv-simsuccessyes1:39:55
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median8.082295144233397
survival_time_median56.14999999999895
deviation-center-line_median2.166982892319907
in-drivable-lane_median2.349999999999996


other stats
agent_compute-ego0_max0.034800181281655955
agent_compute-ego0_mean0.033323069829875915
agent_compute-ego0_median0.03283659185803234
agent_compute-ego0_min0.032601911801486215
agent_compute-ego1_max0.034371385367883436
agent_compute-ego1_mean0.03285393196310093
agent_compute-ego1_median0.0323411226272583
agent_compute-ego1_min0.03201186828476062
agent_compute-ego2_max0.03386333820524065
agent_compute-ego2_mean0.032570857219019825
agent_compute-ego2_median0.0319278083237889
agent_compute-ego2_min0.03192142512802994
agent_compute-ego3_max0.03448274550489542
agent_compute-ego3_mean0.03264901455620222
agent_compute-ego3_median0.031804692702785506
agent_compute-ego3_min0.03165960546092575
complete-iteration_max1.1314549357108843
complete-iteration_mean0.8621200810576352
complete-iteration_median0.9278974493377712
complete-iteration_min0.3059859284394079
deviation-center-line_max4.128104091484665
deviation-center-line_mean2.065491931026578
deviation-center-line_min0.4995981958735234
deviation-heading_max13.569563663412136
deviation-heading_mean7.928786477783681
deviation-heading_median7.402204609566509
deviation-heading_min1.770530703934101
driven_any_max14.59013926453797
driven_any_mean8.787223498373665
driven_any_median8.659738073838724
driven_any_min3.132702751215601
driven_lanedir_consec_max13.468248042861925
driven_lanedir_consec_mean7.927097498149409
driven_lanedir_consec_min1.5015129455584593
driven_lanedir_max13.468248042861925
driven_lanedir_mean7.927097498149409
driven_lanedir_median8.082295144233397
driven_lanedir_min1.5015129455584593
get_duckie_state_max1.227223334471697e-06
get_duckie_state_mean1.1703873319030705e-06
get_duckie_state_median1.1720427069239176e-06
get_duckie_state_min1.1029003335417605e-06
get_robot_state_max0.013915203691620711
get_robot_state_mean0.01278337428839446
get_robot_state_median0.013698717465803523
get_robot_state_min0.006887067993767828
get_state_dump_max0.009351860176613686
get_state_dump_mean0.008745546324826601
get_state_dump_median0.00916443006848101
get_state_dump_min0.005894546028521421
get_ui_image_max0.05040236396853076
get_ui_image_mean0.04480637180911212
get_ui_image_median0.04796974317029792
get_ui_image_min0.02967484134564297
in-drivable-lane_max52.3499999999987
in-drivable-lane_mean9.599999999999742
in-drivable-lane_min0.0
per-episodes
details{"LFV_multi-norm-loop-000-ego0": {"driven_any": 11.215403526258427, "get_ui_image": 0.04361277352024228, "step_physics": 0.5541156990672346, "survival_time": 56.14999999999895, "driven_lanedir": 10.904211979543934, "get_state_dump": 0.00916443006848101, "get_robot_state": 0.013684354855072457, "sim_render-ego0": 0.0037345676235456906, "sim_render-ego1": 0.00369227123430191, "sim_render-ego2": 0.0036636981251400983, "sim_render-ego3": 0.003542340735099494, "get_duckie_state": 1.145639453494252e-06, "in-drivable-lane": 0.4500000000000064, "deviation-heading": 7.292490419185475, "agent_compute-ego0": 0.03283659185803234, "agent_compute-ego1": 0.032270319733331214, "agent_compute-ego2": 0.0319278083237889, "agent_compute-ego3": 0.031804692702785506, "complete-iteration": 0.8050749344333635, "set_robot_commands": 0.0020669053882042283, "deviation-center-line": 2.078873716556975, "driven_lanedir_consec": 10.904211979543934, "sim_compute_sim_state": 0.024812982387814233, "sim_compute_performance-ego0": 0.001909660274872152, "sim_compute_performance-ego1": 0.0019061281163497328, "sim_compute_performance-ego2": 0.001893443569169774, "sim_compute_performance-ego3": 0.0018478313799006232}, "LFV_multi-norm-loop-000-ego1": {"driven_any": 13.47756706837109, "get_ui_image": 0.04361277352024228, "step_physics": 0.5541156990672346, "survival_time": 56.14999999999895, "driven_lanedir": 13.113812419019206, "get_state_dump": 0.00916443006848101, "get_robot_state": 0.013684354855072457, "sim_render-ego0": 0.0037345676235456906, "sim_render-ego1": 0.00369227123430191, "sim_render-ego2": 0.0036636981251400983, "sim_render-ego3": 0.003542340735099494, "get_duckie_state": 1.145639453494252e-06, "in-drivable-lane": 0.5500000000000078, "deviation-heading": 7.511918799947544, "agent_compute-ego0": 0.03283659185803234, "agent_compute-ego1": 0.032270319733331214, "agent_compute-ego2": 0.0319278083237889, "agent_compute-ego3": 0.031804692702785506, "complete-iteration": 0.8050749344333635, "set_robot_commands": 0.0020669053882042283, "deviation-center-line": 2.2550920680828392, "driven_lanedir_consec": 13.113812419019206, "sim_compute_sim_state": 0.024812982387814233, "sim_compute_performance-ego0": 0.001909660274872152, "sim_compute_performance-ego1": 0.0019061281163497328, "sim_compute_performance-ego2": 0.001893443569169774, "sim_compute_performance-ego3": 0.0018478313799006232}, "LFV_multi-norm-loop-000-ego2": {"driven_any": 8.023821018456836, "get_ui_image": 0.04361277352024228, "step_physics": 0.5541156990672346, "survival_time": 56.14999999999895, "driven_lanedir": 6.642858134718575, "get_state_dump": 0.00916443006848101, "get_robot_state": 0.013684354855072457, "sim_render-ego0": 0.0037345676235456906, "sim_render-ego1": 0.00369227123430191, "sim_render-ego2": 0.0036636981251400983, "sim_render-ego3": 0.003542340735099494, "get_duckie_state": 1.145639453494252e-06, "in-drivable-lane": 27.299999999998704, "deviation-heading": 6.177453763993405, "agent_compute-ego0": 0.03283659185803234, "agent_compute-ego1": 0.032270319733331214, "agent_compute-ego2": 0.0319278083237889, "agent_compute-ego3": 0.031804692702785506, "complete-iteration": 0.8050749344333635, "set_robot_commands": 0.0020669053882042283, "deviation-center-line": 1.275093320622896, "driven_lanedir_consec": 6.642858134718575, "sim_compute_sim_state": 0.024812982387814233, "sim_compute_performance-ego0": 0.001909660274872152, "sim_compute_performance-ego1": 0.0019061281163497328, "sim_compute_performance-ego2": 0.001893443569169774, "sim_compute_performance-ego3": 0.0018478313799006232}, "LFV_multi-norm-loop-000-ego3": {"driven_any": 8.023962897333199, "get_ui_image": 0.04361277352024228, "step_physics": 0.5541156990672346, "survival_time": 56.14999999999895, "driven_lanedir": 7.9432861055445, "get_state_dump": 0.00916443006848101, "get_robot_state": 0.013684354855072457, "sim_render-ego0": 0.0037345676235456906, "sim_render-ego1": 0.00369227123430191, "sim_render-ego2": 0.0036636981251400983, "sim_render-ego3": 0.003542340735099494, "get_duckie_state": 1.145639453494252e-06, "in-drivable-lane": 0.0, "deviation-heading": 6.127275418957405, "agent_compute-ego0": 0.03283659185803234, "agent_compute-ego1": 0.032270319733331214, "agent_compute-ego2": 0.0319278083237889, "agent_compute-ego3": 0.031804692702785506, "complete-iteration": 0.8050749344333635, "set_robot_commands": 0.0020669053882042283, "deviation-center-line": 1.6158092083148012, "driven_lanedir_consec": 7.9432861055445, "sim_compute_sim_state": 0.024812982387814233, "sim_compute_performance-ego0": 0.001909660274872152, "sim_compute_performance-ego1": 0.0019061281163497328, "sim_compute_performance-ego2": 0.001893443569169774, "sim_compute_performance-ego3": 0.0018478313799006232}, "LFV_multi-norm-zigzag-000-ego0": {"driven_any": 14.59013926453797, "get_ui_image": 0.05040236396853076, "step_physics": 0.644353162636864, "survival_time": 59.99999999999873, "driven_lanedir": 12.958561233419328, "get_state_dump": 0.009351860176613686, "get_robot_state": 0.013915203691620711, "sim_render-ego0": 0.003683345502461125, "sim_render-ego1": 0.0036467618489642623, "sim_render-ego2": 0.003634819281686851, "sim_render-ego3": 0.0036912508352313017, "get_duckie_state": 1.1720427069239176e-06, "in-drivable-lane": 4.099999999999996, "deviation-heading": 12.91635896993827, "agent_compute-ego0": 0.034800181281655955, "agent_compute-ego1": 0.034371385367883436, "agent_compute-ego2": 0.03386333820524065, "agent_compute-ego3": 0.03448274550489542, "complete-iteration": 0.9278974493377712, "set_robot_commands": 0.0021907514973941392, "deviation-center-line": 3.136313162745333, "driven_lanedir_consec": 12.958561233419328, "sim_compute_sim_state": 0.04145114606465031, "sim_compute_performance-ego0": 0.0019106257468040145, "sim_compute_performance-ego1": 0.0018855429608855617, "sim_compute_performance-ego2": 0.001888182637693483, "sim_compute_performance-ego3": 0.001856537484606537}, "LFV_multi-norm-zigzag-000-ego1": {"driven_any": 14.590101365571186, "get_ui_image": 0.05040236396853076, "step_physics": 0.644353162636864, "survival_time": 59.99999999999873, "driven_lanedir": 13.468248042861925, "get_state_dump": 0.009351860176613686, "get_robot_state": 0.013915203691620711, "sim_render-ego0": 0.003683345502461125, "sim_render-ego1": 0.0036467618489642623, "sim_render-ego2": 0.003634819281686851, "sim_render-ego3": 0.0036912508352313017, "get_duckie_state": 1.1720427069239176e-06, "in-drivable-lane": 1.8999999999999744, "deviation-heading": 13.569563663412136, "agent_compute-ego0": 0.034800181281655955, "agent_compute-ego1": 0.034371385367883436, "agent_compute-ego2": 0.03386333820524065, "agent_compute-ego3": 0.03448274550489542, "complete-iteration": 0.9278974493377712, "set_robot_commands": 0.0021907514973941392, "deviation-center-line": 3.4210805897719614, "driven_lanedir_consec": 13.468248042861925, "sim_compute_sim_state": 0.04145114606465031, "sim_compute_performance-ego0": 0.0019106257468040145, "sim_compute_performance-ego1": 0.0018855429608855617, "sim_compute_performance-ego2": 0.001888182637693483, "sim_compute_performance-ego3": 0.001856537484606537}, "LFV_multi-norm-zigzag-000-ego2": {"driven_any": 14.590131191211542, "get_ui_image": 0.05040236396853076, "step_physics": 0.644353162636864, "survival_time": 59.99999999999873, "driven_lanedir": 13.292045122272611, "get_state_dump": 0.009351860176613686, "get_robot_state": 0.013915203691620711, "sim_render-ego0": 0.003683345502461125, "sim_render-ego1": 0.0036467618489642623, "sim_render-ego2": 0.003634819281686851, "sim_render-ego3": 0.0036912508352313017, "get_duckie_state": 1.1720427069239176e-06, "in-drivable-lane": 2.749999999999897, "deviation-heading": 12.83358992094231, "agent_compute-ego0": 0.034800181281655955, "agent_compute-ego1": 0.034371385367883436, "agent_compute-ego2": 0.03386333820524065, "agent_compute-ego3": 0.03448274550489542, "complete-iteration": 0.9278974493377712, "set_robot_commands": 0.0021907514973941392, "deviation-center-line": 3.2040632248099095, "driven_lanedir_consec": 13.292045122272611, "sim_compute_sim_state": 0.04145114606465031, "sim_compute_performance-ego0": 0.0019106257468040145, "sim_compute_performance-ego1": 0.0018855429608855617, "sim_compute_performance-ego2": 0.001888182637693483, "sim_compute_performance-ego3": 0.001856537484606537}, "LFV_multi-norm-zigzag-000-ego3": {"driven_any": 3.915255351505443, "get_ui_image": 0.05040236396853076, "step_physics": 0.644353162636864, "survival_time": 59.99999999999873, "driven_lanedir": 1.5015129455584593, "get_state_dump": 0.009351860176613686, "get_robot_state": 0.013915203691620711, "sim_render-ego0": 0.003683345502461125, "sim_render-ego1": 0.0036467618489642623, "sim_render-ego2": 0.003634819281686851, "sim_render-ego3": 0.0036912508352313017, "get_duckie_state": 1.1720427069239176e-06, "in-drivable-lane": 52.3499999999987, "deviation-heading": 3.6631555814654617, "agent_compute-ego0": 0.034800181281655955, "agent_compute-ego1": 0.034371385367883436, "agent_compute-ego2": 0.03386333820524065, "agent_compute-ego3": 0.03448274550489542, "complete-iteration": 0.9278974493377712, "set_robot_commands": 0.0021907514973941392, "deviation-center-line": 0.553818699230186, "driven_lanedir_consec": 1.5015129455584593, "sim_compute_sim_state": 0.04145114606465031, "sim_compute_performance-ego0": 0.0019106257468040145, "sim_compute_performance-ego1": 0.0018855429608855617, "sim_compute_performance-ego2": 0.001888182637693483, "sim_compute_performance-ego3": 0.001856537484606537}, "LFV_multi-norm-techtrack-000-ego0": {"driven_any": 9.295513250344248, "get_ui_image": 0.04796974317029792, "step_physics": 0.8751866662900434, "survival_time": 50.84999999999925, "driven_lanedir": 8.221304182922294, "get_state_dump": 0.009145848877537697, "get_robot_state": 0.013698717465803523, "sim_render-ego0": 0.003588544127983288, "sim_render-ego1": 0.003577204490691599, "sim_render-ego2": 0.003536342169306367, "sim_render-ego3": 0.003525668370934507, "get_duckie_state": 1.227223334471697e-06, "in-drivable-lane": 2.4499999999999744, "deviation-heading": 12.375077177212953, "agent_compute-ego0": 0.032601911801486215, "agent_compute-ego1": 0.0323411226272583, "agent_compute-ego2": 0.03192142512802994, "agent_compute-ego3": 0.03165960546092575, "complete-iteration": 1.1314549357108843, "set_robot_commands": 0.002023835079140654, "deviation-center-line": 4.128104091484665, "driven_lanedir_consec": 8.221304182922294, "sim_compute_sim_state": 0.02683038631918857, "sim_compute_performance-ego0": 0.0018446773349184889, "sim_compute_performance-ego1": 0.0018535004617657317, "sim_compute_performance-ego2": 0.0018642995587032295, "sim_compute_performance-ego3": 0.0018477015973074264}, "LFV_multi-norm-techtrack-000-ego1": {"driven_any": 3.4262092209388495, "get_ui_image": 0.04796974317029792, "step_physics": 0.8751866662900434, "survival_time": 50.84999999999925, "driven_lanedir": 3.052663982149284, "get_state_dump": 0.009145848877537697, "get_robot_state": 0.013698717465803523, "sim_render-ego0": 0.003588544127983288, "sim_render-ego1": 0.003577204490691599, "sim_render-ego2": 0.003536342169306367, "sim_render-ego3": 0.003525668370934507, "get_duckie_state": 1.227223334471697e-06, "in-drivable-lane": 0.4500000000000064, "deviation-heading": 10.940050548441974, "agent_compute-ego0": 0.032601911801486215, "agent_compute-ego1": 0.0323411226272583, "agent_compute-ego2": 0.03192142512802994, "agent_compute-ego3": 0.03165960546092575, "complete-iteration": 1.1314549357108843, "set_robot_commands": 0.002023835079140654, "deviation-center-line": 2.943035804278242, "driven_lanedir_consec": 3.052663982149284, "sim_compute_sim_state": 0.02683038631918857, "sim_compute_performance-ego0": 0.0018446773349184889, "sim_compute_performance-ego1": 0.0018535004617657317, "sim_compute_performance-ego2": 0.0018642995587032295, "sim_compute_performance-ego3": 0.0018477015973074264}, "LFV_multi-norm-techtrack-000-ego2": {"driven_any": 3.4262361651453075, "get_ui_image": 0.04796974317029792, "step_physics": 0.8751866662900434, "survival_time": 50.84999999999925, "driven_lanedir": 3.190950600830093, "get_state_dump": 0.009145848877537697, "get_robot_state": 0.013698717465803523, "sim_render-ego0": 0.003588544127983288, "sim_render-ego1": 0.003577204490691599, "sim_render-ego2": 0.003536342169306367, "sim_render-ego3": 0.003525668370934507, "get_duckie_state": 1.227223334471697e-06, "in-drivable-lane": 37.14999999999919, "deviation-heading": 1.770530703934101, "agent_compute-ego0": 0.032601911801486215, "agent_compute-ego1": 0.0323411226272583, "agent_compute-ego2": 0.03192142512802994, "agent_compute-ego3": 0.03165960546092575, "complete-iteration": 1.1314549357108843, "set_robot_commands": 0.002023835079140654, "deviation-center-line": 0.4995981958735234, "driven_lanedir_consec": 3.190950600830093, "sim_compute_sim_state": 0.02683038631918857, "sim_compute_performance-ego0": 0.0018446773349184889, "sim_compute_performance-ego1": 0.0018535004617657317, "sim_compute_performance-ego2": 0.0018642995587032295, "sim_compute_performance-ego3": 0.0018477015973074264}, "LFV_multi-norm-techtrack-000-ego3": {"driven_any": 12.181312006139803, "get_ui_image": 0.04796974317029792, "step_physics": 0.8751866662900434, "survival_time": 50.84999999999925, "driven_lanedir": 11.189548338513225, "get_state_dump": 0.009145848877537697, "get_robot_state": 0.013698717465803523, "sim_render-ego0": 0.003588544127983288, "sim_render-ego1": 0.003577204490691599, "sim_render-ego2": 0.003536342169306367, "sim_render-ego3": 0.003525668370934507, "get_duckie_state": 1.227223334471697e-06, "in-drivable-lane": 2.699999999999946, "deviation-heading": 10.025123656669871, "agent_compute-ego0": 0.032601911801486215, "agent_compute-ego1": 0.0323411226272583, "agent_compute-ego2": 0.03192142512802994, "agent_compute-ego3": 0.03165960546092575, "complete-iteration": 1.1314549357108843, "set_robot_commands": 0.002023835079140654, "deviation-center-line": 2.4247805431805127, "driven_lanedir_consec": 11.189548338513225, "sim_compute_sim_state": 0.02683038631918857, "sim_compute_performance-ego0": 0.0018446773349184889, "sim_compute_performance-ego1": 0.0018535004617657317, "sim_compute_performance-ego2": 0.0018642995587032295, "sim_compute_performance-ego3": 0.0018477015973074264}, "LFV_multi-norm-small_loop-000-ego0": {"driven_any": 3.132773900201777, "get_ui_image": 0.02967484134564297, "step_physics": 0.17409982955713066, "survival_time": 13.850000000000062, "driven_lanedir": 3.0887020789687285, "get_state_dump": 0.005894546028521421, "get_robot_state": 0.006887067993767828, "sim_render-ego0": 0.0035538004456664163, "sim_render-ego1": 0.00352346039504456, "get_duckie_state": 1.1029003335417605e-06, "in-drivable-lane": 0.0, "deviation-heading": 1.8935548407627265, "agent_compute-ego0": 0.0327841189267824, "agent_compute-ego1": 0.03201186828476062, "complete-iteration": 0.3059859284394079, "set_robot_commands": 0.0020324317671412185, "deviation-center-line": 0.6117330164672249, "driven_lanedir_consec": 3.0887020789687285, "sim_compute_sim_state": 0.0097288622272958, "sim_compute_performance-ego0": 0.001820194635459845, "sim_compute_performance-ego1": 0.0018316284358072623}, "LFV_multi-norm-small_loop-000-ego1": {"driven_any": 3.132702751215601, "get_ui_image": 0.02967484134564297, "step_physics": 0.17409982955713066, "survival_time": 13.850000000000062, "driven_lanedir": 2.411659807769554, "get_state_dump": 0.005894546028521421, "get_robot_state": 0.006887067993767828, "sim_render-ego0": 0.0035538004456664163, "sim_render-ego1": 0.00352346039504456, "get_duckie_state": 1.1029003335417605e-06, "in-drivable-lane": 2.2500000000000178, "deviation-heading": 3.906867224107887, "agent_compute-ego0": 0.0327841189267824, "agent_compute-ego1": 0.03201186828476062, "complete-iteration": 0.3059859284394079, "set_robot_commands": 0.0020324317671412185, "deviation-center-line": 0.7694913929530208, "driven_lanedir_consec": 2.411659807769554, "sim_compute_sim_state": 0.0097288622272958, "sim_compute_performance-ego0": 0.001820194635459845, "sim_compute_performance-ego1": 0.0018316284358072623}}
set_robot_commands_max0.0021907514973941392
set_robot_commands_mean0.0020850593852313228
set_robot_commands_median0.0020669053882042283
set_robot_commands_min0.002023835079140654
sim_compute_performance-ego0_max0.0019106257468040145
sim_compute_performance-ego0_mean0.0018785887640927364
sim_compute_performance-ego0_median0.001909660274872152
sim_compute_performance-ego0_min0.001820194635459845
sim_compute_performance-ego1_max0.0019061281163497328
sim_compute_performance-ego1_mean0.001874567359115616
sim_compute_performance-ego1_median0.0018855429608855617
sim_compute_performance-ego1_min0.0018316284358072623
sim_compute_performance-ego2_max0.001893443569169774
sim_compute_performance-ego2_mean0.0018819752551888288
sim_compute_performance-ego2_median0.001888182637693483
sim_compute_performance-ego2_min0.0018642995587032295
sim_compute_performance-ego3_max0.001856537484606537
sim_compute_performance-ego3_mean0.0018506901539381956
sim_compute_performance-ego3_median0.0018478313799006232
sim_compute_performance-ego3_min0.0018477015973074264
sim_compute_sim_state_max0.04145114606465031
sim_compute_sim_state_mean0.027988270252943134
sim_compute_sim_state_median0.02683038631918857
sim_compute_sim_state_min0.0097288622272958
sim_render-ego0_max0.0037345676235456906
sim_render-ego0_mean0.003652387850520946
sim_render-ego0_median0.003683345502461125
sim_render-ego0_min0.0035538004456664163
sim_render-ego1_max0.00369227123430191
sim_render-ego1_mean0.003622276506137157
sim_render-ego1_median0.0036467618489642623
sim_render-ego1_min0.00352346039504456
sim_render-ego2_max0.0036636981251400983
sim_render-ego2_mean0.003611619858711105
sim_render-ego2_median0.003634819281686851
sim_render-ego2_min0.003536342169306367
sim_render-ego3_max0.0036912508352313017
sim_render-ego3_mean0.003586419980421768
sim_render-ego3_median0.003542340735099494
sim_render-ego3_min0.003525668370934507
simulation-passed1
step_physics_max0.8751866662900434
step_physics_mean0.6173444122207734
step_physics_median0.644353162636864
step_physics_min0.17409982955713066
survival_time_max59.99999999999873
survival_time_mean49.69285714285627
survival_time_min13.850000000000062
No reset possible