Duckietown Challenges Home Challenges Submissions

Job 33209

Job ID33209
submission6724
userBea Baselines 🐤
user labeltemplate-ros
challengeaido5-LFV_multi-sim-validation
stepLFVmultibodyv-sim
statussuccess
up to date Note that this job is not up to date; the challenge has been changed.
evaluatorp-1
date started
date completed
duration0:06:16
message
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.2854660888970464
survival_time_median1.3000000000000005
deviation-center-line_median0.06284413452560553
in-drivable-lane_median0.0


other stats
agent_compute-ego0_max0.048596822298490085
agent_compute-ego0_mean0.04615533453786475
agent_compute-ego0_median0.04495227336883545
agent_compute-ego0_min0.044916907946268715
agent_compute-ego1_max0.04541206359863281
agent_compute-ego1_mean0.044886120160420734
agent_compute-ego1_median0.04481577277183533
agent_compute-ego1_min0.04443052411079407
agent_compute-ego2_max0.0469281581731943
agent_compute-ego2_mean0.046215080807351656
agent_compute-ego2_median0.04665221770604452
agent_compute-ego2_min0.04506486654281616
complete-iteration_max1.0589382006571844
complete-iteration_mean1.0482011620814984
complete-iteration_median1.0508465468883514
complete-iteration_min1.0348187386989594
deviation-center-line_max0.17558186710680573
deviation-center-line_mean0.07497020349885104
deviation-center-line_min0.03023162811959447
deviation-heading_max0.4256838142434032
deviation-heading_mean0.2585336484276801
deviation-heading_median0.24941907306017713
deviation-heading_min0.11294399362033967
driven_any_max0.5067267887685254
driven_any_mean0.3604012772023528
driven_any_median0.29543199872934806
driven_any_min0.2790450441091847
driven_lanedir_consec_max0.5042949535567818
driven_lanedir_consec_mean0.351058153912489
driven_lanedir_consec_min0.25792366855908844
driven_lanedir_max0.5042949535567818
driven_lanedir_mean0.351058153912489
driven_lanedir_median0.2854660888970464
driven_lanedir_min0.25792366855908844
get_state_dump_max0.0481567919254303
get_state_dump_mean0.047535333419457454
get_state_dump_median0.04745464141552265
get_state_dump_min0.046994566917419434
get_ui_image_max0.13541080401493952
get_ui_image_mean0.13124667487592775
get_ui_image_median0.1309635818004608
get_ui_image_min0.12736563881238305
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"ETHZ_autolab_technical_track-0-0-ego0": {"driven_any": 0.29543199872934806, "get_ui_image": 0.13541080401493952, "step_physics": 0.514568989093487, "survival_time": 1.3000000000000005, "driven_lanedir": 0.2854660888970464, "get_state_dump": 0.04745464141552265, "sim_render-ego0": 0.007368317017188439, "sim_render-ego1": 0.007294664016136756, "sim_render-ego2": 0.007060436102060171, "in-drivable-lane": 0.0, "deviation-heading": 0.24097801149263123, "agent_compute-ego0": 0.048596822298490085, "agent_compute-ego1": 0.04541206359863281, "agent_compute-ego2": 0.0469281581731943, "complete-iteration": 1.0589382006571844, "set_robot_commands": 0.007056382986215444, "deviation-center-line": 0.05243521053902064, "driven_lanedir_consec": 0.2854660888970464, "sim_compute_sim_state": 0.06450929091526912, "sim_compute_performance-ego0": 0.005904445281395545, "sim_compute_performance-ego1": 0.006155958542456994, "sim_compute_performance-ego2": 0.006141039041372446, "sim_compute_robot_state-ego0": 0.011104051883404072, "sim_compute_robot_state-ego1": 0.010487593137300933, "sim_compute_robot_state-ego2": 0.010460119981032152, "sim_compute_robot_state-parked0": 0.010785708060631383, "sim_compute_robot_state-parked1": 0.009820048625652607, "sim_compute_robot_state-parked2": 0.010119484021113468, "sim_compute_robot_state-parked3": 0.010705067561222956, "sim_compute_robot_state-parked4": 0.011164701901949368, "sim_compute_robot_state-parked5": 0.01049809272472675}, "ETHZ_autolab_technical_track-0-0-ego1": {"driven_any": 0.2954319987293505, "get_ui_image": 0.13541080401493952, "step_physics": 0.514568989093487, "survival_time": 1.3000000000000005, "driven_lanedir": 0.2916225894959399, "get_state_dump": 0.04745464141552265, "sim_render-ego0": 0.007368317017188439, "sim_render-ego1": 0.007294664016136756, "sim_render-ego2": 0.007060436102060171, "in-drivable-lane": 0.0, "deviation-heading": 0.1262889439224917, "agent_compute-ego0": 0.048596822298490085, "agent_compute-ego1": 0.04541206359863281, "agent_compute-ego2": 0.0469281581731943, "complete-iteration": 1.0589382006571844, "set_robot_commands": 0.007056382986215444, "deviation-center-line": 0.04867126635386884, "driven_lanedir_consec": 0.2916225894959399, "sim_compute_sim_state": 0.06450929091526912, "sim_compute_performance-ego0": 0.005904445281395545, "sim_compute_performance-ego1": 0.006155958542456994, "sim_compute_performance-ego2": 0.006141039041372446, "sim_compute_robot_state-ego0": 0.011104051883404072, "sim_compute_robot_state-ego1": 0.010487593137300933, "sim_compute_robot_state-ego2": 0.010460119981032152, "sim_compute_robot_state-parked0": 0.010785708060631383, "sim_compute_robot_state-parked1": 0.009820048625652607, "sim_compute_robot_state-parked2": 0.010119484021113468, "sim_compute_robot_state-parked3": 0.010705067561222956, "sim_compute_robot_state-parked4": 0.011164701901949368, "sim_compute_robot_state-parked5": 0.01049809272472675}, "ETHZ_autolab_technical_track-0-0-ego2": {"driven_any": 0.29543199872934783, "get_ui_image": 0.13541080401493952, "step_physics": 0.514568989093487, "survival_time": 1.3000000000000005, "driven_lanedir": 0.27329084181707186, "get_state_dump": 0.04745464141552265, "sim_render-ego0": 0.007368317017188439, "sim_render-ego1": 0.007294664016136756, "sim_render-ego2": 0.007060436102060171, "in-drivable-lane": 0.0, "deviation-heading": 0.4241066870766807, "agent_compute-ego0": 0.048596822298490085, "agent_compute-ego1": 0.04541206359863281, "agent_compute-ego2": 0.0469281581731943, "complete-iteration": 1.0589382006571844, "set_robot_commands": 0.007056382986215444, "deviation-center-line": 0.0778327622118958, "driven_lanedir_consec": 0.27329084181707186, "sim_compute_sim_state": 0.06450929091526912, "sim_compute_performance-ego0": 0.005904445281395545, "sim_compute_performance-ego1": 0.006155958542456994, "sim_compute_performance-ego2": 0.006141039041372446, "sim_compute_robot_state-ego0": 0.011104051883404072, "sim_compute_robot_state-ego1": 0.010487593137300933, "sim_compute_robot_state-ego2": 0.010460119981032152, "sim_compute_robot_state-parked0": 0.010785708060631383, "sim_compute_robot_state-parked1": 0.009820048625652607, "sim_compute_robot_state-parked2": 0.010119484021113468, "sim_compute_robot_state-parked3": 0.010705067561222956, "sim_compute_robot_state-parked4": 0.011164701901949368, "sim_compute_robot_state-parked5": 0.01049809272472675}, "ETHZ_autolab_technical_track-0-1-ego0": {"driven_any": 0.5067267887685215, "get_ui_image": 0.1309635818004608, "step_physics": 0.5058795154094696, "survival_time": 2.000000000000001, "driven_lanedir": 0.5042949535567818, "get_state_dump": 0.0481567919254303, "sim_render-ego0": 0.007485884428024292, "sim_render-ego1": 0.007285004854202271, "sim_render-ego2": 0.007696110010147095, "in-drivable-lane": 0.0, "deviation-heading": 0.1941428917269147, "agent_compute-ego0": 0.04495227336883545, "agent_compute-ego1": 0.04481577277183533, "agent_compute-ego2": 0.04506486654281616, "complete-iteration": 1.0508465468883514, "set_robot_commands": 0.007170838117599487, "deviation-center-line": 0.034019277966619695, "driven_lanedir_consec": 0.5042949535567818, "sim_compute_sim_state": 0.06848450303077698, "sim_compute_performance-ego0": 0.0063568115234375, "sim_compute_performance-ego1": 0.006329745054244995, "sim_compute_performance-ego2": 0.006470495462417602, "sim_compute_robot_state-ego0": 0.01091899275779724, "sim_compute_robot_state-ego1": 0.010983258485794067, "sim_compute_robot_state-ego2": 0.011155885457992554, "sim_compute_robot_state-parked0": 0.011061197519302369, "sim_compute_robot_state-parked1": 0.011175411939620973, "sim_compute_robot_state-parked2": 0.010639554262161255, "sim_compute_robot_state-parked3": 0.01119304895401001, "sim_compute_robot_state-parked4": 0.011205685138702392, "sim_compute_robot_state-parked5": 0.010863959789276125}, "ETHZ_autolab_technical_track-0-1-ego1": {"driven_any": 0.5067267887685218, "get_ui_image": 0.1309635818004608, "step_physics": 0.5058795154094696, "survival_time": 2.000000000000001, "driven_lanedir": 0.49725990941494747, "get_state_dump": 0.0481567919254303, "sim_render-ego0": 0.007485884428024292, "sim_render-ego1": 0.007285004854202271, "sim_render-ego2": 0.007696110010147095, "in-drivable-lane": 0.0, "deviation-heading": 0.2965974608483565, "agent_compute-ego0": 0.04495227336883545, "agent_compute-ego1": 0.04481577277183533, "agent_compute-ego2": 0.04506486654281616, "complete-iteration": 1.0508465468883514, "set_robot_commands": 0.007170838117599487, "deviation-center-line": 0.17558186710680573, "driven_lanedir_consec": 0.49725990941494747, "sim_compute_sim_state": 0.06848450303077698, "sim_compute_performance-ego0": 0.0063568115234375, "sim_compute_performance-ego1": 0.006329745054244995, "sim_compute_performance-ego2": 0.006470495462417602, "sim_compute_robot_state-ego0": 0.01091899275779724, "sim_compute_robot_state-ego1": 0.010983258485794067, "sim_compute_robot_state-ego2": 0.011155885457992554, "sim_compute_robot_state-parked0": 0.011061197519302369, "sim_compute_robot_state-parked1": 0.011175411939620973, "sim_compute_robot_state-parked2": 0.010639554262161255, "sim_compute_robot_state-parked3": 0.01119304895401001, "sim_compute_robot_state-parked4": 0.011205685138702392, "sim_compute_robot_state-parked5": 0.010863959789276125}, "ETHZ_autolab_technical_track-0-1-ego2": {"driven_any": 0.5067267887685254, "get_ui_image": 0.1309635818004608, "step_physics": 0.5058795154094696, "survival_time": 2.000000000000001, "driven_lanedir": 0.502699138983365, "get_state_dump": 0.0481567919254303, "sim_render-ego0": 0.007485884428024292, "sim_render-ego1": 0.007285004854202271, "sim_render-ego2": 0.007696110010147095, "in-drivable-lane": 0.0, "deviation-heading": 0.24941907306017713, "agent_compute-ego0": 0.04495227336883545, "agent_compute-ego1": 0.04481577277183533, "agent_compute-ego2": 0.04506486654281616, "complete-iteration": 1.0508465468883514, "set_robot_commands": 0.007170838117599487, "deviation-center-line": 0.10927530776247374, "driven_lanedir_consec": 0.502699138983365, "sim_compute_sim_state": 0.06848450303077698, "sim_compute_performance-ego0": 0.0063568115234375, "sim_compute_performance-ego1": 0.006329745054244995, "sim_compute_performance-ego2": 0.006470495462417602, "sim_compute_robot_state-ego0": 0.01091899275779724, "sim_compute_robot_state-ego1": 0.010983258485794067, "sim_compute_robot_state-ego2": 0.011155885457992554, "sim_compute_robot_state-parked0": 0.011061197519302369, "sim_compute_robot_state-parked1": 0.011175411939620973, "sim_compute_robot_state-parked2": 0.010639554262161255, "sim_compute_robot_state-parked3": 0.01119304895401001, "sim_compute_robot_state-parked4": 0.011205685138702392, "sim_compute_robot_state-parked5": 0.010863959789276125}, "ETHZ_autolab_technical_track-0-2-ego0": {"driven_any": 0.27904504410918823, "get_ui_image": 0.12736563881238305, "step_physics": 0.5053004125754038, "survival_time": 1.2000000000000004, "driven_lanedir": 0.2702189877808481, "get_state_dump": 0.046994566917419434, "sim_render-ego0": 0.007193754116694133, "sim_render-ego1": 0.007342447837193807, "sim_render-ego2": 0.006613016128540039, "in-drivable-lane": 0.0, "deviation-heading": 0.25664195985812654, "agent_compute-ego0": 0.044916907946268715, "agent_compute-ego1": 0.04443052411079407, "agent_compute-ego2": 0.04665221770604452, "complete-iteration": 1.0348187386989594, "set_robot_commands": 0.007008214791615804, "deviation-center-line": 0.06284413452560553, "driven_lanedir_consec": 0.2702189877808481, "sim_compute_sim_state": 0.065969318151474, "sim_compute_performance-ego0": 0.006256550550460815, "sim_compute_performance-ego1": 0.0058317482471466064, "sim_compute_performance-ego2": 0.005430946747461955, "sim_compute_robot_state-ego0": 0.01143824060757955, "sim_compute_robot_state-ego1": 0.009916086991628012, "sim_compute_robot_state-ego2": 0.010054906209309896, "sim_compute_robot_state-parked0": 0.010474562644958496, "sim_compute_robot_state-parked1": 0.010347386201222738, "sim_compute_robot_state-parked2": 0.010733018318812052, "sim_compute_robot_state-parked3": 0.01073002815246582, "sim_compute_robot_state-parked4": 0.01038577159245809, "sim_compute_robot_state-parked5": 0.010274986426035564}, "ETHZ_autolab_technical_track-0-2-ego1": {"driven_any": 0.2790450441091847, "get_ui_image": 0.12736563881238305, "step_physics": 0.5053004125754038, "survival_time": 1.2000000000000004, "driven_lanedir": 0.276747206707312, "get_state_dump": 0.046994566917419434, "sim_render-ego0": 0.007193754116694133, "sim_render-ego1": 0.007342447837193807, "sim_render-ego2": 0.006613016128540039, "in-drivable-lane": 0.0, "deviation-heading": 0.11294399362033967, "agent_compute-ego0": 0.044916907946268715, "agent_compute-ego1": 0.04443052411079407, "agent_compute-ego2": 0.04665221770604452, "complete-iteration": 1.0348187386989594, "set_robot_commands": 0.007008214791615804, "deviation-center-line": 0.03023162811959447, "driven_lanedir_consec": 0.276747206707312, "sim_compute_sim_state": 0.065969318151474, "sim_compute_performance-ego0": 0.006256550550460815, "sim_compute_performance-ego1": 0.0058317482471466064, "sim_compute_performance-ego2": 0.005430946747461955, "sim_compute_robot_state-ego0": 0.01143824060757955, "sim_compute_robot_state-ego1": 0.009916086991628012, "sim_compute_robot_state-ego2": 0.010054906209309896, "sim_compute_robot_state-parked0": 0.010474562644958496, "sim_compute_robot_state-parked1": 0.010347386201222738, "sim_compute_robot_state-parked2": 0.010733018318812052, "sim_compute_robot_state-parked3": 0.01073002815246582, "sim_compute_robot_state-parked4": 0.01038577159245809, "sim_compute_robot_state-parked5": 0.010274986426035564}, "ETHZ_autolab_technical_track-0-2-ego2": {"driven_any": 0.2790450441091874, "get_ui_image": 0.12736563881238305, "step_physics": 0.5053004125754038, "survival_time": 1.2000000000000004, "driven_lanedir": 0.25792366855908844, "get_state_dump": 0.046994566917419434, "sim_render-ego0": 0.007193754116694133, "sim_render-ego1": 0.007342447837193807, "sim_render-ego2": 0.006613016128540039, "in-drivable-lane": 0.0, "deviation-heading": 0.4256838142434032, "agent_compute-ego0": 0.044916907946268715, "agent_compute-ego1": 0.04443052411079407, "agent_compute-ego2": 0.04665221770604452, "complete-iteration": 1.0348187386989594, "set_robot_commands": 0.007008214791615804, "deviation-center-line": 0.08384037690377498, "driven_lanedir_consec": 0.25792366855908844, "sim_compute_sim_state": 0.065969318151474, "sim_compute_performance-ego0": 0.006256550550460815, "sim_compute_performance-ego1": 0.0058317482471466064, "sim_compute_performance-ego2": 0.005430946747461955, "sim_compute_robot_state-ego0": 0.01143824060757955, "sim_compute_robot_state-ego1": 0.009916086991628012, "sim_compute_robot_state-ego2": 0.010054906209309896, "sim_compute_robot_state-parked0": 0.010474562644958496, "sim_compute_robot_state-parked1": 0.010347386201222738, "sim_compute_robot_state-parked2": 0.010733018318812052, "sim_compute_robot_state-parked3": 0.01073002815246582, "sim_compute_robot_state-parked4": 0.01038577159245809, "sim_compute_robot_state-parked5": 0.010274986426035564}}
set_robot_commands_max0.007170838117599487
set_robot_commands_mean0.007078478631810246
set_robot_commands_median0.007056382986215444
set_robot_commands_min0.007008214791615804
sim_compute_performance-ego0_max0.0063568115234375
sim_compute_performance-ego0_mean0.006172602451764621
sim_compute_performance-ego0_median0.006256550550460815
sim_compute_performance-ego0_min0.005904445281395545
sim_compute_performance-ego1_max0.006329745054244995
sim_compute_performance-ego1_mean0.006105817281282865
sim_compute_performance-ego1_median0.006155958542456994
sim_compute_performance-ego1_min0.0058317482471466064
sim_compute_performance-ego2_max0.006470495462417602
sim_compute_performance-ego2_mean0.006014160417084
sim_compute_performance-ego2_median0.006141039041372446
sim_compute_performance-ego2_min0.005430946747461955
sim_compute_robot_state-ego0_max0.01143824060757955
sim_compute_robot_state-ego0_mean0.01115376174959362
sim_compute_robot_state-ego0_median0.011104051883404072
sim_compute_robot_state-ego0_min0.01091899275779724
sim_compute_robot_state-ego1_max0.010983258485794067
sim_compute_robot_state-ego1_mean0.010462312871574337
sim_compute_robot_state-ego1_median0.010487593137300933
sim_compute_robot_state-ego1_min0.009916086991628012
sim_compute_robot_state-ego2_max0.011155885457992554
sim_compute_robot_state-ego2_mean0.010556970549444869
sim_compute_robot_state-ego2_median0.010460119981032152
sim_compute_robot_state-ego2_min0.010054906209309896
sim_compute_robot_state-parked0_max0.011061197519302369
sim_compute_robot_state-parked0_mean0.01077382274163075
sim_compute_robot_state-parked0_median0.010785708060631383
sim_compute_robot_state-parked0_min0.010474562644958496
sim_compute_robot_state-parked1_max0.011175411939620973
sim_compute_robot_state-parked1_mean0.010447615588832103
sim_compute_robot_state-parked1_median0.010347386201222738
sim_compute_robot_state-parked1_min0.009820048625652607
sim_compute_robot_state-parked2_max0.010733018318812052
sim_compute_robot_state-parked2_mean0.010497352200695592
sim_compute_robot_state-parked2_median0.010639554262161255
sim_compute_robot_state-parked2_min0.010119484021113468
sim_compute_robot_state-parked3_max0.01119304895401001
sim_compute_robot_state-parked3_mean0.010876048222566263
sim_compute_robot_state-parked3_median0.01073002815246582
sim_compute_robot_state-parked3_min0.010705067561222956
sim_compute_robot_state-parked4_max0.011205685138702392
sim_compute_robot_state-parked4_mean0.01091871954436995
sim_compute_robot_state-parked4_median0.011164701901949368
sim_compute_robot_state-parked4_min0.01038577159245809
sim_compute_robot_state-parked5_max0.010863959789276125
sim_compute_robot_state-parked5_mean0.01054567964667948
sim_compute_robot_state-parked5_median0.01049809272472675
sim_compute_robot_state-parked5_min0.010274986426035564
sim_compute_sim_state_max0.06848450303077698
sim_compute_sim_state_mean0.06632103736584002
sim_compute_sim_state_median0.065969318151474
sim_compute_sim_state_min0.06450929091526912
sim_render-ego0_max0.007485884428024292
sim_render-ego0_mean0.007349318520635622
sim_render-ego0_median0.007368317017188439
sim_render-ego0_min0.007193754116694133
sim_render-ego1_max0.007342447837193807
sim_render-ego1_mean0.007307372235844278
sim_render-ego1_median0.007294664016136756
sim_render-ego1_min0.007285004854202271
sim_render-ego2_max0.007696110010147095
sim_render-ego2_mean0.007123187413582435
sim_render-ego2_median0.007060436102060171
sim_render-ego2_min0.006613016128540039
simulation-passed1
step_physics_max0.514568989093487
step_physics_mean0.5085829723594535
step_physics_median0.5058795154094696
step_physics_min0.5053004125754038
survival_time_max2.000000000000001
survival_time_mean1.5000000000000009
survival_time_min1.2000000000000004

Highlights

33209

Click the images to see detailed statistics about the episode.

ETHZ_autolab_technical_track-0-0

ETHZ_autolab_technical_track-0-1

ETHZ_autolab_technical_track-0-2

Artifacts

The artifacts are hidden.

Container logs

The logs are hidden.