Duckietown Challenges Home Challenges Submissions

Job 33236

Job ID33236
submission6742
userFrank (Chude) Qian 🇨🇦
user labelchallenge-aido_LF-baseline-behavior-cloning
challengeaido5-LFV_multi-sim-validation
stepLFVmultibodyv-sim
statusaborted
up to date Note that this job is not up to date; the challenge has been changed.
evaluatorp-1
date started
date completed
duration0:07:33
message
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.4737678662434752
survival_time_median1.4500000000000006
deviation-center-line_median0.07423965509698524
in-drivable-lane_median0.0


other stats
agent_compute-ego0_max0.11947775656177152
agent_compute-ego0_mean0.1102741557578489
agent_compute-ego0_median0.1058148844488736
agent_compute-ego0_min0.10552982626290155
agent_compute-ego1_max0.11649390189878402
agent_compute-ego1_mean0.10969626306824476
agent_compute-ego1_median0.10690055222346864
agent_compute-ego1_min0.10569433508248165
agent_compute-ego2_max0.1162813325082102
agent_compute-ego2_mean0.10819131885142429
agent_compute-ego2_median0.10419985343670024
agent_compute-ego2_min0.10409277060936235
complete-iteration_max1.2490911176127772
complete-iteration_mean1.2424655817241903
complete-iteration_median1.2466322553568874
complete-iteration_min1.231673372202906
deviation-center-line_max0.1112341165262841
deviation-center-line_mean0.07436406134063678
deviation-center-line_min0.043417853796394214
deviation-heading_max0.28821621428032984
deviation-heading_mean0.19470986086218017
deviation-heading_median0.20900628716941683
deviation-heading_min0.06030033220904063
driven_any_max0.516244304084731
driven_any_mean0.4854324371670597
driven_any_median0.47447651877753183
driven_any_min0.4698221645458976
driven_lanedir_consec_max0.5133091575178597
driven_lanedir_consec_mean0.4790592081312705
driven_lanedir_consec_min0.45606394535054506
driven_lanedir_max0.5133091575178597
driven_lanedir_mean0.4790592081312705
driven_lanedir_median0.4737678662434752
driven_lanedir_min0.45606394535054506
get_state_dump_max0.04781550745810232
get_state_dump_mean0.0473177143941334
get_state_dump_median0.047360362677738584
get_state_dump_min0.0467772730465593
get_ui_image_max0.13332794452535696
get_ui_image_mean0.12981670708138282
get_ui_image_median0.1301089717495826
get_ui_image_min0.1260132049692088
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"ETHZ_autolab_technical_track-0-0-ego0": {"driven_any": 0.5122187292378719, "get_ui_image": 0.1301089717495826, "step_physics": 0.49025772463890815, "survival_time": 1.5500000000000007, "driven_lanedir": 0.4999338458179956, "get_state_dump": 0.04781550745810232, "sim_render-ego0": 0.0075618144004575664, "sim_render-ego1": 0.007338277755245086, "sim_render-ego2": 0.007724723508281093, "in-drivable-lane": 0.0, "deviation-heading": 0.28821621428032984, "agent_compute-ego0": 0.11947775656177152, "agent_compute-ego1": 0.11649390189878402, "agent_compute-ego2": 0.1162813325082102, "complete-iteration": 1.2490911176127772, "set_robot_commands": 0.0067775018753543975, "deviation-center-line": 0.1112341165262841, "driven_lanedir_consec": 0.4999338458179956, "sim_compute_sim_state": 0.06859740903300623, "sim_compute_performance-ego0": 0.006320668805030084, "sim_compute_performance-ego1": 0.0062275240498204385, "sim_compute_performance-ego2": 0.0063166156891853575, "sim_compute_robot_state-ego0": 0.011162934764739006, "sim_compute_robot_state-ego1": 0.011218493984591576, "sim_compute_robot_state-ego2": 0.01089794405045048, "sim_compute_robot_state-parked0": 0.010972715193225492, "sim_compute_robot_state-parked1": 0.010917386701030115, "sim_compute_robot_state-parked2": 0.011152398201727098, "sim_compute_robot_state-parked3": 0.010616294799312469, "sim_compute_robot_state-parked4": 0.010206660916728356, "sim_compute_robot_state-parked5": 0.010131912846719065}, "ETHZ_autolab_technical_track-0-0-ego1": {"driven_any": 0.516244304084731, "get_ui_image": 0.1301089717495826, "step_physics": 0.49025772463890815, "survival_time": 1.5500000000000007, "driven_lanedir": 0.5133091575178597, "get_state_dump": 0.04781550745810232, "sim_render-ego0": 0.0075618144004575664, "sim_render-ego1": 0.007338277755245086, "sim_render-ego2": 0.007724723508281093, "in-drivable-lane": 0.0, "deviation-heading": 0.12575137697737482, "agent_compute-ego0": 0.11947775656177152, "agent_compute-ego1": 0.11649390189878402, "agent_compute-ego2": 0.1162813325082102, "complete-iteration": 1.2490911176127772, "set_robot_commands": 0.0067775018753543975, "deviation-center-line": 0.045814394626759784, "driven_lanedir_consec": 0.5133091575178597, "sim_compute_sim_state": 0.06859740903300623, "sim_compute_performance-ego0": 0.006320668805030084, "sim_compute_performance-ego1": 0.0062275240498204385, "sim_compute_performance-ego2": 0.0063166156891853575, "sim_compute_robot_state-ego0": 0.011162934764739006, "sim_compute_robot_state-ego1": 0.011218493984591576, "sim_compute_robot_state-ego2": 0.01089794405045048, "sim_compute_robot_state-parked0": 0.010972715193225492, "sim_compute_robot_state-parked1": 0.010917386701030115, "sim_compute_robot_state-parked2": 0.011152398201727098, "sim_compute_robot_state-parked3": 0.010616294799312469, "sim_compute_robot_state-parked4": 0.010206660916728356, "sim_compute_robot_state-parked5": 0.010131912846719065}, "ETHZ_autolab_technical_track-0-0-ego2": {"driven_any": 0.5114984793710307, "get_ui_image": 0.1301089717495826, "step_physics": 0.49025772463890815, "survival_time": 1.5500000000000007, "driven_lanedir": 0.5064588672777126, "get_state_dump": 0.04781550745810232, "sim_render-ego0": 0.0075618144004575664, "sim_render-ego1": 0.007338277755245086, "sim_render-ego2": 0.007724723508281093, "in-drivable-lane": 0.0, "deviation-heading": 0.2423028225833677, "agent_compute-ego0": 0.11947775656177152, "agent_compute-ego1": 0.11649390189878402, "agent_compute-ego2": 0.1162813325082102, "complete-iteration": 1.2490911176127772, "set_robot_commands": 0.0067775018753543975, "deviation-center-line": 0.0919444937279505, "driven_lanedir_consec": 0.5064588672777126, "sim_compute_sim_state": 0.06859740903300623, "sim_compute_performance-ego0": 0.006320668805030084, "sim_compute_performance-ego1": 0.0062275240498204385, "sim_compute_performance-ego2": 0.0063166156891853575, "sim_compute_robot_state-ego0": 0.011162934764739006, "sim_compute_robot_state-ego1": 0.011218493984591576, "sim_compute_robot_state-ego2": 0.01089794405045048, "sim_compute_robot_state-parked0": 0.010972715193225492, "sim_compute_robot_state-parked1": 0.010917386701030115, "sim_compute_robot_state-parked2": 0.011152398201727098, "sim_compute_robot_state-parked3": 0.010616294799312469, "sim_compute_robot_state-parked4": 0.010206660916728356, "sim_compute_robot_state-parked5": 0.010131912846719065}, "ETHZ_autolab_technical_track-0-1-ego0": {"driven_any": 0.47016652758152266, "get_ui_image": 0.13332794452535696, "step_physics": 0.5249936745084566, "survival_time": 1.4500000000000006, "driven_lanedir": 0.45606394535054506, "get_state_dump": 0.047360362677738584, "sim_render-ego0": 0.007509963265780745, "sim_render-ego1": 0.007515109818557213, "sim_render-ego2": 0.0069003351803483635, "in-drivable-lane": 0.0, "deviation-heading": 0.27875254758081713, "agent_compute-ego0": 0.10552982626290155, "agent_compute-ego1": 0.10569433508248165, "agent_compute-ego2": 0.10419985343670024, "complete-iteration": 1.2466322553568874, "set_robot_commands": 0.0063954304004537645, "deviation-center-line": 0.09248426469898884, "driven_lanedir_consec": 0.45606394535054506, "sim_compute_sim_state": 0.06830630631282411, "sim_compute_performance-ego0": 0.006480184094659214, "sim_compute_performance-ego1": 0.005830041293440194, "sim_compute_performance-ego2": 0.005899273116013099, "sim_compute_robot_state-ego0": 0.01120480175676017, "sim_compute_robot_state-ego1": 0.010272437128527412, "sim_compute_robot_state-ego2": 0.010292102550638131, "sim_compute_robot_state-parked0": 0.010637529965104729, "sim_compute_robot_state-parked1": 0.010743659118126178, "sim_compute_robot_state-parked2": 0.011023307668751684, "sim_compute_robot_state-parked3": 0.01100411086246885, "sim_compute_robot_state-parked4": 0.010682352657975822, "sim_compute_robot_state-parked5": 0.010618176953545931}, "ETHZ_autolab_technical_track-0-1-ego1": {"driven_any": 0.47447651877753183, "get_ui_image": 0.13332794452535696, "step_physics": 0.5249936745084566, "survival_time": 1.4500000000000006, "driven_lanedir": 0.4737678662434752, "get_state_dump": 0.047360362677738584, "sim_render-ego0": 0.007509963265780745, "sim_render-ego1": 0.007515109818557213, "sim_render-ego2": 0.0069003351803483635, "in-drivable-lane": 0.0, "deviation-heading": 0.06030033220904063, "agent_compute-ego0": 0.10552982626290155, "agent_compute-ego1": 0.10569433508248165, "agent_compute-ego2": 0.10419985343670024, "complete-iteration": 1.2466322553568874, "set_robot_commands": 0.0063954304004537645, "deviation-center-line": 0.043417853796394214, "driven_lanedir_consec": 0.4737678662434752, "sim_compute_sim_state": 0.06830630631282411, "sim_compute_performance-ego0": 0.006480184094659214, "sim_compute_performance-ego1": 0.005830041293440194, "sim_compute_performance-ego2": 0.005899273116013099, "sim_compute_robot_state-ego0": 0.01120480175676017, "sim_compute_robot_state-ego1": 0.010272437128527412, "sim_compute_robot_state-ego2": 0.010292102550638131, "sim_compute_robot_state-parked0": 0.010637529965104729, "sim_compute_robot_state-parked1": 0.010743659118126178, "sim_compute_robot_state-parked2": 0.011023307668751684, "sim_compute_robot_state-parked3": 0.01100411086246885, "sim_compute_robot_state-parked4": 0.010682352657975822, "sim_compute_robot_state-parked5": 0.010618176953545931}, "ETHZ_autolab_technical_track-0-1-ego2": {"driven_any": 0.4698221645458976, "get_ui_image": 0.13332794452535696, "step_physics": 0.5249936745084566, "survival_time": 1.4500000000000006, "driven_lanedir": 0.466083689689913, "get_state_dump": 0.047360362677738584, "sim_render-ego0": 0.007509963265780745, "sim_render-ego1": 0.007515109818557213, "sim_render-ego2": 0.0069003351803483635, "in-drivable-lane": 0.0, "deviation-heading": 0.20900628716941683, "agent_compute-ego0": 0.10552982626290155, "agent_compute-ego1": 0.10569433508248165, "agent_compute-ego2": 0.10419985343670024, "complete-iteration": 1.2466322553568874, "set_robot_commands": 0.0063954304004537645, "deviation-center-line": 0.07423965509698524, "driven_lanedir_consec": 0.466083689689913, "sim_compute_sim_state": 0.06830630631282411, "sim_compute_performance-ego0": 0.006480184094659214, "sim_compute_performance-ego1": 0.005830041293440194, "sim_compute_performance-ego2": 0.005899273116013099, "sim_compute_robot_state-ego0": 0.01120480175676017, "sim_compute_robot_state-ego1": 0.010272437128527412, "sim_compute_robot_state-ego2": 0.010292102550638131, "sim_compute_robot_state-parked0": 0.010637529965104729, "sim_compute_robot_state-parked1": 0.010743659118126178, "sim_compute_robot_state-parked2": 0.011023307668751684, "sim_compute_robot_state-parked3": 0.01100411086246885, "sim_compute_robot_state-parked4": 0.010682352657975822, "sim_compute_robot_state-parked5": 0.010618176953545931}, "ETHZ_autolab_technical_track-0-2-ego0": {"driven_any": 0.47016652758152266, "get_ui_image": 0.1260132049692088, "step_physics": 0.5140333668938999, "survival_time": 1.4500000000000006, "driven_lanedir": 0.45606394535054506, "get_state_dump": 0.0467772730465593, "sim_render-ego0": 0.007158320525596882, "sim_render-ego1": 0.00727808064427869, "sim_render-ego2": 0.007617860004819673, "in-drivable-lane": 0.0, "deviation-heading": 0.27875254758081713, "agent_compute-ego0": 0.1058148844488736, "agent_compute-ego1": 0.10690055222346864, "agent_compute-ego2": 0.10409277060936235, "complete-iteration": 1.231673372202906, "set_robot_commands": 0.006897786567951071, "deviation-center-line": 0.09248426469898884, "driven_lanedir_consec": 0.45606394535054506, "sim_compute_sim_state": 0.06762599122935328, "sim_compute_performance-ego0": 0.006345181629575532, "sim_compute_performance-ego1": 0.006297481471094592, "sim_compute_performance-ego2": 0.006274856370070885, "sim_compute_robot_state-ego0": 0.010718436076723296, "sim_compute_robot_state-ego1": 0.011607737376772124, "sim_compute_robot_state-ego2": 0.010753319181244949, "sim_compute_robot_state-parked0": 0.010913273383831155, "sim_compute_robot_state-parked1": 0.010749808673200936, "sim_compute_robot_state-parked2": 0.01032755292695144, "sim_compute_robot_state-parked3": 0.010590898579564589, "sim_compute_robot_state-parked4": 0.010552809156220536, "sim_compute_robot_state-parked5": 0.011114720640511349}, "ETHZ_autolab_technical_track-0-2-ego1": {"driven_any": 0.47447651877753183, "get_ui_image": 0.1260132049692088, "step_physics": 0.5140333668938999, "survival_time": 1.4500000000000006, "driven_lanedir": 0.4737678662434752, "get_state_dump": 0.0467772730465593, "sim_render-ego0": 0.007158320525596882, "sim_render-ego1": 0.00727808064427869, "sim_render-ego2": 0.007617860004819673, "in-drivable-lane": 0.0, "deviation-heading": 0.06030033220904063, "agent_compute-ego0": 0.1058148844488736, "agent_compute-ego1": 0.10690055222346864, "agent_compute-ego2": 0.10409277060936235, "complete-iteration": 1.231673372202906, "set_robot_commands": 0.006897786567951071, "deviation-center-line": 0.043417853796394214, "driven_lanedir_consec": 0.4737678662434752, "sim_compute_sim_state": 0.06762599122935328, "sim_compute_performance-ego0": 0.006345181629575532, "sim_compute_performance-ego1": 0.006297481471094592, "sim_compute_performance-ego2": 0.006274856370070885, "sim_compute_robot_state-ego0": 0.010718436076723296, "sim_compute_robot_state-ego1": 0.011607737376772124, "sim_compute_robot_state-ego2": 0.010753319181244949, "sim_compute_robot_state-parked0": 0.010913273383831155, "sim_compute_robot_state-parked1": 0.010749808673200936, "sim_compute_robot_state-parked2": 0.01032755292695144, "sim_compute_robot_state-parked3": 0.010590898579564589, "sim_compute_robot_state-parked4": 0.010552809156220536, "sim_compute_robot_state-parked5": 0.011114720640511349}, "ETHZ_autolab_technical_track-0-2-ego2": {"driven_any": 0.4698221645458976, "get_ui_image": 0.1260132049692088, "step_physics": 0.5140333668938999, "survival_time": 1.4500000000000006, "driven_lanedir": 0.466083689689913, "get_state_dump": 0.0467772730465593, "sim_render-ego0": 0.007158320525596882, "sim_render-ego1": 0.00727808064427869, "sim_render-ego2": 0.007617860004819673, "in-drivable-lane": 0.0, "deviation-heading": 0.20900628716941683, "agent_compute-ego0": 0.1058148844488736, "agent_compute-ego1": 0.10690055222346864, "agent_compute-ego2": 0.10409277060936235, "complete-iteration": 1.231673372202906, "set_robot_commands": 0.006897786567951071, "deviation-center-line": 0.07423965509698524, "driven_lanedir_consec": 0.466083689689913, "sim_compute_sim_state": 0.06762599122935328, "sim_compute_performance-ego0": 0.006345181629575532, "sim_compute_performance-ego1": 0.006297481471094592, "sim_compute_performance-ego2": 0.006274856370070885, "sim_compute_robot_state-ego0": 0.010718436076723296, "sim_compute_robot_state-ego1": 0.011607737376772124, "sim_compute_robot_state-ego2": 0.010753319181244949, "sim_compute_robot_state-parked0": 0.010913273383831155, "sim_compute_robot_state-parked1": 0.010749808673200936, "sim_compute_robot_state-parked2": 0.01032755292695144, "sim_compute_robot_state-parked3": 0.010590898579564589, "sim_compute_robot_state-parked4": 0.010552809156220536, "sim_compute_robot_state-parked5": 0.011114720640511349}}
set_robot_commands_max0.006897786567951071
set_robot_commands_mean0.006690239614586411
set_robot_commands_median0.0067775018753543975
set_robot_commands_min0.0063954304004537645
sim_compute_performance-ego0_max0.006480184094659214
sim_compute_performance-ego0_mean0.006382011509754944
sim_compute_performance-ego0_median0.006345181629575532
sim_compute_performance-ego0_min0.006320668805030084
sim_compute_performance-ego1_max0.006297481471094592
sim_compute_performance-ego1_mean0.0061183489381184085
sim_compute_performance-ego1_median0.0062275240498204385
sim_compute_performance-ego1_min0.005830041293440194
sim_compute_performance-ego2_max0.0063166156891853575
sim_compute_performance-ego2_mean0.006163581725089781
sim_compute_performance-ego2_median0.006274856370070885
sim_compute_performance-ego2_min0.005899273116013099
sim_compute_robot_state-ego0_max0.01120480175676017
sim_compute_robot_state-ego0_mean0.01102872419940749
sim_compute_robot_state-ego0_median0.011162934764739006
sim_compute_robot_state-ego0_min0.010718436076723296
sim_compute_robot_state-ego1_max0.011607737376772124
sim_compute_robot_state-ego1_mean0.01103288949663037
sim_compute_robot_state-ego1_median0.011218493984591576
sim_compute_robot_state-ego1_min0.010272437128527412
sim_compute_robot_state-ego2_max0.01089794405045048
sim_compute_robot_state-ego2_mean0.010647788594111187
sim_compute_robot_state-ego2_median0.010753319181244949
sim_compute_robot_state-ego2_min0.010292102550638131
sim_compute_robot_state-parked0_max0.010972715193225492
sim_compute_robot_state-parked0_mean0.010841172847387129
sim_compute_robot_state-parked0_median0.010913273383831155
sim_compute_robot_state-parked0_min0.010637529965104729
sim_compute_robot_state-parked1_max0.010917386701030115
sim_compute_robot_state-parked1_mean0.010803618164119075
sim_compute_robot_state-parked1_median0.010749808673200936
sim_compute_robot_state-parked1_min0.010743659118126178
sim_compute_robot_state-parked2_max0.011152398201727098
sim_compute_robot_state-parked2_mean0.010834419599143406
sim_compute_robot_state-parked2_median0.011023307668751684
sim_compute_robot_state-parked2_min0.01032755292695144
sim_compute_robot_state-parked3_max0.01100411086246885
sim_compute_robot_state-parked3_mean0.01073710141378197
sim_compute_robot_state-parked3_median0.010616294799312469
sim_compute_robot_state-parked3_min0.010590898579564589
sim_compute_robot_state-parked4_max0.010682352657975822
sim_compute_robot_state-parked4_mean0.010480607576974905
sim_compute_robot_state-parked4_median0.010552809156220536
sim_compute_robot_state-parked4_min0.010206660916728356
sim_compute_robot_state-parked5_max0.011114720640511349
sim_compute_robot_state-parked5_mean0.01062160348025878
sim_compute_robot_state-parked5_median0.010618176953545931
sim_compute_robot_state-parked5_min0.010131912846719065
sim_compute_sim_state_max0.06859740903300623
sim_compute_sim_state_mean0.06817656885839456
sim_compute_sim_state_median0.06830630631282411
sim_compute_sim_state_min0.06762599122935328
sim_render-ego0_max0.0075618144004575664
sim_render-ego0_mean0.007410032730611731
sim_render-ego0_median0.007509963265780745
sim_render-ego0_min0.007158320525596882
sim_render-ego1_max0.007515109818557213
sim_render-ego1_mean0.007377156072693663
sim_render-ego1_median0.007338277755245086
sim_render-ego1_min0.00727808064427869
sim_render-ego2_max0.007724723508281093
sim_render-ego2_mean0.00741430623114971
sim_render-ego2_median0.007617860004819673
sim_render-ego2_min0.0069003351803483635
simulation-passed1
step_physics_max0.5249936745084566
step_physics_mean0.5097615886804215
step_physics_median0.5140333668938999
step_physics_min0.49025772463890815
survival_time_max1.5500000000000007
survival_time_mean1.483333333333334
survival_time_min1.4500000000000006

Highlights

33236

Click the images to see detailed statistics about the episode.

ETHZ_autolab_technical_track-0-0

ETHZ_autolab_technical_track-0-1

ETHZ_autolab_technical_track-0-2

Artifacts

The artifacts are hidden.

Container logs

The logs are hidden.