Duckietown Challenges Home Challenges Submissions

Job 33256

Job ID33256
submission6753
userFrank (Chude) Qian 🇨🇦
user labelchallenge-aido_LF-baseline-behavior-cloning
challengeaido5-LFVI_multi-sim-validation
stepLFVIv-sim
statusaborted
up to date Note that this job is not up to date; the challenge has been changed.
evaluatorp-1
date started
date completed
duration0:06:39
message
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.7391631353553813
survival_time_median2.6749999999999985
deviation-center-line_median0.1352339754916719
in-drivable-lane_median0.0


other stats
agent_compute-ego0_max0.11490706859096404
agent_compute-ego0_mean0.11114480226270614
agent_compute-ego0_median0.11114480226270616
agent_compute-ego0_min0.10738253593444824
agent_compute-ego1_max0.11477280432178127
agent_compute-ego1_mean0.1109597668425584
agent_compute-ego1_median0.1109597668425584
agent_compute-ego1_min0.1071467293633355
agent_compute-ego2_max0.10966784338797292
agent_compute-ego2_mean0.10800877236978128
agent_compute-ego2_median0.10800877236978126
agent_compute-ego2_min0.10634970135158962
complete-iteration_max1.3440709075620096
complete-iteration_mean1.3386199799489802
complete-iteration_median1.3386199799489802
complete-iteration_min1.333169052335951
deviation-center-line_max0.2742705952661278
deviation-center-line_mean0.1405768535355775
deviation-center-line_min0.042585621718128394
deviation-heading_max0.886664110654478
deviation-heading_mean0.3873328482035227
deviation-heading_median0.2805636504046163
deviation-heading_min0.17534142528065275
driven_any_max1.1204464879997982
driven_any_mean0.8704688372315652
driven_any_median0.8602930424293473
driven_any_min0.5388786365262782
driven_lanedir_consec_max1.1047724461927375
driven_lanedir_consec_mean0.7856168144884191
driven_lanedir_consec_min0.5357136234324127
driven_lanedir_max1.1156716704306924
driven_lanedir_mean0.8518412251099949
driven_lanedir_median0.8135307424202576
driven_lanedir_min0.5357136234324127
get_state_dump_max0.04662591026675317
get_state_dump_mean0.04653206371491955
get_state_dump_median0.04653206371491955
get_state_dump_min0.04643821716308594
get_ui_image_max0.10285099860160582
get_ui_image_mean0.10262767995130204
get_ui_image_median0.10262767995130204
get_ui_image_min0.10240436130099828
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"udem1-0-0-ego0": {"driven_any": 0.9302723372620028, "get_ui_image": 0.10285099860160582, "step_physics": 0.5910600308449038, "survival_time": 3.099999999999997, "driven_lanedir": 0.8670604208309904, "get_state_dump": 0.04662591026675317, "sim_render-ego0": 0.0070972750263829385, "sim_render-ego1": 0.007283314581840269, "sim_render-ego2": 0.007157864109162361, "in-drivable-lane": 0.0, "deviation-heading": 0.886664110654478, "agent_compute-ego0": 0.11490706859096404, "agent_compute-ego1": 0.11477280432178127, "agent_compute-ego2": 0.10966784338797292, "complete-iteration": 1.3440709075620096, "set_robot_commands": 0.006979930785394484, "deviation-center-line": 0.2742705952661278, "driven_lanedir_consec": 0.8670604208309904, "sim_compute_sim_state": 0.10689863081901305, "sim_compute_performance-ego0": 0.0059512892077046055, "sim_compute_performance-ego1": 0.00604062311110958, "sim_compute_performance-ego2": 0.005996546437663417, "sim_compute_robot_state-ego0": 0.011243781735820154, "sim_compute_robot_state-ego1": 0.010842204093933104, "sim_compute_robot_state-ego2": 0.010500161878524287, "sim_compute_robot_state-parked0": 0.01083688582143476, "sim_compute_robot_state-parked1": 0.010804176330566406, "sim_compute_robot_state-parked2": 0.01035495727292953, "sim_compute_robot_state-parked3": 0.010654807090759276, "sim_compute_robot_state-parked4": 0.010474712617935674, "sim_compute_robot_state-parked5": 0.010729932015941988}, "udem1-0-0-ego1": {"driven_any": 1.1103592587552915, "get_ui_image": 0.10285099860160582, "step_physics": 0.5910600308449038, "survival_time": 3.099999999999997, "driven_lanedir": 1.1047724461927375, "get_state_dump": 0.04662591026675317, "sim_render-ego0": 0.0070972750263829385, "sim_render-ego1": 0.007283314581840269, "sim_render-ego2": 0.007157864109162361, "in-drivable-lane": 0.0, "deviation-heading": 0.252502667514031, "agent_compute-ego0": 0.11490706859096404, "agent_compute-ego1": 0.11477280432178127, "agent_compute-ego2": 0.10966784338797292, "complete-iteration": 1.3440709075620096, "set_robot_commands": 0.006979930785394484, "deviation-center-line": 0.133974957994109, "driven_lanedir_consec": 1.1047724461927375, "sim_compute_sim_state": 0.10689863081901305, "sim_compute_performance-ego0": 0.0059512892077046055, "sim_compute_performance-ego1": 0.00604062311110958, "sim_compute_performance-ego2": 0.005996546437663417, "sim_compute_robot_state-ego0": 0.011243781735820154, "sim_compute_robot_state-ego1": 0.010842204093933104, "sim_compute_robot_state-ego2": 0.010500161878524287, "sim_compute_robot_state-parked0": 0.01083688582143476, "sim_compute_robot_state-parked1": 0.010804176330566406, "sim_compute_robot_state-parked2": 0.01035495727292953, "sim_compute_robot_state-parked3": 0.010654807090759276, "sim_compute_robot_state-parked4": 0.010474712617935674, "sim_compute_robot_state-parked5": 0.010729932015941988}, "udem1-0-0-ego2": {"driven_any": 1.1204464879997982, "get_ui_image": 0.10285099860160582, "step_physics": 0.5910600308449038, "survival_time": 3.099999999999997, "driven_lanedir": 1.1156716704306924, "get_state_dump": 0.04662591026675317, "sim_render-ego0": 0.0070972750263829385, "sim_render-ego1": 0.007283314581840269, "sim_render-ego2": 0.007157864109162361, "in-drivable-lane": 0.0, "deviation-heading": 0.3086246332952015, "agent_compute-ego0": 0.11490706859096404, "agent_compute-ego1": 0.11477280432178127, "agent_compute-ego2": 0.10966784338797292, "complete-iteration": 1.3440709075620096, "set_robot_commands": 0.006979930785394484, "deviation-center-line": 0.17381803544916724, "driven_lanedir_consec": 0.7346141710663252, "sim_compute_sim_state": 0.10689863081901305, "sim_compute_performance-ego0": 0.0059512892077046055, "sim_compute_performance-ego1": 0.00604062311110958, "sim_compute_performance-ego2": 0.005996546437663417, "sim_compute_robot_state-ego0": 0.011243781735820154, "sim_compute_robot_state-ego1": 0.010842204093933104, "sim_compute_robot_state-ego2": 0.010500161878524287, "sim_compute_robot_state-parked0": 0.01083688582143476, "sim_compute_robot_state-parked1": 0.010804176330566406, "sim_compute_robot_state-parked2": 0.01035495727292953, "sim_compute_robot_state-parked3": 0.010654807090759276, "sim_compute_robot_state-parked4": 0.010474712617935674, "sim_compute_robot_state-parked5": 0.010729932015941988}, "udem1-0-1-ego0": {"driven_any": 0.5388786365262782, "get_ui_image": 0.10240436130099828, "step_physics": 0.6029639456007215, "survival_time": 2.25, "driven_lanedir": 0.5357136234324127, "get_state_dump": 0.04643821716308594, "sim_render-ego0": 0.007043759028116862, "sim_render-ego1": 0.007035493850708008, "sim_render-ego2": 0.007443200217352973, "in-drivable-lane": 0.0, "deviation-heading": 0.21836815061992348, "agent_compute-ego0": 0.10738253593444824, "agent_compute-ego1": 0.1071467293633355, "agent_compute-ego2": 0.10634970135158962, "complete-iteration": 1.333169052335951, "set_robot_commands": 0.006547074847751194, "deviation-center-line": 0.1364929929892348, "driven_lanedir_consec": 0.5357136234324127, "sim_compute_sim_state": 0.10395293235778807, "sim_compute_performance-ego0": 0.005821333991156684, "sim_compute_performance-ego1": 0.005982096989949544, "sim_compute_performance-ego2": 0.006169456905788845, "sim_compute_robot_state-ego0": 0.010821840498182508, "sim_compute_robot_state-ego1": 0.010503927866617838, "sim_compute_robot_state-ego2": 0.010689417521158854, "sim_compute_robot_state-parked0": 0.011049969991048176, "sim_compute_robot_state-parked1": 0.010806777742173935, "sim_compute_robot_state-parked2": 0.010757599936591254, "sim_compute_robot_state-parked3": 0.010918998718261718, "sim_compute_robot_state-parked4": 0.010596677992078992, "sim_compute_robot_state-parked5": 0.010483047697279188}, "udem1-0-1-ego1": {"driven_any": 0.7325425552493282, "get_ui_image": 0.10240436130099828, "step_physics": 0.6029639456007215, "survival_time": 2.25, "driven_lanedir": 0.7278281257636117, "get_state_dump": 0.04643821716308594, "sim_render-ego0": 0.007043759028116862, "sim_render-ego1": 0.007035493850708008, "sim_render-ego2": 0.007443200217352973, "in-drivable-lane": 0.0, "deviation-heading": 0.17534142528065275, "agent_compute-ego0": 0.10738253593444824, "agent_compute-ego1": 0.1071467293633355, "agent_compute-ego2": 0.10634970135158962, "complete-iteration": 1.333169052335951, "set_robot_commands": 0.006547074847751194, "deviation-center-line": 0.042585621718128394, "driven_lanedir_consec": 0.7278281257636117, "sim_compute_sim_state": 0.10395293235778807, "sim_compute_performance-ego0": 0.005821333991156684, "sim_compute_performance-ego1": 0.005982096989949544, "sim_compute_performance-ego2": 0.006169456905788845, "sim_compute_robot_state-ego0": 0.010821840498182508, "sim_compute_robot_state-ego1": 0.010503927866617838, "sim_compute_robot_state-ego2": 0.010689417521158854, "sim_compute_robot_state-parked0": 0.011049969991048176, "sim_compute_robot_state-parked1": 0.010806777742173935, "sim_compute_robot_state-parked2": 0.010757599936591254, "sim_compute_robot_state-parked3": 0.010918998718261718, "sim_compute_robot_state-parked4": 0.010596677992078992, "sim_compute_robot_state-parked5": 0.010483047697279188}, "udem1-0-1-ego2": {"driven_any": 0.790313747596692, "get_ui_image": 0.10240436130099828, "step_physics": 0.6029639456007215, "survival_time": 2.25, "driven_lanedir": 0.7600010640095247, "get_state_dump": 0.04643821716308594, "sim_render-ego0": 0.007043759028116862, "sim_render-ego1": 0.007035493850708008, "sim_render-ego2": 0.007443200217352973, "in-drivable-lane": 0.0, "deviation-heading": 0.4824961018568489, "agent_compute-ego0": 0.10738253593444824, "agent_compute-ego1": 0.1071467293633355, "agent_compute-ego2": 0.10634970135158962, "complete-iteration": 1.333169052335951, "set_robot_commands": 0.006547074847751194, "deviation-center-line": 0.0823189177966977, "driven_lanedir_consec": 0.7437120996444373, "sim_compute_sim_state": 0.10395293235778807, "sim_compute_performance-ego0": 0.005821333991156684, "sim_compute_performance-ego1": 0.005982096989949544, "sim_compute_performance-ego2": 0.006169456905788845, "sim_compute_robot_state-ego0": 0.010821840498182508, "sim_compute_robot_state-ego1": 0.010503927866617838, "sim_compute_robot_state-ego2": 0.010689417521158854, "sim_compute_robot_state-parked0": 0.011049969991048176, "sim_compute_robot_state-parked1": 0.010806777742173935, "sim_compute_robot_state-parked2": 0.010757599936591254, "sim_compute_robot_state-parked3": 0.010918998718261718, "sim_compute_robot_state-parked4": 0.010596677992078992, "sim_compute_robot_state-parked5": 0.010483047697279188}}
set_robot_commands_max0.006979930785394484
set_robot_commands_mean0.006763502816572839
set_robot_commands_median0.006763502816572839
set_robot_commands_min0.006547074847751194
sim_compute_performance-ego0_max0.0059512892077046055
sim_compute_performance-ego0_mean0.005886311599430645
sim_compute_performance-ego0_median0.005886311599430645
sim_compute_performance-ego0_min0.005821333991156684
sim_compute_performance-ego1_max0.00604062311110958
sim_compute_performance-ego1_mean0.006011360050529563
sim_compute_performance-ego1_median0.006011360050529562
sim_compute_performance-ego1_min0.005982096989949544
sim_compute_performance-ego2_max0.006169456905788845
sim_compute_performance-ego2_mean0.006083001671726131
sim_compute_performance-ego2_median0.006083001671726131
sim_compute_performance-ego2_min0.005996546437663417
sim_compute_robot_state-ego0_max0.011243781735820154
sim_compute_robot_state-ego0_mean0.01103281111700133
sim_compute_robot_state-ego0_median0.011032811117001332
sim_compute_robot_state-ego0_min0.010821840498182508
sim_compute_robot_state-ego1_max0.010842204093933104
sim_compute_robot_state-ego1_mean0.010673065980275473
sim_compute_robot_state-ego1_median0.01067306598027547
sim_compute_robot_state-ego1_min0.010503927866617838
sim_compute_robot_state-ego2_max0.010689417521158854
sim_compute_robot_state-ego2_mean0.010594789699841569
sim_compute_robot_state-ego2_median0.01059478969984157
sim_compute_robot_state-ego2_min0.010500161878524287
sim_compute_robot_state-parked0_max0.011049969991048176
sim_compute_robot_state-parked0_mean0.01094342790624147
sim_compute_robot_state-parked0_median0.01094342790624147
sim_compute_robot_state-parked0_min0.01083688582143476
sim_compute_robot_state-parked1_max0.010806777742173935
sim_compute_robot_state-parked1_mean0.010805477036370172
sim_compute_robot_state-parked1_median0.010805477036370172
sim_compute_robot_state-parked1_min0.010804176330566406
sim_compute_robot_state-parked2_max0.010757599936591254
sim_compute_robot_state-parked2_mean0.010556278604760392
sim_compute_robot_state-parked2_median0.010556278604760392
sim_compute_robot_state-parked2_min0.01035495727292953
sim_compute_robot_state-parked3_max0.010918998718261718
sim_compute_robot_state-parked3_mean0.010786902904510495
sim_compute_robot_state-parked3_median0.0107869029045105
sim_compute_robot_state-parked3_min0.010654807090759276
sim_compute_robot_state-parked4_max0.010596677992078992
sim_compute_robot_state-parked4_mean0.010535695305007337
sim_compute_robot_state-parked4_median0.010535695305007331
sim_compute_robot_state-parked4_min0.010474712617935674
sim_compute_robot_state-parked5_max0.010729932015941988
sim_compute_robot_state-parked5_mean0.01060648985661059
sim_compute_robot_state-parked5_median0.010606489856610588
sim_compute_robot_state-parked5_min0.010483047697279188
sim_compute_sim_state_max0.10689863081901305
sim_compute_sim_state_mean0.10542578158840056
sim_compute_sim_state_median0.10542578158840056
sim_compute_sim_state_min0.10395293235778807
sim_render-ego0_max0.0070972750263829385
sim_render-ego0_mean0.0070705170272498995
sim_render-ego0_median0.0070705170272499
sim_render-ego0_min0.007043759028116862
sim_render-ego1_max0.007283314581840269
sim_render-ego1_mean0.007159404216274139
sim_render-ego1_median0.007159404216274139
sim_render-ego1_min0.007035493850708008
sim_render-ego2_max0.007443200217352973
sim_render-ego2_mean0.007300532163257667
sim_render-ego2_median0.007300532163257667
sim_render-ego2_min0.007157864109162361
simulation-passed1
step_physics_max0.6029639456007215
step_physics_mean0.5970119882228128
step_physics_median0.5970119882228127
step_physics_min0.5910600308449038
survival_time_max3.099999999999997
survival_time_mean2.6749999999999985
survival_time_min2.25

Highlights

33256

Click the images to see detailed statistics about the episode.

udem1-0-0

udem1-0-1

Artifacts

The artifacts are hidden.

Container logs

The logs are hidden.