Duckietown Challenges Home Challenges Submissions

Evaluator 2294

ID2294
evaluatorreg01-b132bf379262-1
ownerI don't have one 😀
machineChudeQian-Sager-Duckietown
processreg01-b132bf379262-1
versiond-c:6.1.23;d-c-r:6.0.59
first heard
last heard
statusinactive
# evaluating
# success3 42276
# timeout
# failed
# error
# aborted
# host-error
arm
x86_64
Mac
gpu available
Number of processors
Processor frequency (MHz)
Free % of processors
RAM total (MB)
RAM free (MB)
Disk (MB)
Disk available (MB)
Docker Hub
P1
P2
Cloud simulations
PI Camera
# Duckiebots
Map 3x3 avaiable
Number of duckies
gpu cores
AIDO 2 Map LF public
AIDO 2 Map LF private
AIDO 2 Map LFV public
AIDO 2 Map LFV private
AIDO 2 Map LFVI public
AIDO 2 Map LFVI private
AIDO 3 Map LF public
AIDO 3 Map LF private
AIDO 3 Map LFV public
AIDO 3 Map LFV private
AIDO 3 Map LFVI public
AIDO 3 Map LFVI private
AIDO 5 Map large loop
ETU track
for 2021, map is ETH_small_inter
IPFS mountpoint /ipfs available
IPNS mountpoint /ipns available

Evaluator jobs

Job IDsubmissionuseruser labelchallengestepstatusup to dateevaluatordate starteddate completeddurationmessage
4233011415Frank (Chude) Qian 🇨🇦challenge-aido_LF-baseline-behavior-cloningaido5-LFV_multi-sim-validationLFVmultibodyv-simsuccessnoreg01-b132bf379262-10:16:32
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.8797232186099371
survival_time_median16.150000000000095
deviation-center-line_median0.48598536867156616
in-drivable-lane_median0.0


other stats
agent_compute-ego0_max0.03964455897763649
agent_compute-ego0_mean0.03405058945721226
agent_compute-ego0_median0.03314917375428758
agent_compute-ego0_min0.029358035639712687
agent_compute-ego1_max0.03494731461779672
agent_compute-ego1_mean0.03093653484554377
agent_compute-ego1_median0.03046398856691532
agent_compute-ego1_min0.027398301351919264
agent_compute-ego2_max0.03328895790976767
agent_compute-ego2_mean0.029351029974097137
agent_compute-ego2_median0.028632097569043426
agent_compute-ego2_min0.02613203444348031
complete-iteration_max0.5577170078798851
complete-iteration_mean0.5167141838282916
complete-iteration_median0.5156481457937613
complete-iteration_min0.4767773978112283
deviation-center-line_max0.7009323515097845
deviation-center-line_mean0.4966988332799883
deviation-center-line_min0.292447085545286
deviation-heading_max2.0235055957714505
deviation-heading_mean1.3221919592447
deviation-heading_median1.7699887434863577
deviation-heading_min0.2954985065508312
driven_any_max3.8667464906767126
driven_any_mean1.7296028883871812
driven_any_median0.8831727898326648
driven_any_min0.442965447994197
driven_lanedir_consec_max3.805481530572079
driven_lanedir_consec_mean1.707547011792728
driven_lanedir_consec_min0.4413282179081297
driven_lanedir_max3.805481530572079
driven_lanedir_mean1.707547011792728
driven_lanedir_median0.8797232186099371
driven_lanedir_min0.4413282179081297
get_duckie_state_max1.6807402619636464e-06
get_duckie_state_mean1.5849932164863274e-06
get_duckie_state_median1.6348702566964285e-06
get_duckie_state_min1.4393691307989068e-06
get_robot_state_max0.03419338955598719
get_robot_state_mean0.03152535817650173
get_robot_state_median0.03122721884641854
get_robot_state_min0.029155466127099457
get_state_dump_max0.030711627966110183
get_state_dump_mean0.02439008856887328
get_state_dump_median0.022922805957380832
get_state_dump_min0.019535831783128826
get_ui_image_max0.03873460707457169
get_ui_image_mean0.03516312445585236
get_ui_image_median0.03523918275862655
get_ui_image_min0.03151558353435883
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"ETHZ_autolab_technical_track-sc0-0-ego0": {"driven_any": 0.4429656243033615, "get_ui_image": 0.03873460707457169, "step_physics": 0.3019638713102163, "survival_time": 16.100000000000094, "driven_lanedir": 0.4417431617247505, "get_state_dump": 0.019535831783128826, "get_robot_state": 0.029155466127099457, "sim_render-ego0": 0.005505669931447284, "sim_render-ego1": 0.005016424641105699, "sim_render-ego2": 0.004484403207435371, "get_duckie_state": 1.6348702566964285e-06, "in-drivable-lane": 0.0, "deviation-heading": 0.2954985065508312, "agent_compute-ego0": 0.03964455897763649, "agent_compute-ego1": 0.03494731461779672, "agent_compute-ego2": 0.03328895790976767, "complete-iteration": 0.5577170078798851, "set_robot_commands": 0.0034716884541955793, "deviation-center-line": 0.292447085545286, "driven_lanedir_consec": 0.4417431617247505, "sim_compute_sim_state": 0.024156389029129692, "sim_compute_performance-ego0": 0.003661897611914214, "sim_compute_performance-ego1": 0.0033955033521474516, "sim_compute_performance-ego2": 0.0029454897649539924}, "ETHZ_autolab_technical_track-sc0-0-ego1": {"driven_any": 3.8545175804406857, "get_ui_image": 0.03873460707457169, "step_physics": 0.3019638713102163, "survival_time": 16.100000000000094, "driven_lanedir": 3.793179155723241, "get_state_dump": 0.019535831783128826, "get_robot_state": 0.029155466127099457, "sim_render-ego0": 0.005505669931447284, "sim_render-ego1": 0.005016424641105699, "sim_render-ego2": 0.004484403207435371, "get_duckie_state": 1.6348702566964285e-06, "in-drivable-lane": 0.0, "deviation-heading": 2.0235055957714505, "agent_compute-ego0": 0.03964455897763649, "agent_compute-ego1": 0.03494731461779672, "agent_compute-ego2": 0.03328895790976767, "complete-iteration": 0.5577170078798851, "set_robot_commands": 0.0034716884541955793, "deviation-center-line": 0.6818508603176122, "driven_lanedir_consec": 3.793179155723241, "sim_compute_sim_state": 0.024156389029129692, "sim_compute_performance-ego0": 0.003661897611914214, "sim_compute_performance-ego1": 0.0033955033521474516, "sim_compute_performance-ego2": 0.0029454897649539924}, "ETHZ_autolab_technical_track-sc0-0-ego2": {"driven_any": 0.8831733337334342, "get_ui_image": 0.03873460707457169, "step_physics": 0.3019638713102163, "survival_time": 16.100000000000094, "driven_lanedir": 0.8799348545062682, "get_state_dump": 0.019535831783128826, "get_robot_state": 0.029155466127099457, "sim_render-ego0": 0.005505669931447284, "sim_render-ego1": 0.005016424641105699, "sim_render-ego2": 0.004484403207435371, "get_duckie_state": 1.6348702566964285e-06, "in-drivable-lane": 0.0, "deviation-heading": 0.9007662383562376, "agent_compute-ego0": 0.03964455897763649, "agent_compute-ego1": 0.03494731461779672, "agent_compute-ego2": 0.03328895790976767, "complete-iteration": 0.5577170078798851, "set_robot_commands": 0.0034716884541955793, "deviation-center-line": 0.31350316061355116, "driven_lanedir_consec": 0.8799348545062682, "sim_compute_sim_state": 0.024156389029129692, "sim_compute_performance-ego0": 0.003661897611914214, "sim_compute_performance-ego1": 0.0033955033521474516, "sim_compute_performance-ego2": 0.0029454897649539924}, "ETHZ_autolab_technical_track-sc0-1-ego0": {"driven_any": 0.442965447994197, "get_ui_image": 0.03523918275862655, "step_physics": 0.2747719029524009, "survival_time": 16.150000000000095, "driven_lanedir": 0.4413282179081297, "get_state_dump": 0.022922805957380832, "get_robot_state": 0.03122721884641854, "sim_render-ego0": 0.005305869660510367, "sim_render-ego1": 0.004837596379566488, "sim_render-ego2": 0.004136082557701843, "get_duckie_state": 1.6807402619636464e-06, "in-drivable-lane": 0.0, "deviation-heading": 0.5496646964603306, "agent_compute-ego0": 0.03314917375428758, "agent_compute-ego1": 0.03046398856691532, "agent_compute-ego2": 0.028632097569043426, "complete-iteration": 0.5156481457937613, "set_robot_commands": 0.003283162604175485, "deviation-center-line": 0.404326476340372, "driven_lanedir_consec": 0.4413282179081297, "sim_compute_sim_state": 0.02483065652404407, "sim_compute_performance-ego0": 0.0035571299101177013, "sim_compute_performance-ego1": 0.0032714372817945923, "sim_compute_performance-ego2": 0.0027485137384373336}, "ETHZ_autolab_technical_track-sc0-1-ego1": {"driven_any": 3.8667464906767126, "get_ui_image": 0.03523918275862655, "step_physics": 0.2747719029524009, "survival_time": 16.150000000000095, "driven_lanedir": 3.805481530572079, "get_state_dump": 0.022922805957380832, "get_robot_state": 0.03122721884641854, "sim_render-ego0": 0.005305869660510367, "sim_render-ego1": 0.004837596379566488, "sim_render-ego2": 0.004136082557701843, "get_duckie_state": 1.6807402619636464e-06, "in-drivable-lane": 0.0, "deviation-heading": 2.020325206315202, "agent_compute-ego0": 0.03314917375428758, "agent_compute-ego1": 0.03046398856691532, "agent_compute-ego2": 0.028632097569043426, "complete-iteration": 0.5156481457937613, "set_robot_commands": 0.003283162604175485, "deviation-center-line": 0.7009323515097845, "driven_lanedir_consec": 3.805481530572079, "sim_compute_sim_state": 0.02483065652404407, "sim_compute_performance-ego0": 0.0035571299101177013, "sim_compute_performance-ego1": 0.0032714372817945923, "sim_compute_performance-ego2": 0.0027485137384373336}, "ETHZ_autolab_technical_track-sc0-1-ego2": {"driven_any": 0.8831727898326648, "get_ui_image": 0.03523918275862655, "step_physics": 0.2747719029524009, "survival_time": 16.150000000000095, "driven_lanedir": 0.8797232186099371, "get_state_dump": 0.022922805957380832, "get_robot_state": 0.03122721884641854, "sim_render-ego0": 0.005305869660510367, "sim_render-ego1": 0.004837596379566488, "sim_render-ego2": 0.004136082557701843, "get_duckie_state": 1.6807402619636464e-06, "in-drivable-lane": 0.0, "deviation-heading": 1.7699887434863577, "agent_compute-ego0": 0.03314917375428758, "agent_compute-ego1": 0.03046398856691532, "agent_compute-ego2": 0.028632097569043426, "complete-iteration": 0.5156481457937613, "set_robot_commands": 0.003283162604175485, "deviation-center-line": 0.48598536867156616, "driven_lanedir_consec": 0.8797232186099371, "sim_compute_sim_state": 0.02483065652404407, "sim_compute_performance-ego0": 0.0035571299101177013, "sim_compute_performance-ego1": 0.0032714372817945923, "sim_compute_performance-ego2": 0.0027485137384373336}, "ETHZ_autolab_technical_track-sc0-2-ego0": {"driven_any": 0.442965447994197, "get_ui_image": 0.03151558353435883, "step_physics": 0.2422565136900627, "survival_time": 16.150000000000095, "driven_lanedir": 0.4413282179081297, "get_state_dump": 0.030711627966110183, "get_robot_state": 0.03419338955598719, "sim_render-ego0": 0.004866399263080798, "sim_render-ego1": 0.004358740413890165, "sim_render-ego2": 0.0036938426664370138, "get_duckie_state": 1.4393691307989068e-06, "in-drivable-lane": 0.0, "deviation-heading": 0.5496646964603306, "agent_compute-ego0": 0.029358035639712687, "agent_compute-ego1": 0.027398301351919264, "agent_compute-ego2": 0.02613203444348031, "complete-iteration": 0.4767773978112283, "set_robot_commands": 0.0029029122816150773, "deviation-center-line": 0.404326476340372, "driven_lanedir_consec": 0.4413282179081297, "sim_compute_sim_state": 0.02412008279617357, "sim_compute_performance-ego0": 0.003329637988063942, "sim_compute_performance-ego1": 0.0029348138685196916, "sim_compute_performance-ego2": 0.0024326954832756113}, "ETHZ_autolab_technical_track-sc0-2-ego1": {"driven_any": 3.8667464906767126, "get_ui_image": 0.03151558353435883, "step_physics": 0.2422565136900627, "survival_time": 16.150000000000095, "driven_lanedir": 3.805481530572079, "get_state_dump": 0.030711627966110183, "get_robot_state": 0.03419338955598719, "sim_render-ego0": 0.004866399263080798, "sim_render-ego1": 0.004358740413890165, "sim_render-ego2": 0.0036938426664370138, "get_duckie_state": 1.4393691307989068e-06, "in-drivable-lane": 0.0, "deviation-heading": 2.020325206315202, "agent_compute-ego0": 0.029358035639712687, "agent_compute-ego1": 0.027398301351919264, "agent_compute-ego2": 0.02613203444348031, "complete-iteration": 0.4767773978112283, "set_robot_commands": 0.0029029122816150773, "deviation-center-line": 0.7009323515097845, "driven_lanedir_consec": 3.805481530572079, "sim_compute_sim_state": 0.02412008279617357, "sim_compute_performance-ego0": 0.003329637988063942, "sim_compute_performance-ego1": 0.0029348138685196916, "sim_compute_performance-ego2": 0.0024326954832756113}, "ETHZ_autolab_technical_track-sc0-2-ego2": {"driven_any": 0.8831727898326648, "get_ui_image": 0.03151558353435883, "step_physics": 0.2422565136900627, "survival_time": 16.150000000000095, "driven_lanedir": 0.8797232186099371, "get_state_dump": 0.030711627966110183, "get_robot_state": 0.03419338955598719, "sim_render-ego0": 0.004866399263080798, "sim_render-ego1": 0.004358740413890165, "sim_render-ego2": 0.0036938426664370138, "get_duckie_state": 1.4393691307989068e-06, "in-drivable-lane": 0.0, "deviation-heading": 1.7699887434863577, "agent_compute-ego0": 0.029358035639712687, "agent_compute-ego1": 0.027398301351919264, "agent_compute-ego2": 0.02613203444348031, "complete-iteration": 0.4767773978112283, "set_robot_commands": 0.0029029122816150773, "deviation-center-line": 0.48598536867156616, "driven_lanedir_consec": 0.8797232186099371, "sim_compute_sim_state": 0.02412008279617357, "sim_compute_performance-ego0": 0.003329637988063942, "sim_compute_performance-ego1": 0.0029348138685196916, "sim_compute_performance-ego2": 0.0024326954832756113}}
set_robot_commands_max0.0034716884541955793
set_robot_commands_mean0.003219254446662047
set_robot_commands_median0.003283162604175485
set_robot_commands_min0.0029029122816150773
sim_compute_performance-ego0_max0.003661897611914214
sim_compute_performance-ego0_mean0.003516221836698619
sim_compute_performance-ego0_median0.0035571299101177013
sim_compute_performance-ego0_min0.003329637988063942
sim_compute_performance-ego1_max0.0033955033521474516
sim_compute_performance-ego1_mean0.0032005848341539116
sim_compute_performance-ego1_median0.0032714372817945923
sim_compute_performance-ego1_min0.0029348138685196916
sim_compute_performance-ego2_max0.0029454897649539924
sim_compute_performance-ego2_mean0.0027088996622223124
sim_compute_performance-ego2_median0.0027485137384373336
sim_compute_performance-ego2_min0.0024326954832756113
sim_compute_sim_state_max0.02483065652404407
sim_compute_sim_state_mean0.024369042783115778
sim_compute_sim_state_median0.024156389029129692
sim_compute_sim_state_min0.02412008279617357
sim_render-ego0_max0.005505669931447284
sim_render-ego0_mean0.00522597961834615
sim_render-ego0_median0.005305869660510367
sim_render-ego0_min0.004866399263080798
sim_render-ego1_max0.005016424641105699
sim_render-ego1_mean0.004737587144854118
sim_render-ego1_median0.004837596379566488
sim_render-ego1_min0.004358740413890165
sim_render-ego2_max0.004484403207435371
sim_render-ego2_mean0.004104776143858076
sim_render-ego2_median0.004136082557701843
sim_render-ego2_min0.0036938426664370138
simulation-passed1
step_physics_max0.3019638713102163
step_physics_mean0.27299742931756
step_physics_median0.2747719029524009
step_physics_min0.2422565136900627
survival_time_max16.150000000000095
survival_time_mean16.133333333333425
survival_time_min16.100000000000094
No reset possible
4228811417Frank (Chude) Qian 🇨🇦challenge-aido_LF-baseline-behavior-cloningaido5-LF-sim-testingLFt-simsuccessnoreg01-b132bf379262-10:24:51
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median3.2471360816645007
survival_time_median14.950000000000076
deviation-center-line_median0.5036090300669908
in-drivable-lane_median0.3999999999999986


other stats
agent_compute-ego_max0.03981596231460571
agent_compute-ego_mean0.03495802568598055
agent_compute-ego_median0.03525256236394247
agent_compute-ego_min0.02986033757527669
complete-iteration_max0.2304492646997625
complete-iteration_mean0.19302454743997705
complete-iteration_median0.1933439580599467
complete-iteration_min0.16615602016448974
deviation-center-line_max1.2032927842420045
deviation-center-line_mean0.5589635555239795
deviation-center-line_min0.09345238846662508
deviation-heading_max4.861072932537895
deviation-heading_mean2.198071648491744
deviation-heading_median1.5624964210085197
deviation-heading_min0.22955720444994543
driven_any_max3.5733264229705677
driven_any_mean3.184432222616191
driven_any_median3.573278007563459
driven_any_min0.4551922313048015
driven_lanedir_consec_max3.546374493275372
driven_lanedir_consec_mean2.925085577364233
driven_lanedir_consec_min0.4530687352930016
driven_lanedir_max3.546374493275372
driven_lanedir_mean2.925085577364233
driven_lanedir_median3.2471360816645007
driven_lanedir_min0.4530687352930016
get_duckie_state_max2.308325334028764e-06
get_duckie_state_mean2.138475663046128e-06
get_duckie_state_median2.1711985270182293e-06
get_duckie_state_min1.8175443013509112e-06
get_robot_state_max0.011618516661904076
get_robot_state_mean0.0108019952326798
get_robot_state_median0.010861923694610595
get_robot_state_min0.009459538459777832
get_state_dump_max0.010232145136052912
get_state_dump_mean0.009257237109615
get_state_dump_median0.00926301876703898
get_state_dump_min0.008121618429819743
get_ui_image_max0.0338354923508384
get_ui_image_mean0.029278968755989017
get_ui_image_median0.029461963176727293
get_ui_image_min0.024755874474843342
in-drivable-lane_max1.950000000000008
in-drivable-lane_mean0.6533333333333375
in-drivable-lane_min0.0
per-episodes
details{"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 3.5732956034801044, "get_ui_image": 0.024755874474843342, "step_physics": 0.06069920937220256, "survival_time": 14.950000000000076, "driven_lanedir": 3.1765135984828876, "get_state_dump": 0.008121618429819743, "sim_render-ego": 0.004643121560414632, "get_robot_state": 0.009459538459777832, "get_duckie_state": 1.8485387166341145e-06, "in-drivable-lane": 1.2500000000000178, "agent_compute-ego": 0.03223778088887533, "deviation-heading": 2.038881838939147, "complete-iteration": 0.16615602016448974, "set_robot_commands": 0.0034354535738627115, "deviation-center-line": 0.4737070834202915, "driven_lanedir_consec": 3.1765135984828876, "sim_compute_sim_state": 0.019673515955607096, "sim_compute_performance-ego": 0.003038780689239502}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 3.573321785374329, "get_ui_image": 0.02930785894393921, "step_physics": 0.07080219189325969, "survival_time": 14.950000000000076, "driven_lanedir": 3.5411334862979245, "get_state_dump": 0.00919983704884847, "sim_render-ego": 0.005486131509145101, "get_robot_state": 0.010910611947377524, "get_duckie_state": 2.1711985270182293e-06, "in-drivable-lane": 0.0, "agent_compute-ego": 0.0362935225168864, "deviation-heading": 1.467872043420375, "complete-iteration": 0.19173598130544023, "set_robot_commands": 0.003960427443186442, "deviation-center-line": 0.4222981875337045, "driven_lanedir_consec": 3.5411334862979245, "sim_compute_sim_state": 0.022080933252970374, "sim_compute_performance-ego": 0.003583792050679525}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 3.5732267617448623, "get_ui_image": 0.029461963176727293, "step_physics": 0.07134611050287883, "survival_time": 14.950000000000076, "driven_lanedir": 3.130761234157957, "get_state_dump": 0.009101816813151042, "sim_render-ego": 0.005402817726135254, "get_robot_state": 0.01082019329071045, "get_duckie_state": 2.1719932556152342e-06, "in-drivable-lane": 0.9999999999999964, "agent_compute-ego": 0.036321808497111, "deviation-heading": 3.822038252553737, "complete-iteration": 0.1928362234433492, "set_robot_commands": 0.004115173021952311, "deviation-center-line": 0.835378255057404, "driven_lanedir_consec": 3.130761234157957, "sim_compute_sim_state": 0.02250504493713379, "sim_compute_performance-ego": 0.003651688893636067}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 3.5733264229705677, "get_ui_image": 0.028954152266184488, "step_physics": 0.07485505898793539, "survival_time": 14.950000000000076, "driven_lanedir": 3.543906207763869, "get_state_dump": 0.009589769045511882, "sim_render-ego": 0.0054149913787841794, "get_robot_state": 0.011299760341644286, "get_duckie_state": 2.272923787434896e-06, "in-drivable-lane": 0.0, "agent_compute-ego": 0.03569616079330444, "deviation-heading": 1.289207789779276, "complete-iteration": 0.1998254092534383, "set_robot_commands": 0.003995547294616699, "deviation-center-line": 0.4251649686989813, "driven_lanedir_consec": 3.543906207763869, "sim_compute_sim_state": 0.026322776476542156, "sim_compute_performance-ego": 0.0035856421788533527}, "ETHZ_autolab_technical_track-sc4-0-ego": {"driven_any": 3.5733247503936725, "get_ui_image": 0.029210246404012045, "step_physics": 0.0694572639465332, "survival_time": 14.950000000000076, "driven_lanedir": 3.546374493275372, "get_state_dump": 0.00926397403081258, "sim_render-ego": 0.005445417563120524, "get_robot_state": 0.010992684364318848, "get_duckie_state": 2.1266937255859375e-06, "in-drivable-lane": 0.0, "agent_compute-ego": 0.03609479029973348, "deviation-heading": 1.2813943413361804, "complete-iteration": 0.18796620766321817, "set_robot_commands": 0.004061412811279297, "deviation-center-line": 0.48244177864789733, "driven_lanedir_consec": 3.546374493275372, "sim_compute_sim_state": 0.019810067017873127, "sim_compute_performance-ego": 0.0035198203722635905}, "ETHZ_autolab_technical_track-sc5-0-ego": {"driven_any": 3.573308944854325, "get_ui_image": 0.025491814613342285, "step_physics": 0.06663678407669067, "survival_time": 14.950000000000076, "driven_lanedir": 3.5277629492222227, "get_state_dump": 0.009272428353627522, "sim_render-ego": 0.004781286716461181, "get_robot_state": 0.010431842803955078, "get_duckie_state": 1.8175443013509112e-06, "in-drivable-lane": 0.0, "agent_compute-ego": 0.02986033757527669, "deviation-heading": 1.4912348673628693, "complete-iteration": 0.17311407804489137, "set_robot_commands": 0.0035154533386230467, "deviation-center-line": 0.6347340974949494, "driven_lanedir_consec": 3.5277629492222227, "sim_compute_sim_state": 0.019879770278930665, "sim_compute_performance-ego": 0.003147422472635905}, "ETHZ_autolab_technical_track-sc6-0-ego": {"driven_any": 3.573324489903752, "get_ui_image": 0.02913480202356974, "step_physics": 0.07047186136245727, "survival_time": 14.950000000000076, "driven_lanedir": 3.5433224507851557, "get_state_dump": 0.0087666122118632, "sim_render-ego": 0.005280357201894124, "get_robot_state": 0.010315033594767252, "get_duckie_state": 2.032915751139323e-06, "in-drivable-lane": 0.0, "agent_compute-ego": 0.03359396696090698, "deviation-heading": 1.362557587185807, "complete-iteration": 0.1847441816329956, "set_robot_commands": 0.003939286867777506, "deviation-center-line": 0.5036090300669908, "driven_lanedir_consec": 3.5433224507851557, "sim_compute_sim_state": 0.019761006037394207, "sim_compute_performance-ego": 0.003377408981323242}, "ETHZ_autolab_technical_track-sc7-0-ego": {"driven_any": 3.5732958511664865, "get_ui_image": 0.029930017789204916, "step_physics": 0.07026429176330566, "survival_time": 14.950000000000076, "driven_lanedir": 3.2956307678116157, "get_state_dump": 0.009534088770548505, "sim_render-ego": 0.005338314374287923, "get_robot_state": 0.011128592491149902, "get_duckie_state": 2.235571543375651e-06, "in-drivable-lane": 0.8999999999999968, "agent_compute-ego": 0.03506318807601929, "deviation-heading": 1.5624964210085197, "complete-iteration": 0.1950041421254476, "set_robot_commands": 0.00402104377746582, "deviation-center-line": 0.380173203093675, "driven_lanedir_consec": 3.2956307678116157, "sim_compute_sim_state": 0.026152144273122152, "sim_compute_performance-ego": 0.003464655876159668}, "ETHZ_autolab_technical_track-sc8-0-ego": {"driven_any": 0.4551922313048015, "get_ui_image": 0.0338354923508384, "step_physics": 0.09794611822475088, "survival_time": 2.2, "driven_lanedir": 0.4530687352930016, "get_state_dump": 0.010232145136052912, "sim_render-ego": 0.005523768338290128, "get_robot_state": 0.011618516661904076, "get_duckie_state": 2.308325334028764e-06, "in-drivable-lane": 0.0, "agent_compute-ego": 0.03981596231460571, "deviation-heading": 0.22955720444994543, "complete-iteration": 0.2304492646997625, "set_robot_commands": 0.004380031065507369, "deviation-center-line": 0.09345238846662508, "driven_lanedir_consec": 0.4530687352930016, "sim_compute_sim_state": 0.023446088487451725, "sim_compute_performance-ego": 0.0035374218767339535}, "ETHZ_autolab_technical_track-sc9-0-ego": {"driven_any": 3.573278007563459, "get_ui_image": 0.030094522635142007, "step_physics": 0.07485417286554973, "survival_time": 14.950000000000076, "driven_lanedir": 3.2471360816645007, "get_state_dump": 0.009805270036061605, "sim_render-ego": 0.005528295834859212, "get_robot_state": 0.011024870077768962, "get_duckie_state": 2.2673606872558593e-06, "in-drivable-lane": 0.8500000000000121, "agent_compute-ego": 0.035158194700876874, "deviation-heading": 2.281374184464873, "complete-iteration": 0.1933439580599467, "set_robot_commands": 0.004033427238464355, "deviation-center-line": 0.529744558613175, "driven_lanedir_consec": 3.2471360816645007, "sim_compute_sim_state": 0.019146238962809245, "sim_compute_performance-ego": 0.003588863213857015}, "ETHZ_autolab_technical_track-sc10-0-ego": {"driven_any": 3.5732502549007457, "get_ui_image": 0.02984527667363485, "step_physics": 0.07155529657999675, "survival_time": 14.950000000000076, "driven_lanedir": 3.2945869784256265, "get_state_dump": 0.009251985549926758, "sim_render-ego": 0.005408198038736979, "get_robot_state": 0.01084540049235026, "get_duckie_state": 2.217292785644531e-06, "in-drivable-lane": 0.0, "agent_compute-ego": 0.0357658839225769, "deviation-heading": 4.861072932537895, "complete-iteration": 0.19341633955637613, "set_robot_commands": 0.004019383589426676, "deviation-center-line": 1.2032927842420045, "driven_lanedir_consec": 3.2945869784256265, "sim_compute_sim_state": 0.023021666208902995, "sim_compute_performance-ego": 0.0035937110582987468}, "ETHZ_autolab_technical_track-sc11-0-ego": {"driven_any": 3.5732238087915476, "get_ui_image": 0.03014537493387858, "step_physics": 0.07690306822458903, "survival_time": 14.950000000000076, "driven_lanedir": 2.891413528102826, "get_state_dump": 0.00907121181488037, "sim_render-ego": 0.005327186584472656, "get_robot_state": 0.010775527159372966, "get_duckie_state": 2.151330312093099e-06, "in-drivable-lane": 1.8500000000000103, "agent_compute-ego": 0.0349818476041158, "deviation-heading": 3.985571996243896, "complete-iteration": 0.19782336473464965, "set_robot_commands": 0.0040075135231018065, "deviation-center-line": 0.9313331219786944, "driven_lanedir_consec": 2.891413528102826, "sim_compute_sim_state": 0.023050202528635665, "sim_compute_performance-ego": 0.0034540549914042155}, "ETHZ_autolab_technical_track-sc12-0-ego": {"driven_any": 0.8586678196528237, "get_ui_image": 0.029804239025363673, "step_physics": 0.07689214991284656, "survival_time": 3.8499999999999943, "driven_lanedir": 0.7300373552978957, "get_state_dump": 0.009121188869724026, "sim_render-ego": 0.00516484310100605, "get_robot_state": 0.010677668955418973, "get_duckie_state": 2.1209964504489653e-06, "in-drivable-lane": 0.3999999999999986, "agent_compute-ego": 0.03262277392597942, "deviation-heading": 0.8261934729594337, "complete-iteration": 0.18856183894268877, "set_robot_commands": 0.0040178918219231936, "deviation-center-line": 0.2147924514200419, "driven_lanedir_consec": 0.7300373552978957, "sim_compute_sim_state": 0.016665858107727843, "sim_compute_performance-ego": 0.003485973779257242}, "ETHZ_autolab_technical_track-sc13-0-ego": {"driven_any": 3.573253261363621, "get_ui_image": 0.029368520577748615, "step_physics": 0.07560628652572632, "survival_time": 14.950000000000076, "driven_lanedir": 3.042619666737226, "get_state_dump": 0.00926301876703898, "sim_render-ego": 0.005215938886006673, "get_robot_state": 0.010861923694610595, "get_duckie_state": 2.1568934122721355e-06, "in-drivable-lane": 1.6000000000000227, "agent_compute-ego": 0.03525256236394247, "deviation-heading": 2.8998412377408136, "complete-iteration": 0.1999564115206401, "set_robot_commands": 0.004028780460357666, "deviation-center-line": 0.6021483058558789, "driven_lanedir_consec": 3.042619666737226, "sim_compute_sim_state": 0.02679646571477254, "sim_compute_performance-ego": 0.0034546995162963866}, "ETHZ_autolab_technical_track-sc14-0-ego": {"driven_any": 3.573193345777778, "get_ui_image": 0.029844375451405843, "step_physics": 0.07523447354634603, "survival_time": 14.950000000000076, "driven_lanedir": 2.91201612714542, "get_state_dump": 0.009263591766357422, "sim_render-ego": 0.005223841667175293, "get_robot_state": 0.010867764155069988, "get_duckie_state": 2.1775563557942707e-06, "in-drivable-lane": 1.950000000000008, "agent_compute-ego": 0.03561160484949748, "deviation-heading": 3.5717805573934016, "complete-iteration": 0.20043479045232135, "set_robot_commands": 0.00397892951965332, "deviation-center-line": 0.6521831182693782, "driven_lanedir_consec": 2.91201612714542, "sim_compute_sim_state": 0.026761865615844725, "sim_compute_performance-ego": 0.0035374037424723307}}
set_robot_commands_max0.004380031065507369
set_robot_commands_mean0.003967317023146548
set_robot_commands_median0.0040178918219231936
set_robot_commands_min0.0034354535738627115
sim_compute_performance-ego_max0.003651688893636067
sim_compute_performance-ego_mean0.003468089312874049
sim_compute_performance-ego_median0.0035198203722635905
sim_compute_performance-ego_min0.003038780689239502
sim_compute_sim_state_max0.02679646571477254
sim_compute_sim_state_mean0.022338242923714557
sim_compute_sim_state_median0.02250504493713379
sim_compute_sim_state_min0.016665858107727843
sim_render-ego_max0.005528295834859212
sim_render-ego_mean0.005278967365385995
sim_render-ego_median0.005338314374287923
sim_render-ego_min0.004643121560414632
simulation-passed1
step_physics_max0.09794611822475088
step_physics_mean0.07356828918567122
step_physics_median0.07155529657999675
step_physics_min0.06069920937220256
survival_time_max14.950000000000076
survival_time_mean13.360000000000069
survival_time_min2.2
No reset possible
4227611412Frank (Chude) Qian 🇨🇦challenge-aido_LF-baseline-behavior-cloningaido5-LF-sim-validationLFv-simsuccessnoreg01-b132bf379262-10:07:37
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median3.335947360227941
survival_time_median14.950000000000076
deviation-center-line_median0.4481641284223391
in-drivable-lane_median0.4999999999999982


other stats
agent_compute-ego_max0.03072866598765055
agent_compute-ego_mean0.029386290510495502
agent_compute-ego_median0.029185839494069415
agent_compute-ego_min0.02844481706619263
complete-iteration_max0.17279392162958782
complete-iteration_mean0.16330139915148417
complete-iteration_median0.16140784343083697
complete-iteration_min0.15759598811467487
deviation-center-line_max0.835378255057404
deviation-center-line_mean0.5385011748589467
deviation-center-line_min0.4222981875337045
deviation-heading_max3.822038252553737
deviation-heading_mean2.1106197263244004
deviation-heading_median1.6656164314822948
deviation-heading_min1.289207789779276
driven_any_max3.5733264229705677
driven_any_mean3.573293129562338
driven_any_median3.573309666766959
driven_any_min3.5732267617448623
driven_lanedir_consec_max3.543906207763869
driven_lanedir_consec_mean3.3322637892923375
driven_lanedir_consec_min3.1132542289495984
driven_lanedir_max3.543906207763869
driven_lanedir_mean3.3322637892923375
driven_lanedir_median3.335947360227941
driven_lanedir_min3.1132542289495984
get_duckie_state_max1.1769930521647135e-06
get_duckie_state_mean1.1201699574788411e-06
get_duckie_state_median1.1221567789713542e-06
get_duckie_state_min1.0593732198079427e-06
get_robot_state_max0.009987095991770426
get_robot_state_mean0.009831461509068808
get_robot_state_median0.00984841028849284
get_robot_state_min0.009641929467519125
get_state_dump_max0.008686877886454265
get_state_dump_mean0.008530380129814148
get_state_dump_median0.008550405502319336
get_state_dump_min0.008333831628163656
get_ui_image_max0.02562184810638428
get_ui_image_mean0.02431245962778727
get_ui_image_median0.02404231389363607
get_ui_image_min0.023543362617492677
in-drivable-lane_max1.6000000000000227
in-drivable-lane_mean0.6500000000000048
in-drivable-lane_min0.0
per-episodes
details{"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 3.5732975481595894, "get_ui_image": 0.02383737643559774, "step_physics": 0.05702666362126668, "survival_time": 14.950000000000076, "driven_lanedir": 3.1132542289495984, "get_state_dump": 0.008686877886454265, "sim_render-ego": 0.004510715007781983, "get_robot_state": 0.009842425187428791, "get_duckie_state": 1.0975201924641927e-06, "in-drivable-lane": 1.6000000000000227, "agent_compute-ego": 0.03072866598765055, "deviation-heading": 1.8633608195442144, "complete-iteration": 0.16024240016937255, "set_robot_commands": 0.0033126044273376464, "deviation-center-line": 0.47116328814569697, "driven_lanedir_consec": 3.1132542289495984, "sim_compute_sim_state": 0.019215974807739258, "sim_compute_performance-ego": 0.0030017375946044924}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 3.573321785374329, "get_ui_image": 0.023543362617492677, "step_physics": 0.057986330986022946, "survival_time": 14.950000000000076, "driven_lanedir": 3.5411334862979245, "get_state_dump": 0.008333831628163656, "sim_render-ego": 0.0044900870323181154, "get_robot_state": 0.009641929467519125, "get_duckie_state": 1.0593732198079427e-06, "in-drivable-lane": 0.0, "agent_compute-ego": 0.02844481706619263, "deviation-heading": 1.467872043420375, "complete-iteration": 0.15759598811467487, "set_robot_commands": 0.0032857290903727213, "deviation-center-line": 0.4222981875337045, "driven_lanedir_consec": 3.5411334862979245, "sim_compute_sim_state": 0.018837726910909017, "sim_compute_performance-ego": 0.002953586578369141}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 3.5732267617448623, "get_ui_image": 0.0242472513516744, "step_physics": 0.06015270709991455, "survival_time": 14.950000000000076, "driven_lanedir": 3.130761234157957, "get_state_dump": 0.008622477849324545, "sim_render-ego": 0.0046399084726969405, "get_robot_state": 0.009987095991770426, "get_duckie_state": 1.1467933654785155e-06, "in-drivable-lane": 0.9999999999999964, "agent_compute-ego": 0.028562715848286947, "deviation-heading": 3.822038252553737, "complete-iteration": 0.16257328669230142, "set_robot_commands": 0.0033547163009643556, "deviation-center-line": 0.835378255057404, "driven_lanedir_consec": 3.130761234157957, "sim_compute_sim_state": 0.01987637042999267, "sim_compute_performance-ego": 0.003050700028737386}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 3.5733264229705677, "get_ui_image": 0.02562184810638428, "step_physics": 0.06471714496612549, "survival_time": 14.950000000000076, "driven_lanedir": 3.543906207763869, "get_state_dump": 0.008478333155314127, "sim_render-ego": 0.004670825799306234, "get_robot_state": 0.009854395389556883, "get_duckie_state": 1.1769930521647135e-06, "in-drivable-lane": 0.0, "agent_compute-ego": 0.029808963139851888, "deviation-heading": 1.289207789779276, "complete-iteration": 0.17279392162958782, "set_robot_commands": 0.003477748235066732, "deviation-center-line": 0.4251649686989813, "driven_lanedir_consec": 3.543906207763869, "sim_compute_sim_state": 0.023009124596913656, "sim_compute_performance-ego": 0.003071137269337972}}
set_robot_commands_max0.003477748235066732
set_robot_commands_mean0.003357699513435364
set_robot_commands_median0.003333660364151001
set_robot_commands_min0.0032857290903727213
sim_compute_performance-ego_max0.003071137269337972
sim_compute_performance-ego_mean0.0030192903677622477
sim_compute_performance-ego_median0.0030262188116709395
sim_compute_performance-ego_min0.002953586578369141
sim_compute_sim_state_max0.023009124596913656
sim_compute_sim_state_mean0.020234799186388652
sim_compute_sim_state_median0.01954617261886597
sim_compute_sim_state_min0.018837726910909017
sim_render-ego_max0.004670825799306234
sim_render-ego_mean0.004577884078025818
sim_render-ego_median0.004575311740239462
sim_render-ego_min0.0044900870323181154
simulation-passed1
step_physics_max0.06471714496612549
step_physics_mean0.05997071166833242
step_physics_median0.05906951904296875
step_physics_min0.05702666362126668
survival_time_max14.950000000000076
survival_time_mean14.950000000000076
survival_time_min14.950000000000076
No reset possible