Duckietown Challenges Home Challenges Submissions

Job 33578

Job ID33578
submission8127
userBea Baselines 🐤
user labelstraight
challengeaido5-LF-sim-validation
stepLFv-sim
statussuccess
up to date Note that this job is not up to date; the challenge has been changed.
evaluatorreg08-0c12c4a883f4-1
date started
date completed
duration0:18:19
message
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.6430501145491379
survival_time_median10.90000000000002
deviation-center-line_median0.3525330450206732
in-drivable-lane_median2.225000000000011


other stats
agent_compute-ego_max0.024074729283650717
agent_compute-ego_mean0.022796193081456497
agent_compute-ego_median0.022699575821558633
agent_compute-ego_min0.02181112766265869
complete-iteration_max0.3004433894425296
complete-iteration_mean0.2894845925730244
complete-iteration_median0.28836787922709595
complete-iteration_min0.2797145220366391
deviation-center-line_max0.9632944711251068
deviation-center-line_mean0.4630340322034023
deviation-center-line_min0.14192664544797587
deviation-heading_max2.098533601853976
deviation-heading_mean0.9754792675440108
deviation-heading_median0.7342551245090743
deviation-heading_min0.585297346117501
driven_any_max2.420991347968776
driven_any_mean1.6207752930494792
driven_any_median1.7473878924063322
driven_any_min0.6646238014128742
driven_lanedir_consec_max2.0163429659604093
driven_lanedir_consec_mean0.9238482055775374
driven_lanedir_consec_min0.4265885495638271
driven_lanedir_max2.0163429659604093
driven_lanedir_mean0.9238482055775374
driven_lanedir_median0.6430501145491379
driven_lanedir_min0.4265885495638271
get_state_dump_max0.01778704073370957
get_state_dump_mean0.016657855941195725
get_state_dump_median0.01640467334880942
get_state_dump_min0.015700340270996094
get_ui_image_max0.056605165654962715
get_ui_image_mean0.05370746103576115
get_ui_image_median0.054013886331172475
get_ui_image_min0.051077402219539735
in-drivable-lane_max10.500000000000083
in-drivable-lane_mean4.055000000000026
in-drivable-lane_min1.3499999999999952
per-episodes
details{"ETHZ_autolab_technical_track-0-0-ego": {"driven_any": 1.2994563656887796, "get_ui_image": 0.051077402219539735, "step_physics": 0.1285194492921597, "survival_time": 8.199999999999982, "driven_lanedir": 0.8875163355320987, "get_state_dump": 0.01778704073370957, "sim_render-ego": 0.0074052694367199405, "in-drivable-lane": 2.449999999999994, "agent_compute-ego": 0.023634065942066473, "deviation-heading": 0.656882474004175, "complete-iteration": 0.2860717409994544, "set_robot_commands": 0.006882309913635254, "deviation-center-line": 0.5442231045907214, "driven_lanedir_consec": 0.8875163355320987, "sim_compute_sim_state": 0.021833339842354377, "sim_compute_performance-ego": 0.006309124027810446, "sim_compute_robot_state-ego": 0.011297397497223643, "sim_compute_robot_state-parked0": 0.011108815670013428}, "ETHZ_autolab_technical_track-0-1-ego": {"driven_any": 2.1953194191238845, "get_ui_image": 0.05131295761641334, "step_physics": 0.12498593242729412, "survival_time": 13.600000000000058, "driven_lanedir": 1.1856250938826185, "get_state_dump": 0.017189103890867793, "sim_render-ego": 0.007301247295211344, "in-drivable-lane": 6.050000000000077, "agent_compute-ego": 0.023796141147613525, "deviation-heading": 0.6506184484994173, "complete-iteration": 0.28224052488803864, "set_robot_commands": 0.006877945626483244, "deviation-center-line": 0.7153797678025385, "driven_lanedir_consec": 1.1856250938826185, "sim_compute_sim_state": 0.02222983100835015, "sim_compute_performance-ego": 0.006280799998956568, "sim_compute_robot_state-ego": 0.011168828781913309, "sim_compute_robot_state-parked0": 0.010879226467188668}, "ETHZ_autolab_technical_track-1-0-ego": {"driven_any": 0.7783468901478676, "get_ui_image": 0.05629920725728951, "step_physics": 0.13428641300575406, "survival_time": 5.09999999999999, "driven_lanedir": 0.4870179525099734, "get_state_dump": 0.016361671335556927, "sim_render-ego": 0.006766337974398744, "in-drivable-lane": 1.699999999999994, "agent_compute-ego": 0.022231008492264098, "deviation-heading": 0.7371537164253312, "complete-iteration": 0.28762397812862023, "set_robot_commands": 0.006305916636597877, "deviation-center-line": 0.31383033576316843, "driven_lanedir_consec": 0.4870179525099734, "sim_compute_sim_state": 0.018778609294517367, "sim_compute_performance-ego": 0.005898251253015855, "sim_compute_robot_state-ego": 0.010435744827868892, "sim_compute_robot_state-parked0": 0.010056023504219804}, "ETHZ_autolab_technical_track-1-1-ego": {"driven_any": 0.678601870577068, "get_ui_image": 0.054301216361228, "step_physics": 0.1486721976419513, "survival_time": 4.449999999999992, "driven_lanedir": 0.4265885495638271, "get_state_dump": 0.016447675362061917, "sim_render-ego": 0.0071090205331866664, "in-drivable-lane": 1.4499999999999948, "agent_compute-ego": 0.022014545590690018, "deviation-heading": 0.7313565325928172, "complete-iteration": 0.3004433894425296, "set_robot_commands": 0.006369162141607048, "deviation-center-line": 0.2683902859812928, "driven_lanedir_consec": 0.4265885495638271, "sim_compute_sim_state": 0.018785878513636212, "sim_compute_performance-ego": 0.00584546099887805, "sim_compute_robot_state-ego": 0.010308729128891162, "sim_compute_robot_state-parked0": 0.010381862018885238}, "ETHZ_autolab_technical_track-2-0-ego": {"driven_any": 2.420991347968776, "get_ui_image": 0.054506079355875654, "step_physics": 0.13663264036178588, "survival_time": 14.950000000000076, "driven_lanedir": 0.6446180995854834, "get_state_dump": 0.01769321839014689, "sim_render-ego": 0.007233634789784749, "in-drivable-lane": 10.500000000000083, "agent_compute-ego": 0.024074729283650717, "deviation-heading": 0.8468082391327437, "complete-iteration": 0.2891117803255717, "set_robot_commands": 0.0065484126408894856, "deviation-center-line": 0.14192664544797587, "driven_lanedir_consec": 0.6446180995854834, "sim_compute_sim_state": 0.015320719877878823, "sim_compute_performance-ego": 0.005981527964274089, "sim_compute_robot_state-ego": 0.010601246356964113, "sim_compute_robot_state-parked0": 0.01031112829844157}, "ETHZ_autolab_technical_track-2-1-ego": {"driven_any": 2.4072325102045298, "get_ui_image": 0.053726556301116946, "step_physics": 0.1390138856569926, "survival_time": 14.950000000000076, "driven_lanedir": 0.6414821295127923, "get_state_dump": 0.01611677328745524, "sim_render-ego": 0.0068815461794535316, "in-drivable-lane": 10.500000000000083, "agent_compute-ego": 0.022911940415700275, "deviation-heading": 0.8474318367616545, "complete-iteration": 0.28507004896799726, "set_robot_commands": 0.006470007101694743, "deviation-center-line": 0.14728565348872835, "driven_lanedir_consec": 0.6414821295127923, "sim_compute_sim_state": 0.014334526856740316, "sim_compute_performance-ego": 0.005590362548828125, "sim_compute_robot_state-ego": 0.00992916504542033, "sim_compute_robot_state-parked0": 0.009897143840789794}, "ETHZ_autolab_technical_track-3-0-ego": {"driven_any": 2.411956006437587, "get_ui_image": 0.05244992017745972, "step_physics": 0.14527663071950278, "survival_time": 14.950000000000076, "driven_lanedir": 2.0163429659604093, "get_state_dump": 0.016047765413920084, "sim_render-ego": 0.007059057553609212, "in-drivable-lane": 1.9500000000000275, "agent_compute-ego": 0.02248721122741699, "deviation-heading": 2.098533601853976, "complete-iteration": 0.29580715894699094, "set_robot_commands": 0.0064140113194783525, "deviation-center-line": 0.8309439677931447, "driven_lanedir_consec": 2.0163429659604093, "sim_compute_sim_state": 0.020231870810190837, "sim_compute_performance-ego": 0.005661230087280273, "sim_compute_robot_state-ego": 0.0100885009765625, "sim_compute_robot_state-parked0": 0.00989302396774292}, "ETHZ_autolab_technical_track-3-1-ego": {"driven_any": 2.410019798332097, "get_ui_image": 0.052251645723978675, "step_physics": 0.14153059800465903, "survival_time": 14.950000000000076, "driven_lanedir": 2.008955624758421, "get_state_dump": 0.01708914041519165, "sim_render-ego": 0.006996189753214518, "in-drivable-lane": 2.0000000000000284, "agent_compute-ego": 0.023149329821268716, "deviation-heading": 2.0093607750461997, "complete-iteration": 0.29491865158081054, "set_robot_commands": 0.0064942653973897296, "deviation-center-line": 0.9632944711251068, "driven_lanedir_consec": 2.008955624758421, "sim_compute_sim_state": 0.020661974747975667, "sim_compute_performance-ego": 0.005973169803619385, "sim_compute_robot_state-ego": 0.010501391887664796, "sim_compute_robot_state-parked0": 0.01006582498550415}, "ETHZ_autolab_technical_track-4-0-ego": {"driven_any": 0.6646238014128742, "get_ui_image": 0.0545444596897472, "step_physics": 0.13330527327277444, "survival_time": 4.399999999999992, "driven_lanedir": 0.4333735891477426, "get_state_dump": 0.015700340270996094, "sim_render-ego": 0.006608003919774836, "in-drivable-lane": 1.3499999999999952, "agent_compute-ego": 0.02181112766265869, "deviation-heading": 0.5913497050062915, "complete-iteration": 0.2797145220366391, "set_robot_commands": 0.006231028925288807, "deviation-center-line": 0.31869876800675323, "driven_lanedir_consec": 0.4333735891477426, "sim_compute_sim_state": 0.016046090559525925, "sim_compute_performance-ego": 0.005529344081878662, "sim_compute_robot_state-ego": 0.009808724576776678, "sim_compute_robot_state-parked0": 0.009933458133177324}, "ETHZ_autolab_technical_track-4-1-ego": {"driven_any": 0.9412049206013268, "get_ui_image": 0.056605165654962715, "step_physics": 0.14289094002778863, "survival_time": 6.0499999999999865, "driven_lanedir": 0.5069617153220096, "get_state_dump": 0.016145830312051065, "sim_render-ego": 0.006912369373416112, "in-drivable-lane": 2.5999999999999908, "agent_compute-ego": 0.02185183123123547, "deviation-heading": 0.585297346117501, "complete-iteration": 0.29384413041359136, "set_robot_commands": 0.006334188555882982, "deviation-center-line": 0.3863673220345931, "driven_lanedir_consec": 0.5069617153220096, "sim_compute_sim_state": 0.017434967450859134, "sim_compute_performance-ego": 0.005549263363042153, "sim_compute_robot_state-ego": 0.010094717514416403, "sim_compute_robot_state-parked0": 0.0098204671843978}}
set_robot_commands_max0.006882309913635254
set_robot_commands_mean0.006492724825894752
set_robot_commands_median0.006442009210586548
set_robot_commands_min0.006231028925288807
sim_compute_performance-ego_max0.006309124027810446
sim_compute_performance-ego_mean0.005861853412758361
sim_compute_performance-ego_median0.0058718561259469525
sim_compute_performance-ego_min0.005529344081878662
sim_compute_robot_state-ego_max0.011297397497223643
sim_compute_robot_state-ego_mean0.010423444659370182
sim_compute_robot_state-ego_median0.010372236978380026
sim_compute_robot_state-ego_min0.009808724576776678
sim_compute_robot_state-parked0_max0.011108815670013428
sim_compute_robot_state-parked0_mean0.010234697407036067
sim_compute_robot_state-parked0_median0.010060924244861977
sim_compute_robot_state-parked0_min0.0098204671843978
sim_compute_sim_state_max0.02222983100835015
sim_compute_sim_state_mean0.01856578089620288
sim_compute_sim_state_median0.01878224390407679
sim_compute_sim_state_min0.014334526856740316
sim_render-ego_max0.0074052694367199405
sim_render-ego_mean0.007027267680876967
sim_render-ego_median0.007027623653411865
sim_render-ego_min0.006608003919774836
simulation-passed1
step_physics_max0.1486721976419513
step_physics_mean0.13751139604106624
step_physics_median0.13782326300938924
step_physics_min0.12498593242729412
survival_time_max14.950000000000076
survival_time_mean10.16000000000003
survival_time_min4.399999999999992

Highlights

33578

Click the images to see detailed statistics about the episode.

ETHZ_autolab_technical_track-0-0

ETHZ_autolab_technical_track-0-1

ETHZ_autolab_technical_track-1-0

ETHZ_autolab_technical_track-1-1

ETHZ_autolab_technical_track-2-0

ETHZ_autolab_technical_track-2-1

ETHZ_autolab_technical_track-3-0

ETHZ_autolab_technical_track-3-1

ETHZ_autolab_technical_track-4-0

ETHZ_autolab_technical_track-4-1

Artifacts

The artifacts are hidden.

Container logs

The logs are hidden.