Duckietown Challenges Home Challenges Submissions

Job 38013

Job ID38013
submission9972
userBea Baselines 🐤
user labeltemplate-pytorch
challengeaido5-LFV_multi-sim-validation
stepLFVmultibodyv-sim
statussuccess
up to date Note that this job is not up to date; the challenge has been changed.
evaluatormont04-2d53ef3af4c5-1
date started
date completed
duration0:25:08
message
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.17654906273525572
survival_time_median16.150000000000095
deviation-center-line_median0.08854055627930021
in-drivable-lane_median14.175000000000084


other stats
agent_compute-ego0_max0.019538266892813468
agent_compute-ego0_mean0.01884801000853616
agent_compute-ego0_median0.018653150682478865
agent_compute-ego0_min0.018352612450316143
agent_compute-ego1_max0.02032330943031545
agent_compute-ego1_mean0.019374704948499254
agent_compute-ego1_median0.019110780309986423
agent_compute-ego1_min0.01869002510519589
agent_compute-npc0_max0.04233108195790484
agent_compute-npc0_mean0.04148325507211042
agent_compute-npc0_median0.04136659567420547
agent_compute-npc0_min0.04075208758422096
agent_compute-npc1_max0.053076062465737935
agent_compute-npc1_mean0.04945479686194073
agent_compute-npc1_median0.04789058984936895
agent_compute-npc1_min0.04739773827071529
complete-iteration_max0.6818986725222114
complete-iteration_mean0.671943451076095
complete-iteration_median0.6710435272874059
complete-iteration_min0.6628881534186679
deviation-center-line_max0.6232715283947466
deviation-center-line_mean0.2379409133643312
deviation-center-line_min0.07351702383876668
deviation-heading_max5.138301725734727
deviation-heading_mean1.9741887227495667
deviation-heading_median0.7496904755179121
deviation-heading_min0.5833295862742058
driven_any_max7.316284648275778
driven_any_mean2.4711907587057724
driven_any_median1.728777669471162
driven_any_min0.2847228576197953
driven_lanedir_consec_max1.2316150940995525
driven_lanedir_consec_mean0.4823093660088402
driven_lanedir_consec_min0.1190109591781825
driven_lanedir_max1.2316150940995525
driven_lanedir_mean0.4823093660088402
driven_lanedir_median0.17654906273525572
driven_lanedir_min0.1190109591781825
get_duckie_state_max2.504200548739047e-06
get_duckie_state_mean2.473184432369526e-06
get_duckie_state_median2.4935219185483967e-06
get_duckie_state_min2.4218308298211347e-06
get_robot_state_max0.032264295896869494
get_robot_state_mean0.03121667164499493
get_robot_state_median0.03099289214288866
get_robot_state_min0.030392826895226634
get_state_dump_max0.023404961349042647
get_state_dump_mean0.02303789194610691
get_state_dump_median0.02286273259496541
get_state_dump_min0.022845981894312677
get_ui_image_max0.05411127329610819
get_ui_image_mean0.05374163953483949
get_ui_image_median0.05382189557359025
get_ui_image_min0.05329174973482003
in-drivable-lane_max31.250000000000284
in-drivable-lane_mean17.900000000000137
in-drivable-lane_min8.300000000000047
per-episodes
details{"ETHZ_autolab_technical_track-sc0-0-ego0": {"driven_any": 0.2847228576197953, "get_ui_image": 0.05329174973482003, "step_physics": 0.3556669657947096, "survival_time": 32.600000000000286, "driven_lanedir": 0.1190109591781825, "get_state_dump": 0.023404961349042647, "get_robot_state": 0.032264295896869494, "sim_render-ego0": 0.005391756815413025, "sim_render-ego1": 0.0055106797832652835, "sim_render-npc0": 0.005406525968773964, "sim_render-npc1": 0.005418920809505907, "get_duckie_state": 2.4935219185483967e-06, "in-drivable-lane": 31.250000000000284, "deviation-heading": 0.8214005415783973, "agent_compute-ego0": 0.019538266892813468, "agent_compute-ego1": 0.02032330943031545, "agent_compute-npc0": 0.04233108195790484, "agent_compute-npc1": 0.053076062465737935, "complete-iteration": 0.6818986725222114, "set_robot_commands": 0.0043277543015275265, "deviation-center-line": 0.09085732981531935, "driven_lanedir_consec": 0.1190109591781825, "sim_compute_sim_state": 0.02857477606439883, "sim_compute_performance-ego0": 0.003714765507750716, "sim_compute_performance-ego1": 0.003562457356716226, "sim_compute_performance-npc0": 0.003521481540305483, "sim_compute_performance-npc1": 0.0036663270435450266}, "ETHZ_autolab_technical_track-sc0-0-ego1": {"driven_any": 7.316284648275778, "get_ui_image": 0.05329174973482003, "step_physics": 0.3556669657947096, "survival_time": 32.600000000000286, "driven_lanedir": 0.176506200548197, "get_state_dump": 0.023404961349042647, "get_robot_state": 0.032264295896869494, "sim_render-ego0": 0.005391756815413025, "sim_render-ego1": 0.0055106797832652835, "sim_render-npc0": 0.005406525968773964, "sim_render-npc1": 0.005418920809505907, "get_duckie_state": 2.4935219185483967e-06, "in-drivable-lane": 31.150000000000286, "deviation-heading": 0.6779804094574269, "agent_compute-ego0": 0.019538266892813468, "agent_compute-ego1": 0.02032330943031545, "agent_compute-npc0": 0.04233108195790484, "agent_compute-npc1": 0.053076062465737935, "complete-iteration": 0.6818986725222114, "set_robot_commands": 0.0043277543015275265, "deviation-center-line": 0.07918409296743517, "driven_lanedir_consec": 0.176506200548197, "sim_compute_sim_state": 0.02857477606439883, "sim_compute_performance-ego0": 0.003714765507750716, "sim_compute_performance-ego1": 0.003562457356716226, "sim_compute_performance-npc0": 0.003521481540305483, "sim_compute_performance-npc1": 0.0036663270435450266}, "ETHZ_autolab_technical_track-sc0-1-ego0": {"driven_any": 0.32656701290116175, "get_ui_image": 0.05382189557359025, "step_physics": 0.34978022124316244, "survival_time": 14.800000000000075, "driven_lanedir": 0.17659192492231446, "get_state_dump": 0.022845981894312677, "get_robot_state": 0.03099289214288866, "sim_render-ego0": 0.005282284440221013, "sim_render-ego1": 0.005214887696343499, "sim_render-npc0": 0.005270366733138626, "sim_render-npc1": 0.005348206371874423, "get_duckie_state": 2.504200548739047e-06, "in-drivable-lane": 13.450000000000074, "deviation-heading": 0.5833295862742058, "agent_compute-ego0": 0.018352612450316143, "agent_compute-ego1": 0.019110780309986423, "agent_compute-npc0": 0.04136659567420547, "agent_compute-npc1": 0.04789058984936895, "complete-iteration": 0.6710435272874059, "set_robot_commands": 0.0043453686946147195, "deviation-center-line": 0.08622378274328105, "driven_lanedir_consec": 0.17659192492231446, "sim_compute_sim_state": 0.03475111803492984, "sim_compute_performance-ego0": 0.003617425222654601, "sim_compute_performance-ego1": 0.0034039229960054966, "sim_compute_performance-npc0": 0.0034536485736434523, "sim_compute_performance-npc1": 0.003600967091483038}, "ETHZ_autolab_technical_track-sc0-1-ego1": {"driven_any": 3.1309883260411624, "get_ui_image": 0.05382189557359025, "step_physics": 0.34978022124316244, "survival_time": 14.800000000000075, "driven_lanedir": 1.070322167657742, "get_state_dump": 0.022845981894312677, "get_robot_state": 0.03099289214288866, "sim_render-ego0": 0.005282284440221013, "sim_render-ego1": 0.005214887696343499, "sim_render-npc0": 0.005270366733138626, "sim_render-npc1": 0.005348206371874423, "get_duckie_state": 2.504200548739047e-06, "in-drivable-lane": 8.300000000000047, "deviation-heading": 3.969400682757283, "agent_compute-ego0": 0.018352612450316143, "agent_compute-ego1": 0.019110780309986423, "agent_compute-npc0": 0.04136659567420547, "agent_compute-npc1": 0.04789058984936895, "complete-iteration": 0.6710435272874059, "set_robot_commands": 0.0043453686946147195, "deviation-center-line": 0.4745917224264381, "driven_lanedir_consec": 1.070322167657742, "sim_compute_sim_state": 0.03475111803492984, "sim_compute_performance-ego0": 0.003617425222654601, "sim_compute_performance-ego1": 0.0034039229960054966, "sim_compute_performance-npc0": 0.0034536485736434523, "sim_compute_performance-npc1": 0.003600967091483038}, "ETHZ_autolab_technical_track-sc0-2-ego0": {"driven_any": 0.28557682819382396, "get_ui_image": 0.05411127329610819, "step_physics": 0.3436542598086614, "survival_time": 16.150000000000095, "driven_lanedir": 0.1198098496470532, "get_state_dump": 0.02286273259496541, "get_robot_state": 0.030392826895226634, "sim_render-ego0": 0.005159710952002935, "sim_render-ego1": 0.005233856177551458, "sim_render-npc0": 0.005258951393812434, "sim_render-npc1": 0.005239886027002482, "get_duckie_state": 2.4218308298211347e-06, "in-drivable-lane": 14.900000000000096, "deviation-heading": 0.6547193906953608, "agent_compute-ego0": 0.018653150682478865, "agent_compute-ego1": 0.01869002510519589, "agent_compute-npc0": 0.04075208758422096, "agent_compute-npc1": 0.04739773827071529, "complete-iteration": 0.6628881534186679, "set_robot_commands": 0.004278289275272712, "deviation-center-line": 0.07351702383876668, "driven_lanedir_consec": 0.1198098496470532, "sim_compute_sim_state": 0.03491987753947822, "sim_compute_performance-ego0": 0.00354674873706357, "sim_compute_performance-ego1": 0.0033934588771855497, "sim_compute_performance-npc0": 0.0033954754702446997, "sim_compute_performance-npc1": 0.0035565918075041872}, "ETHZ_autolab_technical_track-sc0-2-ego1": {"driven_any": 3.483004879202915, "get_ui_image": 0.05411127329610819, "step_physics": 0.3436542598086614, "survival_time": 16.150000000000095, "driven_lanedir": 1.2316150940995525, "get_state_dump": 0.02286273259496541, "get_robot_state": 0.030392826895226634, "sim_render-ego0": 0.005159710952002935, "sim_render-ego1": 0.005233856177551458, "sim_render-npc0": 0.005258951393812434, "sim_render-npc1": 0.005239886027002482, "get_duckie_state": 2.4218308298211347e-06, "in-drivable-lane": 8.350000000000046, "deviation-heading": 5.138301725734727, "agent_compute-ego0": 0.018653150682478865, "agent_compute-ego1": 0.01869002510519589, "agent_compute-npc0": 0.04075208758422096, "agent_compute-npc1": 0.04739773827071529, "complete-iteration": 0.6628881534186679, "set_robot_commands": 0.004278289275272712, "deviation-center-line": 0.6232715283947466, "driven_lanedir_consec": 1.2316150940995525, "sim_compute_sim_state": 0.03491987753947822, "sim_compute_performance-ego0": 0.00354674873706357, "sim_compute_performance-ego1": 0.0033934588771855497, "sim_compute_performance-npc0": 0.0033954754702446997, "sim_compute_performance-npc1": 0.0035565918075041872}}
set_robot_commands_max0.0043453686946147195
set_robot_commands_mean0.0043171374238049854
set_robot_commands_median0.0043277543015275265
set_robot_commands_min0.004278289275272712
sim_compute_performance-ego0_max0.003714765507750716
sim_compute_performance-ego0_mean0.0036263131558229617
sim_compute_performance-ego0_median0.003617425222654601
sim_compute_performance-ego0_min0.00354674873706357
sim_compute_performance-ego1_max0.003562457356716226
sim_compute_performance-ego1_mean0.0034532797433024236
sim_compute_performance-ego1_median0.0034039229960054966
sim_compute_performance-ego1_min0.0033934588771855497
sim_compute_performance-npc0_max0.003521481540305483
sim_compute_performance-npc0_mean0.003456868528064545
sim_compute_performance-npc0_median0.0034536485736434523
sim_compute_performance-npc0_min0.0033954754702446997
sim_compute_performance-npc1_max0.0036663270435450266
sim_compute_performance-npc1_mean0.003607961980844084
sim_compute_performance-npc1_median0.003600967091483038
sim_compute_performance-npc1_min0.0035565918075041872
sim_compute_sim_state_max0.03491987753947822
sim_compute_sim_state_mean0.03274859054626896
sim_compute_sim_state_median0.03475111803492984
sim_compute_sim_state_min0.02857477606439883
sim_render-ego0_max0.005391756815413025
sim_render-ego0_mean0.005277917402545657
sim_render-ego0_median0.005282284440221013
sim_render-ego0_min0.005159710952002935
sim_render-ego1_max0.0055106797832652835
sim_render-ego1_mean0.00531980788572008
sim_render-ego1_median0.005233856177551458
sim_render-ego1_min0.005214887696343499
sim_render-npc0_max0.005406525968773964
sim_render-npc0_mean0.005311948031908341
sim_render-npc0_median0.005270366733138626
sim_render-npc0_min0.005258951393812434
sim_render-npc1_max0.005418920809505907
sim_render-npc1_mean0.005335671069460937
sim_render-npc1_median0.005348206371874423
sim_render-npc1_min0.005239886027002482
simulation-passed1
step_physics_max0.3556669657947096
step_physics_mean0.3497004822821778
step_physics_median0.34978022124316244
step_physics_min0.3436542598086614
survival_time_max32.600000000000286
survival_time_mean21.183333333333483
survival_time_min14.800000000000075

Highlights

38013

Click the images to see detailed statistics about the episode.

ETHZ_autolab_technical_track-sc0-0

ETHZ_autolab_technical_track-sc0-1

ETHZ_autolab_technical_track-sc0-2

Artifacts

The artifacts are hidden.

Container logs

The logs are hidden.