Duckietown Challenges Home Challenges Submissions

Submission 4352

Submission4352
Competingyes
Challengeaido3-LFV-sim-testing
UserManfred Diaz
Date submitted
Last status update
Completecomplete
DetailsEvaluation is complete.
Sisters
Result💚
Jobsstep1-simulation: 27568
Next
User labelchallenge-aido_LF-template-tensorflow
Admin priority50
Blessingn/a
User priority50

The highlights are available only to the owner and the admins.

Evaluation jobs for this submission

See previous jobs for previous versions of challenges
Job IDstepstatusup to datedate starteddate completeddurationmessage
27568step1-simulationsuccessyes0:10:17
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.2150955627140676
survival_time_median1.0000000000000002
deviation-center-line_median0.0647768216622839
in-drivable-lane_median0


other stats
agent_compute-ego_max0.029752333958943684
agent_compute-ego_mean0.02580237548546673
agent_compute-ego_median0.02539316090670499
agent_compute-ego_min0.022070358539449757
deviation-center-line_max0.11730386414598128
deviation-center-line_mean0.0697691190393038
deviation-center-line_min0.04177242357999885
deviation-heading_max0.7057842568418827
deviation-heading_mean0.4396512783456828
deviation-heading_median0.45700375457377784
deviation-heading_min0.1835816883041748
driven_any_max0.4528515554114102
driven_any_mean0.29784207951823394
driven_any_median0.27717108313998884
driven_any_min0.20833657736134575
driven_lanedir_consec_max0.39892943341819453
driven_lanedir_consec_mean0.24503872238301003
driven_lanedir_consec_min0.16288079379872933
driven_lanedir_max0.39892943341819453
driven_lanedir_mean0.24503872238301003
driven_lanedir_median0.2150955627140676
driven_lanedir_min0.16288079379872933
in-drivable-lane_max0.05000000000000005
in-drivable-lane_mean0.010000000000000007
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.3213943600594206, "sim_physics": 0.1495940327644348, "survival_time": 1.0000000000000002, "driven_lanedir": 0.2929346791018371, "sim_render-ego": 0.0115689754486084, "in-drivable-lane": 0, "agent_compute-ego": 0.02790771722793579, "deviation-heading": 0.3703925934897238, "set_robot_commands": 0.008199715614318847, "deviation-center-line": 0.05946958790800405, "driven_lanedir_consec": 0.2929346791018371, "sim_compute_sim_state": 0.004517316818237305, "sim_compute_performance-ego": 0.006286931037902832, "sim_compute_robot_state-ego": 0.007987439632415771, "sim_compute_robot_state-npc0": 0.007468521595001221, "sim_compute_robot_state-npc1": 0.007729125022888183, "sim_compute_robot_state-npc2": 0.007251358032226563, "sim_compute_robot_state-npc3": 0.00751720666885376}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.2561600597371167, "sim_physics": 0.15468473434448243, "survival_time": 1.0000000000000002, "driven_lanedir": 0.1961102196983613, "sim_render-ego": 0.011719274520874024, "in-drivable-lane": 0, "agent_compute-ego": 0.025103485584259032, "deviation-heading": 0.45700375457377784, "set_robot_commands": 0.007792794704437256, "deviation-center-line": 0.05917639381913024, "driven_lanedir_consec": 0.1961102196983613, "sim_compute_sim_state": 0.004004538059234619, "sim_compute_performance-ego": 0.007120740413665771, "sim_compute_robot_state-ego": 0.008000874519348144, "sim_compute_robot_state-npc0": 0.006923091411590576, "sim_compute_robot_state-npc1": 0.006899237632751465, "sim_compute_robot_state-npc2": 0.006847059726715088, "sim_compute_robot_state-npc3": 0.0064170598983764645}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.3105663000032091, "sim_physics": 0.15437481800715128, "survival_time": 1.2000000000000004, "driven_lanedir": 0.20550637011920936, "sim_render-ego": 0.011562844117482504, "in-drivable-lane": 0, "agent_compute-ego": 0.02874438961346944, "deviation-heading": 0.6863904837519761, "set_robot_commands": 0.0084970494111379, "deviation-center-line": 0.0973942067123777, "driven_lanedir_consec": 0.20550637011920936, "sim_compute_sim_state": 0.004740049441655477, "sim_compute_performance-ego": 0.006588359673817952, "sim_compute_robot_state-ego": 0.008676379919052124, "sim_compute_robot_state-npc0": 0.00855398178100586, "sim_compute_robot_state-npc1": 0.00899424155553182, "sim_compute_robot_state-npc2": 0.007676353057225545, "sim_compute_robot_state-npc3": 0.007641534010569255}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.27717108313998884, "sim_physics": 0.1656004504153603, "survival_time": 0.9500000000000004, "driven_lanedir": 0.25000994957855593, "sim_render-ego": 0.01070203279194079, "in-drivable-lane": 0, "agent_compute-ego": 0.026295185089111328, "deviation-heading": 0.3936545934076976, "set_robot_commands": 0.008377702612625925, "deviation-center-line": 0.05904082353180448, "driven_lanedir_consec": 0.25000994957855593, "sim_compute_sim_state": 0.00434741220976177, "sim_compute_performance-ego": 0.006184577941894531, "sim_compute_robot_state-ego": 0.007008489809538189, "sim_compute_robot_state-npc0": 0.006936274076762952, "sim_compute_robot_state-npc1": 0.006776884982460423, "sim_compute_robot_state-npc2": 0.006850669258519223, "sim_compute_robot_state-npc3": 0.007002328571520354}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.3384981309679753, "sim_physics": 0.15074270505171555, "survival_time": 1.3000000000000005, "driven_lanedir": 0.2737959746669121, "sim_render-ego": 0.01156911483177772, "in-drivable-lane": 0, "agent_compute-ego": 0.0249327512887808, "deviation-heading": 0.5451601676280756, "set_robot_commands": 0.007561711164621206, "deviation-center-line": 0.04177242357999885, "driven_lanedir_consec": 0.2737959746669121, "sim_compute_sim_state": 0.004472466615530161, "sim_compute_performance-ego": 0.007116491977985089, "sim_compute_robot_state-ego": 0.0075160815165593075, "sim_compute_robot_state-npc0": 0.0073091066800631006, "sim_compute_robot_state-npc1": 0.007265567779541016, "sim_compute_robot_state-npc2": 0.006867298713097205, "sim_compute_robot_state-npc3": 0.007310968178969163}, "ETHZ_autolab_technical_track-5-0": {"driven_any": 0.4528515554114102, "sim_physics": 0.15396996202140018, "survival_time": 1.4500000000000006, "driven_lanedir": 0.39892943341819453, "sim_render-ego": 0.014251758312356883, "in-drivable-lane": 0, "agent_compute-ego": 0.022070358539449757, "deviation-heading": 0.483533039289918, "set_robot_commands": 0.007238823792030071, "deviation-center-line": 0.04994712578578086, "driven_lanedir_consec": 0.39892943341819453, "sim_compute_sim_state": 0.004233516495803307, "sim_compute_performance-ego": 0.008570284679018218, "sim_compute_robot_state-ego": 0.007648887305424131, "sim_compute_robot_state-npc0": 0.007281484275028624, "sim_compute_robot_state-npc1": 0.007325024440370757, "sim_compute_robot_state-npc2": 0.007227223494957234, "sim_compute_robot_state-npc3": 0.007873304959001213}, "ETHZ_autolab_technical_track-6-0": {"driven_any": 0.22925169421311445, "sim_physics": 0.1970089375972748, "survival_time": 0.8000000000000002, "driven_lanedir": 0.21023944951003237, "sim_render-ego": 0.011429518461227415, "in-drivable-lane": 0, "agent_compute-ego": 0.02554844319820404, "deviation-heading": 0.26034105345116637, "set_robot_commands": 0.008888468146324158, "deviation-center-line": 0.0718624397669809, "driven_lanedir_consec": 0.21023944951003237, "sim_compute_sim_state": 0.004621937870979309, "sim_compute_performance-ego": 0.006651788949966431, "sim_compute_robot_state-ego": 0.00809316337108612, "sim_compute_robot_state-npc0": 0.008566528558731079, "sim_compute_robot_state-npc1": 0.007614642381668091, "sim_compute_robot_state-npc2": 0.008164435625076294, "sim_compute_robot_state-npc3": 0.00785839557647705}, "ETHZ_autolab_technical_track-7-0": {"driven_any": 0.24447775749803413, "sim_physics": 0.15641596442774722, "survival_time": 0.9500000000000004, "driven_lanedir": 0.2150955627140676, "sim_render-ego": 0.010664161882902446, "in-drivable-lane": 0, "agent_compute-ego": 0.023652026527806333, "deviation-heading": 0.25820291949681007, "set_robot_commands": 0.0071700372193989, "deviation-center-line": 0.06495319583584644, "driven_lanedir_consec": 0.2150955627140676, "sim_compute_sim_state": 0.004256311215852436, "sim_compute_performance-ego": 0.006424841127897564, "sim_compute_robot_state-ego": 0.008842066714638159, "sim_compute_robot_state-npc0": 0.007572751296193976, "sim_compute_robot_state-npc1": 0.007588512019107216, "sim_compute_robot_state-npc2": 0.007441031305413497, "sim_compute_robot_state-npc3": 0.007097821486623664}, "ETHZ_autolab_technical_track-8-0": {"driven_any": 0.4459063773429647, "sim_physics": 0.12577588327469363, "survival_time": 1.5500000000000007, "driven_lanedir": 0.3580568573791165, "sim_render-ego": 0.01135994542029596, "in-drivable-lane": 0, "agent_compute-ego": 0.024144126522925594, "deviation-heading": 0.654469555377805, "set_robot_commands": 0.007194680552328786, "deviation-center-line": 0.11730386414598128, "driven_lanedir_consec": 0.3580568573791165, "sim_compute_sim_state": 0.0045147557412424395, "sim_compute_performance-ego": 0.006526800893968151, "sim_compute_robot_state-ego": 0.007340231249409337, "sim_compute_robot_state-npc0": 0.007403104535994991, "sim_compute_robot_state-npc1": 0.006897003419937626, "sim_compute_robot_state-npc2": 0.007101605015416299, "sim_compute_robot_state-npc3": 0.007292939770606256}, "ETHZ_autolab_technical_track-9-0": {"driven_any": 0.27114105216140155, "sim_physics": 0.12178959449132284, "survival_time": 1.2000000000000004, "driven_lanedir": 0.18897081105359836, "sim_render-ego": 0.013022204240163168, "in-drivable-lane": 0, "agent_compute-ego": 0.02727355559666951, "deviation-heading": 0.7057842568418827, "set_robot_commands": 0.00801051656405131, "deviation-center-line": 0.08137405648182773, "driven_lanedir_consec": 0.18897081105359836, "sim_compute_sim_state": 0.004208683967590332, "sim_compute_performance-ego": 0.007505923509597778, "sim_compute_robot_state-ego": 0.00823978583017985, "sim_compute_robot_state-npc0": 0.007511516412099202, "sim_compute_robot_state-npc1": 0.007573366165161133, "sim_compute_robot_state-npc2": 0.007507175207138061, "sim_compute_robot_state-npc3": 0.007508158683776856}, "ETHZ_autolab_technical_track-10-0": {"driven_any": 0.2991847393239775, "sim_physics": 0.12958011843941428, "survival_time": 1.1000000000000003, "driven_lanedir": 0.25628559733365686, "sim_render-ego": 0.020633014765652744, "in-drivable-lane": 0.05000000000000005, "agent_compute-ego": 0.02539316090670499, "deviation-heading": 0.4032715894248714, "set_robot_commands": 0.009143385020169344, "deviation-center-line": 0.06986668280396122, "driven_lanedir_consec": 0.25628559733365686, "sim_compute_sim_state": 0.004588408903642135, "sim_compute_performance-ego": 0.009100263768976383, "sim_compute_robot_state-ego": 0.00870855288072066, "sim_compute_robot_state-npc0": 0.0081550424749201, "sim_compute_robot_state-npc1": 0.007884860038757324, "sim_compute_robot_state-npc2": 0.008202964609319513, "sim_compute_robot_state-npc3": 0.007928458127108488}, "ETHZ_autolab_technical_track-11-0": {"driven_any": 0.26267102487161464, "sim_physics": 0.14682858330862864, "survival_time": 1.0500000000000005, "driven_lanedir": 0.19269208167235383, "sim_render-ego": 0.012311174756004696, "in-drivable-lane": 0, "agent_compute-ego": 0.029752333958943684, "deviation-heading": 0.4668421461064573, "set_robot_commands": 0.009625071570986792, "deviation-center-line": 0.062472425143962874, "driven_lanedir_consec": 0.19269208167235383, "sim_compute_sim_state": 0.004546699069795154, "sim_compute_performance-ego": 0.006887390500023251, "sim_compute_robot_state-ego": 0.008581649689447312, "sim_compute_robot_state-npc0": 0.009267114457629975, "sim_compute_robot_state-npc1": 0.00839044934227353, "sim_compute_robot_state-npc2": 0.008038486753191267, "sim_compute_robot_state-npc3": 0.008826778048560732}, "ETHZ_autolab_technical_track-12-0": {"driven_any": 0.20833657736134575, "sim_physics": 0.1566530466079712, "survival_time": 0.9000000000000002, "driven_lanedir": 0.16288079379872933, "sim_render-ego": 0.011239422692192923, "in-drivable-lane": 0.05000000000000005, "agent_compute-ego": 0.025077965524461537, "deviation-heading": 0.26815472024788817, "set_robot_commands": 0.008011566268073188, "deviation-center-line": 0.0647768216622839, "driven_lanedir_consec": 0.16288079379872933, "sim_compute_sim_state": 0.004531794124179416, "sim_compute_performance-ego": 0.00673524538675944, "sim_compute_robot_state-ego": 0.008075396219889322, "sim_compute_robot_state-npc0": 0.00822085804409451, "sim_compute_robot_state-npc1": 0.0072415802213880755, "sim_compute_robot_state-npc2": 0.00729933049943712, "sim_compute_robot_state-npc3": 0.006744782129923503}, "ETHZ_autolab_technical_track-13-0": {"driven_any": 0.2553022910051468, "sim_physics": 0.1258330972571122, "survival_time": 0.9500000000000004, "driven_lanedir": 0.18991455654079337, "sim_render-ego": 0.011053599809345446, "in-drivable-lane": 0.05000000000000005, "agent_compute-ego": 0.026936242454930356, "deviation-heading": 0.4579866137930173, "set_robot_commands": 0.007801444906937449, "deviation-center-line": 0.04983531747202818, "driven_lanedir_consec": 0.18991455654079337, "sim_compute_sim_state": 0.004200144817954616, "sim_compute_performance-ego": 0.006460566269723992, "sim_compute_robot_state-ego": 0.00887072713751542, "sim_compute_robot_state-npc0": 0.007531868784051193, "sim_compute_robot_state-npc1": 0.007728388434962223, "sim_compute_robot_state-npc2": 0.007309110541092723, "sim_compute_robot_state-npc3": 0.00708091886419999}, "ETHZ_autolab_technical_track-14-0": {"driven_any": 0.2947181896767887, "sim_physics": 0.1611201386702688, "survival_time": 0.9500000000000004, "driven_lanedir": 0.28415849915973246, "sim_render-ego": 0.010223426316913803, "in-drivable-lane": 0, "agent_compute-ego": 0.024203890248348837, "deviation-heading": 0.1835816883041748, "set_robot_commands": 0.007355501777247379, "deviation-center-line": 0.09729142093958829, "driven_lanedir_consec": 0.28415849915973246, "sim_compute_sim_state": 0.003957986831665039, "sim_compute_performance-ego": 0.0055600467481111224, "sim_compute_robot_state-ego": 0.00806292734648052, "sim_compute_robot_state-npc0": 0.007113820628116005, "sim_compute_robot_state-npc1": 0.006572384583322625, "sim_compute_robot_state-npc2": 0.00691902010064376, "sim_compute_robot_state-npc3": 0.006455609672947934}}
set_robot_commands_max0.009625071570986792
set_robot_commands_mean0.008057897954979234
set_robot_commands_median0.00801051656405131
set_robot_commands_min0.0071700372193989
sim_compute_performance-ego_max0.009100263768976383
sim_compute_performance-ego_mean0.006914683525287234
sim_compute_performance-ego_median0.006651788949966431
sim_compute_performance-ego_min0.0055600467481111224
sim_compute_robot_state-ego_max0.00887072713751542
sim_compute_robot_state-ego_mean0.008110176876113626
sim_compute_robot_state-ego_median0.008075396219889322
sim_compute_robot_state-ego_min0.007008489809538189
sim_compute_robot_state-npc0_max0.009267114457629975
sim_compute_robot_state-npc0_mean0.007721004334085557
sim_compute_robot_state-npc0_median0.007511516412099202
sim_compute_robot_state-npc0_min0.006923091411590576
sim_compute_robot_state-npc1_max0.00899424155553182
sim_compute_robot_state-npc1_mean0.007498751201341433
sim_compute_robot_state-npc1_median0.007573366165161133
sim_compute_robot_state-npc1_min0.006572384583322625
sim_compute_robot_state-npc2_max0.008202964609319513
sim_compute_robot_state-npc2_mean0.00738020812929796
sim_compute_robot_state-npc2_median0.00729933049943712
sim_compute_robot_state-npc2_min0.006847059726715088
sim_compute_robot_state-npc3_max0.008826778048560732
sim_compute_robot_state-npc3_mean0.0073704176431676465
sim_compute_robot_state-npc3_median0.007310968178969163
sim_compute_robot_state-npc3_min0.0064170598983764645
sim_compute_sim_state_max0.004740049441655477
sim_compute_sim_state_mean0.004382801478874901
sim_compute_sim_state_median0.004472466615530161
sim_compute_sim_state_min0.003957986831665039
sim_physics_max0.1970089375972748
sim_physics_mean0.14999813777859852
sim_physics_median0.15396996202140018
sim_physics_min0.12178959449132284
sim_render-ego_max0.020633014765652744
sim_render-ego_mean0.012220697891182594
sim_render-ego_median0.011562844117482504
sim_render-ego_min0.010223426316913803
simulation-passed1
survival_time_max1.5500000000000007
survival_time_mean1.0900000000000003
survival_time_min0.8000000000000002
No reset possible
27567step1-simulationsuccessyes0:11:20
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible