Duckietown Challenges Home Challenges Submissions

Submission 3522

Submission3522
Competingyes
Challengeaido2-LF-sim-testing
UserBea Baselines 🐤
Date submitted
Last status update
Completecomplete
DetailsEvaluation is complete.
Sisters
Result💚
Jobsstep1-simulation: 23297
Next
User labelchallenge-aido_LF-baseline-duckietown
Admin priority60
Blessingn/a
User priority60

The highlights are available only to the owner and the admins.

Evaluation jobs for this submission

See previous jobs for previous versions of challenges
Job IDstepstatusup to datedate starteddate completeddurationmessage
23297step1-simulationsuccessyes0:32:59
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.9105331996117574
survival_time_median8.74999999999999
deviation-center-line_median0.46886116053489474
in-drivable-lane_median0.34999999999999876


other stats
agent_compute-ego_max0.07810636086039024
agent_compute-ego_mean0.07436389062871882
agent_compute-ego_median0.07448513348897298
agent_compute-ego_min0.07002494017283122
deviation-center-line_max1.1012324949869747
deviation-center-line_mean0.621843615823598
deviation-center-line_min0.2889055808577541
deviation-heading_max7.107524749582782
deviation-heading_mean3.8058642600613912
deviation-heading_median3.0251949916387693
deviation-heading_min0.5502674045269355
driven_any_max2.3489927525744947
driven_any_mean1.4489005949195004
driven_any_median1.352531358730641
driven_any_min0.5650993704023596
driven_lanedir_consec_max2.046205394069817
driven_lanedir_consec_mean0.9745579803094024
driven_lanedir_consec_min0.1525942748122022
driven_lanedir_max2.1053729748967536
driven_lanedir_mean1.1244314428388231
driven_lanedir_median1.205866895080879
driven_lanedir_min0.3649923729690858
in-drivable-lane_max3.250000000000007
in-drivable-lane_mean0.7933333333333384
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 2.3411159850977534, "sim_physics": 0.0594221035639445, "survival_time": 14.950000000000076, "driven_lanedir": 1.699677581130716, "sim_render-ego": 0.06619154691696166, "in-drivable-lane": 1.600000000000012, "agent_compute-ego": 0.07002494017283122, "deviation-heading": 7.082358601554364, "set_robot_commands": 0.07578945795694987, "deviation-center-line": 1.0845556685188198, "driven_lanedir_consec": 1.4679276842489914, "sim_compute_sim_state": 0.04304686943689982, "sim_compute_performance-ego": 0.06750391642252604, "sim_compute_robot_state-ego": 0.0646195642153422}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.8542933877758306, "sim_physics": 0.06227175746343832, "survival_time": 5.649999999999988, "driven_lanedir": 0.6421240312844261, "sim_render-ego": 0.06793188626787304, "in-drivable-lane": 0.2999999999999998, "agent_compute-ego": 0.0749681903197702, "deviation-heading": 2.8029429212628454, "set_robot_commands": 0.0787076169410638, "deviation-center-line": 0.5236766803222217, "driven_lanedir_consec": 0.3443522362026865, "sim_compute_sim_state": 0.04466019900499192, "sim_compute_performance-ego": 0.07112932416190089, "sim_compute_robot_state-ego": 0.06637424283323035}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.6294000090464213, "sim_physics": 0.06230819646049948, "survival_time": 4.249999999999993, "driven_lanedir": 0.6165531290452786, "sim_render-ego": 0.06986186644610237, "in-drivable-lane": 0, "agent_compute-ego": 0.07360470435198616, "deviation-heading": 0.7555768557880084, "set_robot_commands": 0.08253310427946203, "deviation-center-line": 0.4377265710375471, "driven_lanedir_consec": 0.6165531290452786, "sim_compute_sim_state": 0.045275278652415554, "sim_compute_performance-ego": 0.06959921051474179, "sim_compute_robot_state-ego": 0.06713245335747214}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 2.348443440916489, "sim_physics": 0.06271527369817098, "survival_time": 14.950000000000076, "driven_lanedir": 1.386442999493246, "sim_render-ego": 0.07024209499359131, "in-drivable-lane": 3.250000000000007, "agent_compute-ego": 0.07448513348897298, "deviation-heading": 7.107524749582782, "set_robot_commands": 0.08097607374191285, "deviation-center-line": 0.9509148873649668, "driven_lanedir_consec": 0.9105331996117574, "sim_compute_sim_state": 0.045116953055063885, "sim_compute_performance-ego": 0.07113561789194743, "sim_compute_robot_state-ego": 0.06785804430643717}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.352531358730641, "sim_physics": 0.0631691905430385, "survival_time": 8.74999999999999, "driven_lanedir": 1.205866895080879, "sim_render-ego": 0.06921287264142717, "in-drivable-lane": 0.05000000000000071, "agent_compute-ego": 0.0734056077684675, "deviation-heading": 3.0251949916387693, "set_robot_commands": 0.08036584717886788, "deviation-center-line": 0.39246289000961915, "driven_lanedir_consec": 1.205866895080879, "sim_compute_sim_state": 0.04500697272164481, "sim_compute_performance-ego": 0.0712225137438093, "sim_compute_robot_state-ego": 0.0672847979409354}, "ETHZ_autolab_technical_track-5-0": {"driven_any": 2.3487682879377525, "sim_physics": 0.06265082200368245, "survival_time": 14.950000000000076, "driven_lanedir": 1.66663131679877, "sim_render-ego": 0.06961086193720499, "in-drivable-lane": 1.9500000000000275, "agent_compute-ego": 0.07374286651611328, "deviation-heading": 6.939153480174019, "set_robot_commands": 0.07921091397603353, "deviation-center-line": 0.8307035728141909, "driven_lanedir_consec": 1.476540048515924, "sim_compute_sim_state": 0.04479373455047608, "sim_compute_performance-ego": 0.07076534589131674, "sim_compute_robot_state-ego": 0.06915850003560384}, "ETHZ_autolab_technical_track-6-0": {"driven_any": 1.4570084604318512, "sim_physics": 0.060875081001444065, "survival_time": 9.4, "driven_lanedir": 1.2299754639539675, "sim_render-ego": 0.06904787712908805, "in-drivable-lane": 0.30000000000000426, "agent_compute-ego": 0.07505504755263633, "deviation-heading": 3.981964268223915, "set_robot_commands": 0.07970808668339506, "deviation-center-line": 0.46886116053489474, "driven_lanedir_consec": 1.2299754639539675, "sim_compute_sim_state": 0.04395443708338636, "sim_compute_performance-ego": 0.07019736411723684, "sim_compute_robot_state-ego": 0.06557371007635239}, "ETHZ_autolab_technical_track-7-0": {"driven_any": 0.7017407403175606, "sim_physics": 0.061020011597491326, "survival_time": 4.699999999999991, "driven_lanedir": 0.6230755760122261, "sim_render-ego": 0.06893455982208252, "in-drivable-lane": 0.4499999999999984, "agent_compute-ego": 0.07297871214278201, "deviation-heading": 0.5502674045269355, "set_robot_commands": 0.07697715657822629, "deviation-center-line": 0.4182293227116716, "driven_lanedir_consec": 0.6230755760122261, "sim_compute_sim_state": 0.04369845035228324, "sim_compute_performance-ego": 0.07081577879317263, "sim_compute_robot_state-ego": 0.06513287919632932}, "ETHZ_autolab_technical_track-8-0": {"driven_any": 2.3485634274720995, "sim_physics": 0.06179255565007528, "survival_time": 14.950000000000076, "driven_lanedir": 1.6343985330703692, "sim_render-ego": 0.06990999301274617, "in-drivable-lane": 2.0000000000000107, "agent_compute-ego": 0.07339399576187133, "deviation-heading": 6.558135520366688, "set_robot_commands": 0.07828379472096761, "deviation-center-line": 1.1012324949869747, "driven_lanedir_consec": 1.1491904508452029, "sim_compute_sim_state": 0.04458198626836141, "sim_compute_performance-ego": 0.07008235216140747, "sim_compute_robot_state-ego": 0.06775541305541992}, "ETHZ_autolab_technical_track-9-0": {"driven_any": 0.7579005013336338, "sim_physics": 0.06547470848159034, "survival_time": 5.04999999999999, "driven_lanedir": 0.6815029613755158, "sim_render-ego": 0.06968265476793346, "in-drivable-lane": 0, "agent_compute-ego": 0.07810636086039024, "deviation-heading": 1.7445023462223843, "set_robot_commands": 0.08057099049634273, "deviation-center-line": 0.3539333999588354, "driven_lanedir_consec": 0.6815029613755158, "sim_compute_sim_state": 0.044953922233959234, "sim_compute_performance-ego": 0.07275156927580881, "sim_compute_robot_state-ego": 0.06757265270346462}, "ETHZ_autolab_technical_track-10-0": {"driven_any": 0.5650993704023596, "sim_physics": 0.0640353165663682, "survival_time": 3.8499999999999943, "driven_lanedir": 0.5472928626397605, "sim_render-ego": 0.06954072977041269, "in-drivable-lane": 0, "agent_compute-ego": 0.0748238315829983, "deviation-heading": 0.8071601315288, "set_robot_commands": 0.08205757512674704, "deviation-center-line": 0.3713146496765613, "driven_lanedir_consec": 0.5472928626397605, "sim_compute_sim_state": 0.0440250774482628, "sim_compute_performance-ego": 0.07391890302881018, "sim_compute_robot_state-ego": 0.06840219745388279}, "ETHZ_autolab_technical_track-11-0": {"driven_any": 0.7338032228849897, "sim_physics": 0.06258662379517847, "survival_time": 4.899999999999991, "driven_lanedir": 0.6086849129687637, "sim_render-ego": 0.06922754219600133, "in-drivable-lane": 0.34999999999999876, "agent_compute-ego": 0.07304509075320496, "deviation-heading": 1.6270950044583352, "set_robot_commands": 0.0811286921403846, "deviation-center-line": 0.2889055808577541, "driven_lanedir_consec": 0.6086849129687637, "sim_compute_sim_state": 0.04316451598186882, "sim_compute_performance-ego": 0.069862606574078, "sim_compute_robot_state-ego": 0.06729638819791833}, "ETHZ_autolab_technical_track-12-0": {"driven_any": 0.5971166660986074, "sim_physics": 0.0625338112866437, "survival_time": 4.049999999999994, "driven_lanedir": 0.3649923729690858, "sim_render-ego": 0.06865810464929652, "in-drivable-lane": 0.4499999999999993, "agent_compute-ego": 0.07594699624144001, "deviation-heading": 2.1888315894376564, "set_robot_commands": 0.08201107272395382, "deviation-center-line": 0.3008303559076839, "driven_lanedir_consec": 0.1525942748122022, "sim_compute_sim_state": 0.04390771889392241, "sim_compute_performance-ego": 0.06984071084010748, "sim_compute_robot_state-ego": 0.06648111343383789}, "ETHZ_autolab_technical_track-13-0": {"driven_any": 2.3489927525744947, "sim_physics": 0.06323512713114421, "survival_time": 14.950000000000076, "driven_lanedir": 2.1053729748967536, "sim_render-ego": 0.07108763853708903, "in-drivable-lane": 0.25000000000000355, "agent_compute-ego": 0.07481330871582031, "deviation-heading": 5.147190252536901, "set_robot_commands": 0.08077292521794636, "deviation-center-line": 0.7283401972676937, "driven_lanedir_consec": 2.046205394069817, "sim_compute_sim_state": 0.04488282362620036, "sim_compute_performance-ego": 0.07276196082433065, "sim_compute_robot_state-ego": 0.06782719532648722}, "ETHZ_autolab_technical_track-14-0": {"driven_any": 2.348731312772021, "sim_physics": 0.06456433852513631, "survival_time": 14.950000000000076, "driven_lanedir": 1.853880031862586, "sim_render-ego": 0.07117965380350749, "in-drivable-lane": 0.9500000000000136, "agent_compute-ego": 0.0770635732014974, "deviation-heading": 6.77006578361847, "set_robot_commands": 0.08211295445760092, "deviation-center-line": 1.075966805384535, "driven_lanedir_consec": 1.558074615258064, "sim_compute_sim_state": 0.04572325070699056, "sim_compute_performance-ego": 0.0719012212753296, "sim_compute_robot_state-ego": 0.07021227677663168}}
set_robot_commands_max0.08253310427946203
set_robot_commands_mean0.08008041748132362
set_robot_commands_median0.08057099049634273
set_robot_commands_min0.07578945795694987
sim_compute_performance-ego_max0.07391890302881018
sim_compute_performance-ego_mean0.07089922636776826
sim_compute_performance-ego_median0.07081577879317263
sim_compute_performance-ego_min0.06750391642252604
sim_compute_robot_state-ego_max0.07021227677663168
sim_compute_robot_state-ego_mean0.06724542859395634
sim_compute_robot_state-ego_median0.06729638819791833
sim_compute_robot_state-ego_min0.0646195642153422
sim_compute_sim_state_max0.04572325070699056
sim_compute_sim_state_mean0.04445281266778181
sim_compute_sim_state_median0.04466019900499192
sim_compute_sim_state_min0.04304686943689982
sim_physics_max0.06547470848159034
sim_physics_mean0.06257699451785641
sim_physics_median0.06258662379517847
sim_physics_min0.0594221035639445
sim_render-ego_max0.07117965380350749
sim_render-ego_mean0.06935465885942119
sim_render-ego_median0.06954072977041269
sim_render-ego_min0.06619154691696166
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean9.353333333333358
survival_time_min3.8499999999999943
No reset possible
22261step1-simulationsuccessyes0:25:37
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible