Duckietown Challenges Home Challenges Submissions

Submission 2599

Submission2599
Competingyes
Challengeaido2-LF-sim-testing
UserLiam Paull 🇨🇦
Date submitted
Last status update
Completecomplete
DetailsEvaluation is complete.
Sisters
Result💚
Jobsstep1-simulation: 22871
Next
User labelchallenge-aido_LF-template-pytorch
Admin priority50
Blessingn/a
User priority50

The highlights are available only to the owner and the admins.

Evaluation jobs for this submission

See previous jobs for previous versions of challenges
Job IDstepstatusup to datedate starteddate completeddurationmessage
22871step1-simulationsuccessyes0:12:06
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.1139735627251528
survival_time_median1.3500000000000003
deviation-center-line_median0.08503964153926305
in-drivable-lane_median0


other stats
agent_compute-ego_max0.20329191066600655
agent_compute-ego_mean0.17239502975860038
agent_compute-ego_median0.17171478271484375
agent_compute-ego_min0.13107856114705405
deviation-center-line_max0.1212710617322007
deviation-center-line_mean0.08670343154711144
deviation-center-line_min0.06221135828939317
deviation-heading_max0.9968959112231024
deviation-heading_mean0.7572270058137147
deviation-heading_median0.7592158790972738
deviation-heading_min0.4558983017349816
driven_any_max0.2337768127869152
driven_any_mean0.1728229565267463
driven_any_median0.17537372134431994
driven_any_min0.10880362219541367
driven_lanedir_consec_max0.1732475914950573
driven_lanedir_consec_mean0.1179049109046419
driven_lanedir_consec_min0.07501591491870618
driven_lanedir_max0.1732475914950573
driven_lanedir_mean0.1179049109046419
driven_lanedir_median0.1139735627251528
driven_lanedir_min0.07501591491870618
in-drivable-lane_max0.15000000000000013
in-drivable-lane_mean0.023333333333333355
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.2337768127869152, "sim_physics": 0.14239862470915823, "survival_time": 1.6500000000000008, "driven_lanedir": 0.1465881247200835, "sim_render-ego": 0.06840209527449174, "in-drivable-lane": 0.10000000000000007, "agent_compute-ego": 0.19836907675772003, "deviation-heading": 0.9373488182848472, "set_robot_commands": 0.10610135396321614, "deviation-center-line": 0.09589074414272385, "driven_lanedir_consec": 0.1465881247200835, "sim_compute_sim_state": 0.04284101544004498, "sim_compute_performance-ego": 0.07743815219763553, "sim_compute_robot_state-ego": 0.08821915857719653}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.22638205838121855, "sim_physics": 0.10800717157476088, "survival_time": 1.7000000000000008, "driven_lanedir": 0.1566142987092367, "sim_render-ego": 0.06316871502820183, "in-drivable-lane": 0.05000000000000005, "agent_compute-ego": 0.17555786581600413, "deviation-heading": 0.8973721215780901, "set_robot_commands": 0.0920324816423304, "deviation-center-line": 0.06971392826586914, "driven_lanedir_consec": 0.1566142987092367, "sim_compute_sim_state": 0.03905265471514534, "sim_compute_performance-ego": 0.07001454689923454, "sim_compute_robot_state-ego": 0.07620195080252255}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.12840875721871625, "sim_physics": 0.11805632000877744, "survival_time": 1.0500000000000005, "driven_lanedir": 0.09710921619299072, "sim_render-ego": 0.06461857614063081, "in-drivable-lane": 0, "agent_compute-ego": 0.167175327028547, "deviation-heading": 0.5640728245542901, "set_robot_commands": 0.10255880582900274, "deviation-center-line": 0.10018248397771824, "driven_lanedir_consec": 0.09710921619299072, "sim_compute_sim_state": 0.040733133043561666, "sim_compute_performance-ego": 0.07131196203685942, "sim_compute_robot_state-ego": 0.08275156929379418}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.189143589203882, "sim_physics": 0.08490536831043384, "survival_time": 1.3500000000000003, "driven_lanedir": 0.1139735627251528, "sim_render-ego": 0.05043504856250904, "in-drivable-lane": 0, "agent_compute-ego": 0.13107856114705405, "deviation-heading": 0.9968959112231024, "set_robot_commands": 0.07187053892347547, "deviation-center-line": 0.0808985426145111, "driven_lanedir_consec": 0.1139735627251528, "sim_compute_sim_state": 0.03330234245017723, "sim_compute_performance-ego": 0.0529853414606165, "sim_compute_robot_state-ego": 0.05471231319286205}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.2323156261313799, "sim_physics": 0.0875069722533226, "survival_time": 1.6000000000000008, "driven_lanedir": 0.1732475914950573, "sim_render-ego": 0.05455400794744491, "in-drivable-lane": 0, "agent_compute-ego": 0.13605009764432907, "deviation-heading": 0.7794392359100324, "set_robot_commands": 0.07473644614219666, "deviation-center-line": 0.07935154241235286, "driven_lanedir_consec": 0.1732475914950573, "sim_compute_sim_state": 0.03091626614332199, "sim_compute_performance-ego": 0.05467066168785095, "sim_compute_robot_state-ego": 0.0558088943362236}, "ETHZ_autolab_technical_track-5-0": {"driven_any": 0.18976264857822756, "sim_physics": 0.11527362040110996, "survival_time": 1.4000000000000006, "driven_lanedir": 0.0854888207315696, "sim_render-ego": 0.06577726772853307, "in-drivable-lane": 0.15000000000000013, "agent_compute-ego": 0.17255860567092896, "deviation-heading": 0.9891748265490204, "set_robot_commands": 0.09510843242917742, "deviation-center-line": 0.0719992251059456, "driven_lanedir_consec": 0.0854888207315696, "sim_compute_sim_state": 0.036898016929626465, "sim_compute_performance-ego": 0.06799164840153285, "sim_compute_robot_state-ego": 0.07052432639258248}, "ETHZ_autolab_technical_track-6-0": {"driven_any": 0.1903027947264288, "sim_physics": 0.12179765208014126, "survival_time": 1.4500000000000006, "driven_lanedir": 0.1590714389295238, "sim_render-ego": 0.061065673828125, "in-drivable-lane": 0, "agent_compute-ego": 0.16517167255796236, "deviation-heading": 0.5864153296285759, "set_robot_commands": 0.09872695495342386, "deviation-center-line": 0.10448472358234331, "driven_lanedir_consec": 0.1590714389295238, "sim_compute_sim_state": 0.037836313247680664, "sim_compute_performance-ego": 0.06850594487683527, "sim_compute_robot_state-ego": 0.07697728584552634}, "ETHZ_autolab_technical_track-7-0": {"driven_any": 0.10880362219541367, "sim_physics": 0.1090756030309768, "survival_time": 1.0500000000000005, "driven_lanedir": 0.07501591491870618, "sim_render-ego": 0.06346067928132557, "in-drivable-lane": 0, "agent_compute-ego": 0.16571816943940662, "deviation-heading": 0.6089535819541299, "set_robot_commands": 0.09861761047726586, "deviation-center-line": 0.08971452553121945, "driven_lanedir_consec": 0.07501591491870618, "sim_compute_sim_state": 0.03953908738635835, "sim_compute_performance-ego": 0.07087024052937825, "sim_compute_robot_state-ego": 0.07706818126496814}, "ETHZ_autolab_technical_track-8-0": {"driven_any": 0.17537372134431994, "sim_physics": 0.12021333199960214, "survival_time": 1.3500000000000003, "driven_lanedir": 0.1266638945995262, "sim_render-ego": 0.06849990067658601, "in-drivable-lane": 0, "agent_compute-ego": 0.20329191066600655, "deviation-heading": 0.7519237831167496, "set_robot_commands": 0.103369050555759, "deviation-center-line": 0.06381227681626964, "driven_lanedir_consec": 0.1266638945995262, "sim_compute_sim_state": 0.04268503189086914, "sim_compute_performance-ego": 0.07657210915176957, "sim_compute_robot_state-ego": 0.090584189803512}, "ETHZ_autolab_technical_track-9-0": {"driven_any": 0.1417280565582053, "sim_physics": 0.11172369122505188, "survival_time": 1.2000000000000004, "driven_lanedir": 0.10461342097519966, "sim_render-ego": 0.0673153003056844, "in-drivable-lane": 0, "agent_compute-ego": 0.17114191253980002, "deviation-heading": 0.5905018267554549, "set_robot_commands": 0.09780444701512654, "deviation-center-line": 0.08503964153926305, "driven_lanedir_consec": 0.10461342097519966, "sim_compute_sim_state": 0.03775385022163391, "sim_compute_performance-ego": 0.07088841001192729, "sim_compute_robot_state-ego": 0.08099484443664551}, "ETHZ_autolab_technical_track-10-0": {"driven_any": 0.15412268110979, "sim_physics": 0.11664840910169812, "survival_time": 1.3500000000000003, "driven_lanedir": 0.12303777990245868, "sim_render-ego": 0.062442020133689595, "in-drivable-lane": 0, "agent_compute-ego": 0.17171478271484375, "deviation-heading": 0.5898288245736495, "set_robot_commands": 0.0974124272664388, "deviation-center-line": 0.1169722726476068, "driven_lanedir_consec": 0.12303777990245868, "sim_compute_sim_state": 0.040288545467235426, "sim_compute_performance-ego": 0.07141696082221137, "sim_compute_robot_state-ego": 0.07562867800394694}, "ETHZ_autolab_technical_track-11-0": {"driven_any": 0.14877952066571376, "sim_physics": 0.1243896484375, "survival_time": 1.2500000000000004, "driven_lanedir": 0.10287228352430622, "sim_render-ego": 0.06711110115051269, "in-drivable-lane": 0, "agent_compute-ego": 0.19730897903442385, "deviation-heading": 0.7592158790972738, "set_robot_commands": 0.10833165168762209, "deviation-center-line": 0.08581799717637291, "driven_lanedir_consec": 0.10287228352430622, "sim_compute_sim_state": 0.04067755699157715, "sim_compute_performance-ego": 0.07395674705505371, "sim_compute_robot_state-ego": 0.08297057151794433}, "ETHZ_autolab_technical_track-12-0": {"driven_any": 0.18471897984863292, "sim_physics": 0.11839791933695476, "survival_time": 1.5000000000000009, "driven_lanedir": 0.10235357005741286, "sim_render-ego": 0.06591118971506754, "in-drivable-lane": 0.05000000000000005, "agent_compute-ego": 0.1936617771784465, "deviation-heading": 0.9287432649925178, "set_robot_commands": 0.10281867980957032, "deviation-center-line": 0.07319114937288172, "driven_lanedir_consec": 0.10235357005741286, "sim_compute_sim_state": 0.042366464932759605, "sim_compute_performance-ego": 0.07478609879811605, "sim_compute_robot_state-ego": 0.09409173329671223}, "ETHZ_autolab_technical_track-13-0": {"driven_any": 0.143293969658817, "sim_physics": 0.10860212032611552, "survival_time": 1.3000000000000005, "driven_lanedir": 0.08205678304190922, "sim_render-ego": 0.057788803027226374, "in-drivable-lane": 0, "agent_compute-ego": 0.16260437781994158, "deviation-heading": 0.9226205572530052, "set_robot_commands": 0.08592203030219445, "deviation-center-line": 0.06221135828939317, "driven_lanedir_consec": 0.08205678304190922, "sim_compute_sim_state": 0.03571997239039494, "sim_compute_performance-ego": 0.06425319268153264, "sim_compute_robot_state-ego": 0.06730236456944393}, "ETHZ_autolab_technical_track-14-0": {"driven_any": 0.14543150949353348, "sim_physics": 0.1129281719525655, "survival_time": 1.2000000000000004, "driven_lanedir": 0.11986696304649502, "sim_render-ego": 0.06387301286061604, "in-drivable-lane": 0, "agent_compute-ego": 0.17452233036359152, "deviation-heading": 0.4558983017349816, "set_robot_commands": 0.10104320446650188, "deviation-center-line": 0.1212710617322007, "driven_lanedir_consec": 0.11986696304649502, "sim_compute_sim_state": 0.03884513179461161, "sim_compute_performance-ego": 0.0723322331905365, "sim_compute_robot_state-ego": 0.07579616705576579}}
set_robot_commands_max0.10833165168762209
set_robot_commands_mean0.09576360769755345
set_robot_commands_median0.09861761047726586
set_robot_commands_min0.07187053892347547
sim_compute_performance-ego_max0.07743815219763553
sim_compute_performance-ego_mean0.06919961665340603
sim_compute_performance-ego_median0.07088841001192729
sim_compute_performance-ego_min0.0529853414606165
sim_compute_robot_state-ego_max0.09409173329671223
sim_compute_robot_state-ego_mean0.07664214855930979
sim_compute_robot_state-ego_median0.07697728584552634
sim_compute_robot_state-ego_min0.05471231319286205
sim_compute_sim_state_max0.04284101544004498
sim_compute_sim_state_mean0.03863035886966657
sim_compute_sim_state_median0.03905265471514534
sim_compute_sim_state_min0.03091626614332199
sim_physics_max0.14239862470915823
sim_physics_mean0.1133283083165446
sim_physics_median0.11527362040110996
sim_physics_min0.08490536831043384
sim_render-ego_max0.06849990067658601
sim_render-ego_mean0.06296155944404297
sim_render-ego_median0.06387301286061604
sim_render-ego_min0.05043504856250904
simulation-passed1
survival_time_max1.7000000000000008
survival_time_mean1.3600000000000003
survival_time_min1.0500000000000005
No reset possible