Duckietown Challenges Home Challenges Submissions

Submission 4191

Submission4191
Competingyes
Challengeaido3-LFVI-sim-testing
UserLiam Paull 🇨🇦
Date submitted
Last status update
Completecomplete
DetailsEvaluation is complete.
Sisters
Result💚
Jobsstep1-simulation: 27676
Next
User labelchallenge-aido_LF-template-ros - Template solution using ROS
Admin priority50
Blessingn/a
User priority50

The highlights are available only to the owner and the admins.

Evaluation jobs for this submission

Show only up-to-date jobs
Job IDstepstatusup to datedate starteddate completeddurationmessage
27676step1-simulationsuccessyes0:17:51
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.4378933478955715
survival_time_median3.099999999999997
deviation-center-line_median0.13908903563608688
in-drivable-lane_median0.04999999999999982


other stats
agent_compute-ego_max0.0275691491139086
agent_compute-ego_mean0.025046208892549222
agent_compute-ego_median0.025117134225779568
agent_compute-ego_min0.022825743778642403
deviation-center-line_max0.532746324399545
deviation-center-line_mean0.18169206884848385
deviation-center-line_min0.0681161462163248
deviation-heading_max1.1901827219312813
deviation-heading_mean0.6415543546915703
deviation-heading_median0.5031825547422055
deviation-heading_min0.2060429950224342
driven_any_max1.8488671355040076
driven_any_mean0.8309001857913937
driven_any_median0.8893644944837463
driven_any_min0.22794626361561687
driven_lanedir_consec_max1.3664896815564729
driven_lanedir_consec_mean0.5839463445625489
driven_lanedir_consec_min0.1749357963148559
driven_lanedir_max1.807834195793656
driven_lanedir_mean0.6154689923102642
driven_lanedir_median0.4378933478955715
driven_lanedir_min0.1749357963148559
in-drivable-lane_max2.199999999999996
in-drivable-lane_mean0.5766666666666651
in-drivable-lane_min0
per-episodes
details{"udem1-0-0": {"driven_any": 1.2152514395156324, "sim_physics": 0.2031207331295671, "survival_time": 4.3499999999999925, "driven_lanedir": 1.1458081801121476, "sim_render-ego": 0.01343589815600165, "in-drivable-lane": 0.04999999999999982, "agent_compute-ego": 0.026343263428786703, "deviation-heading": 1.1461887665248496, "set_robot_commands": 0.008377582177348521, "deviation-center-line": 0.3196271163955538, "driven_lanedir_consec": 1.1457079084309494, "sim_compute_sim_state": 0.005334862347306876, "sim_compute_performance-ego": 0.007459511702088104, "sim_compute_robot_state-ego": 0.009683080103205538, "sim_compute_robot_state-npc0": 0.009145818907639077, "sim_compute_robot_state-npc1": 0.008413495688602841, "sim_compute_robot_state-npc2": 0.008404583766542632, "sim_compute_robot_state-npc3": 0.008684594055701947}, "udem1-1-0": {"driven_any": 1.181685992599853, "sim_physics": 0.1739485464900373, "survival_time": 4.149999999999993, "driven_lanedir": 0.6522619080269556, "sim_render-ego": 0.013875105294836572, "in-drivable-lane": 1.649999999999994, "agent_compute-ego": 0.022825743778642403, "deviation-heading": 0.36240222968987695, "set_robot_commands": 0.008227221937064665, "deviation-center-line": 0.16820559038086544, "driven_lanedir_consec": 0.6522619080269556, "sim_compute_sim_state": 0.005323389926588679, "sim_compute_performance-ego": 0.007777415126203054, "sim_compute_robot_state-ego": 0.009373078863304782, "sim_compute_robot_state-npc0": 0.009582809655063125, "sim_compute_robot_state-npc1": 0.009214165699051088, "sim_compute_robot_state-npc2": 0.009404102003717996, "sim_compute_robot_state-npc3": 0.009363901184265873}, "udem1-2-0": {"driven_any": 1.0118081524117453, "sim_physics": 0.15411459433065877, "survival_time": 3.699999999999995, "driven_lanedir": 0.9004425545660449, "sim_render-ego": 0.01224861596081708, "in-drivable-lane": 0, "agent_compute-ego": 0.02416434159149995, "deviation-heading": 1.152229849649838, "set_robot_commands": 0.008641288087174698, "deviation-center-line": 0.2913214072499907, "driven_lanedir_consec": 0.8690476242686972, "sim_compute_sim_state": 0.005629065874460581, "sim_compute_performance-ego": 0.007436684660009436, "sim_compute_robot_state-ego": 0.008411558898719581, "sim_compute_robot_state-npc0": 0.00880466602944039, "sim_compute_robot_state-npc1": 0.008528094033937197, "sim_compute_robot_state-npc2": 0.008966191394909008, "sim_compute_robot_state-npc3": 0.008340165421769425}, "udem1-3-0": {"driven_any": 0.22794626361561687, "sim_physics": 0.19968409339586893, "survival_time": 1.2000000000000004, "driven_lanedir": 0.1749357963148559, "sim_render-ego": 0.013925552368164062, "in-drivable-lane": 0.05000000000000005, "agent_compute-ego": 0.025741636753082275, "deviation-heading": 0.6100530204931127, "set_robot_commands": 0.008383959531784058, "deviation-center-line": 0.0681161462163248, "driven_lanedir_consec": 0.1749357963148559, "sim_compute_sim_state": 0.005441427230834961, "sim_compute_performance-ego": 0.007428934176762899, "sim_compute_robot_state-ego": 0.009630362192789711, "sim_compute_robot_state-npc0": 0.008869598309199015, "sim_compute_robot_state-npc1": 0.00855724016825358, "sim_compute_robot_state-npc2": 0.008665382862091064, "sim_compute_robot_state-npc3": 0.007703622182210286}, "udem1-4-0": {"driven_any": 1.8488671355040076, "sim_physics": 0.20035886764526367, "survival_time": 6.149999999999986, "driven_lanedir": 1.807834195793656, "sim_render-ego": 0.013016146372973434, "in-drivable-lane": 0, "agent_compute-ego": 0.026441504315632147, "deviation-heading": 1.1901827219312813, "set_robot_commands": 0.008916412911764005, "deviation-center-line": 0.532746324399545, "driven_lanedir_consec": 1.3664896815564729, "sim_compute_sim_state": 0.005762468508588589, "sim_compute_performance-ego": 0.007451611805737503, "sim_compute_robot_state-ego": 0.00925526774026514, "sim_compute_robot_state-npc0": 0.009021757094840693, "sim_compute_robot_state-npc1": 0.008889605359333317, "sim_compute_robot_state-npc2": 0.009108712033527653, "sim_compute_robot_state-npc3": 0.00860843619680017}, "udem1-5-0": {"driven_any": 0.8893644944837463, "sim_physics": 0.15970337775445753, "survival_time": 3.099999999999997, "driven_lanedir": 0.4378933478955715, "sim_render-ego": 0.013512572934550625, "in-drivable-lane": 1.399999999999996, "agent_compute-ego": 0.023237724458017656, "deviation-heading": 0.413983013659317, "set_robot_commands": 0.009105159390357232, "deviation-center-line": 0.10744428364584496, "driven_lanedir_consec": 0.4378933478955715, "sim_compute_sim_state": 0.005526065826416016, "sim_compute_performance-ego": 0.007791726819930538, "sim_compute_robot_state-ego": 0.009941212592586396, "sim_compute_robot_state-npc0": 0.009531678691987068, "sim_compute_robot_state-npc1": 0.009281858321159115, "sim_compute_robot_state-npc2": 0.009149639837203486, "sim_compute_robot_state-npc3": 0.008827982410307854}, "udem1-6-0": {"driven_any": 0.3217568213058035, "sim_physics": 0.18156851571181729, "survival_time": 1.4500000000000006, "driven_lanedir": 0.31142877744438513, "sim_render-ego": 0.01514665833834944, "in-drivable-lane": 0, "agent_compute-ego": 0.025117134225779568, "deviation-heading": 0.3179105481386682, "set_robot_commands": 0.007921868357165107, "deviation-center-line": 0.12787653843572008, "driven_lanedir_consec": 0.31142877744438513, "sim_compute_sim_state": 0.006379908528821221, "sim_compute_performance-ego": 0.0074337022057895, "sim_compute_robot_state-ego": 0.010127084008578596, "sim_compute_robot_state-npc0": 0.009264600688013536, "sim_compute_robot_state-npc1": 0.008955717086791992, "sim_compute_robot_state-npc2": 0.008590459823608398, "sim_compute_robot_state-npc3": 0.008712456144135574}, "udem1-7-0": {"driven_any": 0.422564670739684, "sim_physics": 0.2466554707951016, "survival_time": 1.800000000000001, "driven_lanedir": 0.41237875627155907, "sim_render-ego": 0.014511307080586752, "in-drivable-lane": 0, "agent_compute-ego": 0.02589945660697089, "deviation-heading": 0.2968053239062273, "set_robot_commands": 0.008697450160980225, "deviation-center-line": 0.13908903563608688, "driven_lanedir_consec": 0.41237875627155907, "sim_compute_sim_state": 0.005279103914896647, "sim_compute_performance-ego": 0.0075049665239122175, "sim_compute_robot_state-ego": 0.009400791592068145, "sim_compute_robot_state-npc0": 0.00957770480049981, "sim_compute_robot_state-npc1": 0.00987472136815389, "sim_compute_robot_state-npc2": 0.009693794780307343, "sim_compute_robot_state-npc3": 0.009548611111111112}, "udem1-8-0": {"driven_any": 1.0869893500063008, "sim_physics": 0.18032205546343769, "survival_time": 4.049999999999994, "driven_lanedir": 0.7141335869056502, "sim_render-ego": 0.013432493916264289, "in-drivable-lane": 1.149999999999996, "agent_compute-ego": 0.023454395341284483, "deviation-heading": 0.878889826365967, "set_robot_commands": 0.008248991436428495, "deviation-center-line": 0.20474526161428125, "driven_lanedir_consec": 0.7141335869056502, "sim_compute_sim_state": 0.00567080945144465, "sim_compute_performance-ego": 0.007877370457590363, "sim_compute_robot_state-ego": 0.00928831394807792, "sim_compute_robot_state-npc0": 0.008902820540063175, "sim_compute_robot_state-npc1": 0.008877568774753146, "sim_compute_robot_state-npc2": 0.008275076195045753, "sim_compute_robot_state-npc3": 0.008974934801643278}, "udem1-9-0": {"driven_any": 1.1424631314529632, "sim_physics": 0.2172694387315195, "survival_time": 3.949999999999994, "driven_lanedir": 0.3199264085960296, "sim_render-ego": 0.013068425504467155, "in-drivable-lane": 2.199999999999996, "agent_compute-ego": 0.0275691491139086, "deviation-heading": 1.1128298423206882, "set_robot_commands": 0.009235771396492102, "deviation-center-line": 0.17094642867950188, "driven_lanedir_consec": 0.3199264085960296, "sim_compute_sim_state": 0.005719866933701913, "sim_compute_performance-ego": 0.007971380330339263, "sim_compute_robot_state-ego": 0.009531253500829768, "sim_compute_robot_state-npc0": 0.00935300090644933, "sim_compute_robot_state-npc1": 0.008882543708704695, "sim_compute_robot_state-npc2": 0.009102905852885186, "sim_compute_robot_state-npc3": 0.008857367913934249}, "udem1-10-0": {"driven_any": 1.0711610669051304, "sim_physics": 0.16766098976135255, "survival_time": 3.7499999999999942, "driven_lanedir": 0.3955395433982156, "sim_render-ego": 0.013152510325113932, "in-drivable-lane": 2.099999999999994, "agent_compute-ego": 0.02371079126993815, "deviation-heading": 0.49052382077367057, "set_robot_commands": 0.008441794713338216, "deviation-center-line": 0.07933265713998794, "driven_lanedir_consec": 0.3955395433982156, "sim_compute_sim_state": 0.005411542256673177, "sim_compute_performance-ego": 0.007565282185872396, "sim_compute_robot_state-ego": 0.00939772923787435, "sim_compute_robot_state-npc0": 0.00928325335184733, "sim_compute_robot_state-npc1": 0.00974232037862142, "sim_compute_robot_state-npc2": 0.008776737848917643, "sim_compute_robot_state-npc3": 0.008700091044108073}, "udem1-11-0": {"driven_any": 0.8244210104658632, "sim_physics": 0.19730839421672208, "survival_time": 3.099999999999997, "driven_lanedir": 0.7829043398589945, "sim_render-ego": 0.013441404988688808, "in-drivable-lane": 0.04999999999999982, "agent_compute-ego": 0.02374854395466466, "deviation-heading": 0.5031825547422055, "set_robot_commands": 0.008669284082228137, "deviation-center-line": 0.13572815870526408, "driven_lanedir_consec": 0.7829043398589945, "sim_compute_sim_state": 0.005799324281754032, "sim_compute_performance-ego": 0.00840353581213182, "sim_compute_robot_state-ego": 0.009904038521551316, "sim_compute_robot_state-npc0": 0.009464467725446148, "sim_compute_robot_state-npc1": 0.0089472686090777, "sim_compute_robot_state-npc2": 0.009206583422999228, "sim_compute_robot_state-npc3": 0.009309034193715742}, "udem1-12-0": {"driven_any": 0.563788053121494, "sim_physics": 0.1961752414703369, "survival_time": 2.000000000000001, "driven_lanedir": 0.5531138948568208, "sim_render-ego": 0.01341167688369751, "in-drivable-lane": 0, "agent_compute-ego": 0.02596161365509033, "deviation-heading": 0.3358737235304561, "set_robot_commands": 0.00909801721572876, "deviation-center-line": 0.14005637483483965, "driven_lanedir_consec": 0.5531138948568208, "sim_compute_sim_state": 0.0053363204002380375, "sim_compute_performance-ego": 0.007636255025863648, "sim_compute_robot_state-ego": 0.008868658542633056, "sim_compute_robot_state-npc0": 0.009092283248901368, "sim_compute_robot_state-npc1": 0.009353953599929807, "sim_compute_robot_state-npc2": 0.009084820747375488, "sim_compute_robot_state-npc3": 0.009058713912963867}, "udem1-13-0": {"driven_any": 0.36238025749644254, "sim_physics": 0.22326147917545203, "survival_time": 1.6500000000000008, "driven_lanedir": 0.33545904027107065, "sim_render-ego": 0.01326320388100364, "in-drivable-lane": 0, "agent_compute-ego": 0.023973161523992367, "deviation-heading": 0.6062170836249625, "set_robot_commands": 0.008365118142330286, "deviation-center-line": 0.10444971478734522, "driven_lanedir_consec": 0.33545904027107065, "sim_compute_sim_state": 0.005052963892618815, "sim_compute_performance-ego": 0.007668675798358339, "sim_compute_robot_state-ego": 0.010330677032470705, "sim_compute_robot_state-npc0": 0.009423364292491566, "sim_compute_robot_state-npc1": 0.008849440198956114, "sim_compute_robot_state-npc2": 0.00912990714564468, "sim_compute_robot_state-npc3": 0.008788556763620087}, "udem1-14-0": {"driven_any": 0.2930549472466218, "sim_physics": 0.2340587285848764, "survival_time": 1.3000000000000005, "driven_lanedir": 0.2879745543420047, "sim_render-ego": 0.012850935642535867, "in-drivable-lane": 0, "agent_compute-ego": 0.027504673370948203, "deviation-heading": 0.2060429950224342, "set_robot_commands": 0.008880367645850549, "deviation-center-line": 0.135695994606106, "driven_lanedir_consec": 0.2879745543420047, "sim_compute_sim_state": 0.005450798914982722, "sim_compute_performance-ego": 0.008511983431302585, "sim_compute_robot_state-ego": 0.009652660443232607, "sim_compute_robot_state-npc0": 0.010113661105816182, "sim_compute_robot_state-npc1": 0.009922009247999923, "sim_compute_robot_state-npc2": 0.010134018384493314, "sim_compute_robot_state-npc3": 0.008152191455547627}}
set_robot_commands_max0.009235771396492102
set_robot_commands_mean0.00861401914573567
set_robot_commands_median0.008641288087174698
set_robot_commands_min0.007921868357165107
sim_compute_performance-ego_max0.008511983431302585
sim_compute_performance-ego_mean0.007727935737459444
sim_compute_performance-ego_median0.007636255025863648
sim_compute_performance-ego_min0.007428934176762899
sim_compute_robot_state-ego_max0.010330677032470705
sim_compute_robot_state-ego_mean0.00951971781454584
sim_compute_robot_state-ego_median0.009531253500829768
sim_compute_robot_state-ego_min0.008411558898719581
sim_compute_robot_state-npc0_max0.010113661105816182
sim_compute_robot_state-npc0_mean0.00929543235651319
sim_compute_robot_state-npc0_median0.00928325335184733
sim_compute_robot_state-npc0_min0.00880466602944039
sim_compute_robot_state-npc1_max0.009922009247999923
sim_compute_robot_state-npc1_mean0.009086000149555056
sim_compute_robot_state-npc1_median0.0089472686090777
sim_compute_robot_state-npc1_min0.008413495688602841
sim_compute_robot_state-npc2_max0.010134018384493314
sim_compute_robot_state-npc2_mean0.009046194406617924
sim_compute_robot_state-npc2_median0.009102905852885186
sim_compute_robot_state-npc2_min0.008275076195045753
sim_compute_robot_state-npc3_max0.009548611111111112
sim_compute_robot_state-npc3_mean0.008775377252789011
sim_compute_robot_state-npc3_median0.008788556763620087
sim_compute_robot_state-npc3_min0.007703622182210286
sim_compute_sim_state_max0.006379908528821221
sim_compute_sim_state_mean0.005541194552621795
sim_compute_sim_state_median0.005450798914982722
sim_compute_sim_state_min0.005052963892618815
sim_physics_max0.2466554707951016
sim_physics_mean0.19568070177709795
sim_physics_median0.19730839421672208
sim_physics_min0.15411459433065877
sim_render-ego_max0.01514665833834944
sim_render-ego_mean0.01348616717653672
sim_render-ego_median0.013432493916264289
sim_render-ego_min0.01224861596081708
simulation-passed1
survival_time_max6.149999999999986
survival_time_mean3.046666666666662
survival_time_min1.2000000000000004
No reset possible
27672step1-simulationsuccessyes0:18:08
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
27671step1-simulationsuccessyes0:18:16
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
25894step1-simulationsuccessno0:12:23
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
25889step1-simulationsuccessno0:13:17
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
24955step1-simulationerrorno0:09:50
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
24382step1-simulationerrorno0:08:58
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
24376step1-simulationerrorno0:09:37
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible