Duckietown Challenges Home Challenges Submissions

Evaluator 1592

ID1592
evaluatoridsc-rudolf-8778
ownerAndrea Censi 🇨🇭
machineidsc-rudolf
processidsc-rudolf-8778
versiond-c:5.0.7;d-c-r:5.0.10;d-s:5.0.3
first heard
last heard
statusinactive
# evaluating
# success5 24496
# timeout1 24569
# failed
# error6 24362
# aborted
# host-error
arm
x86_64
Mac
gpu available
Number of processors
Processor frequency (MHz)
Free % of processors
RAM total (MB)
RAM free (MB)
Disk (MB)
Disk available (MB)
Docker Hub
P1
P2
Cloud simulations
PI Camera
# Duckiebots
Map 3x3 avaiable
Number of duckies
gpu cores
AIDO 2 Map LF public
AIDO 2 Map LF private
AIDO 2 Map LFV public
AIDO 2 Map LFV private
AIDO 2 Map LFVI public
AIDO 2 Map LFVI private
AIDO 3 Map LF public
AIDO 3 Map LF private
AIDO 3 Map LFV public
AIDO 3 Map LFV private
AIDO 3 Map LFVI public
AIDO 3 Map LFVI private
AIDO 5 Map large loop
ETU track
for 2021, map is ETH_small_inter
IPFS mountpoint /ipfs available
IPNS mountpoint /ipns available

Evaluator jobs

Job IDsubmissionuseruser labelchallengestepstatusup to dateevaluatordate starteddate completeddurationmessage
245694293Liam Paull 🇨🇦challenge-aido_LF-template-randomaido3-LF-sim-testingstep1-simulationtimeoutnoidsc-rudolf-87781:06:00
I can see how the jo [...]
I can see how the job 24569 is timeout because passed 3960 seconds and the timeout is 3600.0.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
245564101Harleen Hanspal 🇨🇭PredictorLastaido2-PREDstep1-simulationsuccessyesidsc-rudolf-87780:00:26
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
error_L10.10912764819785031
error_L20.019064588588770033


No reset possible
245354121Tanli Chou 🇹🇼PredictorLastaido2-PREDstep1-simulationsuccessyesidsc-rudolf-87780:01:15
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
error_L10.11959943590378574
error_L20.021301753874458644


No reset possible
245204285Liam Paull 🇨🇦challenge-aido_LF-template-randomaido3-LFV-sim-validationstep1-simulationsuccessnoidsc-rudolf-87780:04:49
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.5723310224856362
survival_time_median2.6999999999999984
deviation-center-line_median0.11519544839797546
in-drivable-lane_median0.5999999999999979


other stats
agent_compute-ego_max0.026326166956048263
agent_compute-ego_mean0.025183032963818647
agent_compute-ego_median0.02506486007145473
agent_compute-ego_min0.024336501404091163
deviation-center-line_max0.17439134565029044
deviation-center-line_mean0.1265175655253199
deviation-center-line_min0.09047885846140293
deviation-heading_max0.5020407942599271
deviation-heading_mean0.3641979127291371
deviation-heading_median0.34764983431811225
deviation-heading_min0.19401296908406307
driven_any_max1.6169932854589055
driven_any_mean1.0272530755098268
driven_any_median1.0243289631429704
driven_any_min0.4119037580118985
driven_lanedir_consec_max1.2433038249708372
driven_lanedir_consec_mean0.7800316850006626
driven_lanedir_consec_min0.3792793194470208
driven_lanedir_max1.2433038249708372
driven_lanedir_mean0.7800316850006626
driven_lanedir_median0.5723310224856362
driven_lanedir_min0.3792793194470208
in-drivable-lane_max0.9999999999999976
in-drivable-lane_mean0.4899999999999984
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0243289631429704, "sim_physics": 0.098156765655235, "survival_time": 2.6999999999999984, "driven_lanedir": 0.5723310224856362, "sim_render-ego": 0.011869668960571287, "in-drivable-lane": 0.9999999999999976, "agent_compute-ego": 0.024336501404091163, "deviation-heading": 0.19401296908406307, "set_robot_commands": 0.007931316340411151, "deviation-center-line": 0.15907928712407876, "driven_lanedir_consec": 0.5723310224856362, "sim_compute_sim_state": 0.0046111566049081305, "sim_compute_performance-ego": 0.006876252315662525, "sim_compute_robot_state-ego": 0.008441938294304742, "sim_compute_robot_state-npc0": 0.00790440594708478, "sim_compute_robot_state-npc1": 0.007532137411612051, "sim_compute_robot_state-npc2": 0.0074497196409437395, "sim_compute_robot_state-npc3": 0.007354895273844401}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.4119037580118985, "sim_physics": 0.1187501049041748, "survival_time": 1.2500000000000004, "driven_lanedir": 0.3792793194470208, "sim_render-ego": 0.012234439849853515, "in-drivable-lane": 0, "agent_compute-ego": 0.024790592193603515, "deviation-heading": 0.47860435001913376, "set_robot_commands": 0.008116836547851563, "deviation-center-line": 0.09344288799285194, "driven_lanedir_consec": 0.3792793194470208, "sim_compute_sim_state": 0.00495035171508789, "sim_compute_performance-ego": 0.007058429718017578, "sim_compute_robot_state-ego": 0.008411865234375, "sim_compute_robot_state-npc0": 0.00831329345703125, "sim_compute_robot_state-npc1": 0.008165197372436523, "sim_compute_robot_state-npc2": 0.00813532829284668, "sim_compute_robot_state-npc3": 0.007908868789672851}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.579862082650716, "sim_physics": 0.11481585314399316, "survival_time": 3.7999999999999945, "driven_lanedir": 1.2433038249708372, "sim_render-ego": 0.0124277158787376, "in-drivable-lane": 0.5999999999999979, "agent_compute-ego": 0.026326166956048263, "deviation-heading": 0.5020407942599271, "set_robot_commands": 0.008403947478846499, "deviation-center-line": 0.17439134565029044, "driven_lanedir_consec": 1.2433038249708372, "sim_compute_sim_state": 0.005015674390290913, "sim_compute_performance-ego": 0.007314951796280711, "sim_compute_robot_state-ego": 0.00901947209709569, "sim_compute_robot_state-npc0": 0.008615308686306602, "sim_compute_robot_state-npc1": 0.008517588439740632, "sim_compute_robot_state-npc2": 0.008341309271360698, "sim_compute_robot_state-npc3": 0.008051122489728425}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.6169932854589055, "sim_physics": 0.10893003246452236, "survival_time": 3.949999999999994, "driven_lanedir": 1.2126117310470583, "sim_render-ego": 0.011939323401149317, "in-drivable-lane": 0.849999999999997, "agent_compute-ego": 0.025397044193895556, "deviation-heading": 0.34764983431811225, "set_robot_commands": 0.008107094825068606, "deviation-center-line": 0.11519544839797546, "driven_lanedir_consec": 1.2126117310470583, "sim_compute_sim_state": 0.004892131950281844, "sim_compute_performance-ego": 0.006935463675969764, "sim_compute_robot_state-ego": 0.008550453789626496, "sim_compute_robot_state-npc0": 0.008083651337442519, "sim_compute_robot_state-npc1": 0.00802466839174681, "sim_compute_robot_state-npc2": 0.007985881612270693, "sim_compute_robot_state-npc3": 0.007843331445621538}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.5031772882846434, "sim_physics": 0.10576155355998448, "survival_time": 1.4000000000000006, "driven_lanedir": 0.4926325270527603, "sim_render-ego": 0.012372306415012904, "in-drivable-lane": 0, "agent_compute-ego": 0.02506486007145473, "deviation-heading": 0.29868161596444953, "set_robot_commands": 0.008312063557761056, "deviation-center-line": 0.09047885846140293, "driven_lanedir_consec": 0.4926325270527603, "sim_compute_sim_state": 0.004841608660561698, "sim_compute_performance-ego": 0.007210944380078997, "sim_compute_robot_state-ego": 0.008943378925323486, "sim_compute_robot_state-npc0": 0.007788947650364467, "sim_compute_robot_state-npc1": 0.007959740502493722, "sim_compute_robot_state-npc2": 0.007895784718649728, "sim_compute_robot_state-npc3": 0.0078534654208592}}
set_robot_commands_max0.008403947478846499
set_robot_commands_mean0.008174251749987775
set_robot_commands_median0.008116836547851563
set_robot_commands_min0.007931316340411151
sim_compute_performance-ego_max0.007314951796280711
sim_compute_performance-ego_mean0.007079208377201916
sim_compute_performance-ego_median0.007058429718017578
sim_compute_performance-ego_min0.006876252315662525
sim_compute_robot_state-ego_max0.00901947209709569
sim_compute_robot_state-ego_mean0.008673421668145082
sim_compute_robot_state-ego_median0.008550453789626496
sim_compute_robot_state-ego_min0.008411865234375
sim_compute_robot_state-npc0_max0.008615308686306602
sim_compute_robot_state-npc0_mean0.008141121415645923
sim_compute_robot_state-npc0_median0.008083651337442519
sim_compute_robot_state-npc0_min0.007788947650364467
sim_compute_robot_state-npc1_max0.008517588439740632
sim_compute_robot_state-npc1_mean0.008039866423605949
sim_compute_robot_state-npc1_median0.00802466839174681
sim_compute_robot_state-npc1_min0.007532137411612051
sim_compute_robot_state-npc2_max0.008341309271360698
sim_compute_robot_state-npc2_mean0.007961604707214307
sim_compute_robot_state-npc2_median0.007985881612270693
sim_compute_robot_state-npc2_min0.0074497196409437395
sim_compute_robot_state-npc3_max0.008051122489728425
sim_compute_robot_state-npc3_mean0.007802336683945284
sim_compute_robot_state-npc3_median0.0078534654208592
sim_compute_robot_state-npc3_min0.007354895273844401
sim_compute_sim_state_max0.005015674390290913
sim_compute_sim_state_mean0.0048621846642260946
sim_compute_sim_state_median0.004892131950281844
sim_compute_sim_state_min0.0046111566049081305
sim_physics_max0.1187501049041748
sim_physics_mean0.10928286194558195
sim_physics_median0.10893003246452236
sim_physics_min0.098156765655235
sim_render-ego_max0.0124277158787376
sim_render-ego_mean0.012168690901064923
sim_render-ego_median0.012234439849853515
sim_render-ego_min0.011869668960571287
simulation-passed1
survival_time_max3.949999999999994
survival_time_mean2.6199999999999974
survival_time_min1.2500000000000004
No reset possible
245094278Gianmarco BernasconiBaseline-IL-logs-tensorflowaido3-LF-sim-validationstep1-simulationsuccessnoidsc-rudolf-87780:11:22
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.07366924946130649
survival_time_median14.950000000000076
deviation-center-line_median0.4003855377220901
in-drivable-lane_median0


other stats
agent_compute-ego_max0.10067662795384726
agent_compute-ego_mean0.09925991948445638
agent_compute-ego_median0.09905867020289104
agent_compute-ego_min0.09822026491165162
deviation-center-line_max1.240504923385635
deviation-center-line_mean0.5940244372761347
deviation-center-line_min0.37546107917489585
deviation-heading_max12.593056185859286
deviation-heading_mean6.740534651739471
deviation-heading_median4.166961046131749
deviation-heading_min2.48020466142352
driven_any_max0.22468034151548505
driven_any_mean0.1194806387858994
driven_any_median0.09100702451803852
driven_any_min0.045873761050629465
driven_lanedir_consec_max0.21763456961662783
driven_lanedir_consec_mean0.10275142012079984
driven_lanedir_consec_min0.017307472134365565
driven_lanedir_max0.21763456961662783
driven_lanedir_mean0.10275142012079984
driven_lanedir_median0.07366924946130649
driven_lanedir_min0.017307472134365565
in-drivable-lane_max0
in-drivable-lane_mean0
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.09100702451803852, "sim_physics": 0.06754703839619955, "survival_time": 14.950000000000076, "driven_lanedir": 0.07366924946130649, "sim_render-ego": 0.013374795913696289, "in-drivable-lane": 0, "agent_compute-ego": 0.10067662795384726, "deviation-heading": 11.339398299292323, "set_robot_commands": 0.009662901560465497, "deviation-center-line": 0.4003855377220901, "driven_lanedir_consec": 0.07366924946130649, "sim_compute_sim_state": 0.0057343037923177085, "sim_compute_performance-ego": 0.007967638174692789, "sim_compute_robot_state-ego": 0.009672886530558268}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.22468034151548505, "sim_physics": 0.06616878747940064, "survival_time": 14.950000000000076, "driven_lanedir": 0.21763456961662783, "sim_render-ego": 0.01360222339630127, "in-drivable-lane": 0, "agent_compute-ego": 0.09957505623499552, "deviation-heading": 3.123053065990475, "set_robot_commands": 0.00985452651977539, "deviation-center-line": 0.3901475948348758, "driven_lanedir_consec": 0.21763456961662783, "sim_compute_sim_state": 0.0058135588963826495, "sim_compute_performance-ego": 0.007825826009114583, "sim_compute_robot_state-ego": 0.009573318958282472}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.045873761050629465, "sim_physics": 0.06240641196568807, "survival_time": 14.950000000000076, "driven_lanedir": 0.03611457270420049, "sim_render-ego": 0.013287754853566487, "in-drivable-lane": 0, "agent_compute-ego": 0.09822026491165162, "deviation-heading": 12.593056185859286, "set_robot_commands": 0.00978104829788208, "deviation-center-line": 1.240504923385635, "driven_lanedir_consec": 0.03611457270420049, "sim_compute_sim_state": 0.005781356493631999, "sim_compute_performance-ego": 0.007692492008209229, "sim_compute_robot_state-ego": 0.009304668108622231}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.17580717030883516, "sim_physics": 0.0662078619003296, "survival_time": 14.950000000000076, "driven_lanedir": 0.16903123668749886, "sim_render-ego": 0.013475972016652423, "in-drivable-lane": 0, "agent_compute-ego": 0.09905867020289104, "deviation-heading": 4.166961046131749, "set_robot_commands": 0.009776372114817302, "deviation-center-line": 0.37546107917489585, "driven_lanedir_consec": 0.16903123668749886, "sim_compute_sim_state": 0.00579203208287557, "sim_compute_performance-ego": 0.007705333232879638, "sim_compute_robot_state-ego": 0.0094668443997701}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.0600348965365089, "sim_physics": 0.06528230349222819, "survival_time": 14.950000000000076, "driven_lanedir": 0.017307472134365565, "sim_render-ego": 0.013409272829691569, "in-drivable-lane": 0, "agent_compute-ego": 0.09876897811889648, "deviation-heading": 2.48020466142352, "set_robot_commands": 0.009884385267893474, "deviation-center-line": 0.5636230512631765, "driven_lanedir_consec": 0.017307472134365565, "sim_compute_sim_state": 0.005777871608734131, "sim_compute_performance-ego": 0.007672590414683024, "sim_compute_robot_state-ego": 0.009416050910949708}}
set_robot_commands_max0.009884385267893474
set_robot_commands_mean0.009791846752166747
set_robot_commands_median0.00978104829788208
set_robot_commands_min0.009662901560465497
sim_compute_performance-ego_max0.007967638174692789
sim_compute_performance-ego_mean0.007772775967915852
sim_compute_performance-ego_median0.007705333232879638
sim_compute_performance-ego_min0.007672590414683024
sim_compute_robot_state-ego_max0.009672886530558268
sim_compute_robot_state-ego_mean0.009486753781636556
sim_compute_robot_state-ego_median0.0094668443997701
sim_compute_robot_state-ego_min0.009304668108622231
sim_compute_sim_state_max0.0058135588963826495
sim_compute_sim_state_mean0.0057798245747884116
sim_compute_sim_state_median0.005781356493631999
sim_compute_sim_state_min0.0057343037923177085
sim_physics_max0.06754703839619955
sim_physics_mean0.06552248064676922
sim_physics_median0.06616878747940064
sim_physics_min0.06240641196568807
sim_render-ego_max0.01360222339630127
sim_render-ego_mean0.013430003801981607
sim_render-ego_median0.013409272829691569
sim_render-ego_min0.013287754853566487
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean14.950000000000076
survival_time_min14.950000000000076
No reset possible
244964266Gianmarco Bernasconichallenge-aido_LF-baseline-duckietownaido3-LFVI-sim-testingstep1-simulationsuccessnoidsc-rudolf-87780:25:01
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.4397650957019148
survival_time_median7.099999999999983
deviation-center-line_median0.26315364514422895
in-drivable-lane_median2.3500000000000334


other stats
agent_compute-ego_max0.033743051382211536
agent_compute-ego_mean0.029700163170903866
agent_compute-ego_median0.031105067693825924
agent_compute-ego_min0.0252266946960898
deviation-center-line_max0.8318084663936395
deviation-center-line_mean0.33854701679290167
deviation-center-line_min0.07071866768395428
deviation-heading_max5.263540545009478
deviation-heading_mean2.2521940579155784
deviation-heading_median1.7032325681216511
deviation-heading_min0.458040948562512
driven_any_max2.0677177611328563
driven_any_mean1.0851870767012346
driven_any_median1.0872639722921038
driven_any_min0.15533262902817865
driven_lanedir_consec_max1.3352926462891797
driven_lanedir_consec_mean0.5196646317975869
driven_lanedir_consec_min0.0862347351611743
driven_lanedir_max1.4867677415986016
driven_lanedir_mean0.6163229204507289
driven_lanedir_median0.4685354536072453
driven_lanedir_min0.0862347351611743
in-drivable-lane_max4.750000000000035
in-drivable-lane_mean2.0800000000000045
in-drivable-lane_min0
per-episodes
details{"udem1-0-0": {"driven_any": 1.0956376889327206, "sim_physics": 0.12169749869240656, "survival_time": 7.199999999999982, "driven_lanedir": 0.5640100522189546, "sim_render-ego": 0.011860463354322646, "in-drivable-lane": 2.199999999999992, "agent_compute-ego": 0.02683420479297638, "deviation-heading": 2.6918402849226397, "set_robot_commands": 0.007881646354993185, "deviation-center-line": 0.3080259834598338, "driven_lanedir_consec": 0.3544193459971956, "sim_compute_sim_state": 0.0047755324178271824, "sim_compute_performance-ego": 0.006799490915404426, "sim_compute_robot_state-ego": 0.00843083361784617, "sim_compute_robot_state-npc0": 0.008180396424399482, "sim_compute_robot_state-npc1": 0.007863698734177483, "sim_compute_robot_state-npc2": 0.007818894253836738, "sim_compute_robot_state-npc3": 0.007638499140739441}, "udem1-1-0": {"driven_any": 0.4927682544515245, "sim_physics": 0.11326940971262314, "survival_time": 3.399999999999996, "driven_lanedir": 0.41444217608799416, "sim_render-ego": 0.011455045026891372, "in-drivable-lane": 0, "agent_compute-ego": 0.0252266946960898, "deviation-heading": 1.3635044948986894, "set_robot_commands": 0.007110781529370476, "deviation-center-line": 0.23610666281129705, "driven_lanedir_consec": 0.41444217608799416, "sim_compute_sim_state": 0.0042082772535436295, "sim_compute_performance-ego": 0.006315560901866239, "sim_compute_robot_state-ego": 0.007961497587316176, "sim_compute_robot_state-npc0": 0.007466575678657083, "sim_compute_robot_state-npc1": 0.007152473225313074, "sim_compute_robot_state-npc2": 0.00692984987707699, "sim_compute_robot_state-npc3": 0.006876223227557014}, "udem1-2-0": {"driven_any": 0.5811014575728148, "sim_physics": 0.1393247465544109, "survival_time": 3.949999999999994, "driven_lanedir": 0.4397650957019148, "sim_render-ego": 0.012510580352590056, "in-drivable-lane": 0.4499999999999984, "agent_compute-ego": 0.028840967371493956, "deviation-heading": 1.2816947758315709, "set_robot_commands": 0.008728600755522523, "deviation-center-line": 0.2044347204601788, "driven_lanedir_consec": 0.4397650957019148, "sim_compute_sim_state": 0.004971766773658463, "sim_compute_performance-ego": 0.007037672815443595, "sim_compute_robot_state-ego": 0.00869108151785935, "sim_compute_robot_state-npc0": 0.008485522451280038, "sim_compute_robot_state-npc1": 0.008223089990736563, "sim_compute_robot_state-npc2": 0.008256163778184335, "sim_compute_robot_state-npc3": 0.008051651942579053}, "udem1-3-0": {"driven_any": 1.0872639722921038, "sim_physics": 0.11656821949381224, "survival_time": 7.099999999999983, "driven_lanedir": 0.4685354536072453, "sim_render-ego": 0.011373995055615062, "in-drivable-lane": 3.399999999999988, "agent_compute-ego": 0.02579454636909592, "deviation-heading": 1.3934898588597016, "set_robot_commands": 0.007573722114025707, "deviation-center-line": 0.16596034208291424, "driven_lanedir_consec": 0.4685354536072453, "sim_compute_sim_state": 0.004463613872796717, "sim_compute_performance-ego": 0.0064770369462563955, "sim_compute_robot_state-ego": 0.008136787884671924, "sim_compute_robot_state-npc0": 0.007643516634551572, "sim_compute_robot_state-npc1": 0.007414770797944404, "sim_compute_robot_state-npc2": 0.007370680150851397, "sim_compute_robot_state-npc3": 0.007186968561629175}, "udem1-4-0": {"driven_any": 1.8025323158558677, "sim_physics": 0.11727171749263617, "survival_time": 11.55000000000003, "driven_lanedir": 0.9087936398165222, "sim_render-ego": 0.012882510304967046, "in-drivable-lane": 4.750000000000035, "agent_compute-ego": 0.026767616148118848, "deviation-heading": 2.5190367919599677, "set_robot_commands": 0.007733631959725252, "deviation-center-line": 0.40510348666732054, "driven_lanedir_consec": 0.8656112862274754, "sim_compute_sim_state": 0.004597917779699549, "sim_compute_performance-ego": 0.006597410548817028, "sim_compute_robot_state-ego": 0.008213626357900116, "sim_compute_robot_state-npc0": 0.007866224685272613, "sim_compute_robot_state-npc1": 0.007703325965187766, "sim_compute_robot_state-npc2": 0.007518401909700204, "sim_compute_robot_state-npc3": 0.007427516953769701}, "udem1-5-0": {"driven_any": 1.2959144281679733, "sim_physics": 0.1231628159681956, "survival_time": 8.399999999999984, "driven_lanedir": 0.4831124862252154, "sim_render-ego": 0.012306190672374907, "in-drivable-lane": 3.599999999999998, "agent_compute-ego": 0.02812047799428304, "deviation-heading": 3.511539887850032, "set_robot_commands": 0.008358035768781389, "deviation-center-line": 0.4757185638861089, "driven_lanedir_consec": 0.3477763719136733, "sim_compute_sim_state": 0.004909945385796683, "sim_compute_performance-ego": 0.0070541174638838995, "sim_compute_robot_state-ego": 0.0086960650625683, "sim_compute_robot_state-npc0": 0.008356409413473946, "sim_compute_robot_state-npc1": 0.008200425477254959, "sim_compute_robot_state-npc2": 0.008012087572188605, "sim_compute_robot_state-npc3": 0.007907430330912272}, "udem1-6-0": {"driven_any": 2.0677177611328563, "sim_physics": 0.13154978463144013, "survival_time": 13.200000000000053, "driven_lanedir": 1.4867677415986016, "sim_render-ego": 0.012854242866689508, "in-drivable-lane": 2.3500000000000334, "agent_compute-ego": 0.031105067693825924, "deviation-heading": 3.522888932654731, "set_robot_commands": 0.009111509178624008, "deviation-center-line": 0.8318084663936395, "driven_lanedir_consec": 1.3352926462891797, "sim_compute_sim_state": 0.00531295303142432, "sim_compute_performance-ego": 0.00735003568909385, "sim_compute_robot_state-ego": 0.009007941592823376, "sim_compute_robot_state-npc0": 0.00884358539725795, "sim_compute_robot_state-npc1": 0.008818595698385528, "sim_compute_robot_state-npc2": 0.00870983438058333, "sim_compute_robot_state-npc3": 0.008618550770210497}, "udem1-7-0": {"driven_any": 1.906880595626944, "sim_physics": 0.13208132884541496, "survival_time": 12.200000000000038, "driven_lanedir": 1.1738478116076407, "sim_render-ego": 0.0128816620248263, "in-drivable-lane": 2.950000000000027, "agent_compute-ego": 0.03196050593110382, "deviation-heading": 4.52056321536142, "set_robot_commands": 0.009374809069711654, "deviation-center-line": 0.7059816791826158, "driven_lanedir_consec": 0.8074238689558373, "sim_compute_sim_state": 0.005340833155835261, "sim_compute_performance-ego": 0.007478866420808385, "sim_compute_robot_state-ego": 0.009025647014868065, "sim_compute_robot_state-npc0": 0.009046639575332893, "sim_compute_robot_state-npc1": 0.008907343520492803, "sim_compute_robot_state-npc2": 0.008857387011168434, "sim_compute_robot_state-npc3": 0.008679940075170799}, "udem1-8-0": {"driven_any": 1.4489589767041795, "sim_physics": 0.12319221216089583, "survival_time": 9.349999999999998, "driven_lanedir": 0.7957456854745655, "sim_render-ego": 0.012332617917800333, "in-drivable-lane": 3.2500000000000036, "agent_compute-ego": 0.02823322979524174, "deviation-heading": 2.5167056736583806, "set_robot_commands": 0.008298018399406882, "deviation-center-line": 0.4533701206257117, "driven_lanedir_consec": 0.7957456854745655, "sim_compute_sim_state": 0.004873413453127611, "sim_compute_performance-ego": 0.0068364933850293495, "sim_compute_robot_state-ego": 0.010279439987345812, "sim_compute_robot_state-npc0": 0.008291235582076293, "sim_compute_robot_state-npc1": 0.008128027227473132, "sim_compute_robot_state-npc2": 0.007961733455963951, "sim_compute_robot_state-npc3": 0.0079583088981914}, "udem1-9-0": {"driven_any": 0.5007418731894605, "sim_physics": 0.14206609864165817, "survival_time": 3.4499999999999957, "driven_lanedir": 0.3617197206476177, "sim_render-ego": 0.013212411299995754, "in-drivable-lane": 0.4999999999999982, "agent_compute-ego": 0.03156365518984587, "deviation-heading": 1.035624169830078, "set_robot_commands": 0.008818339610445326, "deviation-center-line": 0.12937309538346117, "driven_lanedir_consec": 0.3617197206476177, "sim_compute_sim_state": 0.005230958910955899, "sim_compute_performance-ego": 0.00750595590342646, "sim_compute_robot_state-ego": 0.00928918175075365, "sim_compute_robot_state-npc0": 0.008594889571701271, "sim_compute_robot_state-npc1": 0.008589893147565317, "sim_compute_robot_state-npc2": 0.00850904851719953, "sim_compute_robot_state-npc3": 0.008425902629244154}, "udem1-10-0": {"driven_any": 0.15533262902817865, "sim_physics": 0.1238646598962637, "survival_time": 1.3000000000000005, "driven_lanedir": 0.0862347351611743, "sim_render-ego": 0.013372045296889084, "in-drivable-lane": 0, "agent_compute-ego": 0.033743051382211536, "deviation-heading": 1.0214556759706228, "set_robot_commands": 0.008728091533367451, "deviation-center-line": 0.07071866768395428, "driven_lanedir_consec": 0.0862347351611743, "sim_compute_sim_state": 0.005048146614661584, "sim_compute_performance-ego": 0.007574209800133338, "sim_compute_robot_state-ego": 0.009065077855036808, "sim_compute_robot_state-npc0": 0.008958147122309757, "sim_compute_robot_state-npc1": 0.008449747012211727, "sim_compute_robot_state-npc2": 0.008414534422067495, "sim_compute_robot_state-npc3": 0.01047357229086069}, "udem1-11-0": {"driven_any": 1.023029195989719, "sim_physics": 0.125321110682701, "survival_time": 6.699999999999984, "driven_lanedir": 0.45976571292344426, "sim_render-ego": 0.013321598963950998, "in-drivable-lane": 3.149999999999989, "agent_compute-ego": 0.03192008253353745, "deviation-heading": 0.9797530452421974, "set_robot_commands": 0.009560727361422864, "deviation-center-line": 0.26315364514422895, "driven_lanedir_consec": 0.45976571292344426, "sim_compute_sim_state": 0.005425896217573935, "sim_compute_performance-ego": 0.007564229751700785, "sim_compute_robot_state-ego": 0.00910650972110122, "sim_compute_robot_state-npc0": 0.009230837893130174, "sim_compute_robot_state-npc1": 0.00907352077427195, "sim_compute_robot_state-npc2": 0.0089738297818312, "sim_compute_robot_state-npc3": 0.008814126697938834}, "udem1-12-0": {"driven_any": 1.6818602135427074, "sim_physics": 0.1325723926226298, "survival_time": 10.800000000000018, "driven_lanedir": 1.0638129364101503, "sim_render-ego": 0.01302034545827795, "in-drivable-lane": 1.7000000000000162, "agent_compute-ego": 0.0314230532557876, "deviation-heading": 5.263540545009478, "set_robot_commands": 0.009216526040324458, "deviation-center-line": 0.5069688416818203, "driven_lanedir_consec": 0.5681665348698839, "sim_compute_sim_state": 0.005368019695635195, "sim_compute_performance-ego": 0.0074569097271672, "sim_compute_robot_state-ego": 0.008991462213021738, "sim_compute_robot_state-npc0": 0.0090858174694909, "sim_compute_robot_state-npc1": 0.008965254933745772, "sim_compute_robot_state-npc2": 0.008789048150733666, "sim_compute_robot_state-npc3": 0.008675895355365894}, "udem1-13-0": {"driven_any": 0.3561798949235581, "sim_physics": 0.12289577839421292, "survival_time": 2.549999999999999, "driven_lanedir": 0.3456783562826482, "sim_render-ego": 0.01321256861967199, "in-drivable-lane": 0, "agent_compute-ego": 0.031471659155452955, "deviation-heading": 0.458040948562512, "set_robot_commands": 0.009345049951590745, "deviation-center-line": 0.2019242186038276, "driven_lanedir_consec": 0.3456783562826482, "sim_compute_sim_state": 0.005329188178567325, "sim_compute_performance-ego": 0.007518927256266276, "sim_compute_robot_state-ego": 0.008804929022695505, "sim_compute_robot_state-npc0": 0.009150542464910767, "sim_compute_robot_state-npc1": 0.008839649312636432, "sim_compute_robot_state-npc2": 0.008681568444943895, "sim_compute_robot_state-npc3": 0.008549746345071232}, "udem1-14-0": {"driven_any": 0.7818868931079096, "sim_physics": 0.13543784159880418, "survival_time": 5.1999999999999895, "driven_lanedir": 0.19261220299724613, "sim_render-ego": 0.013240094368274394, "in-drivable-lane": 2.8999999999999915, "agent_compute-ego": 0.032497635254493125, "deviation-heading": 1.7032325681216511, "set_robot_commands": 0.009210295402086698, "deviation-center-line": 0.11955675782661242, "driven_lanedir_consec": 0.1443924868239559, "sim_compute_sim_state": 0.00543906596990732, "sim_compute_performance-ego": 0.007449991427935087, "sim_compute_robot_state-ego": 0.008990333630488468, "sim_compute_robot_state-npc0": 0.009060075649848351, "sim_compute_robot_state-npc1": 0.008870544341894297, "sim_compute_robot_state-npc2": 0.008840040518687321, "sim_compute_robot_state-npc3": 0.008589061406942515}}
set_robot_commands_max0.009560727361422864
set_robot_commands_mean0.008603319001959908
set_robot_commands_median0.008728600755522523
set_robot_commands_min0.007110781529370476
sim_compute_performance-ego_max0.007574209800133338
sim_compute_performance-ego_mean0.007134460596882154
sim_compute_performance-ego_median0.00735003568909385
sim_compute_performance-ego_min0.006315560901866239
sim_compute_robot_state-ego_max0.010279439987345812
sim_compute_robot_state-ego_mean0.008846027654419778
sim_compute_robot_state-ego_median0.008990333630488468
sim_compute_robot_state-ego_min0.007961497587316176
sim_compute_robot_state-npc0_max0.009230837893130174
sim_compute_robot_state-npc0_mean0.008550694400912875
sim_compute_robot_state-npc0_median0.008594889571701271
sim_compute_robot_state-npc0_min0.007466575678657083
sim_compute_robot_state-npc1_max0.00907352077427195
sim_compute_robot_state-npc1_mean0.00834669067728608
sim_compute_robot_state-npc1_median0.008449747012211727
sim_compute_robot_state-npc1_min0.007152473225313074
sim_compute_robot_state-npc2_max0.0089738297818312
sim_compute_robot_state-npc2_mean0.008242873481667806
sim_compute_robot_state-npc2_median0.008414534422067495
sim_compute_robot_state-npc2_min0.00692984987707699
sim_compute_robot_state-npc3_max0.01047357229086069
sim_compute_robot_state-npc3_mean0.00825822630841218
sim_compute_robot_state-npc3_median0.008425902629244154
sim_compute_robot_state-npc3_min0.006876223227557014
sim_compute_sim_state_max0.00543906596990732
sim_compute_sim_state_mean0.005019701914067378
sim_compute_sim_state_median0.005048146614661584
sim_compute_sim_state_min0.0042082772535436295
sim_physics_max0.14206609864165817
sim_physics_mean0.1266850410258737
sim_physics_median0.1238646598962637
sim_physics_min0.11326940971262314
sim_render-ego_max0.013372045296889084
sim_render-ego_mean0.012655758105542493
sim_render-ego_median0.0128816620248263
sim_render-ego_min0.011373995055615062
simulation-passed1
survival_time_max13.200000000000053
survival_time_mean7.0900000000000025
survival_time_min1.3000000000000005
No reset possible
244354236Andrea Censi 🇨🇭challenge-aido_LF-template-pytorchaido3-LFVI-sim-validationstep1-simulationerrornoidsc-rudolf-87780:01:34
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
244254227Manfred DiazBaseline-IL-logs-tensorflowaido3-LFVI-sim-testingstep1-simulationerrornoidsc-rudolf-87780:00:53
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
244084214Manfred DiazBaseline-IL-logs-tensorflowaido3-LF-sim-testingstep1-simulationerrornoidsc-rudolf-87780:02:34
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
243904195Liam Paull 🇨🇦challenge-aido_LF-baseline-duckietownaido3-LF-sim-testingstep1-simulationerrornoidsc-rudolf-87780:00:49
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
243774186Liam Paull 🇨🇦challenge-aido_LF-template-ros - Template solution using ROSaido3-LF-sim-testingstep1-simulationerrornoidsc-rudolf-87780:07:26
The result file is n [...]
The result file is not found in working dir /tmp/duckietown/DT18/evaluator/executions/aido3-LF-sim-testing/submission4186/step1-simulation-idsc-rudolf-8778-job24377:

File '/tmp/duckietown/DT18/evaluator/executions/aido3-LF-sim-testing/submission4186/step1-simulation-idsc-rudolf-8778-job24377/challenge-results/challenge_results.yaml' does not exist. 

This usually means that the evaluator did not finish and some times that there was an import error.
Check the evaluator log to see what happened.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
243624183Liam Paull 🇨🇦challenge-aido_LF-baseline-duckietownaido3-LFVI-sim-testingstep1-simulationerrornoidsc-rudolf-87780:04:02
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible