AI Driving Olympics Home Challenges Submissions Jobs

Evaluator 1170

evaluator1170
ownerI don't have one 😀
machineip-172-31-42-167
processip-172-31-42-167-7227
versiond-c:4.0.30;d-c-r:4.0.44;d-s:4.0.22
first heard
last heard
statusinactive
# evaluating
# success26
# timeout
# failed3
# error31
# aborted
# host-error1
arm0
x86_641
Mac0
gpu available1
Number of processors4
Processor frequency (MHz)2.9 GHz
Free % of processors100%
RAM total (MB)60.0 GB
RAM free (MB)57.6 GB
Disk (MB)96.9 GB
Disk available (MB)47.6 GB
Docker Hub
P11
P2
PI Camera0
# Duckiebots0
Map 3x3 avaiable
gpu cores
AIDO 2 Map LF public
AIDO 2 Map LF private
AIDO 2 Map LFV public
AIDO 2 Map LFV private
AIDO 2 Map LFVI public
AIDO 2 Map LFVI private
IPFS mountpoint /ipfs available
IPNS mountpoint /ipns available

Evaluator jobs

Job IDsubmissionuseruser labelchallengestepstatusup to dateevaluatordate starteddate completeddurationmessage
230653550AmaurXRunning the real lane following -- without challenge containeraido2-LF-sim-testingstep1-simulationerroryes11700:07:40
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
(hidden)
230022404vguerraBaseline solution using reinforcement learningaido2-LFV-sim-testingstep1-simulationsuccessyes11700:43:51(hidden)
driven_lanedir_consec_median0.06012441230310195
survival_time_median1.6500000000000008
deviation-center-line_median0.07695572070673869
in-drivable-lane_median0.5500000000000005


other stats
agent_compute-ego_max0.17220924377441407
agent_compute-ego_mean0.15591732591687238
agent_compute-ego_median0.1569546620051066
agent_compute-ego_min0.12864815747296368
deviation-center-line_max0.661406549475925
deviation-center-line_mean0.15051497984053228
deviation-center-line_min0.02780241294906417
deviation-heading_max6.0970954854422645
deviation-heading_mean2.476472329942467
deviation-heading_median0.6439097677899761
deviation-heading_min0.4986756377174347
driven_any_max1.6995671675282338
driven_any_mean0.6476519321163464
driven_any_median0.14314803605730164
driven_any_min0.09895959495462382
driven_lanedir_consec_max0.5717816054931946
driven_lanedir_consec_mean0.21019456307314263
driven_lanedir_consec_min0.03126199365840754
driven_lanedir_max0.5717816054931946
driven_lanedir_mean0.21019456307314263
driven_lanedir_median0.06012441230310195
driven_lanedir_min0.03126199365840754
in-drivable-lane_max7.45000000000004
in-drivable-lane_mean2.850000000000014
in-drivable-lane_min0.2500000000000002
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.6995671675282338, "sim_physics": 0.157306969165802, "survival_time": 14.950000000000076, "driven_lanedir": 0.5305861450747233, "sim_render-ego": 0.057234501043955485, "in-drivable-lane": 7.250000000000041, "agent_compute-ego": 0.1576130755742391, "deviation-heading": 5.8108867746064, "set_robot_commands": 0.0860632840792338, "deviation-center-line": 0.3112082293618781, "driven_lanedir_consec": 0.5305861450747233, "sim_compute_sim_state": 0.03482873757680257, "sim_compute_performance-ego": 0.06162858724594116, "sim_compute_robot_state-ego": 0.06649880727132161, "sim_compute_robot_state-npc0": 0.06290518522262573, "sim_compute_robot_state-npc1": 0.06342979272206624, "sim_compute_robot_state-npc2": 0.06296874443689982, "sim_compute_robot_state-npc3": 0.06156526406606038}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.49843359929386, "sim_physics": 0.15669526815414428, "survival_time": 14.950000000000076, "driven_lanedir": 0.4447841770145087, "sim_render-ego": 0.05771683057149251, "in-drivable-lane": 7.45000000000004, "agent_compute-ego": 0.1612115693092346, "deviation-heading": 5.887846553991392, "set_robot_commands": 0.09067315181096394, "deviation-center-line": 0.661406549475925, "driven_lanedir_consec": 0.4447841770145087, "sim_compute_sim_state": 0.03664316018422445, "sim_compute_performance-ego": 0.06508712927500407, "sim_compute_robot_state-ego": 0.07161466757456461, "sim_compute_robot_state-npc0": 0.06803791761398316, "sim_compute_robot_state-npc1": 0.06555738131205241, "sim_compute_robot_state-npc2": 0.06493489027023315, "sim_compute_robot_state-npc3": 0.0657756241162618}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.1169812369716197, "sim_physics": 0.1739380615098136, "survival_time": 1.4000000000000006, "driven_lanedir": 0.04261239659045657, "sim_render-ego": 0.05727676834378924, "in-drivable-lane": 0.4000000000000003, "agent_compute-ego": 0.14278819731303624, "deviation-heading": 0.5435862078429031, "set_robot_commands": 0.09833520650863647, "deviation-center-line": 0.07836236921321225, "driven_lanedir_consec": 0.04261239659045657, "sim_compute_sim_state": 0.03773929391588483, "sim_compute_performance-ego": 0.06105872562953404, "sim_compute_robot_state-ego": 0.06626198121479579, "sim_compute_robot_state-npc0": 0.06345370837620326, "sim_compute_robot_state-npc1": 0.0607536860874721, "sim_compute_robot_state-npc2": 0.0601136428969247, "sim_compute_robot_state-npc3": 0.06130833285195487}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.10712690030590882, "sim_physics": 0.15860482215881347, "survival_time": 1.2500000000000004, "driven_lanedir": 0.04590199040558929, "sim_render-ego": 0.05826052665710449, "in-drivable-lane": 0.2500000000000002, "agent_compute-ego": 0.17220924377441407, "deviation-heading": 0.5530546834628679, "set_robot_commands": 0.08586774826049805, "deviation-center-line": 0.07695572070673869, "driven_lanedir_consec": 0.04590199040558929, "sim_compute_sim_state": 0.03152559280395508, "sim_compute_performance-ego": 0.059002628326416014, "sim_compute_robot_state-ego": 0.06684134483337402, "sim_compute_robot_state-npc0": 0.06612065315246582, "sim_compute_robot_state-npc1": 0.06238686561584473, "sim_compute_robot_state-npc2": 0.05965214729309082, "sim_compute_robot_state-npc3": 0.05588903427124024}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.14314803605730164, "sim_physics": 0.12175461097999855, "survival_time": 1.3500000000000003, "driven_lanedir": 0.04889196563850473, "sim_render-ego": 0.04742836069177698, "in-drivable-lane": 0.40000000000000024, "agent_compute-ego": 0.12864815747296368, "deviation-heading": 0.6685855127835026, "set_robot_commands": 0.07068991661071777, "deviation-center-line": 0.029021863648060545, "driven_lanedir_consec": 0.04889196563850473, "sim_compute_sim_state": 0.03043363712452076, "sim_compute_performance-ego": 0.05119225713941786, "sim_compute_robot_state-ego": 0.053866739626284, "sim_compute_robot_state-npc0": 0.05411374127423322, "sim_compute_robot_state-npc1": 0.05352738168504503, "sim_compute_robot_state-npc2": 0.05292654920507361, "sim_compute_robot_state-npc3": 0.05205713378058539}, "ETHZ_autolab_technical_track-5-0": {"driven_any": 1.567456030937525, "sim_physics": 0.15773828983306884, "survival_time": 14.950000000000076, "driven_lanedir": 0.5167918887835721, "sim_render-ego": 0.05799082358678182, "in-drivable-lane": 6.950000000000041, "agent_compute-ego": 0.16113531430562336, "deviation-heading": 6.0970954854422645, "set_robot_commands": 0.08789158344268799, "deviation-center-line": 0.2497636020368942, "driven_lanedir_consec": 0.5167918887835721, "sim_compute_sim_state": 0.03660334904988607, "sim_compute_performance-ego": 0.06413703918457031, "sim_compute_robot_state-ego": 0.068031534353892, "sim_compute_robot_state-npc0": 0.06494500080744425, "sim_compute_robot_state-npc1": 0.06407451788584391, "sim_compute_robot_state-npc2": 0.06361393292744955, "sim_compute_robot_state-npc3": 0.06444254477818807}, "ETHZ_autolab_technical_track-6-0": {"driven_any": 0.10949077965113244, "sim_physics": 0.17604069198880876, "survival_time": 1.4000000000000006, "driven_lanedir": 0.03126199365840754, "sim_render-ego": 0.05754572153091431, "in-drivable-lane": 0.5000000000000003, "agent_compute-ego": 0.15547476496015275, "deviation-heading": 0.4986756377174347, "set_robot_commands": 0.09164547068732123, "deviation-center-line": 0.046861495705743765, "driven_lanedir_consec": 0.03126199365840754, "sim_compute_sim_state": 0.033848081316266744, "sim_compute_performance-ego": 0.06139935765947614, "sim_compute_robot_state-ego": 0.06428085906164986, "sim_compute_robot_state-npc0": 0.06479286296027047, "sim_compute_robot_state-npc1": 0.05874625274113247, "sim_compute_robot_state-npc2": 0.057826834065573554, "sim_compute_robot_state-npc3": 0.05379292794636318}, "ETHZ_autolab_technical_track-7-0": {"driven_any": 0.11889607104561672, "sim_physics": 0.15531218462976917, "survival_time": 1.4500000000000006, "driven_lanedir": 0.05028570494010731, "sim_render-ego": 0.052274514888894966, "in-drivable-lane": 0.4000000000000003, "agent_compute-ego": 0.15151653618648134, "deviation-heading": 0.5400609729976547, "set_robot_commands": 0.08720288605525575, "deviation-center-line": 0.06862984067383088, "driven_lanedir_consec": 0.05028570494010731, "sim_compute_sim_state": 0.03665165243477657, "sim_compute_performance-ego": 0.06334070501656368, "sim_compute_robot_state-ego": 0.068458943531431, "sim_compute_robot_state-npc0": 0.06468550090132089, "sim_compute_robot_state-npc1": 0.06417759533586173, "sim_compute_robot_state-npc2": 0.06164630528154044, "sim_compute_robot_state-npc3": 0.06527968110709355}, "ETHZ_autolab_technical_track-8-0": {"driven_any": 0.16979188599709688, "sim_physics": 0.17664715823005228, "survival_time": 1.7000000000000008, "driven_lanedir": 0.06531315904064305, "sim_render-ego": 0.060507465811336744, "in-drivable-lane": 0.5500000000000005, "agent_compute-ego": 0.1649696756811703, "deviation-heading": 0.6439097677899761, "set_robot_commands": 0.0902714729309082, "deviation-center-line": 0.02780241294906417, "driven_lanedir_consec": 0.06531315904064305, "sim_compute_sim_state": 0.037342345013337976, "sim_compute_performance-ego": 0.06518206876866958, "sim_compute_robot_state-ego": 0.07046985626220703, "sim_compute_robot_state-npc0": 0.06696574828203987, "sim_compute_robot_state-npc1": 0.07026646417729995, "sim_compute_robot_state-npc2": 0.06518532949335434, "sim_compute_robot_state-npc3": 0.06302358122432933}, "ETHZ_autolab_technical_track-9-0": {"driven_any": 1.5601848819411486, "sim_physics": 0.14494963804880778, "survival_time": 14.950000000000076, "driven_lanedir": 0.4859839888701125, "sim_render-ego": 0.054344181219736734, "in-drivable-lane": 7.30000000000004, "agent_compute-ego": 0.15126311858495076, "deviation-heading": 5.974823819208034, "set_robot_commands": 0.08385847965876261, "deviation-center-line": 0.167933907103007, "driven_lanedir_consec": 0.4859839888701125, "sim_compute_sim_state": 0.03426305294036865, "sim_compute_performance-ego": 0.061427194277445474, "sim_compute_robot_state-ego": 0.06730058352152507, "sim_compute_robot_state-npc0": 0.060136574109395345, "sim_compute_robot_state-npc1": 0.05894564310709635, "sim_compute_robot_state-npc2": 0.05933799902598063, "sim_compute_robot_state-npc3": 0.06102580944697062}, "ETHZ_autolab_technical_track-10-0": {"driven_any": 0.6240197595499182, "sim_physics": 0.1643636146513354, "survival_time": 5.949999999999987, "driven_lanedir": 0.19135411357194032, "sim_render-ego": 0.0610850438350389, "in-drivable-lane": 2.799999999999995, "agent_compute-ego": 0.15610021503031754, "deviation-heading": 2.430347921357834, "set_robot_commands": 0.08955954703964106, "deviation-center-line": 0.07657285677045554, "driven_lanedir_consec": 0.19135411357194032, "sim_compute_sim_state": 0.035520593659216615, "sim_compute_performance-ego": 0.06544748875273376, "sim_compute_robot_state-ego": 0.06687948483378947, "sim_compute_robot_state-npc0": 0.06390293906716739, "sim_compute_robot_state-npc1": 0.06531234148169766, "sim_compute_robot_state-npc2": 0.06511161106975139, "sim_compute_robot_state-npc3": 0.06217506552944664}, "ETHZ_autolab_technical_track-11-0": {"driven_any": 0.09895959495462382, "sim_physics": 0.15673850200794362, "survival_time": 1.3500000000000003, "driven_lanedir": 0.031560998153521425, "sim_render-ego": 0.05591697163052029, "in-drivable-lane": 0.4500000000000003, "agent_compute-ego": 0.1642713811662462, "deviation-heading": 0.5336889876053491, "set_robot_commands": 0.08699456850687663, "deviation-center-line": 0.06505635963666165, "driven_lanedir_consec": 0.031560998153521425, "sim_compute_sim_state": 0.03714406048810041, "sim_compute_performance-ego": 0.0634533475946497, "sim_compute_robot_state-ego": 0.07102713761506257, "sim_compute_robot_state-npc0": 0.06339217998363354, "sim_compute_robot_state-npc1": 0.06175855354026512, "sim_compute_robot_state-npc2": 0.06208446290757921, "sim_compute_robot_state-npc3": 0.06444201646027742}, "ETHZ_autolab_technical_track-12-0": {"driven_any": 1.6490147376645763, "sim_physics": 0.1572758928934733, "survival_time": 14.950000000000076, "driven_lanedir": 0.5717816054931946, "sim_render-ego": 0.0558881664276123, "in-drivable-lane": 7.100000000000041, "agent_compute-ego": 0.1569546620051066, "deviation-heading": 5.770018112021226, "set_robot_commands": 0.08814735968907673, "deviation-center-line": 0.2666691311120884, "driven_lanedir_consec": 0.5717816054931946, "sim_compute_sim_state": 0.03584709962209066, "sim_compute_performance-ego": 0.06114449024200439, "sim_compute_robot_state-ego": 0.06532016356786093, "sim_compute_robot_state-npc0": 0.06296947320302328, "sim_compute_robot_state-npc1": 0.06246983607610067, "sim_compute_robot_state-npc2": 0.06172402302424113, "sim_compute_robot_state-npc3": 0.06251467068990071}, "ETHZ_autolab_technical_track-13-0": {"driven_any": 0.13029629372032678, "sim_physics": 0.19015496969223025, "survival_time": 1.4000000000000006, "driven_lanedir": 0.06012441230310195, "sim_render-ego": 0.061672593866075785, "in-drivable-lane": 0.3500000000000003, "agent_compute-ego": 0.16273387840815953, "deviation-heading": 0.6022713837689331, "set_robot_commands": 0.0915311404636928, "deviation-center-line": 0.0773688304065683, "driven_lanedir_consec": 0.06012441230310195, "sim_compute_sim_state": 0.03827674899782453, "sim_compute_performance-ego": 0.07115967784609113, "sim_compute_robot_state-ego": 0.07746965544564384, "sim_compute_robot_state-npc0": 0.06822653327669416, "sim_compute_robot_state-npc1": 0.07057217189243861, "sim_compute_robot_state-npc2": 0.067177414894104, "sim_compute_robot_state-npc3": 0.06978196757180351}, "ETHZ_autolab_technical_track-14-0": {"driven_any": 0.12141200612630644, "sim_physics": 0.1749067667758826, "survival_time": 1.6500000000000008, "driven_lanedir": 0.03568390655875575, "sim_render-ego": 0.058315067580251984, "in-drivable-lane": 0.6000000000000005, "agent_compute-ego": 0.15187009898099033, "deviation-heading": 0.5922331285412288, "set_robot_commands": 0.10047131596189555, "deviation-center-line": 0.05411152880785536, "driven_lanedir_consec": 0.03568390655875575, "sim_compute_sim_state": 0.03577529300342907, "sim_compute_performance-ego": 0.06749930526271011, "sim_compute_robot_state-ego": 0.07150495413577918, "sim_compute_robot_state-npc0": 0.06481861345695727, "sim_compute_robot_state-npc1": 0.06667366894808682, "sim_compute_robot_state-npc2": 0.06554648370453806, "sim_compute_robot_state-npc3": 0.06249227668299819}}
set_robot_commands_max0.10047131596189555
set_robot_commands_mean0.08861354211374456
set_robot_commands_median0.08814735968907673
set_robot_commands_min0.07068991661071777
sim_compute_performance-ego_max0.07115967784609113
sim_compute_performance-ego_mean0.06281066681474849
sim_compute_performance-ego_median0.06334070501656368
sim_compute_performance-ego_min0.05119225713941786
sim_compute_robot_state-ego_max0.07746965544564384
sim_compute_robot_state-ego_mean0.06772178085661208
sim_compute_robot_state-ego_median0.06730058352152507
sim_compute_robot_state-ego_min0.053866739626284
sim_compute_robot_state-npc0_max0.06822653327669416
sim_compute_robot_state-npc0_mean0.06396444211249716
sim_compute_robot_state-npc0_median0.06468550090132089
sim_compute_robot_state-npc0_min0.05411374127423322
sim_compute_robot_state-npc1_max0.07057217189243861
sim_compute_robot_state-npc1_mean0.06324347684055359
sim_compute_robot_state-npc1_median0.06342979272206624
sim_compute_robot_state-npc1_min0.05352738168504503
sim_compute_robot_state-npc2_max0.067177414894104
sim_compute_robot_state-npc2_mean0.061990024699755626
sim_compute_robot_state-npc2_median0.06208446290757921
sim_compute_robot_state-npc2_min0.05292654920507361
sim_compute_robot_state-npc3_max0.06978196757180351
sim_compute_robot_state-npc3_mean0.0617043953682316
sim_compute_robot_state-npc3_median0.06249227668299819
sim_compute_robot_state-npc3_min0.05205713378058539
sim_compute_sim_state_max0.03827674899782453
sim_compute_sim_state_mean0.035496179875378994
sim_compute_sim_state_median0.03584709962209066
sim_compute_sim_state_min0.03043363712452076
sim_physics_max0.19015496969223025
sim_physics_mean0.16149516271466294
sim_physics_median0.15773828983306884
sim_physics_min0.12175461097999855
sim_render-ego_max0.061672593866075785
sim_render-ego_mean0.05689716917901884
sim_render-ego_median0.05754572153091431
sim_render-ego_min0.04742836069177698
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean6.243333333333358
survival_time_min1.2500000000000004
229942409jp18813100494Baseline solution using reinforcement learningaido2-LF-sim-validationstep1-simulationerroryes11700:09:40
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
(hidden)
229652451enickyBaseline solution using reinforcement learningaido2-LFVI-sim-validationstep1-simulationsuccessyes11700:35:05(hidden)
driven_lanedir_consec_median-1.339803295303147
survival_time_median14.950000000000076
deviation-center-line_median1.0021347592871723
in-drivable-lane_median4.050000000000024


other stats
agent_compute-ego_max0.16164000272750856
agent_compute-ego_mean0.15610354566574097
agent_compute-ego_median0.1540182638168335
agent_compute-ego_min0.1513586123784383
deviation-center-line_max1.5296442281508644
deviation-center-line_mean0.9253718574185378
deviation-center-line_min0.2826196070981827
deviation-heading_max8.558153948461719
deviation-heading_mean7.098260242116498
deviation-heading_median7.090641611385008
deviation-heading_min5.695926383403844
driven_any_max4.3785064440528245
driven_any_mean4.378506444052816
driven_any_median4.378506444052819
driven_any_min4.378506444052804
driven_lanedir_consec_max-1.272834629261013
driven_lanedir_consec_mean-1.3313573411979192
driven_lanedir_consec_min-1.3670060414727203
driven_lanedir_max-1.366266842110191
driven_lanedir_mean-2.078204689886424
driven_lanedir_median-2.260643253811775
driven_lanedir_min-2.710754983563031
in-drivable-lane_max7.400000000000039
in-drivable-lane_mean4.620000000000026
in-drivable-lane_min2.150000000000011
per-episodes
details{"udem1-0-0": {"driven_any": 4.378506444052811, "sim_physics": 0.16945639848709107, "survival_time": 14.950000000000076, "driven_lanedir": -2.710754983563031, "sim_render-ego": 0.05819206953048706, "in-drivable-lane": 2.150000000000011, "agent_compute-ego": 0.1513586123784383, "deviation-heading": 8.372894374860635, "set_robot_commands": 0.08639689366022746, "deviation-center-line": 1.5195321584534802, "driven_lanedir_consec": -1.3108758978425243, "sim_compute_sim_state": 0.03571542819341024, "sim_compute_performance-ego": 0.06123533646265666, "sim_compute_robot_state-ego": 0.06555419365564982, "sim_compute_robot_state-npc0": 0.062415278752644854, "sim_compute_robot_state-npc1": 0.06303441445032755, "sim_compute_robot_state-npc2": 0.06254379431406656, "sim_compute_robot_state-npc3": 0.061077833970387775}, "udem1-1-0": {"driven_any": 4.3785064440528245, "sim_physics": 0.1963050842285156, "survival_time": 14.950000000000076, "driven_lanedir": -2.686352328474403, "sim_render-ego": 0.06244195063908895, "in-drivable-lane": 2.150000000000011, "agent_compute-ego": 0.16164000272750856, "deviation-heading": 8.558153948461719, "set_robot_commands": 0.09260231733322144, "deviation-center-line": 1.5296442281508644, "driven_lanedir_consec": -1.272834629261013, "sim_compute_sim_state": 0.03846120834350586, "sim_compute_performance-ego": 0.0677091670036316, "sim_compute_robot_state-ego": 0.07323710282643636, "sim_compute_robot_state-npc0": 0.06724067529042561, "sim_compute_robot_state-npc1": 0.06775244156519572, "sim_compute_robot_state-npc2": 0.06679384152094524, "sim_compute_robot_state-npc3": 0.06824360211690267}, "udem1-2-0": {"driven_any": 4.378506444052804, "sim_physics": 0.18989391009012857, "survival_time": 14.950000000000076, "driven_lanedir": -1.366266842110191, "sim_render-ego": 0.0632138458887736, "in-drivable-lane": 7.35000000000004, "agent_compute-ego": 0.16144652446111044, "deviation-heading": 5.773684892471283, "set_robot_commands": 0.08892913262049357, "deviation-center-line": 0.29292853410298886, "driven_lanedir_consec": -1.366266842110191, "sim_compute_sim_state": 0.03933207432428996, "sim_compute_performance-ego": 0.06654704729715984, "sim_compute_robot_state-ego": 0.0708387041091919, "sim_compute_robot_state-npc0": 0.06876530408859254, "sim_compute_robot_state-npc1": 0.06705504814783732, "sim_compute_robot_state-npc2": 0.06762919743855794, "sim_compute_robot_state-npc3": 0.06814869006474812}, "udem1-3-0": {"driven_any": 4.3785064440528245, "sim_physics": 0.18457745790481567, "survival_time": 14.950000000000076, "driven_lanedir": -1.3670060414727203, "sim_render-ego": 0.05885006825129191, "in-drivable-lane": 7.400000000000039, "agent_compute-ego": 0.1540182638168335, "deviation-heading": 5.695926383403844, "set_robot_commands": 0.0852444338798523, "deviation-center-line": 0.2826196070981827, "driven_lanedir_consec": -1.3670060414727203, "sim_compute_sim_state": 0.03720717748006185, "sim_compute_performance-ego": 0.06571757634480795, "sim_compute_robot_state-ego": 0.0673143990834554, "sim_compute_robot_state-npc0": 0.064660009543101, "sim_compute_robot_state-npc1": 0.06520589749018352, "sim_compute_robot_state-npc2": 0.06374581098556518, "sim_compute_robot_state-npc3": 0.06520259459813436}, "udem1-4-0": {"driven_any": 4.378506444052819, "sim_physics": 0.1780240519841512, "survival_time": 14.950000000000076, "driven_lanedir": -2.260643253811775, "sim_render-ego": 0.05824246724446615, "in-drivable-lane": 4.050000000000024, "agent_compute-ego": 0.15205432494481405, "deviation-heading": 7.090641611385008, "set_robot_commands": 0.08677097241083781, "deviation-center-line": 1.0021347592871723, "driven_lanedir_consec": -1.339803295303147, "sim_compute_sim_state": 0.03556403954823812, "sim_compute_performance-ego": 0.062419451872507734, "sim_compute_robot_state-ego": 0.06781713008880615, "sim_compute_robot_state-npc0": 0.06343355655670166, "sim_compute_robot_state-npc1": 0.06446100870768229, "sim_compute_robot_state-npc2": 0.0638701581954956, "sim_compute_robot_state-npc3": 0.06762945731480917}}
set_robot_commands_max0.09260231733322144
set_robot_commands_mean0.08798874998092651
set_robot_commands_median0.08677097241083781
set_robot_commands_min0.0852444338798523
sim_compute_performance-ego_max0.0677091670036316
sim_compute_performance-ego_mean0.06472571579615276
sim_compute_performance-ego_median0.06571757634480795
sim_compute_performance-ego_min0.06123533646265666
sim_compute_robot_state-ego_max0.07323710282643636
sim_compute_robot_state-ego_mean0.06895230595270793
sim_compute_robot_state-ego_median0.06781713008880615
sim_compute_robot_state-ego_min0.06555419365564982
sim_compute_robot_state-npc0_max0.06876530408859254
sim_compute_robot_state-npc0_mean0.06530296484629314
sim_compute_robot_state-npc0_median0.064660009543101
sim_compute_robot_state-npc0_min0.062415278752644854
sim_compute_robot_state-npc1_max0.06775244156519572
sim_compute_robot_state-npc1_mean0.06550176207224527
sim_compute_robot_state-npc1_median0.06520589749018352
sim_compute_robot_state-npc1_min0.06303441445032755
sim_compute_robot_state-npc2_max0.06762919743855794
sim_compute_robot_state-npc2_mean0.06491656049092612
sim_compute_robot_state-npc2_median0.0638701581954956
sim_compute_robot_state-npc2_min0.06254379431406656
sim_compute_robot_state-npc3_max0.06824360211690267
sim_compute_robot_state-npc3_mean0.06606043561299643
sim_compute_robot_state-npc3_median0.06762945731480917
sim_compute_robot_state-npc3_min0.061077833970387775
sim_compute_sim_state_max0.03933207432428996
sim_compute_sim_state_mean0.0372559855779012
sim_compute_sim_state_median0.03720717748006185
sim_compute_sim_state_min0.03556403954823812
sim_physics_max0.1963050842285156
sim_physics_mean0.1836513805389404
sim_physics_median0.18457745790481567
sim_physics_min0.16945639848709107
sim_render-ego_max0.0632138458887736
sim_render-ego_mean0.06018808031082153
sim_render-ego_median0.05885006825129191
sim_render-ego_min0.05819206953048706
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean14.950000000000076
survival_time_min14.950000000000076
229642455Liam Paullchallenge-aido_LF-template-rosaido2-LF-sim-testingstep1-simulationerroryes11700:00:33
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
(hidden)
229612460Liam Paullchallenge-aido_LF-template-rosaido2-LFV-sim-validationstep1-simulationerroryes11700:00:31
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
(hidden)
229472492Liam Paullchallenge-aido_LF-template-pytorchaido2-LF-sim-validationstep1-simulationsuccessyes11700:05:43(hidden)
driven_lanedir_consec_median0.098052898070502
survival_time_median1.5000000000000009
deviation-center-line_median0.07996503098102208
in-drivable-lane_median0.10000000000000007


other stats
agent_compute-ego_max0.1896811803181966
agent_compute-ego_mean0.17274844630726444
agent_compute-ego_median0.17492795812672582
agent_compute-ego_min0.15716963464563544
deviation-center-line_max0.1029737095080038
deviation-center-line_mean0.07544715289323013
deviation-center-line_min0.054503661378267405
deviation-heading_max0.9300111016900432
deviation-heading_mean0.8443195661758613
deviation-heading_median0.9154108518886792
deviation-heading_min0.5868829248472237
driven_any_max0.2090968178479865
driven_any_mean0.18287136203598792
driven_any_median0.19253512399258405
driven_any_min0.1288705873822534
driven_lanedir_consec_max0.13697944344684432
driven_lanedir_consec_mean0.10455701730085398
driven_lanedir_consec_min0.07356958763641286
driven_lanedir_max0.13697944344684432
driven_lanedir_mean0.10455701730085398
driven_lanedir_median0.098052898070502
driven_lanedir_min0.07356958763641286
in-drivable-lane_max0.2500000000000002
in-drivable-lane_mean0.10000000000000007
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.19253512399258405, "sim_physics": 0.13956469694773355, "survival_time": 1.5000000000000009, "driven_lanedir": 0.08867442021339977, "sim_render-ego": 0.06517299016316731, "in-drivable-lane": 0.15000000000000013, "agent_compute-ego": 0.1896811803181966, "deviation-heading": 0.9154108518886792, "set_robot_commands": 0.10138392448425292, "deviation-center-line": 0.08132383542227452, "driven_lanedir_consec": 0.08867442021339977, "sim_compute_sim_state": 0.03859919706980387, "sim_compute_performance-ego": 0.07619848251342773, "sim_compute_robot_state-ego": 0.07812352975209554}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.20532978485023437, "sim_physics": 0.11642525345087051, "survival_time": 1.6000000000000008, "driven_lanedir": 0.12550873713711097, "sim_render-ego": 0.06096312403678894, "in-drivable-lane": 0.10000000000000007, "agent_compute-ego": 0.17499548196792605, "deviation-heading": 0.8668872668409795, "set_robot_commands": 0.0967669039964676, "deviation-center-line": 0.054503661378267405, "driven_lanedir_consec": 0.12550873713711097, "sim_compute_sim_state": 0.042617812752723694, "sim_compute_performance-ego": 0.06908738613128662, "sim_compute_robot_state-ego": 0.08206681162118912}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.1288705873822534, "sim_physics": 0.10104937986894089, "survival_time": 1.1000000000000003, "driven_lanedir": 0.098052898070502, "sim_render-ego": 0.05682373046875, "in-drivable-lane": 0, "agent_compute-ego": 0.15716963464563544, "deviation-heading": 0.5868829248472237, "set_robot_commands": 0.08417518572373824, "deviation-center-line": 0.1029737095080038, "driven_lanedir_consec": 0.098052898070502, "sim_compute_sim_state": 0.03785996003584429, "sim_compute_performance-ego": 0.06582726131786, "sim_compute_robot_state-ego": 0.0641054782000455}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.17852449610688134, "sim_physics": 0.1134080146921092, "survival_time": 1.4500000000000006, "driven_lanedir": 0.07356958763641286, "sim_render-ego": 0.06169375880011197, "in-drivable-lane": 0.2500000000000002, "agent_compute-ego": 0.17492795812672582, "deviation-heading": 0.9300111016900432, "set_robot_commands": 0.09513992276684992, "deviation-center-line": 0.0584695271765828, "driven_lanedir_consec": 0.07356958763641286, "sim_compute_sim_state": 0.03890739638229896, "sim_compute_performance-ego": 0.08647842242799957, "sim_compute_robot_state-ego": 0.07520438062733617}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.2090968178479865, "sim_physics": 0.11562398941286148, "survival_time": 1.5500000000000007, "driven_lanedir": 0.13697944344684432, "sim_render-ego": 0.060915916196761594, "in-drivable-lane": 0, "agent_compute-ego": 0.16696797647783834, "deviation-heading": 0.9224056856123806, "set_robot_commands": 0.08710324379705614, "deviation-center-line": 0.07996503098102208, "driven_lanedir_consec": 0.13697944344684432, "sim_compute_sim_state": 0.03857841799336095, "sim_compute_performance-ego": 0.06849455064342867, "sim_compute_robot_state-ego": 0.07252007146035472}}
set_robot_commands_max0.10138392448425292
set_robot_commands_mean0.09291383615367296
set_robot_commands_median0.09513992276684992
set_robot_commands_min0.08417518572373824
sim_compute_performance-ego_max0.08647842242799957
sim_compute_performance-ego_mean0.07321722060680053
sim_compute_performance-ego_median0.06908738613128662
sim_compute_performance-ego_min0.06582726131786
sim_compute_robot_state-ego_max0.08206681162118912
sim_compute_robot_state-ego_mean0.0744040543322042
sim_compute_robot_state-ego_median0.07520438062733617
sim_compute_robot_state-ego_min0.0641054782000455
sim_compute_sim_state_max0.042617812752723694
sim_compute_sim_state_mean0.03931255684680635
sim_compute_sim_state_median0.03859919706980387
sim_compute_sim_state_min0.03785996003584429
sim_physics_max0.13956469694773355
sim_physics_mean0.11721426687450312
sim_physics_median0.11562398941286148
sim_physics_min0.10104937986894089
sim_render-ego_max0.06517299016316731
sim_render-ego_mean0.06111390393311596
sim_render-ego_median0.06096312403678894
sim_render-ego_min0.05682373046875
simulation-passed1
survival_time_max1.6000000000000008
survival_time_mean1.4400000000000006
survival_time_min1.1000000000000003
229342502RamiNaimchallenge-aido_LF-template-rosaido2-LF-sim-testingstep1-simulationerroryes11700:00:49
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
(hidden)
229252521Liam Paullchallenge-aido_LF-baseline-duckietownaido2-LFV-sim-validationstep1-simulationerroryes11700:00:51
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
(hidden)
229062533Liam Paullbaseline-IL-sim-tensorflowaido2-LFV-sim-validationstep1-simulationerroryes11700:03:37
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
(hidden)
228902570Liam Paullchallenge-aido_LF-baseline-duckietownaido2-LF-sim-testingstep1-simulationerroryes11700:19:30
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
(hidden)
228832581AlexKaravaevchallenge-aido_LF-template-ros - Template solution using ROSaido2-LFVI-sim-testingstep1-simulationerroryes11700:02:45
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
(hidden)
228582624Andrea Censichallenge-aido_LF-template-randomaido2-LFVI-sim-testingstep1-simulationsuccessyes11700:27:59(hidden)
driven_lanedir_consec_median0.6537162971975778
survival_time_median2.5999999999999988
deviation-center-line_median0.14884708769804722
in-drivable-lane_median0.549999999999998


other stats
agent_compute-ego_max0.19035117901288545
agent_compute-ego_mean0.14768375103198966
agent_compute-ego_median0.14996348538445037
agent_compute-ego_min0.1197553248632522
deviation-center-line_max0.5141120095458062
deviation-center-line_mean0.1769000227005324
deviation-center-line_min0.06216029860587694
deviation-heading_max1.9929437250081896
deviation-heading_mean0.692977823395608
deviation-heading_median0.4928440244444201
deviation-heading_min0.24234723632033853
driven_any_max3.5343244022418343
driven_any_mean1.3470385992234175
driven_any_median1.001633421251194
driven_any_min0.3412551960104244
driven_lanedir_consec_max2.494308053441959
driven_lanedir_consec_mean0.881391085527715
driven_lanedir_consec_min0.3199180625488627
driven_lanedir_max2.494308053441959
driven_lanedir_mean0.8962528018383226
driven_lanedir_median0.7206363324756615
driven_lanedir_min0.3199180625488627
in-drivable-lane_max3.549999999999991
in-drivable-lane_mean0.839999999999998
in-drivable-lane_min0
per-episodes
details{"udem1-0-0": {"driven_any": 1.5811782993597916, "sim_physics": 0.19567220422286025, "survival_time": 3.949999999999994, "driven_lanedir": 0.9217908232230632, "sim_render-ego": 0.061594561685489706, "in-drivable-lane": 1.3499999999999952, "agent_compute-ego": 0.1523480656780774, "deviation-heading": 0.5694288623982039, "set_robot_commands": 0.09168362617492676, "deviation-center-line": 0.2348196785686717, "driven_lanedir_consec": 0.9213701538661684, "sim_compute_sim_state": 0.0381959903089306, "sim_compute_performance-ego": 0.07090690166135377, "sim_compute_robot_state-ego": 0.07357261150698119, "sim_compute_robot_state-npc0": 0.06549656542041633, "sim_compute_robot_state-npc1": 0.06673955917358398, "sim_compute_robot_state-npc2": 0.06710352173334436, "sim_compute_robot_state-npc3": 0.06704140916655335}, "udem1-1-0": {"driven_any": 0.47798123795353353, "sim_physics": 0.19222759349005564, "survival_time": 1.4000000000000006, "driven_lanedir": 0.4500753586658095, "sim_render-ego": 0.06281231982367379, "in-drivable-lane": 0, "agent_compute-ego": 0.15666175740105764, "deviation-heading": 0.46504862964833654, "set_robot_commands": 0.0915723272732326, "deviation-center-line": 0.09791133281082, "driven_lanedir_consec": 0.4500753586658095, "sim_compute_sim_state": 0.03440007141658238, "sim_compute_performance-ego": 0.06660535505839757, "sim_compute_robot_state-ego": 0.07319438457489014, "sim_compute_robot_state-npc0": 0.06686609131949288, "sim_compute_robot_state-npc1": 0.06373086145945958, "sim_compute_robot_state-npc2": 0.06058033875056675, "sim_compute_robot_state-npc3": 0.06223780768258231}, "udem1-2-0": {"driven_any": 2.1864003300000694, "sim_physics": 0.18107091570363465, "survival_time": 5.14999999999999, "driven_lanedir": 1.826231945363564, "sim_render-ego": 0.05725020112343205, "in-drivable-lane": 0.549999999999998, "agent_compute-ego": 0.14993725239651876, "deviation-heading": 0.8115272458314897, "set_robot_commands": 0.09524662980755556, "deviation-center-line": 0.1927316041609401, "driven_lanedir_consec": 1.826231945363564, "sim_compute_sim_state": 0.037459510043986795, "sim_compute_performance-ego": 0.06527639361261164, "sim_compute_robot_state-ego": 0.07088523698084563, "sim_compute_robot_state-npc0": 0.0672127158896437, "sim_compute_robot_state-npc1": 0.0654163892986705, "sim_compute_robot_state-npc2": 0.06699281525843352, "sim_compute_robot_state-npc3": 0.06765304491357896}, "udem1-3-0": {"driven_any": 0.9410513078477724, "sim_physics": 0.15045641362667084, "survival_time": 2.3999999999999995, "driven_lanedir": 0.493517638549009, "sim_render-ego": 0.04839162031809489, "in-drivable-lane": 0.8999999999999988, "agent_compute-ego": 0.12111954887708028, "deviation-heading": 0.35154027506548424, "set_robot_commands": 0.0740515540043513, "deviation-center-line": 0.08975118546699407, "driven_lanedir_consec": 0.493517638549009, "sim_compute_sim_state": 0.029703860481580097, "sim_compute_performance-ego": 0.0530322790145874, "sim_compute_robot_state-ego": 0.0551749716202418, "sim_compute_robot_state-npc0": 0.05172191560268402, "sim_compute_robot_state-npc1": 0.05050571262836456, "sim_compute_robot_state-npc2": 0.051816980044047035, "sim_compute_robot_state-npc3": 0.0757492979367574}, "udem1-4-0": {"driven_any": 0.34749292376309954, "sim_physics": 0.17214362961905344, "survival_time": 1.0500000000000005, "driven_lanedir": 0.3325249708009643, "sim_render-ego": 0.049314317249116446, "in-drivable-lane": 0, "agent_compute-ego": 0.1197553248632522, "deviation-heading": 0.30044835691402494, "set_robot_commands": 0.07546254566737584, "deviation-center-line": 0.06216029860587694, "driven_lanedir_consec": 0.3325249708009643, "sim_compute_sim_state": 0.06799874986921038, "sim_compute_performance-ego": 0.07096278099786668, "sim_compute_robot_state-ego": 0.06248797689165387, "sim_compute_robot_state-npc0": 0.06049619402204241, "sim_compute_robot_state-npc1": 0.05990739095778693, "sim_compute_robot_state-npc2": 0.05864983513241723, "sim_compute_robot_state-npc3": 0.07334653536478679}, "udem1-5-0": {"driven_any": 3.5343244022418343, "sim_physics": 0.18314608842312932, "survival_time": 8.349999999999984, "driven_lanedir": 2.494308053441959, "sim_render-ego": 0.05945506638395572, "in-drivable-lane": 2, "agent_compute-ego": 0.15111475790332177, "deviation-heading": 1.9929437250081896, "set_robot_commands": 0.09370930323343792, "deviation-center-line": 0.5141120095458062, "driven_lanedir_consec": 2.494308053441959, "sim_compute_sim_state": 0.03714085196306605, "sim_compute_performance-ego": 0.06612402664687106, "sim_compute_robot_state-ego": 0.07277348940957806, "sim_compute_robot_state-npc0": 0.06934110989827595, "sim_compute_robot_state-npc1": 0.073142435736285, "sim_compute_robot_state-npc2": 0.06697347920811819, "sim_compute_robot_state-npc3": 0.06825473208627302}, "udem1-6-0": {"driven_any": 2.176040550989443, "sim_physics": 0.20966828216626807, "survival_time": 5.14999999999999, "driven_lanedir": 1.9748003483573369, "sim_render-ego": 0.059735626850313354, "in-drivable-lane": 0.29999999999999893, "agent_compute-ego": 0.14996348538445037, "deviation-heading": 0.7877172510198454, "set_robot_commands": 0.0942457138913349, "deviation-center-line": 0.30661477465861414, "driven_lanedir_consec": 1.9748003483573369, "sim_compute_sim_state": 0.03899671499011586, "sim_compute_performance-ego": 0.06725131886676677, "sim_compute_robot_state-ego": 0.07228562669846618, "sim_compute_robot_state-npc0": 0.06944960760838777, "sim_compute_robot_state-npc1": 0.06748239970901637, "sim_compute_robot_state-npc2": 0.06813944196238102, "sim_compute_robot_state-npc3": 0.07316087750555242}, "udem1-7-0": {"driven_any": 1.0050236108346422, "sim_physics": 0.20285287857055664, "survival_time": 2.499999999999999, "driven_lanedir": 0.8701796426684156, "sim_render-ego": 0.061665501594543454, "in-drivable-lane": 0, "agent_compute-ego": 0.14907915115356446, "deviation-heading": 0.9227446658975216, "set_robot_commands": 0.1097263526916504, "deviation-center-line": 0.14884708769804722, "driven_lanedir_consec": 0.8546116490381102, "sim_compute_sim_state": 0.03506758213043213, "sim_compute_performance-ego": 0.06116716861724854, "sim_compute_robot_state-ego": 0.06587601184844971, "sim_compute_robot_state-npc0": 0.06280867099761962, "sim_compute_robot_state-npc1": 0.06020464897155762, "sim_compute_robot_state-npc2": 0.06148030757904053, "sim_compute_robot_state-npc3": 0.06234848022460938}, "udem1-8-0": {"driven_any": 0.9970416603019576, "sim_physics": 0.1394633650779724, "survival_time": 2.5999999999999988, "driven_lanedir": 0.8041152574540316, "sim_render-ego": 0.046051887365487904, "in-drivable-lane": 0.29999999999999893, "agent_compute-ego": 0.19035117901288545, "deviation-heading": 0.6817155913229235, "set_robot_commands": 0.08950298107587375, "deviation-center-line": 0.1898768080806288, "driven_lanedir_consec": 0.8041152574540316, "sim_compute_sim_state": 0.03063852511919462, "sim_compute_performance-ego": 0.050812799196976885, "sim_compute_robot_state-ego": 0.05324454032457792, "sim_compute_robot_state-npc0": 0.05539400760944073, "sim_compute_robot_state-npc1": 0.053239088792067304, "sim_compute_robot_state-npc2": 0.05125705553935124, "sim_compute_robot_state-npc3": 0.05289047956466675}, "udem1-9-0": {"driven_any": 0.4374998710472299, "sim_physics": 0.2056397291330191, "survival_time": 1.3000000000000005, "driven_lanedir": 0.4177527119659043, "sim_render-ego": 0.047837367424598105, "in-drivable-lane": 0, "agent_compute-ego": 0.12186570350940412, "deviation-heading": 0.3796137446285097, "set_robot_commands": 0.1109330837543194, "deviation-center-line": 0.08207813392324871, "driven_lanedir_consec": 0.4177527119659043, "sim_compute_sim_state": 0.03388706537393423, "sim_compute_performance-ego": 0.05386538688953106, "sim_compute_robot_state-ego": 0.06038700617276705, "sim_compute_robot_state-npc0": 0.052376848000746504, "sim_compute_robot_state-npc1": 0.05392351517310509, "sim_compute_robot_state-npc2": 0.05437093514662523, "sim_compute_robot_state-npc3": 0.0554657165820782}, "udem1-10-0": {"driven_any": 0.3412551960104244, "sim_physics": 0.274671424518932, "survival_time": 1.1000000000000003, "driven_lanedir": 0.3199180625488627, "sim_render-ego": 0.06536099043759433, "in-drivable-lane": 0, "agent_compute-ego": 0.17276325009085916, "deviation-heading": 0.3796986873122644, "set_robot_commands": 0.11135086146267978, "deviation-center-line": 0.06276575300040536, "driven_lanedir_consec": 0.3199180625488627, "sim_compute_sim_state": 0.039329236203973945, "sim_compute_performance-ego": 0.07441614974628795, "sim_compute_robot_state-ego": 0.08766601302407005, "sim_compute_robot_state-npc0": 0.0815723484212702, "sim_compute_robot_state-npc1": 0.07754983685233376, "sim_compute_robot_state-npc2": 0.08192734284834428, "sim_compute_robot_state-npc3": 0.0767601728439331}, "udem1-11-0": {"driven_any": 0.9951985237696338, "sim_physics": 0.15707058906555177, "survival_time": 2.499999999999999, "driven_lanedir": 0.7206363324756615, "sim_render-ego": 0.05333284854888916, "in-drivable-lane": 0.549999999999998, "agent_compute-ego": 0.13015392303466797, "deviation-heading": 0.30074636349085415, "set_robot_commands": 0.08186810970306396, "deviation-center-line": 0.16567670185555422, "driven_lanedir_consec": 0.7185075497455284, "sim_compute_sim_state": 0.03126850605010986, "sim_compute_performance-ego": 0.05475784301757813, "sim_compute_robot_state-ego": 0.05910179138183594, "sim_compute_robot_state-npc0": 0.06427786827087402, "sim_compute_robot_state-npc1": 0.0575523853302002, "sim_compute_robot_state-npc2": 0.05820993900299072, "sim_compute_robot_state-npc3": 0.057673282623291015}, "udem1-12-0": {"driven_any": 1.964687870253437, "sim_physics": 0.21055117566534817, "survival_time": 4.699999999999991, "driven_lanedir": 0.35162821871931205, "sim_render-ego": 0.06050950669227762, "in-drivable-lane": 3.549999999999991, "agent_compute-ego": 0.15513104073544767, "deviation-heading": 0.24234723632033853, "set_robot_commands": 0.09754127898114792, "deviation-center-line": 0.13126670634798973, "driven_lanedir_consec": 0.35162821871931205, "sim_compute_sim_state": 0.04621862350626195, "sim_compute_performance-ego": 0.06587822893832593, "sim_compute_robot_state-ego": 0.07534868666466246, "sim_compute_robot_state-npc0": 0.06872372170712085, "sim_compute_robot_state-npc1": 0.06820640411782772, "sim_compute_robot_state-npc2": 0.06909814286739269, "sim_compute_robot_state-npc3": 0.06855597394578}, "udem1-13-0": {"driven_any": 1.001633421251194, "sim_physics": 0.1999692962719844, "survival_time": 2.5999999999999988, "driven_lanedir": 0.6537162971975778, "sim_render-ego": 0.061100276616903454, "in-drivable-lane": 0.5999999999999979, "agent_compute-ego": 0.1449161401161781, "deviation-heading": 0.4928440244444201, "set_robot_commands": 0.09501628233836248, "deviation-center-line": 0.13361893417935136, "driven_lanedir_consec": 0.6537162971975778, "sim_compute_sim_state": 0.03916304386579073, "sim_compute_performance-ego": 0.06494263502267691, "sim_compute_robot_state-ego": 0.07472266142184918, "sim_compute_robot_state-npc0": 0.06933337450027466, "sim_compute_robot_state-npc1": 0.06857509796436016, "sim_compute_robot_state-npc2": 0.06862868712498592, "sim_compute_robot_state-npc3": 0.0671996886913593}, "udem1-14-0": {"driven_any": 2.218769782727203, "sim_physics": 0.18343400955200195, "survival_time": 5.249999999999989, "driven_lanedir": 0.8125963661433656, "sim_render-ego": 0.05792255855741955, "in-drivable-lane": 2.499999999999993, "agent_compute-ego": 0.15009568532307943, "deviation-heading": 1.7163026916317128, "set_robot_commands": 0.08948915118262882, "deviation-center-line": 0.24126933160503777, "driven_lanedir_consec": 0.6077880672015845, "sim_compute_sim_state": 0.037850811367943174, "sim_compute_performance-ego": 0.06253281320844378, "sim_compute_robot_state-ego": 0.06858609290350051, "sim_compute_robot_state-npc0": 0.06513480004810152, "sim_compute_robot_state-npc1": 0.06537731261480423, "sim_compute_robot_state-npc2": 0.06638078008379256, "sim_compute_robot_state-npc3": 0.06538221949622744}}
set_robot_commands_max0.11135086146267978
set_robot_commands_mean0.09342665341612942
set_robot_commands_median0.09370930323343792
set_robot_commands_min0.0740515540043513
sim_compute_performance-ego_max0.07441614974628795
sim_compute_performance-ego_mean0.06323547203303495
sim_compute_performance-ego_median0.06527639361261164
sim_compute_performance-ego_min0.050812799196976885
sim_compute_robot_state-ego_max0.08766601302407005
sim_compute_robot_state-ego_mean0.06835380676162464
sim_compute_robot_state-ego_median0.07088523698084563
sim_compute_robot_state-ego_min0.05324454032457792
sim_compute_robot_state-npc0_max0.0815723484212702
sim_compute_robot_state-npc0_mean0.0646803892877594
sim_compute_robot_state-npc0_median0.06549656542041633
sim_compute_robot_state-npc0_min0.05172191560268402
sim_compute_robot_state-npc1_max0.07754983685233376
sim_compute_robot_state-npc1_mean0.06343686925196154
sim_compute_robot_state-npc1_median0.06537731261480423
sim_compute_robot_state-npc1_min0.05050571262836456
sim_compute_robot_state-npc2_max0.08192734284834428
sim_compute_robot_state-npc2_mean0.06344064015212209
sim_compute_robot_state-npc2_median0.06638078008379256
sim_compute_robot_state-npc2_min0.05125705553935124
sim_compute_robot_state-npc3_max0.0767601728439331
sim_compute_robot_state-npc3_mean0.06624798124186863
sim_compute_robot_state-npc3_median0.0671996886913593
sim_compute_robot_state-npc3_min0.05289047956466675
sim_compute_sim_state_max0.06799874986921038
sim_compute_sim_state_mean0.03848794284607419
sim_compute_sim_state_median0.037459510043986795
sim_compute_sim_state_min0.029703860481580097
sim_physics_max0.274671424518932
sim_physics_mean0.1905358396738026
sim_physics_median0.19222759349005564
sim_physics_min0.1394633650779724
sim_render-ego_max0.06536099043759433
sim_render-ego_mean0.056822310044785974
sim_render-ego_median0.05945506638395572
sim_render-ego_min0.046051887365487904
simulation-passed1
survival_time_max8.349999999999984
survival_time_mean3.3333333333333286
survival_time_min1.0500000000000005
228522645zamatorychallenge-aido_LF-template-ros - Template solution using ROSaido2-LFV-sim-validationstep1-simulationsuccessyes11700:07:55(hidden)
driven_lanedir_consec_median0.36592094708219225
survival_time_median2.5999999999999988
deviation-center-line_median0.16987818035809085
in-drivable-lane_median0.05000000000000005


other stats
agent_compute-ego_max0.07544233649969101
agent_compute-ego_mean0.06975875874859214
agent_compute-ego_median0.07021189743364362
agent_compute-ego_min0.06409977491085346
deviation-center-line_max0.2294363663374862
deviation-center-line_mean0.14972083567701736
deviation-center-line_min0.06426934298501713
deviation-heading_max0.6986268167330368
deviation-heading_mean0.4280304166285303
deviation-heading_median0.41847631252347706
deviation-heading_min0.2596285487829774
driven_any_max1.2972979671834337
driven_any_mean0.7173901327940211
driven_any_median0.7336463183586153
driven_any_min0.26903550091980144
driven_lanedir_consec_max0.97716132702229
driven_lanedir_consec_mean0.5227475277218055
driven_lanedir_consec_min0.2407721645627201
driven_lanedir_max0.97716132702229
driven_lanedir_mean0.5227475277218055
driven_lanedir_median0.36592094708219225
driven_lanedir_min0.2407721645627201
in-drivable-lane_max1.8999999999999944
in-drivable-lane_mean0.5799999999999983
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.922682252912863, "sim_physics": 0.15888397122772646, "survival_time": 3.5499999999999954, "driven_lanedir": 0.36592094708219225, "sim_render-ego": 0.06132647688959686, "in-drivable-lane": 1.8999999999999944, "agent_compute-ego": 0.07021189743364362, "deviation-heading": 0.2596285487829774, "set_robot_commands": 0.09867015019269056, "deviation-center-line": 0.16987818035809085, "driven_lanedir_consec": 0.36592094708219225, "sim_compute_sim_state": 0.0374143123626709, "sim_compute_performance-ego": 0.07139776122402137, "sim_compute_robot_state-ego": 0.07557405216593138, "sim_compute_robot_state-npc0": 0.07096045453783492, "sim_compute_robot_state-npc1": 0.0693918550518197, "sim_compute_robot_state-npc2": 0.06751431209940306, "sim_compute_robot_state-npc3": 0.06642922884981398}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.3642886245953926, "sim_physics": 0.1846514791250229, "survival_time": 1.6000000000000008, "driven_lanedir": 0.3026144243018116, "sim_render-ego": 0.05720393359661102, "in-drivable-lane": 0.05000000000000005, "agent_compute-ego": 0.07544233649969101, "deviation-heading": 0.6986268167330368, "set_robot_commands": 0.09705163538455965, "deviation-center-line": 0.10463456752710916, "driven_lanedir_consec": 0.3026144243018116, "sim_compute_sim_state": 0.03773318976163864, "sim_compute_performance-ego": 0.06416330486536026, "sim_compute_robot_state-ego": 0.07161182165145874, "sim_compute_robot_state-npc0": 0.07017747312784195, "sim_compute_robot_state-npc1": 0.06657131761312485, "sim_compute_robot_state-npc2": 0.06599271297454834, "sim_compute_robot_state-npc3": 0.06588449329137802}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.7336463183586153, "sim_physics": 0.1705481089078463, "survival_time": 2.5999999999999988, "driven_lanedir": 0.727268775640014, "sim_render-ego": 0.05874936855756319, "in-drivable-lane": 0, "agent_compute-ego": 0.06409977491085346, "deviation-heading": 0.2723076711805525, "set_robot_commands": 0.08751562466988197, "deviation-center-line": 0.2294363663374862, "driven_lanedir_consec": 0.727268775640014, "sim_compute_sim_state": 0.03528828345812284, "sim_compute_performance-ego": 0.0654580547259404, "sim_compute_robot_state-ego": 0.06990432739257812, "sim_compute_robot_state-npc0": 0.06671490119053768, "sim_compute_robot_state-npc1": 0.06193419603201059, "sim_compute_robot_state-npc2": 0.06318559554906991, "sim_compute_robot_state-npc3": 0.06105153377239521}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.2972979671834337, "sim_physics": 0.17521740544226863, "survival_time": 4.6499999999999915, "driven_lanedir": 0.97716132702229, "sim_render-ego": 0.058234366037512336, "in-drivable-lane": 0.9499999999999966, "agent_compute-ego": 0.06656772346906764, "deviation-heading": 0.4911127339226078, "set_robot_commands": 0.09138465953129594, "deviation-center-line": 0.18038572117738352, "driven_lanedir_consec": 0.97716132702229, "sim_compute_sim_state": 0.03865647828707131, "sim_compute_performance-ego": 0.0646525941869264, "sim_compute_robot_state-ego": 0.07623565581537062, "sim_compute_robot_state-npc0": 0.06878933342554236, "sim_compute_robot_state-npc1": 0.0685340742911062, "sim_compute_robot_state-npc2": 0.06487546172193302, "sim_compute_robot_state-npc3": 0.06550859892240135}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.26903550091980144, "sim_physics": 0.16164196105230422, "survival_time": 1.0500000000000005, "driven_lanedir": 0.2407721645627201, "sim_render-ego": 0.05829236620948428, "in-drivable-lane": 0, "agent_compute-ego": 0.07247206142970494, "deviation-heading": 0.41847631252347706, "set_robot_commands": 0.09180792172749835, "deviation-center-line": 0.06426934298501713, "driven_lanedir_consec": 0.2407721645627201, "sim_compute_sim_state": 0.035907291230701265, "sim_compute_performance-ego": 0.06959506443568639, "sim_compute_robot_state-ego": 0.06808485303606306, "sim_compute_robot_state-npc0": 0.0637563183194115, "sim_compute_robot_state-npc1": 0.06455160322643462, "sim_compute_robot_state-npc2": 0.06521195457095191, "sim_compute_robot_state-npc3": 0.06523373013450987}}
set_robot_commands_max0.09867015019269056
set_robot_commands_mean0.0932859983011853
set_robot_commands_median0.09180792172749835
set_robot_commands_min0.08751562466988197
sim_compute_performance-ego_max0.07139776122402137
sim_compute_performance-ego_mean0.06705335588758696
sim_compute_performance-ego_median0.0654580547259404
sim_compute_performance-ego_min0.06416330486536026
sim_compute_robot_state-ego_max0.07623565581537062
sim_compute_robot_state-ego_mean0.07228214201228038
sim_compute_robot_state-ego_median0.07161182165145874
sim_compute_robot_state-ego_min0.06808485303606306
sim_compute_robot_state-npc0_max0.07096045453783492
sim_compute_robot_state-npc0_mean0.06807969612023368
sim_compute_robot_state-npc0_median0.06878933342554236
sim_compute_robot_state-npc0_min0.0637563183194115
sim_compute_robot_state-npc1_max0.0693918550518197
sim_compute_robot_state-npc1_mean0.06619660924289919
sim_compute_robot_state-npc1_median0.06657131761312485
sim_compute_robot_state-npc1_min0.06193419603201059
sim_compute_robot_state-npc2_max0.06751431209940306
sim_compute_robot_state-npc2_mean0.06535600738318124
sim_compute_robot_state-npc2_median0.06521195457095191
sim_compute_robot_state-npc2_min0.06318559554906991
sim_compute_robot_state-npc3_max0.06642922884981398
sim_compute_robot_state-npc3_mean0.06482151699409969
sim_compute_robot_state-npc3_median0.06550859892240135
sim_compute_robot_state-npc3_min0.06105153377239521
sim_compute_sim_state_max0.03865647828707131
sim_compute_sim_state_mean0.03699991102004099
sim_compute_sim_state_median0.0374143123626709
sim_compute_sim_state_min0.03528828345812284
sim_physics_max0.1846514791250229
sim_physics_mean0.1701885851510337
sim_physics_median0.1705481089078463
sim_physics_min0.15888397122772646
sim_render-ego_max0.06132647688959686
sim_render-ego_mean0.058761302258153535
sim_render-ego_median0.05829236620948428
sim_render-ego_min0.05720393359661102
simulation-passed1
survival_time_max4.6499999999999915
survival_time_mean2.6899999999999973
survival_time_min1.0500000000000005
228412653zamatorychallenge-aido_LF-baseline-duckietownaido2-LF-sim-validationstep1-simulationerroryes11700:11:37
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
(hidden)
228302677RamiNaimchallenge-aido_LF-baseline-duckietownaido2-LF-sim-validationstep1-simulationsuccessyes11700:14:18(hidden)
driven_lanedir_consec_median0.9526256427714684
survival_time_median6.849999999999984
deviation-center-line_median0.4899144899236154
in-drivable-lane_median0.1999999999999993


other stats
agent_compute-ego_max0.09070723218129094
agent_compute-ego_mean0.08712371735758455
agent_compute-ego_median0.08926532566547393
agent_compute-ego_min0.07913075609410063
deviation-center-line_max1.0607082104768049
deviation-center-line_mean0.5437866453098109
deviation-center-line_min0.1955702585542869
deviation-heading_max6.082322784884084
deviation-heading_mean2.519842131301548
deviation-heading_median1.7913614924974466
deviation-heading_min0.6122990104005587
driven_any_max2.348957891787202
driven_any_mean1.2656193247780287
driven_any_median1.047157865268293
driven_any_min0.7017412917729268
driven_lanedir_consec_max1.5359432523425878
driven_lanedir_consec_mean0.9506897383499108
driven_lanedir_consec_min0.4853286693558676
driven_lanedir_max1.7769894027388546
driven_lanedir_mean0.998898968429164
driven_lanedir_median0.9526256427714684
driven_lanedir_min0.4853286693558676
in-drivable-lane_max2.84999999999999
in-drivable-lane_mean0.9300000000000012
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.9982040060192792, "sim_physics": 0.14568811968753212, "survival_time": 6.649999999999984, "driven_lanedir": 0.9526256427714684, "sim_render-ego": 0.07138629604999285, "in-drivable-lane": 0, "agent_compute-ego": 0.09070723218129094, "deviation-heading": 1.5444153235768223, "set_robot_commands": 0.11152350812926327, "deviation-center-line": 0.4899144899236154, "driven_lanedir_consec": 0.9526256427714684, "sim_compute_sim_state": 0.04398489177675176, "sim_compute_performance-ego": 0.08070741201701917, "sim_compute_robot_state-ego": 0.08787020346275846}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 2.348957891787202, "sim_physics": 0.11418504238128664, "survival_time": 14.950000000000076, "driven_lanedir": 1.7769894027388546, "sim_render-ego": 0.06160179694493611, "in-drivable-lane": 1.6000000000000174, "agent_compute-ego": 0.09060343503952026, "deviation-heading": 6.082322784884084, "set_robot_commands": 0.09051936149597169, "deviation-center-line": 1.0607082104768049, "driven_lanedir_consec": 1.5359432523425878, "sim_compute_sim_state": 0.03739113092422485, "sim_compute_performance-ego": 0.06572386185328166, "sim_compute_robot_state-ego": 0.071898725827535}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.7017412917729268, "sim_physics": 0.11013732818847008, "survival_time": 4.699999999999991, "driven_lanedir": 0.6949619154585704, "sim_render-ego": 0.06355151977944881, "in-drivable-lane": 0, "agent_compute-ego": 0.07913075609410063, "deviation-heading": 0.6122990104005587, "set_robot_commands": 0.10216910788353452, "deviation-center-line": 0.5419749208758108, "driven_lanedir_consec": 0.6949619154585704, "sim_compute_sim_state": 0.03819934611624859, "sim_compute_performance-ego": 0.0669844556362071, "sim_compute_robot_state-ego": 0.07225152025831506}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.047157865268293, "sim_physics": 0.13488634833454216, "survival_time": 6.849999999999984, "driven_lanedir": 0.4853286693558676, "sim_render-ego": 0.0674557094156307, "in-drivable-lane": 2.84999999999999, "agent_compute-ego": 0.085911837807537, "deviation-heading": 1.7913614924974466, "set_robot_commands": 0.10666405545534008, "deviation-center-line": 0.1955702585542869, "driven_lanedir_consec": 0.4853286693558676, "sim_compute_sim_state": 0.04139672404658185, "sim_compute_performance-ego": 0.07476893306648644, "sim_compute_robot_state-ego": 0.0840359656480107}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.2320355690424432, "sim_physics": 0.1356927365064621, "survival_time": 7.99999999999998, "driven_lanedir": 1.0845892118210592, "sim_render-ego": 0.07043762356042862, "in-drivable-lane": 0.1999999999999993, "agent_compute-ego": 0.08926532566547393, "deviation-heading": 2.568812045148827, "set_robot_commands": 0.1166650652885437, "deviation-center-line": 0.4307653467185367, "driven_lanedir_consec": 1.0845892118210592, "sim_compute_sim_state": 0.043792127072811125, "sim_compute_performance-ego": 0.07908401042222976, "sim_compute_robot_state-ego": 0.09164804220199584}}
set_robot_commands_max0.1166650652885437
set_robot_commands_mean0.10550821965053066
set_robot_commands_median0.10666405545534008
set_robot_commands_min0.09051936149597169
sim_compute_performance-ego_max0.08070741201701917
sim_compute_performance-ego_mean0.07345373459904483
sim_compute_performance-ego_median0.07476893306648644
sim_compute_performance-ego_min0.06572386185328166
sim_compute_robot_state-ego_max0.09164804220199584
sim_compute_robot_state-ego_mean0.08154089147972302
sim_compute_robot_state-ego_median0.0840359656480107
sim_compute_robot_state-ego_min0.071898725827535
sim_compute_sim_state_max0.04398489177675176
sim_compute_sim_state_mean0.040952843987323635
sim_compute_sim_state_median0.04139672404658185
sim_compute_sim_state_min0.03739113092422485
sim_physics_max0.14568811968753212
sim_physics_mean0.12811791501965858
sim_physics_median0.13488634833454216
sim_physics_min0.11013732818847008
sim_render-ego_max0.07138629604999285
sim_render-ego_mean0.06688658915008742
sim_render-ego_median0.0674557094156307
sim_render-ego_min0.06160179694493611
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean8.230000000000002
survival_time_min4.699999999999991
228242691Konstantin Chaykachallenge-aido_LF-baseline-duckietownaido2-LF-sim-validationstep1-simulationsuccessyes11700:17:37(hidden)
driven_lanedir_consec_median0.7192183073704621
survival_time_median5.349999999999989
deviation-center-line_median0.5112833342363641
in-drivable-lane_median1.1999999999999975


other stats
agent_compute-ego_max0.09646046495883263
agent_compute-ego_mean0.09114246686827716
agent_compute-ego_median0.09081674655278524
agent_compute-ego_min0.0852532418568929
deviation-center-line_max0.9296349062389074
deviation-center-line_mean0.6238025365351884
deviation-center-line_min0.34452443790814913
deviation-heading_max7.55524936973824
deviation-heading_mean3.837572682812902
deviation-heading_median2.4571322166172407
deviation-heading_min0.8712884405280571
driven_any_max2.3485722270463634
driven_any_mean1.3843598161513242
driven_any_median0.7892393487072294
driven_any_min0.7015645083356484
driven_lanedir_consec_max0.9976794100250816
driven_lanedir_consec_mean0.7074863519848085
driven_lanedir_consec_min0.1680339722699235
driven_lanedir_max1.4377596432867712
driven_lanedir_mean0.9090116332636152
driven_lanedir_median0.7192183073704621
driven_lanedir_min0.3152981596165893
in-drivable-lane_max3.250000000000016
in-drivable-lane_mean1.4800000000000035
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.7892393487072294, "sim_physics": 0.14935669275087732, "survival_time": 5.349999999999989, "driven_lanedir": 0.6768960659975769, "sim_render-ego": 0.0700454778760393, "in-drivable-lane": 0, "agent_compute-ego": 0.09646046495883263, "deviation-heading": 2.044030161059483, "set_robot_commands": 0.1153168967951124, "deviation-center-line": 0.4594888496580274, "driven_lanedir_consec": 0.6768960659975769, "sim_compute_sim_state": 0.04378071900840118, "sim_compute_performance-ego": 0.08032992621448552, "sim_compute_robot_state-ego": 0.10028142572563384}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.7015645083356484, "sim_physics": 0.14084962581066376, "survival_time": 4.699999999999991, "driven_lanedir": 0.3152981596165893, "sim_render-ego": 0.07248037419420608, "in-drivable-lane": 1.1999999999999975, "agent_compute-ego": 0.09038088423140506, "deviation-heading": 2.4571322166172407, "set_robot_commands": 0.11479434307585372, "deviation-center-line": 0.34452443790814913, "driven_lanedir_consec": 0.1680339722699235, "sim_compute_sim_state": 0.04453245629655554, "sim_compute_performance-ego": 0.08261059446537748, "sim_compute_robot_state-ego": 0.09308202215965758}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.733865744790049, "sim_physics": 0.12942163798273826, "survival_time": 4.899999999999991, "driven_lanedir": 0.7192183073704621, "sim_render-ego": 0.07046843548210299, "in-drivable-lane": 0, "agent_compute-ego": 0.09280099674147002, "deviation-heading": 0.8712884405280571, "set_robot_commands": 0.1134122877704854, "deviation-center-line": 0.5112833342363641, "driven_lanedir_consec": 0.7192183073704621, "sim_compute_sim_state": 0.04500862530299595, "sim_compute_performance-ego": 0.0803954114719313, "sim_compute_robot_state-ego": 0.08649433389001963}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 2.3485722270463634, "sim_physics": 0.13310299078623453, "survival_time": 14.950000000000076, "driven_lanedir": 1.395885990046676, "sim_render-ego": 0.07342968146006267, "in-drivable-lane": 2.9500000000000037, "agent_compute-ego": 0.09081674655278524, "deviation-heading": 7.55524936973824, "set_robot_commands": 0.11294524749120076, "deviation-center-line": 0.8740811546344934, "driven_lanedir_consec": 0.975604004260998, "sim_compute_sim_state": 0.04443172772725423, "sim_compute_performance-ego": 0.08072090148925781, "sim_compute_robot_state-ego": 0.09006675799687704}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 2.348557251877331, "sim_physics": 0.12735562483469645, "survival_time": 14.950000000000076, "driven_lanedir": 1.4377596432867712, "sim_render-ego": 0.06901970704396566, "in-drivable-lane": 3.250000000000016, "agent_compute-ego": 0.0852532418568929, "deviation-heading": 6.260163226121487, "set_robot_commands": 0.10892044544219973, "deviation-center-line": 0.9296349062389074, "driven_lanedir_consec": 0.9976794100250816, "sim_compute_sim_state": 0.04246190786361694, "sim_compute_performance-ego": 0.07636543432871501, "sim_compute_robot_state-ego": 0.08415834506352743}}
set_robot_commands_max0.1153168967951124
set_robot_commands_mean0.1130778441149704
set_robot_commands_median0.1134122877704854
set_robot_commands_min0.10892044544219973
sim_compute_performance-ego_max0.08261059446537748
sim_compute_performance-ego_mean0.08008445359395341
sim_compute_performance-ego_median0.0803954114719313
sim_compute_performance-ego_min0.07636543432871501
sim_compute_robot_state-ego_max0.10028142572563384
sim_compute_robot_state-ego_mean0.0908165769671431
sim_compute_robot_state-ego_median0.09006675799687704
sim_compute_robot_state-ego_min0.08415834506352743
sim_compute_sim_state_max0.04500862530299595
sim_compute_sim_state_mean0.04404308723976477
sim_compute_sim_state_median0.04443172772725423
sim_compute_sim_state_min0.04246190786361694
sim_physics_max0.14935669275087732
sim_physics_mean0.13601731443304205
sim_physics_median0.13310299078623453
sim_physics_min0.12735562483469645
sim_render-ego_max0.07342968146006267
sim_render-ego_mean0.07108873521127533
sim_render-ego_median0.07046843548210299
sim_render-ego_min0.06901970704396566
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean8.970000000000024
survival_time_min4.699999999999991
227912754Bhairav Mehtachallenge-aido_LF-template-ros - Template solution using ROSaido2-LF-sim-testingstep1-simulationsuccessyes11700:15:03(hidden)
driven_lanedir_consec_median0.4126113388371666
survival_time_median2.6999999999999984
deviation-center-line_median0.11871775985231396
in-drivable-lane_median0.9499999999999976


other stats
agent_compute-ego_max0.09334176381429037
agent_compute-ego_mean0.06307417156415215
agent_compute-ego_median0.060917873492186095
agent_compute-ego_min0.042298351015363424
deviation-center-line_max0.2616199012603187
deviation-center-line_mean0.12663752615997417
deviation-center-line_min0.07143676193760398
deviation-heading_max1.4563581054905994
deviation-heading_mean0.5551840294909584
deviation-heading_median0.55940705176748
deviation-heading_min0.2596285487829774
driven_any_max1.6839250134630197
driven_any_mean0.7327294413370017
driven_any_median0.7309130538792373
driven_any_min0.2364518949491652
driven_lanedir_consec_max0.9416535020294268
driven_lanedir_consec_mean0.4469104002974222
driven_lanedir_consec_min0.2221238695940002
driven_lanedir_max0.9416535020294268
driven_lanedir_mean0.4469104002974222
driven_lanedir_median0.4126113388371666
driven_lanedir_min0.2221238695940002
in-drivable-lane_max2.1499999999999924
in-drivable-lane_mean0.8233333333333307
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.922682252912863, "sim_physics": 0.08699881862586653, "survival_time": 3.5499999999999954, "driven_lanedir": 0.36592094708219225, "sim_render-ego": 0.04776946255858515, "in-drivable-lane": 1.8999999999999944, "agent_compute-ego": 0.0529491599176971, "deviation-heading": 0.2596285487829774, "set_robot_commands": 0.07126130184657137, "deviation-center-line": 0.16987818035809085, "driven_lanedir_consec": 0.36592094708219225, "sim_compute_sim_state": 0.02946349600671043, "sim_compute_performance-ego": 0.05647001803760797, "sim_compute_robot_state-ego": 0.0564642523376035}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.7993934895811189, "sim_physics": 0.14628276824951172, "survival_time": 2.9999999999999973, "driven_lanedir": 0.6632135184572027, "sim_render-ego": 0.06436090469360352, "in-drivable-lane": 0.29999999999999893, "agent_compute-ego": 0.09334176381429037, "deviation-heading": 0.5809378480871981, "set_robot_commands": 0.11633018652598064, "deviation-center-line": 0.1166759393545397, "driven_lanedir_consec": 0.6632135184572027, "sim_compute_sim_state": 0.0459917147954305, "sim_compute_performance-ego": 0.07905261913935344, "sim_compute_robot_state-ego": 0.092208202679952}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.2364518949491652, "sim_physics": 0.0698591253974221, "survival_time": 1.1000000000000003, "driven_lanedir": 0.2221238695940002, "sim_render-ego": 0.03800857067108154, "in-drivable-lane": 0, "agent_compute-ego": 0.04253717986020175, "deviation-heading": 0.34882560565471876, "set_robot_commands": 0.05812524665485729, "deviation-center-line": 0.11316665887359229, "driven_lanedir_consec": 0.2221238695940002, "sim_compute_sim_state": 0.024246941913257943, "sim_compute_performance-ego": 0.04133977673270486, "sim_compute_robot_state-ego": 0.044428229331970215}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.5946812776947944, "sim_physics": 0.08250038822491963, "survival_time": 2.3999999999999995, "driven_lanedir": 0.5792955579972934, "sim_render-ego": 0.04506258169809977, "in-drivable-lane": 0, "agent_compute-ego": 0.05151469508806864, "deviation-heading": 0.5685240160177978, "set_robot_commands": 0.07042579849561055, "deviation-center-line": 0.15908349194402024, "driven_lanedir_consec": 0.5792955579972934, "sim_compute_sim_state": 0.02917337914307912, "sim_compute_performance-ego": 0.04943455755710602, "sim_compute_robot_state-ego": 0.05521536866823832}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.609146202404747, "sim_physics": 0.07575164152228314, "survival_time": 2.3, "driven_lanedir": 0.2919817227673325, "sim_render-ego": 0.04774337747822637, "in-drivable-lane": 0.9499999999999992, "agent_compute-ego": 0.05201359417127526, "deviation-heading": 0.3390861746033595, "set_robot_commands": 0.06321318253226903, "deviation-center-line": 0.1011892720306074, "driven_lanedir_consec": 0.2919817227673325, "sim_compute_sim_state": 0.03172426120094631, "sim_compute_performance-ego": 0.05304265540579091, "sim_compute_robot_state-ego": 0.07120410255763841}, "ETHZ_autolab_technical_track-5-0": {"driven_any": 0.32177231722795413, "sim_physics": 0.06808024644851685, "survival_time": 1.2000000000000004, "driven_lanedir": 0.259671941523266, "sim_render-ego": 0.04289453228314718, "in-drivable-lane": 0.05000000000000005, "agent_compute-ego": 0.049532165129979454, "deviation-heading": 0.55940705176748, "set_robot_commands": 0.06795849402745564, "deviation-center-line": 0.07983398841276981, "driven_lanedir_consec": 0.259671941523266, "sim_compute_sim_state": 0.027759979168574016, "sim_compute_performance-ego": 0.04627335071563721, "sim_compute_robot_state-ego": 0.049128939708073936}, "ETHZ_autolab_technical_track-6-0": {"driven_any": 0.9218874635466072, "sim_physics": 0.05483752641922388, "survival_time": 3.899999999999994, "driven_lanedir": 0.5450627289344152, "sim_render-ego": 0.0353005268634894, "in-drivable-lane": 1.2999999999999954, "agent_compute-ego": 0.04521560974610157, "deviation-heading": 0.6586708623908946, "set_robot_commands": 0.05353235892760448, "deviation-center-line": 0.13114121213460145, "driven_lanedir_consec": 0.5450627289344152, "sim_compute_sim_state": 0.02300859414614164, "sim_compute_performance-ego": 0.03834956425886888, "sim_compute_robot_state-ego": 0.0402368032015287}, "ETHZ_autolab_technical_track-7-0": {"driven_any": 0.8035998912048764, "sim_physics": 0.06214954171861921, "survival_time": 2.799999999999998, "driven_lanedir": 0.4126113388371666, "sim_render-ego": 0.03616715754781451, "in-drivable-lane": 0.9999999999999972, "agent_compute-ego": 0.042298351015363424, "deviation-heading": 0.6465417997696941, "set_robot_commands": 0.054484320538384576, "deviation-center-line": 0.119844131874105, "driven_lanedir_consec": 0.4126113388371666, "sim_compute_sim_state": 0.023121280329568044, "sim_compute_performance-ego": 0.03927615284919739, "sim_compute_robot_state-ego": 0.041196508066994805}, "ETHZ_autolab_technical_track-8-0": {"driven_any": 1.082025040886041, "sim_physics": 0.10097110956564716, "survival_time": 4.3499999999999925, "driven_lanedir": 0.4507633352947824, "sim_render-ego": 0.05548786568915707, "in-drivable-lane": 2.1499999999999924, "agent_compute-ego": 0.060917873492186095, "deviation-heading": 0.6137519362826567, "set_robot_commands": 0.08320942144284303, "deviation-center-line": 0.11871775985231396, "driven_lanedir_consec": 0.4507633352947824, "sim_compute_sim_state": 0.03555542573161509, "sim_compute_performance-ego": 0.061913597172704234, "sim_compute_robot_state-ego": 0.06625576128904846}, "ETHZ_autolab_technical_track-9-0": {"driven_any": 1.6839250134630197, "sim_physics": 0.14686742695895108, "survival_time": 5.4999999999999885, "driven_lanedir": 0.9416535020294268, "sim_render-ego": 0.06865748058665883, "in-drivable-lane": 1.7999999999999936, "agent_compute-ego": 0.08102627450769598, "deviation-heading": 1.4563581054905994, "set_robot_commands": 0.108070293339816, "deviation-center-line": 0.2616199012603187, "driven_lanedir_consec": 0.9416535020294268, "sim_compute_sim_state": 0.04271366162733598, "sim_compute_performance-ego": 0.0824317455291748, "sim_compute_robot_state-ego": 0.09029148491946132}, "ETHZ_autolab_technical_track-10-0": {"driven_any": 0.2667775284624888, "sim_physics": 0.14281814297040304, "survival_time": 1.2000000000000004, "driven_lanedir": 0.25235480657068055, "sim_render-ego": 0.06885078549385071, "in-drivable-lane": 0, "agent_compute-ego": 0.07861332098642985, "deviation-heading": 0.2735028974766809, "set_robot_commands": 0.1072155733903249, "deviation-center-line": 0.10630271043038582, "driven_lanedir_consec": 0.25235480657068055, "sim_compute_sim_state": 0.046645681063334145, "sim_compute_performance-ego": 0.07552722096443176, "sim_compute_robot_state-ego": 0.08181244134902954}, "ETHZ_autolab_technical_track-11-0": {"driven_any": 1.0389325864387626, "sim_physics": 0.12133136043300875, "survival_time": 3.8499999999999943, "driven_lanedir": 0.4755729783153157, "sim_render-ego": 0.06469099242965896, "in-drivable-lane": 1.7499999999999938, "agent_compute-ego": 0.07373788449671362, "deviation-heading": 0.521699236138543, "set_robot_commands": 0.1031774328900622, "deviation-center-line": 0.10517150645857888, "driven_lanedir_consec": 0.4755729783153157, "sim_compute_sim_state": 0.04129406074424843, "sim_compute_performance-ego": 0.0725489684513637, "sim_compute_robot_state-ego": 0.077300805550117}, "ETHZ_autolab_technical_track-12-0": {"driven_any": 0.6835794874956865, "sim_physics": 0.11820222854614258, "survival_time": 2.499999999999999, "driven_lanedir": 0.6100305079584653, "sim_render-ego": 0.06765528678894044, "in-drivable-lane": 0.14999999999999947, "agent_compute-ego": 0.07008903980255127, "deviation-heading": 0.4739455376152246, "set_robot_commands": 0.0975852870941162, "deviation-center-line": 0.12143860235134882, "driven_lanedir_consec": 0.6100305079584653, "sim_compute_sim_state": 0.04008932590484619, "sim_compute_performance-ego": 0.07243114471435547, "sim_compute_robot_state-ego": 0.07954689025878907}, "ETHZ_autolab_technical_track-13-0": {"driven_any": 0.29517411990766207, "sim_physics": 0.1271915894288283, "survival_time": 1.3000000000000005, "driven_lanedir": 0.25251967754950355, "sim_render-ego": 0.06645137530106765, "in-drivable-lane": 0.05000000000000005, "agent_compute-ego": 0.07445968114412747, "deviation-heading": 0.466101326638835, "set_robot_commands": 0.1002655212695782, "deviation-center-line": 0.07143676193760398, "driven_lanedir_consec": 0.25251967754950355, "sim_compute_sim_state": 0.0428534929568951, "sim_compute_performance-ego": 0.07041814694037804, "sim_compute_robot_state-ego": 0.07791085426624005}, "ETHZ_autolab_technical_track-14-0": {"driven_any": 0.7309130538792373, "sim_physics": 0.1285004218419393, "survival_time": 2.6999999999999984, "driven_lanedir": 0.38087957155028906, "sim_render-ego": 0.07044598791334364, "in-drivable-lane": 0.9499999999999976, "agent_compute-ego": 0.07786598028960051, "deviation-heading": 0.5607794956477159, "set_robot_commands": 0.11132287979125977, "deviation-center-line": 0.12406277512673576, "driven_lanedir_consec": 0.38087957155028906, "sim_compute_sim_state": 0.043861450972380464, "sim_compute_performance-ego": 0.07565736770629883, "sim_compute_robot_state-ego": 0.08322817749447292}}
set_robot_commands_max0.11633018652598064
set_robot_commands_mean0.08441181991778227
set_robot_commands_median0.08320942144284303
set_robot_commands_min0.05353235892760448
sim_compute_performance-ego_max0.0824317455291748
sim_compute_performance-ego_mean0.06094445907833157
sim_compute_performance-ego_median0.061913597172704234
sim_compute_performance-ego_min0.03834956425886888
sim_compute_robot_state-ego_max0.092208202679952
sim_compute_robot_state-ego_mean0.06709525477861054
sim_compute_robot_state-ego_median0.07120410255763841
sim_compute_robot_state-ego_min0.0402368032015287
sim_compute_sim_state_max0.046645681063334145
sim_compute_sim_state_mean0.03516684971362423
sim_compute_sim_state_median0.03555542573161509
sim_compute_sim_state_min0.02300859414614164
sim_physics_max0.14686742695895108
sim_physics_mean0.1021561557567522
sim_physics_median0.10097110956564716
sim_physics_min0.05483752641922388
sim_render-ego_max0.07044598791334364
sim_render-ego_mean0.05463645919978165
sim_render-ego_median0.05548786568915707
sim_render-ego_min0.0353005268634894
simulation-passed1
survival_time_max5.4999999999999885
survival_time_mean2.7766666666666637
survival_time_min1.1000000000000003
227782775Bhairav Mehtachallenge-aido_LF-baseline-duckietownaido2-LFVI-sim-validationstep1-simulationerroryes11700:07:39
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
(hidden)
227742783RamiNaimchallenge-aido_LF-template-ros - Template solution using ROSaido2-LFV-sim-validationstep1-simulationerroryes11700:00:32
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
(hidden)
227672799RamiNaimchallenge-aido_LF-baseline-duckietownaido2-LFVI-sim-testingstep1-simulationfailedyes11700:01:50
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 174, in read_one
    nickname=self.nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 293, in read_until_over
    raise TimeoutError(msg) from None
TimeoutError: Timeout while reading output of node "agent".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "experiment_manager.py", line 297, in run_episode
    r: MsgReceived = agent.write_topic_and_expect('get_commands', expect='commands')
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 93, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 236, in read_one
    raise TimeoutError(msg) from e
TimeoutError: Timeout detected on /fifos/agent-out after 1 messages. Expected topic "commands".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
    yield cie
  File "experiment_manager.py", line 441, in <module>
    wrap(cie)
  File "experiment_manager.py", line 429, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 135, in main
    physics_dt=config.physics_dt)
  File "experiment_manager.py", line 301, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.
(hidden)
227162907Julian ZillyBaseline-IL-logs-tensorflowaido2-LFVI-sim-testingstep1-simulationsuccessyes11700:48:27(hidden)
driven_lanedir_consec_median0.4666277151948612
survival_time_median6.099999999999986
deviation-center-line_median0.33341532886591296
in-drivable-lane_median0


other stats
agent_compute-ego_max0.24081028329915016
agent_compute-ego_mean0.21500585768339991
agent_compute-ego_median0.2153776197329811
agent_compute-ego_min0.18366585671901703
deviation-center-line_max1.0680309819943516
deviation-center-line_mean0.3913121338092333
deviation-center-line_min0.16662188238079648
deviation-heading_max3.0037699632472425
deviation-heading_mean1.182427425260287
deviation-heading_median0.8527152034102187
deviation-heading_min0.3980684508158633
driven_any_max2.5534750247741376
driven_any_mean1.0516115757409483
driven_any_median1.0073534337246877
driven_any_min0.3609526397352217
driven_lanedir_consec_max2.3199836050434404
driven_lanedir_consec_mean0.768818678491447
driven_lanedir_consec_min0.3359040954329422
driven_lanedir_max2.320009231072208
driven_lanedir_mean0.7823190645837699
driven_lanedir_median0.6115511519355601
driven_lanedir_min0.3359040954329422
in-drivable-lane_max6.899999999999996
in-drivable-lane_mean1.2566666666666677
in-drivable-lane_min0
per-episodes
details{"udem1-0-0": {"driven_any": 1.3567594419471278, "sim_physics": 0.16086294768769063, "survival_time": 8.09999999999998, "driven_lanedir": 1.350113977643261, "sim_render-ego": 0.056208638497340827, "in-drivable-lane": 0, "agent_compute-ego": 0.20737828737423744, "deviation-heading": 0.7854059946495453, "set_robot_commands": 0.08446863845542625, "deviation-center-line": 0.5135734996132552, "driven_lanedir_consec": 1.349704181184413, "sim_compute_sim_state": 0.03384544378445472, "sim_compute_performance-ego": 0.06262452661255259, "sim_compute_robot_state-ego": 0.06392931496655499, "sim_compute_robot_state-npc0": 0.06024970243006577, "sim_compute_robot_state-npc1": 0.0603605611824695, "sim_compute_robot_state-npc2": 0.059421405380154835, "sim_compute_robot_state-npc3": 0.05943729406521644}, "udem1-1-0": {"driven_any": 0.4483038438343857, "sim_physics": 0.1944651521485427, "survival_time": 2.8999999999999977, "driven_lanedir": 0.4226843204952568, "sim_render-ego": 0.06312317272712445, "in-drivable-lane": 0, "agent_compute-ego": 0.24081028329915016, "deviation-heading": 0.9833905711787422, "set_robot_commands": 0.09462197895707757, "deviation-center-line": 0.20838323969703185, "driven_lanedir_consec": 0.4226843204952568, "sim_compute_sim_state": 0.04031549239980763, "sim_compute_performance-ego": 0.07303933028517098, "sim_compute_robot_state-ego": 0.07257994701122415, "sim_compute_robot_state-npc0": 0.07271349019017713, "sim_compute_robot_state-npc1": 0.06892230181858458, "sim_compute_robot_state-npc2": 0.06693886477371742, "sim_compute_robot_state-npc3": 0.06809870127973885}, "udem1-2-0": {"driven_any": 2.169128413136148, "sim_physics": 0.1784298775242824, "survival_time": 12.750000000000046, "driven_lanedir": 1.7728095571844806, "sim_render-ego": 0.058147586560716814, "in-drivable-lane": 2.2000000000000313, "agent_compute-ego": 0.21870157952402153, "deviation-heading": 0.8644122890492316, "set_robot_commands": 0.086009666966457, "deviation-center-line": 0.6336040432427312, "driven_lanedir_consec": 1.7727843554142828, "sim_compute_sim_state": 0.03547094475989248, "sim_compute_performance-ego": 0.06281317916570925, "sim_compute_robot_state-ego": 0.06827142752853094, "sim_compute_robot_state-npc0": 0.06443559235217525, "sim_compute_robot_state-npc1": 0.06371428265291101, "sim_compute_robot_state-npc2": 0.06348480523801317, "sim_compute_robot_state-npc3": 0.0618650380302878}, "udem1-3-0": {"driven_any": 2.5534750247741376, "sim_physics": 0.18150043567021687, "survival_time": 14.950000000000076, "driven_lanedir": 2.320009231072208, "sim_render-ego": 0.05951105117797851, "in-drivable-lane": 1.3000000000000185, "agent_compute-ego": 0.2267906594276428, "deviation-heading": 0.8527152034102187, "set_robot_commands": 0.09161422491073608, "deviation-center-line": 1.0680309819943516, "driven_lanedir_consec": 2.3199836050434404, "sim_compute_sim_state": 0.03810274600982666, "sim_compute_performance-ego": 0.06795958598454793, "sim_compute_robot_state-ego": 0.07215615272521973, "sim_compute_robot_state-npc0": 0.06867355902989705, "sim_compute_robot_state-npc1": 0.06742413759231568, "sim_compute_robot_state-npc2": 0.06603851159413655, "sim_compute_robot_state-npc3": 0.06712712208429972}, "udem1-4-0": {"driven_any": 0.36968771707772213, "sim_physics": 0.17604111651985013, "survival_time": 2.4499999999999993, "driven_lanedir": 0.35661432194998266, "sim_render-ego": 0.058815776085367005, "in-drivable-lane": 0, "agent_compute-ego": 0.2147966161066172, "deviation-heading": 0.6524331044587797, "set_robot_commands": 0.0863172959308235, "deviation-center-line": 0.17497068978210834, "driven_lanedir_consec": 0.35661432194998266, "sim_compute_sim_state": 0.03720334597996303, "sim_compute_performance-ego": 0.06364175738120566, "sim_compute_robot_state-ego": 0.07049610663433464, "sim_compute_robot_state-npc0": 0.06291585552449129, "sim_compute_robot_state-npc1": 0.06324453743136658, "sim_compute_robot_state-npc2": 0.06394011633736747, "sim_compute_robot_state-npc3": 0.06501986055958028}, "udem1-5-0": {"driven_any": 1.0422940344693128, "sim_physics": 0.1616687850346641, "survival_time": 6.299999999999986, "driven_lanedir": 0.3977931184447061, "sim_render-ego": 0.05222206645541721, "in-drivable-lane": 2.94999999999999, "agent_compute-ego": 0.20187060416690888, "deviation-heading": 2.0606697069733593, "set_robot_commands": 0.08063065816485693, "deviation-center-line": 0.33341532886591296, "driven_lanedir_consec": 0.3977931184447061, "sim_compute_sim_state": 0.03366036642165411, "sim_compute_performance-ego": 0.057754720960344584, "sim_compute_robot_state-ego": 0.060668583900209454, "sim_compute_robot_state-npc0": 0.058301064703199595, "sim_compute_robot_state-npc1": 0.059340352103823706, "sim_compute_robot_state-npc2": 0.05916883642711337, "sim_compute_robot_state-npc3": 0.058577155310010155}, "udem1-6-0": {"driven_any": 0.806444978131922, "sim_physics": 0.1632484474567452, "survival_time": 4.94999999999999, "driven_lanedir": 0.8035043721169954, "sim_render-ego": 0.05046743575972741, "in-drivable-lane": 0, "agent_compute-ego": 0.18410092170792397, "deviation-heading": 0.4193380514366821, "set_robot_commands": 0.0706047241133873, "deviation-center-line": 0.4521438668866459, "driven_lanedir_consec": 0.8035043721169954, "sim_compute_sim_state": 0.031309816572401256, "sim_compute_performance-ego": 0.052710058713200114, "sim_compute_robot_state-ego": 0.05662678949760668, "sim_compute_robot_state-npc0": 0.05571620151250049, "sim_compute_robot_state-npc1": 0.05392583692916716, "sim_compute_robot_state-npc2": 0.053246657053629555, "sim_compute_robot_state-npc3": 0.05397228279499093}, "udem1-7-0": {"driven_any": 1.0073534337246877, "sim_physics": 0.1753149736123007, "survival_time": 6.099999999999986, "driven_lanedir": 0.8835141035321403, "sim_render-ego": 0.053683177369539856, "in-drivable-lane": 0, "agent_compute-ego": 0.2090711359117852, "deviation-heading": 2.247171448785188, "set_robot_commands": 0.08345583032389156, "deviation-center-line": 0.37984219953095794, "driven_lanedir_consec": 0.8699571327515463, "sim_compute_sim_state": 0.036032934657862926, "sim_compute_performance-ego": 0.061541078520602865, "sim_compute_robot_state-ego": 0.06372736711971096, "sim_compute_robot_state-npc0": 0.06175728313258437, "sim_compute_robot_state-npc1": 0.06167042841676806, "sim_compute_robot_state-npc2": 0.06099127941444272, "sim_compute_robot_state-npc3": 0.06194405477555072}, "udem1-8-0": {"driven_any": 1.0248237349996272, "sim_physics": 0.16847854660403344, "survival_time": 6.199999999999986, "driven_lanedir": 0.6115511519355601, "sim_render-ego": 0.05821573734283447, "in-drivable-lane": 1.7499999999999938, "agent_compute-ego": 0.22646634617159445, "deviation-heading": 2.0843979982694227, "set_robot_commands": 0.08865055537992908, "deviation-center-line": 0.422810088980332, "driven_lanedir_consec": 0.6115511519355601, "sim_compute_sim_state": 0.03695705436891125, "sim_compute_performance-ego": 0.06465587885149064, "sim_compute_robot_state-ego": 0.07038880548169536, "sim_compute_robot_state-npc0": 0.0662179377771193, "sim_compute_robot_state-npc1": 0.06768460619834162, "sim_compute_robot_state-npc2": 0.066291747554656, "sim_compute_robot_state-npc3": 0.06592234680729528}, "udem1-9-0": {"driven_any": 0.4483038436627429, "sim_physics": 0.21281704820435624, "survival_time": 2.8999999999999977, "driven_lanedir": 0.4319199677822532, "sim_render-ego": 0.059479051622851144, "in-drivable-lane": 0, "agent_compute-ego": 0.2302473947919648, "deviation-heading": 0.7843852312230172, "set_robot_commands": 0.09298109186106716, "deviation-center-line": 0.19267159047164883, "driven_lanedir_consec": 0.4319199677822532, "sim_compute_sim_state": 0.03792332780772242, "sim_compute_performance-ego": 0.06692788107641812, "sim_compute_robot_state-ego": 0.07169935621064284, "sim_compute_robot_state-npc0": 0.0633230209350586, "sim_compute_robot_state-npc1": 0.06601200843679494, "sim_compute_robot_state-npc2": 0.06796681469884412, "sim_compute_robot_state-npc3": 0.06888561824272418}, "udem1-10-0": {"driven_any": 0.3609526397352217, "sim_physics": 0.13652426501115164, "survival_time": 2.3999999999999995, "driven_lanedir": 0.3414443288920854, "sim_render-ego": 0.05012953778107961, "in-drivable-lane": 0, "agent_compute-ego": 0.18366585671901703, "deviation-heading": 0.7915362159748539, "set_robot_commands": 0.07276544471581776, "deviation-center-line": 0.16662188238079648, "driven_lanedir_consec": 0.3414443288920854, "sim_compute_sim_state": 0.02814263602097829, "sim_compute_performance-ego": 0.05132330457369486, "sim_compute_robot_state-ego": 0.05397580067316691, "sim_compute_robot_state-npc0": 0.05324078599611918, "sim_compute_robot_state-npc1": 0.0516338050365448, "sim_compute_robot_state-npc2": 0.05148957669734955, "sim_compute_robot_state-npc3": 0.05064860979715983}, "udem1-11-0": {"driven_any": 0.4046281574961264, "sim_physics": 0.17425620780800874, "survival_time": 2.6499999999999986, "driven_lanedir": 0.40003643479537576, "sim_render-ego": 0.059543209255866286, "in-drivable-lane": 0, "agent_compute-ego": 0.2275342851314905, "deviation-heading": 0.3980684508158633, "set_robot_commands": 0.09360101537884406, "deviation-center-line": 0.2708859521467339, "driven_lanedir_consec": 0.40003643479537576, "sim_compute_sim_state": 0.04588238698131633, "sim_compute_performance-ego": 0.06477773864314242, "sim_compute_robot_state-ego": 0.07112785105435353, "sim_compute_robot_state-npc0": 0.06320575048338692, "sim_compute_robot_state-npc1": 0.06361128249258366, "sim_compute_robot_state-npc2": 0.06380772140790832, "sim_compute_robot_state-npc3": 0.06412427830246259}, "udem1-12-0": {"driven_any": 1.5489327489523863, "sim_physics": 0.18279394636983456, "survival_time": 9.199999999999996, "driven_lanedir": 0.3359040954329422, "sim_render-ego": 0.05661508700122004, "in-drivable-lane": 6.899999999999996, "agent_compute-ego": 0.2153776197329811, "deviation-heading": 0.4854799489598317, "set_robot_commands": 0.08781885582467784, "deviation-center-line": 0.2750717398716856, "driven_lanedir_consec": 0.3359040954329422, "sim_compute_sim_state": 0.03592445539391559, "sim_compute_performance-ego": 0.06084367373715276, "sim_compute_robot_state-ego": 0.06565342778744905, "sim_compute_robot_state-npc0": 0.06527293894601904, "sim_compute_robot_state-npc1": 0.06513830501100291, "sim_compute_robot_state-npc2": 0.06659146236336749, "sim_compute_robot_state-npc3": 0.06259006391400876}, "udem1-13-0": {"driven_any": 0.9898831334165998, "sim_physics": 0.1600898047288259, "survival_time": 5.999999999999987, "driven_lanedir": 0.6517710759380049, "sim_render-ego": 0.05402262409528096, "in-drivable-lane": 1.4499999999999948, "agent_compute-ego": 0.21399815479914347, "deviation-heading": 1.32323720047233, "set_robot_commands": 0.08393151760101318, "deviation-center-line": 0.3285019922645743, "driven_lanedir_consec": 0.6517710759380049, "sim_compute_sim_state": 0.03379512031873067, "sim_compute_performance-ego": 0.06050180594126384, "sim_compute_robot_state-ego": 0.06370269854863485, "sim_compute_robot_state-npc0": 0.06445305148760477, "sim_compute_robot_state-npc1": 0.061798487106959024, "sim_compute_robot_state-npc2": 0.0630123237768809, "sim_compute_robot_state-npc3": 0.058296746015548705}, "udem1-14-0": {"driven_any": 1.243202490756078, "sim_physics": 0.19875283369281949, "survival_time": 7.449999999999981, "driven_lanedir": 0.6551159115412959, "sim_render-ego": 0.059761714615277794, "in-drivable-lane": 2.299999999999992, "agent_compute-ego": 0.22427812038652048, "deviation-heading": 3.0037699632472425, "set_robot_commands": 0.08876893344341509, "deviation-center-line": 0.44915491140973257, "driven_lanedir_consec": 0.4666277151948612, "sim_compute_sim_state": 0.0367012071929522, "sim_compute_performance-ego": 0.0669086379492843, "sim_compute_robot_state-ego": 0.07077355192811698, "sim_compute_robot_state-npc0": 0.06753436190969991, "sim_compute_robot_state-npc1": 0.06654394072974289, "sim_compute_robot_state-npc2": 0.06632584853460324, "sim_compute_robot_state-npc3": 0.06508081871391143}}
set_robot_commands_max0.09462197895707757
set_robot_commands_mean0.08574936213516135
set_robot_commands_median0.0863172959308235
set_robot_commands_min0.0706047241133873
sim_compute_performance-ego_max0.07303933028517098
sim_compute_performance-ego_mean0.06253487722638539
sim_compute_performance-ego_median0.06281317916570925
sim_compute_performance-ego_min0.05132330457369486
sim_compute_robot_state-ego_max0.07257994701122415
sim_compute_robot_state-ego_mean0.06638514540449673
sim_compute_robot_state-ego_median0.06827142752853094
sim_compute_robot_state-ego_min0.05397580067316691
sim_compute_robot_state-npc0_max0.07271349019017713
sim_compute_robot_state-npc0_mean0.06320070642733991
sim_compute_robot_state-npc0_median0.0633230209350586
sim_compute_robot_state-npc0_min0.05324078599611918
sim_compute_robot_state-npc1_max0.06892230181858458
sim_compute_robot_state-npc1_mean0.06273499154262509
sim_compute_robot_state-npc1_median0.06361128249258366
sim_compute_robot_state-npc1_min0.0516338050365448
sim_compute_robot_state-npc2_max0.06796681469884412
sim_compute_robot_state-npc2_mean0.06258106475014566
sim_compute_robot_state-npc2_median0.06380772140790832
sim_compute_robot_state-npc2_min0.05148957669734955
sim_compute_robot_state-npc3_max0.06888561824272418
sim_compute_robot_state-npc3_mean0.06210599937951904
sim_compute_robot_state-npc3_median0.06259006391400876
sim_compute_robot_state-npc3_min0.05064860979715983
sim_compute_sim_state_max0.04588238698131633
sim_compute_sim_state_mean0.03608448524469265
sim_compute_sim_state_median0.036032934657862926
sim_compute_sim_state_min0.02814263602097829
sim_physics_max0.21281704820435624
sim_physics_mean0.1750162925382215
sim_physics_median0.1753149736123007
sim_physics_min0.13652426501115164
sim_render-ego_max0.06312317272712445
sim_render-ego_mean0.05666305775650816
sim_render-ego_median0.058147586560716814
sim_render-ego_min0.05012953778107961
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean6.353333333333333
survival_time_min2.3999999999999995
226902964Julian ZillyBaseline-IL-logs-tensorflowaido2-LFVI-sim-testingstep1-simulationerroryes11700:30:04
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
(hidden)
226792990Bnaichchallenge-aido_LF-template-tensorflowaido2-LF-sim-testingstep1-simulationsuccessyes11700:19:55(hidden)
driven_lanedir_consec_median0.4674105668566355
survival_time_median2.2
deviation-center-line_median0.14260864304413795
in-drivable-lane_median0.05000000000000005


other stats
agent_compute-ego_max0.16078927176339286
agent_compute-ego_mean0.14282817072772858
agent_compute-ego_median0.14508687727379077
agent_compute-ego_min0.12342469692230223
deviation-center-line_max0.24855260007623764
deviation-center-line_mean0.1536149482643388
deviation-center-line_min0.054939994894037315
deviation-heading_max1.8641620598518744
deviation-heading_mean0.8952012229712518
deviation-heading_median0.7895172974159795
deviation-heading_min0.16887123225343423
driven_any_max1.115020174350162
driven_any_mean0.6913356929021803
driven_any_median0.5698572536338683
driven_any_min0.2242253658467636
driven_lanedir_consec_max1.0109122045607752
driven_lanedir_consec_mean0.530901817664039
driven_lanedir_consec_min0.2043437063123985
driven_lanedir_max1.0109122045607752
driven_lanedir_mean0.5357764002052454
driven_lanedir_median0.4674105668566355
driven_lanedir_min0.2043437063123985
in-drivable-lane_max0.8499999999999988
in-drivable-lane_mean0.21333333333333268
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.5698572536338683, "sim_physics": 0.1197052923115817, "survival_time": 2.2, "driven_lanedir": 0.4674105668566355, "sim_render-ego": 0.06454132361845537, "in-drivable-lane": 0.04999999999999982, "agent_compute-ego": 0.15045611424879593, "deviation-heading": 0.986047559590748, "set_robot_commands": 0.09872914986176924, "deviation-center-line": 0.15850046398007744, "driven_lanedir_consec": 0.4674105668566355, "sim_compute_sim_state": 0.04202381047335538, "sim_compute_performance-ego": 0.0703295577656139, "sim_compute_robot_state-ego": 0.07401771437038075}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.0985958356678462, "sim_physics": 0.11414403091242284, "survival_time": 4.049999999999994, "driven_lanedir": 0.6188261785631852, "sim_render-ego": 0.058628356015240704, "in-drivable-lane": 0.849999999999997, "agent_compute-ego": 0.14910571957811897, "deviation-heading": 1.8641620598518744, "set_robot_commands": 0.09392536128008808, "deviation-center-line": 0.23887642097618683, "driven_lanedir_consec": 0.6188261785631852, "sim_compute_sim_state": 0.03865203150996455, "sim_compute_performance-ego": 0.06899055139518079, "sim_compute_robot_state-ego": 0.07644848764678579}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.0141832231616486, "sim_physics": 0.09869634571360118, "survival_time": 3.349999999999996, "driven_lanedir": 0.6240440080843483, "sim_render-ego": 0.05711614551828868, "in-drivable-lane": 0.8499999999999988, "agent_compute-ego": 0.13779151973439685, "deviation-heading": 1.2465664826829024, "set_robot_commands": 0.0864762334681269, "deviation-center-line": 0.2026247100413827, "driven_lanedir_consec": 0.6240440080843483, "sim_compute_sim_state": 0.03696886817021156, "sim_compute_performance-ego": 0.05955210728431815, "sim_compute_robot_state-ego": 0.06565097908475506}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.4730904817176167, "sim_physics": 0.13165937151227677, "survival_time": 1.7500000000000009, "driven_lanedir": 0.4262039888411144, "sim_render-ego": 0.06161456789289202, "in-drivable-lane": 0.05000000000000005, "agent_compute-ego": 0.16078927176339286, "deviation-heading": 0.5649772595087351, "set_robot_commands": 0.0974483013153076, "deviation-center-line": 0.10057119795270568, "driven_lanedir_consec": 0.4262039888411144, "sim_compute_sim_state": 0.03989124979291644, "sim_compute_performance-ego": 0.07575529643467495, "sim_compute_robot_state-ego": 0.08035784448896136}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.0793444208920262, "sim_physics": 0.1068226026766228, "survival_time": 3.2999999999999963, "driven_lanedir": 0.7060654197835117, "sim_render-ego": 0.06008834911115242, "in-drivable-lane": 0.14999999999999947, "agent_compute-ego": 0.14508687727379077, "deviation-heading": 1.859862636690693, "set_robot_commands": 0.08988872802618778, "deviation-center-line": 0.20762517952512652, "driven_lanedir_consec": 0.6329466816654139, "sim_compute_sim_state": 0.03948089931950425, "sim_compute_performance-ego": 0.06781721476352576, "sim_compute_robot_state-ego": 0.0721688089948712}, "ETHZ_autolab_technical_track-5-0": {"driven_any": 1.0854626323213636, "sim_physics": 0.11847137769063314, "survival_time": 3.7499999999999942, "driven_lanedir": 0.8941456058271351, "sim_render-ego": 0.06262227058410645, "in-drivable-lane": 0.2499999999999991, "agent_compute-ego": 0.15615893999735514, "deviation-heading": 1.5242487591729903, "set_robot_commands": 0.10125529289245604, "deviation-center-line": 0.24855260007623764, "driven_lanedir_consec": 0.8941456058271351, "sim_compute_sim_state": 0.03989203770955404, "sim_compute_performance-ego": 0.07273376146952311, "sim_compute_robot_state-ego": 0.0792226791381836}, "ETHZ_autolab_technical_track-6-0": {"driven_any": 0.4975230586545693, "sim_physics": 0.11407703619736892, "survival_time": 1.950000000000001, "driven_lanedir": 0.4623215168562016, "sim_render-ego": 0.05972836567805363, "in-drivable-lane": 0, "agent_compute-ego": 0.14738033979366988, "deviation-heading": 0.8083924602797856, "set_robot_commands": 0.09181320361602, "deviation-center-line": 0.18107931077120223, "driven_lanedir_consec": 0.4623215168562016, "sim_compute_sim_state": 0.03899241105104104, "sim_compute_performance-ego": 0.06626442762521598, "sim_compute_robot_state-ego": 0.06759114754505646}, "ETHZ_autolab_technical_track-7-0": {"driven_any": 0.7639702521227303, "sim_physics": 0.11910515643180684, "survival_time": 2.3499999999999996, "driven_lanedir": 0.6388081427034005, "sim_render-ego": 0.05981422485189235, "in-drivable-lane": 0.14999999999999947, "agent_compute-ego": 0.14519372899481592, "deviation-heading": 0.7857308395630479, "set_robot_commands": 0.0927539531220781, "deviation-center-line": 0.13384131025090726, "driven_lanedir_consec": 0.6388081427034005, "sim_compute_sim_state": 0.039263532516804145, "sim_compute_performance-ego": 0.07147267524232255, "sim_compute_robot_state-ego": 0.07540180835318058}, "ETHZ_autolab_technical_track-8-0": {"driven_any": 0.2727753478149496, "sim_physics": 0.11133464574813842, "survival_time": 1.0000000000000002, "driven_lanedir": 0.245270103761297, "sim_render-ego": 0.05800687074661255, "in-drivable-lane": 0, "agent_compute-ego": 0.13222719430923463, "deviation-heading": 0.3538261212195276, "set_robot_commands": 0.09118638038635254, "deviation-center-line": 0.054939994894037315, "driven_lanedir_consec": 0.245270103761297, "sim_compute_sim_state": 0.03701982498168945, "sim_compute_performance-ego": 0.06322704553604126, "sim_compute_robot_state-ego": 0.06554750204086304}, "ETHZ_autolab_technical_track-9-0": {"driven_any": 0.2242253658467636, "sim_physics": 0.10692928234736124, "survival_time": 1.2000000000000004, "driven_lanedir": 0.2043437063123985, "sim_render-ego": 0.056670536597569786, "in-drivable-lane": 0, "agent_compute-ego": 0.13902821143468222, "deviation-heading": 0.392570122212106, "set_robot_commands": 0.08662878473599751, "deviation-center-line": 0.10303347017776196, "driven_lanedir_consec": 0.2043437063123985, "sim_compute_sim_state": 0.03550867239634196, "sim_compute_performance-ego": 0.06239059567451477, "sim_compute_robot_state-ego": 0.066602756579717}, "ETHZ_autolab_technical_track-10-0": {"driven_any": 0.3890457352602684, "sim_physics": 0.11020803451538086, "survival_time": 1.3500000000000003, "driven_lanedir": 0.370010549565549, "sim_render-ego": 0.06152955691019694, "in-drivable-lane": 0, "agent_compute-ego": 0.13469083220870406, "deviation-heading": 0.30955396972767846, "set_robot_commands": 0.08793067049097132, "deviation-center-line": 0.11479870198382952, "driven_lanedir_consec": 0.370010549565549, "sim_compute_sim_state": 0.03769452483565719, "sim_compute_performance-ego": 0.06674381538673684, "sim_compute_robot_state-ego": 0.07138112739280418}, "ETHZ_autolab_technical_track-11-0": {"driven_any": 0.4136641462617409, "sim_physics": 0.10320230325063068, "survival_time": 1.5000000000000009, "driven_lanedir": 0.3848177438390939, "sim_render-ego": 0.057191356023152666, "in-drivable-lane": 0.05000000000000005, "agent_compute-ego": 0.13151512145996094, "deviation-heading": 0.3345732011189008, "set_robot_commands": 0.0860421101252238, "deviation-center-line": 0.1107455533021294, "driven_lanedir_consec": 0.3848177438390939, "sim_compute_sim_state": 0.03575569788614909, "sim_compute_performance-ego": 0.06546770731608073, "sim_compute_robot_state-ego": 0.06376083691914876}, "ETHZ_autolab_technical_track-12-0": {"driven_any": 1.115020174350162, "sim_physics": 0.10040699067662974, "survival_time": 3.049999999999997, "driven_lanedir": 1.0109122045607752, "sim_render-ego": 0.05651704991450075, "in-drivable-lane": 0.09999999999999964, "agent_compute-ego": 0.13690479857022644, "deviation-heading": 0.7895172974159795, "set_robot_commands": 0.0893147421664879, "deviation-center-line": 0.14260864304413795, "driven_lanedir_consec": 1.0109122045607752, "sim_compute_sim_state": 0.03825966256563781, "sim_compute_performance-ego": 0.06801813938578621, "sim_compute_robot_state-ego": 0.06942095131170554}, "ETHZ_autolab_technical_track-13-0": {"driven_any": 1.1097736052757812, "sim_physics": 0.10951447813478236, "survival_time": 3.649999999999995, "driven_lanedir": 0.7290041333729471, "sim_render-ego": 0.06152659246366318, "in-drivable-lane": 0.6999999999999975, "agent_compute-ego": 0.15266919462648157, "deviation-heading": 1.4391183432803738, "set_robot_commands": 0.09493612263300648, "deviation-center-line": 0.20987123968971763, "driven_lanedir_consec": 0.7290041333729471, "sim_compute_sim_state": 0.037008847275825395, "sim_compute_performance-ego": 0.06688708475191299, "sim_compute_robot_state-ego": 0.07470039472188035}, "ETHZ_autolab_technical_track-14-0": {"driven_any": 0.2635038605513683, "sim_physics": 0.10474686622619628, "survival_time": 1.0000000000000002, "driven_lanedir": 0.25446213415108776, "sim_render-ego": 0.052589905261993405, "in-drivable-lane": 0, "agent_compute-ego": 0.12342469692230223, "deviation-heading": 0.16887123225343423, "set_robot_commands": 0.07996058464050293, "deviation-center-line": 0.0965554272996418, "driven_lanedir_consec": 0.25446213415108776, "sim_compute_sim_state": 0.03388156890869141, "sim_compute_performance-ego": 0.061900758743286134, "sim_compute_robot_state-ego": 0.0649411916732788}}
set_robot_commands_max0.10125529289245604
set_robot_commands_mean0.09121930791737176
set_robot_commands_median0.09118638038635254
set_robot_commands_min0.07996058464050293
sim_compute_performance-ego_max0.07575529643467495
sim_compute_performance-ego_mean0.06717004925164893
sim_compute_performance-ego_median0.06688708475191299
sim_compute_performance-ego_min0.05955210728431815
sim_compute_robot_state-ego_max0.08035784448896136
sim_compute_robot_state-ego_mean0.07114761535077149
sim_compute_robot_state-ego_median0.07138112739280418
sim_compute_robot_state-ego_min0.06376083691914876
sim_compute_sim_state_max0.04202381047335538
sim_compute_sim_state_mean0.03801957595955625
sim_compute_sim_state_median0.03825966256563781
sim_compute_sim_state_min0.03388156890869141
sim_physics_max0.13165937151227677
sim_physics_mean0.1112682542896956
sim_physics_median0.11020803451538086
sim_physics_min0.09869634571360118
sim_render-ego_max0.06454132361845537
sim_render-ego_mean0.05921236474585139
sim_render-ego_median0.05972836567805363
sim_render-ego_min0.052589905261993405
simulation-passed1
survival_time_max4.049999999999994
survival_time_mean2.3633333333333315
survival_time_min1.0000000000000002
226692998Manfred Diazchallenge-aido_LF-template-tensorflowaido2-LFV-sim-testingstep1-simulationerroryes11700:00:35
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
(hidden)
226613010Manfred Diazchallenge-aido_LF-template-pytorchaido2-LFV-sim-testingstep1-simulationerroryes11700:00:34
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
(hidden)
226573018Manfred Diazchallenge-aido_LF-template-pytorchaido2-LF-sim-testingstep1-simulationerroryes11700:00:43
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
(hidden)
226503035Manfred Diazchallenge-aido_LF-template-pytorchaido2-LFV-sim-validationstep1-simulationerroryes11700:01:28
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
(hidden)
226453043Manfred Diazchallenge-aido_LF-template-tensorflowaido2-LF-sim-validationstep1-simulationerroryes11700:02:05
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
(hidden)
226033116almasipBaseline solution using reinforcement learningaido2-LF-sim-testingstep1-simulationerroryes11700:41:00
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
(hidden)
225903128RamiNaimmodified configsaido2-LF-sim-validationstep1-simulationsuccessyes11700:18:52(hidden)
driven_lanedir_consec_median1.788863100122598
survival_time_median11.55000000000003
deviation-center-line_median0.883874737421354
in-drivable-lane_median0


other stats
agent_compute-ego_max0.13429467192975988
agent_compute-ego_mean0.12628459943923823
agent_compute-ego_median0.12749469995498658
agent_compute-ego_min0.11807761589686076
deviation-center-line_max1.0946223724521775
deviation-center-line_mean0.6953784558293481
deviation-center-line_min0.17191299395167942
deviation-heading_max2.628846142364572
deviation-heading_mean1.7573813005909933
deviation-heading_median1.7199613100686606
deviation-heading_min0.8065682073729439
driven_any_max2.757705617427992
driven_any_mean1.833266693824096
driven_any_median2.1162018288910027
driven_any_min0.38982449960220633
driven_lanedir_consec_max2.683081207471093
driven_lanedir_consec_mean1.6709691393545196
driven_lanedir_consec_min0.3666403320209208
driven_lanedir_max2.683081207471093
driven_lanedir_mean1.6709691393545196
driven_lanedir_median1.788863100122598
driven_lanedir_min0.3666403320209208
in-drivable-lane_max1.4500000000000064
in-drivable-lane_mean0.5800000000000003
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.1449661689503934, "sim_physics": 0.10924721503442572, "survival_time": 6.449999999999985, "driven_lanedir": 1.108459393560946, "sim_render-ego": 0.061804226202558175, "in-drivable-lane": 0, "agent_compute-ego": 0.13127065813818642, "deviation-heading": 1.3107865801649998, "set_robot_commands": 0.0963860463726428, "deviation-center-line": 0.28244243279023584, "driven_lanedir_consec": 1.108459393560946, "sim_compute_sim_state": 0.037991956222889034, "sim_compute_performance-ego": 0.06721262044684831, "sim_compute_robot_state-ego": 0.07070313313210658}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 2.757705617427992, "sim_physics": 0.12120811382929483, "survival_time": 14.950000000000076, "driven_lanedir": 2.40780166359704, "sim_render-ego": 0.06306131601333619, "in-drivable-lane": 1.4499999999999948, "agent_compute-ego": 0.12028535127639772, "deviation-heading": 2.3207442629837907, "set_robot_commands": 0.10234675248463948, "deviation-center-line": 1.0946223724521775, "driven_lanedir_consec": 2.40780166359704, "sim_compute_sim_state": 0.04140539646148682, "sim_compute_performance-ego": 0.07082133928934733, "sim_compute_robot_state-ego": 0.0777511747678121}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 2.1162018288910027, "sim_physics": 0.11785315331958587, "survival_time": 11.55000000000003, "driven_lanedir": 1.788863100122598, "sim_render-ego": 0.06783663246022674, "in-drivable-lane": 1.4500000000000064, "agent_compute-ego": 0.13429467192975988, "deviation-heading": 1.7199613100686606, "set_robot_commands": 0.1019938477190026, "deviation-center-line": 0.883874737421354, "driven_lanedir_consec": 1.788863100122598, "sim_compute_sim_state": 0.04184405112163329, "sim_compute_performance-ego": 0.0723004826219567, "sim_compute_robot_state-ego": 0.08085418263555089}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.38982449960220633, "sim_physics": 0.11441489557425182, "survival_time": 2.3999999999999995, "driven_lanedir": 0.3666403320209208, "sim_render-ego": 0.061984499295552574, "in-drivable-lane": 0, "agent_compute-ego": 0.11807761589686076, "deviation-heading": 0.8065682073729439, "set_robot_commands": 0.09455598890781404, "deviation-center-line": 0.17191299395167942, "driven_lanedir_consec": 0.3666403320209208, "sim_compute_sim_state": 0.03933866818745931, "sim_compute_performance-ego": 0.07082806527614594, "sim_compute_robot_state-ego": 0.07123340666294098}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 2.7576353542488854, "sim_physics": 0.11172621170679728, "survival_time": 14.950000000000076, "driven_lanedir": 2.683081207471093, "sim_render-ego": 0.06116952021916707, "in-drivable-lane": 0, "agent_compute-ego": 0.12749469995498658, "deviation-heading": 2.628846142364572, "set_robot_commands": 0.09367799282073974, "deviation-center-line": 1.0440397425312935, "driven_lanedir_consec": 2.683081207471093, "sim_compute_sim_state": 0.03920460383097331, "sim_compute_performance-ego": 0.06848024686177571, "sim_compute_robot_state-ego": 0.07245434681574503}}
set_robot_commands_max0.10234675248463948
set_robot_commands_mean0.09779212566096772
set_robot_commands_median0.0963860463726428
set_robot_commands_min0.09367799282073974
sim_compute_performance-ego_max0.0723004826219567
sim_compute_performance-ego_mean0.0699285508992148
sim_compute_performance-ego_median0.07082133928934733
sim_compute_performance-ego_min0.06721262044684831
sim_compute_robot_state-ego_max0.08085418263555089
sim_compute_robot_state-ego_mean0.07459924880283111
sim_compute_robot_state-ego_median0.07245434681574503
sim_compute_robot_state-ego_min0.07070313313210658
sim_compute_sim_state_max0.04184405112163329
sim_compute_sim_state_mean0.03995693516488835
sim_compute_sim_state_median0.03933866818745931
sim_compute_sim_state_min0.037991956222889034
sim_physics_max0.12120811382929483
sim_physics_mean0.1148899178928711
sim_physics_median0.11441489557425182
sim_physics_min0.10924721503442572
sim_render-ego_max0.06783663246022674
sim_render-ego_mean0.06317123883816814
sim_render-ego_median0.061984499295552574
sim_render-ego_min0.06116952021916707
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean10.060000000000034
survival_time_min2.3999999999999995
225543542almasipMy solution using reinforcement learningaido2-LFV-sim-testingstep1-simulationerroryes11700:28:46
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
(hidden)
225373200JBRRussiaNN Solutionaido2-LF-sim-validationstep1-simulationsuccessyes11700:15:40(hidden)
driven_lanedir_consec_median1.2741917108025818
survival_time_median6.149999999999986
deviation-center-line_median0.5255953182189327
in-drivable-lane_median0.29999999999999893


other stats
agent_compute-ego_max0.11920613638112244
agent_compute-ego_mean0.10321787400202008
agent_compute-ego_median0.09974804520606996
agent_compute-ego_min0.09305051883061728
deviation-center-line_max1.3966197192599437
deviation-center-line_mean0.6600151295437044
deviation-center-line_min0.3850883390670986
deviation-heading_max2.317493657298202
deviation-heading_mean1.2943668649358675
deviation-heading_median1.306245165415645
deviation-heading_min0.3556489394582953
driven_any_max3.4726673490497113
driven_any_mean1.6860849178575343
driven_any_median1.37052851133553
driven_any_min0.7641285374625653
driven_lanedir_consec_max3.3295714704706763
driven_lanedir_consec_mean1.542493658186574
driven_lanedir_consec_min0.7600686978573941
driven_lanedir_max3.3295714704706763
driven_lanedir_mean1.542493658186574
driven_lanedir_median1.2741917108025818
driven_lanedir_min0.7600686978573941
in-drivable-lane_max1.2999999999999954
in-drivable-lane_mean0.3899999999999986
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.37052851133553, "sim_physics": 0.14529232281010326, "survival_time": 6.149999999999986, "driven_lanedir": 1.3389799348663602, "sim_render-ego": 0.06576415387595572, "in-drivable-lane": 0, "agent_compute-ego": 0.1061410651943548, "deviation-heading": 0.9554701659028992, "set_robot_commands": 0.10741307095783512, "deviation-center-line": 0.5255953182189327, "driven_lanedir_consec": 1.3389799348663602, "sim_compute_sim_state": 0.044252948063175854, "sim_compute_performance-ego": 0.07279589505699592, "sim_compute_robot_state-ego": 0.08164905144916318}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 3.4726673490497113, "sim_physics": 0.11096593856811524, "survival_time": 14.950000000000076, "driven_lanedir": 3.3295714704706763, "sim_render-ego": 0.05943371136983236, "in-drivable-lane": 0.29999999999999893, "agent_compute-ego": 0.09305051883061728, "deviation-heading": 2.317493657298202, "set_robot_commands": 0.09007409811019898, "deviation-center-line": 1.3966197192599437, "driven_lanedir_consec": 3.3295714704706763, "sim_compute_sim_state": 0.03730576038360596, "sim_compute_performance-ego": 0.06658477067947388, "sim_compute_robot_state-ego": 0.07266314347585043}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.7641285374625653, "sim_physics": 0.11035491379214005, "survival_time": 3.5499999999999954, "driven_lanedir": 0.7600686978573941, "sim_render-ego": 0.06354887720564721, "in-drivable-lane": 0, "agent_compute-ego": 0.11920613638112244, "deviation-heading": 0.3556489394582953, "set_robot_commands": 0.09625660869437204, "deviation-center-line": 0.3850883390670986, "driven_lanedir_consec": 0.7600686978573941, "sim_compute_sim_state": 0.040364429984294195, "sim_compute_performance-ego": 0.06702186356128102, "sim_compute_robot_state-ego": 0.07628271949123329}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.6669627589536304, "sim_physics": 0.1226870786576044, "survival_time": 7.349999999999982, "driven_lanedir": 1.2741917108025818, "sim_render-ego": 0.0628183244847927, "in-drivable-lane": 1.2999999999999954, "agent_compute-ego": 0.09794360439793594, "deviation-heading": 1.5369763966042964, "set_robot_commands": 0.09895638543732312, "deviation-center-line": 0.5357340420469399, "driven_lanedir_consec": 1.2741917108025818, "sim_compute_sim_state": 0.04040342772088083, "sim_compute_performance-ego": 0.07343006620601732, "sim_compute_robot_state-ego": 0.07973839798752143}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.156137432486233, "sim_physics": 0.11582530691073492, "survival_time": 5.1999999999999895, "driven_lanedir": 1.0096564769358576, "sim_render-ego": 0.06213269325403067, "in-drivable-lane": 0.34999999999999876, "agent_compute-ego": 0.09974804520606996, "deviation-heading": 1.306245165415645, "set_robot_commands": 0.0981413905437176, "deviation-center-line": 0.4570382291256076, "driven_lanedir_consec": 1.0096564769358576, "sim_compute_sim_state": 0.03854018449783325, "sim_compute_performance-ego": 0.07106007520969097, "sim_compute_robot_state-ego": 0.07186213594216567}}
set_robot_commands_max0.10741307095783512
set_robot_commands_mean0.09816831074868936
set_robot_commands_median0.0981413905437176
set_robot_commands_min0.09007409811019898
sim_compute_performance-ego_max0.07343006620601732
sim_compute_performance-ego_mean0.07017853414269183
sim_compute_performance-ego_median0.07106007520969097
sim_compute_performance-ego_min0.06658477067947388
sim_compute_robot_state-ego_max0.08164905144916318
sim_compute_robot_state-ego_mean0.0764390896691868
sim_compute_robot_state-ego_median0.07628271949123329
sim_compute_robot_state-ego_min0.07186213594216567
sim_compute_sim_state_max0.044252948063175854
sim_compute_sim_state_mean0.04017335012995802
sim_compute_sim_state_median0.040364429984294195
sim_compute_sim_state_min0.03730576038360596
sim_physics_max0.14529232281010326
sim_physics_mean0.12102511214773956
sim_physics_median0.11582530691073492
sim_physics_min0.11035491379214005
sim_render-ego_max0.06576415387595572
sim_render-ego_mean0.06273955203805173
sim_render-ego_median0.0628183244847927
sim_render-ego_min0.05943371136983236
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean7.440000000000007
survival_time_min3.5499999999999954
225273212AmaurXchallenge-aido_LF-template-randomaido2-LF-sim-testingstep1-simulationsuccessyes11700:15:54(hidden)
driven_lanedir_consec_median0.5723310224856362
survival_time_median2.549999999999999
deviation-center-line_median0.10099507669212504
in-drivable-lane_median0.4499999999999984


other stats
agent_compute-ego_max0.16518081559075248
agent_compute-ego_mean0.14849343825951647
agent_compute-ego_median0.15440706479347358
agent_compute-ego_min0.11801325573640711
deviation-center-line_max0.2838635700333795
deviation-center-line_mean0.12786165368054708
deviation-center-line_min0.07112529346797256
deviation-heading_max0.5289022616823588
deviation-heading_mean0.3391682685652287
deviation-heading_median0.32928385103533875
deviation-heading_min0.19401296908406307
driven_any_max2.1706243860917107
driven_any_mean0.9759490378276146
driven_any_median1.0117660515775693
driven_any_min0.23626560261560617
driven_lanedir_consec_max1.919400421063832
driven_lanedir_consec_mean0.6896171461819246
driven_lanedir_consec_min0.2264965947033466
driven_lanedir_max1.919400421063832
driven_lanedir_mean0.6896171461819246
driven_lanedir_median0.5723310224856362
driven_lanedir_min0.2264965947033466
in-drivable-lane_max1.7999999999999936
in-drivable-lane_mean0.5899999999999982
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0243289631429708, "sim_physics": 0.07738417166250723, "survival_time": 2.6999999999999984, "driven_lanedir": 0.5723310224856362, "sim_render-ego": 0.043635306534943755, "in-drivable-lane": 0.9999999999999976, "agent_compute-ego": 0.12188785605960424, "deviation-heading": 0.19401296908406307, "set_robot_commands": 0.07697531912061903, "deviation-center-line": 0.15907928712407893, "driven_lanedir_consec": 0.5723310224856362, "sim_compute_sim_state": 0.029291510581970215, "sim_compute_performance-ego": 0.04966103147577356, "sim_compute_robot_state-ego": 0.05459047688378228}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.9933867744747804, "sim_physics": 0.10370931905858656, "survival_time": 2.549999999999999, "driven_lanedir": 0.8010406009604816, "sim_render-ego": 0.05983307782341452, "in-drivable-lane": 0.29999999999999893, "agent_compute-ego": 0.1532199710023169, "deviation-heading": 0.5289022616823588, "set_robot_commands": 0.09742384330899108, "deviation-center-line": 0.13005513204193506, "driven_lanedir_consec": 0.8010406009604816, "sim_compute_sim_state": 0.03873957372179218, "sim_compute_performance-ego": 0.0683598471622841, "sim_compute_robot_state-ego": 0.07314488934535607}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.23626560261560617, "sim_physics": 0.09765825552098892, "survival_time": 0.8500000000000002, "driven_lanedir": 0.2264965947033466, "sim_render-ego": 0.046211593291338754, "in-drivable-lane": 0, "agent_compute-ego": 0.11801325573640711, "deviation-heading": 0.23048898560984332, "set_robot_commands": 0.08134933078990263, "deviation-center-line": 0.0788839760023766, "driven_lanedir_consec": 0.2264965947033466, "sim_compute_sim_state": 0.03078438253963695, "sim_compute_performance-ego": 0.04979803982902976, "sim_compute_robot_state-ego": 0.0546112902024213}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.4346971317320432, "sim_physics": 0.08533355712890625, "survival_time": 1.2500000000000004, "driven_lanedir": 0.40985475638935265, "sim_render-ego": 0.04932748794555664, "in-drivable-lane": 0, "agent_compute-ego": 0.1307369899749756, "deviation-heading": 0.4138862827398061, "set_robot_commands": 0.07686433792114258, "deviation-center-line": 0.08421324241865966, "driven_lanedir_consec": 0.40985475638935265, "sim_compute_sim_state": 0.03176578521728515, "sim_compute_performance-ego": 0.05468446731567383, "sim_compute_robot_state-ego": 0.0529654598236084}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.618214457700942, "sim_physics": 0.11829186994818192, "survival_time": 3.949999999999994, "driven_lanedir": 0.7890999076769956, "sim_render-ego": 0.06336900554125822, "in-drivable-lane": 1.7999999999999936, "agent_compute-ego": 0.15488088281848764, "deviation-heading": 0.23606825392187256, "set_robot_commands": 0.09954697874527944, "deviation-center-line": 0.2072381278624381, "driven_lanedir_consec": 0.7890999076769956, "sim_compute_sim_state": 0.04015143611763097, "sim_compute_performance-ego": 0.06994145731382732, "sim_compute_robot_state-ego": 0.07663967337789415}, "ETHZ_autolab_technical_track-5-0": {"driven_any": 1.0038514956833002, "sim_physics": 0.09707772001928212, "survival_time": 2.4499999999999993, "driven_lanedir": 0.7531703123735944, "sim_render-ego": 0.056141775481554926, "in-drivable-lane": 0.4499999999999984, "agent_compute-ego": 0.1386057406055684, "deviation-heading": 0.4596437246381204, "set_robot_commands": 0.08685422430233079, "deviation-center-line": 0.08968283443958727, "driven_lanedir_consec": 0.7531703123735944, "sim_compute_sim_state": 0.035452229636056085, "sim_compute_performance-ego": 0.061752445843754986, "sim_compute_robot_state-ego": 0.06489214605214644}, "ETHZ_autolab_technical_track-6-0": {"driven_any": 1.0542898001504375, "sim_physics": 0.10645874057497295, "survival_time": 2.799999999999998, "driven_lanedir": 0.5389398655375865, "sim_render-ego": 0.06114740031106131, "in-drivable-lane": 1.1499999999999972, "agent_compute-ego": 0.15887082474572317, "deviation-heading": 0.4109275195546752, "set_robot_commands": 0.09185802936553956, "deviation-center-line": 0.10786249131209884, "driven_lanedir_consec": 0.5389398655375865, "sim_compute_sim_state": 0.038338805947984965, "sim_compute_performance-ego": 0.06956102166857038, "sim_compute_robot_state-ego": 0.07391739317349025}, "ETHZ_autolab_technical_track-7-0": {"driven_any": 0.3164475681403097, "sim_physics": 0.13412561870756604, "survival_time": 1.0500000000000005, "driven_lanedir": 0.3093025166124813, "sim_render-ego": 0.0697104363214402, "in-drivable-lane": 0, "agent_compute-ego": 0.16370303290230886, "deviation-heading": 0.2242052814634115, "set_robot_commands": 0.10664458501906622, "deviation-center-line": 0.09758615464743424, "driven_lanedir_consec": 0.3093025166124813, "sim_compute_sim_state": 0.04194303921290806, "sim_compute_performance-ego": 0.08136912754603795, "sim_compute_robot_state-ego": 0.08413418134053548}, "ETHZ_autolab_technical_track-8-0": {"driven_any": 1.2018528489510765, "sim_physics": 0.11888569896504032, "survival_time": 2.9499999999999975, "driven_lanedir": 0.6922532395203, "sim_render-ego": 0.06511033591577563, "in-drivable-lane": 1.0499999999999965, "agent_compute-ego": 0.15440706479347358, "deviation-heading": 0.32928385103533875, "set_robot_commands": 0.09908421564910372, "deviation-center-line": 0.07112529346797256, "driven_lanedir_consec": 0.6922532395203, "sim_compute_sim_state": 0.039788205744856496, "sim_compute_performance-ego": 0.07019101159047272, "sim_compute_robot_state-ego": 0.0768775010513047}, "ETHZ_autolab_technical_track-9-0": {"driven_any": 1.0435481553257333, "sim_physics": 0.12095764767039906, "survival_time": 2.7499999999999982, "driven_lanedir": 0.5204405548974873, "sim_render-ego": 0.06402306123213335, "in-drivable-lane": 1.1499999999999977, "agent_compute-ego": 0.15236693729053843, "deviation-heading": 0.33296447766287096, "set_robot_commands": 0.09351201490922408, "deviation-center-line": 0.0950267943453044, "driven_lanedir_consec": 0.5204405548974873, "sim_compute_sim_state": 0.038284982334483755, "sim_compute_performance-ego": 0.07211659604852849, "sim_compute_robot_state-ego": 0.07801404432816939}, "ETHZ_autolab_technical_track-10-0": {"driven_any": 1.5954548672193265, "sim_physics": 0.12133163910407524, "survival_time": 3.8499999999999943, "driven_lanedir": 1.1042463557848754, "sim_render-ego": 0.06288487880260914, "in-drivable-lane": 1.0499999999999965, "agent_compute-ego": 0.15440815454953677, "deviation-heading": 0.3566810710676767, "set_robot_commands": 0.0987993741964365, "deviation-center-line": 0.22513914436082189, "driven_lanedir_consec": 1.1042463557848754, "sim_compute_sim_state": 0.03860132415573318, "sim_compute_performance-ego": 0.07041774786912001, "sim_compute_robot_state-ego": 0.07716525065434443}, "ETHZ_autolab_technical_track-11-0": {"driven_any": 0.49030923107489305, "sim_physics": 0.12482187577656335, "survival_time": 1.4000000000000006, "driven_lanedir": 0.4826393189617785, "sim_render-ego": 0.06323105948311943, "in-drivable-lane": 0, "agent_compute-ego": 0.15072258881160192, "deviation-heading": 0.23322336656472228, "set_robot_commands": 0.09153297117778234, "deviation-center-line": 0.10099507669212504, "driven_lanedir_consec": 0.4826393189617785, "sim_compute_sim_state": 0.037735206740243096, "sim_compute_performance-ego": 0.07172695228031703, "sim_compute_robot_state-ego": 0.06896485601152692}, "ETHZ_autolab_technical_track-12-0": {"driven_any": 1.0117660515775693, "sim_physics": 0.11490081805808872, "survival_time": 2.549999999999999, "driven_lanedir": 0.791717039833255, "sim_render-ego": 0.06318563573500689, "in-drivable-lane": 0.3999999999999986, "agent_compute-ego": 0.15518763953564213, "deviation-heading": 0.320449356593834, "set_robot_commands": 0.09451901678945504, "deviation-center-line": 0.1017166571540705, "driven_lanedir_consec": 0.791717039833255, "sim_compute_sim_state": 0.03930749145208621, "sim_compute_performance-ego": 0.07027874273412368, "sim_compute_robot_state-ego": 0.07791759921055214}, "ETHZ_autolab_technical_track-13-0": {"driven_any": 0.44419823353351984, "sim_physics": 0.13744818722760235, "survival_time": 1.3500000000000003, "driven_lanedir": 0.4333246859278659, "sim_render-ego": 0.07067856082209835, "in-drivable-lane": 0, "agent_compute-ego": 0.16518081559075248, "deviation-heading": 0.2988926743481924, "set_robot_commands": 0.10743244489034016, "deviation-center-line": 0.08545702330592322, "driven_lanedir_consec": 0.4333246859278659, "sim_compute_sim_state": 0.04360642256560149, "sim_compute_performance-ego": 0.0736606032760055, "sim_compute_robot_state-ego": 0.0883776346842448}, "ETHZ_autolab_technical_track-14-0": {"driven_any": 2.1706243860917107, "sim_physics": 0.12215609643973556, "survival_time": 5.09999999999999, "driven_lanedir": 1.919400421063832, "sim_render-ego": 0.0634904235017066, "in-drivable-lane": 0.4999999999999982, "agent_compute-ego": 0.15520981947580972, "deviation-heading": 0.5178939525116442, "set_robot_commands": 0.09666385603886024, "deviation-center-line": 0.2838635700333795, "driven_lanedir_consec": 1.919400421063832, "sim_compute_sim_state": 0.03959233153100107, "sim_compute_performance-ego": 0.06744003529642142, "sim_compute_robot_state-ego": 0.07469556612126968}}
set_robot_commands_max0.10743244489034016
set_robot_commands_mean0.0932707028149382
set_robot_commands_median0.09451901678945504
set_robot_commands_min0.07686433792114258
sim_compute_performance-ego_max0.08136912754603795
sim_compute_performance-ego_mean0.0667306084833294
sim_compute_performance-ego_median0.06994145731382732
sim_compute_performance-ego_min0.04966103147577356
sim_compute_robot_state-ego_max0.0883776346842448
sim_compute_robot_state-ego_mean0.07179386415070975
sim_compute_robot_state-ego_median0.07469556612126968
sim_compute_robot_state-ego_min0.0529654598236084
sim_compute_sim_state_max0.04360642256560149
sim_compute_sim_state_mean0.03755884849995132
sim_compute_sim_state_median0.03860132415573318
sim_compute_sim_state_min0.029291510581970215
sim_physics_max0.13744818722760235
sim_physics_mean0.11203608105749976
sim_physics_median0.11829186994818192
sim_physics_min0.07738417166250723
sim_render-ego_max0.07067856082209835
sim_render-ego_mean0.060132002582867855
sim_render-ego_median0.06318563573500689
sim_render-ego_min0.043635306534943755
simulation-passed1
survival_time_max5.09999999999999
survival_time_mean2.503333333333331
survival_time_min0.8500000000000002
225183225JBRRussiaJetBrains Researchaido2-LF-sim-validationstep1-simulationerroryes11700:06:42
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
(hidden)
225023235jp18813100494RL - TH -hhkaido2-LF-sim-validationstep1-simulationsuccessyes11700:23:59(hidden)
driven_lanedir_consec_median1.1983913415685112
survival_time_median14.950000000000076
deviation-center-line_median0.6850787478372781
in-drivable-lane_median1.2999999999999954


other stats
agent_compute-ego_max0.4241221670834523
agent_compute-ego_mean0.3876007399550453
agent_compute-ego_median0.3754875111579895
agent_compute-ego_min0.36152824958165486
deviation-center-line_max1.7178214473097992
deviation-center-line_mean0.7652117516387154
deviation-center-line_min0.16663604062107484
deviation-heading_max6.630879161706989
deviation-heading_mean2.7514377485618997
deviation-heading_median1.7662409830910664
deviation-heading_min0.9004302815499615
driven_any_max2.999167612240379
driven_any_mean1.7612804030677842
driven_any_median1.2814529152834666
driven_any_min1.020217595230667
driven_lanedir_consec_max2.9398018789941585
driven_lanedir_consec_mean1.5471043948167942
driven_lanedir_consec_min0.7724192105599141
driven_lanedir_max2.9398018789941585
driven_lanedir_mean1.5471043948167942
driven_lanedir_median1.1983913415685112
driven_lanedir_min0.7724192105599141
in-drivable-lane_max8.100000000000028
in-drivable-lane_mean2.9000000000000186
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.2814529152834666, "sim_physics": 0.11486467860993883, "survival_time": 5.249999999999989, "driven_lanedir": 0.7724192105599141, "sim_render-ego": 0.06300380343482608, "in-drivable-lane": 1.2999999999999954, "agent_compute-ego": 0.4124119531540644, "deviation-heading": 1.18926127832002, "set_robot_commands": 0.10078028043111166, "deviation-center-line": 0.41176379178095385, "driven_lanedir_consec": 0.7724192105599141, "sim_compute_sim_state": 0.04039531435285296, "sim_compute_performance-ego": 0.07392493202572777, "sim_compute_robot_state-ego": 0.0774755977448963}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.020217595230667, "sim_physics": 0.1298193616687127, "survival_time": 2.6499999999999986, "driven_lanedir": 0.8708362736898217, "sim_render-ego": 0.06724382796377507, "in-drivable-lane": 0.1999999999999993, "agent_compute-ego": 0.4241221670834523, "deviation-heading": 0.9004302815499615, "set_robot_commands": 0.10350080706038566, "deviation-center-line": 0.16663604062107484, "driven_lanedir_consec": 0.8708362736898217, "sim_compute_sim_state": 0.041961035638485314, "sim_compute_performance-ego": 0.07818290422547539, "sim_compute_robot_state-ego": 0.08859840429054117}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 2.999167612240379, "sim_physics": 0.11985732396443684, "survival_time": 14.950000000000076, "driven_lanedir": 2.9398018789941585, "sim_render-ego": 0.06519367853800456, "in-drivable-lane": 4.90000000000007, "agent_compute-ego": 0.3644538187980652, "deviation-heading": 1.7662409830910664, "set_robot_commands": 0.10189027388890584, "deviation-center-line": 0.6850787478372781, "driven_lanedir_consec": 2.9398018789941585, "sim_compute_sim_state": 0.04086846748987834, "sim_compute_performance-ego": 0.07294020096460978, "sim_compute_robot_state-ego": 0.0802271310488383}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.204334760078908, "sim_physics": 0.1163254181543986, "survival_time": 14.950000000000076, "driven_lanedir": 1.1983913415685112, "sim_render-ego": 0.06363127708435058, "in-drivable-lane": 0, "agent_compute-ego": 0.36152824958165486, "deviation-heading": 6.630879161706989, "set_robot_commands": 0.10460791269938152, "deviation-center-line": 1.7178214473097992, "driven_lanedir_consec": 1.1983913415685112, "sim_compute_sim_state": 0.04204733292261759, "sim_compute_performance-ego": 0.07094504674275716, "sim_compute_robot_state-ego": 0.0804587451616923}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 2.3012291325055, "sim_physics": 0.12099390268325806, "survival_time": 14.950000000000076, "driven_lanedir": 1.954073269271566, "sim_render-ego": 0.06389883279800415, "in-drivable-lane": 8.100000000000028, "agent_compute-ego": 0.3754875111579895, "deviation-heading": 3.270377038141461, "set_robot_commands": 0.10254108746846516, "deviation-center-line": 0.8447587306444703, "driven_lanedir_consec": 1.954073269271566, "sim_compute_sim_state": 0.041153624057769775, "sim_compute_performance-ego": 0.07105539639790853, "sim_compute_robot_state-ego": 0.08026451428731282}}
set_robot_commands_max0.10460791269938152
set_robot_commands_mean0.10266407230964995
set_robot_commands_median0.10254108746846516
set_robot_commands_min0.10078028043111166
sim_compute_performance-ego_max0.07818290422547539
sim_compute_performance-ego_mean0.07340969607129573
sim_compute_performance-ego_median0.07294020096460978
sim_compute_performance-ego_min0.07094504674275716
sim_compute_robot_state-ego_max0.08859840429054117
sim_compute_robot_state-ego_mean0.08140487850665619
sim_compute_robot_state-ego_median0.08026451428731282
sim_compute_robot_state-ego_min0.0774755977448963
sim_compute_sim_state_max0.04204733292261759
sim_compute_sim_state_mean0.0412851548923208
sim_compute_sim_state_median0.041153624057769775
sim_compute_sim_state_min0.04039531435285296
sim_physics_max0.1298193616687127
sim_physics_mean0.12037213701614902
sim_physics_median0.11985732396443684
sim_physics_min0.11486467860993883
sim_render-ego_max0.06724382796377507
sim_render-ego_mean0.06459428396379208
sim_render-ego_median0.06389883279800415
sim_render-ego_min0.06300380343482608
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean10.550000000000043
survival_time_min2.6499999999999986
225003237jp18813100494Second test - THaido2-LF-sim-validationstep1-simulationerroryes11700:00:29
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
(hidden)
224973240jp18813100494Second test - THaido2-LF-sim-validationstep1-simulationerroryes11700:00:31
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
(hidden)
224773270jp18813100494First test - THaido2-LF-sim-validationstep1-simulationsuccessyes11700:24:04(hidden)
driven_lanedir_consec_median2.732569779983079
survival_time_median14.950000000000076
deviation-center-line_median1.3088909637976252
in-drivable-lane_median0.2499999999999991


other stats
agent_compute-ego_max0.17541760603586834
agent_compute-ego_mean0.16663807121912638
agent_compute-ego_median0.17426217873891195
agent_compute-ego_min0.14786717414855957
deviation-center-line_max1.5017394198979486
deviation-center-line_mean1.1184325312986343
deviation-center-line_min0.06964352006535018
deviation-heading_max7.892533925983011
deviation-heading_mean5.123147457767591
deviation-heading_median5.4495764408882446
deviation-heading_min2.315642698211586
driven_any_max5.006219968165855
driven_any_mean2.68363899056599
driven_any_median2.906508313115725
driven_any_min0.5135772446808157
driven_lanedir_consec_max4.685364571279574
driven_lanedir_consec_mean2.3766419058094583
driven_lanedir_consec_min0.5115159308480957
driven_lanedir_max4.685364571279574
driven_lanedir_mean2.3766419058094583
driven_lanedir_median2.732569779983079
driven_lanedir_min0.5115159308480957
in-drivable-lane_max2.900000000000041
in-drivable-lane_mean0.7300000000000084
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.5135772446808157, "sim_physics": 0.09150862296422324, "survival_time": 14.950000000000076, "driven_lanedir": 0.5115159308480957, "sim_render-ego": 0.05572895129521688, "in-drivable-lane": 0, "agent_compute-ego": 0.1603718113899231, "deviation-heading": 6.156268431366704, "set_robot_commands": 0.08157912651697795, "deviation-center-line": 0.06964352006535018, "driven_lanedir_consec": 0.5115159308480957, "sim_compute_sim_state": 0.03449620723724365, "sim_compute_performance-ego": 0.05934163411458333, "sim_compute_robot_state-ego": 0.06586052417755127}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 5.006219968165855, "sim_physics": 0.1182863203684489, "survival_time": 14.950000000000076, "driven_lanedir": 4.685364571279574, "sim_render-ego": 0.0627890149752299, "in-drivable-lane": 0.5000000000000018, "agent_compute-ego": 0.17541760603586834, "deviation-heading": 2.315642698211586, "set_robot_commands": 0.09665383100509645, "deviation-center-line": 1.3088909637976252, "driven_lanedir_consec": 4.685364571279574, "sim_compute_sim_state": 0.03975577751795451, "sim_compute_performance-ego": 0.0704632560412089, "sim_compute_robot_state-ego": 0.07596733490626018}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 2.906508313115725, "sim_physics": 0.11692658265431724, "survival_time": 14.950000000000076, "driven_lanedir": 2.732569779983079, "sim_render-ego": 0.06363548676172892, "in-drivable-lane": 0.2499999999999991, "agent_compute-ego": 0.17527158578236898, "deviation-heading": 7.892533925983011, "set_robot_commands": 0.09271923065185549, "deviation-center-line": 1.5017394198979486, "driven_lanedir_consec": 2.732569779983079, "sim_compute_sim_state": 0.038709693749745686, "sim_compute_performance-ego": 0.0692694346110026, "sim_compute_robot_state-ego": 0.07308470884958904}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.1089971347571286, "sim_physics": 0.11663126150767009, "survival_time": 14.950000000000076, "driven_lanedir": 1.108191950356348, "sim_render-ego": 0.06212608734766642, "in-drivable-lane": 0, "agent_compute-ego": 0.17426217873891195, "deviation-heading": 5.4495764408882446, "set_robot_commands": 0.09511188904444376, "deviation-center-line": 1.4776116708377949, "driven_lanedir_consec": 1.108191950356348, "sim_compute_sim_state": 0.040215418338775635, "sim_compute_performance-ego": 0.06951912959416708, "sim_compute_robot_state-ego": 0.07555549383163453}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 3.8828922921104265, "sim_physics": 0.09692757209142049, "survival_time": 14.950000000000076, "driven_lanedir": 2.8455672965801964, "sim_render-ego": 0.05332414229710897, "in-drivable-lane": 2.900000000000041, "agent_compute-ego": 0.14786717414855957, "deviation-heading": 3.801715792388409, "set_robot_commands": 0.07882250706354776, "deviation-center-line": 1.2342770818944546, "driven_lanedir_consec": 2.8455672965801964, "sim_compute_sim_state": 0.034219493865966795, "sim_compute_performance-ego": 0.05891122500101725, "sim_compute_robot_state-ego": 0.06063933293024699}}
set_robot_commands_max0.09665383100509645
set_robot_commands_mean0.08897731685638428
set_robot_commands_median0.09271923065185549
set_robot_commands_min0.07882250706354776
sim_compute_performance-ego_max0.0704632560412089
sim_compute_performance-ego_mean0.06550093587239583
sim_compute_performance-ego_median0.0692694346110026
sim_compute_performance-ego_min0.05891122500101725
sim_compute_robot_state-ego_max0.07596733490626018
sim_compute_robot_state-ego_mean0.0702214789390564
sim_compute_robot_state-ego_median0.07308470884958904
sim_compute_robot_state-ego_min0.06063933293024699
sim_compute_sim_state_max0.040215418338775635
sim_compute_sim_state_mean0.03747931814193726
sim_compute_sim_state_median0.038709693749745686
sim_compute_sim_state_min0.034219493865966795
sim_physics_max0.1182863203684489
sim_physics_mean0.10805607191721596
sim_physics_median0.11663126150767009
sim_physics_min0.09150862296422324
sim_render-ego_max0.06363548676172892
sim_render-ego_mean0.059520736535390216
sim_render-ego_median0.06212608734766642
sim_render-ego_min0.05332414229710897
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean14.950000000000076
survival_time_min14.950000000000076
224573333MYFtestaido2-LFV-sim-validationstep1-simulationerroryes11700:19:17
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
(hidden)
224473294ioartSSegmaido2-LF-sim-validationstep1-simulationsuccessyes11700:08:57(hidden)
driven_lanedir_consec_median0.63022393251254
survival_time_median4.549999999999992
deviation-center-line_median0.26373706556356136
in-drivable-lane_median0.1999999999999993


other stats
agent_compute-ego_max0.10791878830896665
agent_compute-ego_mean0.10464020120734056
agent_compute-ego_median0.10654690501454112
agent_compute-ego_min0.10004129308335324
deviation-center-line_max0.6144364465634398
deviation-center-line_mean0.32710983617265516
deviation-center-line_min0.16101686364899737
deviation-heading_max1.2120220205241528
deviation-heading_mean0.6066504028202278
deviation-heading_median0.4789650270486564
deviation-heading_min0.3161131166445413
driven_any_max1.703773432968235
driven_any_mean0.9310214045812928
driven_any_median1.019543694515259
driven_any_min0.3463654324913009
driven_lanedir_consec_max1.2672309232923884
driven_lanedir_consec_mean0.7420399913488278
driven_lanedir_consec_min0.3411103448246551
driven_lanedir_max1.2672309232923884
driven_lanedir_mean0.7420399913488278
driven_lanedir_median0.63022393251254
driven_lanedir_min0.3411103448246551
in-drivable-lane_max1.7499999999999938
in-drivable-lane_mean0.6999999999999975
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.019543694515259, "sim_physics": 0.12740253878163768, "survival_time": 4.549999999999992, "driven_lanedir": 0.63022393251254, "sim_render-ego": 0.06858300638722849, "in-drivable-lane": 1.5499999999999945, "agent_compute-ego": 0.10654690501454112, "deviation-heading": 0.3784747830029385, "set_robot_commands": 0.11341244047814672, "deviation-center-line": 0.26373706556356136, "driven_lanedir_consec": 0.63022393251254, "sim_compute_sim_state": 0.04229345426454649, "sim_compute_performance-ego": 0.07762705100761665, "sim_compute_robot_state-ego": 0.08824291858044299}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.092320879119447, "sim_physics": 0.12647273143132529, "survival_time": 4.799999999999991, "driven_lanedir": 0.9966293118184264, "sim_render-ego": 0.0680234283208847, "in-drivable-lane": 0.1999999999999993, "agent_compute-ego": 0.10125591854254404, "deviation-heading": 1.2120220205241528, "set_robot_commands": 0.10182855029900868, "deviation-center-line": 0.4116015105826717, "driven_lanedir_consec": 0.9966293118184264, "sim_compute_sim_state": 0.04150405526161194, "sim_compute_performance-ego": 0.07467975219090779, "sim_compute_robot_state-ego": 0.08539104710022609}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.3463654324913009, "sim_physics": 0.13683699199131558, "survival_time": 1.7500000000000009, "driven_lanedir": 0.3411103448246551, "sim_render-ego": 0.07293192318507603, "in-drivable-lane": 0, "agent_compute-ego": 0.10743810108729772, "deviation-heading": 0.3161131166445413, "set_robot_commands": 0.1043532507760184, "deviation-center-line": 0.18475729450460557, "driven_lanedir_consec": 0.3411103448246551, "sim_compute_sim_state": 0.0406670229775565, "sim_compute_performance-ego": 0.07545925549098424, "sim_compute_robot_state-ego": 0.08614868436540876}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.4931035838122221, "sim_physics": 0.12455772339029517, "survival_time": 2.3499999999999996, "driven_lanedir": 0.4750054442961291, "sim_render-ego": 0.06587501789661164, "in-drivable-lane": 0, "agent_compute-ego": 0.10004129308335324, "deviation-heading": 0.6476770668808497, "set_robot_commands": 0.10112368806879572, "deviation-center-line": 0.16101686364899737, "driven_lanedir_consec": 0.4750054442961291, "sim_compute_sim_state": 0.04167757643030045, "sim_compute_performance-ego": 0.07186958130369796, "sim_compute_robot_state-ego": 0.08673487318323013}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.703773432968235, "sim_physics": 0.12174493482668106, "survival_time": 7.299999999999982, "driven_lanedir": 1.2672309232923884, "sim_render-ego": 0.06735959934861693, "in-drivable-lane": 1.7499999999999938, "agent_compute-ego": 0.10791878830896665, "deviation-heading": 0.4789650270486564, "set_robot_commands": 0.104660933964873, "deviation-center-line": 0.6144364465634398, "driven_lanedir_consec": 1.2672309232923884, "sim_compute_sim_state": 0.042644198626688085, "sim_compute_performance-ego": 0.0741271433764941, "sim_compute_robot_state-ego": 0.0814229037663708}}
set_robot_commands_max0.11341244047814672
set_robot_commands_mean0.1050757727173685
set_robot_commands_median0.1043532507760184
set_robot_commands_min0.10112368806879572
sim_compute_performance-ego_max0.07762705100761665
sim_compute_performance-ego_mean0.07475255667394015
sim_compute_performance-ego_median0.07467975219090779
sim_compute_performance-ego_min0.07186958130369796
sim_compute_robot_state-ego_max0.08824291858044299
sim_compute_robot_state-ego_mean0.08558808539913575
sim_compute_robot_state-ego_median0.08614868436540876
sim_compute_robot_state-ego_min0.0814229037663708
sim_compute_sim_state_max0.042644198626688085
sim_compute_sim_state_mean0.041757261512140695
sim_compute_sim_state_median0.04167757643030045
sim_compute_sim_state_min0.0406670229775565
sim_physics_max0.13683699199131558
sim_physics_mean0.12740298408425094
sim_physics_median0.12647273143132529
sim_physics_min0.12174493482668106
sim_render-ego_max0.07293192318507603
sim_render-ego_mean0.06855459502768355
sim_render-ego_median0.0680234283208847
sim_render-ego_min0.06587501789661164
simulation-passed1
survival_time_max7.299999999999982
survival_time_mean4.149999999999993
survival_time_min1.7500000000000009
224323307ioartSSegmaido2-LF-sim-validationstep1-simulationsuccessyes11700:16:05(hidden)
driven_lanedir_consec_median1.4862720471820374
survival_time_median6.499999999999985
deviation-center-line_median0.5050795679889822
in-drivable-lane_median0


other stats
agent_compute-ego_max0.10688530353077672
agent_compute-ego_mean0.09557676623688148
agent_compute-ego_median0.10340248048305511
agent_compute-ego_min0.07238284257742075
deviation-center-line_max1.1970445329844628
deviation-center-line_mean0.6655961094745276
deviation-center-line_min0.25677866449725595
deviation-heading_max2.468521413512545
deviation-heading_mean1.2853718630195443
deviation-heading_median1.0486021747763747
deviation-heading_min0.3160951456118222
driven_any_max3.40356679139738
driven_any_mean1.8310504447528777
driven_any_median1.5081048726568118
driven_any_min0.4931040796609572
driven_lanedir_consec_max2.9362983305238366
driven_lanedir_consec_mean1.5896980240286542
driven_lanedir_consec_min0.489153382091744
driven_lanedir_max2.9362983305238366
driven_lanedir_mean1.5896980240286542
driven_lanedir_median1.4862720471820374
driven_lanedir_min0.489153382091744
in-drivable-lane_max2.600000000000028
in-drivable-lane_mean0.8200000000000098
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 3.0494783179554457, "sim_physics": 0.09143360765063809, "survival_time": 12.850000000000048, "driven_lanedir": 2.353278194592611, "sim_render-ego": 0.05681992783156814, "in-drivable-lane": 2.600000000000028, "agent_compute-ego": 0.08833983436168863, "deviation-heading": 1.9504722954919012, "set_robot_commands": 0.08522165053549444, "deviation-center-line": 1.0765082202940304, "driven_lanedir_consec": 2.353278194592611, "sim_compute_sim_state": 0.035043006741119265, "sim_compute_performance-ego": 0.05992426018770567, "sim_compute_robot_state-ego": 0.06473530591229984}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.5081048726568118, "sim_physics": 0.06287336899684026, "survival_time": 6.499999999999985, "driven_lanedir": 1.4862720471820374, "sim_render-ego": 0.03646995471074031, "in-drivable-lane": 0, "agent_compute-ego": 0.07238284257742075, "deviation-heading": 1.0486021747763747, "set_robot_commands": 0.09782827817476712, "deviation-center-line": 0.5050795679889822, "driven_lanedir_consec": 1.4862720471820374, "sim_compute_sim_state": 0.024072957038879395, "sim_compute_performance-ego": 0.04101676574120155, "sim_compute_robot_state-ego": 0.04251813888549805}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.4931040796609572, "sim_physics": 0.13131924892993682, "survival_time": 2.3499999999999996, "driven_lanedir": 0.489153382091744, "sim_render-ego": 0.06728261582394864, "in-drivable-lane": 0, "agent_compute-ego": 0.10687337023146608, "deviation-heading": 0.3160951456118222, "set_robot_commands": 0.10685874553436928, "deviation-center-line": 0.25677866449725595, "driven_lanedir_consec": 0.489153382091744, "sim_compute_sim_state": 0.04120838388483575, "sim_compute_performance-ego": 0.07653935919416711, "sim_compute_robot_state-ego": 0.08336358374737679}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.700998162093792, "sim_physics": 0.12828345596790314, "survival_time": 3.1999999999999966, "driven_lanedir": 0.6834881657530425, "sim_render-ego": 0.06629328057169914, "in-drivable-lane": 0, "agent_compute-ego": 0.10340248048305511, "deviation-heading": 0.6431682857050783, "set_robot_commands": 0.10654974356293678, "deviation-center-line": 0.2925695616079067, "driven_lanedir_consec": 0.6834881657530425, "sim_compute_sim_state": 0.04124385863542557, "sim_compute_performance-ego": 0.07092500850558281, "sim_compute_robot_state-ego": 0.07586171850562096}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 3.40356679139738, "sim_physics": 0.1238858139305784, "survival_time": 14.250000000000068, "driven_lanedir": 2.9362983305238366, "sim_render-ego": 0.066722277591103, "in-drivable-lane": 1.500000000000021, "agent_compute-ego": 0.10688530353077672, "deviation-heading": 2.468521413512545, "set_robot_commands": 0.10538050835592704, "deviation-center-line": 1.1970445329844628, "driven_lanedir_consec": 2.9362983305238366, "sim_compute_sim_state": 0.04208247201484546, "sim_compute_performance-ego": 0.07600058923687851, "sim_compute_robot_state-ego": 0.08439350881074605}}
set_robot_commands_max0.10685874553436928
set_robot_commands_mean0.10036778523269892
set_robot_commands_median0.10538050835592704
set_robot_commands_min0.08522165053549444
sim_compute_performance-ego_max0.07653935919416711
sim_compute_performance-ego_mean0.06488119657310713
sim_compute_performance-ego_median0.07092500850558281
sim_compute_performance-ego_min0.04101676574120155
sim_compute_robot_state-ego_max0.08439350881074605
sim_compute_robot_state-ego_mean0.07017445117230833
sim_compute_robot_state-ego_median0.07586171850562096
sim_compute_robot_state-ego_min0.04251813888549805
sim_compute_sim_state_max0.04208247201484546
sim_compute_sim_state_mean0.036730135663021087
sim_compute_sim_state_median0.04120838388483575
sim_compute_sim_state_min0.024072957038879395
sim_physics_max0.13131924892993682
sim_physics_mean0.10755909909517931
sim_physics_median0.1238858139305784
sim_physics_min0.06287336899684026
sim_render-ego_max0.06728261582394864
sim_render-ego_mean0.05871761130581184
sim_render-ego_median0.06629328057169914
sim_render-ego_min0.03646995471074031
simulation-passed1
survival_time_max14.250000000000068
survival_time_mean7.830000000000018
survival_time_min2.3499999999999996
224303528enickyBaseline solution using reinforcement learningaido2-LF-sim-validationstep1-simulationfailedyes11700:00:57
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "experiment_manager.py", line 297, in run_episode
    r: MsgReceived = agent.write_topic_and_expect('get_commands', expect='commands')
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 93, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 174, in read_one
    nickname=self.nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 283, in read_until_over
    raise RemoteNodeAborted(m)
zuper_nodes.structures.RemoteNodeAborted: External node "agent" aborted:

error in agent |Exception while handling a message on topic "get_commands".
               |
               || Traceback (most recent call last):
               ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 274, in loop
               ||     handle_message_node(parsed, receiver0, context0)
               ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 428, in handle_message_node
               ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
               ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/utils.py", line 18, in call_if_fun_exists
               ||     f(**kwargs)
               ||   File "solution.py", line 48, in on_received_get_commands
               ||     pwm_left, pwm_right = self.compute_action(self.current_image)
               ||   File "solution.py", line 43, in compute_action
               ||     action = self.model.select_action(observation)
               ||   File "/workspace/model.py", line 150, in select_action
               ||     return self.actor(state).cpu().data.numpy().flatten()
               ||   File "/usr/local/lib/python3.7/site-packages/torch/nn/modules/module.py", line 489, in __call__
               ||     result = self.forward(*input, **kwargs)
               ||   File "/workspace/model.py", line 45, in forward
               ||     x = self.bn1(self.lr(self.conv1(x)))
               ||   File "/usr/local/lib/python3.7/site-packages/torch/nn/modules/module.py", line 489, in __call__
               ||     result = self.forward(*input, **kwargs)
               ||   File "/usr/local/lib/python3.7/site-packages/torch/nn/modules/conv.py", line 320, in forward
               ||     self.padding, self.dilation, self.groups)
               || RuntimeError: Given groups=1, weight of size [32, 3, 8, 8], expected input[1, 1, 120, 160] to have 3 channels, but got 1 channels instead
               ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
    yield cie
  File "experiment_manager.py", line 441, in <module>
    wrap(cie)
  File "experiment_manager.py", line 429, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 135, in main
    physics_dt=config.physics_dt)
  File "experiment_manager.py", line 301, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.
(hidden)
224293309enickyBaseline solution using reinforcement learningaido2-LF-sim-testingstep1-simulationfailedyes11700:01:09
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "experiment_manager.py", line 297, in run_episode
    r: MsgReceived = agent.write_topic_and_expect('get_commands', expect='commands')
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 93, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 174, in read_one
    nickname=self.nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 283, in read_until_over
    raise RemoteNodeAborted(m)
zuper_nodes.structures.RemoteNodeAborted: External node "agent" aborted:

error in agent |Exception while handling a message on topic "get_commands".
               |
               || Traceback (most recent call last):
               ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 274, in loop
               ||     handle_message_node(parsed, receiver0, context0)
               ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 428, in handle_message_node
               ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
               ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/utils.py", line 18, in call_if_fun_exists
               ||     f(**kwargs)
               ||   File "solution.py", line 48, in on_received_get_commands
               ||     pwm_left, pwm_right = self.compute_action(self.current_image)
               ||   File "solution.py", line 41, in compute_action
               ||     observation = self.preprocessor.preprocess(observation)
               ||   File "/workspace/wrappers.py", line 14, in preprocess
               ||     resizedImage = imresize(obs, self.shape)  # .transpose(2, 0, 1)
               ||   File "/usr/local/lib/python3.7/site-packages/numpy/lib/utils.py", line 101, in newfunc
               ||     return func(*args, **kwds)
               ||   File "/usr/local/lib/python3.7/site-packages/scipy/misc/pilutil.py", line 555, in imresize
               ||     im = toimage(arr, mode=mode)
               ||   File "/usr/local/lib/python3.7/site-packages/numpy/lib/utils.py", line 101, in newfunc
               ||     return func(*args, **kwds)
               ||   File "/usr/local/lib/python3.7/site-packages/scipy/misc/pilutil.py", line 327, in toimage
               ||     raise ValueError("'arr' does not have a suitable array shape for "
               || ValueError: 'arr' does not have a suitable array shape for any mode.
               ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
    yield cie
  File "experiment_manager.py", line 441, in <module>
    wrap(cie)
  File "experiment_manager.py", line 429, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 135, in main
    physics_dt=config.physics_dt)
  File "experiment_manager.py", line 301, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.
(hidden)
224243311ASHWINRAMchallenge-aido_LF-template-randomaido2-LF-sim-validationstep1-simulationsuccessyes11700:06:16(hidden)
driven_lanedir_consec_median0.7558221274508995
survival_time_median2.549999999999999
deviation-center-line_median0.12011701524194925
in-drivable-lane_median0.749999999999998


other stats
agent_compute-ego_max0.23490166196636125
agent_compute-ego_mean0.2226517407586593
agent_compute-ego_median0.2262714921611629
agent_compute-ego_min0.19597804373589112
deviation-center-line_max0.1863474249309824
deviation-center-line_mean0.12385480885359738
deviation-center-line_min0.08247952053666581
deviation-heading_max0.9044166301315548
deviation-heading_mean0.49788505265240224
deviation-heading_median0.47821103799183057
deviation-heading_min0.2489665952552648
driven_any_max1.6730433112178271
driven_any_mean1.2223886565680262
driven_any_median1.1418209699500368
driven_any_min0.5871969308894068
driven_lanedir_consec_max1.232427854822812
driven_lanedir_consec_mean0.8474389757539477
driven_lanedir_consec_min0.5736256913531315
driven_lanedir_max1.232427854822812
driven_lanedir_mean0.8474389757539477
driven_lanedir_median0.7558221274508995
driven_lanedir_min0.5736256913531315
in-drivable-lane_max1.049999999999997
in-drivable-lane_mean0.6699999999999979
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.1418209699500368, "sim_physics": 0.09754683457168878, "survival_time": 2.549999999999999, "driven_lanedir": 0.7331929678509965, "sim_render-ego": 0.06061172952838973, "in-drivable-lane": 0.749999999999998, "agent_compute-ego": 0.23490166196636125, "deviation-heading": 0.47821103799183057, "set_robot_commands": 0.08511721854116402, "deviation-center-line": 0.09396284247174208, "driven_lanedir_consec": 0.7331929678509965, "sim_compute_sim_state": 0.04257688335343903, "sim_compute_performance-ego": 0.062135443967931414, "sim_compute_robot_state-ego": 0.06579788058411841}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.092853780444004, "sim_physics": 0.15167190551757812, "survival_time": 2.499999999999999, "driven_lanedir": 0.7558221274508995, "sim_render-ego": 0.05669726371765137, "in-drivable-lane": 0.6499999999999981, "agent_compute-ego": 0.22392931938171387, "deviation-heading": 0.2995319860011346, "set_robot_commands": 0.08868768215179443, "deviation-center-line": 0.12011701524194925, "driven_lanedir_consec": 0.7558221274508995, "sim_compute_sim_state": 0.03567124843597412, "sim_compute_performance-ego": 0.07465490341186523, "sim_compute_robot_state-ego": 0.06543695449829101}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.6170282903388562, "sim_physics": 0.07659059331036996, "survival_time": 3.4499999999999957, "driven_lanedir": 0.942126237291899, "sim_render-ego": 0.04572483767633853, "in-drivable-lane": 1.049999999999997, "agent_compute-ego": 0.19597804373589112, "deviation-heading": 0.9044166301315548, "set_robot_commands": 0.0694464807925017, "deviation-center-line": 0.1863474249309824, "driven_lanedir_consec": 0.942126237291899, "sim_compute_sim_state": 0.02771299818287725, "sim_compute_performance-ego": 0.052260692568792816, "sim_compute_robot_state-ego": 0.055125606232795166}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.6730433112178271, "sim_physics": 0.09469888308276868, "survival_time": 3.649999999999995, "driven_lanedir": 1.232427854822812, "sim_render-ego": 0.058296993987201014, "in-drivable-lane": 0.8999999999999968, "agent_compute-ego": 0.2262714921611629, "deviation-heading": 0.5582990138822262, "set_robot_commands": 0.08607747456798814, "deviation-center-line": 0.13636724108664736, "driven_lanedir_consec": 1.232427854822812, "sim_compute_sim_state": 0.03590637037198838, "sim_compute_performance-ego": 0.06231470957194289, "sim_compute_robot_state-ego": 0.06518524313626224}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.5871969308894068, "sim_physics": 0.10853547885500152, "survival_time": 1.4500000000000006, "driven_lanedir": 0.5736256913531315, "sim_render-ego": 0.06070867900190682, "in-drivable-lane": 0, "agent_compute-ego": 0.23217818654816727, "deviation-heading": 0.2489665952552648, "set_robot_commands": 0.08523770858501566, "deviation-center-line": 0.08247952053666581, "driven_lanedir_consec": 0.5736256913531315, "sim_compute_sim_state": 0.034427018001161776, "sim_compute_performance-ego": 0.06565380096435547, "sim_compute_robot_state-ego": 0.06410250992610536}}
set_robot_commands_max0.08868768215179443
set_robot_commands_mean0.0829133129276928
set_robot_commands_median0.08523770858501566
set_robot_commands_min0.0694464807925017
sim_compute_performance-ego_max0.07465490341186523
sim_compute_performance-ego_mean0.06340391009697757
sim_compute_performance-ego_median0.06231470957194289
sim_compute_performance-ego_min0.052260692568792816
sim_compute_robot_state-ego_max0.06579788058411841
sim_compute_robot_state-ego_mean0.06312963887551444
sim_compute_robot_state-ego_median0.06518524313626224
sim_compute_robot_state-ego_min0.055125606232795166
sim_compute_sim_state_max0.04257688335343903
sim_compute_sim_state_mean0.03525890366908811
sim_compute_sim_state_median0.03567124843597412
sim_compute_sim_state_min0.02771299818287725
sim_physics_max0.15167190551757812
sim_physics_mean0.1058087390674814
sim_physics_median0.09754683457168878
sim_physics_min0.07659059331036996
sim_render-ego_max0.06070867900190682
sim_render-ego_mean0.056407900782297495
sim_render-ego_median0.058296993987201014
sim_render-ego_min0.04572483767633853
simulation-passed1
survival_time_max3.649999999999995
survival_time_mean2.719999999999998
survival_time_min1.4500000000000006
224163322jp18813100494RL - TH -xyzaido2-LFV-sim-validationstep1-simulationerroryes11700:02:13
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
(hidden)
223873343JBRRussiaJetBrains Researchaido2-LFV-sim-testingstep1-simulationerroryes11700:59:06
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
(hidden)
223753356JBRRussiaJetBrains Researchaido2-LF-sim-validationstep1-simulationerroryes11700:20:19
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
(hidden)
223703368AmaurXchallenge-aido_LF-template-randomaido2-LFV-sim-validationstep1-simulationsuccessyes11700:08:06(hidden)
driven_lanedir_consec_median0.5723310224856362
survival_time_median2.6999999999999984
deviation-center-line_median0.11519544839797546
in-drivable-lane_median0.5999999999999979


other stats
agent_compute-ego_max0.1653811264038086
agent_compute-ego_mean0.14275720167310305
agent_compute-ego_median0.1357676469827
agent_compute-ego_min0.1289552961077009
deviation-center-line_max0.1743913456502906
deviation-center-line_mean0.12651756552531995
deviation-center-line_min0.09047885846140293
deviation-heading_max0.5020407942599273
deviation-heading_mean0.3641979127291371
deviation-heading_median0.34764983431811214
deviation-heading_min0.19401296908406307
driven_any_max1.6169932854589035
driven_any_mean1.0272530755098266
driven_any_median1.0243289631429708
driven_any_min0.4119037580118998
driven_lanedir_consec_max1.2433038249708377
driven_lanedir_consec_mean0.7800316850006626
driven_lanedir_consec_min0.3792793194470208
driven_lanedir_max1.2433038249708377
driven_lanedir_mean0.7800316850006626
driven_lanedir_median0.5723310224856362
driven_lanedir_min0.3792793194470208
in-drivable-lane_max0.9999999999999976
in-drivable-lane_mean0.4899999999999984
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0243289631429708, "sim_physics": 0.1516671578089396, "survival_time": 2.6999999999999984, "driven_lanedir": 0.5723310224856362, "sim_render-ego": 0.05554395693319815, "in-drivable-lane": 0.9999999999999976, "agent_compute-ego": 0.13391990131802028, "deviation-heading": 0.19401296908406307, "set_robot_commands": 0.09441771772172716, "deviation-center-line": 0.15907928712407893, "driven_lanedir_consec": 0.5723310224856362, "sim_compute_sim_state": 0.036886758274502225, "sim_compute_performance-ego": 0.06259040479306821, "sim_compute_robot_state-ego": 0.06976095835367839, "sim_compute_robot_state-npc0": 0.06653802041654233, "sim_compute_robot_state-npc1": 0.05873954737627947, "sim_compute_robot_state-npc2": 0.059659617918509024, "sim_compute_robot_state-npc3": 0.060559873227719906}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.4119037580118998, "sim_physics": 0.21529409408569336, "survival_time": 1.2500000000000004, "driven_lanedir": 0.3792793194470208, "sim_render-ego": 0.0652924919128418, "in-drivable-lane": 0, "agent_compute-ego": 0.1653811264038086, "deviation-heading": 0.47860435001913393, "set_robot_commands": 0.10315236091613768, "deviation-center-line": 0.09344288799285194, "driven_lanedir_consec": 0.3792793194470208, "sim_compute_sim_state": 0.041140804290771486, "sim_compute_performance-ego": 0.07150863647460938, "sim_compute_robot_state-ego": 0.08774508476257324, "sim_compute_robot_state-npc0": 0.07220564842224121, "sim_compute_robot_state-npc1": 0.0773888111114502, "sim_compute_robot_state-npc2": 0.07594542503356934, "sim_compute_robot_state-npc3": 0.07374726295471191}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.579862082650716, "sim_physics": 0.17924976976294266, "survival_time": 3.7999999999999945, "driven_lanedir": 1.2433038249708377, "sim_render-ego": 0.060702392929478696, "in-drivable-lane": 0.5999999999999979, "agent_compute-ego": 0.1497620375532853, "deviation-heading": 0.5020407942599273, "set_robot_commands": 0.09661884998020372, "deviation-center-line": 0.1743913456502906, "driven_lanedir_consec": 1.2433038249708377, "sim_compute_sim_state": 0.0399524914590936, "sim_compute_performance-ego": 0.07223416629590486, "sim_compute_robot_state-ego": 0.07397449016571045, "sim_compute_robot_state-npc0": 0.07071870565414429, "sim_compute_robot_state-npc1": 0.06944392543090017, "sim_compute_robot_state-npc2": 0.06822553433870014, "sim_compute_robot_state-npc3": 0.0686252148527848}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.6169932854589035, "sim_physics": 0.15764643874349474, "survival_time": 3.949999999999994, "driven_lanedir": 1.2126117310470583, "sim_render-ego": 0.05640117729766459, "in-drivable-lane": 0.849999999999997, "agent_compute-ego": 0.1357676469827, "deviation-heading": 0.34764983431811214, "set_robot_commands": 0.0818163050880915, "deviation-center-line": 0.11519544839797546, "driven_lanedir_consec": 1.2126117310470583, "sim_compute_sim_state": 0.03468578978429867, "sim_compute_performance-ego": 0.06297004675563378, "sim_compute_robot_state-ego": 0.06797525248950041, "sim_compute_robot_state-npc0": 0.06250819978834707, "sim_compute_robot_state-npc1": 0.06619101838220524, "sim_compute_robot_state-npc2": 0.05763191814664044, "sim_compute_robot_state-npc3": 0.06263548513002033}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.5031772882846431, "sim_physics": 0.1702117919921875, "survival_time": 1.4000000000000006, "driven_lanedir": 0.4926325270527603, "sim_render-ego": 0.056707186358315606, "in-drivable-lane": 0, "agent_compute-ego": 0.1289552961077009, "deviation-heading": 0.29868161596444953, "set_robot_commands": 0.07796416112354823, "deviation-center-line": 0.09047885846140293, "driven_lanedir_consec": 0.4926325270527603, "sim_compute_sim_state": 0.03794162614004953, "sim_compute_performance-ego": 0.056555637291499546, "sim_compute_robot_state-ego": 0.06111586093902588, "sim_compute_robot_state-npc0": 0.05672934225627354, "sim_compute_robot_state-npc1": 0.06067251307623727, "sim_compute_robot_state-npc2": 0.058712473937443325, "sim_compute_robot_state-npc3": 0.07422083616256714}}
set_robot_commands_max0.10315236091613768
set_robot_commands_mean0.09079387896594168
set_robot_commands_median0.09441771772172716
set_robot_commands_min0.07796416112354823
sim_compute_performance-ego_max0.07223416629590486
sim_compute_performance-ego_mean0.06517177832214315
sim_compute_performance-ego_median0.06297004675563378
sim_compute_performance-ego_min0.056555637291499546
sim_compute_robot_state-ego_max0.08774508476257324
sim_compute_robot_state-ego_mean0.07211432934209767
sim_compute_robot_state-ego_median0.06976095835367839
sim_compute_robot_state-ego_min0.06111586093902588
sim_compute_robot_state-npc0_max0.07220564842224121
sim_compute_robot_state-npc0_mean0.06573998330750969
sim_compute_robot_state-npc0_median0.06653802041654233
sim_compute_robot_state-npc0_min0.05672934225627354
sim_compute_robot_state-npc1_max0.0773888111114502
sim_compute_robot_state-npc1_mean0.06648716307541447
sim_compute_robot_state-npc1_median0.06619101838220524
sim_compute_robot_state-npc1_min0.05873954737627947
sim_compute_robot_state-npc2_max0.07594542503356934
sim_compute_robot_state-npc2_mean0.06403499387497245
sim_compute_robot_state-npc2_median0.059659617918509024
sim_compute_robot_state-npc2_min0.05763191814664044
sim_compute_robot_state-npc3_max0.07422083616256714
sim_compute_robot_state-npc3_mean0.06795773446556082
sim_compute_robot_state-npc3_median0.0686252148527848
sim_compute_robot_state-npc3_min0.060559873227719906
sim_compute_sim_state_max0.041140804290771486
sim_compute_sim_state_mean0.038121493989743106
sim_compute_sim_state_median0.03794162614004953
sim_compute_sim_state_min0.03468578978429867
sim_physics_max0.21529409408569336
sim_physics_mean0.17481385047865156
sim_physics_median0.1702117919921875
sim_physics_min0.1516671578089396
sim_render-ego_max0.0652924919128418
sim_render-ego_mean0.05892944108629977
sim_render-ego_median0.056707186358315606
sim_render-ego_min0.05554395693319815
simulation-passed1
survival_time_max3.949999999999994
survival_time_mean2.6199999999999974
survival_time_min1.2500000000000004
223593384jp18813100494RL-TH-shiaido2-LFV-sim-validationstep1-simulationsuccessyes11700:29:16(hidden)
driven_lanedir_consec_median2.014963426083584
survival_time_median14.950000000000076
deviation-center-line_median0.7835435398988666
in-drivable-lane_median1.2500000000000018


other stats
agent_compute-ego_max0.17468318382898967
agent_compute-ego_mean0.16892855939625537
agent_compute-ego_median0.16805754820505778
agent_compute-ego_min0.16395220705257949
deviation-center-line_max1.1420799755697089
deviation-center-line_mean0.6905197721352371
deviation-center-line_min0.11120974714089606
deviation-heading_max5.288306496665341
deviation-heading_mean2.354684133490915
deviation-heading_median2.316078363499446
deviation-heading_min0.4761406434174122
driven_any_max3.589118018203941
driven_any_mean2.278782555309843
driven_any_median2.3571086635878236
driven_any_min0.7866079095386854
driven_lanedir_consec_max3.3597020570676293
driven_lanedir_consec_mean1.9481957680427784
driven_lanedir_consec_min0.6807447403868805
driven_lanedir_max3.3597020570676293
driven_lanedir_mean1.9553465332756064
driven_lanedir_median2.0507172522477246
driven_lanedir_min0.6807447403868805
in-drivable-lane_max13.100000000000076
in-drivable-lane_mean3.720000000000023
in-drivable-lane_min0.2499999999999991
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.7866079095386854, "sim_physics": 0.15188687721888225, "survival_time": 14.950000000000076, "driven_lanedir": 0.6807447403868805, "sim_render-ego": 0.05911167621612549, "in-drivable-lane": 13.100000000000076, "agent_compute-ego": 0.16408493836720783, "deviation-heading": 0.4761406434174122, "set_robot_commands": 0.09264017422993978, "deviation-center-line": 0.11120974714089606, "driven_lanedir_consec": 0.6807447403868805, "sim_compute_sim_state": 0.03724752426147461, "sim_compute_performance-ego": 0.0665476409594218, "sim_compute_robot_state-ego": 0.07028584718704224, "sim_compute_robot_state-npc0": 0.06644086519877115, "sim_compute_robot_state-npc1": 0.06515290180842082, "sim_compute_robot_state-npc2": 0.06672252337137859, "sim_compute_robot_state-npc3": 0.06597165822982788}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 3.589118018203941, "sim_physics": 0.200612850189209, "survival_time": 14.950000000000076, "driven_lanedir": 3.3597020570676293, "sim_render-ego": 0.0583255664507548, "in-drivable-lane": 0.2499999999999991, "agent_compute-ego": 0.16805754820505778, "deviation-heading": 2.979443906575837, "set_robot_commands": 0.0901508871714274, "deviation-center-line": 1.1398250402165415, "driven_lanedir_consec": 3.3597020570676293, "sim_compute_sim_state": 0.037813059488932294, "sim_compute_performance-ego": 0.06568450927734375, "sim_compute_robot_state-ego": 0.07163995901743571, "sim_compute_robot_state-npc0": 0.06618937412897746, "sim_compute_robot_state-npc1": 0.06750948985417683, "sim_compute_robot_state-npc2": 0.06385759830474853, "sim_compute_robot_state-npc3": 0.06501540104548137}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.6176315741315754, "sim_physics": 0.16855825147321146, "survival_time": 4.6499999999999915, "driven_lanedir": 1.2379019004726923, "sim_render-ego": 0.05730776632985761, "in-drivable-lane": 1.149999999999996, "agent_compute-ego": 0.16395220705257949, "deviation-heading": 0.7134512572965398, "set_robot_commands": 0.086898926765688, "deviation-center-line": 0.27594055785017235, "driven_lanedir_consec": 1.2379019004726923, "sim_compute_sim_state": 0.035206525556502805, "sim_compute_performance-ego": 0.06328994997086064, "sim_compute_robot_state-ego": 0.06590979073637275, "sim_compute_robot_state-npc0": 0.06359380547718335, "sim_compute_robot_state-npc1": 0.062002017933835266, "sim_compute_robot_state-npc2": 0.06060944064970939, "sim_compute_robot_state-npc3": 0.06308477155623897}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 2.3571086635878236, "sim_physics": 0.16992889006932577, "survival_time": 14.950000000000076, "driven_lanedir": 2.0507172522477246, "sim_render-ego": 0.06156554460525512, "in-drivable-lane": 2.8500000000000405, "agent_compute-ego": 0.17468318382898967, "deviation-heading": 5.288306496665341, "set_robot_commands": 0.09102298418680826, "deviation-center-line": 1.1420799755697089, "driven_lanedir_consec": 2.014963426083584, "sim_compute_sim_state": 0.04204496224721273, "sim_compute_performance-ego": 0.0675730315844218, "sim_compute_robot_state-ego": 0.07232025067011515, "sim_compute_robot_state-npc0": 0.06788545449574789, "sim_compute_robot_state-npc1": 0.06832826852798463, "sim_compute_robot_state-npc2": 0.06820342381795247, "sim_compute_robot_state-npc3": 0.06831830978393555}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 3.0434466110871914, "sim_physics": 0.16900892595274258, "survival_time": 11.300000000000026, "driven_lanedir": 2.4476667162031065, "sim_render-ego": 0.060848805756695504, "in-drivable-lane": 1.2500000000000018, "agent_compute-ego": 0.17386491952744204, "deviation-heading": 2.316078363499446, "set_robot_commands": 0.09639366643618694, "deviation-center-line": 0.7835435398988666, "driven_lanedir_consec": 2.4476667162031065, "sim_compute_sim_state": 0.03841309104345541, "sim_compute_performance-ego": 0.07094153260762713, "sim_compute_robot_state-ego": 0.07593006264846937, "sim_compute_robot_state-npc0": 0.07030968433987778, "sim_compute_robot_state-npc1": 0.06892363265552352, "sim_compute_robot_state-npc2": 0.06802891313502218, "sim_compute_robot_state-npc3": 0.06817817266008495}}
set_robot_commands_max0.09639366643618694
set_robot_commands_mean0.09142132775801008
set_robot_commands_median0.09102298418680826
set_robot_commands_min0.086898926765688
sim_compute_performance-ego_max0.07094153260762713
sim_compute_performance-ego_mean0.06680733287993502
sim_compute_performance-ego_median0.0665476409594218
sim_compute_performance-ego_min0.06328994997086064
sim_compute_robot_state-ego_max0.07593006264846937
sim_compute_robot_state-ego_mean0.07121718205188704
sim_compute_robot_state-ego_median0.07163995901743571
sim_compute_robot_state-ego_min0.06590979073637275
sim_compute_robot_state-npc0_max0.07030968433987778
sim_compute_robot_state-npc0_mean0.06688383672811152
sim_compute_robot_state-npc0_median0.06644086519877115
sim_compute_robot_state-npc0_min0.06359380547718335
sim_compute_robot_state-npc1_max0.06892363265552352
sim_compute_robot_state-npc1_mean0.0663832621559882
sim_compute_robot_state-npc1_median0.06750948985417683
sim_compute_robot_state-npc1_min0.062002017933835266
sim_compute_robot_state-npc2_max0.06820342381795247
sim_compute_robot_state-npc2_mean0.06548437985576223
sim_compute_robot_state-npc2_median0.06672252337137859
sim_compute_robot_state-npc2_min0.06060944064970939
sim_compute_robot_state-npc3_max0.06831830978393555
sim_compute_robot_state-npc3_mean0.06611366265511374
sim_compute_robot_state-npc3_median0.06597165822982788
sim_compute_robot_state-npc3_min0.06308477155623897
sim_compute_sim_state_max0.04204496224721273
sim_compute_sim_state_mean0.03814503251951557
sim_compute_sim_state_median0.037813059488932294
sim_compute_sim_state_min0.035206525556502805
sim_physics_max0.200612850189209
sim_physics_mean0.1719991589806742
sim_physics_median0.16900892595274258
sim_physics_min0.15188687721888225
sim_render-ego_max0.06156554460525512
sim_render-ego_mean0.05943187187173771
sim_render-ego_median0.05911167621612549
sim_render-ego_min0.05730776632985761
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean12.16000000000005
survival_time_min4.6499999999999915
223443396jp18813100494RL-TH-shiaido2-LFVI-sim-validationstep1-simulationerroryes11700:28:08
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
(hidden)
223383402jp18813100494RL-TH-shiaido2-LFV-sim-validationstep1-simulationsuccessyes11700:31:23(hidden)
driven_lanedir_consec_median2.0656256711545056
survival_time_median14.950000000000076
deviation-center-line_median1.067962415499822
in-drivable-lane_median0.09999999999999964


other stats
agent_compute-ego_max0.17157697677612305
agent_compute-ego_mean0.1661475680247456
agent_compute-ego_median0.16582575379585734
agent_compute-ego_min0.1575186038017273
deviation-center-line_max1.3050316432676294
deviation-center-line_mean0.939056391191476
deviation-center-line_min0.2352082649629227
deviation-heading_max8.476768494662194
deviation-heading_mean4.140557172545289
deviation-heading_median3.0429296736689047
deviation-heading_min1.500030541342493
driven_any_max3.794125700053806
driven_any_mean2.4869055410177014
driven_any_median2.612878294174509
driven_any_min1.4086570521625874
driven_lanedir_consec_max3.742087276869941
driven_lanedir_consec_mean2.2992516928522773
driven_lanedir_consec_min1.254594619368286
driven_lanedir_max3.742087276869941
driven_lanedir_mean2.3843231188552685
driven_lanedir_median2.4306487193687563
driven_lanedir_min1.3149287011689903
in-drivable-lane_max4.099999999999985
in-drivable-lane_mean1.1700000000000017
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 2.7094953140588514, "sim_physics": 0.1594630495707194, "survival_time": 14.950000000000076, "driven_lanedir": 2.6525567712103726, "sim_render-ego": 0.05655939896901448, "in-drivable-lane": 0, "agent_compute-ego": 0.1575186038017273, "deviation-heading": 3.0429296736689047, "set_robot_commands": 0.08654730717341105, "deviation-center-line": 1.3050316432676294, "driven_lanedir_consec": 2.6525567712103726, "sim_compute_sim_state": 0.03513382434844971, "sim_compute_performance-ego": 0.06142990112304687, "sim_compute_robot_state-ego": 0.0656575067838033, "sim_compute_robot_state-npc0": 0.06254857540130615, "sim_compute_robot_state-npc1": 0.061590179602305097, "sim_compute_robot_state-npc2": 0.061166305541992184, "sim_compute_robot_state-npc3": 0.06215750296910604}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 3.794125700053806, "sim_physics": 0.17906782229741414, "survival_time": 14.950000000000076, "driven_lanedir": 3.742087276869941, "sim_render-ego": 0.05846297740936279, "in-drivable-lane": 0, "agent_compute-ego": 0.17134380181630451, "deviation-heading": 2.262240256023796, "set_robot_commands": 0.09059075196584064, "deviation-center-line": 1.067962415499822, "driven_lanedir_consec": 3.742087276869941, "sim_compute_sim_state": 0.03646530866622925, "sim_compute_performance-ego": 0.06677495479583741, "sim_compute_robot_state-ego": 0.0705595866839091, "sim_compute_robot_state-npc0": 0.06733516216278077, "sim_compute_robot_state-npc1": 0.06486596584320069, "sim_compute_robot_state-npc2": 0.06476866642634074, "sim_compute_robot_state-npc3": 0.0646024481455485}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 2.612878294174509, "sim_physics": 0.16263309790163624, "survival_time": 14.700000000000074, "driven_lanedir": 2.4306487193687563, "sim_render-ego": 0.05863287578634664, "in-drivable-lane": 1.6500000000000234, "agent_compute-ego": 0.16582575379585734, "deviation-heading": 5.420816897029061, "set_robot_commands": 0.09164221676028504, "deviation-center-line": 1.197885946037198, "driven_lanedir_consec": 2.0656256711545056, "sim_compute_sim_state": 0.03645126998019056, "sim_compute_performance-ego": 0.06632480410491529, "sim_compute_robot_state-ego": 0.06964137278446535, "sim_compute_robot_state-npc0": 0.06554411138807024, "sim_compute_robot_state-npc1": 0.06411471577728686, "sim_compute_robot_state-npc2": 0.06464217876901432, "sim_compute_robot_state-npc3": 0.06445423194340297}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.4086570521625874, "sim_physics": 0.15182961225509645, "survival_time": 14.950000000000076, "driven_lanedir": 1.3149287011689903, "sim_render-ego": 0.05691541751225789, "in-drivable-lane": 4.099999999999985, "agent_compute-ego": 0.16447270393371582, "deviation-heading": 8.476768494662194, "set_robot_commands": 0.09010095755259195, "deviation-center-line": 0.8891936861898081, "driven_lanedir_consec": 1.254594619368286, "sim_compute_sim_state": 0.03670051495234171, "sim_compute_performance-ego": 0.06298758029937744, "sim_compute_robot_state-ego": 0.06820156415303548, "sim_compute_robot_state-npc0": 0.06556615670522054, "sim_compute_robot_state-npc1": 0.06560276110967, "sim_compute_robot_state-npc2": 0.06421844482421875, "sim_compute_robot_state-npc3": 0.06594360669453939}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.9093713446387544, "sim_physics": 0.15730951513562882, "survival_time": 6.999999999999983, "driven_lanedir": 1.7813941256582806, "sim_render-ego": 0.061457674843924386, "in-drivable-lane": 0.09999999999999964, "agent_compute-ego": 0.17157697677612305, "deviation-heading": 1.500030541342493, "set_robot_commands": 0.09291960852486748, "deviation-center-line": 0.2352082649629227, "driven_lanedir_consec": 1.7813941256582806, "sim_compute_sim_state": 0.03777547223227365, "sim_compute_performance-ego": 0.06616788932255337, "sim_compute_robot_state-ego": 0.07253009080886841, "sim_compute_robot_state-npc0": 0.06814404726028442, "sim_compute_robot_state-npc1": 0.06711064577102661, "sim_compute_robot_state-npc2": 0.06574511698314121, "sim_compute_robot_state-npc3": 0.06774926696504865}}
set_robot_commands_max0.09291960852486748
set_robot_commands_mean0.09036016839539925
set_robot_commands_median0.09059075196584064
set_robot_commands_min0.08654730717341105
sim_compute_performance-ego_max0.06677495479583741
sim_compute_performance-ego_mean0.06473702592914607
sim_compute_performance-ego_median0.06616788932255337
sim_compute_performance-ego_min0.06142990112304687
sim_compute_robot_state-ego_max0.07253009080886841
sim_compute_robot_state-ego_mean0.06931802424281633
sim_compute_robot_state-ego_median0.06964137278446535
sim_compute_robot_state-ego_min0.0656575067838033
sim_compute_robot_state-npc0_max0.06814404726028442
sim_compute_robot_state-npc0_mean0.06582761058353241
sim_compute_robot_state-npc0_median0.06556615670522054
sim_compute_robot_state-npc0_min0.06254857540130615
sim_compute_robot_state-npc1_max0.06711064577102661
sim_compute_robot_state-npc1_mean0.06465685362069785
sim_compute_robot_state-npc1_median0.06486596584320069
sim_compute_robot_state-npc1_min0.061590179602305097
sim_compute_robot_state-npc2_max0.06574511698314121
sim_compute_robot_state-npc2_mean0.06410814250894145
sim_compute_robot_state-npc2_median0.06464217876901432
sim_compute_robot_state-npc2_min0.061166305541992184
sim_compute_robot_state-npc3_max0.06774926696504865
sim_compute_robot_state-npc3_mean0.06498141134352911
sim_compute_robot_state-npc3_median0.0646024481455485
sim_compute_robot_state-npc3_min0.06215750296910604
sim_compute_sim_state_max0.03777547223227365
sim_compute_sim_state_mean0.036505278035896975
sim_compute_sim_state_median0.03646530866622925
sim_compute_sim_state_min0.03513382434844971
sim_physics_max0.17906782229741414
sim_physics_mean0.162060619432099
sim_physics_median0.1594630495707194
sim_physics_min0.15182961225509645
sim_render-ego_max0.061457674843924386
sim_render-ego_mean0.05840566890418124
sim_render-ego_median0.05846297740936279
sim_render-ego_min0.05655939896901448
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean13.31000000000006
survival_time_min6.999999999999983
223313408jp18813100494RL-TH-shiaido2-LFV-sim-validationstep1-simulationerroryes11700:12:17
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
(hidden)
223213416jp18813100494RL-TH-shiaido2-LFV-sim-validationstep1-simulationsuccessyes11700:15:58(hidden)
driven_lanedir_consec_median1.2580438506957332
survival_time_median4.749999999999991
deviation-center-line_median0.1709778304894985
in-drivable-lane_median0


other stats
agent_compute-ego_max0.186421237885952
agent_compute-ego_mean0.1634811872993364
agent_compute-ego_median0.16133998342826542
agent_compute-ego_min0.1479099675228721
deviation-center-line_max1.1320753038367135
deviation-center-line_mean0.36205692070584794
deviation-center-line_min0.10197035077862077
deviation-heading_max2.925601922534284
deviation-heading_mean1.3747463875384525
deviation-heading_median0.7827631633831899
deviation-heading_min0.416623550202254
driven_any_max3.192725188309568
driven_any_mean1.5218035838557185
driven_any_median1.6119628587810757
driven_any_min0.3748407069628104
driven_lanedir_consec_max3.102306128264719
driven_lanedir_consec_mean1.3810705780078862
driven_lanedir_consec_min0.33620562275774324
driven_lanedir_max3.102306128264719
driven_lanedir_mean1.3810705780078862
driven_lanedir_median1.2580438506957332
driven_lanedir_min0.33620562275774324
in-drivable-lane_max0.7499999999999973
in-drivable-lane_mean0.20000000000000015
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.5475524597576161, "sim_physics": 0.1902866289019585, "survival_time": 1.6000000000000008, "driven_lanedir": 0.5184875524460546, "sim_render-ego": 0.06517490744590759, "in-drivable-lane": 0, "agent_compute-ego": 0.186421237885952, "deviation-heading": 0.416623550202254, "set_robot_commands": 0.10628607124090196, "deviation-center-line": 0.10197035077862077, "driven_lanedir_consec": 0.5184875524460546, "sim_compute_sim_state": 0.04143783450126648, "sim_compute_performance-ego": 0.07095081359148026, "sim_compute_robot_state-ego": 0.07490003854036331, "sim_compute_robot_state-npc0": 0.07249683886766434, "sim_compute_robot_state-npc1": 0.07334111630916595, "sim_compute_robot_state-npc2": 0.07342071831226349, "sim_compute_robot_state-npc3": 0.07157215476036072}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.3748407069628104, "sim_physics": 0.18071763004575456, "survival_time": 1.4000000000000006, "driven_lanedir": 0.33620562275774324, "sim_render-ego": 0.057043101106371195, "in-drivable-lane": 0, "agent_compute-ego": 0.15559966223580496, "deviation-heading": 0.6016523243227658, "set_robot_commands": 0.09027866806302752, "deviation-center-line": 0.10799033914292748, "driven_lanedir_consec": 0.33620562275774324, "sim_compute_sim_state": 0.03605071987424578, "sim_compute_performance-ego": 0.06602322203772408, "sim_compute_robot_state-ego": 0.06492687974657331, "sim_compute_robot_state-npc0": 0.06292646271841866, "sim_compute_robot_state-npc1": 0.06834076983588082, "sim_compute_robot_state-npc2": 0.07268591438020978, "sim_compute_robot_state-npc3": 0.06726715394428798}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.6119628587810757, "sim_physics": 0.15812611830861945, "survival_time": 4.749999999999991, "driven_lanedir": 1.2580438506957332, "sim_render-ego": 0.053469015422620274, "in-drivable-lane": 0.7499999999999973, "agent_compute-ego": 0.1479099675228721, "deviation-heading": 0.7827631633831899, "set_robot_commands": 0.07991972471538343, "deviation-center-line": 0.1709778304894985, "driven_lanedir_consec": 1.2580438506957332, "sim_compute_sim_state": 0.03478398323059082, "sim_compute_performance-ego": 0.06110592892295435, "sim_compute_robot_state-ego": 0.06461988248323139, "sim_compute_robot_state-npc0": 0.05992673070807206, "sim_compute_robot_state-npc1": 0.0599736866198088, "sim_compute_robot_state-npc2": 0.05890616115770842, "sim_compute_robot_state-npc3": 0.061214800884849145}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 3.192725188309568, "sim_physics": 0.17002066453297934, "survival_time": 14.950000000000076, "driven_lanedir": 3.102306128264719, "sim_render-ego": 0.05933587233225505, "in-drivable-lane": 0, "agent_compute-ego": 0.16613508542378744, "deviation-heading": 2.925601922534284, "set_robot_commands": 0.09139331817626951, "deviation-center-line": 1.1320753038367135, "driven_lanedir_consec": 3.102306128264719, "sim_compute_sim_state": 0.03707913557688395, "sim_compute_performance-ego": 0.06752230962117513, "sim_compute_robot_state-ego": 0.07134349505106607, "sim_compute_robot_state-npc0": 0.06644055525461832, "sim_compute_robot_state-npc1": 0.06602872371673583, "sim_compute_robot_state-npc2": 0.06562368154525756, "sim_compute_robot_state-npc3": 0.06601786136627197}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.881936705467523, "sim_physics": 0.15356253230639097, "survival_time": 8.84999999999999, "driven_lanedir": 1.6903097358751815, "sim_render-ego": 0.055662075678507485, "in-drivable-lane": 0.25000000000000355, "agent_compute-ego": 0.16133998342826542, "deviation-heading": 2.147090977249769, "set_robot_commands": 0.08786082402460993, "deviation-center-line": 0.29727077928147916, "driven_lanedir_consec": 1.6903097358751815, "sim_compute_sim_state": 0.0370673446331994, "sim_compute_performance-ego": 0.06212713489424711, "sim_compute_robot_state-ego": 0.06649650422866735, "sim_compute_robot_state-npc0": 0.06516521259889764, "sim_compute_robot_state-npc1": 0.06453637080003986, "sim_compute_robot_state-npc2": 0.06370009271438512, "sim_compute_robot_state-npc3": 0.06599960219388627}}
set_robot_commands_max0.10628607124090196
set_robot_commands_mean0.09114772124403848
set_robot_commands_median0.09027866806302752
set_robot_commands_min0.07991972471538343
sim_compute_performance-ego_max0.07095081359148026
sim_compute_performance-ego_mean0.06554588181351619
sim_compute_performance-ego_median0.06602322203772408
sim_compute_performance-ego_min0.06110592892295435
sim_compute_robot_state-ego_max0.07490003854036331
sim_compute_robot_state-ego_mean0.06845736000998029
sim_compute_robot_state-ego_median0.06649650422866735
sim_compute_robot_state-ego_min0.06461988248323139
sim_compute_robot_state-npc0_max0.07249683886766434
sim_compute_robot_state-npc0_mean0.0653911600295342
sim_compute_robot_state-npc0_median0.06516521259889764
sim_compute_robot_state-npc0_min0.05992673070807206
sim_compute_robot_state-npc1_max0.07334111630916595
sim_compute_robot_state-npc1_mean0.06644413345632626
sim_compute_robot_state-npc1_median0.06602872371673583
sim_compute_robot_state-npc1_min0.0599736866198088
sim_compute_robot_state-npc2_max0.07342071831226349
sim_compute_robot_state-npc2_mean0.06686731362196488
sim_compute_robot_state-npc2_median0.06562368154525756
sim_compute_robot_state-npc2_min0.05890616115770842
sim_compute_robot_state-npc3_max0.07157215476036072
sim_compute_robot_state-npc3_mean0.06641431462993122
sim_compute_robot_state-npc3_median0.06601786136627197
sim_compute_robot_state-npc3_min0.061214800884849145
sim_compute_sim_state_max0.04143783450126648
sim_compute_sim_state_mean0.03728380356323728
sim_compute_sim_state_median0.0370673446331994
sim_compute_sim_state_min0.03478398323059082
sim_physics_max0.1902866289019585
sim_physics_mean0.17054271481914057
sim_physics_median0.17002066453297934
sim_physics_min0.15356253230639097
sim_render-ego_max0.06517490744590759
sim_render-ego_mean0.05813699439713232
sim_render-ego_median0.057043101106371195
sim_render-ego_min0.053469015422620274
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean6.310000000000012
survival_time_min1.4000000000000006
223103424jp18813100494RL-TH-shiaido2-LFV-sim-validationstep1-simulationsuccessyes11700:31:06(hidden)
driven_lanedir_consec_median2.6853739513856465
survival_time_median14.950000000000076
deviation-center-line_median0.904356570989936
in-drivable-lane_median0


other stats
agent_compute-ego_max0.16993042548497517
agent_compute-ego_mean0.1610130560874939
agent_compute-ego_median0.15860117355982462
agent_compute-ego_min0.15495229148864745
deviation-center-line_max1.2262029270835118
deviation-center-line_mean0.8070600915977242
deviation-center-line_min0.25243172547580756
deviation-heading_max4.70697477823008
deviation-heading_mean3.3700774614271567
deviation-heading_median3.596520086178101
deviation-heading_min1.9689577032995276
driven_any_max3.6679529495143193
driven_any_mean2.8002989199964845
driven_any_median2.798066880559286
driven_any_min2.0107297460871
driven_lanedir_consec_max3.612765573596355
driven_lanedir_consec_mean2.590162626986308
driven_lanedir_consec_min1.440758901329754
driven_lanedir_max3.612765573596355
driven_lanedir_mean2.6012680099921552
driven_lanedir_median2.6853739513856465
driven_lanedir_min1.440758901329754
in-drivable-lane_max2.3000000000000327
in-drivable-lane_mean0.5900000000000061
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 2.798066880559286, "sim_physics": 0.15062413771947225, "survival_time": 14.950000000000076, "driven_lanedir": 2.6853739513856465, "sim_render-ego": 0.057138010660807294, "in-drivable-lane": 0, "agent_compute-ego": 0.1633625356356303, "deviation-heading": 4.241814130061826, "set_robot_commands": 0.08751890261967978, "deviation-center-line": 0.904356570989936, "driven_lanedir_consec": 2.6853739513856465, "sim_compute_sim_state": 0.04147142648696899, "sim_compute_performance-ego": 0.0625065008799235, "sim_compute_robot_state-ego": 0.0651844596862793, "sim_compute_robot_state-npc0": 0.06423521041870117, "sim_compute_robot_state-npc1": 0.06215200185775757, "sim_compute_robot_state-npc2": 0.06553987661997478, "sim_compute_robot_state-npc3": 0.06267652273178101}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 3.6679529495143193, "sim_physics": 0.1711104933420817, "survival_time": 14.950000000000076, "driven_lanedir": 3.612765573596355, "sim_render-ego": 0.05780163923899333, "in-drivable-lane": 0, "agent_compute-ego": 0.15821885426839194, "deviation-heading": 2.336120609366247, "set_robot_commands": 0.08577289819717407, "deviation-center-line": 1.2262029270835118, "driven_lanedir_consec": 3.612765573596355, "sim_compute_sim_state": 0.038803377946217854, "sim_compute_performance-ego": 0.06558411200841267, "sim_compute_robot_state-ego": 0.06800716797510784, "sim_compute_robot_state-npc0": 0.0654430357615153, "sim_compute_robot_state-npc1": 0.06525684038798014, "sim_compute_robot_state-npc2": 0.06361711899439494, "sim_compute_robot_state-npc3": 0.06456395864486694}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 2.3280983853584063, "sim_physics": 0.15441890875498454, "survival_time": 14.950000000000076, "driven_lanedir": 2.1624555334621935, "sim_render-ego": 0.05657849868138631, "in-drivable-lane": 2.3000000000000327, "agent_compute-ego": 0.15860117355982462, "deviation-heading": 4.70697477823008, "set_robot_commands": 0.0906017557779948, "deviation-center-line": 0.6926233292200495, "driven_lanedir_consec": 2.106928618432955, "sim_compute_sim_state": 0.03690572738647461, "sim_compute_performance-ego": 0.06346465190251668, "sim_compute_robot_state-ego": 0.06723767280578613, "sim_compute_robot_state-npc0": 0.0637391193707784, "sim_compute_robot_state-npc1": 0.06457918564478557, "sim_compute_robot_state-npc2": 0.0648497215906779, "sim_compute_robot_state-npc3": 0.06489957014719645}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 3.196646638463311, "sim_physics": 0.1568604604403178, "survival_time": 14.950000000000076, "driven_lanedir": 3.104986090186827, "sim_render-ego": 0.060015067259470624, "in-drivable-lane": 0, "agent_compute-ego": 0.16993042548497517, "deviation-heading": 3.596520086178101, "set_robot_commands": 0.08948218584060669, "deviation-center-line": 0.9596859052193152, "driven_lanedir_consec": 3.104986090186827, "sim_compute_sim_state": 0.03680365800857544, "sim_compute_performance-ego": 0.06534903923670451, "sim_compute_robot_state-ego": 0.0710450530052185, "sim_compute_robot_state-npc0": 0.06627983967463176, "sim_compute_robot_state-npc1": 0.06588219165802002, "sim_compute_robot_state-npc2": 0.06427190065383911, "sim_compute_robot_state-npc3": 0.0661713202794393}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 2.0107297460871, "sim_physics": 0.13624010848999024, "survival_time": 6.249999999999986, "driven_lanedir": 1.440758901329754, "sim_render-ego": 0.055894140243530274, "in-drivable-lane": 0.6499999999999977, "agent_compute-ego": 0.15495229148864745, "deviation-heading": 1.9689577032995276, "set_robot_commands": 0.08353702926635742, "deviation-center-line": 0.25243172547580756, "driven_lanedir_consec": 1.440758901329754, "sim_compute_sim_state": 0.034356002807617185, "sim_compute_performance-ego": 0.06125058364868164, "sim_compute_robot_state-ego": 0.06394232368469238, "sim_compute_robot_state-npc0": 0.06324353218078613, "sim_compute_robot_state-npc1": 0.06079923439025879, "sim_compute_robot_state-npc2": 0.06020779991149902, "sim_compute_robot_state-npc3": 0.06356545639038086}}
set_robot_commands_max0.0906017557779948
set_robot_commands_mean0.08738255434036254
set_robot_commands_median0.08751890261967978
set_robot_commands_min0.08353702926635742
sim_compute_performance-ego_max0.06558411200841267
sim_compute_performance-ego_mean0.0636309775352478
sim_compute_performance-ego_median0.06346465190251668
sim_compute_performance-ego_min0.06125058364868164
sim_compute_robot_state-ego_max0.0710450530052185
sim_compute_robot_state-ego_mean0.06708333543141684
sim_compute_robot_state-ego_median0.06723767280578613
sim_compute_robot_state-ego_min0.06394232368469238
sim_compute_robot_state-npc0_max0.06627983967463176
sim_compute_robot_state-npc0_mean0.06458814748128254
sim_compute_robot_state-npc0_median0.06423521041870117
sim_compute_robot_state-npc0_min0.06324353218078613
sim_compute_robot_state-npc1_max0.06588219165802002
sim_compute_robot_state-npc1_mean0.06373389078776043
sim_compute_robot_state-npc1_median0.06457918564478557
sim_compute_robot_state-npc1_min0.06079923439025879
sim_compute_robot_state-npc2_max0.06553987661997478
sim_compute_robot_state-npc2_mean0.06369728355407715
sim_compute_robot_state-npc2_median0.06427190065383911
sim_compute_robot_state-npc2_min0.06020779991149902
sim_compute_robot_state-npc3_max0.0661713202794393
sim_compute_robot_state-npc3_mean0.0643753656387329
sim_compute_robot_state-npc3_median0.06456395864486694
sim_compute_robot_state-npc3_min0.06267652273178101
sim_compute_sim_state_max0.04147142648696899
sim_compute_sim_state_mean0.037668038527170815
sim_compute_sim_state_median0.03690572738647461
sim_compute_sim_state_min0.034356002807617185
sim_physics_max0.1711104933420817
sim_physics_mean0.15385082174936932
sim_physics_median0.15441890875498454
sim_physics_min0.13624010848999024
sim_render-ego_max0.060015067259470624
sim_render-ego_mean0.05748547121683757
sim_render-ego_median0.057138010660807294
sim_render-ego_min0.055894140243530274
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean13.21000000000006
survival_time_min6.249999999999986
222883443Bea Baselinesrotationaido2-LF-sim-testingstep1-simulationerroryes11700:44:09
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
(hidden)
222753486Eric LuTesting the RL solutionaido2-LF-sim-testingstep1-simulationsuccessyes11701 day, 3:57:46(hidden)
driven_lanedir_consec_median0.06367783568903462
survival_time_median1.4500000000000006
deviation-center-line_median0.04974186686138894
in-drivable-lane_median0.4000000000000003


other stats
agent_compute-ego_max0.25048987865447997
agent_compute-ego_mean0.185303342267423
agent_compute-ego_median0.1901712993095661
agent_compute-ego_min0.1265334569490873
deviation-center-line_max0.13716536430908818
deviation-center-line_mean0.062447022660311574
deviation-center-line_min0.020740182125360773
deviation-heading_max2.6587956694721475
deviation-heading_mean0.7539988129029603
deviation-heading_median0.6390550063134295
deviation-heading_min0.4542446118536185
driven_any_max0.8267848421065904
driven_any_mean0.19130854690630883
driven_any_median0.15118247004213617
driven_any_min0.09247893697680527
driven_lanedir_consec_max0.25845167083475795
driven_lanedir_consec_mean0.0759205222279397
driven_lanedir_consec_min0.05041774427903778
driven_lanedir_max0.25845167083475795
driven_lanedir_mean0.0759205222279397
driven_lanedir_median0.06367783568903462
driven_lanedir_min0.05041774427903778
in-drivable-lane_max2.949999999999994
in-drivable-lane_mean0.4833333333333332
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.8267848421065904, "sim_physics": 0.08469597192911002, "survival_time": 6.499999999999985, "driven_lanedir": 0.25845167083475795, "sim_render-ego": 0.04976728879488432, "in-drivable-lane": 2.949999999999994, "agent_compute-ego": 0.1265334569490873, "deviation-heading": 2.6587956694721475, "set_robot_commands": 0.07674078757946308, "deviation-center-line": 0.13716536430908818, "driven_lanedir_consec": 0.25845167083475795, "sim_compute_sim_state": 0.03311858727381779, "sim_compute_performance-ego": 0.05327652417696439, "sim_compute_robot_state-ego": 0.053633394608130824}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.17202377932961074, "sim_physics": 0.12061794365153591, "survival_time": 1.7000000000000008, "driven_lanedir": 0.07187352560193594, "sim_render-ego": 0.08646341632394229, "in-drivable-lane": 0.5500000000000005, "agent_compute-ego": 0.19860719933229337, "deviation-heading": 0.5989987151196788, "set_robot_commands": 0.13048308035906622, "deviation-center-line": 0.02538719315741941, "driven_lanedir_consec": 0.07187352560193594, "sim_compute_sim_state": 0.04096547295065487, "sim_compute_performance-ego": 0.0871279379900764, "sim_compute_robot_state-ego": 0.08124090643490062}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.09649483662110243, "sim_physics": 0.10450345591494913, "survival_time": 0.9500000000000004, "driven_lanedir": 0.06371220633826802, "sim_render-ego": 0.05041053420618961, "in-drivable-lane": 0, "agent_compute-ego": 0.13201436243559184, "deviation-heading": 0.5755681727747278, "set_robot_commands": 0.07876314614948474, "deviation-center-line": 0.08266439803926309, "driven_lanedir_consec": 0.06371220633826802, "sim_compute_sim_state": 0.03045025624726948, "sim_compute_performance-ego": 0.05527866514105546, "sim_compute_robot_state-ego": 0.05613283107155248}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.185603290561254, "sim_physics": 0.07909401770560973, "survival_time": 1.5500000000000007, "driven_lanedir": 0.053054835047705584, "sim_render-ego": 0.05317869494038244, "in-drivable-lane": 0.6000000000000004, "agent_compute-ego": 0.13353410843879945, "deviation-heading": 0.6724749648025801, "set_robot_commands": 0.06973055870302262, "deviation-center-line": 0.03909919462792472, "driven_lanedir_consec": 0.053054835047705584, "sim_compute_sim_state": 0.029895428688295422, "sim_compute_performance-ego": 0.05736698642853768, "sim_compute_robot_state-ego": 0.09072773687301144}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.1878462099345752, "sim_physics": 0.10623336633046468, "survival_time": 1.5000000000000009, "driven_lanedir": 0.087946364297947, "sim_render-ego": 0.05942589441935221, "in-drivable-lane": 0.30000000000000027, "agent_compute-ego": 0.15926391283671062, "deviation-heading": 0.6706635974468063, "set_robot_commands": 0.08467528025309244, "deviation-center-line": 0.04504364324207036, "driven_lanedir_consec": 0.087946364297947, "sim_compute_sim_state": 0.03698028723398845, "sim_compute_performance-ego": 0.062192988395690915, "sim_compute_robot_state-ego": 0.06524926026662191}, "ETHZ_autolab_technical_track-5-0": {"driven_any": 0.19789195631820497, "sim_physics": 0.10366132855415344, "survival_time": 1.6000000000000008, "driven_lanedir": 0.058039878827935265, "sim_render-ego": 0.05520235002040863, "in-drivable-lane": 0.6500000000000005, "agent_compute-ego": 0.1550941988825798, "deviation-heading": 0.6888255207987066, "set_robot_commands": 0.09197775274515152, "deviation-center-line": 0.04886445405353931, "driven_lanedir_consec": 0.058039878827935265, "sim_compute_sim_state": 0.03431142866611481, "sim_compute_performance-ego": 0.057771235704422, "sim_compute_robot_state-ego": 0.0671875849366188}, "ETHZ_autolab_technical_track-6-0": {"driven_any": 0.14970075277696282, "sim_physics": 0.08114846547444661, "survival_time": 1.5000000000000009, "driven_lanedir": 0.07020932384059586, "sim_render-ego": 0.04374246597290039, "in-drivable-lane": 0.3500000000000003, "agent_compute-ego": 0.25048987865447997, "deviation-heading": 0.6032116829345795, "set_robot_commands": 0.07076231638590495, "deviation-center-line": 0.07195604610468018, "driven_lanedir_consec": 0.07020932384059586, "sim_compute_sim_state": 0.02975594997406006, "sim_compute_performance-ego": 0.048803671201070147, "sim_compute_robot_state-ego": 0.0534111499786377}, "ETHZ_autolab_technical_track-7-0": {"driven_any": 0.10161179276842544, "sim_physics": 0.17568060159683227, "survival_time": 1.0000000000000002, "driven_lanedir": 0.06344695718209348, "sim_render-ego": 0.07885233163833619, "in-drivable-lane": 0, "agent_compute-ego": 0.24846017360687256, "deviation-heading": 0.6671361068899688, "set_robot_commands": 0.13474732637405396, "deviation-center-line": 0.08810896643006304, "driven_lanedir_consec": 0.06344695718209348, "sim_compute_sim_state": 0.05147743225097656, "sim_compute_performance-ego": 0.08842319250106812, "sim_compute_robot_state-ego": 0.1030389904975891}, "ETHZ_autolab_technical_track-8-0": {"driven_any": 0.15442761569424313, "sim_physics": 0.13997349245794888, "survival_time": 1.4500000000000006, "driven_lanedir": 0.05103714655676894, "sim_render-ego": 0.0656123161315918, "in-drivable-lane": 0.5000000000000003, "agent_compute-ego": 0.1901712993095661, "deviation-heading": 0.5767406422998546, "set_robot_commands": 0.11516002128864156, "deviation-center-line": 0.020740182125360773, "driven_lanedir_consec": 0.05103714655676894, "sim_compute_sim_state": 0.04332614767140355, "sim_compute_performance-ego": 0.07530630045923693, "sim_compute_robot_state-ego": 0.0897744688494452}, "ETHZ_autolab_technical_track-9-0": {"driven_any": 0.11410312382911052, "sim_physics": 0.1451069400424049, "survival_time": 1.0500000000000005, "driven_lanedir": 0.06367783568903462, "sim_render-ego": 0.07298793111528669, "in-drivable-lane": 0, "agent_compute-ego": 0.2023989132472447, "deviation-heading": 0.6390550063134295, "set_robot_commands": 0.10607482138134185, "deviation-center-line": 0.07130533080692798, "driven_lanedir_consec": 0.06367783568903462, "sim_compute_sim_state": 0.04612764858064197, "sim_compute_performance-ego": 0.07775064877101354, "sim_compute_robot_state-ego": 0.08006079991658528}, "ETHZ_autolab_technical_track-10-0": {"driven_any": 0.09247893697680527, "sim_physics": 0.13707466352553593, "survival_time": 1.0500000000000005, "driven_lanedir": 0.05041774427903778, "sim_render-ego": 0.07592521395002093, "in-drivable-lane": 0, "agent_compute-ego": 0.18822515578497023, "deviation-heading": 0.6055245772068751, "set_robot_commands": 0.10626685051690964, "deviation-center-line": 0.08887284279543603, "driven_lanedir_consec": 0.05041774427903778, "sim_compute_sim_state": 0.04308347474961054, "sim_compute_performance-ego": 0.07226393336341494, "sim_compute_robot_state-ego": 0.07627144313993908}, "ETHZ_autolab_technical_track-11-0": {"driven_any": 0.14492437713889245, "sim_physics": 0.16515412500926427, "survival_time": 1.4000000000000006, "driven_lanedir": 0.05130562947818762, "sim_render-ego": 0.07190895080566406, "in-drivable-lane": 0.4000000000000003, "agent_compute-ego": 0.19885980231421335, "deviation-heading": 0.6411746685685318, "set_robot_commands": 0.11241357667105538, "deviation-center-line": 0.04974186686138894, "driven_lanedir_consec": 0.05130562947818762, "sim_compute_sim_state": 0.04248306580952236, "sim_compute_performance-ego": 0.07620636905942645, "sim_compute_robot_state-ego": 0.09645531858716692}, "ETHZ_autolab_technical_track-12-0": {"driven_any": 0.1925943741248424, "sim_physics": 0.1336524710059166, "survival_time": 1.6000000000000008, "driven_lanedir": 0.06821388655818905, "sim_render-ego": 0.0713479295372963, "in-drivable-lane": 0.5500000000000005, "agent_compute-ego": 0.20590143650770187, "deviation-heading": 0.576845938160491, "set_robot_commands": 0.11590152978897096, "deviation-center-line": 0.03738790650798199, "driven_lanedir_consec": 0.06821388655818905, "sim_compute_sim_state": 0.04496585577726364, "sim_compute_performance-ego": 0.08037322014570236, "sim_compute_robot_state-ego": 0.08837568014860153}, "ETHZ_autolab_technical_track-13-0": {"driven_any": 0.15118247004213617, "sim_physics": 0.14187608446393693, "survival_time": 1.4000000000000006, "driven_lanedir": 0.055727843728325066, "sim_render-ego": 0.07353863545826503, "in-drivable-lane": 0.4000000000000003, "agent_compute-ego": 0.1817237905093602, "deviation-heading": 0.6807223189024116, "set_robot_commands": 0.10466604573386055, "deviation-center-line": 0.03249332564558453, "driven_lanedir_consec": 0.055727843728325066, "sim_compute_sim_state": 0.04349757092339652, "sim_compute_performance-ego": 0.08023187943867274, "sim_compute_robot_state-ego": 0.0841423783983503}, "ETHZ_autolab_technical_track-14-0": {"driven_any": 0.10195984537187595, "sim_physics": 0.16032921075820922, "survival_time": 1.0000000000000002, "driven_lanedir": 0.07169298515831324, "sim_render-ego": 0.07264488935470581, "in-drivable-lane": 0, "agent_compute-ego": 0.20827244520187377, "deviation-heading": 0.4542446118536185, "set_robot_commands": 0.10709511041641236, "deviation-center-line": 0.09787462519794515, "driven_lanedir_consec": 0.07169298515831324, "sim_compute_sim_state": 0.04552516937255859, "sim_compute_performance-ego": 0.08079593181610108, "sim_compute_robot_state-ego": 0.09639257192611694}}
set_robot_commands_max0.13474732637405396
set_robot_commands_mean0.10036388028976212
set_robot_commands_median0.10607482138134185
set_robot_commands_min0.06973055870302262
sim_compute_performance-ego_max0.08842319250106812
sim_compute_performance-ego_mean0.07021129897283021
sim_compute_performance-ego_median0.07530630045923693
sim_compute_performance-ego_min0.048803671201070147
sim_compute_robot_state-ego_max0.1030389904975891
sim_compute_robot_state-ego_mean0.07880630104221789
sim_compute_robot_state-ego_median0.08124090643490062
sim_compute_robot_state-ego_min0.0534111499786377
sim_compute_sim_state_max0.05147743225097656
sim_compute_sim_state_mean0.03973091841130498
sim_compute_sim_state_median0.04248306580952236
sim_compute_sim_state_min0.02975594997406006
sim_physics_max0.17568060159683227
sim_physics_mean0.1252534758946879
sim_physics_median0.1336524710059166
sim_physics_min0.07909401770560973
sim_render-ego_max0.08646341632394229
sim_render-ego_mean0.06540058951128178
sim_render-ego_median0.0713479295372963
sim_render-ego_min0.04374246597290039
simulation-passed1
survival_time_max6.499999999999985
survival_time_mean1.683333333333333
survival_time_min0.9500000000000004
222633502MYFtestaido2-LF-sim-testingstep1-simulationerroryes11700:31:46
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
(hidden)
222433371AmaurXchallenge-aido_LF-template-randomaido2-LFVI-sim-testingstep1-simulationsuccessyes11700:27:33(hidden)
driven_lanedir_consec_median0.6537162971975778
survival_time_median2.5999999999999988
deviation-center-line_median0.14884708769804722
in-drivable-lane_median0.549999999999998


other stats
agent_compute-ego_max0.15284274295418562
agent_compute-ego_mean0.1389760730366271
agent_compute-ego_median0.14101755160551804
agent_compute-ego_min0.11352571656432332
deviation-center-line_max0.5141120095458062
deviation-center-line_mean0.1769000227005324
deviation-center-line_min0.06216029860587694
deviation-heading_max1.9929437250081896
deviation-heading_mean0.692977823395608
deviation-heading_median0.4928440244444201
deviation-heading_min0.24234723632033853
driven_any_max3.5343244022418343
driven_any_mean1.3470385992234175
driven_any_median1.001633421251194
driven_any_min0.3412551960104244
driven_lanedir_consec_max2.494308053441959
driven_lanedir_consec_mean0.881391085527715
driven_lanedir_consec_min0.3199180625488627
driven_lanedir_max2.494308053441959
driven_lanedir_mean0.8962528018383226
driven_lanedir_median0.7206363324756615
driven_lanedir_min0.3199180625488627
in-drivable-lane_max3.549999999999991
in-drivable-lane_mean0.839999999999998
in-drivable-lane_min0
per-episodes
details{"udem1-0-0": {"driven_any": 1.5811782993597916, "sim_physics": 0.15207772617098653, "survival_time": 3.949999999999994, "driven_lanedir": 0.9217908232230632, "sim_render-ego": 0.04570551461811307, "in-drivable-lane": 1.3499999999999952, "agent_compute-ego": 0.11352571656432332, "deviation-heading": 0.5694288623982039, "set_robot_commands": 0.06939254531377478, "deviation-center-line": 0.2348196785686717, "driven_lanedir_consec": 0.9213701538661684, "sim_compute_sim_state": 0.029152345053757293, "sim_compute_performance-ego": 0.0496189413191397, "sim_compute_robot_state-ego": 0.05444100536877596, "sim_compute_robot_state-npc0": 0.05037228970588008, "sim_compute_robot_state-npc1": 0.05192792566516732, "sim_compute_robot_state-npc2": 0.049318455442597595, "sim_compute_robot_state-npc3": 0.050767406632628624}, "udem1-1-0": {"driven_any": 0.47798123795353353, "sim_physics": 0.15187386955533708, "survival_time": 1.4000000000000006, "driven_lanedir": 0.4500753586658095, "sim_render-ego": 0.0524679252079555, "in-drivable-lane": 0, "agent_compute-ego": 0.12913919346673147, "deviation-heading": 0.46504862964833654, "set_robot_commands": 0.07927133355821882, "deviation-center-line": 0.09791133281082, "driven_lanedir_consec": 0.4500753586658095, "sim_compute_sim_state": 0.03683925526482718, "sim_compute_performance-ego": 0.056170719010489326, "sim_compute_robot_state-ego": 0.059978791645595005, "sim_compute_robot_state-npc0": 0.0565274783543178, "sim_compute_robot_state-npc1": 0.05540902273995536, "sim_compute_robot_state-npc2": 0.05425804001944406, "sim_compute_robot_state-npc3": 0.0552699225289481}, "udem1-2-0": {"driven_any": 2.1864003300000694, "sim_physics": 0.18483692234002272, "survival_time": 5.14999999999999, "driven_lanedir": 1.826231945363564, "sim_render-ego": 0.06176399027259605, "in-drivable-lane": 0.549999999999998, "agent_compute-ego": 0.14877219801967584, "deviation-heading": 0.8115272458314897, "set_robot_commands": 0.09145886921188208, "deviation-center-line": 0.1927316041609401, "driven_lanedir_consec": 1.826231945363564, "sim_compute_sim_state": 0.03851457012509837, "sim_compute_performance-ego": 0.0650154502646437, "sim_compute_robot_state-ego": 0.06870469537753503, "sim_compute_robot_state-npc0": 0.06853022853147636, "sim_compute_robot_state-npc1": 0.06678659939071507, "sim_compute_robot_state-npc2": 0.06673416582126061, "sim_compute_robot_state-npc3": 0.0658057685037261}, "udem1-3-0": {"driven_any": 0.9410513078477724, "sim_physics": 0.20133942862351736, "survival_time": 2.3999999999999995, "driven_lanedir": 0.493517638549009, "sim_render-ego": 0.05787234008312225, "in-drivable-lane": 0.8999999999999988, "agent_compute-ego": 0.1397484689950943, "deviation-heading": 0.35154027506548424, "set_robot_commands": 0.08420828978220622, "deviation-center-line": 0.08975118546699407, "driven_lanedir_consec": 0.493517638549009, "sim_compute_sim_state": 0.03961726029713949, "sim_compute_performance-ego": 0.0652184287707011, "sim_compute_robot_state-ego": 0.07237879931926727, "sim_compute_robot_state-npc0": 0.06464627881844838, "sim_compute_robot_state-npc1": 0.07054537038008372, "sim_compute_robot_state-npc2": 0.06333055595556895, "sim_compute_robot_state-npc3": 0.0682753175497055}, "udem1-4-0": {"driven_any": 0.34749292376309954, "sim_physics": 0.1934224878038679, "survival_time": 1.0500000000000005, "driven_lanedir": 0.3325249708009643, "sim_render-ego": 0.05934523400806245, "in-drivable-lane": 0, "agent_compute-ego": 0.14104469617207846, "deviation-heading": 0.30044835691402494, "set_robot_commands": 0.07958488237290155, "deviation-center-line": 0.06216029860587694, "driven_lanedir_consec": 0.3325249708009643, "sim_compute_sim_state": 0.03960812659490676, "sim_compute_performance-ego": 0.06937974975222633, "sim_compute_robot_state-ego": 0.07549651463826497, "sim_compute_robot_state-npc0": 0.0648859114873977, "sim_compute_robot_state-npc1": 0.06110496748061407, "sim_compute_robot_state-npc2": 0.06711194628760928, "sim_compute_robot_state-npc3": 0.0663223493666876}, "udem1-5-0": {"driven_any": 3.5343244022418343, "sim_physics": 0.19562299237279832, "survival_time": 8.349999999999984, "driven_lanedir": 2.494308053441959, "sim_render-ego": 0.0634358585951571, "in-drivable-lane": 2, "agent_compute-ego": 0.15284274295418562, "deviation-heading": 1.9929437250081896, "set_robot_commands": 0.0942087330504092, "deviation-center-line": 0.5141120095458062, "driven_lanedir_consec": 2.494308053441959, "sim_compute_sim_state": 0.03867934278385368, "sim_compute_performance-ego": 0.06742804064722119, "sim_compute_robot_state-ego": 0.07363343238830566, "sim_compute_robot_state-npc0": 0.06855054815372306, "sim_compute_robot_state-npc1": 0.06713665745215501, "sim_compute_robot_state-npc2": 0.06753144007243082, "sim_compute_robot_state-npc3": 0.06734143616910467}, "udem1-6-0": {"driven_any": 2.176040550989443, "sim_physics": 0.2016110535964225, "survival_time": 5.14999999999999, "driven_lanedir": 1.9748003483573369, "sim_render-ego": 0.05901173017557385, "in-drivable-lane": 0.29999999999999893, "agent_compute-ego": 0.14692489383290114, "deviation-heading": 0.7877172510198454, "set_robot_commands": 0.08957806837211535, "deviation-center-line": 0.30661477465861414, "driven_lanedir_consec": 1.9748003483573369, "sim_compute_sim_state": 0.04028066385139539, "sim_compute_performance-ego": 0.06638032487295206, "sim_compute_robot_state-ego": 0.06875058053766639, "sim_compute_robot_state-npc0": 0.06517222089674866, "sim_compute_robot_state-npc1": 0.06698437801842551, "sim_compute_robot_state-npc2": 0.06575310808940998, "sim_compute_robot_state-npc3": 0.06498588173134813}, "udem1-7-0": {"driven_any": 1.0050236108346422, "sim_physics": 0.2084524631500244, "survival_time": 2.499999999999999, "driven_lanedir": 0.8701796426684156, "sim_render-ego": 0.06019917964935303, "in-drivable-lane": 0, "agent_compute-ego": 0.1469633340835571, "deviation-heading": 0.9227446658975216, "set_robot_commands": 0.09319165706634522, "deviation-center-line": 0.14884708769804722, "driven_lanedir_consec": 0.8546116490381102, "sim_compute_sim_state": 0.039212522506713865, "sim_compute_performance-ego": 0.06549994945526123, "sim_compute_robot_state-ego": 0.07060802459716797, "sim_compute_robot_state-npc0": 0.06986909866333008, "sim_compute_robot_state-npc1": 0.06824799537658692, "sim_compute_robot_state-npc2": 0.06760644435882568, "sim_compute_robot_state-npc3": 0.07096383571624756}, "udem1-8-0": {"driven_any": 0.9970416603019576, "sim_physics": 0.1898782757612375, "survival_time": 2.5999999999999988, "driven_lanedir": 0.8041152574540316, "sim_render-ego": 0.06001604061860304, "in-drivable-lane": 0.29999999999999893, "agent_compute-ego": 0.14101755160551804, "deviation-heading": 0.6817155913229235, "set_robot_commands": 0.09204180882527278, "deviation-center-line": 0.1898768080806288, "driven_lanedir_consec": 0.8041152574540316, "sim_compute_sim_state": 0.037646201940683216, "sim_compute_performance-ego": 0.06593385568031898, "sim_compute_robot_state-ego": 0.06956790960752048, "sim_compute_robot_state-npc0": 0.0658245453467736, "sim_compute_robot_state-npc1": 0.06798773545485276, "sim_compute_robot_state-npc2": 0.0672946022107051, "sim_compute_robot_state-npc3": 0.06544340115327102}, "udem1-9-0": {"driven_any": 0.4374998710472299, "sim_physics": 0.2169507741928101, "survival_time": 1.3000000000000005, "driven_lanedir": 0.4177527119659043, "sim_render-ego": 0.06410253047943115, "in-drivable-lane": 0, "agent_compute-ego": 0.14377412429222694, "deviation-heading": 0.3796137446285097, "set_robot_commands": 0.07721329652346097, "deviation-center-line": 0.08207813392324871, "driven_lanedir_consec": 0.4177527119659043, "sim_compute_sim_state": 0.03754541507134071, "sim_compute_performance-ego": 0.06886683977567233, "sim_compute_robot_state-ego": 0.07164738728449895, "sim_compute_robot_state-npc0": 0.05748748779296875, "sim_compute_robot_state-npc1": 0.06110611328711876, "sim_compute_robot_state-npc2": 0.06475905271676871, "sim_compute_robot_state-npc3": 0.05855944523444542}, "udem1-10-0": {"driven_any": 0.3412551960104244, "sim_physics": 0.14809103445573288, "survival_time": 1.1000000000000003, "driven_lanedir": 0.3199180625488627, "sim_render-ego": 0.04630926522341641, "in-drivable-lane": 0, "agent_compute-ego": 0.12010794336145576, "deviation-heading": 0.3796986873122644, "set_robot_commands": 0.0737856084650213, "deviation-center-line": 0.06276575300040536, "driven_lanedir_consec": 0.3199180625488627, "sim_compute_sim_state": 0.028044397180730648, "sim_compute_performance-ego": 0.051333958452398125, "sim_compute_robot_state-ego": 0.05179762840270996, "sim_compute_robot_state-npc0": 0.04942713000557639, "sim_compute_robot_state-npc1": 0.04824194041165439, "sim_compute_robot_state-npc2": 0.04873067682439631, "sim_compute_robot_state-npc3": 0.05121774023229426}, "udem1-11-0": {"driven_any": 0.9951985237696338, "sim_physics": 0.16938559532165529, "survival_time": 2.499999999999999, "driven_lanedir": 0.7206363324756615, "sim_render-ego": 0.05834739208221436, "in-drivable-lane": 0.549999999999998, "agent_compute-ego": 0.13397613048553467, "deviation-heading": 0.30074636349085415, "set_robot_commands": 0.08734458446502685, "deviation-center-line": 0.16567670185555422, "driven_lanedir_consec": 0.7185075497455284, "sim_compute_sim_state": 0.03670097827911377, "sim_compute_performance-ego": 0.06331414699554444, "sim_compute_robot_state-ego": 0.06611420154571533, "sim_compute_robot_state-npc0": 0.06355718612670898, "sim_compute_robot_state-npc1": 0.06462915420532227, "sim_compute_robot_state-npc2": 0.06562133312225342, "sim_compute_robot_state-npc3": 0.0655593729019165}, "udem1-12-0": {"driven_any": 1.964687870253437, "sim_physics": 0.19544417046486065, "survival_time": 4.699999999999991, "driven_lanedir": 0.35162821871931205, "sim_render-ego": 0.05966703942481508, "in-drivable-lane": 3.549999999999991, "agent_compute-ego": 0.14727406806134163, "deviation-heading": 0.24234723632033853, "set_robot_commands": 0.09151381634651348, "deviation-center-line": 0.13126670634798973, "driven_lanedir_consec": 0.35162821871931205, "sim_compute_sim_state": 0.03709340602793592, "sim_compute_performance-ego": 0.0671356459881397, "sim_compute_robot_state-ego": 0.07044849243569881, "sim_compute_robot_state-npc0": 0.06600507269514368, "sim_compute_robot_state-npc1": 0.0664763222349451, "sim_compute_robot_state-npc2": 0.06481939934669657, "sim_compute_robot_state-npc3": 0.06726677113390983}, "udem1-13-0": {"driven_any": 1.001633421251194, "sim_physics": 0.19323916618640608, "survival_time": 2.5999999999999988, "driven_lanedir": 0.6537162971975778, "sim_render-ego": 0.05675416267835177, "in-drivable-lane": 0.5999999999999979, "agent_compute-ego": 0.14085448246735793, "deviation-heading": 0.4928440244444201, "set_robot_commands": 0.09070884264432467, "deviation-center-line": 0.13361893417935136, "driven_lanedir_consec": 0.6537162971975778, "sim_compute_sim_state": 0.037528615731459394, "sim_compute_performance-ego": 0.06540880294946524, "sim_compute_robot_state-ego": 0.0683485590494596, "sim_compute_robot_state-npc0": 0.062012236851912275, "sim_compute_robot_state-npc1": 0.06202433659480168, "sim_compute_robot_state-npc2": 0.0631749492425185, "sim_compute_robot_state-npc3": 0.06530338984269363}, "udem1-14-0": {"driven_any": 2.218769782727203, "sim_physics": 0.17780730837867373, "survival_time": 5.249999999999989, "driven_lanedir": 0.8125963661433656, "sim_render-ego": 0.05484543527875628, "in-drivable-lane": 2.499999999999993, "agent_compute-ego": 0.13867555118742445, "deviation-heading": 1.7163026916317128, "set_robot_commands": 0.08519623620169503, "deviation-center-line": 0.24126933160503777, "driven_lanedir_consec": 0.6077880672015845, "sim_compute_sim_state": 0.05763060706002371, "sim_compute_performance-ego": 0.059641583760579424, "sim_compute_robot_state-ego": 0.0636707964397612, "sim_compute_robot_state-npc0": 0.06126974196661086, "sim_compute_robot_state-npc1": 0.06115427471342541, "sim_compute_robot_state-npc2": 0.062056205386207215, "sim_compute_robot_state-npc3": 0.06124926521664574}}
set_robot_commands_max0.0942087330504092
set_robot_commands_mean0.08524657147994456
set_robot_commands_median0.08734458446502685
set_robot_commands_min0.06939254531377478
sim_compute_performance-ego_max0.06937974975222633
sim_compute_performance-ego_mean0.06308976251298352
sim_compute_performance-ego_median0.06540880294946524
sim_compute_performance-ego_min0.0496189413191397
sim_compute_robot_state-ego_max0.07549651463826497
sim_compute_robot_state-ego_mean0.0670391212425295
sim_compute_robot_state-ego_median0.06875058053766639
sim_compute_robot_state-ego_min0.05179762840270996
sim_compute_robot_state-npc0_max0.06986909866333008
sim_compute_robot_state-npc0_mean0.06227583035980112
sim_compute_robot_state-npc0_median0.06464627881844838
sim_compute_robot_state-npc0_min0.04942713000557639
sim_compute_robot_state-npc1_max0.07054537038008372
sim_compute_robot_state-npc1_mean0.06265085289372156
sim_compute_robot_state-npc1_median0.06462915420532227
sim_compute_robot_state-npc1_min0.04824194041165439
sim_compute_robot_state-npc2_max0.06760644435882568
sim_compute_robot_state-npc2_mean0.06254002499311286
sim_compute_robot_state-npc2_median0.06481939934669657
sim_compute_robot_state-npc2_min0.04873067682439631
sim_compute_robot_state-npc3_max0.07096383571624756
sim_compute_robot_state-npc3_mean0.06295542026090485
sim_compute_robot_state-npc3_median0.06544340115327102
sim_compute_robot_state-npc3_min0.050767406632628624
sim_compute_sim_state_max0.05763060706002371
sim_compute_sim_state_mean0.0382729138512653
sim_compute_sim_state_median0.037646201940683216
sim_compute_sim_state_min0.028044397180730648
sim_physics_max0.2169507741928101
sim_physics_mean0.18533555122495687
sim_physics_median0.19323916618640608
sim_physics_min0.14809103445573288
sim_render-ego_max0.06410253047943115
sim_render-ego_mean0.057322909226368096
sim_render-ego_median0.05901173017557385
sim_render-ego_min0.04570551461811307
simulation-passed1
survival_time_max8.349999999999984
survival_time_mean3.3333333333333286
survival_time_min1.0500000000000005
222382516Liam Paullchallenge-aido_LF-baseline-duckietownaido2-LF-sim-testingstep1-simulationhost-erroryes11700:02:21
Uncaught exception w [...]
Uncaught exception while running Docker Compose:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 759, in run_one
    run_docker(wd, project, cmd)
  File "/project/src/duckietown_challenges_runner/runner.py", line 1100, in run_docker
    subprocess.check_call(cmd0, cwd=cwd, stdout=tee_stdout, stderr=tee_stderr)
  File "/usr/lib/python3.6/subprocess.py", line 286, in check_call
    retcode = call(*popenargs, **kwargs)
  File "/usr/lib/python3.6/subprocess.py", line 267, in call
    with Popen(*popenargs, **kwargs) as p:
  File "/usr/lib/python3.6/subprocess.py", line 709, in __init__
    restore_signals, start_new_session)
  File "/usr/lib/python3.6/subprocess.py", line 1344, in _execute_child
    raise child_exception_type(errno_num, err_msg, err_filename)
FileNotFoundError: [Errno 2] No such file or directory: '/tmp/duckietown/DT18/evaluator/executions/aido2-LF-sim-testing/submission2516/step1-simulation-ip-172-31-42-167-7227-job22238': '/tmp/duckietown/DT18/evaluator/executions/aido2-LF-sim-testing/submission2516/step1-simulation-ip-172-31-42-167-7227-job22238'
(hidden)
222282873almasipchallenge-aido_LF-template-pytorchaido2-LF-sim-validationstep1-simulationsuccessyes11700:08:40(hidden)
driven_lanedir_consec_median0.09961531722234862
survival_time_median1.6500000000000008
deviation-center-line_median0.04987285137994037
in-drivable-lane_median0.4500000000000004


other stats
agent_compute-ego_max0.16820432080162895
agent_compute-ego_mean0.15956264209695883
agent_compute-ego_median0.16390464522621848
agent_compute-ego_min0.14047913802297493
deviation-center-line_max0.432567895594584
deviation-center-line_mean0.13207635699799877
deviation-center-line_min0.045928609215654045
deviation-heading_max5.523263516698244
deviation-heading_mean1.681879291579813
deviation-heading_median0.7649954370880971
deviation-heading_min0.577888224526248
driven_any_max1.95293972861085
driven_any_mean0.5311400455593419
driven_any_median0.19547117711578071
driven_any_min0.09959056097976744
driven_lanedir_consec_max0.6138489815617549
driven_lanedir_consec_mean0.19064283524028425
driven_lanedir_consec_min0.05930083493455784
driven_lanedir_max0.6138489815617549
driven_lanedir_mean0.19064283524028425
driven_lanedir_median0.09961531722234862
driven_lanedir_min0.05930083493455784
in-drivable-lane_max7.000000000000033
in-drivable-lane_mean1.6500000000000068
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.95293972861085, "sim_physics": 0.10342413562161104, "survival_time": 14.300000000000068, "driven_lanedir": 0.6138489815617549, "sim_render-ego": 0.05950220064683394, "in-drivable-lane": 7.000000000000033, "agent_compute-ego": 0.1609252532878956, "deviation-heading": 5.523263516698244, "set_robot_commands": 0.09181046902716576, "deviation-center-line": 0.432567895594584, "driven_lanedir_consec": 0.6138489815617549, "sim_compute_sim_state": 0.03754695312126533, "sim_compute_performance-ego": 0.06796296826609365, "sim_compute_robot_state-ego": 0.07055984760497834}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.1859469308962671, "sim_physics": 0.12182507663965224, "survival_time": 1.6000000000000008, "driven_lanedir": 0.09961531722234862, "sim_render-ego": 0.061429888010025024, "in-drivable-lane": 0.2500000000000002, "agent_compute-ego": 0.1642998531460762, "deviation-heading": 0.7649954370880971, "set_robot_commands": 0.0965668559074402, "deviation-center-line": 0.045928609215654045, "driven_lanedir_consec": 0.09961531722234862, "sim_compute_sim_state": 0.04166921228170395, "sim_compute_performance-ego": 0.06727860122919083, "sim_compute_robot_state-ego": 0.07364858686923981}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.09959056097976744, "sim_physics": 0.09187915450648258, "survival_time": 0.9500000000000004, "driven_lanedir": 0.06585589022440708, "sim_render-ego": 0.0502731298145495, "in-drivable-lane": 0, "agent_compute-ego": 0.14047913802297493, "deviation-heading": 0.577888224526248, "set_robot_commands": 0.08007468675312243, "deviation-center-line": 0.08436587838873519, "driven_lanedir_consec": 0.06585589022440708, "sim_compute_sim_state": 0.031740502307289524, "sim_compute_performance-ego": 0.06019889680962814, "sim_compute_robot_state-ego": 0.055345736051860606}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.19547117711578071, "sim_physics": 0.1066137154897054, "survival_time": 1.6500000000000008, "driven_lanedir": 0.05930083493455784, "sim_render-ego": 0.0568210067171039, "in-drivable-lane": 0.5500000000000005, "agent_compute-ego": 0.16390464522621848, "deviation-heading": 0.8231297426676447, "set_robot_commands": 0.0973442540024266, "deviation-center-line": 0.04764655041108008, "driven_lanedir_consec": 0.05930083493455784, "sim_compute_sim_state": 0.0391867377541282, "sim_compute_performance-ego": 0.06435211499532063, "sim_compute_robot_state-ego": 0.07350105227846088}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.22175183019404412, "sim_physics": 0.1253992517789205, "survival_time": 1.800000000000001, "driven_lanedir": 0.11459315225835276, "sim_render-ego": 0.06388092703289455, "in-drivable-lane": 0.4500000000000004, "agent_compute-ego": 0.16820432080162895, "deviation-heading": 0.720119536918831, "set_robot_commands": 0.09970845778783162, "deviation-center-line": 0.04987285137994037, "driven_lanedir_consec": 0.11459315225835276, "sim_compute_sim_state": 0.04097011354234484, "sim_compute_performance-ego": 0.07725827561484443, "sim_compute_robot_state-ego": 0.0841803749402364}}
set_robot_commands_max0.09970845778783162
set_robot_commands_mean0.09310094469559732
set_robot_commands_median0.0965668559074402
set_robot_commands_min0.08007468675312243
sim_compute_performance-ego_max0.07725827561484443
sim_compute_performance-ego_mean0.06741017138301554
sim_compute_performance-ego_median0.06727860122919083
sim_compute_performance-ego_min0.06019889680962814
sim_compute_robot_state-ego_max0.0841803749402364
sim_compute_robot_state-ego_mean0.0714471195489552
sim_compute_robot_state-ego_median0.07350105227846088
sim_compute_robot_state-ego_min0.055345736051860606
sim_compute_sim_state_max0.04166921228170395
sim_compute_sim_state_mean0.03822270380134637
sim_compute_sim_state_median0.0391867377541282
sim_compute_sim_state_min0.031740502307289524
sim_physics_max0.1253992517789205
sim_physics_mean0.10982826680727437
sim_physics_median0.1066137154897054
sim_physics_min0.09187915450648258
sim_render-ego_max0.06388092703289455
sim_render-ego_mean0.05838143044428138
sim_render-ego_median0.05950220064683394
sim_render-ego_min0.0502731298145495
simulation-passed1
survival_time_max14.300000000000068
survival_time_mean4.060000000000015
survival_time_min0.9500000000000004