Duckietown Challenges Home Challenges Submissions

Evaluator 1170

ID1170
evaluatorip-172-31-42-167-7227
ownerI don't have one 😀
machineip-172-31-42-167
processip-172-31-42-167-7227
versiond-c:4.0.30;d-c-r:4.0.44;d-s:4.0.22
first heard
last heard
statusinactive
# evaluating
# success26 22228
# timeout
# failed3 22429
# error31 22263
# aborted
# host-error1 22238
arm
x86_64
Mac
gpu available
Number of processors
Processor frequency (MHz)
Free % of processors
RAM total (MB)
RAM free (MB)
Disk (MB)
Disk available (MB)
Docker Hub
P1
P2
Cloud simulations
PI Camera
# Duckiebots
Map 3x3 avaiable
Number of duckies
gpu cores
AIDO 2 Map LF public
AIDO 2 Map LF private
AIDO 2 Map LFV public
AIDO 2 Map LFV private
AIDO 2 Map LFVI public
AIDO 2 Map LFVI private
AIDO 3 Map LF public
AIDO 3 Map LF private
AIDO 3 Map LFV public
AIDO 3 Map LFV private
AIDO 3 Map LFVI public
AIDO 3 Map LFVI private
AIDO 5 Map large loop
ETU track
for 2021, map is ETH_small_inter
IPFS mountpoint /ipfs available
IPNS mountpoint /ipns available

Evaluator jobs

Job IDsubmissionuseruser labelchallengestepstatusup to dateevaluatordate starteddate completeddurationmessage
230653550Amaury Camus 🇨🇭Running the real lane following -- without challenge containeraido2-LF-sim-testingstep1-simulationerroryesip-172-31-42-167-72270:07:40
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
230022404Victor Guerra 🇫🇷Baseline solution using reinforcement learningaido2-LFV-sim-testingstep1-simulationsuccessyesip-172-31-42-167-72270:43:51
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.06012441230310195
survival_time_median1.6500000000000008
deviation-center-line_median0.07695572070673869
in-drivable-lane_median0.5500000000000005


other stats
agent_compute-ego_max0.17220924377441407
agent_compute-ego_mean0.15591732591687238
agent_compute-ego_median0.1569546620051066
agent_compute-ego_min0.12864815747296368
deviation-center-line_max0.661406549475925
deviation-center-line_mean0.15051497984053228
deviation-center-line_min0.02780241294906417
deviation-heading_max6.0970954854422645
deviation-heading_mean2.476472329942467
deviation-heading_median0.6439097677899761
deviation-heading_min0.4986756377174347
driven_any_max1.6995671675282338
driven_any_mean0.6476519321163464
driven_any_median0.14314803605730164
driven_any_min0.09895959495462382
driven_lanedir_consec_max0.5717816054931946
driven_lanedir_consec_mean0.21019456307314263
driven_lanedir_consec_min0.03126199365840754
driven_lanedir_max0.5717816054931946
driven_lanedir_mean0.21019456307314263
driven_lanedir_median0.06012441230310195
driven_lanedir_min0.03126199365840754
in-drivable-lane_max7.45000000000004
in-drivable-lane_mean2.850000000000014
in-drivable-lane_min0.2500000000000002
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.6995671675282338, "sim_physics": 0.157306969165802, "survival_time": 14.950000000000076, "driven_lanedir": 0.5305861450747233, "sim_render-ego": 0.057234501043955485, "in-drivable-lane": 7.250000000000041, "agent_compute-ego": 0.1576130755742391, "deviation-heading": 5.8108867746064, "set_robot_commands": 0.0860632840792338, "deviation-center-line": 0.3112082293618781, "driven_lanedir_consec": 0.5305861450747233, "sim_compute_sim_state": 0.03482873757680257, "sim_compute_performance-ego": 0.06162858724594116, "sim_compute_robot_state-ego": 0.06649880727132161, "sim_compute_robot_state-npc0": 0.06290518522262573, "sim_compute_robot_state-npc1": 0.06342979272206624, "sim_compute_robot_state-npc2": 0.06296874443689982, "sim_compute_robot_state-npc3": 0.06156526406606038}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.49843359929386, "sim_physics": 0.15669526815414428, "survival_time": 14.950000000000076, "driven_lanedir": 0.4447841770145087, "sim_render-ego": 0.05771683057149251, "in-drivable-lane": 7.45000000000004, "agent_compute-ego": 0.1612115693092346, "deviation-heading": 5.887846553991392, "set_robot_commands": 0.09067315181096394, "deviation-center-line": 0.661406549475925, "driven_lanedir_consec": 0.4447841770145087, "sim_compute_sim_state": 0.03664316018422445, "sim_compute_performance-ego": 0.06508712927500407, "sim_compute_robot_state-ego": 0.07161466757456461, "sim_compute_robot_state-npc0": 0.06803791761398316, "sim_compute_robot_state-npc1": 0.06555738131205241, "sim_compute_robot_state-npc2": 0.06493489027023315, "sim_compute_robot_state-npc3": 0.0657756241162618}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.1169812369716197, "sim_physics": 0.1739380615098136, "survival_time": 1.4000000000000006, "driven_lanedir": 0.04261239659045657, "sim_render-ego": 0.05727676834378924, "in-drivable-lane": 0.4000000000000003, "agent_compute-ego": 0.14278819731303624, "deviation-heading": 0.5435862078429031, "set_robot_commands": 0.09833520650863647, "deviation-center-line": 0.07836236921321225, "driven_lanedir_consec": 0.04261239659045657, "sim_compute_sim_state": 0.03773929391588483, "sim_compute_performance-ego": 0.06105872562953404, "sim_compute_robot_state-ego": 0.06626198121479579, "sim_compute_robot_state-npc0": 0.06345370837620326, "sim_compute_robot_state-npc1": 0.0607536860874721, "sim_compute_robot_state-npc2": 0.0601136428969247, "sim_compute_robot_state-npc3": 0.06130833285195487}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.10712690030590882, "sim_physics": 0.15860482215881347, "survival_time": 1.2500000000000004, "driven_lanedir": 0.04590199040558929, "sim_render-ego": 0.05826052665710449, "in-drivable-lane": 0.2500000000000002, "agent_compute-ego": 0.17220924377441407, "deviation-heading": 0.5530546834628679, "set_robot_commands": 0.08586774826049805, "deviation-center-line": 0.07695572070673869, "driven_lanedir_consec": 0.04590199040558929, "sim_compute_sim_state": 0.03152559280395508, "sim_compute_performance-ego": 0.059002628326416014, "sim_compute_robot_state-ego": 0.06684134483337402, "sim_compute_robot_state-npc0": 0.06612065315246582, "sim_compute_robot_state-npc1": 0.06238686561584473, "sim_compute_robot_state-npc2": 0.05965214729309082, "sim_compute_robot_state-npc3": 0.05588903427124024}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.14314803605730164, "sim_physics": 0.12175461097999855, "survival_time": 1.3500000000000003, "driven_lanedir": 0.04889196563850473, "sim_render-ego": 0.04742836069177698, "in-drivable-lane": 0.40000000000000024, "agent_compute-ego": 0.12864815747296368, "deviation-heading": 0.6685855127835026, "set_robot_commands": 0.07068991661071777, "deviation-center-line": 0.029021863648060545, "driven_lanedir_consec": 0.04889196563850473, "sim_compute_sim_state": 0.03043363712452076, "sim_compute_performance-ego": 0.05119225713941786, "sim_compute_robot_state-ego": 0.053866739626284, "sim_compute_robot_state-npc0": 0.05411374127423322, "sim_compute_robot_state-npc1": 0.05352738168504503, "sim_compute_robot_state-npc2": 0.05292654920507361, "sim_compute_robot_state-npc3": 0.05205713378058539}, "ETHZ_autolab_technical_track-5-0": {"driven_any": 1.567456030937525, "sim_physics": 0.15773828983306884, "survival_time": 14.950000000000076, "driven_lanedir": 0.5167918887835721, "sim_render-ego": 0.05799082358678182, "in-drivable-lane": 6.950000000000041, "agent_compute-ego": 0.16113531430562336, "deviation-heading": 6.0970954854422645, "set_robot_commands": 0.08789158344268799, "deviation-center-line": 0.2497636020368942, "driven_lanedir_consec": 0.5167918887835721, "sim_compute_sim_state": 0.03660334904988607, "sim_compute_performance-ego": 0.06413703918457031, "sim_compute_robot_state-ego": 0.068031534353892, "sim_compute_robot_state-npc0": 0.06494500080744425, "sim_compute_robot_state-npc1": 0.06407451788584391, "sim_compute_robot_state-npc2": 0.06361393292744955, "sim_compute_robot_state-npc3": 0.06444254477818807}, "ETHZ_autolab_technical_track-6-0": {"driven_any": 0.10949077965113244, "sim_physics": 0.17604069198880876, "survival_time": 1.4000000000000006, "driven_lanedir": 0.03126199365840754, "sim_render-ego": 0.05754572153091431, "in-drivable-lane": 0.5000000000000003, "agent_compute-ego": 0.15547476496015275, "deviation-heading": 0.4986756377174347, "set_robot_commands": 0.09164547068732123, "deviation-center-line": 0.046861495705743765, "driven_lanedir_consec": 0.03126199365840754, "sim_compute_sim_state": 0.033848081316266744, "sim_compute_performance-ego": 0.06139935765947614, "sim_compute_robot_state-ego": 0.06428085906164986, "sim_compute_robot_state-npc0": 0.06479286296027047, "sim_compute_robot_state-npc1": 0.05874625274113247, "sim_compute_robot_state-npc2": 0.057826834065573554, "sim_compute_robot_state-npc3": 0.05379292794636318}, "ETHZ_autolab_technical_track-7-0": {"driven_any": 0.11889607104561672, "sim_physics": 0.15531218462976917, "survival_time": 1.4500000000000006, "driven_lanedir": 0.05028570494010731, "sim_render-ego": 0.052274514888894966, "in-drivable-lane": 0.4000000000000003, "agent_compute-ego": 0.15151653618648134, "deviation-heading": 0.5400609729976547, "set_robot_commands": 0.08720288605525575, "deviation-center-line": 0.06862984067383088, "driven_lanedir_consec": 0.05028570494010731, "sim_compute_sim_state": 0.03665165243477657, "sim_compute_performance-ego": 0.06334070501656368, "sim_compute_robot_state-ego": 0.068458943531431, "sim_compute_robot_state-npc0": 0.06468550090132089, "sim_compute_robot_state-npc1": 0.06417759533586173, "sim_compute_robot_state-npc2": 0.06164630528154044, "sim_compute_robot_state-npc3": 0.06527968110709355}, "ETHZ_autolab_technical_track-8-0": {"driven_any": 0.16979188599709688, "sim_physics": 0.17664715823005228, "survival_time": 1.7000000000000008, "driven_lanedir": 0.06531315904064305, "sim_render-ego": 0.060507465811336744, "in-drivable-lane": 0.5500000000000005, "agent_compute-ego": 0.1649696756811703, "deviation-heading": 0.6439097677899761, "set_robot_commands": 0.0902714729309082, "deviation-center-line": 0.02780241294906417, "driven_lanedir_consec": 0.06531315904064305, "sim_compute_sim_state": 0.037342345013337976, "sim_compute_performance-ego": 0.06518206876866958, "sim_compute_robot_state-ego": 0.07046985626220703, "sim_compute_robot_state-npc0": 0.06696574828203987, "sim_compute_robot_state-npc1": 0.07026646417729995, "sim_compute_robot_state-npc2": 0.06518532949335434, "sim_compute_robot_state-npc3": 0.06302358122432933}, "ETHZ_autolab_technical_track-9-0": {"driven_any": 1.5601848819411486, "sim_physics": 0.14494963804880778, "survival_time": 14.950000000000076, "driven_lanedir": 0.4859839888701125, "sim_render-ego": 0.054344181219736734, "in-drivable-lane": 7.30000000000004, "agent_compute-ego": 0.15126311858495076, "deviation-heading": 5.974823819208034, "set_robot_commands": 0.08385847965876261, "deviation-center-line": 0.167933907103007, "driven_lanedir_consec": 0.4859839888701125, "sim_compute_sim_state": 0.03426305294036865, "sim_compute_performance-ego": 0.061427194277445474, "sim_compute_robot_state-ego": 0.06730058352152507, "sim_compute_robot_state-npc0": 0.060136574109395345, "sim_compute_robot_state-npc1": 0.05894564310709635, "sim_compute_robot_state-npc2": 0.05933799902598063, "sim_compute_robot_state-npc3": 0.06102580944697062}, "ETHZ_autolab_technical_track-10-0": {"driven_any": 0.6240197595499182, "sim_physics": 0.1643636146513354, "survival_time": 5.949999999999987, "driven_lanedir": 0.19135411357194032, "sim_render-ego": 0.0610850438350389, "in-drivable-lane": 2.799999999999995, "agent_compute-ego": 0.15610021503031754, "deviation-heading": 2.430347921357834, "set_robot_commands": 0.08955954703964106, "deviation-center-line": 0.07657285677045554, "driven_lanedir_consec": 0.19135411357194032, "sim_compute_sim_state": 0.035520593659216615, "sim_compute_performance-ego": 0.06544748875273376, "sim_compute_robot_state-ego": 0.06687948483378947, "sim_compute_robot_state-npc0": 0.06390293906716739, "sim_compute_robot_state-npc1": 0.06531234148169766, "sim_compute_robot_state-npc2": 0.06511161106975139, "sim_compute_robot_state-npc3": 0.06217506552944664}, "ETHZ_autolab_technical_track-11-0": {"driven_any": 0.09895959495462382, "sim_physics": 0.15673850200794362, "survival_time": 1.3500000000000003, "driven_lanedir": 0.031560998153521425, "sim_render-ego": 0.05591697163052029, "in-drivable-lane": 0.4500000000000003, "agent_compute-ego": 0.1642713811662462, "deviation-heading": 0.5336889876053491, "set_robot_commands": 0.08699456850687663, "deviation-center-line": 0.06505635963666165, "driven_lanedir_consec": 0.031560998153521425, "sim_compute_sim_state": 0.03714406048810041, "sim_compute_performance-ego": 0.0634533475946497, "sim_compute_robot_state-ego": 0.07102713761506257, "sim_compute_robot_state-npc0": 0.06339217998363354, "sim_compute_robot_state-npc1": 0.06175855354026512, "sim_compute_robot_state-npc2": 0.06208446290757921, "sim_compute_robot_state-npc3": 0.06444201646027742}, "ETHZ_autolab_technical_track-12-0": {"driven_any": 1.6490147376645763, "sim_physics": 0.1572758928934733, "survival_time": 14.950000000000076, "driven_lanedir": 0.5717816054931946, "sim_render-ego": 0.0558881664276123, "in-drivable-lane": 7.100000000000041, "agent_compute-ego": 0.1569546620051066, "deviation-heading": 5.770018112021226, "set_robot_commands": 0.08814735968907673, "deviation-center-line": 0.2666691311120884, "driven_lanedir_consec": 0.5717816054931946, "sim_compute_sim_state": 0.03584709962209066, "sim_compute_performance-ego": 0.06114449024200439, "sim_compute_robot_state-ego": 0.06532016356786093, "sim_compute_robot_state-npc0": 0.06296947320302328, "sim_compute_robot_state-npc1": 0.06246983607610067, "sim_compute_robot_state-npc2": 0.06172402302424113, "sim_compute_robot_state-npc3": 0.06251467068990071}, "ETHZ_autolab_technical_track-13-0": {"driven_any": 0.13029629372032678, "sim_physics": 0.19015496969223025, "survival_time": 1.4000000000000006, "driven_lanedir": 0.06012441230310195, "sim_render-ego": 0.061672593866075785, "in-drivable-lane": 0.3500000000000003, "agent_compute-ego": 0.16273387840815953, "deviation-heading": 0.6022713837689331, "set_robot_commands": 0.0915311404636928, "deviation-center-line": 0.0773688304065683, "driven_lanedir_consec": 0.06012441230310195, "sim_compute_sim_state": 0.03827674899782453, "sim_compute_performance-ego": 0.07115967784609113, "sim_compute_robot_state-ego": 0.07746965544564384, "sim_compute_robot_state-npc0": 0.06822653327669416, "sim_compute_robot_state-npc1": 0.07057217189243861, "sim_compute_robot_state-npc2": 0.067177414894104, "sim_compute_robot_state-npc3": 0.06978196757180351}, "ETHZ_autolab_technical_track-14-0": {"driven_any": 0.12141200612630644, "sim_physics": 0.1749067667758826, "survival_time": 1.6500000000000008, "driven_lanedir": 0.03568390655875575, "sim_render-ego": 0.058315067580251984, "in-drivable-lane": 0.6000000000000005, "agent_compute-ego": 0.15187009898099033, "deviation-heading": 0.5922331285412288, "set_robot_commands": 0.10047131596189555, "deviation-center-line": 0.05411152880785536, "driven_lanedir_consec": 0.03568390655875575, "sim_compute_sim_state": 0.03577529300342907, "sim_compute_performance-ego": 0.06749930526271011, "sim_compute_robot_state-ego": 0.07150495413577918, "sim_compute_robot_state-npc0": 0.06481861345695727, "sim_compute_robot_state-npc1": 0.06667366894808682, "sim_compute_robot_state-npc2": 0.06554648370453806, "sim_compute_robot_state-npc3": 0.06249227668299819}}
set_robot_commands_max0.10047131596189555
set_robot_commands_mean0.08861354211374456
set_robot_commands_median0.08814735968907673
set_robot_commands_min0.07068991661071777
sim_compute_performance-ego_max0.07115967784609113
sim_compute_performance-ego_mean0.06281066681474849
sim_compute_performance-ego_median0.06334070501656368
sim_compute_performance-ego_min0.05119225713941786
sim_compute_robot_state-ego_max0.07746965544564384
sim_compute_robot_state-ego_mean0.06772178085661208
sim_compute_robot_state-ego_median0.06730058352152507
sim_compute_robot_state-ego_min0.053866739626284
sim_compute_robot_state-npc0_max0.06822653327669416
sim_compute_robot_state-npc0_mean0.06396444211249716
sim_compute_robot_state-npc0_median0.06468550090132089
sim_compute_robot_state-npc0_min0.05411374127423322
sim_compute_robot_state-npc1_max0.07057217189243861
sim_compute_robot_state-npc1_mean0.06324347684055359
sim_compute_robot_state-npc1_median0.06342979272206624
sim_compute_robot_state-npc1_min0.05352738168504503
sim_compute_robot_state-npc2_max0.067177414894104
sim_compute_robot_state-npc2_mean0.061990024699755626
sim_compute_robot_state-npc2_median0.06208446290757921
sim_compute_robot_state-npc2_min0.05292654920507361
sim_compute_robot_state-npc3_max0.06978196757180351
sim_compute_robot_state-npc3_mean0.0617043953682316
sim_compute_robot_state-npc3_median0.06249227668299819
sim_compute_robot_state-npc3_min0.05205713378058539
sim_compute_sim_state_max0.03827674899782453
sim_compute_sim_state_mean0.035496179875378994
sim_compute_sim_state_median0.03584709962209066
sim_compute_sim_state_min0.03043363712452076
sim_physics_max0.19015496969223025
sim_physics_mean0.16149516271466294
sim_physics_median0.15773828983306884
sim_physics_min0.12175461097999855
sim_render-ego_max0.061672593866075785
sim_render-ego_mean0.05689716917901884
sim_render-ego_median0.05754572153091431
sim_render-ego_min0.04742836069177698
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean6.243333333333358
survival_time_min1.2500000000000004
No reset possible
229942409jiang pengBaseline solution using reinforcement learningaido2-LF-sim-validationstep1-simulationerroryesip-172-31-42-167-72270:09:40
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
229652451Nicky EichmannBaseline solution using reinforcement learningaido2-LFVI-sim-validationstep1-simulationsuccessyesip-172-31-42-167-72270:35:05
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median-1.339803295303147
survival_time_median14.950000000000076
deviation-center-line_median1.0021347592871723
in-drivable-lane_median4.050000000000024


other stats
agent_compute-ego_max0.16164000272750856
agent_compute-ego_mean0.15610354566574097
agent_compute-ego_median0.1540182638168335
agent_compute-ego_min0.1513586123784383
deviation-center-line_max1.5296442281508644
deviation-center-line_mean0.9253718574185378
deviation-center-line_min0.2826196070981827
deviation-heading_max8.558153948461719
deviation-heading_mean7.098260242116498
deviation-heading_median7.090641611385008
deviation-heading_min5.695926383403844
driven_any_max4.3785064440528245
driven_any_mean4.378506444052816
driven_any_median4.378506444052819
driven_any_min4.378506444052804
driven_lanedir_consec_max-1.272834629261013
driven_lanedir_consec_mean-1.3313573411979192
driven_lanedir_consec_min-1.3670060414727203
driven_lanedir_max-1.366266842110191
driven_lanedir_mean-2.078204689886424
driven_lanedir_median-2.260643253811775
driven_lanedir_min-2.710754983563031
in-drivable-lane_max7.400000000000039
in-drivable-lane_mean4.620000000000026
in-drivable-lane_min2.150000000000011
per-episodes
details{"udem1-0-0": {"driven_any": 4.378506444052811, "sim_physics": 0.16945639848709107, "survival_time": 14.950000000000076, "driven_lanedir": -2.710754983563031, "sim_render-ego": 0.05819206953048706, "in-drivable-lane": 2.150000000000011, "agent_compute-ego": 0.1513586123784383, "deviation-heading": 8.372894374860635, "set_robot_commands": 0.08639689366022746, "deviation-center-line": 1.5195321584534802, "driven_lanedir_consec": -1.3108758978425243, "sim_compute_sim_state": 0.03571542819341024, "sim_compute_performance-ego": 0.06123533646265666, "sim_compute_robot_state-ego": 0.06555419365564982, "sim_compute_robot_state-npc0": 0.062415278752644854, "sim_compute_robot_state-npc1": 0.06303441445032755, "sim_compute_robot_state-npc2": 0.06254379431406656, "sim_compute_robot_state-npc3": 0.061077833970387775}, "udem1-1-0": {"driven_any": 4.3785064440528245, "sim_physics": 0.1963050842285156, "survival_time": 14.950000000000076, "driven_lanedir": -2.686352328474403, "sim_render-ego": 0.06244195063908895, "in-drivable-lane": 2.150000000000011, "agent_compute-ego": 0.16164000272750856, "deviation-heading": 8.558153948461719, "set_robot_commands": 0.09260231733322144, "deviation-center-line": 1.5296442281508644, "driven_lanedir_consec": -1.272834629261013, "sim_compute_sim_state": 0.03846120834350586, "sim_compute_performance-ego": 0.0677091670036316, "sim_compute_robot_state-ego": 0.07323710282643636, "sim_compute_robot_state-npc0": 0.06724067529042561, "sim_compute_robot_state-npc1": 0.06775244156519572, "sim_compute_robot_state-npc2": 0.06679384152094524, "sim_compute_robot_state-npc3": 0.06824360211690267}, "udem1-2-0": {"driven_any": 4.378506444052804, "sim_physics": 0.18989391009012857, "survival_time": 14.950000000000076, "driven_lanedir": -1.366266842110191, "sim_render-ego": 0.0632138458887736, "in-drivable-lane": 7.35000000000004, "agent_compute-ego": 0.16144652446111044, "deviation-heading": 5.773684892471283, "set_robot_commands": 0.08892913262049357, "deviation-center-line": 0.29292853410298886, "driven_lanedir_consec": -1.366266842110191, "sim_compute_sim_state": 0.03933207432428996, "sim_compute_performance-ego": 0.06654704729715984, "sim_compute_robot_state-ego": 0.0708387041091919, "sim_compute_robot_state-npc0": 0.06876530408859254, "sim_compute_robot_state-npc1": 0.06705504814783732, "sim_compute_robot_state-npc2": 0.06762919743855794, "sim_compute_robot_state-npc3": 0.06814869006474812}, "udem1-3-0": {"driven_any": 4.3785064440528245, "sim_physics": 0.18457745790481567, "survival_time": 14.950000000000076, "driven_lanedir": -1.3670060414727203, "sim_render-ego": 0.05885006825129191, "in-drivable-lane": 7.400000000000039, "agent_compute-ego": 0.1540182638168335, "deviation-heading": 5.695926383403844, "set_robot_commands": 0.0852444338798523, "deviation-center-line": 0.2826196070981827, "driven_lanedir_consec": -1.3670060414727203, "sim_compute_sim_state": 0.03720717748006185, "sim_compute_performance-ego": 0.06571757634480795, "sim_compute_robot_state-ego": 0.0673143990834554, "sim_compute_robot_state-npc0": 0.064660009543101, "sim_compute_robot_state-npc1": 0.06520589749018352, "sim_compute_robot_state-npc2": 0.06374581098556518, "sim_compute_robot_state-npc3": 0.06520259459813436}, "udem1-4-0": {"driven_any": 4.378506444052819, "sim_physics": 0.1780240519841512, "survival_time": 14.950000000000076, "driven_lanedir": -2.260643253811775, "sim_render-ego": 0.05824246724446615, "in-drivable-lane": 4.050000000000024, "agent_compute-ego": 0.15205432494481405, "deviation-heading": 7.090641611385008, "set_robot_commands": 0.08677097241083781, "deviation-center-line": 1.0021347592871723, "driven_lanedir_consec": -1.339803295303147, "sim_compute_sim_state": 0.03556403954823812, "sim_compute_performance-ego": 0.062419451872507734, "sim_compute_robot_state-ego": 0.06781713008880615, "sim_compute_robot_state-npc0": 0.06343355655670166, "sim_compute_robot_state-npc1": 0.06446100870768229, "sim_compute_robot_state-npc2": 0.0638701581954956, "sim_compute_robot_state-npc3": 0.06762945731480917}}
set_robot_commands_max0.09260231733322144
set_robot_commands_mean0.08798874998092651
set_robot_commands_median0.08677097241083781
set_robot_commands_min0.0852444338798523
sim_compute_performance-ego_max0.0677091670036316
sim_compute_performance-ego_mean0.06472571579615276
sim_compute_performance-ego_median0.06571757634480795
sim_compute_performance-ego_min0.06123533646265666
sim_compute_robot_state-ego_max0.07323710282643636
sim_compute_robot_state-ego_mean0.06895230595270793
sim_compute_robot_state-ego_median0.06781713008880615
sim_compute_robot_state-ego_min0.06555419365564982
sim_compute_robot_state-npc0_max0.06876530408859254
sim_compute_robot_state-npc0_mean0.06530296484629314
sim_compute_robot_state-npc0_median0.064660009543101
sim_compute_robot_state-npc0_min0.062415278752644854
sim_compute_robot_state-npc1_max0.06775244156519572
sim_compute_robot_state-npc1_mean0.06550176207224527
sim_compute_robot_state-npc1_median0.06520589749018352
sim_compute_robot_state-npc1_min0.06303441445032755
sim_compute_robot_state-npc2_max0.06762919743855794
sim_compute_robot_state-npc2_mean0.06491656049092612
sim_compute_robot_state-npc2_median0.0638701581954956
sim_compute_robot_state-npc2_min0.06254379431406656
sim_compute_robot_state-npc3_max0.06824360211690267
sim_compute_robot_state-npc3_mean0.06606043561299643
sim_compute_robot_state-npc3_median0.06762945731480917
sim_compute_robot_state-npc3_min0.061077833970387775
sim_compute_sim_state_max0.03933207432428996
sim_compute_sim_state_mean0.0372559855779012
sim_compute_sim_state_median0.03720717748006185
sim_compute_sim_state_min0.03556403954823812
sim_physics_max0.1963050842285156
sim_physics_mean0.1836513805389404
sim_physics_median0.18457745790481567
sim_physics_min0.16945639848709107
sim_render-ego_max0.0632138458887736
sim_render-ego_mean0.06018808031082153
sim_render-ego_median0.05885006825129191
sim_render-ego_min0.05819206953048706
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean14.950000000000076
survival_time_min14.950000000000076
No reset possible
229642455Liam Paull 🇨🇦challenge-aido_LF-template-rosaido2-LF-sim-testingstep1-simulationerroryesip-172-31-42-167-72270:00:33
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
229612460Liam Paull 🇨🇦challenge-aido_LF-template-rosaido2-LFV-sim-validationstep1-simulationerroryesip-172-31-42-167-72270:00:31
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
229472492Liam Paull 🇨🇦challenge-aido_LF-template-pytorchaido2-LF-sim-validationstep1-simulationsuccessyesip-172-31-42-167-72270:05:43
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.098052898070502
survival_time_median1.5000000000000009
deviation-center-line_median0.07996503098102208
in-drivable-lane_median0.10000000000000007


other stats
agent_compute-ego_max0.1896811803181966
agent_compute-ego_mean0.17274844630726444
agent_compute-ego_median0.17492795812672582
agent_compute-ego_min0.15716963464563544
deviation-center-line_max0.1029737095080038
deviation-center-line_mean0.07544715289323013
deviation-center-line_min0.054503661378267405
deviation-heading_max0.9300111016900432
deviation-heading_mean0.8443195661758613
deviation-heading_median0.9154108518886792
deviation-heading_min0.5868829248472237
driven_any_max0.2090968178479865
driven_any_mean0.18287136203598792
driven_any_median0.19253512399258405
driven_any_min0.1288705873822534
driven_lanedir_consec_max0.13697944344684432
driven_lanedir_consec_mean0.10455701730085398
driven_lanedir_consec_min0.07356958763641286
driven_lanedir_max0.13697944344684432
driven_lanedir_mean0.10455701730085398
driven_lanedir_median0.098052898070502
driven_lanedir_min0.07356958763641286
in-drivable-lane_max0.2500000000000002
in-drivable-lane_mean0.10000000000000007
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.19253512399258405, "sim_physics": 0.13956469694773355, "survival_time": 1.5000000000000009, "driven_lanedir": 0.08867442021339977, "sim_render-ego": 0.06517299016316731, "in-drivable-lane": 0.15000000000000013, "agent_compute-ego": 0.1896811803181966, "deviation-heading": 0.9154108518886792, "set_robot_commands": 0.10138392448425292, "deviation-center-line": 0.08132383542227452, "driven_lanedir_consec": 0.08867442021339977, "sim_compute_sim_state": 0.03859919706980387, "sim_compute_performance-ego": 0.07619848251342773, "sim_compute_robot_state-ego": 0.07812352975209554}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.20532978485023437, "sim_physics": 0.11642525345087051, "survival_time": 1.6000000000000008, "driven_lanedir": 0.12550873713711097, "sim_render-ego": 0.06096312403678894, "in-drivable-lane": 0.10000000000000007, "agent_compute-ego": 0.17499548196792605, "deviation-heading": 0.8668872668409795, "set_robot_commands": 0.0967669039964676, "deviation-center-line": 0.054503661378267405, "driven_lanedir_consec": 0.12550873713711097, "sim_compute_sim_state": 0.042617812752723694, "sim_compute_performance-ego": 0.06908738613128662, "sim_compute_robot_state-ego": 0.08206681162118912}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.1288705873822534, "sim_physics": 0.10104937986894089, "survival_time": 1.1000000000000003, "driven_lanedir": 0.098052898070502, "sim_render-ego": 0.05682373046875, "in-drivable-lane": 0, "agent_compute-ego": 0.15716963464563544, "deviation-heading": 0.5868829248472237, "set_robot_commands": 0.08417518572373824, "deviation-center-line": 0.1029737095080038, "driven_lanedir_consec": 0.098052898070502, "sim_compute_sim_state": 0.03785996003584429, "sim_compute_performance-ego": 0.06582726131786, "sim_compute_robot_state-ego": 0.0641054782000455}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.17852449610688134, "sim_physics": 0.1134080146921092, "survival_time": 1.4500000000000006, "driven_lanedir": 0.07356958763641286, "sim_render-ego": 0.06169375880011197, "in-drivable-lane": 0.2500000000000002, "agent_compute-ego": 0.17492795812672582, "deviation-heading": 0.9300111016900432, "set_robot_commands": 0.09513992276684992, "deviation-center-line": 0.0584695271765828, "driven_lanedir_consec": 0.07356958763641286, "sim_compute_sim_state": 0.03890739638229896, "sim_compute_performance-ego": 0.08647842242799957, "sim_compute_robot_state-ego": 0.07520438062733617}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.2090968178479865, "sim_physics": 0.11562398941286148, "survival_time": 1.5500000000000007, "driven_lanedir": 0.13697944344684432, "sim_render-ego": 0.060915916196761594, "in-drivable-lane": 0, "agent_compute-ego": 0.16696797647783834, "deviation-heading": 0.9224056856123806, "set_robot_commands": 0.08710324379705614, "deviation-center-line": 0.07996503098102208, "driven_lanedir_consec": 0.13697944344684432, "sim_compute_sim_state": 0.03857841799336095, "sim_compute_performance-ego": 0.06849455064342867, "sim_compute_robot_state-ego": 0.07252007146035472}}
set_robot_commands_max0.10138392448425292
set_robot_commands_mean0.09291383615367296
set_robot_commands_median0.09513992276684992
set_robot_commands_min0.08417518572373824
sim_compute_performance-ego_max0.08647842242799957
sim_compute_performance-ego_mean0.07321722060680053
sim_compute_performance-ego_median0.06908738613128662
sim_compute_performance-ego_min0.06582726131786
sim_compute_robot_state-ego_max0.08206681162118912
sim_compute_robot_state-ego_mean0.0744040543322042
sim_compute_robot_state-ego_median0.07520438062733617
sim_compute_robot_state-ego_min0.0641054782000455
sim_compute_sim_state_max0.042617812752723694
sim_compute_sim_state_mean0.03931255684680635
sim_compute_sim_state_median0.03859919706980387
sim_compute_sim_state_min0.03785996003584429
sim_physics_max0.13956469694773355
sim_physics_mean0.11721426687450312
sim_physics_median0.11562398941286148
sim_physics_min0.10104937986894089
sim_render-ego_max0.06517299016316731
sim_render-ego_mean0.06111390393311596
sim_render-ego_median0.06096312403678894
sim_render-ego_min0.05682373046875
simulation-passed1
survival_time_max1.6000000000000008
survival_time_mean1.4400000000000006
survival_time_min1.1000000000000003
No reset possible
229342502Rami Al-Naim 🇷🇺challenge-aido_LF-template-rosaido2-LF-sim-testingstep1-simulationerroryesip-172-31-42-167-72270:00:49
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
229252521Liam Paull 🇨🇦challenge-aido_LF-baseline-duckietownaido2-LFV-sim-validationstep1-simulationerroryesip-172-31-42-167-72270:00:51
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
229062533Liam Paull 🇨🇦baseline-IL-sim-tensorflowaido2-LFV-sim-validationstep1-simulationerroryesip-172-31-42-167-72270:03:37
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
228902570Liam Paull 🇨🇦challenge-aido_LF-baseline-duckietownaido2-LF-sim-testingstep1-simulationerroryesip-172-31-42-167-72270:19:30
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
228832581Alexander Karavaevchallenge-aido_LF-template-ros - Template solution using ROSaido2-LFVI-sim-testingstep1-simulationerroryesip-172-31-42-167-72270:02:45
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
228582624Andrea Censi 🇨🇭challenge-aido_LF-template-randomaido2-LFVI-sim-testingstep1-simulationsuccessyesip-172-31-42-167-72270:27:59
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.6537162971975778
survival_time_median2.5999999999999988
deviation-center-line_median0.14884708769804722
in-drivable-lane_median0.549999999999998


other stats
agent_compute-ego_max0.19035117901288545
agent_compute-ego_mean0.14768375103198966
agent_compute-ego_median0.14996348538445037
agent_compute-ego_min0.1197553248632522
deviation-center-line_max0.5141120095458062
deviation-center-line_mean0.1769000227005324
deviation-center-line_min0.06216029860587694
deviation-heading_max1.9929437250081896
deviation-heading_mean0.692977823395608
deviation-heading_median0.4928440244444201
deviation-heading_min0.24234723632033853
driven_any_max3.5343244022418343
driven_any_mean1.3470385992234175
driven_any_median1.001633421251194
driven_any_min0.3412551960104244
driven_lanedir_consec_max2.494308053441959
driven_lanedir_consec_mean0.881391085527715
driven_lanedir_consec_min0.3199180625488627
driven_lanedir_max2.494308053441959
driven_lanedir_mean0.8962528018383226
driven_lanedir_median0.7206363324756615
driven_lanedir_min0.3199180625488627
in-drivable-lane_max3.549999999999991
in-drivable-lane_mean0.839999999999998
in-drivable-lane_min0
per-episodes
details{"udem1-0-0": {"driven_any": 1.5811782993597916, "sim_physics": 0.19567220422286025, "survival_time": 3.949999999999994, "driven_lanedir": 0.9217908232230632, "sim_render-ego": 0.061594561685489706, "in-drivable-lane": 1.3499999999999952, "agent_compute-ego": 0.1523480656780774, "deviation-heading": 0.5694288623982039, "set_robot_commands": 0.09168362617492676, "deviation-center-line": 0.2348196785686717, "driven_lanedir_consec": 0.9213701538661684, "sim_compute_sim_state": 0.0381959903089306, "sim_compute_performance-ego": 0.07090690166135377, "sim_compute_robot_state-ego": 0.07357261150698119, "sim_compute_robot_state-npc0": 0.06549656542041633, "sim_compute_robot_state-npc1": 0.06673955917358398, "sim_compute_robot_state-npc2": 0.06710352173334436, "sim_compute_robot_state-npc3": 0.06704140916655335}, "udem1-1-0": {"driven_any": 0.47798123795353353, "sim_physics": 0.19222759349005564, "survival_time": 1.4000000000000006, "driven_lanedir": 0.4500753586658095, "sim_render-ego": 0.06281231982367379, "in-drivable-lane": 0, "agent_compute-ego": 0.15666175740105764, "deviation-heading": 0.46504862964833654, "set_robot_commands": 0.0915723272732326, "deviation-center-line": 0.09791133281082, "driven_lanedir_consec": 0.4500753586658095, "sim_compute_sim_state": 0.03440007141658238, "sim_compute_performance-ego": 0.06660535505839757, "sim_compute_robot_state-ego": 0.07319438457489014, "sim_compute_robot_state-npc0": 0.06686609131949288, "sim_compute_robot_state-npc1": 0.06373086145945958, "sim_compute_robot_state-npc2": 0.06058033875056675, "sim_compute_robot_state-npc3": 0.06223780768258231}, "udem1-2-0": {"driven_any": 2.1864003300000694, "sim_physics": 0.18107091570363465, "survival_time": 5.14999999999999, "driven_lanedir": 1.826231945363564, "sim_render-ego": 0.05725020112343205, "in-drivable-lane": 0.549999999999998, "agent_compute-ego": 0.14993725239651876, "deviation-heading": 0.8115272458314897, "set_robot_commands": 0.09524662980755556, "deviation-center-line": 0.1927316041609401, "driven_lanedir_consec": 1.826231945363564, "sim_compute_sim_state": 0.037459510043986795, "sim_compute_performance-ego": 0.06527639361261164, "sim_compute_robot_state-ego": 0.07088523698084563, "sim_compute_robot_state-npc0": 0.0672127158896437, "sim_compute_robot_state-npc1": 0.0654163892986705, "sim_compute_robot_state-npc2": 0.06699281525843352, "sim_compute_robot_state-npc3": 0.06765304491357896}, "udem1-3-0": {"driven_any": 0.9410513078477724, "sim_physics": 0.15045641362667084, "survival_time": 2.3999999999999995, "driven_lanedir": 0.493517638549009, "sim_render-ego": 0.04839162031809489, "in-drivable-lane": 0.8999999999999988, "agent_compute-ego": 0.12111954887708028, "deviation-heading": 0.35154027506548424, "set_robot_commands": 0.0740515540043513, "deviation-center-line": 0.08975118546699407, "driven_lanedir_consec": 0.493517638549009, "sim_compute_sim_state": 0.029703860481580097, "sim_compute_performance-ego": 0.0530322790145874, "sim_compute_robot_state-ego": 0.0551749716202418, "sim_compute_robot_state-npc0": 0.05172191560268402, "sim_compute_robot_state-npc1": 0.05050571262836456, "sim_compute_robot_state-npc2": 0.051816980044047035, "sim_compute_robot_state-npc3": 0.0757492979367574}, "udem1-4-0": {"driven_any": 0.34749292376309954, "sim_physics": 0.17214362961905344, "survival_time": 1.0500000000000005, "driven_lanedir": 0.3325249708009643, "sim_render-ego": 0.049314317249116446, "in-drivable-lane": 0, "agent_compute-ego": 0.1197553248632522, "deviation-heading": 0.30044835691402494, "set_robot_commands": 0.07546254566737584, "deviation-center-line": 0.06216029860587694, "driven_lanedir_consec": 0.3325249708009643, "sim_compute_sim_state": 0.06799874986921038, "sim_compute_performance-ego": 0.07096278099786668, "sim_compute_robot_state-ego": 0.06248797689165387, "sim_compute_robot_state-npc0": 0.06049619402204241, "sim_compute_robot_state-npc1": 0.05990739095778693, "sim_compute_robot_state-npc2": 0.05864983513241723, "sim_compute_robot_state-npc3": 0.07334653536478679}, "udem1-5-0": {"driven_any": 3.5343244022418343, "sim_physics": 0.18314608842312932, "survival_time": 8.349999999999984, "driven_lanedir": 2.494308053441959, "sim_render-ego": 0.05945506638395572, "in-drivable-lane": 2, "agent_compute-ego": 0.15111475790332177, "deviation-heading": 1.9929437250081896, "set_robot_commands": 0.09370930323343792, "deviation-center-line": 0.5141120095458062, "driven_lanedir_consec": 2.494308053441959, "sim_compute_sim_state": 0.03714085196306605, "sim_compute_performance-ego": 0.06612402664687106, "sim_compute_robot_state-ego": 0.07277348940957806, "sim_compute_robot_state-npc0": 0.06934110989827595, "sim_compute_robot_state-npc1": 0.073142435736285, "sim_compute_robot_state-npc2": 0.06697347920811819, "sim_compute_robot_state-npc3": 0.06825473208627302}, "udem1-6-0": {"driven_any": 2.176040550989443, "sim_physics": 0.20966828216626807, "survival_time": 5.14999999999999, "driven_lanedir": 1.9748003483573369, "sim_render-ego": 0.059735626850313354, "in-drivable-lane": 0.29999999999999893, "agent_compute-ego": 0.14996348538445037, "deviation-heading": 0.7877172510198454, "set_robot_commands": 0.0942457138913349, "deviation-center-line": 0.30661477465861414, "driven_lanedir_consec": 1.9748003483573369, "sim_compute_sim_state": 0.03899671499011586, "sim_compute_performance-ego": 0.06725131886676677, "sim_compute_robot_state-ego": 0.07228562669846618, "sim_compute_robot_state-npc0": 0.06944960760838777, "sim_compute_robot_state-npc1": 0.06748239970901637, "sim_compute_robot_state-npc2": 0.06813944196238102, "sim_compute_robot_state-npc3": 0.07316087750555242}, "udem1-7-0": {"driven_any": 1.0050236108346422, "sim_physics": 0.20285287857055664, "survival_time": 2.499999999999999, "driven_lanedir": 0.8701796426684156, "sim_render-ego": 0.061665501594543454, "in-drivable-lane": 0, "agent_compute-ego": 0.14907915115356446, "deviation-heading": 0.9227446658975216, "set_robot_commands": 0.1097263526916504, "deviation-center-line": 0.14884708769804722, "driven_lanedir_consec": 0.8546116490381102, "sim_compute_sim_state": 0.03506758213043213, "sim_compute_performance-ego": 0.06116716861724854, "sim_compute_robot_state-ego": 0.06587601184844971, "sim_compute_robot_state-npc0": 0.06280867099761962, "sim_compute_robot_state-npc1": 0.06020464897155762, "sim_compute_robot_state-npc2": 0.06148030757904053, "sim_compute_robot_state-npc3": 0.06234848022460938}, "udem1-8-0": {"driven_any": 0.9970416603019576, "sim_physics": 0.1394633650779724, "survival_time": 2.5999999999999988, "driven_lanedir": 0.8041152574540316, "sim_render-ego": 0.046051887365487904, "in-drivable-lane": 0.29999999999999893, "agent_compute-ego": 0.19035117901288545, "deviation-heading": 0.6817155913229235, "set_robot_commands": 0.08950298107587375, "deviation-center-line": 0.1898768080806288, "driven_lanedir_consec": 0.8041152574540316, "sim_compute_sim_state": 0.03063852511919462, "sim_compute_performance-ego": 0.050812799196976885, "sim_compute_robot_state-ego": 0.05324454032457792, "sim_compute_robot_state-npc0": 0.05539400760944073, "sim_compute_robot_state-npc1": 0.053239088792067304, "sim_compute_robot_state-npc2": 0.05125705553935124, "sim_compute_robot_state-npc3": 0.05289047956466675}, "udem1-9-0": {"driven_any": 0.4374998710472299, "sim_physics": 0.2056397291330191, "survival_time": 1.3000000000000005, "driven_lanedir": 0.4177527119659043, "sim_render-ego": 0.047837367424598105, "in-drivable-lane": 0, "agent_compute-ego": 0.12186570350940412, "deviation-heading": 0.3796137446285097, "set_robot_commands": 0.1109330837543194, "deviation-center-line": 0.08207813392324871, "driven_lanedir_consec": 0.4177527119659043, "sim_compute_sim_state": 0.03388706537393423, "sim_compute_performance-ego": 0.05386538688953106, "sim_compute_robot_state-ego": 0.06038700617276705, "sim_compute_robot_state-npc0": 0.052376848000746504, "sim_compute_robot_state-npc1": 0.05392351517310509, "sim_compute_robot_state-npc2": 0.05437093514662523, "sim_compute_robot_state-npc3": 0.0554657165820782}, "udem1-10-0": {"driven_any": 0.3412551960104244, "sim_physics": 0.274671424518932, "survival_time": 1.1000000000000003, "driven_lanedir": 0.3199180625488627, "sim_render-ego": 0.06536099043759433, "in-drivable-lane": 0, "agent_compute-ego": 0.17276325009085916, "deviation-heading": 0.3796986873122644, "set_robot_commands": 0.11135086146267978, "deviation-center-line": 0.06276575300040536, "driven_lanedir_consec": 0.3199180625488627, "sim_compute_sim_state": 0.039329236203973945, "sim_compute_performance-ego": 0.07441614974628795, "sim_compute_robot_state-ego": 0.08766601302407005, "sim_compute_robot_state-npc0": 0.0815723484212702, "sim_compute_robot_state-npc1": 0.07754983685233376, "sim_compute_robot_state-npc2": 0.08192734284834428, "sim_compute_robot_state-npc3": 0.0767601728439331}, "udem1-11-0": {"driven_any": 0.9951985237696338, "sim_physics": 0.15707058906555177, "survival_time": 2.499999999999999, "driven_lanedir": 0.7206363324756615, "sim_render-ego": 0.05333284854888916, "in-drivable-lane": 0.549999999999998, "agent_compute-ego": 0.13015392303466797, "deviation-heading": 0.30074636349085415, "set_robot_commands": 0.08186810970306396, "deviation-center-line": 0.16567670185555422, "driven_lanedir_consec": 0.7185075497455284, "sim_compute_sim_state": 0.03126850605010986, "sim_compute_performance-ego": 0.05475784301757813, "sim_compute_robot_state-ego": 0.05910179138183594, "sim_compute_robot_state-npc0": 0.06427786827087402, "sim_compute_robot_state-npc1": 0.0575523853302002, "sim_compute_robot_state-npc2": 0.05820993900299072, "sim_compute_robot_state-npc3": 0.057673282623291015}, "udem1-12-0": {"driven_any": 1.964687870253437, "sim_physics": 0.21055117566534817, "survival_time": 4.699999999999991, "driven_lanedir": 0.35162821871931205, "sim_render-ego": 0.06050950669227762, "in-drivable-lane": 3.549999999999991, "agent_compute-ego": 0.15513104073544767, "deviation-heading": 0.24234723632033853, "set_robot_commands": 0.09754127898114792, "deviation-center-line": 0.13126670634798973, "driven_lanedir_consec": 0.35162821871931205, "sim_compute_sim_state": 0.04621862350626195, "sim_compute_performance-ego": 0.06587822893832593, "sim_compute_robot_state-ego": 0.07534868666466246, "sim_compute_robot_state-npc0": 0.06872372170712085, "sim_compute_robot_state-npc1": 0.06820640411782772, "sim_compute_robot_state-npc2": 0.06909814286739269, "sim_compute_robot_state-npc3": 0.06855597394578}, "udem1-13-0": {"driven_any": 1.001633421251194, "sim_physics": 0.1999692962719844, "survival_time": 2.5999999999999988, "driven_lanedir": 0.6537162971975778, "sim_render-ego": 0.061100276616903454, "in-drivable-lane": 0.5999999999999979, "agent_compute-ego": 0.1449161401161781, "deviation-heading": 0.4928440244444201, "set_robot_commands": 0.09501628233836248, "deviation-center-line": 0.13361893417935136, "driven_lanedir_consec": 0.6537162971975778, "sim_compute_sim_state": 0.03916304386579073, "sim_compute_performance-ego": 0.06494263502267691, "sim_compute_robot_state-ego": 0.07472266142184918, "sim_compute_robot_state-npc0": 0.06933337450027466, "sim_compute_robot_state-npc1": 0.06857509796436016, "sim_compute_robot_state-npc2": 0.06862868712498592, "sim_compute_robot_state-npc3": 0.0671996886913593}, "udem1-14-0": {"driven_any": 2.218769782727203, "sim_physics": 0.18343400955200195, "survival_time": 5.249999999999989, "driven_lanedir": 0.8125963661433656, "sim_render-ego": 0.05792255855741955, "in-drivable-lane": 2.499999999999993, "agent_compute-ego": 0.15009568532307943, "deviation-heading": 1.7163026916317128, "set_robot_commands": 0.08948915118262882, "deviation-center-line": 0.24126933160503777, "driven_lanedir_consec": 0.6077880672015845, "sim_compute_sim_state": 0.037850811367943174, "sim_compute_performance-ego": 0.06253281320844378, "sim_compute_robot_state-ego": 0.06858609290350051, "sim_compute_robot_state-npc0": 0.06513480004810152, "sim_compute_robot_state-npc1": 0.06537731261480423, "sim_compute_robot_state-npc2": 0.06638078008379256, "sim_compute_robot_state-npc3": 0.06538221949622744}}
set_robot_commands_max0.11135086146267978
set_robot_commands_mean0.09342665341612942
set_robot_commands_median0.09370930323343792
set_robot_commands_min0.0740515540043513
sim_compute_performance-ego_max0.07441614974628795
sim_compute_performance-ego_mean0.06323547203303495
sim_compute_performance-ego_median0.06527639361261164
sim_compute_performance-ego_min0.050812799196976885
sim_compute_robot_state-ego_max0.08766601302407005
sim_compute_robot_state-ego_mean0.06835380676162464
sim_compute_robot_state-ego_median0.07088523698084563
sim_compute_robot_state-ego_min0.05324454032457792
sim_compute_robot_state-npc0_max0.0815723484212702
sim_compute_robot_state-npc0_mean0.0646803892877594
sim_compute_robot_state-npc0_median0.06549656542041633
sim_compute_robot_state-npc0_min0.05172191560268402
sim_compute_robot_state-npc1_max0.07754983685233376
sim_compute_robot_state-npc1_mean0.06343686925196154
sim_compute_robot_state-npc1_median0.06537731261480423
sim_compute_robot_state-npc1_min0.05050571262836456
sim_compute_robot_state-npc2_max0.08192734284834428
sim_compute_robot_state-npc2_mean0.06344064015212209
sim_compute_robot_state-npc2_median0.06638078008379256
sim_compute_robot_state-npc2_min0.05125705553935124
sim_compute_robot_state-npc3_max0.0767601728439331
sim_compute_robot_state-npc3_mean0.06624798124186863
sim_compute_robot_state-npc3_median0.0671996886913593
sim_compute_robot_state-npc3_min0.05289047956466675
sim_compute_sim_state_max0.06799874986921038
sim_compute_sim_state_mean0.03848794284607419
sim_compute_sim_state_median0.037459510043986795
sim_compute_sim_state_min0.029703860481580097
sim_physics_max0.274671424518932
sim_physics_mean0.1905358396738026
sim_physics_median0.19222759349005564
sim_physics_min0.1394633650779724
sim_render-ego_max0.06536099043759433
sim_render-ego_mean0.056822310044785974
sim_render-ego_median0.05945506638395572
sim_render-ego_min0.046051887365487904
simulation-passed1
survival_time_max8.349999999999984
survival_time_mean3.3333333333333286
survival_time_min1.0500000000000005
No reset possible
228522645Egor Zamotaevchallenge-aido_LF-template-ros - Template solution using ROSaido2-LFV-sim-validationstep1-simulationsuccessyesip-172-31-42-167-72270:07:55
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.36592094708219225
survival_time_median2.5999999999999988
deviation-center-line_median0.16987818035809085
in-drivable-lane_median0.05000000000000005


other stats
agent_compute-ego_max0.07544233649969101
agent_compute-ego_mean0.06975875874859214
agent_compute-ego_median0.07021189743364362
agent_compute-ego_min0.06409977491085346
deviation-center-line_max0.2294363663374862
deviation-center-line_mean0.14972083567701736
deviation-center-line_min0.06426934298501713
deviation-heading_max0.6986268167330368
deviation-heading_mean0.4280304166285303
deviation-heading_median0.41847631252347706
deviation-heading_min0.2596285487829774
driven_any_max1.2972979671834337
driven_any_mean0.7173901327940211
driven_any_median0.7336463183586153
driven_any_min0.26903550091980144
driven_lanedir_consec_max0.97716132702229
driven_lanedir_consec_mean0.5227475277218055
driven_lanedir_consec_min0.2407721645627201
driven_lanedir_max0.97716132702229
driven_lanedir_mean0.5227475277218055
driven_lanedir_median0.36592094708219225
driven_lanedir_min0.2407721645627201
in-drivable-lane_max1.8999999999999944
in-drivable-lane_mean0.5799999999999983
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.922682252912863, "sim_physics": 0.15888397122772646, "survival_time": 3.5499999999999954, "driven_lanedir": 0.36592094708219225, "sim_render-ego": 0.06132647688959686, "in-drivable-lane": 1.8999999999999944, "agent_compute-ego": 0.07021189743364362, "deviation-heading": 0.2596285487829774, "set_robot_commands": 0.09867015019269056, "deviation-center-line": 0.16987818035809085, "driven_lanedir_consec": 0.36592094708219225, "sim_compute_sim_state": 0.0374143123626709, "sim_compute_performance-ego": 0.07139776122402137, "sim_compute_robot_state-ego": 0.07557405216593138, "sim_compute_robot_state-npc0": 0.07096045453783492, "sim_compute_robot_state-npc1": 0.0693918550518197, "sim_compute_robot_state-npc2": 0.06751431209940306, "sim_compute_robot_state-npc3": 0.06642922884981398}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.3642886245953926, "sim_physics": 0.1846514791250229, "survival_time": 1.6000000000000008, "driven_lanedir": 0.3026144243018116, "sim_render-ego": 0.05720393359661102, "in-drivable-lane": 0.05000000000000005, "agent_compute-ego": 0.07544233649969101, "deviation-heading": 0.6986268167330368, "set_robot_commands": 0.09705163538455965, "deviation-center-line": 0.10463456752710916, "driven_lanedir_consec": 0.3026144243018116, "sim_compute_sim_state": 0.03773318976163864, "sim_compute_performance-ego": 0.06416330486536026, "sim_compute_robot_state-ego": 0.07161182165145874, "sim_compute_robot_state-npc0": 0.07017747312784195, "sim_compute_robot_state-npc1": 0.06657131761312485, "sim_compute_robot_state-npc2": 0.06599271297454834, "sim_compute_robot_state-npc3": 0.06588449329137802}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.7336463183586153, "sim_physics": 0.1705481089078463, "survival_time": 2.5999999999999988, "driven_lanedir": 0.727268775640014, "sim_render-ego": 0.05874936855756319, "in-drivable-lane": 0, "agent_compute-ego": 0.06409977491085346, "deviation-heading": 0.2723076711805525, "set_robot_commands": 0.08751562466988197, "deviation-center-line": 0.2294363663374862, "driven_lanedir_consec": 0.727268775640014, "sim_compute_sim_state": 0.03528828345812284, "sim_compute_performance-ego": 0.0654580547259404, "sim_compute_robot_state-ego": 0.06990432739257812, "sim_compute_robot_state-npc0": 0.06671490119053768, "sim_compute_robot_state-npc1": 0.06193419603201059, "sim_compute_robot_state-npc2": 0.06318559554906991, "sim_compute_robot_state-npc3": 0.06105153377239521}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.2972979671834337, "sim_physics": 0.17521740544226863, "survival_time": 4.6499999999999915, "driven_lanedir": 0.97716132702229, "sim_render-ego": 0.058234366037512336, "in-drivable-lane": 0.9499999999999966, "agent_compute-ego": 0.06656772346906764, "deviation-heading": 0.4911127339226078, "set_robot_commands": 0.09138465953129594, "deviation-center-line": 0.18038572117738352, "driven_lanedir_consec": 0.97716132702229, "sim_compute_sim_state": 0.03865647828707131, "sim_compute_performance-ego": 0.0646525941869264, "sim_compute_robot_state-ego": 0.07623565581537062, "sim_compute_robot_state-npc0": 0.06878933342554236, "sim_compute_robot_state-npc1": 0.0685340742911062, "sim_compute_robot_state-npc2": 0.06487546172193302, "sim_compute_robot_state-npc3": 0.06550859892240135}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.26903550091980144, "sim_physics": 0.16164196105230422, "survival_time": 1.0500000000000005, "driven_lanedir": 0.2407721645627201, "sim_render-ego": 0.05829236620948428, "in-drivable-lane": 0, "agent_compute-ego": 0.07247206142970494, "deviation-heading": 0.41847631252347706, "set_robot_commands": 0.09180792172749835, "deviation-center-line": 0.06426934298501713, "driven_lanedir_consec": 0.2407721645627201, "sim_compute_sim_state": 0.035907291230701265, "sim_compute_performance-ego": 0.06959506443568639, "sim_compute_robot_state-ego": 0.06808485303606306, "sim_compute_robot_state-npc0": 0.0637563183194115, "sim_compute_robot_state-npc1": 0.06455160322643462, "sim_compute_robot_state-npc2": 0.06521195457095191, "sim_compute_robot_state-npc3": 0.06523373013450987}}
set_robot_commands_max0.09867015019269056
set_robot_commands_mean0.0932859983011853
set_robot_commands_median0.09180792172749835
set_robot_commands_min0.08751562466988197
sim_compute_performance-ego_max0.07139776122402137
sim_compute_performance-ego_mean0.06705335588758696
sim_compute_performance-ego_median0.0654580547259404
sim_compute_performance-ego_min0.06416330486536026
sim_compute_robot_state-ego_max0.07623565581537062
sim_compute_robot_state-ego_mean0.07228214201228038
sim_compute_robot_state-ego_median0.07161182165145874
sim_compute_robot_state-ego_min0.06808485303606306
sim_compute_robot_state-npc0_max0.07096045453783492
sim_compute_robot_state-npc0_mean0.06807969612023368
sim_compute_robot_state-npc0_median0.06878933342554236
sim_compute_robot_state-npc0_min0.0637563183194115
sim_compute_robot_state-npc1_max0.0693918550518197
sim_compute_robot_state-npc1_mean0.06619660924289919
sim_compute_robot_state-npc1_median0.06657131761312485
sim_compute_robot_state-npc1_min0.06193419603201059
sim_compute_robot_state-npc2_max0.06751431209940306
sim_compute_robot_state-npc2_mean0.06535600738318124
sim_compute_robot_state-npc2_median0.06521195457095191
sim_compute_robot_state-npc2_min0.06318559554906991
sim_compute_robot_state-npc3_max0.06642922884981398
sim_compute_robot_state-npc3_mean0.06482151699409969
sim_compute_robot_state-npc3_median0.06550859892240135
sim_compute_robot_state-npc3_min0.06105153377239521
sim_compute_sim_state_max0.03865647828707131
sim_compute_sim_state_mean0.03699991102004099
sim_compute_sim_state_median0.0374143123626709
sim_compute_sim_state_min0.03528828345812284
sim_physics_max0.1846514791250229
sim_physics_mean0.1701885851510337
sim_physics_median0.1705481089078463
sim_physics_min0.15888397122772646
sim_render-ego_max0.06132647688959686
sim_render-ego_mean0.058761302258153535
sim_render-ego_median0.05829236620948428
sim_render-ego_min0.05720393359661102
simulation-passed1
survival_time_max4.6499999999999915
survival_time_mean2.6899999999999973
survival_time_min1.0500000000000005
No reset possible
228412653Egor Zamotaevchallenge-aido_LF-baseline-duckietownaido2-LF-sim-validationstep1-simulationerroryesip-172-31-42-167-72270:11:37
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
228302677Rami Al-Naim 🇷🇺challenge-aido_LF-baseline-duckietownaido2-LF-sim-validationstep1-simulationsuccessyesip-172-31-42-167-72270:14:18
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.9526256427714684
survival_time_median6.849999999999984
deviation-center-line_median0.4899144899236154
in-drivable-lane_median0.1999999999999993


other stats
agent_compute-ego_max0.09070723218129094
agent_compute-ego_mean0.08712371735758455
agent_compute-ego_median0.08926532566547393
agent_compute-ego_min0.07913075609410063
deviation-center-line_max1.0607082104768049
deviation-center-line_mean0.5437866453098109
deviation-center-line_min0.1955702585542869
deviation-heading_max6.082322784884084
deviation-heading_mean2.519842131301548
deviation-heading_median1.7913614924974466
deviation-heading_min0.6122990104005587
driven_any_max2.348957891787202
driven_any_mean1.2656193247780287
driven_any_median1.047157865268293
driven_any_min0.7017412917729268
driven_lanedir_consec_max1.5359432523425878
driven_lanedir_consec_mean0.9506897383499108
driven_lanedir_consec_min0.4853286693558676
driven_lanedir_max1.7769894027388546
driven_lanedir_mean0.998898968429164
driven_lanedir_median0.9526256427714684
driven_lanedir_min0.4853286693558676
in-drivable-lane_max2.84999999999999
in-drivable-lane_mean0.9300000000000012
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.9982040060192792, "sim_physics": 0.14568811968753212, "survival_time": 6.649999999999984, "driven_lanedir": 0.9526256427714684, "sim_render-ego": 0.07138629604999285, "in-drivable-lane": 0, "agent_compute-ego": 0.09070723218129094, "deviation-heading": 1.5444153235768223, "set_robot_commands": 0.11152350812926327, "deviation-center-line": 0.4899144899236154, "driven_lanedir_consec": 0.9526256427714684, "sim_compute_sim_state": 0.04398489177675176, "sim_compute_performance-ego": 0.08070741201701917, "sim_compute_robot_state-ego": 0.08787020346275846}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 2.348957891787202, "sim_physics": 0.11418504238128664, "survival_time": 14.950000000000076, "driven_lanedir": 1.7769894027388546, "sim_render-ego": 0.06160179694493611, "in-drivable-lane": 1.6000000000000174, "agent_compute-ego": 0.09060343503952026, "deviation-heading": 6.082322784884084, "set_robot_commands": 0.09051936149597169, "deviation-center-line": 1.0607082104768049, "driven_lanedir_consec": 1.5359432523425878, "sim_compute_sim_state": 0.03739113092422485, "sim_compute_performance-ego": 0.06572386185328166, "sim_compute_robot_state-ego": 0.071898725827535}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.7017412917729268, "sim_physics": 0.11013732818847008, "survival_time": 4.699999999999991, "driven_lanedir": 0.6949619154585704, "sim_render-ego": 0.06355151977944881, "in-drivable-lane": 0, "agent_compute-ego": 0.07913075609410063, "deviation-heading": 0.6122990104005587, "set_robot_commands": 0.10216910788353452, "deviation-center-line": 0.5419749208758108, "driven_lanedir_consec": 0.6949619154585704, "sim_compute_sim_state": 0.03819934611624859, "sim_compute_performance-ego": 0.0669844556362071, "sim_compute_robot_state-ego": 0.07225152025831506}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.047157865268293, "sim_physics": 0.13488634833454216, "survival_time": 6.849999999999984, "driven_lanedir": 0.4853286693558676, "sim_render-ego": 0.0674557094156307, "in-drivable-lane": 2.84999999999999, "agent_compute-ego": 0.085911837807537, "deviation-heading": 1.7913614924974466, "set_robot_commands": 0.10666405545534008, "deviation-center-line": 0.1955702585542869, "driven_lanedir_consec": 0.4853286693558676, "sim_compute_sim_state": 0.04139672404658185, "sim_compute_performance-ego": 0.07476893306648644, "sim_compute_robot_state-ego": 0.0840359656480107}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.2320355690424432, "sim_physics": 0.1356927365064621, "survival_time": 7.99999999999998, "driven_lanedir": 1.0845892118210592, "sim_render-ego": 0.07043762356042862, "in-drivable-lane": 0.1999999999999993, "agent_compute-ego": 0.08926532566547393, "deviation-heading": 2.568812045148827, "set_robot_commands": 0.1166650652885437, "deviation-center-line": 0.4307653467185367, "driven_lanedir_consec": 1.0845892118210592, "sim_compute_sim_state": 0.043792127072811125, "sim_compute_performance-ego": 0.07908401042222976, "sim_compute_robot_state-ego": 0.09164804220199584}}
set_robot_commands_max0.1166650652885437
set_robot_commands_mean0.10550821965053066
set_robot_commands_median0.10666405545534008
set_robot_commands_min0.09051936149597169
sim_compute_performance-ego_max0.08070741201701917
sim_compute_performance-ego_mean0.07345373459904483
sim_compute_performance-ego_median0.07476893306648644
sim_compute_performance-ego_min0.06572386185328166
sim_compute_robot_state-ego_max0.09164804220199584
sim_compute_robot_state-ego_mean0.08154089147972302
sim_compute_robot_state-ego_median0.0840359656480107
sim_compute_robot_state-ego_min0.071898725827535
sim_compute_sim_state_max0.04398489177675176
sim_compute_sim_state_mean0.040952843987323635
sim_compute_sim_state_median0.04139672404658185
sim_compute_sim_state_min0.03739113092422485
sim_physics_max0.14568811968753212
sim_physics_mean0.12811791501965858
sim_physics_median0.13488634833454216
sim_physics_min0.11013732818847008
sim_render-ego_max0.07138629604999285
sim_render-ego_mean0.06688658915008742
sim_render-ego_median0.0674557094156307
sim_render-ego_min0.06160179694493611
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean8.230000000000002
survival_time_min4.699999999999991
No reset possible
228242691Konstantin Chaikachallenge-aido_LF-baseline-duckietownaido2-LF-sim-validationstep1-simulationsuccessyesip-172-31-42-167-72270:17:37
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.7192183073704621
survival_time_median5.349999999999989
deviation-center-line_median0.5112833342363641
in-drivable-lane_median1.1999999999999975


other stats
agent_compute-ego_max0.09646046495883263
agent_compute-ego_mean0.09114246686827716
agent_compute-ego_median0.09081674655278524
agent_compute-ego_min0.0852532418568929
deviation-center-line_max0.9296349062389074
deviation-center-line_mean0.6238025365351884
deviation-center-line_min0.34452443790814913
deviation-heading_max7.55524936973824
deviation-heading_mean3.837572682812902
deviation-heading_median2.4571322166172407
deviation-heading_min0.8712884405280571
driven_any_max2.3485722270463634
driven_any_mean1.3843598161513242
driven_any_median0.7892393487072294
driven_any_min0.7015645083356484
driven_lanedir_consec_max0.9976794100250816
driven_lanedir_consec_mean0.7074863519848085
driven_lanedir_consec_min0.1680339722699235
driven_lanedir_max1.4377596432867712
driven_lanedir_mean0.9090116332636152
driven_lanedir_median0.7192183073704621
driven_lanedir_min0.3152981596165893
in-drivable-lane_max3.250000000000016
in-drivable-lane_mean1.4800000000000035
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.7892393487072294, "sim_physics": 0.14935669275087732, "survival_time": 5.349999999999989, "driven_lanedir": 0.6768960659975769, "sim_render-ego": 0.0700454778760393, "in-drivable-lane": 0, "agent_compute-ego": 0.09646046495883263, "deviation-heading": 2.044030161059483, "set_robot_commands": 0.1153168967951124, "deviation-center-line": 0.4594888496580274, "driven_lanedir_consec": 0.6768960659975769, "sim_compute_sim_state": 0.04378071900840118, "sim_compute_performance-ego": 0.08032992621448552, "sim_compute_robot_state-ego": 0.10028142572563384}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.7015645083356484, "sim_physics": 0.14084962581066376, "survival_time": 4.699999999999991, "driven_lanedir": 0.3152981596165893, "sim_render-ego": 0.07248037419420608, "in-drivable-lane": 1.1999999999999975, "agent_compute-ego": 0.09038088423140506, "deviation-heading": 2.4571322166172407, "set_robot_commands": 0.11479434307585372, "deviation-center-line": 0.34452443790814913, "driven_lanedir_consec": 0.1680339722699235, "sim_compute_sim_state": 0.04453245629655554, "sim_compute_performance-ego": 0.08261059446537748, "sim_compute_robot_state-ego": 0.09308202215965758}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.733865744790049, "sim_physics": 0.12942163798273826, "survival_time": 4.899999999999991, "driven_lanedir": 0.7192183073704621, "sim_render-ego": 0.07046843548210299, "in-drivable-lane": 0, "agent_compute-ego": 0.09280099674147002, "deviation-heading": 0.8712884405280571, "set_robot_commands": 0.1134122877704854, "deviation-center-line": 0.5112833342363641, "driven_lanedir_consec": 0.7192183073704621, "sim_compute_sim_state": 0.04500862530299595, "sim_compute_performance-ego": 0.0803954114719313, "sim_compute_robot_state-ego": 0.08649433389001963}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 2.3485722270463634, "sim_physics": 0.13310299078623453, "survival_time": 14.950000000000076, "driven_lanedir": 1.395885990046676, "sim_render-ego": 0.07342968146006267, "in-drivable-lane": 2.9500000000000037, "agent_compute-ego": 0.09081674655278524, "deviation-heading": 7.55524936973824, "set_robot_commands": 0.11294524749120076, "deviation-center-line": 0.8740811546344934, "driven_lanedir_consec": 0.975604004260998, "sim_compute_sim_state": 0.04443172772725423, "sim_compute_performance-ego": 0.08072090148925781, "sim_compute_robot_state-ego": 0.09006675799687704}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 2.348557251877331, "sim_physics": 0.12735562483469645, "survival_time": 14.950000000000076, "driven_lanedir": 1.4377596432867712, "sim_render-ego": 0.06901970704396566, "in-drivable-lane": 3.250000000000016, "agent_compute-ego": 0.0852532418568929, "deviation-heading": 6.260163226121487, "set_robot_commands": 0.10892044544219973, "deviation-center-line": 0.9296349062389074, "driven_lanedir_consec": 0.9976794100250816, "sim_compute_sim_state": 0.04246190786361694, "sim_compute_performance-ego": 0.07636543432871501, "sim_compute_robot_state-ego": 0.08415834506352743}}
set_robot_commands_max0.1153168967951124
set_robot_commands_mean0.1130778441149704
set_robot_commands_median0.1134122877704854
set_robot_commands_min0.10892044544219973
sim_compute_performance-ego_max0.08261059446537748
sim_compute_performance-ego_mean0.08008445359395341
sim_compute_performance-ego_median0.0803954114719313
sim_compute_performance-ego_min0.07636543432871501
sim_compute_robot_state-ego_max0.10028142572563384
sim_compute_robot_state-ego_mean0.0908165769671431
sim_compute_robot_state-ego_median0.09006675799687704
sim_compute_robot_state-ego_min0.08415834506352743
sim_compute_sim_state_max0.04500862530299595
sim_compute_sim_state_mean0.04404308723976477
sim_compute_sim_state_median0.04443172772725423
sim_compute_sim_state_min0.04246190786361694
sim_physics_max0.14935669275087732
sim_physics_mean0.13601731443304205
sim_physics_median0.13310299078623453
sim_physics_min0.12735562483469645
sim_render-ego_max0.07342968146006267
sim_render-ego_mean0.07108873521127533
sim_render-ego_median0.07046843548210299
sim_render-ego_min0.06901970704396566
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean8.970000000000024
survival_time_min4.699999999999991
No reset possible
227912754Bhairav Mehtachallenge-aido_LF-template-ros - Template solution using ROSaido2-LF-sim-testingstep1-simulationsuccessyesip-172-31-42-167-72270:15:03
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.4126113388371666
survival_time_median2.6999999999999984
deviation-center-line_median0.11871775985231396
in-drivable-lane_median0.9499999999999976


other stats
agent_compute-ego_max0.09334176381429037
agent_compute-ego_mean0.06307417156415215
agent_compute-ego_median0.060917873492186095
agent_compute-ego_min0.042298351015363424
deviation-center-line_max0.2616199012603187
deviation-center-line_mean0.12663752615997417
deviation-center-line_min0.07143676193760398
deviation-heading_max1.4563581054905994
deviation-heading_mean0.5551840294909584
deviation-heading_median0.55940705176748
deviation-heading_min0.2596285487829774
driven_any_max1.6839250134630197
driven_any_mean0.7327294413370017
driven_any_median0.7309130538792373
driven_any_min0.2364518949491652
driven_lanedir_consec_max0.9416535020294268
driven_lanedir_consec_mean0.4469104002974222
driven_lanedir_consec_min0.2221238695940002
driven_lanedir_max0.9416535020294268
driven_lanedir_mean0.4469104002974222
driven_lanedir_median0.4126113388371666
driven_lanedir_min0.2221238695940002
in-drivable-lane_max2.1499999999999924
in-drivable-lane_mean0.8233333333333307
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.922682252912863, "sim_physics": 0.08699881862586653, "survival_time": 3.5499999999999954, "driven_lanedir": 0.36592094708219225, "sim_render-ego": 0.04776946255858515, "in-drivable-lane": 1.8999999999999944, "agent_compute-ego": 0.0529491599176971, "deviation-heading": 0.2596285487829774, "set_robot_commands": 0.07126130184657137, "deviation-center-line": 0.16987818035809085, "driven_lanedir_consec": 0.36592094708219225, "sim_compute_sim_state": 0.02946349600671043, "sim_compute_performance-ego": 0.05647001803760797, "sim_compute_robot_state-ego": 0.0564642523376035}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.7993934895811189, "sim_physics": 0.14628276824951172, "survival_time": 2.9999999999999973, "driven_lanedir": 0.6632135184572027, "sim_render-ego": 0.06436090469360352, "in-drivable-lane": 0.29999999999999893, "agent_compute-ego": 0.09334176381429037, "deviation-heading": 0.5809378480871981, "set_robot_commands": 0.11633018652598064, "deviation-center-line": 0.1166759393545397, "driven_lanedir_consec": 0.6632135184572027, "sim_compute_sim_state": 0.0459917147954305, "sim_compute_performance-ego": 0.07905261913935344, "sim_compute_robot_state-ego": 0.092208202679952}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.2364518949491652, "sim_physics": 0.0698591253974221, "survival_time": 1.1000000000000003, "driven_lanedir": 0.2221238695940002, "sim_render-ego": 0.03800857067108154, "in-drivable-lane": 0, "agent_compute-ego": 0.04253717986020175, "deviation-heading": 0.34882560565471876, "set_robot_commands": 0.05812524665485729, "deviation-center-line": 0.11316665887359229, "driven_lanedir_consec": 0.2221238695940002, "sim_compute_sim_state": 0.024246941913257943, "sim_compute_performance-ego": 0.04133977673270486, "sim_compute_robot_state-ego": 0.044428229331970215}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.5946812776947944, "sim_physics": 0.08250038822491963, "survival_time": 2.3999999999999995, "driven_lanedir": 0.5792955579972934, "sim_render-ego": 0.04506258169809977, "in-drivable-lane": 0, "agent_compute-ego": 0.05151469508806864, "deviation-heading": 0.5685240160177978, "set_robot_commands": 0.07042579849561055, "deviation-center-line": 0.15908349194402024, "driven_lanedir_consec": 0.5792955579972934, "sim_compute_sim_state": 0.02917337914307912, "sim_compute_performance-ego": 0.04943455755710602, "sim_compute_robot_state-ego": 0.05521536866823832}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.609146202404747, "sim_physics": 0.07575164152228314, "survival_time": 2.3, "driven_lanedir": 0.2919817227673325, "sim_render-ego": 0.04774337747822637, "in-drivable-lane": 0.9499999999999992, "agent_compute-ego": 0.05201359417127526, "deviation-heading": 0.3390861746033595, "set_robot_commands": 0.06321318253226903, "deviation-center-line": 0.1011892720306074, "driven_lanedir_consec": 0.2919817227673325, "sim_compute_sim_state": 0.03172426120094631, "sim_compute_performance-ego": 0.05304265540579091, "sim_compute_robot_state-ego": 0.07120410255763841}, "ETHZ_autolab_technical_track-5-0": {"driven_any": 0.32177231722795413, "sim_physics": 0.06808024644851685, "survival_time": 1.2000000000000004, "driven_lanedir": 0.259671941523266, "sim_render-ego": 0.04289453228314718, "in-drivable-lane": 0.05000000000000005, "agent_compute-ego": 0.049532165129979454, "deviation-heading": 0.55940705176748, "set_robot_commands": 0.06795849402745564, "deviation-center-line": 0.07983398841276981, "driven_lanedir_consec": 0.259671941523266, "sim_compute_sim_state": 0.027759979168574016, "sim_compute_performance-ego": 0.04627335071563721, "sim_compute_robot_state-ego": 0.049128939708073936}, "ETHZ_autolab_technical_track-6-0": {"driven_any": 0.9218874635466072, "sim_physics": 0.05483752641922388, "survival_time": 3.899999999999994, "driven_lanedir": 0.5450627289344152, "sim_render-ego": 0.0353005268634894, "in-drivable-lane": 1.2999999999999954, "agent_compute-ego": 0.04521560974610157, "deviation-heading": 0.6586708623908946, "set_robot_commands": 0.05353235892760448, "deviation-center-line": 0.13114121213460145, "driven_lanedir_consec": 0.5450627289344152, "sim_compute_sim_state": 0.02300859414614164, "sim_compute_performance-ego": 0.03834956425886888, "sim_compute_robot_state-ego": 0.0402368032015287}, "ETHZ_autolab_technical_track-7-0": {"driven_any": 0.8035998912048764, "sim_physics": 0.06214954171861921, "survival_time": 2.799999999999998, "driven_lanedir": 0.4126113388371666, "sim_render-ego": 0.03616715754781451, "in-drivable-lane": 0.9999999999999972, "agent_compute-ego": 0.042298351015363424, "deviation-heading": 0.6465417997696941, "set_robot_commands": 0.054484320538384576, "deviation-center-line": 0.119844131874105, "driven_lanedir_consec": 0.4126113388371666, "sim_compute_sim_state": 0.023121280329568044, "sim_compute_performance-ego": 0.03927615284919739, "sim_compute_robot_state-ego": 0.041196508066994805}, "ETHZ_autolab_technical_track-8-0": {"driven_any": 1.082025040886041, "sim_physics": 0.10097110956564716, "survival_time": 4.3499999999999925, "driven_lanedir": 0.4507633352947824, "sim_render-ego": 0.05548786568915707, "in-drivable-lane": 2.1499999999999924, "agent_compute-ego": 0.060917873492186095, "deviation-heading": 0.6137519362826567, "set_robot_commands": 0.08320942144284303, "deviation-center-line": 0.11871775985231396, "driven_lanedir_consec": 0.4507633352947824, "sim_compute_sim_state": 0.03555542573161509, "sim_compute_performance-ego": 0.061913597172704234, "sim_compute_robot_state-ego": 0.06625576128904846}, "ETHZ_autolab_technical_track-9-0": {"driven_any": 1.6839250134630197, "sim_physics": 0.14686742695895108, "survival_time": 5.4999999999999885, "driven_lanedir": 0.9416535020294268, "sim_render-ego": 0.06865748058665883, "in-drivable-lane": 1.7999999999999936, "agent_compute-ego": 0.08102627450769598, "deviation-heading": 1.4563581054905994, "set_robot_commands": 0.108070293339816, "deviation-center-line": 0.2616199012603187, "driven_lanedir_consec": 0.9416535020294268, "sim_compute_sim_state": 0.04271366162733598, "sim_compute_performance-ego": 0.0824317455291748, "sim_compute_robot_state-ego": 0.09029148491946132}, "ETHZ_autolab_technical_track-10-0": {"driven_any": 0.2667775284624888, "sim_physics": 0.14281814297040304, "survival_time": 1.2000000000000004, "driven_lanedir": 0.25235480657068055, "sim_render-ego": 0.06885078549385071, "in-drivable-lane": 0, "agent_compute-ego": 0.07861332098642985, "deviation-heading": 0.2735028974766809, "set_robot_commands": 0.1072155733903249, "deviation-center-line": 0.10630271043038582, "driven_lanedir_consec": 0.25235480657068055, "sim_compute_sim_state": 0.046645681063334145, "sim_compute_performance-ego": 0.07552722096443176, "sim_compute_robot_state-ego": 0.08181244134902954}, "ETHZ_autolab_technical_track-11-0": {"driven_any": 1.0389325864387626, "sim_physics": 0.12133136043300875, "survival_time": 3.8499999999999943, "driven_lanedir": 0.4755729783153157, "sim_render-ego": 0.06469099242965896, "in-drivable-lane": 1.7499999999999938, "agent_compute-ego": 0.07373788449671362, "deviation-heading": 0.521699236138543, "set_robot_commands": 0.1031774328900622, "deviation-center-line": 0.10517150645857888, "driven_lanedir_consec": 0.4755729783153157, "sim_compute_sim_state": 0.04129406074424843, "sim_compute_performance-ego": 0.0725489684513637, "sim_compute_robot_state-ego": 0.077300805550117}, "ETHZ_autolab_technical_track-12-0": {"driven_any": 0.6835794874956865, "sim_physics": 0.11820222854614258, "survival_time": 2.499999999999999, "driven_lanedir": 0.6100305079584653, "sim_render-ego": 0.06765528678894044, "in-drivable-lane": 0.14999999999999947, "agent_compute-ego": 0.07008903980255127, "deviation-heading": 0.4739455376152246, "set_robot_commands": 0.0975852870941162, "deviation-center-line": 0.12143860235134882, "driven_lanedir_consec": 0.6100305079584653, "sim_compute_sim_state": 0.04008932590484619, "sim_compute_performance-ego": 0.07243114471435547, "sim_compute_robot_state-ego": 0.07954689025878907}, "ETHZ_autolab_technical_track-13-0": {"driven_any": 0.29517411990766207, "sim_physics": 0.1271915894288283, "survival_time": 1.3000000000000005, "driven_lanedir": 0.25251967754950355, "sim_render-ego": 0.06645137530106765, "in-drivable-lane": 0.05000000000000005, "agent_compute-ego": 0.07445968114412747, "deviation-heading": 0.466101326638835, "set_robot_commands": 0.1002655212695782, "deviation-center-line": 0.07143676193760398, "driven_lanedir_consec": 0.25251967754950355, "sim_compute_sim_state": 0.0428534929568951, "sim_compute_performance-ego": 0.07041814694037804, "sim_compute_robot_state-ego": 0.07791085426624005}, "ETHZ_autolab_technical_track-14-0": {"driven_any": 0.7309130538792373, "sim_physics": 0.1285004218419393, "survival_time": 2.6999999999999984, "driven_lanedir": 0.38087957155028906, "sim_render-ego": 0.07044598791334364, "in-drivable-lane": 0.9499999999999976, "agent_compute-ego": 0.07786598028960051, "deviation-heading": 0.5607794956477159, "set_robot_commands": 0.11132287979125977, "deviation-center-line": 0.12406277512673576, "driven_lanedir_consec": 0.38087957155028906, "sim_compute_sim_state": 0.043861450972380464, "sim_compute_performance-ego": 0.07565736770629883, "sim_compute_robot_state-ego": 0.08322817749447292}}
set_robot_commands_max0.11633018652598064
set_robot_commands_mean0.08441181991778227
set_robot_commands_median0.08320942144284303
set_robot_commands_min0.05353235892760448
sim_compute_performance-ego_max0.0824317455291748
sim_compute_performance-ego_mean0.06094445907833157
sim_compute_performance-ego_median0.061913597172704234
sim_compute_performance-ego_min0.03834956425886888
sim_compute_robot_state-ego_max0.092208202679952
sim_compute_robot_state-ego_mean0.06709525477861054
sim_compute_robot_state-ego_median0.07120410255763841
sim_compute_robot_state-ego_min0.0402368032015287
sim_compute_sim_state_max0.046645681063334145
sim_compute_sim_state_mean0.03516684971362423
sim_compute_sim_state_median0.03555542573161509
sim_compute_sim_state_min0.02300859414614164
sim_physics_max0.14686742695895108
sim_physics_mean0.1021561557567522
sim_physics_median0.10097110956564716
sim_physics_min0.05483752641922388
sim_render-ego_max0.07044598791334364
sim_render-ego_mean0.05463645919978165
sim_render-ego_median0.05548786568915707
sim_render-ego_min0.0353005268634894
simulation-passed1
survival_time_max5.4999999999999885
survival_time_mean2.7766666666666637
survival_time_min1.1000000000000003
No reset possible
227782775Bhairav Mehtachallenge-aido_LF-baseline-duckietownaido2-LFVI-sim-validationstep1-simulationerroryesip-172-31-42-167-72270:07:39
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
227742783Rami Al-Naim 🇷🇺challenge-aido_LF-template-ros - Template solution using ROSaido2-LFV-sim-validationstep1-simulationerroryesip-172-31-42-167-72270:00:32
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
227672799Rami Al-Naim 🇷🇺challenge-aido_LF-baseline-duckietownaido2-LFVI-sim-testingstep1-simulationfailedyesip-172-31-42-167-72270:01:50
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 174, in read_one
    nickname=self.nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 293, in read_until_over
    raise TimeoutError(msg) from None
TimeoutError: Timeout while reading output of node "agent".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "experiment_manager.py", line 297, in run_episode
    r: MsgReceived = agent.write_topic_and_expect('get_commands', expect='commands')
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 93, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 236, in read_one
    raise TimeoutError(msg) from e
TimeoutError: Timeout detected on /fifos/agent-out after 1 messages. Expected topic "commands".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
    yield cie
  File "experiment_manager.py", line 441, in <module>
    wrap(cie)
  File "experiment_manager.py", line 429, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 135, in main
    physics_dt=config.physics_dt)
  File "experiment_manager.py", line 301, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
227162907Julian ZillyBaseline-IL-logs-tensorflowaido2-LFVI-sim-testingstep1-simulationsuccessyesip-172-31-42-167-72270:48:27
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.4666277151948612
survival_time_median6.099999999999986
deviation-center-line_median0.33341532886591296
in-drivable-lane_median0


other stats
agent_compute-ego_max0.24081028329915016
agent_compute-ego_mean0.21500585768339991
agent_compute-ego_median0.2153776197329811
agent_compute-ego_min0.18366585671901703
deviation-center-line_max1.0680309819943516
deviation-center-line_mean0.3913121338092333
deviation-center-line_min0.16662188238079648
deviation-heading_max3.0037699632472425
deviation-heading_mean1.182427425260287
deviation-heading_median0.8527152034102187
deviation-heading_min0.3980684508158633
driven_any_max2.5534750247741376
driven_any_mean1.0516115757409483
driven_any_median1.0073534337246877
driven_any_min0.3609526397352217
driven_lanedir_consec_max2.3199836050434404
driven_lanedir_consec_mean0.768818678491447
driven_lanedir_consec_min0.3359040954329422
driven_lanedir_max2.320009231072208
driven_lanedir_mean0.7823190645837699
driven_lanedir_median0.6115511519355601
driven_lanedir_min0.3359040954329422
in-drivable-lane_max6.899999999999996
in-drivable-lane_mean1.2566666666666677
in-drivable-lane_min0
per-episodes
details{"udem1-0-0": {"driven_any": 1.3567594419471278, "sim_physics": 0.16086294768769063, "survival_time": 8.09999999999998, "driven_lanedir": 1.350113977643261, "sim_render-ego": 0.056208638497340827, "in-drivable-lane": 0, "agent_compute-ego": 0.20737828737423744, "deviation-heading": 0.7854059946495453, "set_robot_commands": 0.08446863845542625, "deviation-center-line": 0.5135734996132552, "driven_lanedir_consec": 1.349704181184413, "sim_compute_sim_state": 0.03384544378445472, "sim_compute_performance-ego": 0.06262452661255259, "sim_compute_robot_state-ego": 0.06392931496655499, "sim_compute_robot_state-npc0": 0.06024970243006577, "sim_compute_robot_state-npc1": 0.0603605611824695, "sim_compute_robot_state-npc2": 0.059421405380154835, "sim_compute_robot_state-npc3": 0.05943729406521644}, "udem1-1-0": {"driven_any": 0.4483038438343857, "sim_physics": 0.1944651521485427, "survival_time": 2.8999999999999977, "driven_lanedir": 0.4226843204952568, "sim_render-ego": 0.06312317272712445, "in-drivable-lane": 0, "agent_compute-ego": 0.24081028329915016, "deviation-heading": 0.9833905711787422, "set_robot_commands": 0.09462197895707757, "deviation-center-line": 0.20838323969703185, "driven_lanedir_consec": 0.4226843204952568, "sim_compute_sim_state": 0.04031549239980763, "sim_compute_performance-ego": 0.07303933028517098, "sim_compute_robot_state-ego": 0.07257994701122415, "sim_compute_robot_state-npc0": 0.07271349019017713, "sim_compute_robot_state-npc1": 0.06892230181858458, "sim_compute_robot_state-npc2": 0.06693886477371742, "sim_compute_robot_state-npc3": 0.06809870127973885}, "udem1-2-0": {"driven_any": 2.169128413136148, "sim_physics": 0.1784298775242824, "survival_time": 12.750000000000046, "driven_lanedir": 1.7728095571844806, "sim_render-ego": 0.058147586560716814, "in-drivable-lane": 2.2000000000000313, "agent_compute-ego": 0.21870157952402153, "deviation-heading": 0.8644122890492316, "set_robot_commands": 0.086009666966457, "deviation-center-line": 0.6336040432427312, "driven_lanedir_consec": 1.7727843554142828, "sim_compute_sim_state": 0.03547094475989248, "sim_compute_performance-ego": 0.06281317916570925, "sim_compute_robot_state-ego": 0.06827142752853094, "sim_compute_robot_state-npc0": 0.06443559235217525, "sim_compute_robot_state-npc1": 0.06371428265291101, "sim_compute_robot_state-npc2": 0.06348480523801317, "sim_compute_robot_state-npc3": 0.0618650380302878}, "udem1-3-0": {"driven_any": 2.5534750247741376, "sim_physics": 0.18150043567021687, "survival_time": 14.950000000000076, "driven_lanedir": 2.320009231072208, "sim_render-ego": 0.05951105117797851, "in-drivable-lane": 1.3000000000000185, "agent_compute-ego": 0.2267906594276428, "deviation-heading": 0.8527152034102187, "set_robot_commands": 0.09161422491073608, "deviation-center-line": 1.0680309819943516, "driven_lanedir_consec": 2.3199836050434404, "sim_compute_sim_state": 0.03810274600982666, "sim_compute_performance-ego": 0.06795958598454793, "sim_compute_robot_state-ego": 0.07215615272521973, "sim_compute_robot_state-npc0": 0.06867355902989705, "sim_compute_robot_state-npc1": 0.06742413759231568, "sim_compute_robot_state-npc2": 0.06603851159413655, "sim_compute_robot_state-npc3": 0.06712712208429972}, "udem1-4-0": {"driven_any": 0.36968771707772213, "sim_physics": 0.17604111651985013, "survival_time": 2.4499999999999993, "driven_lanedir": 0.35661432194998266, "sim_render-ego": 0.058815776085367005, "in-drivable-lane": 0, "agent_compute-ego": 0.2147966161066172, "deviation-heading": 0.6524331044587797, "set_robot_commands": 0.0863172959308235, "deviation-center-line": 0.17497068978210834, "driven_lanedir_consec": 0.35661432194998266, "sim_compute_sim_state": 0.03720334597996303, "sim_compute_performance-ego": 0.06364175738120566, "sim_compute_robot_state-ego": 0.07049610663433464, "sim_compute_robot_state-npc0": 0.06291585552449129, "sim_compute_robot_state-npc1": 0.06324453743136658, "sim_compute_robot_state-npc2": 0.06394011633736747, "sim_compute_robot_state-npc3": 0.06501986055958028}, "udem1-5-0": {"driven_any": 1.0422940344693128, "sim_physics": 0.1616687850346641, "survival_time": 6.299999999999986, "driven_lanedir": 0.3977931184447061, "sim_render-ego": 0.05222206645541721, "in-drivable-lane": 2.94999999999999, "agent_compute-ego": 0.20187060416690888, "deviation-heading": 2.0606697069733593, "set_robot_commands": 0.08063065816485693, "deviation-center-line": 0.33341532886591296, "driven_lanedir_consec": 0.3977931184447061, "sim_compute_sim_state": 0.03366036642165411, "sim_compute_performance-ego": 0.057754720960344584, "sim_compute_robot_state-ego": 0.060668583900209454, "sim_compute_robot_state-npc0": 0.058301064703199595, "sim_compute_robot_state-npc1": 0.059340352103823706, "sim_compute_robot_state-npc2": 0.05916883642711337, "sim_compute_robot_state-npc3": 0.058577155310010155}, "udem1-6-0": {"driven_any": 0.806444978131922, "sim_physics": 0.1632484474567452, "survival_time": 4.94999999999999, "driven_lanedir": 0.8035043721169954, "sim_render-ego": 0.05046743575972741, "in-drivable-lane": 0, "agent_compute-ego": 0.18410092170792397, "deviation-heading": 0.4193380514366821, "set_robot_commands": 0.0706047241133873, "deviation-center-line": 0.4521438668866459, "driven_lanedir_consec": 0.8035043721169954, "sim_compute_sim_state": 0.031309816572401256, "sim_compute_performance-ego": 0.052710058713200114, "sim_compute_robot_state-ego": 0.05662678949760668, "sim_compute_robot_state-npc0": 0.05571620151250049, "sim_compute_robot_state-npc1": 0.05392583692916716, "sim_compute_robot_state-npc2": 0.053246657053629555, "sim_compute_robot_state-npc3": 0.05397228279499093}, "udem1-7-0": {"driven_any": 1.0073534337246877, "sim_physics": 0.1753149736123007, "survival_time": 6.099999999999986, "driven_lanedir": 0.8835141035321403, "sim_render-ego": 0.053683177369539856, "in-drivable-lane": 0, "agent_compute-ego": 0.2090711359117852, "deviation-heading": 2.247171448785188, "set_robot_commands": 0.08345583032389156, "deviation-center-line": 0.37984219953095794, "driven_lanedir_consec": 0.8699571327515463, "sim_compute_sim_state": 0.036032934657862926, "sim_compute_performance-ego": 0.061541078520602865, "sim_compute_robot_state-ego": 0.06372736711971096, "sim_compute_robot_state-npc0": 0.06175728313258437, "sim_compute_robot_state-npc1": 0.06167042841676806, "sim_compute_robot_state-npc2": 0.06099127941444272, "sim_compute_robot_state-npc3": 0.06194405477555072}, "udem1-8-0": {"driven_any": 1.0248237349996272, "sim_physics": 0.16847854660403344, "survival_time": 6.199999999999986, "driven_lanedir": 0.6115511519355601, "sim_render-ego": 0.05821573734283447, "in-drivable-lane": 1.7499999999999938, "agent_compute-ego": 0.22646634617159445, "deviation-heading": 2.0843979982694227, "set_robot_commands": 0.08865055537992908, "deviation-center-line": 0.422810088980332, "driven_lanedir_consec": 0.6115511519355601, "sim_compute_sim_state": 0.03695705436891125, "sim_compute_performance-ego": 0.06465587885149064, "sim_compute_robot_state-ego": 0.07038880548169536, "sim_compute_robot_state-npc0": 0.0662179377771193, "sim_compute_robot_state-npc1": 0.06768460619834162, "sim_compute_robot_state-npc2": 0.066291747554656, "sim_compute_robot_state-npc3": 0.06592234680729528}, "udem1-9-0": {"driven_any": 0.4483038436627429, "sim_physics": 0.21281704820435624, "survival_time": 2.8999999999999977, "driven_lanedir": 0.4319199677822532, "sim_render-ego": 0.059479051622851144, "in-drivable-lane": 0, "agent_compute-ego": 0.2302473947919648, "deviation-heading": 0.7843852312230172, "set_robot_commands": 0.09298109186106716, "deviation-center-line": 0.19267159047164883, "driven_lanedir_consec": 0.4319199677822532, "sim_compute_sim_state": 0.03792332780772242, "sim_compute_performance-ego": 0.06692788107641812, "sim_compute_robot_state-ego": 0.07169935621064284, "sim_compute_robot_state-npc0": 0.0633230209350586, "sim_compute_robot_state-npc1": 0.06601200843679494, "sim_compute_robot_state-npc2": 0.06796681469884412, "sim_compute_robot_state-npc3": 0.06888561824272418}, "udem1-10-0": {"driven_any": 0.3609526397352217, "sim_physics": 0.13652426501115164, "survival_time": 2.3999999999999995, "driven_lanedir": 0.3414443288920854, "sim_render-ego": 0.05012953778107961, "in-drivable-lane": 0, "agent_compute-ego": 0.18366585671901703, "deviation-heading": 0.7915362159748539, "set_robot_commands": 0.07276544471581776, "deviation-center-line": 0.16662188238079648, "driven_lanedir_consec": 0.3414443288920854, "sim_compute_sim_state": 0.02814263602097829, "sim_compute_performance-ego": 0.05132330457369486, "sim_compute_robot_state-ego": 0.05397580067316691, "sim_compute_robot_state-npc0": 0.05324078599611918, "sim_compute_robot_state-npc1": 0.0516338050365448, "sim_compute_robot_state-npc2": 0.05148957669734955, "sim_compute_robot_state-npc3": 0.05064860979715983}, "udem1-11-0": {"driven_any": 0.4046281574961264, "sim_physics": 0.17425620780800874, "survival_time": 2.6499999999999986, "driven_lanedir": 0.40003643479537576, "sim_render-ego": 0.059543209255866286, "in-drivable-lane": 0, "agent_compute-ego": 0.2275342851314905, "deviation-heading": 0.3980684508158633, "set_robot_commands": 0.09360101537884406, "deviation-center-line": 0.2708859521467339, "driven_lanedir_consec": 0.40003643479537576, "sim_compute_sim_state": 0.04588238698131633, "sim_compute_performance-ego": 0.06477773864314242, "sim_compute_robot_state-ego": 0.07112785105435353, "sim_compute_robot_state-npc0": 0.06320575048338692, "sim_compute_robot_state-npc1": 0.06361128249258366, "sim_compute_robot_state-npc2": 0.06380772140790832, "sim_compute_robot_state-npc3": 0.06412427830246259}, "udem1-12-0": {"driven_any": 1.5489327489523863, "sim_physics": 0.18279394636983456, "survival_time": 9.199999999999996, "driven_lanedir": 0.3359040954329422, "sim_render-ego": 0.05661508700122004, "in-drivable-lane": 6.899999999999996, "agent_compute-ego": 0.2153776197329811, "deviation-heading": 0.4854799489598317, "set_robot_commands": 0.08781885582467784, "deviation-center-line": 0.2750717398716856, "driven_lanedir_consec": 0.3359040954329422, "sim_compute_sim_state": 0.03592445539391559, "sim_compute_performance-ego": 0.06084367373715276, "sim_compute_robot_state-ego": 0.06565342778744905, "sim_compute_robot_state-npc0": 0.06527293894601904, "sim_compute_robot_state-npc1": 0.06513830501100291, "sim_compute_robot_state-npc2": 0.06659146236336749, "sim_compute_robot_state-npc3": 0.06259006391400876}, "udem1-13-0": {"driven_any": 0.9898831334165998, "sim_physics": 0.1600898047288259, "survival_time": 5.999999999999987, "driven_lanedir": 0.6517710759380049, "sim_render-ego": 0.05402262409528096, "in-drivable-lane": 1.4499999999999948, "agent_compute-ego": 0.21399815479914347, "deviation-heading": 1.32323720047233, "set_robot_commands": 0.08393151760101318, "deviation-center-line": 0.3285019922645743, "driven_lanedir_consec": 0.6517710759380049, "sim_compute_sim_state": 0.03379512031873067, "sim_compute_performance-ego": 0.06050180594126384, "sim_compute_robot_state-ego": 0.06370269854863485, "sim_compute_robot_state-npc0": 0.06445305148760477, "sim_compute_robot_state-npc1": 0.061798487106959024, "sim_compute_robot_state-npc2": 0.0630123237768809, "sim_compute_robot_state-npc3": 0.058296746015548705}, "udem1-14-0": {"driven_any": 1.243202490756078, "sim_physics": 0.19875283369281949, "survival_time": 7.449999999999981, "driven_lanedir": 0.6551159115412959, "sim_render-ego": 0.059761714615277794, "in-drivable-lane": 2.299999999999992, "agent_compute-ego": 0.22427812038652048, "deviation-heading": 3.0037699632472425, "set_robot_commands": 0.08876893344341509, "deviation-center-line": 0.44915491140973257, "driven_lanedir_consec": 0.4666277151948612, "sim_compute_sim_state": 0.0367012071929522, "sim_compute_performance-ego": 0.0669086379492843, "sim_compute_robot_state-ego": 0.07077355192811698, "sim_compute_robot_state-npc0": 0.06753436190969991, "sim_compute_robot_state-npc1": 0.06654394072974289, "sim_compute_robot_state-npc2": 0.06632584853460324, "sim_compute_robot_state-npc3": 0.06508081871391143}}
set_robot_commands_max0.09462197895707757
set_robot_commands_mean0.08574936213516135
set_robot_commands_median0.0863172959308235
set_robot_commands_min0.0706047241133873
sim_compute_performance-ego_max0.07303933028517098
sim_compute_performance-ego_mean0.06253487722638539
sim_compute_performance-ego_median0.06281317916570925
sim_compute_performance-ego_min0.05132330457369486
sim_compute_robot_state-ego_max0.07257994701122415
sim_compute_robot_state-ego_mean0.06638514540449673
sim_compute_robot_state-ego_median0.06827142752853094
sim_compute_robot_state-ego_min0.05397580067316691
sim_compute_robot_state-npc0_max0.07271349019017713
sim_compute_robot_state-npc0_mean0.06320070642733991
sim_compute_robot_state-npc0_median0.0633230209350586
sim_compute_robot_state-npc0_min0.05324078599611918
sim_compute_robot_state-npc1_max0.06892230181858458
sim_compute_robot_state-npc1_mean0.06273499154262509
sim_compute_robot_state-npc1_median0.06361128249258366
sim_compute_robot_state-npc1_min0.0516338050365448
sim_compute_robot_state-npc2_max0.06796681469884412
sim_compute_robot_state-npc2_mean0.06258106475014566
sim_compute_robot_state-npc2_median0.06380772140790832
sim_compute_robot_state-npc2_min0.05148957669734955
sim_compute_robot_state-npc3_max0.06888561824272418
sim_compute_robot_state-npc3_mean0.06210599937951904
sim_compute_robot_state-npc3_median0.06259006391400876
sim_compute_robot_state-npc3_min0.05064860979715983
sim_compute_sim_state_max0.04588238698131633
sim_compute_sim_state_mean0.03608448524469265
sim_compute_sim_state_median0.036032934657862926
sim_compute_sim_state_min0.02814263602097829
sim_physics_max0.21281704820435624
sim_physics_mean0.1750162925382215
sim_physics_median0.1753149736123007
sim_physics_min0.13652426501115164
sim_render-ego_max0.06312317272712445
sim_render-ego_mean0.05666305775650816
sim_render-ego_median0.058147586560716814
sim_render-ego_min0.05012953778107961
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean6.353333333333333
survival_time_min2.3999999999999995
No reset possible
226902964Julian ZillyBaseline-IL-logs-tensorflowaido2-LFVI-sim-testingstep1-simulationerroryesip-172-31-42-167-72270:30:04
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
226792990Maxim Scherbakovchallenge-aido_LF-template-tensorflowaido2-LF-sim-testingstep1-simulationsuccessyesip-172-31-42-167-72270:19:55
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.4674105668566355
survival_time_median2.2
deviation-center-line_median0.14260864304413795
in-drivable-lane_median0.05000000000000005


other stats
agent_compute-ego_max0.16078927176339286
agent_compute-ego_mean0.14282817072772858
agent_compute-ego_median0.14508687727379077
agent_compute-ego_min0.12342469692230223
deviation-center-line_max0.24855260007623764
deviation-center-line_mean0.1536149482643388
deviation-center-line_min0.054939994894037315
deviation-heading_max1.8641620598518744
deviation-heading_mean0.8952012229712518
deviation-heading_median0.7895172974159795
deviation-heading_min0.16887123225343423
driven_any_max1.115020174350162
driven_any_mean0.6913356929021803
driven_any_median0.5698572536338683
driven_any_min0.2242253658467636
driven_lanedir_consec_max1.0109122045607752
driven_lanedir_consec_mean0.530901817664039
driven_lanedir_consec_min0.2043437063123985
driven_lanedir_max1.0109122045607752
driven_lanedir_mean0.5357764002052454
driven_lanedir_median0.4674105668566355
driven_lanedir_min0.2043437063123985
in-drivable-lane_max0.8499999999999988
in-drivable-lane_mean0.21333333333333268
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.5698572536338683, "sim_physics": 0.1197052923115817, "survival_time": 2.2, "driven_lanedir": 0.4674105668566355, "sim_render-ego": 0.06454132361845537, "in-drivable-lane": 0.04999999999999982, "agent_compute-ego": 0.15045611424879593, "deviation-heading": 0.986047559590748, "set_robot_commands": 0.09872914986176924, "deviation-center-line": 0.15850046398007744, "driven_lanedir_consec": 0.4674105668566355, "sim_compute_sim_state": 0.04202381047335538, "sim_compute_performance-ego": 0.0703295577656139, "sim_compute_robot_state-ego": 0.07401771437038075}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.0985958356678462, "sim_physics": 0.11414403091242284, "survival_time": 4.049999999999994, "driven_lanedir": 0.6188261785631852, "sim_render-ego": 0.058628356015240704, "in-drivable-lane": 0.849999999999997, "agent_compute-ego": 0.14910571957811897, "deviation-heading": 1.8641620598518744, "set_robot_commands": 0.09392536128008808, "deviation-center-line": 0.23887642097618683, "driven_lanedir_consec": 0.6188261785631852, "sim_compute_sim_state": 0.03865203150996455, "sim_compute_performance-ego": 0.06899055139518079, "sim_compute_robot_state-ego": 0.07644848764678579}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.0141832231616486, "sim_physics": 0.09869634571360118, "survival_time": 3.349999999999996, "driven_lanedir": 0.6240440080843483, "sim_render-ego": 0.05711614551828868, "in-drivable-lane": 0.8499999999999988, "agent_compute-ego": 0.13779151973439685, "deviation-heading": 1.2465664826829024, "set_robot_commands": 0.0864762334681269, "deviation-center-line": 0.2026247100413827, "driven_lanedir_consec": 0.6240440080843483, "sim_compute_sim_state": 0.03696886817021156, "sim_compute_performance-ego": 0.05955210728431815, "sim_compute_robot_state-ego": 0.06565097908475506}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.4730904817176167, "sim_physics": 0.13165937151227677, "survival_time": 1.7500000000000009, "driven_lanedir": 0.4262039888411144, "sim_render-ego": 0.06161456789289202, "in-drivable-lane": 0.05000000000000005, "agent_compute-ego": 0.16078927176339286, "deviation-heading": 0.5649772595087351, "set_robot_commands": 0.0974483013153076, "deviation-center-line": 0.10057119795270568, "driven_lanedir_consec": 0.4262039888411144, "sim_compute_sim_state": 0.03989124979291644, "sim_compute_performance-ego": 0.07575529643467495, "sim_compute_robot_state-ego": 0.08035784448896136}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.0793444208920262, "sim_physics": 0.1068226026766228, "survival_time": 3.2999999999999963, "driven_lanedir": 0.7060654197835117, "sim_render-ego": 0.06008834911115242, "in-drivable-lane": 0.14999999999999947, "agent_compute-ego": 0.14508687727379077, "deviation-heading": 1.859862636690693, "set_robot_commands": 0.08988872802618778, "deviation-center-line": 0.20762517952512652, "driven_lanedir_consec": 0.6329466816654139, "sim_compute_sim_state": 0.03948089931950425, "sim_compute_performance-ego": 0.06781721476352576, "sim_compute_robot_state-ego": 0.0721688089948712}, "ETHZ_autolab_technical_track-5-0": {"driven_any": 1.0854626323213636, "sim_physics": 0.11847137769063314, "survival_time": 3.7499999999999942, "driven_lanedir": 0.8941456058271351, "sim_render-ego": 0.06262227058410645, "in-drivable-lane": 0.2499999999999991, "agent_compute-ego": 0.15615893999735514, "deviation-heading": 1.5242487591729903, "set_robot_commands": 0.10125529289245604, "deviation-center-line": 0.24855260007623764, "driven_lanedir_consec": 0.8941456058271351, "sim_compute_sim_state": 0.03989203770955404, "sim_compute_performance-ego": 0.07273376146952311, "sim_compute_robot_state-ego": 0.0792226791381836}, "ETHZ_autolab_technical_track-6-0": {"driven_any": 0.4975230586545693, "sim_physics": 0.11407703619736892, "survival_time": 1.950000000000001, "driven_lanedir": 0.4623215168562016, "sim_render-ego": 0.05972836567805363, "in-drivable-lane": 0, "agent_compute-ego": 0.14738033979366988, "deviation-heading": 0.8083924602797856, "set_robot_commands": 0.09181320361602, "deviation-center-line": 0.18107931077120223, "driven_lanedir_consec": 0.4623215168562016, "sim_compute_sim_state": 0.03899241105104104, "sim_compute_performance-ego": 0.06626442762521598, "sim_compute_robot_state-ego": 0.06759114754505646}, "ETHZ_autolab_technical_track-7-0": {"driven_any": 0.7639702521227303, "sim_physics": 0.11910515643180684, "survival_time": 2.3499999999999996, "driven_lanedir": 0.6388081427034005, "sim_render-ego": 0.05981422485189235, "in-drivable-lane": 0.14999999999999947, "agent_compute-ego": 0.14519372899481592, "deviation-heading": 0.7857308395630479, "set_robot_commands": 0.0927539531220781, "deviation-center-line": 0.13384131025090726, "driven_lanedir_consec": 0.6388081427034005, "sim_compute_sim_state": 0.039263532516804145, "sim_compute_performance-ego": 0.07147267524232255, "sim_compute_robot_state-ego": 0.07540180835318058}, "ETHZ_autolab_technical_track-8-0": {"driven_any": 0.2727753478149496, "sim_physics": 0.11133464574813842, "survival_time": 1.0000000000000002, "driven_lanedir": 0.245270103761297, "sim_render-ego": 0.05800687074661255, "in-drivable-lane": 0, "agent_compute-ego": 0.13222719430923463, "deviation-heading": 0.3538261212195276, "set_robot_commands": 0.09118638038635254, "deviation-center-line": 0.054939994894037315, "driven_lanedir_consec": 0.245270103761297, "sim_compute_sim_state": 0.03701982498168945, "sim_compute_performance-ego": 0.06322704553604126, "sim_compute_robot_state-ego": 0.06554750204086304}, "ETHZ_autolab_technical_track-9-0": {"driven_any": 0.2242253658467636, "sim_physics": 0.10692928234736124, "survival_time": 1.2000000000000004, "driven_lanedir": 0.2043437063123985, "sim_render-ego": 0.056670536597569786, "in-drivable-lane": 0, "agent_compute-ego": 0.13902821143468222, "deviation-heading": 0.392570122212106, "set_robot_commands": 0.08662878473599751, "deviation-center-line": 0.10303347017776196, "driven_lanedir_consec": 0.2043437063123985, "sim_compute_sim_state": 0.03550867239634196, "sim_compute_performance-ego": 0.06239059567451477, "sim_compute_robot_state-ego": 0.066602756579717}, "ETHZ_autolab_technical_track-10-0": {"driven_any": 0.3890457352602684, "sim_physics": 0.11020803451538086, "survival_time": 1.3500000000000003, "driven_lanedir": 0.370010549565549, "sim_render-ego": 0.06152955691019694, "in-drivable-lane": 0, "agent_compute-ego": 0.13469083220870406, "deviation-heading": 0.30955396972767846, "set_robot_commands": 0.08793067049097132, "deviation-center-line": 0.11479870198382952, "driven_lanedir_consec": 0.370010549565549, "sim_compute_sim_state": 0.03769452483565719, "sim_compute_performance-ego": 0.06674381538673684, "sim_compute_robot_state-ego": 0.07138112739280418}, "ETHZ_autolab_technical_track-11-0": {"driven_any": 0.4136641462617409, "sim_physics": 0.10320230325063068, "survival_time": 1.5000000000000009, "driven_lanedir": 0.3848177438390939, "sim_render-ego": 0.057191356023152666, "in-drivable-lane": 0.05000000000000005, "agent_compute-ego": 0.13151512145996094, "deviation-heading": 0.3345732011189008, "set_robot_commands": 0.0860421101252238, "deviation-center-line": 0.1107455533021294, "driven_lanedir_consec": 0.3848177438390939, "sim_compute_sim_state": 0.03575569788614909, "sim_compute_performance-ego": 0.06546770731608073, "sim_compute_robot_state-ego": 0.06376083691914876}, "ETHZ_autolab_technical_track-12-0": {"driven_any": 1.115020174350162, "sim_physics": 0.10040699067662974, "survival_time": 3.049999999999997, "driven_lanedir": 1.0109122045607752, "sim_render-ego": 0.05651704991450075, "in-drivable-lane": 0.09999999999999964, "agent_compute-ego": 0.13690479857022644, "deviation-heading": 0.7895172974159795, "set_robot_commands": 0.0893147421664879, "deviation-center-line": 0.14260864304413795, "driven_lanedir_consec": 1.0109122045607752, "sim_compute_sim_state": 0.03825966256563781, "sim_compute_performance-ego": 0.06801813938578621, "sim_compute_robot_state-ego": 0.06942095131170554}, "ETHZ_autolab_technical_track-13-0": {"driven_any": 1.1097736052757812, "sim_physics": 0.10951447813478236, "survival_time": 3.649999999999995, "driven_lanedir": 0.7290041333729471, "sim_render-ego": 0.06152659246366318, "in-drivable-lane": 0.6999999999999975, "agent_compute-ego": 0.15266919462648157, "deviation-heading": 1.4391183432803738, "set_robot_commands": 0.09493612263300648, "deviation-center-line": 0.20987123968971763, "driven_lanedir_consec": 0.7290041333729471, "sim_compute_sim_state": 0.037008847275825395, "sim_compute_performance-ego": 0.06688708475191299, "sim_compute_robot_state-ego": 0.07470039472188035}, "ETHZ_autolab_technical_track-14-0": {"driven_any": 0.2635038605513683, "sim_physics": 0.10474686622619628, "survival_time": 1.0000000000000002, "driven_lanedir": 0.25446213415108776, "sim_render-ego": 0.052589905261993405, "in-drivable-lane": 0, "agent_compute-ego": 0.12342469692230223, "deviation-heading": 0.16887123225343423, "set_robot_commands": 0.07996058464050293, "deviation-center-line": 0.0965554272996418, "driven_lanedir_consec": 0.25446213415108776, "sim_compute_sim_state": 0.03388156890869141, "sim_compute_performance-ego": 0.061900758743286134, "sim_compute_robot_state-ego": 0.0649411916732788}}
set_robot_commands_max0.10125529289245604
set_robot_commands_mean0.09121930791737176
set_robot_commands_median0.09118638038635254
set_robot_commands_min0.07996058464050293
sim_compute_performance-ego_max0.07575529643467495
sim_compute_performance-ego_mean0.06717004925164893
sim_compute_performance-ego_median0.06688708475191299
sim_compute_performance-ego_min0.05955210728431815
sim_compute_robot_state-ego_max0.08035784448896136
sim_compute_robot_state-ego_mean0.07114761535077149
sim_compute_robot_state-ego_median0.07138112739280418
sim_compute_robot_state-ego_min0.06376083691914876
sim_compute_sim_state_max0.04202381047335538
sim_compute_sim_state_mean0.03801957595955625
sim_compute_sim_state_median0.03825966256563781
sim_compute_sim_state_min0.03388156890869141
sim_physics_max0.13165937151227677
sim_physics_mean0.1112682542896956
sim_physics_median0.11020803451538086
sim_physics_min0.09869634571360118
sim_render-ego_max0.06454132361845537
sim_render-ego_mean0.05921236474585139
sim_render-ego_median0.05972836567805363
sim_render-ego_min0.052589905261993405
simulation-passed1
survival_time_max4.049999999999994
survival_time_mean2.3633333333333315
survival_time_min1.0000000000000002
No reset possible
226692998Manfred Diazchallenge-aido_LF-template-tensorflowaido2-LFV-sim-testingstep1-simulationerroryesip-172-31-42-167-72270:00:35
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
226613010Manfred Diazchallenge-aido_LF-template-pytorchaido2-LFV-sim-testingstep1-simulationerroryesip-172-31-42-167-72270:00:34
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
226573018Manfred Diazchallenge-aido_LF-template-pytorchaido2-LF-sim-testingstep1-simulationerroryesip-172-31-42-167-72270:00:43
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
226503035Manfred Diazchallenge-aido_LF-template-pytorchaido2-LFV-sim-validationstep1-simulationerroryesip-172-31-42-167-72270:01:28
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
226453043Manfred Diazchallenge-aido_LF-template-tensorflowaido2-LF-sim-validationstep1-simulationerroryesip-172-31-42-167-72270:02:05
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
226033116Peter Almasi 🇭🇺Baseline solution using reinforcement learningaido2-LF-sim-testingstep1-simulationerroryesip-172-31-42-167-72270:41:00
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
225903128Rami Al-Naim 🇷🇺modified configsaido2-LF-sim-validationstep1-simulationsuccessyesip-172-31-42-167-72270:18:52
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.788863100122598
survival_time_median11.55000000000003
deviation-center-line_median0.883874737421354
in-drivable-lane_median0


other stats
agent_compute-ego_max0.13429467192975988
agent_compute-ego_mean0.12628459943923823
agent_compute-ego_median0.12749469995498658
agent_compute-ego_min0.11807761589686076
deviation-center-line_max1.0946223724521775
deviation-center-line_mean0.6953784558293481
deviation-center-line_min0.17191299395167942
deviation-heading_max2.628846142364572
deviation-heading_mean1.7573813005909933
deviation-heading_median1.7199613100686606
deviation-heading_min0.8065682073729439
driven_any_max2.757705617427992
driven_any_mean1.833266693824096
driven_any_median2.1162018288910027
driven_any_min0.38982449960220633
driven_lanedir_consec_max2.683081207471093
driven_lanedir_consec_mean1.6709691393545196
driven_lanedir_consec_min0.3666403320209208
driven_lanedir_max2.683081207471093
driven_lanedir_mean1.6709691393545196
driven_lanedir_median1.788863100122598
driven_lanedir_min0.3666403320209208
in-drivable-lane_max1.4500000000000064
in-drivable-lane_mean0.5800000000000003
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.1449661689503934, "sim_physics": 0.10924721503442572, "survival_time": 6.449999999999985, "driven_lanedir": 1.108459393560946, "sim_render-ego": 0.061804226202558175, "in-drivable-lane": 0, "agent_compute-ego": 0.13127065813818642, "deviation-heading": 1.3107865801649998, "set_robot_commands": 0.0963860463726428, "deviation-center-line": 0.28244243279023584, "driven_lanedir_consec": 1.108459393560946, "sim_compute_sim_state": 0.037991956222889034, "sim_compute_performance-ego": 0.06721262044684831, "sim_compute_robot_state-ego": 0.07070313313210658}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 2.757705617427992, "sim_physics": 0.12120811382929483, "survival_time": 14.950000000000076, "driven_lanedir": 2.40780166359704, "sim_render-ego": 0.06306131601333619, "in-drivable-lane": 1.4499999999999948, "agent_compute-ego": 0.12028535127639772, "deviation-heading": 2.3207442629837907, "set_robot_commands": 0.10234675248463948, "deviation-center-line": 1.0946223724521775, "driven_lanedir_consec": 2.40780166359704, "sim_compute_sim_state": 0.04140539646148682, "sim_compute_performance-ego": 0.07082133928934733, "sim_compute_robot_state-ego": 0.0777511747678121}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 2.1162018288910027, "sim_physics": 0.11785315331958587, "survival_time": 11.55000000000003, "driven_lanedir": 1.788863100122598, "sim_render-ego": 0.06783663246022674, "in-drivable-lane": 1.4500000000000064, "agent_compute-ego": 0.13429467192975988, "deviation-heading": 1.7199613100686606, "set_robot_commands": 0.1019938477190026, "deviation-center-line": 0.883874737421354, "driven_lanedir_consec": 1.788863100122598, "sim_compute_sim_state": 0.04184405112163329, "sim_compute_performance-ego": 0.0723004826219567, "sim_compute_robot_state-ego": 0.08085418263555089}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.38982449960220633, "sim_physics": 0.11441489557425182, "survival_time": 2.3999999999999995, "driven_lanedir": 0.3666403320209208, "sim_render-ego": 0.061984499295552574, "in-drivable-lane": 0, "agent_compute-ego": 0.11807761589686076, "deviation-heading": 0.8065682073729439, "set_robot_commands": 0.09455598890781404, "deviation-center-line": 0.17191299395167942, "driven_lanedir_consec": 0.3666403320209208, "sim_compute_sim_state": 0.03933866818745931, "sim_compute_performance-ego": 0.07082806527614594, "sim_compute_robot_state-ego": 0.07123340666294098}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 2.7576353542488854, "sim_physics": 0.11172621170679728, "survival_time": 14.950000000000076, "driven_lanedir": 2.683081207471093, "sim_render-ego": 0.06116952021916707, "in-drivable-lane": 0, "agent_compute-ego": 0.12749469995498658, "deviation-heading": 2.628846142364572, "set_robot_commands": 0.09367799282073974, "deviation-center-line": 1.0440397425312935, "driven_lanedir_consec": 2.683081207471093, "sim_compute_sim_state": 0.03920460383097331, "sim_compute_performance-ego": 0.06848024686177571, "sim_compute_robot_state-ego": 0.07245434681574503}}
set_robot_commands_max0.10234675248463948
set_robot_commands_mean0.09779212566096772
set_robot_commands_median0.0963860463726428
set_robot_commands_min0.09367799282073974
sim_compute_performance-ego_max0.0723004826219567
sim_compute_performance-ego_mean0.0699285508992148
sim_compute_performance-ego_median0.07082133928934733
sim_compute_performance-ego_min0.06721262044684831
sim_compute_robot_state-ego_max0.08085418263555089
sim_compute_robot_state-ego_mean0.07459924880283111
sim_compute_robot_state-ego_median0.07245434681574503
sim_compute_robot_state-ego_min0.07070313313210658
sim_compute_sim_state_max0.04184405112163329
sim_compute_sim_state_mean0.03995693516488835
sim_compute_sim_state_median0.03933866818745931
sim_compute_sim_state_min0.037991956222889034
sim_physics_max0.12120811382929483
sim_physics_mean0.1148899178928711
sim_physics_median0.11441489557425182
sim_physics_min0.10924721503442572
sim_render-ego_max0.06783663246022674
sim_render-ego_mean0.06317123883816814
sim_render-ego_median0.061984499295552574
sim_render-ego_min0.06116952021916707
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean10.060000000000034
survival_time_min2.3999999999999995
No reset possible
225543542Peter Almasi 🇭🇺My solution using reinforcement learningaido2-LFV-sim-testingstep1-simulationerroryesip-172-31-42-167-72270:28:46
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
225373200Anastasiya Nikolskaya 🇷🇺NN Solutionaido2-LF-sim-validationstep1-simulationsuccessyesip-172-31-42-167-72270:15:40
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.2741917108025818
survival_time_median6.149999999999986
deviation-center-line_median0.5255953182189327
in-drivable-lane_median0.29999999999999893


other stats
agent_compute-ego_max0.11920613638112244
agent_compute-ego_mean0.10321787400202008
agent_compute-ego_median0.09974804520606996
agent_compute-ego_min0.09305051883061728
deviation-center-line_max1.3966197192599437
deviation-center-line_mean0.6600151295437044
deviation-center-line_min0.3850883390670986
deviation-heading_max2.317493657298202
deviation-heading_mean1.2943668649358675
deviation-heading_median1.306245165415645
deviation-heading_min0.3556489394582953
driven_any_max3.4726673490497113
driven_any_mean1.6860849178575343
driven_any_median1.37052851133553
driven_any_min0.7641285374625653
driven_lanedir_consec_max3.3295714704706763
driven_lanedir_consec_mean1.542493658186574
driven_lanedir_consec_min0.7600686978573941
driven_lanedir_max3.3295714704706763
driven_lanedir_mean1.542493658186574
driven_lanedir_median1.2741917108025818
driven_lanedir_min0.7600686978573941
in-drivable-lane_max1.2999999999999954
in-drivable-lane_mean0.3899999999999986
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.37052851133553, "sim_physics": 0.14529232281010326, "survival_time": 6.149999999999986, "driven_lanedir": 1.3389799348663602, "sim_render-ego": 0.06576415387595572, "in-drivable-lane": 0, "agent_compute-ego": 0.1061410651943548, "deviation-heading": 0.9554701659028992, "set_robot_commands": 0.10741307095783512, "deviation-center-line": 0.5255953182189327, "driven_lanedir_consec": 1.3389799348663602, "sim_compute_sim_state": 0.044252948063175854, "sim_compute_performance-ego": 0.07279589505699592, "sim_compute_robot_state-ego": 0.08164905144916318}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 3.4726673490497113, "sim_physics": 0.11096593856811524, "survival_time": 14.950000000000076, "driven_lanedir": 3.3295714704706763, "sim_render-ego": 0.05943371136983236, "in-drivable-lane": 0.29999999999999893, "agent_compute-ego": 0.09305051883061728, "deviation-heading": 2.317493657298202, "set_robot_commands": 0.09007409811019898, "deviation-center-line": 1.3966197192599437, "driven_lanedir_consec": 3.3295714704706763, "sim_compute_sim_state": 0.03730576038360596, "sim_compute_performance-ego": 0.06658477067947388, "sim_compute_robot_state-ego": 0.07266314347585043}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.7641285374625653, "sim_physics": 0.11035491379214005, "survival_time": 3.5499999999999954, "driven_lanedir": 0.7600686978573941, "sim_render-ego": 0.06354887720564721, "in-drivable-lane": 0, "agent_compute-ego": 0.11920613638112244, "deviation-heading": 0.3556489394582953, "set_robot_commands": 0.09625660869437204, "deviation-center-line": 0.3850883390670986, "driven_lanedir_consec": 0.7600686978573941, "sim_compute_sim_state": 0.040364429984294195, "sim_compute_performance-ego": 0.06702186356128102, "sim_compute_robot_state-ego": 0.07628271949123329}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.6669627589536304, "sim_physics": 0.1226870786576044, "survival_time": 7.349999999999982, "driven_lanedir": 1.2741917108025818, "sim_render-ego": 0.0628183244847927, "in-drivable-lane": 1.2999999999999954, "agent_compute-ego": 0.09794360439793594, "deviation-heading": 1.5369763966042964, "set_robot_commands": 0.09895638543732312, "deviation-center-line": 0.5357340420469399, "driven_lanedir_consec": 1.2741917108025818, "sim_compute_sim_state": 0.04040342772088083, "sim_compute_performance-ego": 0.07343006620601732, "sim_compute_robot_state-ego": 0.07973839798752143}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.156137432486233, "sim_physics": 0.11582530691073492, "survival_time": 5.1999999999999895, "driven_lanedir": 1.0096564769358576, "sim_render-ego": 0.06213269325403067, "in-drivable-lane": 0.34999999999999876, "agent_compute-ego": 0.09974804520606996, "deviation-heading": 1.306245165415645, "set_robot_commands": 0.0981413905437176, "deviation-center-line": 0.4570382291256076, "driven_lanedir_consec": 1.0096564769358576, "sim_compute_sim_state": 0.03854018449783325, "sim_compute_performance-ego": 0.07106007520969097, "sim_compute_robot_state-ego": 0.07186213594216567}}
set_robot_commands_max0.10741307095783512
set_robot_commands_mean0.09816831074868936
set_robot_commands_median0.0981413905437176
set_robot_commands_min0.09007409811019898
sim_compute_performance-ego_max0.07343006620601732
sim_compute_performance-ego_mean0.07017853414269183
sim_compute_performance-ego_median0.07106007520969097
sim_compute_performance-ego_min0.06658477067947388
sim_compute_robot_state-ego_max0.08164905144916318
sim_compute_robot_state-ego_mean0.0764390896691868
sim_compute_robot_state-ego_median0.07628271949123329
sim_compute_robot_state-ego_min0.07186213594216567
sim_compute_sim_state_max0.044252948063175854
sim_compute_sim_state_mean0.04017335012995802
sim_compute_sim_state_median0.040364429984294195
sim_compute_sim_state_min0.03730576038360596
sim_physics_max0.14529232281010326
sim_physics_mean0.12102511214773956
sim_physics_median0.11582530691073492
sim_physics_min0.11035491379214005
sim_render-ego_max0.06576415387595572
sim_render-ego_mean0.06273955203805173
sim_render-ego_median0.0628183244847927
sim_render-ego_min0.05943371136983236
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean7.440000000000007
survival_time_min3.5499999999999954
No reset possible
225273212Amaury Camus 🇨🇭challenge-aido_LF-template-randomaido2-LF-sim-testingstep1-simulationsuccessyesip-172-31-42-167-72270:15:54
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.5723310224856362
survival_time_median2.549999999999999
deviation-center-line_median0.10099507669212504
in-drivable-lane_median0.4499999999999984


other stats
agent_compute-ego_max0.16518081559075248
agent_compute-ego_mean0.14849343825951647
agent_compute-ego_median0.15440706479347358
agent_compute-ego_min0.11801325573640711
deviation-center-line_max0.2838635700333795
deviation-center-line_mean0.12786165368054708
deviation-center-line_min0.07112529346797256
deviation-heading_max0.5289022616823588
deviation-heading_mean0.3391682685652287
deviation-heading_median0.32928385103533875
deviation-heading_min0.19401296908406307
driven_any_max2.1706243860917107
driven_any_mean0.9759490378276146
driven_any_median1.0117660515775693
driven_any_min0.23626560261560617
driven_lanedir_consec_max1.919400421063832
driven_lanedir_consec_mean0.6896171461819246
driven_lanedir_consec_min0.2264965947033466
driven_lanedir_max1.919400421063832
driven_lanedir_mean0.6896171461819246
driven_lanedir_median0.5723310224856362
driven_lanedir_min0.2264965947033466
in-drivable-lane_max1.7999999999999936
in-drivable-lane_mean0.5899999999999982
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0243289631429708, "sim_physics": 0.07738417166250723, "survival_time": 2.6999999999999984, "driven_lanedir": 0.5723310224856362, "sim_render-ego": 0.043635306534943755, "in-drivable-lane": 0.9999999999999976, "agent_compute-ego": 0.12188785605960424, "deviation-heading": 0.19401296908406307, "set_robot_commands": 0.07697531912061903, "deviation-center-line": 0.15907928712407893, "driven_lanedir_consec": 0.5723310224856362, "sim_compute_sim_state": 0.029291510581970215, "sim_compute_performance-ego": 0.04966103147577356, "sim_compute_robot_state-ego": 0.05459047688378228}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.9933867744747804, "sim_physics": 0.10370931905858656, "survival_time": 2.549999999999999, "driven_lanedir": 0.8010406009604816, "sim_render-ego": 0.05983307782341452, "in-drivable-lane": 0.29999999999999893, "agent_compute-ego": 0.1532199710023169, "deviation-heading": 0.5289022616823588, "set_robot_commands": 0.09742384330899108, "deviation-center-line": 0.13005513204193506, "driven_lanedir_consec": 0.8010406009604816, "sim_compute_sim_state": 0.03873957372179218, "sim_compute_performance-ego": 0.0683598471622841, "sim_compute_robot_state-ego": 0.07314488934535607}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.23626560261560617, "sim_physics": 0.09765825552098892, "survival_time": 0.8500000000000002, "driven_lanedir": 0.2264965947033466, "sim_render-ego": 0.046211593291338754, "in-drivable-lane": 0, "agent_compute-ego": 0.11801325573640711, "deviation-heading": 0.23048898560984332, "set_robot_commands": 0.08134933078990263, "deviation-center-line": 0.0788839760023766, "driven_lanedir_consec": 0.2264965947033466, "sim_compute_sim_state": 0.03078438253963695, "sim_compute_performance-ego": 0.04979803982902976, "sim_compute_robot_state-ego": 0.0546112902024213}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.4346971317320432, "sim_physics": 0.08533355712890625, "survival_time": 1.2500000000000004, "driven_lanedir": 0.40985475638935265, "sim_render-ego": 0.04932748794555664, "in-drivable-lane": 0, "agent_compute-ego": 0.1307369899749756, "deviation-heading": 0.4138862827398061, "set_robot_commands": 0.07686433792114258, "deviation-center-line": 0.08421324241865966, "driven_lanedir_consec": 0.40985475638935265, "sim_compute_sim_state": 0.03176578521728515, "sim_compute_performance-ego": 0.05468446731567383, "sim_compute_robot_state-ego": 0.0529654598236084}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.618214457700942, "sim_physics": 0.11829186994818192, "survival_time": 3.949999999999994, "driven_lanedir": 0.7890999076769956, "sim_render-ego": 0.06336900554125822, "in-drivable-lane": 1.7999999999999936, "agent_compute-ego": 0.15488088281848764, "deviation-heading": 0.23606825392187256, "set_robot_commands": 0.09954697874527944, "deviation-center-line": 0.2072381278624381, "driven_lanedir_consec": 0.7890999076769956, "sim_compute_sim_state": 0.04015143611763097, "sim_compute_performance-ego": 0.06994145731382732, "sim_compute_robot_state-ego": 0.07663967337789415}, "ETHZ_autolab_technical_track-5-0": {"driven_any": 1.0038514956833002, "sim_physics": 0.09707772001928212, "survival_time": 2.4499999999999993, "driven_lanedir": 0.7531703123735944, "sim_render-ego": 0.056141775481554926, "in-drivable-lane": 0.4499999999999984, "agent_compute-ego": 0.1386057406055684, "deviation-heading": 0.4596437246381204, "set_robot_commands": 0.08685422430233079, "deviation-center-line": 0.08968283443958727, "driven_lanedir_consec": 0.7531703123735944, "sim_compute_sim_state": 0.035452229636056085, "sim_compute_performance-ego": 0.061752445843754986, "sim_compute_robot_state-ego": 0.06489214605214644}, "ETHZ_autolab_technical_track-6-0": {"driven_any": 1.0542898001504375, "sim_physics": 0.10645874057497295, "survival_time": 2.799999999999998, "driven_lanedir": 0.5389398655375865, "sim_render-ego": 0.06114740031106131, "in-drivable-lane": 1.1499999999999972, "agent_compute-ego": 0.15887082474572317, "deviation-heading": 0.4109275195546752, "set_robot_commands": 0.09185802936553956, "deviation-center-line": 0.10786249131209884, "driven_lanedir_consec": 0.5389398655375865, "sim_compute_sim_state": 0.038338805947984965, "sim_compute_performance-ego": 0.06956102166857038, "sim_compute_robot_state-ego": 0.07391739317349025}, "ETHZ_autolab_technical_track-7-0": {"driven_any": 0.3164475681403097, "sim_physics": 0.13412561870756604, "survival_time": 1.0500000000000005, "driven_lanedir": 0.3093025166124813, "sim_render-ego": 0.0697104363214402, "in-drivable-lane": 0, "agent_compute-ego": 0.16370303290230886, "deviation-heading": 0.2242052814634115, "set_robot_commands": 0.10664458501906622, "deviation-center-line": 0.09758615464743424, "driven_lanedir_consec": 0.3093025166124813, "sim_compute_sim_state": 0.04194303921290806, "sim_compute_performance-ego": 0.08136912754603795, "sim_compute_robot_state-ego": 0.08413418134053548}, "ETHZ_autolab_technical_track-8-0": {"driven_any": 1.2018528489510765, "sim_physics": 0.11888569896504032, "survival_time": 2.9499999999999975, "driven_lanedir": 0.6922532395203, "sim_render-ego": 0.06511033591577563, "in-drivable-lane": 1.0499999999999965, "agent_compute-ego": 0.15440706479347358, "deviation-heading": 0.32928385103533875, "set_robot_commands": 0.09908421564910372, "deviation-center-line": 0.07112529346797256, "driven_lanedir_consec": 0.6922532395203, "sim_compute_sim_state": 0.039788205744856496, "sim_compute_performance-ego": 0.07019101159047272, "sim_compute_robot_state-ego": 0.0768775010513047}, "ETHZ_autolab_technical_track-9-0": {"driven_any": 1.0435481553257333, "sim_physics": 0.12095764767039906, "survival_time": 2.7499999999999982, "driven_lanedir": 0.5204405548974873, "sim_render-ego": 0.06402306123213335, "in-drivable-lane": 1.1499999999999977, "agent_compute-ego": 0.15236693729053843, "deviation-heading": 0.33296447766287096, "set_robot_commands": 0.09351201490922408, "deviation-center-line": 0.0950267943453044, "driven_lanedir_consec": 0.5204405548974873, "sim_compute_sim_state": 0.038284982334483755, "sim_compute_performance-ego": 0.07211659604852849, "sim_compute_robot_state-ego": 0.07801404432816939}, "ETHZ_autolab_technical_track-10-0": {"driven_any": 1.5954548672193265, "sim_physics": 0.12133163910407524, "survival_time": 3.8499999999999943, "driven_lanedir": 1.1042463557848754, "sim_render-ego": 0.06288487880260914, "in-drivable-lane": 1.0499999999999965, "agent_compute-ego": 0.15440815454953677, "deviation-heading": 0.3566810710676767, "set_robot_commands": 0.0987993741964365, "deviation-center-line": 0.22513914436082189, "driven_lanedir_consec": 1.1042463557848754, "sim_compute_sim_state": 0.03860132415573318, "sim_compute_performance-ego": 0.07041774786912001, "sim_compute_robot_state-ego": 0.07716525065434443}, "ETHZ_autolab_technical_track-11-0": {"driven_any": 0.49030923107489305, "sim_physics": 0.12482187577656335, "survival_time": 1.4000000000000006, "driven_lanedir": 0.4826393189617785, "sim_render-ego": 0.06323105948311943, "in-drivable-lane": 0, "agent_compute-ego": 0.15072258881160192, "deviation-heading": 0.23322336656472228, "set_robot_commands": 0.09153297117778234, "deviation-center-line": 0.10099507669212504, "driven_lanedir_consec": 0.4826393189617785, "sim_compute_sim_state": 0.037735206740243096, "sim_compute_performance-ego": 0.07172695228031703, "sim_compute_robot_state-ego": 0.06896485601152692}, "ETHZ_autolab_technical_track-12-0": {"driven_any": 1.0117660515775693, "sim_physics": 0.11490081805808872, "survival_time": 2.549999999999999, "driven_lanedir": 0.791717039833255, "sim_render-ego": 0.06318563573500689, "in-drivable-lane": 0.3999999999999986, "agent_compute-ego": 0.15518763953564213, "deviation-heading": 0.320449356593834, "set_robot_commands": 0.09451901678945504, "deviation-center-line": 0.1017166571540705, "driven_lanedir_consec": 0.791717039833255, "sim_compute_sim_state": 0.03930749145208621, "sim_compute_performance-ego": 0.07027874273412368, "sim_compute_robot_state-ego": 0.07791759921055214}, "ETHZ_autolab_technical_track-13-0": {"driven_any": 0.44419823353351984, "sim_physics": 0.13744818722760235, "survival_time": 1.3500000000000003, "driven_lanedir": 0.4333246859278659, "sim_render-ego": 0.07067856082209835, "in-drivable-lane": 0, "agent_compute-ego": 0.16518081559075248, "deviation-heading": 0.2988926743481924, "set_robot_commands": 0.10743244489034016, "deviation-center-line": 0.08545702330592322, "driven_lanedir_consec": 0.4333246859278659, "sim_compute_sim_state": 0.04360642256560149, "sim_compute_performance-ego": 0.0736606032760055, "sim_compute_robot_state-ego": 0.0883776346842448}, "ETHZ_autolab_technical_track-14-0": {"driven_any": 2.1706243860917107, "sim_physics": 0.12215609643973556, "survival_time": 5.09999999999999, "driven_lanedir": 1.919400421063832, "sim_render-ego": 0.0634904235017066, "in-drivable-lane": 0.4999999999999982, "agent_compute-ego": 0.15520981947580972, "deviation-heading": 0.5178939525116442, "set_robot_commands": 0.09666385603886024, "deviation-center-line": 0.2838635700333795, "driven_lanedir_consec": 1.919400421063832, "sim_compute_sim_state": 0.03959233153100107, "sim_compute_performance-ego": 0.06744003529642142, "sim_compute_robot_state-ego": 0.07469556612126968}}
set_robot_commands_max0.10743244489034016
set_robot_commands_mean0.0932707028149382
set_robot_commands_median0.09451901678945504
set_robot_commands_min0.07686433792114258
sim_compute_performance-ego_max0.08136912754603795
sim_compute_performance-ego_mean0.0667306084833294
sim_compute_performance-ego_median0.06994145731382732
sim_compute_performance-ego_min0.04966103147577356
sim_compute_robot_state-ego_max0.0883776346842448
sim_compute_robot_state-ego_mean0.07179386415070975
sim_compute_robot_state-ego_median0.07469556612126968
sim_compute_robot_state-ego_min0.0529654598236084
sim_compute_sim_state_max0.04360642256560149
sim_compute_sim_state_mean0.03755884849995132
sim_compute_sim_state_median0.03860132415573318
sim_compute_sim_state_min0.029291510581970215
sim_physics_max0.13744818722760235
sim_physics_mean0.11203608105749976
sim_physics_median0.11829186994818192
sim_physics_min0.07738417166250723
sim_render-ego_max0.07067856082209835
sim_render-ego_mean0.060132002582867855
sim_render-ego_median0.06318563573500689
sim_render-ego_min0.043635306534943755
simulation-passed1
survival_time_max5.09999999999999
survival_time_mean2.503333333333331
survival_time_min0.8500000000000002
No reset possible
225183225Anastasiya Nikolskaya 🇷🇺JetBrains Researchaido2-LF-sim-validationstep1-simulationerroryesip-172-31-42-167-72270:06:42
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
225023235jiang pengRL - TH -hhkaido2-LF-sim-validationstep1-simulationsuccessyesip-172-31-42-167-72270:23:59
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.1983913415685112
survival_time_median14.950000000000076
deviation-center-line_median0.6850787478372781
in-drivable-lane_median1.2999999999999954


other stats
agent_compute-ego_max0.4241221670834523
agent_compute-ego_mean0.3876007399550453
agent_compute-ego_median0.3754875111579895
agent_compute-ego_min0.36152824958165486
deviation-center-line_max1.7178214473097992
deviation-center-line_mean0.7652117516387154
deviation-center-line_min0.16663604062107484
deviation-heading_max6.630879161706989
deviation-heading_mean2.7514377485618997
deviation-heading_median1.7662409830910664
deviation-heading_min0.9004302815499615
driven_any_max2.999167612240379
driven_any_mean1.7612804030677842
driven_any_median1.2814529152834666
driven_any_min1.020217595230667
driven_lanedir_consec_max2.9398018789941585
driven_lanedir_consec_mean1.5471043948167942
driven_lanedir_consec_min0.7724192105599141
driven_lanedir_max2.9398018789941585
driven_lanedir_mean1.5471043948167942
driven_lanedir_median1.1983913415685112
driven_lanedir_min0.7724192105599141
in-drivable-lane_max8.100000000000028
in-drivable-lane_mean2.9000000000000186
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.2814529152834666, "sim_physics": 0.11486467860993883, "survival_time": 5.249999999999989, "driven_lanedir": 0.7724192105599141, "sim_render-ego": 0.06300380343482608, "in-drivable-lane": 1.2999999999999954, "agent_compute-ego": 0.4124119531540644, "deviation-heading": 1.18926127832002, "set_robot_commands": 0.10078028043111166, "deviation-center-line": 0.41176379178095385, "driven_lanedir_consec": 0.7724192105599141, "sim_compute_sim_state": 0.04039531435285296, "sim_compute_performance-ego": 0.07392493202572777, "sim_compute_robot_state-ego": 0.0774755977448963}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.020217595230667, "sim_physics": 0.1298193616687127, "survival_time": 2.6499999999999986, "driven_lanedir": 0.8708362736898217, "sim_render-ego": 0.06724382796377507, "in-drivable-lane": 0.1999999999999993, "agent_compute-ego": 0.4241221670834523, "deviation-heading": 0.9004302815499615, "set_robot_commands": 0.10350080706038566, "deviation-center-line": 0.16663604062107484, "driven_lanedir_consec": 0.8708362736898217, "sim_compute_sim_state": 0.041961035638485314, "sim_compute_performance-ego": 0.07818290422547539, "sim_compute_robot_state-ego": 0.08859840429054117}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 2.999167612240379, "sim_physics": 0.11985732396443684, "survival_time": 14.950000000000076, "driven_lanedir": 2.9398018789941585, "sim_render-ego": 0.06519367853800456, "in-drivable-lane": 4.90000000000007, "agent_compute-ego": 0.3644538187980652, "deviation-heading": 1.7662409830910664, "set_robot_commands": 0.10189027388890584, "deviation-center-line": 0.6850787478372781, "driven_lanedir_consec": 2.9398018789941585, "sim_compute_sim_state": 0.04086846748987834, "sim_compute_performance-ego": 0.07294020096460978, "sim_compute_robot_state-ego": 0.0802271310488383}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.204334760078908, "sim_physics": 0.1163254181543986, "survival_time": 14.950000000000076, "driven_lanedir": 1.1983913415685112, "sim_render-ego": 0.06363127708435058, "in-drivable-lane": 0, "agent_compute-ego": 0.36152824958165486, "deviation-heading": 6.630879161706989, "set_robot_commands": 0.10460791269938152, "deviation-center-line": 1.7178214473097992, "driven_lanedir_consec": 1.1983913415685112, "sim_compute_sim_state": 0.04204733292261759, "sim_compute_performance-ego": 0.07094504674275716, "sim_compute_robot_state-ego": 0.0804587451616923}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 2.3012291325055, "sim_physics": 0.12099390268325806, "survival_time": 14.950000000000076, "driven_lanedir": 1.954073269271566, "sim_render-ego": 0.06389883279800415, "in-drivable-lane": 8.100000000000028, "agent_compute-ego": 0.3754875111579895, "deviation-heading": 3.270377038141461, "set_robot_commands": 0.10254108746846516, "deviation-center-line": 0.8447587306444703, "driven_lanedir_consec": 1.954073269271566, "sim_compute_sim_state": 0.041153624057769775, "sim_compute_performance-ego": 0.07105539639790853, "sim_compute_robot_state-ego": 0.08026451428731282}}
set_robot_commands_max0.10460791269938152
set_robot_commands_mean0.10266407230964995
set_robot_commands_median0.10254108746846516
set_robot_commands_min0.10078028043111166
sim_compute_performance-ego_max0.07818290422547539
sim_compute_performance-ego_mean0.07340969607129573
sim_compute_performance-ego_median0.07294020096460978
sim_compute_performance-ego_min0.07094504674275716
sim_compute_robot_state-ego_max0.08859840429054117
sim_compute_robot_state-ego_mean0.08140487850665619
sim_compute_robot_state-ego_median0.08026451428731282
sim_compute_robot_state-ego_min0.0774755977448963
sim_compute_sim_state_max0.04204733292261759
sim_compute_sim_state_mean0.0412851548923208
sim_compute_sim_state_median0.041153624057769775
sim_compute_sim_state_min0.04039531435285296
sim_physics_max0.1298193616687127
sim_physics_mean0.12037213701614902
sim_physics_median0.11985732396443684
sim_physics_min0.11486467860993883
sim_render-ego_max0.06724382796377507
sim_render-ego_mean0.06459428396379208
sim_render-ego_median0.06389883279800415
sim_render-ego_min0.06300380343482608
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean10.550000000000043
survival_time_min2.6499999999999986
No reset possible
225003237jiang pengSecond test - THaido2-LF-sim-validationstep1-simulationerroryesip-172-31-42-167-72270:00:29
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
224973240jiang pengSecond test - THaido2-LF-sim-validationstep1-simulationerroryesip-172-31-42-167-72270:00:31
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
224773270jiang pengFirst test - THaido2-LF-sim-validationstep1-simulationsuccessyesip-172-31-42-167-72270:24:04
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median2.732569779983079
survival_time_median14.950000000000076
deviation-center-line_median1.3088909637976252
in-drivable-lane_median0.2499999999999991


other stats
agent_compute-ego_max0.17541760603586834
agent_compute-ego_mean0.16663807121912638
agent_compute-ego_median0.17426217873891195
agent_compute-ego_min0.14786717414855957
deviation-center-line_max1.5017394198979486
deviation-center-line_mean1.1184325312986343
deviation-center-line_min0.06964352006535018
deviation-heading_max7.892533925983011
deviation-heading_mean5.123147457767591
deviation-heading_median5.4495764408882446
deviation-heading_min2.315642698211586
driven_any_max5.006219968165855
driven_any_mean2.68363899056599
driven_any_median2.906508313115725
driven_any_min0.5135772446808157
driven_lanedir_consec_max4.685364571279574
driven_lanedir_consec_mean2.3766419058094583
driven_lanedir_consec_min0.5115159308480957
driven_lanedir_max4.685364571279574
driven_lanedir_mean2.3766419058094583
driven_lanedir_median2.732569779983079
driven_lanedir_min0.5115159308480957
in-drivable-lane_max2.900000000000041
in-drivable-lane_mean0.7300000000000084
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.5135772446808157, "sim_physics": 0.09150862296422324, "survival_time": 14.950000000000076, "driven_lanedir": 0.5115159308480957, "sim_render-ego": 0.05572895129521688, "in-drivable-lane": 0, "agent_compute-ego": 0.1603718113899231, "deviation-heading": 6.156268431366704, "set_robot_commands": 0.08157912651697795, "deviation-center-line": 0.06964352006535018, "driven_lanedir_consec": 0.5115159308480957, "sim_compute_sim_state": 0.03449620723724365, "sim_compute_performance-ego": 0.05934163411458333, "sim_compute_robot_state-ego": 0.06586052417755127}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 5.006219968165855, "sim_physics": 0.1182863203684489, "survival_time": 14.950000000000076, "driven_lanedir": 4.685364571279574, "sim_render-ego": 0.0627890149752299, "in-drivable-lane": 0.5000000000000018, "agent_compute-ego": 0.17541760603586834, "deviation-heading": 2.315642698211586, "set_robot_commands": 0.09665383100509645, "deviation-center-line": 1.3088909637976252, "driven_lanedir_consec": 4.685364571279574, "sim_compute_sim_state": 0.03975577751795451, "sim_compute_performance-ego": 0.0704632560412089, "sim_compute_robot_state-ego": 0.07596733490626018}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 2.906508313115725, "sim_physics": 0.11692658265431724, "survival_time": 14.950000000000076, "driven_lanedir": 2.732569779983079, "sim_render-ego": 0.06363548676172892, "in-drivable-lane": 0.2499999999999991, "agent_compute-ego": 0.17527158578236898, "deviation-heading": 7.892533925983011, "set_robot_commands": 0.09271923065185549, "deviation-center-line": 1.5017394198979486, "driven_lanedir_consec": 2.732569779983079, "sim_compute_sim_state": 0.038709693749745686, "sim_compute_performance-ego": 0.0692694346110026, "sim_compute_robot_state-ego": 0.07308470884958904}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.1089971347571286, "sim_physics": 0.11663126150767009, "survival_time": 14.950000000000076, "driven_lanedir": 1.108191950356348, "sim_render-ego": 0.06212608734766642, "in-drivable-lane": 0, "agent_compute-ego": 0.17426217873891195, "deviation-heading": 5.4495764408882446, "set_robot_commands": 0.09511188904444376, "deviation-center-line": 1.4776116708377949, "driven_lanedir_consec": 1.108191950356348, "sim_compute_sim_state": 0.040215418338775635, "sim_compute_performance-ego": 0.06951912959416708, "sim_compute_robot_state-ego": 0.07555549383163453}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 3.8828922921104265, "sim_physics": 0.09692757209142049, "survival_time": 14.950000000000076, "driven_lanedir": 2.8455672965801964, "sim_render-ego": 0.05332414229710897, "in-drivable-lane": 2.900000000000041, "agent_compute-ego": 0.14786717414855957, "deviation-heading": 3.801715792388409, "set_robot_commands": 0.07882250706354776, "deviation-center-line": 1.2342770818944546, "driven_lanedir_consec": 2.8455672965801964, "sim_compute_sim_state": 0.034219493865966795, "sim_compute_performance-ego": 0.05891122500101725, "sim_compute_robot_state-ego": 0.06063933293024699}}
set_robot_commands_max0.09665383100509645
set_robot_commands_mean0.08897731685638428
set_robot_commands_median0.09271923065185549
set_robot_commands_min0.07882250706354776
sim_compute_performance-ego_max0.0704632560412089
sim_compute_performance-ego_mean0.06550093587239583
sim_compute_performance-ego_median0.0692694346110026
sim_compute_performance-ego_min0.05891122500101725
sim_compute_robot_state-ego_max0.07596733490626018
sim_compute_robot_state-ego_mean0.0702214789390564
sim_compute_robot_state-ego_median0.07308470884958904
sim_compute_robot_state-ego_min0.06063933293024699
sim_compute_sim_state_max0.040215418338775635
sim_compute_sim_state_mean0.03747931814193726
sim_compute_sim_state_median0.038709693749745686
sim_compute_sim_state_min0.034219493865966795
sim_physics_max0.1182863203684489
sim_physics_mean0.10805607191721596
sim_physics_median0.11663126150767009
sim_physics_min0.09150862296422324
sim_render-ego_max0.06363548676172892
sim_render-ego_mean0.059520736535390216
sim_render-ego_median0.06212608734766642
sim_render-ego_min0.05332414229710897
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean14.950000000000076
survival_time_min14.950000000000076
No reset possible
224573333FANG MEIYI 🇸🇬testaido2-LFV-sim-validationstep1-simulationerroryesip-172-31-42-167-72270:19:17
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
224473294Artem IoselevskiiSSegmaido2-LF-sim-validationstep1-simulationsuccessyesip-172-31-42-167-72270:08:57
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.63022393251254
survival_time_median4.549999999999992
deviation-center-line_median0.26373706556356136
in-drivable-lane_median0.1999999999999993


other stats
agent_compute-ego_max0.10791878830896665
agent_compute-ego_mean0.10464020120734056
agent_compute-ego_median0.10654690501454112
agent_compute-ego_min0.10004129308335324
deviation-center-line_max0.6144364465634398
deviation-center-line_mean0.32710983617265516
deviation-center-line_min0.16101686364899737
deviation-heading_max1.2120220205241528
deviation-heading_mean0.6066504028202278
deviation-heading_median0.4789650270486564
deviation-heading_min0.3161131166445413
driven_any_max1.703773432968235
driven_any_mean0.9310214045812928
driven_any_median1.019543694515259
driven_any_min0.3463654324913009
driven_lanedir_consec_max1.2672309232923884
driven_lanedir_consec_mean0.7420399913488278
driven_lanedir_consec_min0.3411103448246551
driven_lanedir_max1.2672309232923884
driven_lanedir_mean0.7420399913488278
driven_lanedir_median0.63022393251254
driven_lanedir_min0.3411103448246551
in-drivable-lane_max1.7499999999999938
in-drivable-lane_mean0.6999999999999975
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.019543694515259, "sim_physics": 0.12740253878163768, "survival_time": 4.549999999999992, "driven_lanedir": 0.63022393251254, "sim_render-ego": 0.06858300638722849, "in-drivable-lane": 1.5499999999999945, "agent_compute-ego": 0.10654690501454112, "deviation-heading": 0.3784747830029385, "set_robot_commands": 0.11341244047814672, "deviation-center-line": 0.26373706556356136, "driven_lanedir_consec": 0.63022393251254, "sim_compute_sim_state": 0.04229345426454649, "sim_compute_performance-ego": 0.07762705100761665, "sim_compute_robot_state-ego": 0.08824291858044299}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.092320879119447, "sim_physics": 0.12647273143132529, "survival_time": 4.799999999999991, "driven_lanedir": 0.9966293118184264, "sim_render-ego": 0.0680234283208847, "in-drivable-lane": 0.1999999999999993, "agent_compute-ego": 0.10125591854254404, "deviation-heading": 1.2120220205241528, "set_robot_commands": 0.10182855029900868, "deviation-center-line": 0.4116015105826717, "driven_lanedir_consec": 0.9966293118184264, "sim_compute_sim_state": 0.04150405526161194, "sim_compute_performance-ego": 0.07467975219090779, "sim_compute_robot_state-ego": 0.08539104710022609}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.3463654324913009, "sim_physics": 0.13683699199131558, "survival_time": 1.7500000000000009, "driven_lanedir": 0.3411103448246551, "sim_render-ego": 0.07293192318507603, "in-drivable-lane": 0, "agent_compute-ego": 0.10743810108729772, "deviation-heading": 0.3161131166445413, "set_robot_commands": 0.1043532507760184, "deviation-center-line": 0.18475729450460557, "driven_lanedir_consec": 0.3411103448246551, "sim_compute_sim_state": 0.0406670229775565, "sim_compute_performance-ego": 0.07545925549098424, "sim_compute_robot_state-ego": 0.08614868436540876}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.4931035838122221, "sim_physics": 0.12455772339029517, "survival_time": 2.3499999999999996, "driven_lanedir": 0.4750054442961291, "sim_render-ego": 0.06587501789661164, "in-drivable-lane": 0, "agent_compute-ego": 0.10004129308335324, "deviation-heading": 0.6476770668808497, "set_robot_commands": 0.10112368806879572, "deviation-center-line": 0.16101686364899737, "driven_lanedir_consec": 0.4750054442961291, "sim_compute_sim_state": 0.04167757643030045, "sim_compute_performance-ego": 0.07186958130369796, "sim_compute_robot_state-ego": 0.08673487318323013}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.703773432968235, "sim_physics": 0.12174493482668106, "survival_time": 7.299999999999982, "driven_lanedir": 1.2672309232923884, "sim_render-ego": 0.06735959934861693, "in-drivable-lane": 1.7499999999999938, "agent_compute-ego": 0.10791878830896665, "deviation-heading": 0.4789650270486564, "set_robot_commands": 0.104660933964873, "deviation-center-line": 0.6144364465634398, "driven_lanedir_consec": 1.2672309232923884, "sim_compute_sim_state": 0.042644198626688085, "sim_compute_performance-ego": 0.0741271433764941, "sim_compute_robot_state-ego": 0.0814229037663708}}
set_robot_commands_max0.11341244047814672
set_robot_commands_mean0.1050757727173685
set_robot_commands_median0.1043532507760184
set_robot_commands_min0.10112368806879572
sim_compute_performance-ego_max0.07762705100761665
sim_compute_performance-ego_mean0.07475255667394015
sim_compute_performance-ego_median0.07467975219090779
sim_compute_performance-ego_min0.07186958130369796
sim_compute_robot_state-ego_max0.08824291858044299
sim_compute_robot_state-ego_mean0.08558808539913575
sim_compute_robot_state-ego_median0.08614868436540876
sim_compute_robot_state-ego_min0.0814229037663708
sim_compute_sim_state_max0.042644198626688085
sim_compute_sim_state_mean0.041757261512140695
sim_compute_sim_state_median0.04167757643030045
sim_compute_sim_state_min0.0406670229775565
sim_physics_max0.13683699199131558
sim_physics_mean0.12740298408425094
sim_physics_median0.12647273143132529
sim_physics_min0.12174493482668106
sim_render-ego_max0.07293192318507603
sim_render-ego_mean0.06855459502768355
sim_render-ego_median0.0680234283208847
sim_render-ego_min0.06587501789661164
simulation-passed1
survival_time_max7.299999999999982
survival_time_mean4.149999999999993
survival_time_min1.7500000000000009
No reset possible
224323307Artem IoselevskiiSSegmaido2-LF-sim-validationstep1-simulationsuccessyesip-172-31-42-167-72270:16:05
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.4862720471820374
survival_time_median6.499999999999985
deviation-center-line_median0.5050795679889822
in-drivable-lane_median0


other stats
agent_compute-ego_max0.10688530353077672
agent_compute-ego_mean0.09557676623688148
agent_compute-ego_median0.10340248048305511
agent_compute-ego_min0.07238284257742075
deviation-center-line_max1.1970445329844628
deviation-center-line_mean0.6655961094745276
deviation-center-line_min0.25677866449725595
deviation-heading_max2.468521413512545
deviation-heading_mean1.2853718630195443
deviation-heading_median1.0486021747763747
deviation-heading_min0.3160951456118222
driven_any_max3.40356679139738
driven_any_mean1.8310504447528777
driven_any_median1.5081048726568118
driven_any_min0.4931040796609572
driven_lanedir_consec_max2.9362983305238366
driven_lanedir_consec_mean1.5896980240286542
driven_lanedir_consec_min0.489153382091744
driven_lanedir_max2.9362983305238366
driven_lanedir_mean1.5896980240286542
driven_lanedir_median1.4862720471820374
driven_lanedir_min0.489153382091744
in-drivable-lane_max2.600000000000028
in-drivable-lane_mean0.8200000000000098
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 3.0494783179554457, "sim_physics": 0.09143360765063809, "survival_time": 12.850000000000048, "driven_lanedir": 2.353278194592611, "sim_render-ego": 0.05681992783156814, "in-drivable-lane": 2.600000000000028, "agent_compute-ego": 0.08833983436168863, "deviation-heading": 1.9504722954919012, "set_robot_commands": 0.08522165053549444, "deviation-center-line": 1.0765082202940304, "driven_lanedir_consec": 2.353278194592611, "sim_compute_sim_state": 0.035043006741119265, "sim_compute_performance-ego": 0.05992426018770567, "sim_compute_robot_state-ego": 0.06473530591229984}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.5081048726568118, "sim_physics": 0.06287336899684026, "survival_time": 6.499999999999985, "driven_lanedir": 1.4862720471820374, "sim_render-ego": 0.03646995471074031, "in-drivable-lane": 0, "agent_compute-ego": 0.07238284257742075, "deviation-heading": 1.0486021747763747, "set_robot_commands": 0.09782827817476712, "deviation-center-line": 0.5050795679889822, "driven_lanedir_consec": 1.4862720471820374, "sim_compute_sim_state": 0.024072957038879395, "sim_compute_performance-ego": 0.04101676574120155, "sim_compute_robot_state-ego": 0.04251813888549805}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.4931040796609572, "sim_physics": 0.13131924892993682, "survival_time": 2.3499999999999996, "driven_lanedir": 0.489153382091744, "sim_render-ego": 0.06728261582394864, "in-drivable-lane": 0, "agent_compute-ego": 0.10687337023146608, "deviation-heading": 0.3160951456118222, "set_robot_commands": 0.10685874553436928, "deviation-center-line": 0.25677866449725595, "driven_lanedir_consec": 0.489153382091744, "sim_compute_sim_state": 0.04120838388483575, "sim_compute_performance-ego": 0.07653935919416711, "sim_compute_robot_state-ego": 0.08336358374737679}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.700998162093792, "sim_physics": 0.12828345596790314, "survival_time": 3.1999999999999966, "driven_lanedir": 0.6834881657530425, "sim_render-ego": 0.06629328057169914, "in-drivable-lane": 0, "agent_compute-ego": 0.10340248048305511, "deviation-heading": 0.6431682857050783, "set_robot_commands": 0.10654974356293678, "deviation-center-line": 0.2925695616079067, "driven_lanedir_consec": 0.6834881657530425, "sim_compute_sim_state": 0.04124385863542557, "sim_compute_performance-ego": 0.07092500850558281, "sim_compute_robot_state-ego": 0.07586171850562096}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 3.40356679139738, "sim_physics": 0.1238858139305784, "survival_time": 14.250000000000068, "driven_lanedir": 2.9362983305238366, "sim_render-ego": 0.066722277591103, "in-drivable-lane": 1.500000000000021, "agent_compute-ego": 0.10688530353077672, "deviation-heading": 2.468521413512545, "set_robot_commands": 0.10538050835592704, "deviation-center-line": 1.1970445329844628, "driven_lanedir_consec": 2.9362983305238366, "sim_compute_sim_state": 0.04208247201484546, "sim_compute_performance-ego": 0.07600058923687851, "sim_compute_robot_state-ego": 0.08439350881074605}}
set_robot_commands_max0.10685874553436928
set_robot_commands_mean0.10036778523269892
set_robot_commands_median0.10538050835592704
set_robot_commands_min0.08522165053549444
sim_compute_performance-ego_max0.07653935919416711
sim_compute_performance-ego_mean0.06488119657310713
sim_compute_performance-ego_median0.07092500850558281
sim_compute_performance-ego_min0.04101676574120155
sim_compute_robot_state-ego_max0.08439350881074605
sim_compute_robot_state-ego_mean0.07017445117230833
sim_compute_robot_state-ego_median0.07586171850562096
sim_compute_robot_state-ego_min0.04251813888549805
sim_compute_sim_state_max0.04208247201484546
sim_compute_sim_state_mean0.036730135663021087
sim_compute_sim_state_median0.04120838388483575
sim_compute_sim_state_min0.024072957038879395
sim_physics_max0.13131924892993682
sim_physics_mean0.10755909909517931
sim_physics_median0.1238858139305784
sim_physics_min0.06287336899684026
sim_render-ego_max0.06728261582394864
sim_render-ego_mean0.05871761130581184
sim_render-ego_median0.06629328057169914
sim_render-ego_min0.03646995471074031
simulation-passed1
survival_time_max14.250000000000068
survival_time_mean7.830000000000018
survival_time_min2.3499999999999996
No reset possible
224303528Nicky EichmannBaseline solution using reinforcement learningaido2-LF-sim-validationstep1-simulationfailedyesip-172-31-42-167-72270:00:57
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "experiment_manager.py", line 297, in run_episode
    r: MsgReceived = agent.write_topic_and_expect('get_commands', expect='commands')
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 93, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 174, in read_one
    nickname=self.nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 283, in read_until_over
    raise RemoteNodeAborted(m)
zuper_nodes.structures.RemoteNodeAborted: External node "agent" aborted:

error in agent |Exception while handling a message on topic "get_commands".
               |
               || Traceback (most recent call last):
               ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 274, in loop
               ||     handle_message_node(parsed, receiver0, context0)
               ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 428, in handle_message_node
               ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
               ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/utils.py", line 18, in call_if_fun_exists
               ||     f(**kwargs)
               ||   File "solution.py", line 48, in on_received_get_commands
               ||     pwm_left, pwm_right = self.compute_action(self.current_image)
               ||   File "solution.py", line 43, in compute_action
               ||     action = self.model.select_action(observation)
               ||   File "/workspace/model.py", line 150, in select_action
               ||     return self.actor(state).cpu().data.numpy().flatten()
               ||   File "/usr/local/lib/python3.7/site-packages/torch/nn/modules/module.py", line 489, in __call__
               ||     result = self.forward(*input, **kwargs)
               ||   File "/workspace/model.py", line 45, in forward
               ||     x = self.bn1(self.lr(self.conv1(x)))
               ||   File "/usr/local/lib/python3.7/site-packages/torch/nn/modules/module.py", line 489, in __call__
               ||     result = self.forward(*input, **kwargs)
               ||   File "/usr/local/lib/python3.7/site-packages/torch/nn/modules/conv.py", line 320, in forward
               ||     self.padding, self.dilation, self.groups)
               || RuntimeError: Given groups=1, weight of size [32, 3, 8, 8], expected input[1, 1, 120, 160] to have 3 channels, but got 1 channels instead
               ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
    yield cie
  File "experiment_manager.py", line 441, in <module>
    wrap(cie)
  File "experiment_manager.py", line 429, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 135, in main
    physics_dt=config.physics_dt)
  File "experiment_manager.py", line 301, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
224293309Nicky EichmannBaseline solution using reinforcement learningaido2-LF-sim-testingstep1-simulationfailedyesip-172-31-42-167-72270:01:09
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "experiment_manager.py", line 297, in run_episode
    r: MsgReceived = agent.write_topic_and_expect('get_commands', expect='commands')
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 93, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 174, in read_one
    nickname=self.nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 283, in read_until_over
    raise RemoteNodeAborted(m)
zuper_nodes.structures.RemoteNodeAborted: External node "agent" aborted:

error in agent |Exception while handling a message on topic "get_commands".
               |
               || Traceback (most recent call last):
               ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 274, in loop
               ||     handle_message_node(parsed, receiver0, context0)
               ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 428, in handle_message_node
               ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
               ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/utils.py", line 18, in call_if_fun_exists
               ||     f(**kwargs)
               ||   File "solution.py", line 48, in on_received_get_commands
               ||     pwm_left, pwm_right = self.compute_action(self.current_image)
               ||   File "solution.py", line 41, in compute_action
               ||     observation = self.preprocessor.preprocess(observation)
               ||   File "/workspace/wrappers.py", line 14, in preprocess
               ||     resizedImage = imresize(obs, self.shape)  # .transpose(2, 0, 1)
               ||   File "/usr/local/lib/python3.7/site-packages/numpy/lib/utils.py", line 101, in newfunc
               ||     return func(*args, **kwds)
               ||   File "/usr/local/lib/python3.7/site-packages/scipy/misc/pilutil.py", line 555, in imresize
               ||     im = toimage(arr, mode=mode)
               ||   File "/usr/local/lib/python3.7/site-packages/numpy/lib/utils.py", line 101, in newfunc
               ||     return func(*args, **kwds)
               ||   File "/usr/local/lib/python3.7/site-packages/scipy/misc/pilutil.py", line 327, in toimage
               ||     raise ValueError("'arr' does not have a suitable array shape for "
               || ValueError: 'arr' does not have a suitable array shape for any mode.
               ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
    yield cie
  File "experiment_manager.py", line 441, in <module>
    wrap(cie)
  File "experiment_manager.py", line 429, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 135, in main
    physics_dt=config.physics_dt)
  File "experiment_manager.py", line 301, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
224243311Ashwin Ram 🇸🇬challenge-aido_LF-template-randomaido2-LF-sim-validationstep1-simulationsuccessyesip-172-31-42-167-72270:06:16
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.7558221274508995
survival_time_median2.549999999999999
deviation-center-line_median0.12011701524194925
in-drivable-lane_median0.749999999999998


other stats
agent_compute-ego_max0.23490166196636125
agent_compute-ego_mean0.2226517407586593
agent_compute-ego_median0.2262714921611629
agent_compute-ego_min0.19597804373589112
deviation-center-line_max0.1863474249309824
deviation-center-line_mean0.12385480885359738
deviation-center-line_min0.08247952053666581
deviation-heading_max0.9044166301315548
deviation-heading_mean0.49788505265240224
deviation-heading_median0.47821103799183057
deviation-heading_min0.2489665952552648
driven_any_max1.6730433112178271
driven_any_mean1.2223886565680262
driven_any_median1.1418209699500368
driven_any_min0.5871969308894068
driven_lanedir_consec_max1.232427854822812
driven_lanedir_consec_mean0.8474389757539477
driven_lanedir_consec_min0.5736256913531315
driven_lanedir_max1.232427854822812
driven_lanedir_mean0.8474389757539477
driven_lanedir_median0.7558221274508995
driven_lanedir_min0.5736256913531315
in-drivable-lane_max1.049999999999997
in-drivable-lane_mean0.6699999999999979
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.1418209699500368, "sim_physics": 0.09754683457168878, "survival_time": 2.549999999999999, "driven_lanedir": 0.7331929678509965, "sim_render-ego": 0.06061172952838973, "in-drivable-lane": 0.749999999999998, "agent_compute-ego": 0.23490166196636125, "deviation-heading": 0.47821103799183057, "set_robot_commands": 0.08511721854116402, "deviation-center-line": 0.09396284247174208, "driven_lanedir_consec": 0.7331929678509965, "sim_compute_sim_state": 0.04257688335343903, "sim_compute_performance-ego": 0.062135443967931414, "sim_compute_robot_state-ego": 0.06579788058411841}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.092853780444004, "sim_physics": 0.15167190551757812, "survival_time": 2.499999999999999, "driven_lanedir": 0.7558221274508995, "sim_render-ego": 0.05669726371765137, "in-drivable-lane": 0.6499999999999981, "agent_compute-ego": 0.22392931938171387, "deviation-heading": 0.2995319860011346, "set_robot_commands": 0.08868768215179443, "deviation-center-line": 0.12011701524194925, "driven_lanedir_consec": 0.7558221274508995, "sim_compute_sim_state": 0.03567124843597412, "sim_compute_performance-ego": 0.07465490341186523, "sim_compute_robot_state-ego": 0.06543695449829101}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.6170282903388562, "sim_physics": 0.07659059331036996, "survival_time": 3.4499999999999957, "driven_lanedir": 0.942126237291899, "sim_render-ego": 0.04572483767633853, "in-drivable-lane": 1.049999999999997, "agent_compute-ego": 0.19597804373589112, "deviation-heading": 0.9044166301315548, "set_robot_commands": 0.0694464807925017, "deviation-center-line": 0.1863474249309824, "driven_lanedir_consec": 0.942126237291899, "sim_compute_sim_state": 0.02771299818287725, "sim_compute_performance-ego": 0.052260692568792816, "sim_compute_robot_state-ego": 0.055125606232795166}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.6730433112178271, "sim_physics": 0.09469888308276868, "survival_time": 3.649999999999995, "driven_lanedir": 1.232427854822812, "sim_render-ego": 0.058296993987201014, "in-drivable-lane": 0.8999999999999968, "agent_compute-ego": 0.2262714921611629, "deviation-heading": 0.5582990138822262, "set_robot_commands": 0.08607747456798814, "deviation-center-line": 0.13636724108664736, "driven_lanedir_consec": 1.232427854822812, "sim_compute_sim_state": 0.03590637037198838, "sim_compute_performance-ego": 0.06231470957194289, "sim_compute_robot_state-ego": 0.06518524313626224}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.5871969308894068, "sim_physics": 0.10853547885500152, "survival_time": 1.4500000000000006, "driven_lanedir": 0.5736256913531315, "sim_render-ego": 0.06070867900190682, "in-drivable-lane": 0, "agent_compute-ego": 0.23217818654816727, "deviation-heading": 0.2489665952552648, "set_robot_commands": 0.08523770858501566, "deviation-center-line": 0.08247952053666581, "driven_lanedir_consec": 0.5736256913531315, "sim_compute_sim_state": 0.034427018001161776, "sim_compute_performance-ego": 0.06565380096435547, "sim_compute_robot_state-ego": 0.06410250992610536}}
set_robot_commands_max0.08868768215179443
set_robot_commands_mean0.0829133129276928
set_robot_commands_median0.08523770858501566
set_robot_commands_min0.0694464807925017
sim_compute_performance-ego_max0.07465490341186523
sim_compute_performance-ego_mean0.06340391009697757
sim_compute_performance-ego_median0.06231470957194289
sim_compute_performance-ego_min0.052260692568792816
sim_compute_robot_state-ego_max0.06579788058411841
sim_compute_robot_state-ego_mean0.06312963887551444
sim_compute_robot_state-ego_median0.06518524313626224
sim_compute_robot_state-ego_min0.055125606232795166
sim_compute_sim_state_max0.04257688335343903
sim_compute_sim_state_mean0.03525890366908811
sim_compute_sim_state_median0.03567124843597412
sim_compute_sim_state_min0.02771299818287725
sim_physics_max0.15167190551757812
sim_physics_mean0.1058087390674814
sim_physics_median0.09754683457168878
sim_physics_min0.07659059331036996
sim_render-ego_max0.06070867900190682
sim_render-ego_mean0.056407900782297495
sim_render-ego_median0.058296993987201014
sim_render-ego_min0.04572483767633853
simulation-passed1
survival_time_max3.649999999999995
survival_time_mean2.719999999999998
survival_time_min1.4500000000000006
No reset possible
224163322jiang pengRL - TH -xyzaido2-LFV-sim-validationstep1-simulationerroryesip-172-31-42-167-72270:02:13
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
223873343Anastasiya Nikolskaya 🇷🇺JetBrains Researchaido2-LFV-sim-testingstep1-simulationerroryesip-172-31-42-167-72270:59:06
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
223753356Anastasiya Nikolskaya 🇷🇺JetBrains Researchaido2-LF-sim-validationstep1-simulationerroryesip-172-31-42-167-72270:20:19
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
223703368Amaury Camus 🇨🇭challenge-aido_LF-template-randomaido2-LFV-sim-validationstep1-simulationsuccessyesip-172-31-42-167-72270:08:06
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.5723310224856362
survival_time_median2.6999999999999984
deviation-center-line_median0.11519544839797546
in-drivable-lane_median0.5999999999999979


other stats
agent_compute-ego_max0.1653811264038086
agent_compute-ego_mean0.14275720167310305
agent_compute-ego_median0.1357676469827
agent_compute-ego_min0.1289552961077009
deviation-center-line_max0.1743913456502906
deviation-center-line_mean0.12651756552531995
deviation-center-line_min0.09047885846140293
deviation-heading_max0.5020407942599273
deviation-heading_mean0.3641979127291371
deviation-heading_median0.34764983431811214
deviation-heading_min0.19401296908406307
driven_any_max1.6169932854589035
driven_any_mean1.0272530755098266
driven_any_median1.0243289631429708
driven_any_min0.4119037580118998
driven_lanedir_consec_max1.2433038249708377
driven_lanedir_consec_mean0.7800316850006626
driven_lanedir_consec_min0.3792793194470208
driven_lanedir_max1.2433038249708377
driven_lanedir_mean0.7800316850006626
driven_lanedir_median0.5723310224856362
driven_lanedir_min0.3792793194470208
in-drivable-lane_max0.9999999999999976
in-drivable-lane_mean0.4899999999999984
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0243289631429708, "sim_physics": 0.1516671578089396, "survival_time": 2.6999999999999984, "driven_lanedir": 0.5723310224856362, "sim_render-ego": 0.05554395693319815, "in-drivable-lane": 0.9999999999999976, "agent_compute-ego": 0.13391990131802028, "deviation-heading": 0.19401296908406307, "set_robot_commands": 0.09441771772172716, "deviation-center-line": 0.15907928712407893, "driven_lanedir_consec": 0.5723310224856362, "sim_compute_sim_state": 0.036886758274502225, "sim_compute_performance-ego": 0.06259040479306821, "sim_compute_robot_state-ego": 0.06976095835367839, "sim_compute_robot_state-npc0": 0.06653802041654233, "sim_compute_robot_state-npc1": 0.05873954737627947, "sim_compute_robot_state-npc2": 0.059659617918509024, "sim_compute_robot_state-npc3": 0.060559873227719906}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.4119037580118998, "sim_physics": 0.21529409408569336, "survival_time": 1.2500000000000004, "driven_lanedir": 0.3792793194470208, "sim_render-ego": 0.0652924919128418, "in-drivable-lane": 0, "agent_compute-ego": 0.1653811264038086, "deviation-heading": 0.47860435001913393, "set_robot_commands": 0.10315236091613768, "deviation-center-line": 0.09344288799285194, "driven_lanedir_consec": 0.3792793194470208, "sim_compute_sim_state": 0.041140804290771486, "sim_compute_performance-ego": 0.07150863647460938, "sim_compute_robot_state-ego": 0.08774508476257324, "sim_compute_robot_state-npc0": 0.07220564842224121, "sim_compute_robot_state-npc1": 0.0773888111114502, "sim_compute_robot_state-npc2": 0.07594542503356934, "sim_compute_robot_state-npc3": 0.07374726295471191}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.579862082650716, "sim_physics": 0.17924976976294266, "survival_time": 3.7999999999999945, "driven_lanedir": 1.2433038249708377, "sim_render-ego": 0.060702392929478696, "in-drivable-lane": 0.5999999999999979, "agent_compute-ego": 0.1497620375532853, "deviation-heading": 0.5020407942599273, "set_robot_commands": 0.09661884998020372, "deviation-center-line": 0.1743913456502906, "driven_lanedir_consec": 1.2433038249708377, "sim_compute_sim_state": 0.0399524914590936, "sim_compute_performance-ego": 0.07223416629590486, "sim_compute_robot_state-ego": 0.07397449016571045, "sim_compute_robot_state-npc0": 0.07071870565414429, "sim_compute_robot_state-npc1": 0.06944392543090017, "sim_compute_robot_state-npc2": 0.06822553433870014, "sim_compute_robot_state-npc3": 0.0686252148527848}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.6169932854589035, "sim_physics": 0.15764643874349474, "survival_time": 3.949999999999994, "driven_lanedir": 1.2126117310470583, "sim_render-ego": 0.05640117729766459, "in-drivable-lane": 0.849999999999997, "agent_compute-ego": 0.1357676469827, "deviation-heading": 0.34764983431811214, "set_robot_commands": 0.0818163050880915, "deviation-center-line": 0.11519544839797546, "driven_lanedir_consec": 1.2126117310470583, "sim_compute_sim_state": 0.03468578978429867, "sim_compute_performance-ego": 0.06297004675563378, "sim_compute_robot_state-ego": 0.06797525248950041, "sim_compute_robot_state-npc0": 0.06250819978834707, "sim_compute_robot_state-npc1": 0.06619101838220524, "sim_compute_robot_state-npc2": 0.05763191814664044, "sim_compute_robot_state-npc3": 0.06263548513002033}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.5031772882846431, "sim_physics": 0.1702117919921875, "survival_time": 1.4000000000000006, "driven_lanedir": 0.4926325270527603, "sim_render-ego": 0.056707186358315606, "in-drivable-lane": 0, "agent_compute-ego": 0.1289552961077009, "deviation-heading": 0.29868161596444953, "set_robot_commands": 0.07796416112354823, "deviation-center-line": 0.09047885846140293, "driven_lanedir_consec": 0.4926325270527603, "sim_compute_sim_state": 0.03794162614004953, "sim_compute_performance-ego": 0.056555637291499546, "sim_compute_robot_state-ego": 0.06111586093902588, "sim_compute_robot_state-npc0": 0.05672934225627354, "sim_compute_robot_state-npc1": 0.06067251307623727, "sim_compute_robot_state-npc2": 0.058712473937443325, "sim_compute_robot_state-npc3": 0.07422083616256714}}
set_robot_commands_max0.10315236091613768
set_robot_commands_mean0.09079387896594168
set_robot_commands_median0.09441771772172716
set_robot_commands_min0.07796416112354823
sim_compute_performance-ego_max0.07223416629590486
sim_compute_performance-ego_mean0.06517177832214315
sim_compute_performance-ego_median0.06297004675563378
sim_compute_performance-ego_min0.056555637291499546
sim_compute_robot_state-ego_max0.08774508476257324
sim_compute_robot_state-ego_mean0.07211432934209767
sim_compute_robot_state-ego_median0.06976095835367839
sim_compute_robot_state-ego_min0.06111586093902588
sim_compute_robot_state-npc0_max0.07220564842224121
sim_compute_robot_state-npc0_mean0.06573998330750969
sim_compute_robot_state-npc0_median0.06653802041654233
sim_compute_robot_state-npc0_min0.05672934225627354
sim_compute_robot_state-npc1_max0.0773888111114502
sim_compute_robot_state-npc1_mean0.06648716307541447
sim_compute_robot_state-npc1_median0.06619101838220524
sim_compute_robot_state-npc1_min0.05873954737627947
sim_compute_robot_state-npc2_max0.07594542503356934
sim_compute_robot_state-npc2_mean0.06403499387497245
sim_compute_robot_state-npc2_median0.059659617918509024
sim_compute_robot_state-npc2_min0.05763191814664044
sim_compute_robot_state-npc3_max0.07422083616256714
sim_compute_robot_state-npc3_mean0.06795773446556082
sim_compute_robot_state-npc3_median0.0686252148527848
sim_compute_robot_state-npc3_min0.060559873227719906
sim_compute_sim_state_max0.041140804290771486
sim_compute_sim_state_mean0.038121493989743106
sim_compute_sim_state_median0.03794162614004953
sim_compute_sim_state_min0.03468578978429867
sim_physics_max0.21529409408569336
sim_physics_mean0.17481385047865156
sim_physics_median0.1702117919921875
sim_physics_min0.1516671578089396
sim_render-ego_max0.0652924919128418
sim_render-ego_mean0.05892944108629977
sim_render-ego_median0.056707186358315606
sim_render-ego_min0.05554395693319815
simulation-passed1
survival_time_max3.949999999999994
survival_time_mean2.6199999999999974
survival_time_min1.2500000000000004
No reset possible
223593384jiang pengRL-TH-shiaido2-LFV-sim-validationstep1-simulationsuccessyesip-172-31-42-167-72270:29:16
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median2.014963426083584
survival_time_median14.950000000000076
deviation-center-line_median0.7835435398988666
in-drivable-lane_median1.2500000000000018


other stats
agent_compute-ego_max0.17468318382898967
agent_compute-ego_mean0.16892855939625537
agent_compute-ego_median0.16805754820505778
agent_compute-ego_min0.16395220705257949
deviation-center-line_max1.1420799755697089
deviation-center-line_mean0.6905197721352371
deviation-center-line_min0.11120974714089606
deviation-heading_max5.288306496665341
deviation-heading_mean2.354684133490915
deviation-heading_median2.316078363499446
deviation-heading_min0.4761406434174122
driven_any_max3.589118018203941
driven_any_mean2.278782555309843
driven_any_median2.3571086635878236
driven_any_min0.7866079095386854
driven_lanedir_consec_max3.3597020570676293
driven_lanedir_consec_mean1.9481957680427784
driven_lanedir_consec_min0.6807447403868805
driven_lanedir_max3.3597020570676293
driven_lanedir_mean1.9553465332756064
driven_lanedir_median2.0507172522477246
driven_lanedir_min0.6807447403868805
in-drivable-lane_max13.100000000000076
in-drivable-lane_mean3.720000000000023
in-drivable-lane_min0.2499999999999991
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.7866079095386854, "sim_physics": 0.15188687721888225, "survival_time": 14.950000000000076, "driven_lanedir": 0.6807447403868805, "sim_render-ego": 0.05911167621612549, "in-drivable-lane": 13.100000000000076, "agent_compute-ego": 0.16408493836720783, "deviation-heading": 0.4761406434174122, "set_robot_commands": 0.09264017422993978, "deviation-center-line": 0.11120974714089606, "driven_lanedir_consec": 0.6807447403868805, "sim_compute_sim_state": 0.03724752426147461, "sim_compute_performance-ego": 0.0665476409594218, "sim_compute_robot_state-ego": 0.07028584718704224, "sim_compute_robot_state-npc0": 0.06644086519877115, "sim_compute_robot_state-npc1": 0.06515290180842082, "sim_compute_robot_state-npc2": 0.06672252337137859, "sim_compute_robot_state-npc3": 0.06597165822982788}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 3.589118018203941, "sim_physics": 0.200612850189209, "survival_time": 14.950000000000076, "driven_lanedir": 3.3597020570676293, "sim_render-ego": 0.0583255664507548, "in-drivable-lane": 0.2499999999999991, "agent_compute-ego": 0.16805754820505778, "deviation-heading": 2.979443906575837, "set_robot_commands": 0.0901508871714274, "deviation-center-line": 1.1398250402165415, "driven_lanedir_consec": 3.3597020570676293, "sim_compute_sim_state": 0.037813059488932294, "sim_compute_performance-ego": 0.06568450927734375, "sim_compute_robot_state-ego": 0.07163995901743571, "sim_compute_robot_state-npc0": 0.06618937412897746, "sim_compute_robot_state-npc1": 0.06750948985417683, "sim_compute_robot_state-npc2": 0.06385759830474853, "sim_compute_robot_state-npc3": 0.06501540104548137}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.6176315741315754, "sim_physics": 0.16855825147321146, "survival_time": 4.6499999999999915, "driven_lanedir": 1.2379019004726923, "sim_render-ego": 0.05730776632985761, "in-drivable-lane": 1.149999999999996, "agent_compute-ego": 0.16395220705257949, "deviation-heading": 0.7134512572965398, "set_robot_commands": 0.086898926765688, "deviation-center-line": 0.27594055785017235, "driven_lanedir_consec": 1.2379019004726923, "sim_compute_sim_state": 0.035206525556502805, "sim_compute_performance-ego": 0.06328994997086064, "sim_compute_robot_state-ego": 0.06590979073637275, "sim_compute_robot_state-npc0": 0.06359380547718335, "sim_compute_robot_state-npc1": 0.062002017933835266, "sim_compute_robot_state-npc2": 0.06060944064970939, "sim_compute_robot_state-npc3": 0.06308477155623897}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 2.3571086635878236, "sim_physics": 0.16992889006932577, "survival_time": 14.950000000000076, "driven_lanedir": 2.0507172522477246, "sim_render-ego": 0.06156554460525512, "in-drivable-lane": 2.8500000000000405, "agent_compute-ego": 0.17468318382898967, "deviation-heading": 5.288306496665341, "set_robot_commands": 0.09102298418680826, "deviation-center-line": 1.1420799755697089, "driven_lanedir_consec": 2.014963426083584, "sim_compute_sim_state": 0.04204496224721273, "sim_compute_performance-ego": 0.0675730315844218, "sim_compute_robot_state-ego": 0.07232025067011515, "sim_compute_robot_state-npc0": 0.06788545449574789, "sim_compute_robot_state-npc1": 0.06832826852798463, "sim_compute_robot_state-npc2": 0.06820342381795247, "sim_compute_robot_state-npc3": 0.06831830978393555}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 3.0434466110871914, "sim_physics": 0.16900892595274258, "survival_time": 11.300000000000026, "driven_lanedir": 2.4476667162031065, "sim_render-ego": 0.060848805756695504, "in-drivable-lane": 1.2500000000000018, "agent_compute-ego": 0.17386491952744204, "deviation-heading": 2.316078363499446, "set_robot_commands": 0.09639366643618694, "deviation-center-line": 0.7835435398988666, "driven_lanedir_consec": 2.4476667162031065, "sim_compute_sim_state": 0.03841309104345541, "sim_compute_performance-ego": 0.07094153260762713, "sim_compute_robot_state-ego": 0.07593006264846937, "sim_compute_robot_state-npc0": 0.07030968433987778, "sim_compute_robot_state-npc1": 0.06892363265552352, "sim_compute_robot_state-npc2": 0.06802891313502218, "sim_compute_robot_state-npc3": 0.06817817266008495}}
set_robot_commands_max0.09639366643618694
set_robot_commands_mean0.09142132775801008
set_robot_commands_median0.09102298418680826
set_robot_commands_min0.086898926765688
sim_compute_performance-ego_max0.07094153260762713
sim_compute_performance-ego_mean0.06680733287993502
sim_compute_performance-ego_median0.0665476409594218
sim_compute_performance-ego_min0.06328994997086064
sim_compute_robot_state-ego_max0.07593006264846937
sim_compute_robot_state-ego_mean0.07121718205188704
sim_compute_robot_state-ego_median0.07163995901743571
sim_compute_robot_state-ego_min0.06590979073637275
sim_compute_robot_state-npc0_max0.07030968433987778
sim_compute_robot_state-npc0_mean0.06688383672811152
sim_compute_robot_state-npc0_median0.06644086519877115
sim_compute_robot_state-npc0_min0.06359380547718335
sim_compute_robot_state-npc1_max0.06892363265552352
sim_compute_robot_state-npc1_mean0.0663832621559882
sim_compute_robot_state-npc1_median0.06750948985417683
sim_compute_robot_state-npc1_min0.062002017933835266
sim_compute_robot_state-npc2_max0.06820342381795247
sim_compute_robot_state-npc2_mean0.06548437985576223
sim_compute_robot_state-npc2_median0.06672252337137859
sim_compute_robot_state-npc2_min0.06060944064970939
sim_compute_robot_state-npc3_max0.06831830978393555
sim_compute_robot_state-npc3_mean0.06611366265511374
sim_compute_robot_state-npc3_median0.06597165822982788
sim_compute_robot_state-npc3_min0.06308477155623897
sim_compute_sim_state_max0.04204496224721273
sim_compute_sim_state_mean0.03814503251951557
sim_compute_sim_state_median0.037813059488932294
sim_compute_sim_state_min0.035206525556502805
sim_physics_max0.200612850189209
sim_physics_mean0.1719991589806742
sim_physics_median0.16900892595274258
sim_physics_min0.15188687721888225
sim_render-ego_max0.06156554460525512
sim_render-ego_mean0.05943187187173771
sim_render-ego_median0.05911167621612549
sim_render-ego_min0.05730776632985761
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean12.16000000000005
survival_time_min4.6499999999999915
No reset possible
223443396jiang pengRL-TH-shiaido2-LFVI-sim-validationstep1-simulationerroryesip-172-31-42-167-72270:28:08
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
223383402jiang pengRL-TH-shiaido2-LFV-sim-validationstep1-simulationsuccessyesip-172-31-42-167-72270:31:23
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median2.0656256711545056
survival_time_median14.950000000000076
deviation-center-line_median1.067962415499822
in-drivable-lane_median0.09999999999999964


other stats
agent_compute-ego_max0.17157697677612305
agent_compute-ego_mean0.1661475680247456
agent_compute-ego_median0.16582575379585734
agent_compute-ego_min0.1575186038017273
deviation-center-line_max1.3050316432676294
deviation-center-line_mean0.939056391191476
deviation-center-line_min0.2352082649629227
deviation-heading_max8.476768494662194
deviation-heading_mean4.140557172545289
deviation-heading_median3.0429296736689047
deviation-heading_min1.500030541342493
driven_any_max3.794125700053806
driven_any_mean2.4869055410177014
driven_any_median2.612878294174509
driven_any_min1.4086570521625874
driven_lanedir_consec_max3.742087276869941
driven_lanedir_consec_mean2.2992516928522773
driven_lanedir_consec_min1.254594619368286
driven_lanedir_max3.742087276869941
driven_lanedir_mean2.3843231188552685
driven_lanedir_median2.4306487193687563
driven_lanedir_min1.3149287011689903
in-drivable-lane_max4.099999999999985
in-drivable-lane_mean1.1700000000000017
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 2.7094953140588514, "sim_physics": 0.1594630495707194, "survival_time": 14.950000000000076, "driven_lanedir": 2.6525567712103726, "sim_render-ego": 0.05655939896901448, "in-drivable-lane": 0, "agent_compute-ego": 0.1575186038017273, "deviation-heading": 3.0429296736689047, "set_robot_commands": 0.08654730717341105, "deviation-center-line": 1.3050316432676294, "driven_lanedir_consec": 2.6525567712103726, "sim_compute_sim_state": 0.03513382434844971, "sim_compute_performance-ego": 0.06142990112304687, "sim_compute_robot_state-ego": 0.0656575067838033, "sim_compute_robot_state-npc0": 0.06254857540130615, "sim_compute_robot_state-npc1": 0.061590179602305097, "sim_compute_robot_state-npc2": 0.061166305541992184, "sim_compute_robot_state-npc3": 0.06215750296910604}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 3.794125700053806, "sim_physics": 0.17906782229741414, "survival_time": 14.950000000000076, "driven_lanedir": 3.742087276869941, "sim_render-ego": 0.05846297740936279, "in-drivable-lane": 0, "agent_compute-ego": 0.17134380181630451, "deviation-heading": 2.262240256023796, "set_robot_commands": 0.09059075196584064, "deviation-center-line": 1.067962415499822, "driven_lanedir_consec": 3.742087276869941, "sim_compute_sim_state": 0.03646530866622925, "sim_compute_performance-ego": 0.06677495479583741, "sim_compute_robot_state-ego": 0.0705595866839091, "sim_compute_robot_state-npc0": 0.06733516216278077, "sim_compute_robot_state-npc1": 0.06486596584320069, "sim_compute_robot_state-npc2": 0.06476866642634074, "sim_compute_robot_state-npc3": 0.0646024481455485}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 2.612878294174509, "sim_physics": 0.16263309790163624, "survival_time": 14.700000000000074, "driven_lanedir": 2.4306487193687563, "sim_render-ego": 0.05863287578634664, "in-drivable-lane": 1.6500000000000234, "agent_compute-ego": 0.16582575379585734, "deviation-heading": 5.420816897029061, "set_robot_commands": 0.09164221676028504, "deviation-center-line": 1.197885946037198, "driven_lanedir_consec": 2.0656256711545056, "sim_compute_sim_state": 0.03645126998019056, "sim_compute_performance-ego": 0.06632480410491529, "sim_compute_robot_state-ego": 0.06964137278446535, "sim_compute_robot_state-npc0": 0.06554411138807024, "sim_compute_robot_state-npc1": 0.06411471577728686, "sim_compute_robot_state-npc2": 0.06464217876901432, "sim_compute_robot_state-npc3": 0.06445423194340297}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.4086570521625874, "sim_physics": 0.15182961225509645, "survival_time": 14.950000000000076, "driven_lanedir": 1.3149287011689903, "sim_render-ego": 0.05691541751225789, "in-drivable-lane": 4.099999999999985, "agent_compute-ego": 0.16447270393371582, "deviation-heading": 8.476768494662194, "set_robot_commands": 0.09010095755259195, "deviation-center-line": 0.8891936861898081, "driven_lanedir_consec": 1.254594619368286, "sim_compute_sim_state": 0.03670051495234171, "sim_compute_performance-ego": 0.06298758029937744, "sim_compute_robot_state-ego": 0.06820156415303548, "sim_compute_robot_state-npc0": 0.06556615670522054, "sim_compute_robot_state-npc1": 0.06560276110967, "sim_compute_robot_state-npc2": 0.06421844482421875, "sim_compute_robot_state-npc3": 0.06594360669453939}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.9093713446387544, "sim_physics": 0.15730951513562882, "survival_time": 6.999999999999983, "driven_lanedir": 1.7813941256582806, "sim_render-ego": 0.061457674843924386, "in-drivable-lane": 0.09999999999999964, "agent_compute-ego": 0.17157697677612305, "deviation-heading": 1.500030541342493, "set_robot_commands": 0.09291960852486748, "deviation-center-line": 0.2352082649629227, "driven_lanedir_consec": 1.7813941256582806, "sim_compute_sim_state": 0.03777547223227365, "sim_compute_performance-ego": 0.06616788932255337, "sim_compute_robot_state-ego": 0.07253009080886841, "sim_compute_robot_state-npc0": 0.06814404726028442, "sim_compute_robot_state-npc1": 0.06711064577102661, "sim_compute_robot_state-npc2": 0.06574511698314121, "sim_compute_robot_state-npc3": 0.06774926696504865}}
set_robot_commands_max0.09291960852486748
set_robot_commands_mean0.09036016839539925
set_robot_commands_median0.09059075196584064
set_robot_commands_min0.08654730717341105
sim_compute_performance-ego_max0.06677495479583741
sim_compute_performance-ego_mean0.06473702592914607
sim_compute_performance-ego_median0.06616788932255337
sim_compute_performance-ego_min0.06142990112304687
sim_compute_robot_state-ego_max0.07253009080886841
sim_compute_robot_state-ego_mean0.06931802424281633
sim_compute_robot_state-ego_median0.06964137278446535
sim_compute_robot_state-ego_min0.0656575067838033
sim_compute_robot_state-npc0_max0.06814404726028442
sim_compute_robot_state-npc0_mean0.06582761058353241
sim_compute_robot_state-npc0_median0.06556615670522054
sim_compute_robot_state-npc0_min0.06254857540130615
sim_compute_robot_state-npc1_max0.06711064577102661
sim_compute_robot_state-npc1_mean0.06465685362069785
sim_compute_robot_state-npc1_median0.06486596584320069
sim_compute_robot_state-npc1_min0.061590179602305097
sim_compute_robot_state-npc2_max0.06574511698314121
sim_compute_robot_state-npc2_mean0.06410814250894145
sim_compute_robot_state-npc2_median0.06464217876901432
sim_compute_robot_state-npc2_min0.061166305541992184
sim_compute_robot_state-npc3_max0.06774926696504865
sim_compute_robot_state-npc3_mean0.06498141134352911
sim_compute_robot_state-npc3_median0.0646024481455485
sim_compute_robot_state-npc3_min0.06215750296910604
sim_compute_sim_state_max0.03777547223227365
sim_compute_sim_state_mean0.036505278035896975
sim_compute_sim_state_median0.03646530866622925
sim_compute_sim_state_min0.03513382434844971
sim_physics_max0.17906782229741414
sim_physics_mean0.162060619432099
sim_physics_median0.1594630495707194
sim_physics_min0.15182961225509645
sim_render-ego_max0.061457674843924386
sim_render-ego_mean0.05840566890418124
sim_render-ego_median0.05846297740936279
sim_render-ego_min0.05655939896901448
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean13.31000000000006
survival_time_min6.999999999999983
No reset possible
223313408jiang pengRL-TH-shiaido2-LFV-sim-validationstep1-simulationerroryesip-172-31-42-167-72270:12:17
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
223213416jiang pengRL-TH-shiaido2-LFV-sim-validationstep1-simulationsuccessyesip-172-31-42-167-72270:15:58
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.2580438506957332
survival_time_median4.749999999999991
deviation-center-line_median0.1709778304894985
in-drivable-lane_median0


other stats
agent_compute-ego_max0.186421237885952
agent_compute-ego_mean0.1634811872993364
agent_compute-ego_median0.16133998342826542
agent_compute-ego_min0.1479099675228721
deviation-center-line_max1.1320753038367135
deviation-center-line_mean0.36205692070584794
deviation-center-line_min0.10197035077862077
deviation-heading_max2.925601922534284
deviation-heading_mean1.3747463875384525
deviation-heading_median0.7827631633831899
deviation-heading_min0.416623550202254
driven_any_max3.192725188309568
driven_any_mean1.5218035838557185
driven_any_median1.6119628587810757
driven_any_min0.3748407069628104
driven_lanedir_consec_max3.102306128264719
driven_lanedir_consec_mean1.3810705780078862
driven_lanedir_consec_min0.33620562275774324
driven_lanedir_max3.102306128264719
driven_lanedir_mean1.3810705780078862
driven_lanedir_median1.2580438506957332
driven_lanedir_min0.33620562275774324
in-drivable-lane_max0.7499999999999973
in-drivable-lane_mean0.20000000000000015
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.5475524597576161, "sim_physics": 0.1902866289019585, "survival_time": 1.6000000000000008, "driven_lanedir": 0.5184875524460546, "sim_render-ego": 0.06517490744590759, "in-drivable-lane": 0, "agent_compute-ego": 0.186421237885952, "deviation-heading": 0.416623550202254, "set_robot_commands": 0.10628607124090196, "deviation-center-line": 0.10197035077862077, "driven_lanedir_consec": 0.5184875524460546, "sim_compute_sim_state": 0.04143783450126648, "sim_compute_performance-ego": 0.07095081359148026, "sim_compute_robot_state-ego": 0.07490003854036331, "sim_compute_robot_state-npc0": 0.07249683886766434, "sim_compute_robot_state-npc1": 0.07334111630916595, "sim_compute_robot_state-npc2": 0.07342071831226349, "sim_compute_robot_state-npc3": 0.07157215476036072}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.3748407069628104, "sim_physics": 0.18071763004575456, "survival_time": 1.4000000000000006, "driven_lanedir": 0.33620562275774324, "sim_render-ego": 0.057043101106371195, "in-drivable-lane": 0, "agent_compute-ego": 0.15559966223580496, "deviation-heading": 0.6016523243227658, "set_robot_commands": 0.09027866806302752, "deviation-center-line": 0.10799033914292748, "driven_lanedir_consec": 0.33620562275774324, "sim_compute_sim_state": 0.03605071987424578, "sim_compute_performance-ego": 0.06602322203772408, "sim_compute_robot_state-ego": 0.06492687974657331, "sim_compute_robot_state-npc0": 0.06292646271841866, "sim_compute_robot_state-npc1": 0.06834076983588082, "sim_compute_robot_state-npc2": 0.07268591438020978, "sim_compute_robot_state-npc3": 0.06726715394428798}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.6119628587810757, "sim_physics": 0.15812611830861945, "survival_time": 4.749999999999991, "driven_lanedir": 1.2580438506957332, "sim_render-ego": 0.053469015422620274, "in-drivable-lane": 0.7499999999999973, "agent_compute-ego": 0.1479099675228721, "deviation-heading": 0.7827631633831899, "set_robot_commands": 0.07991972471538343, "deviation-center-line": 0.1709778304894985, "driven_lanedir_consec": 1.2580438506957332, "sim_compute_sim_state": 0.03478398323059082, "sim_compute_performance-ego": 0.06110592892295435, "sim_compute_robot_state-ego": 0.06461988248323139, "sim_compute_robot_state-npc0": 0.05992673070807206, "sim_compute_robot_state-npc1": 0.0599736866198088, "sim_compute_robot_state-npc2": 0.05890616115770842, "sim_compute_robot_state-npc3": 0.061214800884849145}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 3.192725188309568, "sim_physics": 0.17002066453297934, "survival_time": 14.950000000000076, "driven_lanedir": 3.102306128264719, "sim_render-ego": 0.05933587233225505, "in-drivable-lane": 0, "agent_compute-ego": 0.16613508542378744, "deviation-heading": 2.925601922534284, "set_robot_commands": 0.09139331817626951, "deviation-center-line": 1.1320753038367135, "driven_lanedir_consec": 3.102306128264719, "sim_compute_sim_state": 0.03707913557688395, "sim_compute_performance-ego": 0.06752230962117513, "sim_compute_robot_state-ego": 0.07134349505106607, "sim_compute_robot_state-npc0": 0.06644055525461832, "sim_compute_robot_state-npc1": 0.06602872371673583, "sim_compute_robot_state-npc2": 0.06562368154525756, "sim_compute_robot_state-npc3": 0.06601786136627197}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.881936705467523, "sim_physics": 0.15356253230639097, "survival_time": 8.84999999999999, "driven_lanedir": 1.6903097358751815, "sim_render-ego": 0.055662075678507485, "in-drivable-lane": 0.25000000000000355, "agent_compute-ego": 0.16133998342826542, "deviation-heading": 2.147090977249769, "set_robot_commands": 0.08786082402460993, "deviation-center-line": 0.29727077928147916, "driven_lanedir_consec": 1.6903097358751815, "sim_compute_sim_state": 0.0370673446331994, "sim_compute_performance-ego": 0.06212713489424711, "sim_compute_robot_state-ego": 0.06649650422866735, "sim_compute_robot_state-npc0": 0.06516521259889764, "sim_compute_robot_state-npc1": 0.06453637080003986, "sim_compute_robot_state-npc2": 0.06370009271438512, "sim_compute_robot_state-npc3": 0.06599960219388627}}
set_robot_commands_max0.10628607124090196
set_robot_commands_mean0.09114772124403848
set_robot_commands_median0.09027866806302752
set_robot_commands_min0.07991972471538343
sim_compute_performance-ego_max0.07095081359148026
sim_compute_performance-ego_mean0.06554588181351619
sim_compute_performance-ego_median0.06602322203772408
sim_compute_performance-ego_min0.06110592892295435
sim_compute_robot_state-ego_max0.07490003854036331
sim_compute_robot_state-ego_mean0.06845736000998029
sim_compute_robot_state-ego_median0.06649650422866735
sim_compute_robot_state-ego_min0.06461988248323139
sim_compute_robot_state-npc0_max0.07249683886766434
sim_compute_robot_state-npc0_mean0.0653911600295342
sim_compute_robot_state-npc0_median0.06516521259889764
sim_compute_robot_state-npc0_min0.05992673070807206
sim_compute_robot_state-npc1_max0.07334111630916595
sim_compute_robot_state-npc1_mean0.06644413345632626
sim_compute_robot_state-npc1_median0.06602872371673583
sim_compute_robot_state-npc1_min0.0599736866198088
sim_compute_robot_state-npc2_max0.07342071831226349
sim_compute_robot_state-npc2_mean0.06686731362196488
sim_compute_robot_state-npc2_median0.06562368154525756
sim_compute_robot_state-npc2_min0.05890616115770842
sim_compute_robot_state-npc3_max0.07157215476036072
sim_compute_robot_state-npc3_mean0.06641431462993122
sim_compute_robot_state-npc3_median0.06601786136627197
sim_compute_robot_state-npc3_min0.061214800884849145
sim_compute_sim_state_max0.04143783450126648
sim_compute_sim_state_mean0.03728380356323728
sim_compute_sim_state_median0.0370673446331994
sim_compute_sim_state_min0.03478398323059082
sim_physics_max0.1902866289019585
sim_physics_mean0.17054271481914057
sim_physics_median0.17002066453297934
sim_physics_min0.15356253230639097
sim_render-ego_max0.06517490744590759
sim_render-ego_mean0.05813699439713232
sim_render-ego_median0.057043101106371195
sim_render-ego_min0.053469015422620274
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean6.310000000000012
survival_time_min1.4000000000000006
No reset possible
223103424jiang pengRL-TH-shiaido2-LFV-sim-validationstep1-simulationsuccessyesip-172-31-42-167-72270:31:06
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median2.6853739513856465
survival_time_median14.950000000000076
deviation-center-line_median0.904356570989936
in-drivable-lane_median0


other stats
agent_compute-ego_max0.16993042548497517
agent_compute-ego_mean0.1610130560874939
agent_compute-ego_median0.15860117355982462
agent_compute-ego_min0.15495229148864745
deviation-center-line_max1.2262029270835118
deviation-center-line_mean0.8070600915977242
deviation-center-line_min0.25243172547580756
deviation-heading_max4.70697477823008
deviation-heading_mean3.3700774614271567
deviation-heading_median3.596520086178101
deviation-heading_min1.9689577032995276
driven_any_max3.6679529495143193
driven_any_mean2.8002989199964845
driven_any_median2.798066880559286
driven_any_min2.0107297460871
driven_lanedir_consec_max3.612765573596355
driven_lanedir_consec_mean2.590162626986308
driven_lanedir_consec_min1.440758901329754
driven_lanedir_max3.612765573596355
driven_lanedir_mean2.6012680099921552
driven_lanedir_median2.6853739513856465
driven_lanedir_min1.440758901329754
in-drivable-lane_max2.3000000000000327
in-drivable-lane_mean0.5900000000000061
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 2.798066880559286, "sim_physics": 0.15062413771947225, "survival_time": 14.950000000000076, "driven_lanedir": 2.6853739513856465, "sim_render-ego": 0.057138010660807294, "in-drivable-lane": 0, "agent_compute-ego": 0.1633625356356303, "deviation-heading": 4.241814130061826, "set_robot_commands": 0.08751890261967978, "deviation-center-line": 0.904356570989936, "driven_lanedir_consec": 2.6853739513856465, "sim_compute_sim_state": 0.04147142648696899, "sim_compute_performance-ego": 0.0625065008799235, "sim_compute_robot_state-ego": 0.0651844596862793, "sim_compute_robot_state-npc0": 0.06423521041870117, "sim_compute_robot_state-npc1": 0.06215200185775757, "sim_compute_robot_state-npc2": 0.06553987661997478, "sim_compute_robot_state-npc3": 0.06267652273178101}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 3.6679529495143193, "sim_physics": 0.1711104933420817, "survival_time": 14.950000000000076, "driven_lanedir": 3.612765573596355, "sim_render-ego": 0.05780163923899333, "in-drivable-lane": 0, "agent_compute-ego": 0.15821885426839194, "deviation-heading": 2.336120609366247, "set_robot_commands": 0.08577289819717407, "deviation-center-line": 1.2262029270835118, "driven_lanedir_consec": 3.612765573596355, "sim_compute_sim_state": 0.038803377946217854, "sim_compute_performance-ego": 0.06558411200841267, "sim_compute_robot_state-ego": 0.06800716797510784, "sim_compute_robot_state-npc0": 0.0654430357615153, "sim_compute_robot_state-npc1": 0.06525684038798014, "sim_compute_robot_state-npc2": 0.06361711899439494, "sim_compute_robot_state-npc3": 0.06456395864486694}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 2.3280983853584063, "sim_physics": 0.15441890875498454, "survival_time": 14.950000000000076, "driven_lanedir": 2.1624555334621935, "sim_render-ego": 0.05657849868138631, "in-drivable-lane": 2.3000000000000327, "agent_compute-ego": 0.15860117355982462, "deviation-heading": 4.70697477823008, "set_robot_commands": 0.0906017557779948, "deviation-center-line": 0.6926233292200495, "driven_lanedir_consec": 2.106928618432955, "sim_compute_sim_state": 0.03690572738647461, "sim_compute_performance-ego": 0.06346465190251668, "sim_compute_robot_state-ego": 0.06723767280578613, "sim_compute_robot_state-npc0": 0.0637391193707784, "sim_compute_robot_state-npc1": 0.06457918564478557, "sim_compute_robot_state-npc2": 0.0648497215906779, "sim_compute_robot_state-npc3": 0.06489957014719645}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 3.196646638463311, "sim_physics": 0.1568604604403178, "survival_time": 14.950000000000076, "driven_lanedir": 3.104986090186827, "sim_render-ego": 0.060015067259470624, "in-drivable-lane": 0, "agent_compute-ego": 0.16993042548497517, "deviation-heading": 3.596520086178101, "set_robot_commands": 0.08948218584060669, "deviation-center-line": 0.9596859052193152, "driven_lanedir_consec": 3.104986090186827, "sim_compute_sim_state": 0.03680365800857544, "sim_compute_performance-ego": 0.06534903923670451, "sim_compute_robot_state-ego": 0.0710450530052185, "sim_compute_robot_state-npc0": 0.06627983967463176, "sim_compute_robot_state-npc1": 0.06588219165802002, "sim_compute_robot_state-npc2": 0.06427190065383911, "sim_compute_robot_state-npc3": 0.0661713202794393}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 2.0107297460871, "sim_physics": 0.13624010848999024, "survival_time": 6.249999999999986, "driven_lanedir": 1.440758901329754, "sim_render-ego": 0.055894140243530274, "in-drivable-lane": 0.6499999999999977, "agent_compute-ego": 0.15495229148864745, "deviation-heading": 1.9689577032995276, "set_robot_commands": 0.08353702926635742, "deviation-center-line": 0.25243172547580756, "driven_lanedir_consec": 1.440758901329754, "sim_compute_sim_state": 0.034356002807617185, "sim_compute_performance-ego": 0.06125058364868164, "sim_compute_robot_state-ego": 0.06394232368469238, "sim_compute_robot_state-npc0": 0.06324353218078613, "sim_compute_robot_state-npc1": 0.06079923439025879, "sim_compute_robot_state-npc2": 0.06020779991149902, "sim_compute_robot_state-npc3": 0.06356545639038086}}
set_robot_commands_max0.0906017557779948
set_robot_commands_mean0.08738255434036254
set_robot_commands_median0.08751890261967978
set_robot_commands_min0.08353702926635742
sim_compute_performance-ego_max0.06558411200841267
sim_compute_performance-ego_mean0.0636309775352478
sim_compute_performance-ego_median0.06346465190251668
sim_compute_performance-ego_min0.06125058364868164
sim_compute_robot_state-ego_max0.0710450530052185
sim_compute_robot_state-ego_mean0.06708333543141684
sim_compute_robot_state-ego_median0.06723767280578613
sim_compute_robot_state-ego_min0.06394232368469238
sim_compute_robot_state-npc0_max0.06627983967463176
sim_compute_robot_state-npc0_mean0.06458814748128254
sim_compute_robot_state-npc0_median0.06423521041870117
sim_compute_robot_state-npc0_min0.06324353218078613
sim_compute_robot_state-npc1_max0.06588219165802002
sim_compute_robot_state-npc1_mean0.06373389078776043
sim_compute_robot_state-npc1_median0.06457918564478557
sim_compute_robot_state-npc1_min0.06079923439025879
sim_compute_robot_state-npc2_max0.06553987661997478
sim_compute_robot_state-npc2_mean0.06369728355407715
sim_compute_robot_state-npc2_median0.06427190065383911
sim_compute_robot_state-npc2_min0.06020779991149902
sim_compute_robot_state-npc3_max0.0661713202794393
sim_compute_robot_state-npc3_mean0.0643753656387329
sim_compute_robot_state-npc3_median0.06456395864486694
sim_compute_robot_state-npc3_min0.06267652273178101
sim_compute_sim_state_max0.04147142648696899
sim_compute_sim_state_mean0.037668038527170815
sim_compute_sim_state_median0.03690572738647461
sim_compute_sim_state_min0.034356002807617185
sim_physics_max0.1711104933420817
sim_physics_mean0.15385082174936932
sim_physics_median0.15441890875498454
sim_physics_min0.13624010848999024
sim_render-ego_max0.060015067259470624
sim_render-ego_mean0.05748547121683757
sim_render-ego_median0.057138010660807294
sim_render-ego_min0.055894140243530274
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean13.21000000000006
survival_time_min6.249999999999986
No reset possible
222883443Bea Baselines 🐤rotationaido2-LF-sim-testingstep1-simulationerroryesip-172-31-42-167-72270:44:09
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
222753486Eric LuTesting the RL solutionaido2-LF-sim-testingstep1-simulationsuccessyesip-172-31-42-167-72271 day, 3:57:46
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median-0.0014713911579301575
survival_time_median14.950000000000076
deviation-center-line_median0.3550429130563084
in-drivable-lane_median7.600000000000043


other stats
agent_compute-ego_max0.14667528867721558
agent_compute-ego_mean0.11371671756108603
agent_compute-ego_median0.09297221422195434
agent_compute-ego_min0.09165705601374308
deviation-center-line_max0.6007136359417561
deviation-center-line_mean0.3394558693803663
deviation-center-line_min0.017558302483544185
deviation-heading_max5.876680788839771
deviation-heading_mean5.668498743453998
deviation-heading_median5.709677935349317
deviation-heading_min5.445457843647878
driven_any_max0.026478672834056367
driven_any_mean0.02338944237901273
driven_any_median0.023285267728313904
driven_any_min0.0197794984093383
driven_lanedir_consec_max0.0021599934447711355
driven_lanedir_consec_mean-0.0011081890688229216
driven_lanedir_consec_min-0.004544743757038283
driven_lanedir_max0.0021599934447711355
driven_lanedir_mean-0.0011081890688229216
driven_lanedir_median-0.0014713911579301575
driven_lanedir_min-0.004544743757038283
in-drivable-lane_max7.700000000000042
in-drivable-lane_mean7.596666666666709
in-drivable-lane_min7.500000000000043
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.026478672834056367, "sim_physics": 0.09258068720499676, "survival_time": 14.950000000000076, "driven_lanedir": 0.0021599934447711355, "sim_render-ego": 0.05000855922698975, "in-drivable-lane": 7.600000000000043, "agent_compute-ego": 0.13064491351445515, "deviation-heading": 5.657649106857695, "set_robot_commands": 0.07870402495066325, "deviation-center-line": 0.5610133203215761, "driven_lanedir_consec": 0.0021599934447711355, "sim_compute_sim_state": 0.03201866229375203, "sim_compute_performance-ego": 0.0552703857421875, "sim_compute_robot_state-ego": 0.05960890452067057}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.02593019554121306, "sim_physics": 0.10646082480748496, "survival_time": 14.950000000000076, "driven_lanedir": -0.003361806018059577, "sim_render-ego": 0.0590419872601827, "in-drivable-lane": 7.600000000000044, "agent_compute-ego": 0.14667528867721558, "deviation-heading": 5.445457843647878, "set_robot_commands": 0.09039310375849406, "deviation-center-line": 0.13860669343031343, "driven_lanedir_consec": -0.003361806018059577, "sim_compute_sim_state": 0.03696814219156901, "sim_compute_performance-ego": 0.06475492636362712, "sim_compute_robot_state-ego": 0.06983600775400797}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.023804404672438047, "sim_physics": 0.10069575786590576, "survival_time": 14.950000000000076, "driven_lanedir": 0.0021181059556472093, "sim_render-ego": 0.057851548194885256, "in-drivable-lane": 7.550000000000042, "agent_compute-ego": 0.14416041135787963, "deviation-heading": 5.876680788839771, "set_robot_commands": 0.08650801420211791, "deviation-center-line": 0.4784517475259532, "driven_lanedir_consec": 0.0021181059556472093, "sim_compute_sim_state": 0.036829968293507896, "sim_compute_performance-ego": 0.06380326668421428, "sim_compute_robot_state-ego": 0.06874792496363322}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.022165452661374756, "sim_physics": 0.0975876728693644, "survival_time": 14.950000000000076, "driven_lanedir": -0.002690854798440334, "sim_render-ego": 0.05663137515385946, "in-drivable-lane": 7.700000000000042, "agent_compute-ego": 0.13800410111745198, "deviation-heading": 5.721005148732661, "set_robot_commands": 0.08554488579432169, "deviation-center-line": 0.44901648578509457, "driven_lanedir_consec": -0.002690854798440334, "sim_compute_sim_state": 0.03538971900939941, "sim_compute_performance-ego": 0.06292197863260905, "sim_compute_robot_state-ego": 0.06739279667536417}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.025942472252175396, "sim_physics": 0.10979872941970824, "survival_time": 14.950000000000076, "driven_lanedir": -0.0005547867508171045, "sim_render-ego": 0.05993210474650065, "in-drivable-lane": 7.650000000000044, "agent_compute-ego": 0.14452271699905395, "deviation-heading": 5.453097843541612, "set_robot_commands": 0.08983767032623291, "deviation-center-line": 0.28665447981951625, "driven_lanedir_consec": -0.0005547867508171045, "sim_compute_sim_state": 0.03726516803105672, "sim_compute_performance-ego": 0.06555669148763021, "sim_compute_robot_state-ego": 0.06920684734980265}, "ETHZ_autolab_technical_track-5-0": {"driven_any": 0.026249880775217276, "sim_physics": 0.10736752112706502, "survival_time": 14.950000000000076, "driven_lanedir": -0.0017675599932500674, "sim_render-ego": 0.056802678108215335, "in-drivable-lane": 7.650000000000041, "agent_compute-ego": 0.13656593720118204, "deviation-heading": 5.813994332249986, "set_robot_commands": 0.08397180239359538, "deviation-center-line": 0.6007136359417561, "driven_lanedir_consec": -0.0017675599932500674, "sim_compute_sim_state": 0.035358447233835855, "sim_compute_performance-ego": 0.06240944703420003, "sim_compute_robot_state-ego": 0.06595220406850179}, "ETHZ_autolab_technical_track-6-0": {"driven_any": 0.023285267728313904, "sim_physics": 0.09096333344777426, "survival_time": 14.950000000000076, "driven_lanedir": -0.00391925832851836, "sim_render-ego": 0.050444507598876955, "in-drivable-lane": 7.600000000000044, "agent_compute-ego": 0.12745762427647908, "deviation-heading": 5.466476436400955, "set_robot_commands": 0.0759960126876831, "deviation-center-line": 0.3550429130563084, "driven_lanedir_consec": -0.00391925832851836, "sim_compute_sim_state": 0.032001434961954754, "sim_compute_performance-ego": 0.05527700424194336, "sim_compute_robot_state-ego": 0.059445348580678306}, "ETHZ_autolab_technical_track-7-0": {"driven_any": 0.023561644755163248, "sim_physics": 0.05889373461405436, "survival_time": 14.950000000000076, "driven_lanedir": 0.002049277100081514, "sim_render-ego": 0.03729665517807007, "in-drivable-lane": 7.550000000000042, "agent_compute-ego": 0.0922732671101888, "deviation-heading": 5.854958069383543, "set_robot_commands": 0.057264458338419595, "deviation-center-line": 0.41169203827872664, "driven_lanedir_consec": 0.002049277100081514, "sim_compute_sim_state": 0.0247168493270874, "sim_compute_performance-ego": 0.04164129575093587, "sim_compute_robot_state-ego": 0.043497200012207034}, "ETHZ_autolab_technical_track-8-0": {"driven_any": 0.02419197298360903, "sim_physics": 0.0627041482925415, "survival_time": 14.950000000000076, "driven_lanedir": 0.0002979654230168549, "sim_render-ego": 0.03834487756093343, "in-drivable-lane": 7.600000000000043, "agent_compute-ego": 0.09297221422195434, "deviation-heading": 5.709677935349317, "set_robot_commands": 0.05629457712173462, "deviation-center-line": 0.017558302483544185, "driven_lanedir_consec": 0.0002979654230168549, "sim_compute_sim_state": 0.024801865418752036, "sim_compute_performance-ego": 0.04145778258641561, "sim_compute_robot_state-ego": 0.04314438263575236}, "ETHZ_autolab_technical_track-9-0": {"driven_any": 0.021258166206925968, "sim_physics": 0.05962665557861328, "survival_time": 14.950000000000076, "driven_lanedir": -4.181733071773053e-05, "sim_render-ego": 0.03749032100041707, "in-drivable-lane": 7.500000000000043, "agent_compute-ego": 0.09190254052480062, "deviation-heading": 5.783324089492346, "set_robot_commands": 0.05699239015579224, "deviation-center-line": 0.2514968415228165, "driven_lanedir_consec": -4.181733071773053e-05, "sim_compute_sim_state": 0.024487291971842448, "sim_compute_performance-ego": 0.04101931095123291, "sim_compute_robot_state-ego": 0.043004098733266195}, "ETHZ_autolab_technical_track-10-0": {"driven_any": 0.021434292120195386, "sim_physics": 0.060143366654713946, "survival_time": 14.950000000000076, "driven_lanedir": 0.000713963463023104, "sim_render-ego": 0.03718838135401408, "in-drivable-lane": 7.600000000000045, "agent_compute-ego": 0.09165705601374308, "deviation-heading": 5.526728061201507, "set_robot_commands": 0.05656405051549276, "deviation-center-line": 0.46282395191752784, "driven_lanedir_consec": 0.000713963463023104, "sim_compute_sim_state": 0.024595565795898437, "sim_compute_performance-ego": 0.04091428756713867, "sim_compute_robot_state-ego": 0.04278571923573811}, "ETHZ_autolab_technical_track-11-0": {"driven_any": 0.0197794984093383, "sim_physics": 0.06091517210006714, "survival_time": 14.950000000000076, "driven_lanedir": -0.0014713911579301575, "sim_render-ego": 0.03784651676813761, "in-drivable-lane": 7.550000000000041, "agent_compute-ego": 0.0917790389060974, "deviation-heading": 5.8066732640248135, "set_robot_commands": 0.055818110307057696, "deviation-center-line": 0.16800033110632376, "driven_lanedir_consec": -0.0014713911579301575, "sim_compute_sim_state": 0.024514262676239015, "sim_compute_performance-ego": 0.04067435105641683, "sim_compute_robot_state-ego": 0.043329782485961914}, "ETHZ_autolab_technical_track-12-0": {"driven_any": 0.020981564902326583, "sim_physics": 0.05781523704528808, "survival_time": 14.950000000000076, "driven_lanedir": -0.001808663823426926, "sim_render-ego": 0.03721868912378947, "in-drivable-lane": 7.650000000000043, "agent_compute-ego": 0.09202382485071818, "deviation-heading": 5.5154737798413205, "set_robot_commands": 0.05630490064620971, "deviation-center-line": 0.3169911817232478, "driven_lanedir_consec": -0.001808663823426926, "sim_compute_sim_state": 0.024337209860483804, "sim_compute_performance-ego": 0.04092731396357219, "sim_compute_robot_state-ego": 0.04277552286783854}, "ETHZ_autolab_technical_track-13-0": {"driven_any": 0.022551048035819046, "sim_physics": 0.05651435454686483, "survival_time": 14.950000000000076, "driven_lanedir": -0.004544743757038283, "sim_render-ego": 0.037113094329833986, "in-drivable-lane": 7.600000000000042, "agent_compute-ego": 0.0925499931971232, "deviation-heading": 5.790764092245773, "set_robot_commands": 0.05637972831726074, "deviation-center-line": 0.03881032426772201, "driven_lanedir_consec": -0.004544743757038283, "sim_compute_sim_state": 0.02446094751358032, "sim_compute_performance-ego": 0.04117955525716146, "sim_compute_robot_state-ego": 0.04286343415578207}, "ETHZ_autolab_technical_track-14-0": {"driven_any": 0.023227101807024583, "sim_physics": 0.05658928076426188, "survival_time": 14.950000000000076, "driven_lanedir": -0.0038012594606851025, "sim_render-ego": 0.03691718975702921, "in-drivable-lane": 7.550000000000044, "agent_compute-ego": 0.0925618354479472, "deviation-heading": 5.605520360000814, "set_robot_commands": 0.056587196985880536, "deviation-center-line": 0.5549657935250676, "driven_lanedir_consec": -0.0038012594606851025, "sim_compute_sim_state": 0.02446415344874064, "sim_compute_performance-ego": 0.04075482050577799, "sim_compute_robot_state-ego": 0.04381116469701131}}
set_robot_commands_max0.09039310375849406
set_robot_commands_mean0.06954406176673042
set_robot_commands_median0.057264458338419595
set_robot_commands_min0.055818110307057696
sim_compute_performance-ego_max0.06555669148763021
sim_compute_performance-ego_mean0.050570827855004205
sim_compute_performance-ego_median0.04164129575093587
sim_compute_performance-ego_min0.04067435105641683
sim_compute_robot_state-ego_max0.06983600775400797
sim_compute_robot_state-ego_mean0.05369342258241441
sim_compute_robot_state-ego_median0.04381116469701131
sim_compute_robot_state-ego_min0.04277552286783854
sim_compute_sim_state_max0.03726516803105672
sim_compute_sim_state_mean0.029480645868513324
sim_compute_sim_state_median0.024801865418752036
sim_compute_sim_state_min0.024337209860483804
sim_physics_max0.10979872941970824
sim_physics_mean0.07857709842258029
sim_physics_median0.0627041482925415
sim_physics_min0.05651435454686483
sim_render-ego_max0.05993210474650065
sim_render-ego_mean0.046008565690782335
sim_render-ego_median0.03834487756093343
sim_render-ego_min0.03691718975702921
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean14.950000000000076
survival_time_min14.950000000000076
No reset possible
222633502FANG MEIYI 🇸🇬testaido2-LF-sim-testingstep1-simulationerroryesip-172-31-42-167-72270:31:46
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
222433371Amaury Camus 🇨🇭challenge-aido_LF-template-randomaido2-LFVI-sim-testingstep1-simulationsuccessyesip-172-31-42-167-72270:27:33
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.6537162971975778
survival_time_median2.5999999999999988
deviation-center-line_median0.14884708769804722
in-drivable-lane_median0.549999999999998


other stats
agent_compute-ego_max0.15284274295418562
agent_compute-ego_mean0.1389760730366271
agent_compute-ego_median0.14101755160551804
agent_compute-ego_min0.11352571656432332
deviation-center-line_max0.5141120095458062
deviation-center-line_mean0.1769000227005324
deviation-center-line_min0.06216029860587694
deviation-heading_max1.9929437250081896
deviation-heading_mean0.692977823395608
deviation-heading_median0.4928440244444201
deviation-heading_min0.24234723632033853
driven_any_max3.5343244022418343
driven_any_mean1.3470385992234175
driven_any_median1.001633421251194
driven_any_min0.3412551960104244
driven_lanedir_consec_max2.494308053441959
driven_lanedir_consec_mean0.881391085527715
driven_lanedir_consec_min0.3199180625488627
driven_lanedir_max2.494308053441959
driven_lanedir_mean0.8962528018383226
driven_lanedir_median0.7206363324756615
driven_lanedir_min0.3199180625488627
in-drivable-lane_max3.549999999999991
in-drivable-lane_mean0.839999999999998
in-drivable-lane_min0
per-episodes
details{"udem1-0-0": {"driven_any": 1.5811782993597916, "sim_physics": 0.15207772617098653, "survival_time": 3.949999999999994, "driven_lanedir": 0.9217908232230632, "sim_render-ego": 0.04570551461811307, "in-drivable-lane": 1.3499999999999952, "agent_compute-ego": 0.11352571656432332, "deviation-heading": 0.5694288623982039, "set_robot_commands": 0.06939254531377478, "deviation-center-line": 0.2348196785686717, "driven_lanedir_consec": 0.9213701538661684, "sim_compute_sim_state": 0.029152345053757293, "sim_compute_performance-ego": 0.0496189413191397, "sim_compute_robot_state-ego": 0.05444100536877596, "sim_compute_robot_state-npc0": 0.05037228970588008, "sim_compute_robot_state-npc1": 0.05192792566516732, "sim_compute_robot_state-npc2": 0.049318455442597595, "sim_compute_robot_state-npc3": 0.050767406632628624}, "udem1-1-0": {"driven_any": 0.47798123795353353, "sim_physics": 0.15187386955533708, "survival_time": 1.4000000000000006, "driven_lanedir": 0.4500753586658095, "sim_render-ego": 0.0524679252079555, "in-drivable-lane": 0, "agent_compute-ego": 0.12913919346673147, "deviation-heading": 0.46504862964833654, "set_robot_commands": 0.07927133355821882, "deviation-center-line": 0.09791133281082, "driven_lanedir_consec": 0.4500753586658095, "sim_compute_sim_state": 0.03683925526482718, "sim_compute_performance-ego": 0.056170719010489326, "sim_compute_robot_state-ego": 0.059978791645595005, "sim_compute_robot_state-npc0": 0.0565274783543178, "sim_compute_robot_state-npc1": 0.05540902273995536, "sim_compute_robot_state-npc2": 0.05425804001944406, "sim_compute_robot_state-npc3": 0.0552699225289481}, "udem1-2-0": {"driven_any": 2.1864003300000694, "sim_physics": 0.18483692234002272, "survival_time": 5.14999999999999, "driven_lanedir": 1.826231945363564, "sim_render-ego": 0.06176399027259605, "in-drivable-lane": 0.549999999999998, "agent_compute-ego": 0.14877219801967584, "deviation-heading": 0.8115272458314897, "set_robot_commands": 0.09145886921188208, "deviation-center-line": 0.1927316041609401, "driven_lanedir_consec": 1.826231945363564, "sim_compute_sim_state": 0.03851457012509837, "sim_compute_performance-ego": 0.0650154502646437, "sim_compute_robot_state-ego": 0.06870469537753503, "sim_compute_robot_state-npc0": 0.06853022853147636, "sim_compute_robot_state-npc1": 0.06678659939071507, "sim_compute_robot_state-npc2": 0.06673416582126061, "sim_compute_robot_state-npc3": 0.0658057685037261}, "udem1-3-0": {"driven_any": 0.9410513078477724, "sim_physics": 0.20133942862351736, "survival_time": 2.3999999999999995, "driven_lanedir": 0.493517638549009, "sim_render-ego": 0.05787234008312225, "in-drivable-lane": 0.8999999999999988, "agent_compute-ego": 0.1397484689950943, "deviation-heading": 0.35154027506548424, "set_robot_commands": 0.08420828978220622, "deviation-center-line": 0.08975118546699407, "driven_lanedir_consec": 0.493517638549009, "sim_compute_sim_state": 0.03961726029713949, "sim_compute_performance-ego": 0.0652184287707011, "sim_compute_robot_state-ego": 0.07237879931926727, "sim_compute_robot_state-npc0": 0.06464627881844838, "sim_compute_robot_state-npc1": 0.07054537038008372, "sim_compute_robot_state-npc2": 0.06333055595556895, "sim_compute_robot_state-npc3": 0.0682753175497055}, "udem1-4-0": {"driven_any": 0.34749292376309954, "sim_physics": 0.1934224878038679, "survival_time": 1.0500000000000005, "driven_lanedir": 0.3325249708009643, "sim_render-ego": 0.05934523400806245, "in-drivable-lane": 0, "agent_compute-ego": 0.14104469617207846, "deviation-heading": 0.30044835691402494, "set_robot_commands": 0.07958488237290155, "deviation-center-line": 0.06216029860587694, "driven_lanedir_consec": 0.3325249708009643, "sim_compute_sim_state": 0.03960812659490676, "sim_compute_performance-ego": 0.06937974975222633, "sim_compute_robot_state-ego": 0.07549651463826497, "sim_compute_robot_state-npc0": 0.0648859114873977, "sim_compute_robot_state-npc1": 0.06110496748061407, "sim_compute_robot_state-npc2": 0.06711194628760928, "sim_compute_robot_state-npc3": 0.0663223493666876}, "udem1-5-0": {"driven_any": 3.5343244022418343, "sim_physics": 0.19562299237279832, "survival_time": 8.349999999999984, "driven_lanedir": 2.494308053441959, "sim_render-ego": 0.0634358585951571, "in-drivable-lane": 2, "agent_compute-ego": 0.15284274295418562, "deviation-heading": 1.9929437250081896, "set_robot_commands": 0.0942087330504092, "deviation-center-line": 0.5141120095458062, "driven_lanedir_consec": 2.494308053441959, "sim_compute_sim_state": 0.03867934278385368, "sim_compute_performance-ego": 0.06742804064722119, "sim_compute_robot_state-ego": 0.07363343238830566, "sim_compute_robot_state-npc0": 0.06855054815372306, "sim_compute_robot_state-npc1": 0.06713665745215501, "sim_compute_robot_state-npc2": 0.06753144007243082, "sim_compute_robot_state-npc3": 0.06734143616910467}, "udem1-6-0": {"driven_any": 2.176040550989443, "sim_physics": 0.2016110535964225, "survival_time": 5.14999999999999, "driven_lanedir": 1.9748003483573369, "sim_render-ego": 0.05901173017557385, "in-drivable-lane": 0.29999999999999893, "agent_compute-ego": 0.14692489383290114, "deviation-heading": 0.7877172510198454, "set_robot_commands": 0.08957806837211535, "deviation-center-line": 0.30661477465861414, "driven_lanedir_consec": 1.9748003483573369, "sim_compute_sim_state": 0.04028066385139539, "sim_compute_performance-ego": 0.06638032487295206, "sim_compute_robot_state-ego": 0.06875058053766639, "sim_compute_robot_state-npc0": 0.06517222089674866, "sim_compute_robot_state-npc1": 0.06698437801842551, "sim_compute_robot_state-npc2": 0.06575310808940998, "sim_compute_robot_state-npc3": 0.06498588173134813}, "udem1-7-0": {"driven_any": 1.0050236108346422, "sim_physics": 0.2084524631500244, "survival_time": 2.499999999999999, "driven_lanedir": 0.8701796426684156, "sim_render-ego": 0.06019917964935303, "in-drivable-lane": 0, "agent_compute-ego": 0.1469633340835571, "deviation-heading": 0.9227446658975216, "set_robot_commands": 0.09319165706634522, "deviation-center-line": 0.14884708769804722, "driven_lanedir_consec": 0.8546116490381102, "sim_compute_sim_state": 0.039212522506713865, "sim_compute_performance-ego": 0.06549994945526123, "sim_compute_robot_state-ego": 0.07060802459716797, "sim_compute_robot_state-npc0": 0.06986909866333008, "sim_compute_robot_state-npc1": 0.06824799537658692, "sim_compute_robot_state-npc2": 0.06760644435882568, "sim_compute_robot_state-npc3": 0.07096383571624756}, "udem1-8-0": {"driven_any": 0.9970416603019576, "sim_physics": 0.1898782757612375, "survival_time": 2.5999999999999988, "driven_lanedir": 0.8041152574540316, "sim_render-ego": 0.06001604061860304, "in-drivable-lane": 0.29999999999999893, "agent_compute-ego": 0.14101755160551804, "deviation-heading": 0.6817155913229235, "set_robot_commands": 0.09204180882527278, "deviation-center-line": 0.1898768080806288, "driven_lanedir_consec": 0.8041152574540316, "sim_compute_sim_state": 0.037646201940683216, "sim_compute_performance-ego": 0.06593385568031898, "sim_compute_robot_state-ego": 0.06956790960752048, "sim_compute_robot_state-npc0": 0.0658245453467736, "sim_compute_robot_state-npc1": 0.06798773545485276, "sim_compute_robot_state-npc2": 0.0672946022107051, "sim_compute_robot_state-npc3": 0.06544340115327102}, "udem1-9-0": {"driven_any": 0.4374998710472299, "sim_physics": 0.2169507741928101, "survival_time": 1.3000000000000005, "driven_lanedir": 0.4177527119659043, "sim_render-ego": 0.06410253047943115, "in-drivable-lane": 0, "agent_compute-ego": 0.14377412429222694, "deviation-heading": 0.3796137446285097, "set_robot_commands": 0.07721329652346097, "deviation-center-line": 0.08207813392324871, "driven_lanedir_consec": 0.4177527119659043, "sim_compute_sim_state": 0.03754541507134071, "sim_compute_performance-ego": 0.06886683977567233, "sim_compute_robot_state-ego": 0.07164738728449895, "sim_compute_robot_state-npc0": 0.05748748779296875, "sim_compute_robot_state-npc1": 0.06110611328711876, "sim_compute_robot_state-npc2": 0.06475905271676871, "sim_compute_robot_state-npc3": 0.05855944523444542}, "udem1-10-0": {"driven_any": 0.3412551960104244, "sim_physics": 0.14809103445573288, "survival_time": 1.1000000000000003, "driven_lanedir": 0.3199180625488627, "sim_render-ego": 0.04630926522341641, "in-drivable-lane": 0, "agent_compute-ego": 0.12010794336145576, "deviation-heading": 0.3796986873122644, "set_robot_commands": 0.0737856084650213, "deviation-center-line": 0.06276575300040536, "driven_lanedir_consec": 0.3199180625488627, "sim_compute_sim_state": 0.028044397180730648, "sim_compute_performance-ego": 0.051333958452398125, "sim_compute_robot_state-ego": 0.05179762840270996, "sim_compute_robot_state-npc0": 0.04942713000557639, "sim_compute_robot_state-npc1": 0.04824194041165439, "sim_compute_robot_state-npc2": 0.04873067682439631, "sim_compute_robot_state-npc3": 0.05121774023229426}, "udem1-11-0": {"driven_any": 0.9951985237696338, "sim_physics": 0.16938559532165529, "survival_time": 2.499999999999999, "driven_lanedir": 0.7206363324756615, "sim_render-ego": 0.05834739208221436, "in-drivable-lane": 0.549999999999998, "agent_compute-ego": 0.13397613048553467, "deviation-heading": 0.30074636349085415, "set_robot_commands": 0.08734458446502685, "deviation-center-line": 0.16567670185555422, "driven_lanedir_consec": 0.7185075497455284, "sim_compute_sim_state": 0.03670097827911377, "sim_compute_performance-ego": 0.06331414699554444, "sim_compute_robot_state-ego": 0.06611420154571533, "sim_compute_robot_state-npc0": 0.06355718612670898, "sim_compute_robot_state-npc1": 0.06462915420532227, "sim_compute_robot_state-npc2": 0.06562133312225342, "sim_compute_robot_state-npc3": 0.0655593729019165}, "udem1-12-0": {"driven_any": 1.964687870253437, "sim_physics": 0.19544417046486065, "survival_time": 4.699999999999991, "driven_lanedir": 0.35162821871931205, "sim_render-ego": 0.05966703942481508, "in-drivable-lane": 3.549999999999991, "agent_compute-ego": 0.14727406806134163, "deviation-heading": 0.24234723632033853, "set_robot_commands": 0.09151381634651348, "deviation-center-line": 0.13126670634798973, "driven_lanedir_consec": 0.35162821871931205, "sim_compute_sim_state": 0.03709340602793592, "sim_compute_performance-ego": 0.0671356459881397, "sim_compute_robot_state-ego": 0.07044849243569881, "sim_compute_robot_state-npc0": 0.06600507269514368, "sim_compute_robot_state-npc1": 0.0664763222349451, "sim_compute_robot_state-npc2": 0.06481939934669657, "sim_compute_robot_state-npc3": 0.06726677113390983}, "udem1-13-0": {"driven_any": 1.001633421251194, "sim_physics": 0.19323916618640608, "survival_time": 2.5999999999999988, "driven_lanedir": 0.6537162971975778, "sim_render-ego": 0.05675416267835177, "in-drivable-lane": 0.5999999999999979, "agent_compute-ego": 0.14085448246735793, "deviation-heading": 0.4928440244444201, "set_robot_commands": 0.09070884264432467, "deviation-center-line": 0.13361893417935136, "driven_lanedir_consec": 0.6537162971975778, "sim_compute_sim_state": 0.037528615731459394, "sim_compute_performance-ego": 0.06540880294946524, "sim_compute_robot_state-ego": 0.0683485590494596, "sim_compute_robot_state-npc0": 0.062012236851912275, "sim_compute_robot_state-npc1": 0.06202433659480168, "sim_compute_robot_state-npc2": 0.0631749492425185, "sim_compute_robot_state-npc3": 0.06530338984269363}, "udem1-14-0": {"driven_any": 2.218769782727203, "sim_physics": 0.17780730837867373, "survival_time": 5.249999999999989, "driven_lanedir": 0.8125963661433656, "sim_render-ego": 0.05484543527875628, "in-drivable-lane": 2.499999999999993, "agent_compute-ego": 0.13867555118742445, "deviation-heading": 1.7163026916317128, "set_robot_commands": 0.08519623620169503, "deviation-center-line": 0.24126933160503777, "driven_lanedir_consec": 0.6077880672015845, "sim_compute_sim_state": 0.05763060706002371, "sim_compute_performance-ego": 0.059641583760579424, "sim_compute_robot_state-ego": 0.0636707964397612, "sim_compute_robot_state-npc0": 0.06126974196661086, "sim_compute_robot_state-npc1": 0.06115427471342541, "sim_compute_robot_state-npc2": 0.062056205386207215, "sim_compute_robot_state-npc3": 0.06124926521664574}}
set_robot_commands_max0.0942087330504092
set_robot_commands_mean0.08524657147994456
set_robot_commands_median0.08734458446502685
set_robot_commands_min0.06939254531377478
sim_compute_performance-ego_max0.06937974975222633
sim_compute_performance-ego_mean0.06308976251298352
sim_compute_performance-ego_median0.06540880294946524
sim_compute_performance-ego_min0.0496189413191397
sim_compute_robot_state-ego_max0.07549651463826497
sim_compute_robot_state-ego_mean0.0670391212425295
sim_compute_robot_state-ego_median0.06875058053766639
sim_compute_robot_state-ego_min0.05179762840270996
sim_compute_robot_state-npc0_max0.06986909866333008
sim_compute_robot_state-npc0_mean0.06227583035980112
sim_compute_robot_state-npc0_median0.06464627881844838
sim_compute_robot_state-npc0_min0.04942713000557639
sim_compute_robot_state-npc1_max0.07054537038008372
sim_compute_robot_state-npc1_mean0.06265085289372156
sim_compute_robot_state-npc1_median0.06462915420532227
sim_compute_robot_state-npc1_min0.04824194041165439
sim_compute_robot_state-npc2_max0.06760644435882568
sim_compute_robot_state-npc2_mean0.06254002499311286
sim_compute_robot_state-npc2_median0.06481939934669657
sim_compute_robot_state-npc2_min0.04873067682439631
sim_compute_robot_state-npc3_max0.07096383571624756
sim_compute_robot_state-npc3_mean0.06295542026090485
sim_compute_robot_state-npc3_median0.06544340115327102
sim_compute_robot_state-npc3_min0.050767406632628624
sim_compute_sim_state_max0.05763060706002371
sim_compute_sim_state_mean0.0382729138512653
sim_compute_sim_state_median0.037646201940683216
sim_compute_sim_state_min0.028044397180730648
sim_physics_max0.2169507741928101
sim_physics_mean0.18533555122495687
sim_physics_median0.19323916618640608
sim_physics_min0.14809103445573288
sim_render-ego_max0.06410253047943115
sim_render-ego_mean0.057322909226368096
sim_render-ego_median0.05901173017557385
sim_render-ego_min0.04570551461811307
simulation-passed1
survival_time_max8.349999999999984
survival_time_mean3.3333333333333286
survival_time_min1.0500000000000005
No reset possible
222382516Liam Paull 🇨🇦challenge-aido_LF-baseline-duckietownaido2-LF-sim-testingstep1-simulationhost-erroryesip-172-31-42-167-72270:02:21
Uncaught exception w [...]
Uncaught exception while running Docker Compose:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 759, in run_one
    run_docker(wd, project, cmd)
  File "/project/src/duckietown_challenges_runner/runner.py", line 1100, in run_docker
    subprocess.check_call(cmd0, cwd=cwd, stdout=tee_stdout, stderr=tee_stderr)
  File "/usr/lib/python3.6/subprocess.py", line 286, in check_call
    retcode = call(*popenargs, **kwargs)
  File "/usr/lib/python3.6/subprocess.py", line 267, in call
    with Popen(*popenargs, **kwargs) as p:
  File "/usr/lib/python3.6/subprocess.py", line 709, in __init__
    restore_signals, start_new_session)
  File "/usr/lib/python3.6/subprocess.py", line 1344, in _execute_child
    raise child_exception_type(errno_num, err_msg, err_filename)
FileNotFoundError: [Errno 2] No such file or directory: '/tmp/duckietown/DT18/evaluator/executions/aido2-LF-sim-testing/submission2516/step1-simulation-ip-172-31-42-167-7227-job22238': '/tmp/duckietown/DT18/evaluator/executions/aido2-LF-sim-testing/submission2516/step1-simulation-ip-172-31-42-167-7227-job22238'
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
222282873Peter Almasi 🇭🇺challenge-aido_LF-template-pytorchaido2-LF-sim-validationstep1-simulationsuccessyesip-172-31-42-167-72270:08:40
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.09961531722234862
survival_time_median1.6500000000000008
deviation-center-line_median0.04987285137994037
in-drivable-lane_median0.4500000000000004


other stats
agent_compute-ego_max0.16820432080162895
agent_compute-ego_mean0.15956264209695883
agent_compute-ego_median0.16390464522621848
agent_compute-ego_min0.14047913802297493
deviation-center-line_max0.432567895594584
deviation-center-line_mean0.13207635699799877
deviation-center-line_min0.045928609215654045
deviation-heading_max5.523263516698244
deviation-heading_mean1.681879291579813
deviation-heading_median0.7649954370880971
deviation-heading_min0.577888224526248
driven_any_max1.95293972861085
driven_any_mean0.5311400455593419
driven_any_median0.19547117711578071
driven_any_min0.09959056097976744
driven_lanedir_consec_max0.6138489815617549
driven_lanedir_consec_mean0.19064283524028425
driven_lanedir_consec_min0.05930083493455784
driven_lanedir_max0.6138489815617549
driven_lanedir_mean0.19064283524028425
driven_lanedir_median0.09961531722234862
driven_lanedir_min0.05930083493455784
in-drivable-lane_max7.000000000000033
in-drivable-lane_mean1.6500000000000068
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.95293972861085, "sim_physics": 0.10342413562161104, "survival_time": 14.300000000000068, "driven_lanedir": 0.6138489815617549, "sim_render-ego": 0.05950220064683394, "in-drivable-lane": 7.000000000000033, "agent_compute-ego": 0.1609252532878956, "deviation-heading": 5.523263516698244, "set_robot_commands": 0.09181046902716576, "deviation-center-line": 0.432567895594584, "driven_lanedir_consec": 0.6138489815617549, "sim_compute_sim_state": 0.03754695312126533, "sim_compute_performance-ego": 0.06796296826609365, "sim_compute_robot_state-ego": 0.07055984760497834}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.1859469308962671, "sim_physics": 0.12182507663965224, "survival_time": 1.6000000000000008, "driven_lanedir": 0.09961531722234862, "sim_render-ego": 0.061429888010025024, "in-drivable-lane": 0.2500000000000002, "agent_compute-ego": 0.1642998531460762, "deviation-heading": 0.7649954370880971, "set_robot_commands": 0.0965668559074402, "deviation-center-line": 0.045928609215654045, "driven_lanedir_consec": 0.09961531722234862, "sim_compute_sim_state": 0.04166921228170395, "sim_compute_performance-ego": 0.06727860122919083, "sim_compute_robot_state-ego": 0.07364858686923981}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.09959056097976744, "sim_physics": 0.09187915450648258, "survival_time": 0.9500000000000004, "driven_lanedir": 0.06585589022440708, "sim_render-ego": 0.0502731298145495, "in-drivable-lane": 0, "agent_compute-ego": 0.14047913802297493, "deviation-heading": 0.577888224526248, "set_robot_commands": 0.08007468675312243, "deviation-center-line": 0.08436587838873519, "driven_lanedir_consec": 0.06585589022440708, "sim_compute_sim_state": 0.031740502307289524, "sim_compute_performance-ego": 0.06019889680962814, "sim_compute_robot_state-ego": 0.055345736051860606}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.19547117711578071, "sim_physics": 0.1066137154897054, "survival_time": 1.6500000000000008, "driven_lanedir": 0.05930083493455784, "sim_render-ego": 0.0568210067171039, "in-drivable-lane": 0.5500000000000005, "agent_compute-ego": 0.16390464522621848, "deviation-heading": 0.8231297426676447, "set_robot_commands": 0.0973442540024266, "deviation-center-line": 0.04764655041108008, "driven_lanedir_consec": 0.05930083493455784, "sim_compute_sim_state": 0.0391867377541282, "sim_compute_performance-ego": 0.06435211499532063, "sim_compute_robot_state-ego": 0.07350105227846088}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.22175183019404412, "sim_physics": 0.1253992517789205, "survival_time": 1.800000000000001, "driven_lanedir": 0.11459315225835276, "sim_render-ego": 0.06388092703289455, "in-drivable-lane": 0.4500000000000004, "agent_compute-ego": 0.16820432080162895, "deviation-heading": 0.720119536918831, "set_robot_commands": 0.09970845778783162, "deviation-center-line": 0.04987285137994037, "driven_lanedir_consec": 0.11459315225835276, "sim_compute_sim_state": 0.04097011354234484, "sim_compute_performance-ego": 0.07725827561484443, "sim_compute_robot_state-ego": 0.0841803749402364}}
set_robot_commands_max0.09970845778783162
set_robot_commands_mean0.09310094469559732
set_robot_commands_median0.0965668559074402
set_robot_commands_min0.08007468675312243
sim_compute_performance-ego_max0.07725827561484443
sim_compute_performance-ego_mean0.06741017138301554
sim_compute_performance-ego_median0.06727860122919083
sim_compute_performance-ego_min0.06019889680962814
sim_compute_robot_state-ego_max0.0841803749402364
sim_compute_robot_state-ego_mean0.0714471195489552
sim_compute_robot_state-ego_median0.07350105227846088
sim_compute_robot_state-ego_min0.055345736051860606
sim_compute_sim_state_max0.04166921228170395
sim_compute_sim_state_mean0.03822270380134637
sim_compute_sim_state_median0.0391867377541282
sim_compute_sim_state_min0.031740502307289524
sim_physics_max0.1253992517789205
sim_physics_mean0.10982826680727437
sim_physics_median0.1066137154897054
sim_physics_min0.09187915450648258
sim_render-ego_max0.06388092703289455
sim_render-ego_mean0.05838143044428138
sim_render-ego_median0.05950220064683394
sim_render-ego_min0.0502731298145495
simulation-passed1
survival_time_max14.300000000000068
survival_time_mean4.060000000000015
survival_time_min0.9500000000000004
No reset possible