AI Driving Olympics Home Challenges Submissions Jobs

Evaluator 1291

evaluator1291
ownerI don't have one 😀
machineip-172-31-42-167
processip-172-31-42-167-7227
versiond-c:4.0.30;d-c-r:4.0.46;d-s:4.0.22
first heard
last heard
statusinactive
# evaluating
# success39
# timeout
# failed12
# error33
# aborted
# host-error2
arm0
x86_641
Mac0
gpu available1
Number of processors4
Processor frequency (MHz)2.9 GHz
Free % of processors100%
RAM total (MB)60.0 GB
RAM free (MB)57.2 GB
Disk (MB)96.9 GB
Disk available (MB)45.3 GB
Docker Hub
P11
P2
Cloud simulations
PI Camera0
# Duckiebots0
Map 3x3 avaiable
gpu cores
AIDO 2 Map LF public
AIDO 2 Map LF private
AIDO 2 Map LFV public
AIDO 2 Map LFV private
AIDO 2 Map LFVI public
AIDO 2 Map LFVI private
AIDO 3 Map LF public
AIDO 3 Map LF private
AIDO 3 Map LFV public
AIDO 3 Map LFV private
AIDO 3 Map LFVI public
AIDO 3 Map LFVI private
IPFS mountpoint /ipfs available
IPNS mountpoint /ipns available

Evaluator jobs

Job IDsubmissionuseruser labelchallengestepstatusup to dateevaluatordate starteddate completeddurationmessage
242514025dgmds17avchallenge-aido_LF-template-pytorchaido2-LF-sim-validation-offseasonstep1-simulationsuccessyes12910:03:53Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.2390767607415909
survival_time_median1.7000000000000008
deviation-center-line_median0.08731774378025493
in-drivable-lane_median0


other stats
agent_compute-ego_max0.16627474088926572
agent_compute-ego_mean0.1313293596330848
agent_compute-ego_median0.12806763819285802
agent_compute-ego_min0.09928670796481046
deviation-center-line_max0.12054118396669132
deviation-center-line_mean0.0943806886453727
deviation-center-line_min0.07236157409992623
deviation-heading_max0.8395823312464852
deviation-heading_mean0.6952558053777387
deviation-heading_median0.7189552202610832
deviation-heading_min0.45739388058973846
driven_any_max0.3749492126045942
driven_any_mean0.2776285226328782
driven_any_median0.3017614212335563
driven_any_min0.17025356377144965
driven_lanedir_consec_max0.3270190082975084
driven_lanedir_consec_mean0.22965679021530988
driven_lanedir_consec_min0.14686490694733578
driven_lanedir_max0.3270190082975084
driven_lanedir_mean0.22965679021530988
driven_lanedir_median0.2390767607415909
driven_lanedir_min0.14686490694733578
in-drivable-lane_max0
in-drivable-lane_mean0
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.3749492126045942, "sim_physics": 0.12693515339413206, "survival_time": 1.850000000000001, "driven_lanedir": 0.3270190082975084, "sim_render-ego": 0.06605729541263065, "in-drivable-lane": 0, "agent_compute-ego": 0.16627474088926572, "deviation-heading": 0.7189552202610832, "set_robot_commands": 0.09236621212314916, "deviation-center-line": 0.12054118396669132, "driven_lanedir_consec": 0.3270190082975084, "sim_compute_sim_state": 0.04001455049257021, "sim_compute_performance-ego": 0.07290745425868679, "sim_compute_robot_state-ego": 0.07285991874901024}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.3017614212335563, "sim_physics": 0.08956792074091294, "survival_time": 1.7000000000000008, "driven_lanedir": 0.2564287352724717, "sim_render-ego": 0.052202484186957866, "in-drivable-lane": 0, "agent_compute-ego": 0.13587720955119414, "deviation-heading": 0.6733187045960338, "set_robot_commands": 0.07599426718319163, "deviation-center-line": 0.07236157409992623, "driven_lanedir_consec": 0.2564287352724717, "sim_compute_sim_state": 0.0335771686890546, "sim_compute_performance-ego": 0.061313993790570426, "sim_compute_robot_state-ego": 0.06306799019084257}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.17025356377144965, "sim_physics": 0.07938455451618541, "survival_time": 1.1000000000000003, "driven_lanedir": 0.14686490694733578, "sim_render-ego": 0.042021328752691094, "in-drivable-lane": 0, "agent_compute-ego": 0.09928670796481046, "deviation-heading": 0.45739388058973846, "set_robot_commands": 0.056093421849337494, "deviation-center-line": 0.10546361989156476, "driven_lanedir_consec": 0.14686490694733578, "sim_compute_sim_state": 0.027623111551458187, "sim_compute_performance-ego": 0.04570894891565496, "sim_compute_robot_state-ego": 0.04802670262076638}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.23782365344564824, "sim_physics": 0.08705323083060128, "survival_time": 1.4000000000000006, "driven_lanedir": 0.1788945398176427, "sim_render-ego": 0.047928035259246826, "in-drivable-lane": 0, "agent_compute-ego": 0.12806763819285802, "deviation-heading": 0.8395823312464852, "set_robot_commands": 0.07527873345783778, "deviation-center-line": 0.08621932148842626, "driven_lanedir_consec": 0.1788945398176427, "sim_compute_sim_state": 0.03158831596374512, "sim_compute_performance-ego": 0.05270154135567801, "sim_compute_robot_state-ego": 0.05596248592649187}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.3033547621091426, "sim_physics": 0.07809444155011858, "survival_time": 1.7500000000000009, "driven_lanedir": 0.2390767607415909, "sim_render-ego": 0.0470867361341204, "in-drivable-lane": 0, "agent_compute-ego": 0.12714050156729562, "deviation-heading": 0.7870288901953529, "set_robot_commands": 0.07119325229099818, "deviation-center-line": 0.08731774378025493, "driven_lanedir_consec": 0.2390767607415909, "sim_compute_sim_state": 0.02933272634233747, "sim_compute_performance-ego": 0.05213925497872489, "sim_compute_robot_state-ego": 0.06471589633396693}}
set_robot_commands_max0.09236621212314916
set_robot_commands_mean0.07418517738090284
set_robot_commands_median0.07527873345783778
set_robot_commands_min0.056093421849337494
sim_compute_performance-ego_max0.07290745425868679
sim_compute_performance-ego_mean0.05695423865986302
sim_compute_performance-ego_median0.05270154135567801
sim_compute_performance-ego_min0.04570894891565496
sim_compute_robot_state-ego_max0.07285991874901024
sim_compute_robot_state-ego_mean0.0609265987642156
sim_compute_robot_state-ego_median0.06306799019084257
sim_compute_robot_state-ego_min0.04802670262076638
sim_compute_sim_state_max0.04001455049257021
sim_compute_sim_state_mean0.03242717460783312
sim_compute_sim_state_median0.03158831596374512
sim_compute_sim_state_min0.027623111551458187
sim_physics_max0.12693515339413206
sim_physics_mean0.09220706020639004
sim_physics_median0.08705323083060128
sim_physics_min0.07809444155011858
sim_render-ego_max0.06605729541263065
sim_render-ego_mean0.05105917594912936
sim_render-ego_median0.047928035259246826
sim_render-ego_min0.042021328752691094
simulation-passed1
survival_time_max1.850000000000001
survival_time_mean1.5600000000000007
survival_time_min1.1000000000000003
242424033frank_qcd_qkchallenge-aido_LF-template-ros - Template solution using ROSaido2-LF-sim-testing-offseasonstep1-simulationsuccessyes12910:14:22Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.4126113388371666
survival_time_median2.6999999999999984
deviation-center-line_median0.11871775985231396
in-drivable-lane_median0.9499999999999976


other stats
agent_compute-ego_max0.08625599054189828
agent_compute-ego_mean0.06545590483320625
agent_compute-ego_median0.06711106300354004
agent_compute-ego_min0.05170397247586932
deviation-center-line_max0.2616199012603187
deviation-center-line_mean0.12663752615997417
deviation-center-line_min0.07143676193760398
deviation-heading_max1.4563581054905994
deviation-heading_mean0.5551840294909584
deviation-heading_median0.55940705176748
deviation-heading_min0.2596285487829774
driven_any_max1.6839250134630197
driven_any_mean0.7327294413370017
driven_any_median0.7309130538792373
driven_any_min0.2364518949491652
driven_lanedir_consec_max0.9416535020294268
driven_lanedir_consec_mean0.4469104002974222
driven_lanedir_consec_min0.2221238695940002
driven_lanedir_max0.9416535020294268
driven_lanedir_mean0.4469104002974222
driven_lanedir_median0.4126113388371666
driven_lanedir_min0.2221238695940002
in-drivable-lane_max2.1499999999999924
in-drivable-lane_mean0.8233333333333307
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.922682252912863, "sim_physics": 0.1152582974501059, "survival_time": 3.5499999999999954, "driven_lanedir": 0.36592094708219225, "sim_render-ego": 0.06141374144755619, "in-drivable-lane": 1.8999999999999944, "agent_compute-ego": 0.07228640435447156, "deviation-heading": 0.2596285487829774, "set_robot_commands": 0.08963692020362532, "deviation-center-line": 0.16987818035809085, "driven_lanedir_consec": 0.36592094708219225, "sim_compute_sim_state": 0.03723813446474747, "sim_compute_performance-ego": 0.06911584692941584, "sim_compute_robot_state-ego": 0.0728284305250141}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.7993934895811189, "sim_physics": 0.10965328613917032, "survival_time": 2.9999999999999973, "driven_lanedir": 0.6632135184572027, "sim_render-ego": 0.05989002386728923, "in-drivable-lane": 0.29999999999999893, "agent_compute-ego": 0.06711106300354004, "deviation-heading": 0.5809378480871981, "set_robot_commands": 0.09171077410380044, "deviation-center-line": 0.1166759393545397, "driven_lanedir_consec": 0.6632135184572027, "sim_compute_sim_state": 0.03891295989354451, "sim_compute_performance-ego": 0.06470248699188233, "sim_compute_robot_state-ego": 0.07342348098754883}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.2364518949491652, "sim_physics": 0.11428345333446156, "survival_time": 1.1000000000000003, "driven_lanedir": 0.2221238695940002, "sim_render-ego": 0.06141300634904341, "in-drivable-lane": 0, "agent_compute-ego": 0.0644609819759022, "deviation-heading": 0.34882560565471876, "set_robot_commands": 0.09197779135270552, "deviation-center-line": 0.11316665887359229, "driven_lanedir_consec": 0.2221238695940002, "sim_compute_sim_state": 0.039153792641379616, "sim_compute_performance-ego": 0.06963430751453746, "sim_compute_robot_state-ego": 0.07346431775526567}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.5946812776947944, "sim_physics": 0.12053691347440083, "survival_time": 2.3999999999999995, "driven_lanedir": 0.5792955579972934, "sim_render-ego": 0.06152849396069845, "in-drivable-lane": 0, "agent_compute-ego": 0.06888946890830994, "deviation-heading": 0.5685240160177978, "set_robot_commands": 0.0911272217830022, "deviation-center-line": 0.15908349194402024, "driven_lanedir_consec": 0.5792955579972934, "sim_compute_sim_state": 0.03807920217514038, "sim_compute_performance-ego": 0.06891987224419911, "sim_compute_robot_state-ego": 0.06644616027673085}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.609146202404747, "sim_physics": 0.12105796129807182, "survival_time": 2.3, "driven_lanedir": 0.2919817227673325, "sim_render-ego": 0.06257574454597804, "in-drivable-lane": 0.9499999999999992, "agent_compute-ego": 0.07804710968681004, "deviation-heading": 0.3390861746033595, "set_robot_commands": 0.09984223220659338, "deviation-center-line": 0.1011892720306074, "driven_lanedir_consec": 0.2919817227673325, "sim_compute_sim_state": 0.0419939082601796, "sim_compute_performance-ego": 0.06749126703842827, "sim_compute_robot_state-ego": 0.07498586177825928}, "ETHZ_autolab_technical_track-5-0": {"driven_any": 0.32177231722795413, "sim_physics": 0.10813112060228984, "survival_time": 1.2000000000000004, "driven_lanedir": 0.259671941523266, "sim_render-ego": 0.0538142720858256, "in-drivable-lane": 0.05000000000000005, "agent_compute-ego": 0.06173714995384216, "deviation-heading": 0.55940705176748, "set_robot_commands": 0.08492747942606609, "deviation-center-line": 0.07983398841276981, "driven_lanedir_consec": 0.259671941523266, "sim_compute_sim_state": 0.035684674978256226, "sim_compute_performance-ego": 0.057745675245920815, "sim_compute_robot_state-ego": 0.06469250718752544}, "ETHZ_autolab_technical_track-6-0": {"driven_any": 0.9218874635466072, "sim_physics": 0.11351568882281964, "survival_time": 3.899999999999994, "driven_lanedir": 0.5450627289344152, "sim_render-ego": 0.06516244472601475, "in-drivable-lane": 1.2999999999999954, "agent_compute-ego": 0.06772094812148656, "deviation-heading": 0.6586708623908946, "set_robot_commands": 0.088167178325164, "deviation-center-line": 0.13114121213460145, "driven_lanedir_consec": 0.5450627289344152, "sim_compute_sim_state": 0.038558366971138194, "sim_compute_performance-ego": 0.075775574415158, "sim_compute_robot_state-ego": 0.06782164023472713}, "ETHZ_autolab_technical_track-7-0": {"driven_any": 0.8035998912048764, "sim_physics": 0.0795491806098393, "survival_time": 2.799999999999998, "driven_lanedir": 0.4126113388371666, "sim_render-ego": 0.04486587217875889, "in-drivable-lane": 0.9999999999999972, "agent_compute-ego": 0.05170397247586932, "deviation-heading": 0.6465417997696941, "set_robot_commands": 0.07026986139161247, "deviation-center-line": 0.119844131874105, "driven_lanedir_consec": 0.4126113388371666, "sim_compute_sim_state": 0.02878409624099731, "sim_compute_performance-ego": 0.04810681939125061, "sim_compute_robot_state-ego": 0.05069054450307574}, "ETHZ_autolab_technical_track-8-0": {"driven_any": 1.082025040886041, "sim_physics": 0.08206461489885702, "survival_time": 4.3499999999999925, "driven_lanedir": 0.4507633352947824, "sim_render-ego": 0.045274304247450554, "in-drivable-lane": 2.1499999999999924, "agent_compute-ego": 0.05246536485080061, "deviation-heading": 0.6137519362826567, "set_robot_commands": 0.07070483284435053, "deviation-center-line": 0.11871775985231396, "driven_lanedir_consec": 0.4507633352947824, "sim_compute_sim_state": 0.029729881505856568, "sim_compute_performance-ego": 0.0508778067840927, "sim_compute_robot_state-ego": 0.05319372264818213}, "ETHZ_autolab_technical_track-9-0": {"driven_any": 1.6839250134630197, "sim_physics": 0.08666576688939875, "survival_time": 5.4999999999999885, "driven_lanedir": 0.9416535020294268, "sim_render-ego": 0.04753606536171653, "in-drivable-lane": 1.7999999999999936, "agent_compute-ego": 0.05828435204245828, "deviation-heading": 1.4563581054905994, "set_robot_commands": 0.07354183413765647, "deviation-center-line": 0.2616199012603187, "driven_lanedir_consec": 0.9416535020294268, "sim_compute_sim_state": 0.03192270018837669, "sim_compute_performance-ego": 0.0510006080974232, "sim_compute_robot_state-ego": 0.05258553678339178}, "ETHZ_autolab_technical_track-10-0": {"driven_any": 0.2667775284624888, "sim_physics": 0.08706937233606975, "survival_time": 1.2000000000000004, "driven_lanedir": 0.25235480657068055, "sim_render-ego": 0.04745560884475708, "in-drivable-lane": 0, "agent_compute-ego": 0.05345945556958517, "deviation-heading": 0.2735028974766809, "set_robot_commands": 0.07471247514088948, "deviation-center-line": 0.10630271043038582, "driven_lanedir_consec": 0.25235480657068055, "sim_compute_sim_state": 0.03272449970245361, "sim_compute_performance-ego": 0.05435901880264282, "sim_compute_robot_state-ego": 0.0534152090549469}, "ETHZ_autolab_technical_track-11-0": {"driven_any": 1.0389325864387626, "sim_physics": 0.09923049072166544, "survival_time": 3.8499999999999943, "driven_lanedir": 0.4755729783153157, "sim_render-ego": 0.05137330525881284, "in-drivable-lane": 1.7499999999999938, "agent_compute-ego": 0.062483385011747286, "deviation-heading": 0.521699236138543, "set_robot_commands": 0.07960305585489645, "deviation-center-line": 0.10517150645857888, "driven_lanedir_consec": 0.4755729783153157, "sim_compute_sim_state": 0.03313115045621798, "sim_compute_performance-ego": 0.056381002649084314, "sim_compute_robot_state-ego": 0.059746373783458366}, "ETHZ_autolab_technical_track-12-0": {"driven_any": 0.6835794874956865, "sim_physics": 0.10831332206726074, "survival_time": 2.499999999999999, "driven_lanedir": 0.6100305079584653, "sim_render-ego": 0.05624489784240723, "in-drivable-lane": 0.14999999999999947, "agent_compute-ego": 0.06821502685546875, "deviation-heading": 0.4739455376152246, "set_robot_commands": 0.08412778854370118, "deviation-center-line": 0.12143860235134882, "driven_lanedir_consec": 0.6100305079584653, "sim_compute_sim_state": 0.03808627605438233, "sim_compute_performance-ego": 0.06167109966278076, "sim_compute_robot_state-ego": 0.06277284145355225}, "ETHZ_autolab_technical_track-13-0": {"driven_any": 0.29517411990766207, "sim_physics": 0.12679200906019944, "survival_time": 1.3000000000000005, "driven_lanedir": 0.25251967754950355, "sim_render-ego": 0.06066429615020752, "in-drivable-lane": 0.05000000000000005, "agent_compute-ego": 0.08625599054189828, "deviation-heading": 0.466101326638835, "set_robot_commands": 0.09967133632073036, "deviation-center-line": 0.07143676193760398, "driven_lanedir_consec": 0.25251967754950355, "sim_compute_sim_state": 0.049069918118990384, "sim_compute_performance-ego": 0.06791069874396691, "sim_compute_robot_state-ego": 0.07237301422999455}, "ETHZ_autolab_technical_track-14-0": {"driven_any": 0.7309130538792373, "sim_physics": 0.1129042042626275, "survival_time": 2.6999999999999984, "driven_lanedir": 0.38087957155028906, "sim_render-ego": 0.058872624679848, "in-drivable-lane": 0.9499999999999976, "agent_compute-ego": 0.06871789914590341, "deviation-heading": 0.5607794956477159, "set_robot_commands": 0.0855096490294845, "deviation-center-line": 0.12406277512673576, "driven_lanedir_consec": 0.38087957155028906, "sim_compute_sim_state": 0.03541923893822564, "sim_compute_performance-ego": 0.06428851463176587, "sim_compute_robot_state-ego": 0.07162940943682636}}
set_robot_commands_max0.09984223220659338
set_robot_commands_mean0.08503536204428523
set_robot_commands_median0.0855096490294845
set_robot_commands_min0.07026986139161247
sim_compute_performance-ego_max0.075775574415158
sim_compute_performance-ego_mean0.061865373276169935
sim_compute_performance-ego_median0.06428851463176587
sim_compute_performance-ego_min0.04810681939125061
sim_compute_robot_state-ego_max0.07498586177825928
sim_compute_robot_state-ego_mean0.06467127004256662
sim_compute_robot_state-ego_median0.06644616027673085
sim_compute_robot_state-ego_min0.05069054450307574
sim_compute_sim_state_max0.049069918118990384
sim_compute_sim_state_mean0.03656592003932577
sim_compute_sim_state_median0.03723813446474747
sim_compute_sim_state_min0.02878409624099731
sim_physics_max0.12679200906019944
sim_physics_mean0.10566837879781588
sim_physics_median0.10965328613917032
sim_physics_min0.0795491806098393
sim_render-ego_max0.06516244472601475
sim_render-ego_mean0.055872313436424285
sim_render-ego_median0.058872624679848
sim_render-ego_min0.04486587217875889
simulation-passed1
survival_time_max5.4999999999999885
survival_time_mean2.7766666666666637
survival_time_min1.1000000000000003
242394040frank_qcd_qkchallenge-aido_LF-template-ros - Template solution using ROSaido2-LFVI-sim-validation-offseasonstep1-simulationerroryes12910:07:30
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
Hidden. If you are the author, please login using the top-right link or use the dashboard.
242384043riza.veliogluPredictorLastaido2-PREDstep1-simulationsuccessno12910:01:37Hidden. If you are the author, please login using the top-right link or use the dashboard.
error_L10.11146035845548724
error_L20.019208026578897232


242304024meanstreetsPredictorLastaido2-PREDstep1-simulationsuccessno12910:00:27Hidden. If you are the author, please login using the top-right link or use the dashboard.
error_L10.11549356909288
error_L20.021365875461778584


242244014dgmds17avchallenge-aido_LF-template-pytorchaido2-LF-sim-validation-offseasonstep1-simulationerroryes12910:00:43
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
Hidden. If you are the author, please login using the top-right link or use the dashboard.
242224019dgmds17avchallenge-aido_LF-template-pytorchaido2-LFVI-sim-testing-offseasonstep1-simulationerroryes12910:01:24
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
Hidden. If you are the author, please login using the top-right link or use the dashboard.
242164010kene4192CNN-48by96-less-one-50-augaido2-LFV-sim-validation-offseasonstep1-simulationfailedyes12910:02:56
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "experiment_manager.py", line 297, in run_episode
    r: MsgReceived = agent.write_topic_and_expect('get_commands', expect='commands')
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 93, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 174, in read_one
    nickname=self.nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 283, in read_until_over
    raise RemoteNodeAborted(m)
zuper_nodes.structures.RemoteNodeAborted: External node "agent" aborted:

error in agent |Exception while handling a message on topic "get_commands".
               |
               || Traceback (most recent call last):
               ||   File "/workspace/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 274, in loop
               ||     handle_message_node(parsed, receiver0, context0)
               ||   File "/workspace/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 428, in handle_message_node
               ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
               ||   File "/workspace/src/zuper-nodes/src/zuper_nodes_wrapper/utils.py", line 18, in call_if_fun_exists
               ||     f(**kwargs)
               ||   File "imitation_agent.py", line 83, in on_received_get_commands
               ||     pwm_left, pwm_right = self.compute_action(self.config.current_image)
               ||   File "imitation_agent.py", line 52, in compute_action
               ||     graph = load_graph(frozen_model_filename)
               ||   File "/workspace/graph_utils.py", line 15, in load_graph
               ||     tf.import_graph_def(graph_def, name="prefix")
               ||   File "/usr/local/lib/python3.7/dist-packages/tensorflow/python/util/deprecation.py", line 507, in new_func
               ||     return func(*args, **kwargs)
               ||   File "/usr/local/lib/python3.7/dist-packages/tensorflow/python/framework/importer.py", line 426, in import_graph_def
               ||     graph._c_graph, serialized, options)  # pylint: disable=protected-access
               || tensorflow.python.framework.errors_impl.NotFoundError: Op type not registered 'ImageProjectiveTransformV2' in binary running on ef0495743c75. Make sure the Op and Kernel are registered in the binary running in this process. Note that if you are loading a saved graph which used ops from tf.contrib, accessing (e.g.) `tf.contrib.resampler` should be done before importing the graph, as contrib ops are lazily registered when the module is first accessed.
               ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
    yield cie
  File "experiment_manager.py", line 441, in <module>
    wrap(cie)
  File "experiment_manager.py", line 429, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 135, in main
    physics_dt=config.physics_dt)
  File "experiment_manager.py", line 301, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.
Hidden. If you are the author, please login using the top-right link or use the dashboard.
242154009kene4192CNN-8logs-60by80-latestaido2-LFV-sim-validation-offseasonstep1-simulationsuccessyes12910:16:37Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.1952234028445328
survival_time_median13.00000000000005
deviation-center-line_median0.3256618704452082
in-drivable-lane_median2.3999999999999915


other stats
agent_compute-ego_max0.11907339737965512
agent_compute-ego_mean0.11830892618638418
agent_compute-ego_median0.11829149421257308
agent_compute-ego_min0.11766454068625844
deviation-center-line_max0.5344984645986883
deviation-center-line_mean0.33373860704654085
deviation-center-line_min0.14378333683408742
deviation-heading_max1.562809565076711
deviation-heading_mean1.229904356455272
deviation-heading_median1.1186705479884342
deviation-heading_min0.9454037442742542
driven_any_max1.7446467209804262
driven_any_mean1.255517800327618
driven_any_median1.611251704928607
driven_any_min0.22880056343648816
driven_lanedir_consec_max1.7367392886938515
driven_lanedir_consec_mean0.9961459420709204
driven_lanedir_consec_min0.1995007661685579
driven_lanedir_max1.7367392886938515
driven_lanedir_mean0.9961885494729422
driven_lanedir_median1.195436439854642
driven_lanedir_min0.1995007661685579
in-drivable-lane_max3.100000000000044
in-drivable-lane_mean1.6900000000000155
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.9923053585059056, "sim_physics": 0.09173779698866832, "survival_time": 7.89999999999998, "driven_lanedir": 0.647504007011475, "sim_render-ego": 0.0354262273522872, "in-drivable-lane": 2.3999999999999915, "agent_compute-ego": 0.11829149421257308, "deviation-heading": 0.999382388975032, "set_robot_commands": 0.054936648924139485, "deviation-center-line": 0.34252413548837746, "driven_lanedir_consec": 0.647504007011475, "sim_compute_sim_state": 0.02239957489544832, "sim_compute_performance-ego": 0.03832693190514287, "sim_compute_robot_state-ego": 0.04036252558985843, "sim_compute_robot_state-npc0": 0.03986259502700613, "sim_compute_robot_state-npc1": 0.03904065452044523, "sim_compute_robot_state-npc2": 0.038914840432662, "sim_compute_robot_state-npc3": 0.03902263279202618}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.7446467209804262, "sim_physics": 0.09826469580332438, "survival_time": 14.950000000000076, "driven_lanedir": 1.7367392886938515, "sim_render-ego": 0.035647926330566404, "in-drivable-lane": 0, "agent_compute-ego": 0.11859069267908733, "deviation-heading": 1.1186705479884342, "set_robot_commands": 0.054910106658935545, "deviation-center-line": 0.5344984645986883, "driven_lanedir_consec": 1.7367392886938515, "sim_compute_sim_state": 0.022767698764801024, "sim_compute_performance-ego": 0.03853987455368042, "sim_compute_robot_state-ego": 0.04069352626800537, "sim_compute_robot_state-npc0": 0.041070401668548584, "sim_compute_robot_state-npc1": 0.03950678110122681, "sim_compute_robot_state-npc2": 0.039288843472798665, "sim_compute_robot_state-npc3": 0.039430228074391685}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.611251704928607, "sim_physics": 0.0900276746505346, "survival_time": 13.65000000000006, "driven_lanedir": 1.2017622456361838, "sim_render-ego": 0.03520317916031722, "in-drivable-lane": 3.100000000000044, "agent_compute-ego": 0.11792450597434692, "deviation-heading": 1.562809565076711, "set_robot_commands": 0.05486709032303248, "deviation-center-line": 0.32222522786634267, "driven_lanedir_consec": 1.2017622456361838, "sim_compute_sim_state": 0.022816099090017243, "sim_compute_performance-ego": 0.03990311413020878, "sim_compute_robot_state-ego": 0.04070883530836839, "sim_compute_robot_state-npc0": 0.042579586252624736, "sim_compute_robot_state-npc1": 0.039325075708466134, "sim_compute_robot_state-npc2": 0.0391649964091542, "sim_compute_robot_state-npc3": 0.03942370589399512}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.700584653786663, "sim_physics": 0.08992650967377883, "survival_time": 13.00000000000005, "driven_lanedir": 1.195436439854642, "sim_render-ego": 0.035550045967102054, "in-drivable-lane": 2.950000000000042, "agent_compute-ego": 0.11907339737965512, "deviation-heading": 1.5232555359619275, "set_robot_commands": 0.054250281590681806, "deviation-center-line": 0.3256618704452082, "driven_lanedir_consec": 1.1952234028445328, "sim_compute_sim_state": 0.02248762112397414, "sim_compute_performance-ego": 0.038557898998260495, "sim_compute_robot_state-ego": 0.040445626699007475, "sim_compute_robot_state-npc0": 0.04002711314421434, "sim_compute_robot_state-npc1": 0.039264647777263934, "sim_compute_robot_state-npc2": 0.03924060051257794, "sim_compute_robot_state-npc3": 0.04049841073843149}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.22880056343648816, "sim_physics": 0.09023163958293635, "survival_time": 2.0500000000000007, "driven_lanedir": 0.1995007661685579, "sim_render-ego": 0.03497586017701684, "in-drivable-lane": 0, "agent_compute-ego": 0.11766454068625844, "deviation-heading": 0.9454037442742542, "set_robot_commands": 0.053757958295868664, "deviation-center-line": 0.14378333683408742, "driven_lanedir_consec": 0.1995007661685579, "sim_compute_sim_state": 0.022427209993688073, "sim_compute_performance-ego": 0.037980957729060474, "sim_compute_robot_state-ego": 0.040193778712575026, "sim_compute_robot_state-npc0": 0.03968077171139601, "sim_compute_robot_state-npc1": 0.03895214127331245, "sim_compute_robot_state-npc2": 0.03878805695510492, "sim_compute_robot_state-npc3": 0.03891725074954149}}
set_robot_commands_max0.054936648924139485
set_robot_commands_mean0.05454441715853159
set_robot_commands_median0.05486709032303248
set_robot_commands_min0.053757958295868664
sim_compute_performance-ego_max0.03990311413020878
sim_compute_performance-ego_mean0.03866175546327061
sim_compute_performance-ego_median0.03853987455368042
sim_compute_performance-ego_min0.037980957729060474
sim_compute_robot_state-ego_max0.04070883530836839
sim_compute_robot_state-ego_mean0.040480858515562934
sim_compute_robot_state-ego_median0.040445626699007475
sim_compute_robot_state-ego_min0.040193778712575026
sim_compute_robot_state-npc0_max0.042579586252624736
sim_compute_robot_state-npc0_mean0.04064409356075795
sim_compute_robot_state-npc0_median0.04002711314421434
sim_compute_robot_state-npc0_min0.03968077171139601
sim_compute_robot_state-npc1_max0.03950678110122681
sim_compute_robot_state-npc1_mean0.03921786007614291
sim_compute_robot_state-npc1_median0.039264647777263934
sim_compute_robot_state-npc1_min0.03895214127331245
sim_compute_robot_state-npc2_max0.039288843472798665
sim_compute_robot_state-npc2_mean0.039079467556459545
sim_compute_robot_state-npc2_median0.0391649964091542
sim_compute_robot_state-npc2_min0.03878805695510492
sim_compute_robot_state-npc3_max0.04049841073843149
sim_compute_robot_state-npc3_mean0.0394584456496772
sim_compute_robot_state-npc3_median0.03942370589399512
sim_compute_robot_state-npc3_min0.03891725074954149
sim_compute_sim_state_max0.022816099090017243
sim_compute_sim_state_mean0.022579640773585756
sim_compute_sim_state_median0.02248762112397414
sim_compute_sim_state_min0.02239957489544832
sim_physics_max0.09826469580332438
sim_physics_mean0.09203766333984847
sim_physics_median0.09023163958293635
sim_physics_min0.08992650967377883
sim_render-ego_max0.035647926330566404
sim_render-ego_mean0.03536064779745794
sim_render-ego_median0.0354262273522872
sim_render-ego_min0.03497586017701684
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean10.310000000000034
survival_time_min2.0500000000000007
242144008jagwarBaseline solution using reinforcement learningaido2-LF-sim-validation-offseasonstep1-simulationsuccessyes12910:08:36Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.15983003669304985
survival_time_median4.149999999999993
deviation-center-line_median0.0703502703414475
in-drivable-lane_median1.7999999999999974


other stats
agent_compute-ego_max0.09613393624623616
agent_compute-ego_mean0.0952625260891794
agent_compute-ego_median0.0955228460840432
agent_compute-ego_min0.09408488980046024
deviation-center-line_max0.6960955385806167
deviation-center-line_mean0.28487389184774126
deviation-center-line_min0.021871844335814388
deviation-heading_max5.983722633208984
deviation-heading_mean2.918648007643378
deviation-heading_median1.5654975982633557
deviation-heading_min0.5967098075182897
driven_any_max1.889158590404872
driven_any_mean0.869731362762467
driven_any_median0.4651432691953716
driven_any_min0.0980990159131188
driven_lanedir_consec_max0.6425970163950665
driven_lanedir_consec_mean0.2774269639310317
driven_lanedir_consec_min0.034697835002273525
driven_lanedir_max0.6425970163950665
driven_lanedir_mean0.2774269639310317
driven_lanedir_median0.15983003669304985
driven_lanedir_min0.034697835002273525
in-drivable-lane_max7.600000000000042
in-drivable-lane_mean3.510000000000015
in-drivable-lane_min0.4500000000000003
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.889158590404872, "sim_physics": 0.055369951725006104, "survival_time": 14.950000000000076, "driven_lanedir": 0.6425970163950665, "sim_render-ego": 0.035343929926554364, "in-drivable-lane": 7.100000000000034, "agent_compute-ego": 0.0960918672879537, "deviation-heading": 5.983722633208984, "set_robot_commands": 0.05422401905059814, "deviation-center-line": 0.6960955385806167, "driven_lanedir_consec": 0.6425970163950665, "sim_compute_sim_state": 0.02259062925974528, "sim_compute_performance-ego": 0.038076802889506024, "sim_compute_robot_state-ego": 0.04011547088623047}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.1541454437653466, "sim_physics": 0.0586084057303036, "survival_time": 1.7000000000000008, "driven_lanedir": 0.04181350773923831, "sim_render-ego": 0.034477198825163, "in-drivable-lane": 0.6000000000000005, "agent_compute-ego": 0.09447909102720373, "deviation-heading": 0.6183887112259263, "set_robot_commands": 0.053534255308263445, "deviation-center-line": 0.021871844335814388, "driven_lanedir_consec": 0.04181350773923831, "sim_compute_sim_state": 0.022742636063519645, "sim_compute_performance-ego": 0.038333920871510226, "sim_compute_robot_state-ego": 0.040275952395270855}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.0980990159131188, "sim_physics": 0.05540929900275336, "survival_time": 1.3500000000000003, "driven_lanedir": 0.034697835002273525, "sim_render-ego": 0.03404392136467828, "in-drivable-lane": 0.4500000000000003, "agent_compute-ego": 0.09408488980046024, "deviation-heading": 0.5967098075182897, "set_robot_commands": 0.0537840172096535, "deviation-center-line": 0.07026661260266032, "driven_lanedir_consec": 0.034697835002273525, "sim_compute_sim_state": 0.022600747920848704, "sim_compute_performance-ego": 0.0380075595996998, "sim_compute_robot_state-ego": 0.040156134852656615}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.7421104945336263, "sim_physics": 0.05637174208958944, "survival_time": 14.950000000000076, "driven_lanedir": 0.5081964238255305, "sim_render-ego": 0.03531768639882406, "in-drivable-lane": 7.600000000000042, "agent_compute-ego": 0.09613393624623616, "deviation-heading": 5.828921288000335, "set_robot_commands": 0.05439356486002604, "deviation-center-line": 0.5657851933781672, "driven_lanedir_consec": 0.5081964238255305, "sim_compute_sim_state": 0.022633309364318847, "sim_compute_performance-ego": 0.03806220849355062, "sim_compute_robot_state-ego": 0.04006751139958699}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.4651432691953716, "sim_physics": 0.05886568218828684, "survival_time": 4.149999999999993, "driven_lanedir": 0.15983003669304985, "sim_render-ego": 0.03531084290469985, "in-drivable-lane": 1.7999999999999974, "agent_compute-ego": 0.0955228460840432, "deviation-heading": 1.5654975982633557, "set_robot_commands": 0.054625232535672474, "deviation-center-line": 0.0703502703414475, "driven_lanedir_consec": 0.15983003669304985, "sim_compute_sim_state": 0.02272988514727857, "sim_compute_performance-ego": 0.038458209439932584, "sim_compute_robot_state-ego": 0.039753181388579216}}
set_robot_commands_max0.054625232535672474
set_robot_commands_mean0.05411221779284272
set_robot_commands_median0.05422401905059814
set_robot_commands_min0.053534255308263445
sim_compute_performance-ego_max0.038458209439932584
sim_compute_performance-ego_mean0.03818774025883985
sim_compute_performance-ego_median0.038076802889506024
sim_compute_performance-ego_min0.0380075595996998
sim_compute_robot_state-ego_max0.040275952395270855
sim_compute_robot_state-ego_mean0.040073650184464835
sim_compute_robot_state-ego_median0.04011547088623047
sim_compute_robot_state-ego_min0.039753181388579216
sim_compute_sim_state_max0.022742636063519645
sim_compute_sim_state_mean0.02265944155114221
sim_compute_sim_state_median0.022633309364318847
sim_compute_sim_state_min0.02259062925974528
sim_physics_max0.05886568218828684
sim_physics_mean0.05692501614718788
sim_physics_median0.05637174208958944
sim_physics_min0.055369951725006104
sim_render-ego_max0.035343929926554364
sim_render-ego_mean0.03489871588398391
sim_render-ego_median0.03531084290469985
sim_render-ego_min0.03404392136467828
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean7.42000000000003
survival_time_min1.3500000000000003
242134007InderpalBaseline solution using reinforcement learningaido2-LFV-sim-validation-offseasonstep1-simulationerroryes12910:00:25
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
Hidden. If you are the author, please login using the top-right link or use the dashboard.
242124006jagwarBaseline solution using reinforcement learningaido2-LF-sim-validation-offseasonstep1-simulationsuccessyes12910:04:38Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.07579582448250355
survival_time_median1.6000000000000008
deviation-center-line_median0.08009172848177352
in-drivable-lane_median0.5500000000000005


other stats
agent_compute-ego_max0.09601959871209186
agent_compute-ego_mean0.0949256401643521
agent_compute-ego_median0.09500908106565475
agent_compute-ego_min0.093785938463713
deviation-center-line_max0.2405417869685169
deviation-center-line_mean0.09169309380908088
deviation-center-line_min0.024549257963551625
deviation-heading_max4.617564995557
deviation-heading_mean1.5644167646288392
deviation-heading_median0.5550325578631559
deviation-heading_min0.5438538878239981
driven_any_max1.4816910427797223
driven_any_mean0.495176833085527
driven_any_median0.18694509205844767
driven_any_min0.09880002889701386
driven_lanedir_consec_max0.49519261333171904
driven_lanedir_consec_mean0.17250946715992693
driven_lanedir_consec_min0.06472982378274272
driven_lanedir_max0.49519261333171904
driven_lanedir_mean0.17250946715992693
driven_lanedir_median0.07579582448250355
driven_lanedir_min0.06472982378274272
in-drivable-lane_max5.400000000000016
in-drivable-lane_mean1.660000000000003
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.4816910427797223, "sim_physics": 0.056865911898405654, "survival_time": 11.500000000000028, "driven_lanedir": 0.49519261333171904, "sim_render-ego": 0.035276695956354555, "in-drivable-lane": 5.400000000000016, "agent_compute-ego": 0.09601959871209186, "deviation-heading": 4.617564995557, "set_robot_commands": 0.054113337268000064, "deviation-center-line": 0.2405417869685169, "driven_lanedir_consec": 0.49519261333171904, "sim_compute_sim_state": 0.02241007970727008, "sim_compute_performance-ego": 0.037818044164906375, "sim_compute_robot_state-ego": 0.03979926212974216}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.18694509205844767, "sim_physics": 0.05601000785827637, "survival_time": 1.6000000000000008, "driven_lanedir": 0.07579582448250355, "sim_render-ego": 0.034890249371528625, "in-drivable-lane": 0.5000000000000004, "agent_compute-ego": 0.09500908106565475, "deviation-heading": 0.5513759756100111, "set_robot_commands": 0.054661400616168976, "deviation-center-line": 0.024549257963551625, "driven_lanedir_consec": 0.07579582448250355, "sim_compute_sim_state": 0.02267883718013763, "sim_compute_performance-ego": 0.0376165583729744, "sim_compute_robot_state-ego": 0.04014083743095398}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.09880002889701386, "sim_physics": 0.05664123986896716, "survival_time": 0.9500000000000004, "driven_lanedir": 0.06756661795490837, "sim_render-ego": 0.0344741846385755, "in-drivable-lane": 0, "agent_compute-ego": 0.093785938463713, "deviation-heading": 0.5550325578631559, "set_robot_commands": 0.05422968613473993, "deviation-center-line": 0.08312789178633377, "driven_lanedir_consec": 0.06756661795490837, "sim_compute_sim_state": 0.022804473575792815, "sim_compute_performance-ego": 0.03830104125173468, "sim_compute_robot_state-ego": 0.03982152436908923}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.5263936149096982, "sim_physics": 0.05797784841513332, "survival_time": 3.949999999999994, "driven_lanedir": 0.15926245624776092, "sim_render-ego": 0.03561568561988541, "in-drivable-lane": 1.8499999999999983, "agent_compute-ego": 0.09532391874096062, "deviation-heading": 1.554256406290032, "set_robot_commands": 0.05461578127704089, "deviation-center-line": 0.08009172848177352, "driven_lanedir_consec": 0.15926245624776092, "sim_compute_sim_state": 0.02261855028852632, "sim_compute_performance-ego": 0.03783848617650286, "sim_compute_robot_state-ego": 0.04013185259662097}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.1820543867827529, "sim_physics": 0.05938730388879776, "survival_time": 1.6000000000000008, "driven_lanedir": 0.06472982378274272, "sim_render-ego": 0.03480908274650574, "in-drivable-lane": 0.5500000000000005, "agent_compute-ego": 0.0944896638393402, "deviation-heading": 0.5438538878239981, "set_robot_commands": 0.054827980697155, "deviation-center-line": 0.0301548038452286, "driven_lanedir_consec": 0.06472982378274272, "sim_compute_sim_state": 0.023577839136123657, "sim_compute_performance-ego": 0.037807755172252655, "sim_compute_robot_state-ego": 0.043960362672805786}}
set_robot_commands_max0.054827980697155
set_robot_commands_mean0.05448963719862097
set_robot_commands_median0.05461578127704089
set_robot_commands_min0.054113337268000064
sim_compute_performance-ego_max0.03830104125173468
sim_compute_performance-ego_mean0.03787637702767419
sim_compute_performance-ego_median0.037818044164906375
sim_compute_performance-ego_min0.0376165583729744
sim_compute_robot_state-ego_max0.043960362672805786
sim_compute_robot_state-ego_mean0.040770767839842424
sim_compute_robot_state-ego_median0.04013185259662097
sim_compute_robot_state-ego_min0.03979926212974216
sim_compute_sim_state_max0.023577839136123657
sim_compute_sim_state_mean0.022817955977570106
sim_compute_sim_state_median0.02267883718013763
sim_compute_sim_state_min0.02241007970727008
sim_physics_max0.05938730388879776
sim_physics_mean0.05737646238591605
sim_physics_median0.056865911898405654
sim_physics_min0.05601000785827637
sim_render-ego_max0.03561568561988541
sim_render-ego_mean0.035013179666569964
sim_render-ego_median0.034890249371528625
sim_render-ego_min0.0344741846385755
simulation-passed1
survival_time_max11.500000000000028
survival_time_mean3.9200000000000057
survival_time_min0.9500000000000004
242114005jagwarBaseline solution using reinforcement learningaido2-LF-sim-validation-offseasonstep1-simulationsuccessyes12910:02:53Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.0772679506413414
survival_time_median1.6000000000000008
deviation-center-line_median0.0613513324699074
in-drivable-lane_median0.2500000000000002


other stats
agent_compute-ego_max0.09663986414670944
agent_compute-ego_mean0.0958702497830367
agent_compute-ego_median0.09591157812821238
agent_compute-ego_min0.09439153671264648
deviation-center-line_max0.08345382407618472
deviation-center-line_mean0.058419638662448946
deviation-center-line_min0.026443558539094345
deviation-heading_max0.9218048369594884
deviation-heading_mean0.719622609823016
deviation-heading_median0.6997052138594824
deviation-heading_min0.6227713704254445
driven_any_max0.20250596105814983
driven_any_mean0.17867700914822263
driven_any_median0.19996483831105633
driven_any_min0.09531884518035684
driven_lanedir_consec_max0.11241693563678412
driven_lanedir_consec_mean0.08370788016267627
driven_lanedir_consec_min0.05478240813622692
driven_lanedir_max0.11241693563678412
driven_lanedir_mean0.08370788016267627
driven_lanedir_median0.0772679506413414
driven_lanedir_min0.05478240813622692
in-drivable-lane_max0.6000000000000005
in-drivable-lane_mean0.3200000000000003
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.20250596105814983, "sim_physics": 0.05838939121791294, "survival_time": 1.7500000000000009, "driven_lanedir": 0.06884443029429255, "sim_render-ego": 0.035469654628208704, "in-drivable-lane": 0.6000000000000005, "agent_compute-ego": 0.0966219765799386, "deviation-heading": 0.6997052138594824, "set_robot_commands": 0.053894846779959545, "deviation-center-line": 0.0613513324699074, "driven_lanedir_consec": 0.06884443029429255, "sim_compute_sim_state": 0.022397940499441965, "sim_compute_performance-ego": 0.03811454772949219, "sim_compute_robot_state-ego": 0.040408781596592495}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.19996483831105633, "sim_physics": 0.05308730942862375, "survival_time": 1.7500000000000009, "driven_lanedir": 0.0772679506413414, "sim_render-ego": 0.03483869688851493, "in-drivable-lane": 0.5500000000000005, "agent_compute-ego": 0.09439153671264648, "deviation-heading": 0.6227713704254445, "set_robot_commands": 0.05404246875217983, "deviation-center-line": 0.026443558539094345, "driven_lanedir_consec": 0.0772679506413414, "sim_compute_sim_state": 0.022618559428623744, "sim_compute_performance-ego": 0.03792435782296317, "sim_compute_robot_state-ego": 0.04007571084158761}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.09531884518035684, "sim_physics": 0.057345264836361536, "survival_time": 0.9500000000000004, "driven_lanedir": 0.05478240813622692, "sim_render-ego": 0.0344429518047132, "in-drivable-lane": 0, "agent_compute-ego": 0.09591157812821238, "deviation-heading": 0.6228573861704099, "set_robot_commands": 0.05313186896474738, "deviation-center-line": 0.08345382407618472, "driven_lanedir_consec": 0.05478240813622692, "sim_compute_sim_state": 0.02287936210632324, "sim_compute_performance-ego": 0.03819581081992701, "sim_compute_robot_state-ego": 0.04053026751468056}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.20016427696693792, "sim_physics": 0.061871004104614255, "survival_time": 1.5000000000000009, "driven_lanedir": 0.11241693563678412, "sim_render-ego": 0.03550979296366374, "in-drivable-lane": 0.20000000000000015, "agent_compute-ego": 0.0957862933476766, "deviation-heading": 0.9218048369594884, "set_robot_commands": 0.05368614196777344, "deviation-center-line": 0.06879476900788264, "driven_lanedir_consec": 0.11241693563678412, "sim_compute_sim_state": 0.02270797888437907, "sim_compute_performance-ego": 0.03782270749409993, "sim_compute_robot_state-ego": 0.04026153087615967}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.19543112422461217, "sim_physics": 0.06400367617607117, "survival_time": 1.6000000000000008, "driven_lanedir": 0.10522767610473638, "sim_render-ego": 0.036433689296245575, "in-drivable-lane": 0.2500000000000002, "agent_compute-ego": 0.09663986414670944, "deviation-heading": 0.7309742417002549, "set_robot_commands": 0.05451656132936478, "deviation-center-line": 0.052054709219175606, "driven_lanedir_consec": 0.10522767610473638, "sim_compute_sim_state": 0.023417800664901733, "sim_compute_performance-ego": 0.0393063947558403, "sim_compute_robot_state-ego": 0.04083704948425293}}
set_robot_commands_max0.05451656132936478
set_robot_commands_mean0.05385437755880499
set_robot_commands_median0.053894846779959545
set_robot_commands_min0.05313186896474738
sim_compute_performance-ego_max0.0393063947558403
sim_compute_performance-ego_mean0.03827276372446452
sim_compute_performance-ego_median0.03811454772949219
sim_compute_performance-ego_min0.03782270749409993
sim_compute_robot_state-ego_max0.04083704948425293
sim_compute_robot_state-ego_mean0.040422668062654654
sim_compute_robot_state-ego_median0.040408781596592495
sim_compute_robot_state-ego_min0.04007571084158761
sim_compute_sim_state_max0.023417800664901733
sim_compute_sim_state_mean0.02280432831673395
sim_compute_sim_state_median0.02270797888437907
sim_compute_sim_state_min0.022397940499441965
sim_physics_max0.06400367617607117
sim_physics_mean0.058939329152716734
sim_physics_median0.05838939121791294
sim_physics_min0.05308730942862375
sim_render-ego_max0.036433689296245575
sim_render-ego_mean0.03533895711626923
sim_render-ego_median0.035469654628208704
sim_render-ego_min0.0344429518047132
simulation-passed1
survival_time_max1.7500000000000009
survival_time_mean1.510000000000001
survival_time_min0.9500000000000004
242064000InderpalBaseline solution using reinforcement learningaido2-LFV-sim-validation-offseasonstep1-simulationerroryes12910:00:28
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
Hidden. If you are the author, please login using the top-right link or use the dashboard.
242053999InderpalBaseline solution using reinforcement learningaido2-LFV-sim-validation-offseasonstep1-simulationerroryes12910:00:28
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
Hidden. If you are the author, please login using the top-right link or use the dashboard.
242033998InderpalBaseline solution using reinforcement learningaido2-LFV-sim-validation-offseasonstep1-simulationhost-erroryes12910:01:35
Uncaught exception w [...]
Uncaught exception while running Docker Compose:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 759, in run_one
    run_docker(wd, project, cmd)
  File "/project/src/duckietown_challenges_runner/runner.py", line 1100, in run_docker
    subprocess.check_call(cmd0, cwd=cwd, stdout=tee_stdout, stderr=tee_stderr)
  File "/usr/lib/python3.6/subprocess.py", line 286, in check_call
    retcode = call(*popenargs, **kwargs)
  File "/usr/lib/python3.6/subprocess.py", line 267, in call
    with Popen(*popenargs, **kwargs) as p:
  File "/usr/lib/python3.6/subprocess.py", line 709, in __init__
    restore_signals, start_new_session)
  File "/usr/lib/python3.6/subprocess.py", line 1344, in _execute_child
    raise child_exception_type(errno_num, err_msg, err_filename)
FileNotFoundError: [Errno 2] No such file or directory: '/tmp/duckietown/DT18/evaluator/executions/aido2-LFV-sim-validation-offseason/submission3998/step1-simulation-ip-172-31-42-167-7227-job24203': '/tmp/duckietown/DT18/evaluator/executions/aido2-LFV-sim-validation-offseason/submission3998/step1-simulation-ip-172-31-42-167-7227-job24203'
Hidden. If you are the author, please login using the top-right link or use the dashboard.
241933989jagwarBaseline solution using reinforcement learningaido2-LFVI-sim-testing-offseasonstep1-simulationerroryes12910:12:27
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
Hidden. If you are the author, please login using the top-right link or use the dashboard.
241903984jagwarBaseline solution using reinforcement learningaido2-LF-sim-validation-offseasonstep1-simulationsuccessyes12910:04:48Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.11925280990562026
survival_time_median1.4500000000000006
deviation-center-line_median0.07598570357684653
in-drivable-lane_median0


other stats
agent_compute-ego_max0.18854566278128787
agent_compute-ego_mean0.16184220244334488
agent_compute-ego_median0.15700873874482654
agent_compute-ego_min0.14333097751323992
deviation-center-line_max0.10027282357584272
deviation-center-line_mean0.07734860649591588
deviation-center-line_min0.06045013765355835
deviation-heading_max0.9068035029186574
deviation-heading_mean0.7515052271859106
deviation-heading_median0.7204652740850678
deviation-heading_min0.5367230331073389
driven_any_max0.21468146773583277
driven_any_mean0.1922058536396188
driven_any_median0.2072449185087261
driven_any_min0.13932120481015925
driven_lanedir_consec_max0.1559987034744572
driven_lanedir_consec_mean0.1287179576015225
driven_lanedir_consec_min0.10830944814629584
driven_lanedir_max0.1559987034744572
driven_lanedir_mean0.1287179576015225
driven_lanedir_median0.11925280990562026
driven_lanedir_min0.10830944814629584
in-drivable-lane_max0.15000000000000013
in-drivable-lane_mean0.030000000000000027
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.20878554467107727, "sim_physics": 0.10555112746454054, "survival_time": 1.5500000000000007, "driven_lanedir": 0.11018191257811603, "sim_render-ego": 0.05691415263760474, "in-drivable-lane": 0.15000000000000013, "agent_compute-ego": 0.15350837092245778, "deviation-heading": 0.8784138376717667, "set_robot_commands": 0.08129599017481651, "deviation-center-line": 0.08186327107034987, "driven_lanedir_consec": 0.11018191257811603, "sim_compute_sim_state": 0.03465456347311697, "sim_compute_performance-ego": 0.06270694732666016, "sim_compute_robot_state-ego": 0.06790360327689879}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.2072449185087261, "sim_physics": 0.11194923828388084, "survival_time": 1.4500000000000006, "driven_lanedir": 0.1498469139031231, "sim_render-ego": 0.05767253349567282, "in-drivable-lane": 0, "agent_compute-ego": 0.16681726225491228, "deviation-heading": 0.7204652740850678, "set_robot_commands": 0.08830396060285897, "deviation-center-line": 0.06045013765355835, "driven_lanedir_consec": 0.1498469139031231, "sim_compute_sim_state": 0.03733583976482523, "sim_compute_performance-ego": 0.06955302994826744, "sim_compute_robot_state-ego": 0.07014833647629311}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.13932120481015925, "sim_physics": 0.10933848789760044, "survival_time": 1.0500000000000005, "driven_lanedir": 0.10830944814629584, "sim_render-ego": 0.06103466805957612, "in-drivable-lane": 0, "agent_compute-ego": 0.15700873874482654, "deviation-heading": 0.5367230331073389, "set_robot_commands": 0.08222117878141857, "deviation-center-line": 0.10027282357584272, "driven_lanedir_consec": 0.10830944814629584, "sim_compute_sim_state": 0.03948378562927246, "sim_compute_performance-ego": 0.06559086981273833, "sim_compute_robot_state-ego": 0.06546919686453682}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.19099613247229863, "sim_physics": 0.10698398259969856, "survival_time": 1.3000000000000005, "driven_lanedir": 0.11925280990562026, "sim_render-ego": 0.0559467077255249, "in-drivable-lane": 0, "agent_compute-ego": 0.14333097751323992, "deviation-heading": 0.9068035029186574, "set_robot_commands": 0.08338176287137546, "deviation-center-line": 0.07598570357684653, "driven_lanedir_consec": 0.11925280990562026, "sim_compute_sim_state": 0.03615858921637902, "sim_compute_performance-ego": 0.0623777096088116, "sim_compute_robot_state-ego": 0.06540194841531607}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.21468146773583277, "sim_physics": 0.11789335875675595, "survival_time": 1.4500000000000006, "driven_lanedir": 0.1559987034744572, "sim_render-ego": 0.06605066924259581, "in-drivable-lane": 0, "agent_compute-ego": 0.18854566278128787, "deviation-heading": 0.7151204881467224, "set_robot_commands": 0.09931351398599558, "deviation-center-line": 0.06817109660298196, "driven_lanedir_consec": 0.1559987034744572, "sim_compute_sim_state": 0.03906979231998838, "sim_compute_performance-ego": 0.07097945542171083, "sim_compute_robot_state-ego": 0.07861217959173794}}
set_robot_commands_max0.09931351398599558
set_robot_commands_mean0.08690328128329303
set_robot_commands_median0.08338176287137546
set_robot_commands_min0.08129599017481651
sim_compute_performance-ego_max0.07097945542171083
sim_compute_performance-ego_mean0.06624160242363768
sim_compute_performance-ego_median0.06559086981273833
sim_compute_performance-ego_min0.0623777096088116
sim_compute_robot_state-ego_max0.07861217959173794
sim_compute_robot_state-ego_mean0.06950705292495656
sim_compute_robot_state-ego_median0.06790360327689879
sim_compute_robot_state-ego_min0.06540194841531607
sim_compute_sim_state_max0.03948378562927246
sim_compute_sim_state_mean0.03734051408071641
sim_compute_sim_state_median0.03733583976482523
sim_compute_sim_state_min0.03465456347311697
sim_physics_max0.11789335875675595
sim_physics_mean0.11034323900049528
sim_physics_median0.10933848789760044
sim_physics_min0.10555112746454054
sim_render-ego_max0.06605066924259581
sim_render-ego_mean0.05952374623219488
sim_render-ego_median0.05767253349567282
sim_render-ego_min0.0559467077255249
simulation-passed1
survival_time_max1.5500000000000007
survival_time_mean1.3600000000000003
survival_time_min1.0500000000000005
241873979kene4192CNN-More-Less-One-200-1607aido2-LFV-sim-validation-offseasonstep1-simulationsuccessyes12910:09:06Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.5023434565289406
survival_time_median4.199999999999993
deviation-center-line_median0.17507015629058817
in-drivable-lane_median0


other stats
agent_compute-ego_max0.11996814182826453
agent_compute-ego_mean0.11802581095016124
agent_compute-ego_median0.11788666248321532
agent_compute-ego_min0.11695061789618598
deviation-center-line_max0.6460659939847264
deviation-center-line_mean0.25618809798806963
deviation-center-line_min0.07931830581813651
deviation-heading_max1.932506820469996
deviation-heading_mean1.3814352340891929
deviation-heading_median1.4178669878324306
deviation-heading_min0.8737860689832767
driven_any_max1.046072237588788
driven_any_mean0.5354377268924694
driven_any_median0.5434824197914987
driven_any_min0.1653078317781185
driven_lanedir_consec_max0.970354015928126
driven_lanedir_consec_mean0.4777915741225094
driven_lanedir_consec_min0.117287795145798
driven_lanedir_max0.970354015928126
driven_lanedir_mean0.4777915741225094
driven_lanedir_median0.5023434565289406
driven_lanedir_min0.117287795145798
in-drivable-lane_max0.10000000000000142
in-drivable-lane_mean0.020000000000000285
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.046072237588788, "sim_physics": 0.09292284695498916, "survival_time": 8.299999999999983, "driven_lanedir": 0.970354015928126, "sim_render-ego": 0.03603935816201819, "in-drivable-lane": 0.10000000000000142, "agent_compute-ego": 0.11824099414319876, "deviation-heading": 1.932506820469996, "set_robot_commands": 0.054944651672639046, "deviation-center-line": 0.6460659939847264, "driven_lanedir_consec": 0.970354015928126, "sim_compute_sim_state": 0.022699883185237288, "sim_compute_performance-ego": 0.038999831820108806, "sim_compute_robot_state-ego": 0.04149222230336752, "sim_compute_robot_state-npc0": 0.04031713899359646, "sim_compute_robot_state-npc1": 0.03980569523501109, "sim_compute_robot_state-npc2": 0.03966030586196716, "sim_compute_robot_state-npc3": 0.0396460854863546}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.26011787173774675, "sim_physics": 0.09008729722764756, "survival_time": 2.25, "driven_lanedir": 0.19512641186752824, "sim_render-ego": 0.03647498024834527, "in-drivable-lane": 0, "agent_compute-ego": 0.11695061789618598, "deviation-heading": 1.4178669878324306, "set_robot_commands": 0.054578505622016056, "deviation-center-line": 0.1565201674570823, "driven_lanedir_consec": 0.19512641186752824, "sim_compute_sim_state": 0.022826284832424583, "sim_compute_performance-ego": 0.03861703872680664, "sim_compute_robot_state-ego": 0.04081703291998969, "sim_compute_robot_state-npc0": 0.04034141434563531, "sim_compute_robot_state-npc1": 0.03964693811204698, "sim_compute_robot_state-npc2": 0.0395911799536811, "sim_compute_robot_state-npc3": 0.03957157135009766}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.6622082735661947, "sim_physics": 0.09127032106572933, "survival_time": 5.4999999999999885, "driven_lanedir": 0.6038461911421544, "sim_render-ego": 0.03614023598757657, "in-drivable-lane": 0, "agent_compute-ego": 0.11788666248321532, "deviation-heading": 1.610511938167705, "set_robot_commands": 0.055853204293684525, "deviation-center-line": 0.2239658663898147, "driven_lanedir_consec": 0.6038461911421544, "sim_compute_sim_state": 0.022744063897566363, "sim_compute_performance-ego": 0.038734514063054865, "sim_compute_robot_state-ego": 0.041424166072498665, "sim_compute_robot_state-npc0": 0.040476020899685945, "sim_compute_robot_state-npc1": 0.03985693237998269, "sim_compute_robot_state-npc2": 0.03962564034895463, "sim_compute_robot_state-npc3": 0.03992493369362571}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.5434824197914987, "sim_physics": 0.09146126679011754, "survival_time": 4.199999999999993, "driven_lanedir": 0.5023434565289406, "sim_render-ego": 0.03600750934510004, "in-drivable-lane": 0, "agent_compute-ego": 0.11996814182826453, "deviation-heading": 1.0725043549925544, "set_robot_commands": 0.054271590142023, "deviation-center-line": 0.17507015629058817, "driven_lanedir_consec": 0.5023434565289406, "sim_compute_sim_state": 0.02256264573051816, "sim_compute_performance-ego": 0.03905048540660313, "sim_compute_robot_state-ego": 0.040814073312850224, "sim_compute_robot_state-npc0": 0.04030875932602655, "sim_compute_robot_state-npc1": 0.03937436285473052, "sim_compute_robot_state-npc2": 0.03935809930165609, "sim_compute_robot_state-npc3": 0.03950704279400054}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.1653078317781185, "sim_physics": 0.08979256664003644, "survival_time": 1.4000000000000006, "driven_lanedir": 0.117287795145798, "sim_render-ego": 0.035984422479357035, "in-drivable-lane": 0, "agent_compute-ego": 0.11708263839994158, "deviation-heading": 0.8737860689832767, "set_robot_commands": 0.05464962550571987, "deviation-center-line": 0.07931830581813651, "driven_lanedir_consec": 0.117287795145798, "sim_compute_sim_state": 0.022635800497872487, "sim_compute_performance-ego": 0.03843822649547032, "sim_compute_robot_state-ego": 0.0411829948425293, "sim_compute_robot_state-npc0": 0.04060364621026175, "sim_compute_robot_state-npc1": 0.040178963116237094, "sim_compute_robot_state-npc2": 0.03979051113128662, "sim_compute_robot_state-npc3": 0.03995045593806675}}
set_robot_commands_max0.055853204293684525
set_robot_commands_mean0.0548595154472165
set_robot_commands_median0.05464962550571987
set_robot_commands_min0.054271590142023
sim_compute_performance-ego_max0.03905048540660313
sim_compute_performance-ego_mean0.03876801930240875
sim_compute_performance-ego_median0.038734514063054865
sim_compute_performance-ego_min0.03843822649547032
sim_compute_robot_state-ego_max0.04149222230336752
sim_compute_robot_state-ego_mean0.04114609789024708
sim_compute_robot_state-ego_median0.0411829948425293
sim_compute_robot_state-ego_min0.040814073312850224
sim_compute_robot_state-npc0_max0.04060364621026175
sim_compute_robot_state-npc0_mean0.04040939595504121
sim_compute_robot_state-npc0_median0.04034141434563531
sim_compute_robot_state-npc0_min0.04030875932602655
sim_compute_robot_state-npc1_max0.040178963116237094
sim_compute_robot_state-npc1_mean0.03977257833960167
sim_compute_robot_state-npc1_median0.03980569523501109
sim_compute_robot_state-npc1_min0.03937436285473052
sim_compute_robot_state-npc2_max0.03979051113128662
sim_compute_robot_state-npc2_mean0.03960514731950912
sim_compute_robot_state-npc2_median0.03962564034895463
sim_compute_robot_state-npc2_min0.03935809930165609
sim_compute_robot_state-npc3_max0.03995045593806675
sim_compute_robot_state-npc3_mean0.039720017852429054
sim_compute_robot_state-npc3_median0.0396460854863546
sim_compute_robot_state-npc3_min0.03950704279400054
sim_compute_sim_state_max0.022826284832424583
sim_compute_sim_state_mean0.02269373562872378
sim_compute_sim_state_median0.022699883185237288
sim_compute_sim_state_min0.02256264573051816
sim_physics_max0.09292284695498916
sim_physics_mean0.091106859735704
sim_physics_median0.09127032106572933
sim_physics_min0.08979256664003644
sim_render-ego_max0.03647498024834527
sim_render-ego_mean0.036129301244479425
sim_render-ego_median0.03603935816201819
sim_render-ego_min0.035984422479357035
simulation-passed1
survival_time_max8.299999999999983
survival_time_mean4.329999999999993
survival_time_min1.4000000000000006
241823974ekunniiBaseline solution using reinforcement learningaido2-LF-sim-validation-offseasonstep1-simulationsuccessyes12910:04:43Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.06454460099062675
survival_time_median1.6000000000000008
deviation-center-line_median0.04275896688221893
in-drivable-lane_median0.4500000000000004


other stats
agent_compute-ego_max0.10264609271082384
agent_compute-ego_mean0.09701086434879004
agent_compute-ego_median0.09594948830143098
agent_compute-ego_min0.09362062285928165
deviation-center-line_max0.13718448071669845
deviation-center-line_mean0.0684921545577323
deviation-center-line_min0.03871162596530647
deviation-heading_max2.735299351096212
deviation-heading_mean1.1074335531278754
deviation-heading_median0.7042447910838436
deviation-heading_min0.6427699281071828
driven_any_max0.8942512637639648
driven_any_mean0.31095777816370673
driven_any_median0.18824557338854264
driven_any_min0.08996491052944253
driven_lanedir_consec_max0.2292061820947371
driven_lanedir_consec_mean0.09472789098805764
driven_lanedir_consec_min0.04478126069436117
driven_lanedir_max0.2292061820947371
driven_lanedir_mean0.09472789098805764
driven_lanedir_median0.06454460099062675
driven_lanedir_min0.04478126069436117
in-drivable-lane_max3.5999999999999917
in-drivable-lane_mean1.0099999999999985
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.8942512637639648, "sim_physics": 0.06372406071630017, "survival_time": 7.249999999999982, "driven_lanedir": 0.2292061820947371, "sim_render-ego": 0.03942658490148084, "in-drivable-lane": 3.5999999999999917, "agent_compute-ego": 0.10264609271082384, "deviation-heading": 2.735299351096212, "set_robot_commands": 0.057690580959977776, "deviation-center-line": 0.13718448071669845, "driven_lanedir_consec": 0.2292061820947371, "sim_compute_sim_state": 0.025390330676374764, "sim_compute_performance-ego": 0.04287418990299619, "sim_compute_robot_state-ego": 0.044683568230990706}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.19438136117780877, "sim_physics": 0.05683975359972786, "survival_time": 1.7000000000000008, "driven_lanedir": 0.08715643071703483, "sim_render-ego": 0.0353010191636927, "in-drivable-lane": 0.4500000000000004, "agent_compute-ego": 0.09362062285928165, "deviation-heading": 0.6989631533120237, "set_robot_commands": 0.05336518147412468, "deviation-center-line": 0.03871162596530647, "driven_lanedir_consec": 0.08715643071703483, "sim_compute_sim_state": 0.024535312372095445, "sim_compute_performance-ego": 0.038845034206614774, "sim_compute_robot_state-ego": 0.04095963870777803}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.08996491052944253, "sim_physics": 0.05967116355895996, "survival_time": 0.9500000000000004, "driven_lanedir": 0.0479509804435283, "sim_render-ego": 0.03548543076766165, "in-drivable-lane": 0, "agent_compute-ego": 0.095776357148823, "deviation-heading": 0.6427699281071828, "set_robot_commands": 0.05353345369037829, "deviation-center-line": 0.08216877498149172, "driven_lanedir_consec": 0.0479509804435283, "sim_compute_sim_state": 0.023606363095735248, "sim_compute_performance-ego": 0.03907295277244166, "sim_compute_robot_state-ego": 0.0411552253522371}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.187945781958775, "sim_physics": 0.06090966612100601, "survival_time": 1.6000000000000008, "driven_lanedir": 0.04478126069436117, "sim_render-ego": 0.03618890792131424, "in-drivable-lane": 0.6000000000000005, "agent_compute-ego": 0.09706176072359084, "deviation-heading": 0.7558905420401153, "set_robot_commands": 0.057833969593048096, "deviation-center-line": 0.04275896688221893, "driven_lanedir_consec": 0.04478126069436117, "sim_compute_sim_state": 0.02339804172515869, "sim_compute_performance-ego": 0.03862155228853226, "sim_compute_robot_state-ego": 0.04078549146652222}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.18824557338854264, "sim_physics": 0.06394163254768617, "survival_time": 1.5500000000000007, "driven_lanedir": 0.06454460099062675, "sim_render-ego": 0.03665424162341702, "in-drivable-lane": 0.4000000000000003, "agent_compute-ego": 0.09594948830143098, "deviation-heading": 0.7042447910838436, "set_robot_commands": 0.05346919644263483, "deviation-center-line": 0.041636924242946, "driven_lanedir_consec": 0.06454460099062675, "sim_compute_sim_state": 0.023623074254681988, "sim_compute_performance-ego": 0.03946469676110052, "sim_compute_robot_state-ego": 0.04122935571978169}}
set_robot_commands_max0.057833969593048096
set_robot_commands_mean0.05517847643203273
set_robot_commands_median0.05353345369037829
set_robot_commands_min0.05336518147412468
sim_compute_performance-ego_max0.04287418990299619
sim_compute_performance-ego_mean0.03977568518633708
sim_compute_performance-ego_median0.03907295277244166
sim_compute_performance-ego_min0.03862155228853226
sim_compute_robot_state-ego_max0.044683568230990706
sim_compute_robot_state-ego_mean0.04176265589546194
sim_compute_robot_state-ego_median0.0411552253522371
sim_compute_robot_state-ego_min0.04078549146652222
sim_compute_sim_state_max0.025390330676374764
sim_compute_sim_state_mean0.024110624424809227
sim_compute_sim_state_median0.023623074254681988
sim_compute_sim_state_min0.02339804172515869
sim_physics_max0.06394163254768617
sim_physics_mean0.06101725530873603
sim_physics_median0.06090966612100601
sim_physics_min0.05683975359972786
sim_render-ego_max0.03942658490148084
sim_render-ego_mean0.036611236875513285
sim_render-ego_median0.03618890792131424
sim_render-ego_min0.0353010191636927
simulation-passed1
survival_time_max7.249999999999982
survival_time_mean2.609999999999997
survival_time_min0.9500000000000004
241793971kene4192CNN-More-Less-One-200-1607aido2-LFV-sim-validation-offseasonstep1-simulationfailedyes12910:00:47
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "experiment_manager.py", line 297, in run_episode
    r: MsgReceived = agent.write_topic_and_expect('get_commands', expect='commands')
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 93, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 174, in read_one
    nickname=self.nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 283, in read_until_over
    raise RemoteNodeAborted(m)
zuper_nodes.structures.RemoteNodeAborted: External node "agent" aborted:

error in agent |Exception while handling a message on topic "get_commands".
               |
               || Traceback (most recent call last):
               ||   File "/workspace/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 274, in loop
               ||     handle_message_node(parsed, receiver0, context0)
               ||   File "/workspace/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 428, in handle_message_node
               ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
               ||   File "/workspace/src/zuper-nodes/src/zuper_nodes_wrapper/utils.py", line 18, in call_if_fun_exists
               ||     f(**kwargs)
               ||   File "imitation_agent.py", line 83, in on_received_get_commands
               ||     pwm_left, pwm_right = self.compute_action(self.config.current_image)
               ||   File "imitation_agent.py", line 72, in compute_action
               ||     x: observation
               ||   File "/usr/local/lib/python3.7/dist-packages/tensorflow/python/client/session.py", line 929, in run
               ||     run_metadata_ptr)
               ||   File "/usr/local/lib/python3.7/dist-packages/tensorflow/python/client/session.py", line 1128, in _run
               ||     str(subfeed_t.get_shape())))
               || ValueError: Cannot feed value of shape (1, 4608) for Tensor 'prefix/x:0', which has shape '(?, 14400)'
               ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
    yield cie
  File "experiment_manager.py", line 441, in <module>
    wrap(cie)
  File "experiment_manager.py", line 429, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 135, in main
    physics_dt=config.physics_dt)
  File "experiment_manager.py", line 301, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.
Hidden. If you are the author, please login using the top-right link or use the dashboard.
241773969kene4192CNN-More-Less-One-200-1607aido2-LFV-sim-validation-offseasonstep1-simulationfailedyes12910:02:31
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "experiment_manager.py", line 297, in run_episode
    r: MsgReceived = agent.write_topic_and_expect('get_commands', expect='commands')
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 93, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 174, in read_one
    nickname=self.nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 283, in read_until_over
    raise RemoteNodeAborted(m)
zuper_nodes.structures.RemoteNodeAborted: External node "agent" aborted:

error in agent |Exception while handling a message on topic "get_commands".
               |
               || Traceback (most recent call last):
               ||   File "/workspace/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 274, in loop
               ||     handle_message_node(parsed, receiver0, context0)
               ||   File "/workspace/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 428, in handle_message_node
               ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
               ||   File "/workspace/src/zuper-nodes/src/zuper_nodes_wrapper/utils.py", line 18, in call_if_fun_exists
               ||     f(**kwargs)
               ||   File "imitation_agent.py", line 83, in on_received_get_commands
               ||     pwm_left, pwm_right = self.compute_action(self.config.current_image)
               ||   File "imitation_agent.py", line 72, in compute_action
               ||     x: observation
               ||   File "/usr/local/lib/python3.7/dist-packages/tensorflow/python/client/session.py", line 929, in run
               ||     run_metadata_ptr)
               ||   File "/usr/local/lib/python3.7/dist-packages/tensorflow/python/client/session.py", line 1128, in _run
               ||     str(subfeed_t.get_shape())))
               || ValueError: Cannot feed value of shape (1, 4800) for Tensor 'prefix/x:0', which has shape '(?, 14400)'
               ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
    yield cie
  File "experiment_manager.py", line 441, in <module>
    wrap(cie)
  File "experiment_manager.py", line 429, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 135, in main
    physics_dt=config.physics_dt)
  File "experiment_manager.py", line 301, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.
Hidden. If you are the author, please login using the top-right link or use the dashboard.
241723961jagwarBaseline solution using reinforcement learningaido2-LFV-sim-testing-offseasonstep1-simulationerroryes12910:17:21
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
Hidden. If you are the author, please login using the top-right link or use the dashboard.
241713966ekunniiBaseline solution using reinforcement learningaido2-LF-sim-validation-offseasonstep1-simulationerroryes12910:00:35
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
Hidden. If you are the author, please login using the top-right link or use the dashboard.
241693962jagwarBaseline solution using reinforcement learningaido2-LFV-sim-validation-offseasonstep1-simulationsuccessyes12910:07:03Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.07551485562861782
survival_time_median1.4500000000000006
deviation-center-line_median0.09362617382590456
in-drivable-lane_median0.4000000000000003


other stats
agent_compute-ego_max0.21044018350798507
agent_compute-ego_mean0.16529575799844107
agent_compute-ego_median0.15773930420746674
agent_compute-ego_min0.14487847915062538
deviation-center-line_max0.10260554899178596
deviation-center-line_mean0.07679947183624983
deviation-center-line_min0.03603645325283269
deviation-heading_max1.854935730405859
deviation-heading_mean0.883917892491068
deviation-heading_median0.6356811413845974
deviation-heading_min0.5751540795888518
driven_any_max0.5182735884865612
driven_any_mean0.2271955674033622
driven_any_median0.15661494768192794
driven_any_min0.11434936553255484
driven_lanedir_consec_max0.16492648525961995
driven_lanedir_consec_mean0.08926978947100114
driven_lanedir_consec_min0.05751065867736016
driven_lanedir_max0.16492648525961995
driven_lanedir_mean0.08926978947100114
driven_lanedir_median0.07551485562861782
driven_lanedir_min0.05751065867736016
in-drivable-lane_max1.9999999999999971
in-drivable-lane_mean0.6599999999999997
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.2162076641094172, "sim_physics": 0.17249367043778702, "survival_time": 1.850000000000001, "driven_lanedir": 0.060893961810018826, "sim_render-ego": 0.06005472750277133, "in-drivable-lane": 0.8000000000000007, "agent_compute-ego": 0.15773930420746674, "deviation-heading": 0.6183161015648596, "set_robot_commands": 0.09144973754882812, "deviation-center-line": 0.05549402521811258, "driven_lanedir_consec": 0.060893961810018826, "sim_compute_sim_state": 0.036435024158374685, "sim_compute_performance-ego": 0.06896498396589949, "sim_compute_robot_state-ego": 0.06950143865636878, "sim_compute_robot_state-npc0": 0.06540289440670528, "sim_compute_robot_state-npc1": 0.06594462652464171, "sim_compute_robot_state-npc2": 0.06822528065861883, "sim_compute_robot_state-npc3": 0.06705717138341956}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.5182735884865612, "sim_physics": 0.16015451333739542, "survival_time": 4.399999999999992, "driven_lanedir": 0.16492648525961995, "sim_render-ego": 0.06261696056886153, "in-drivable-lane": 1.9999999999999971, "agent_compute-ego": 0.15538633953441272, "deviation-heading": 1.854935730405859, "set_robot_commands": 0.09187248078259556, "deviation-center-line": 0.0962351578926134, "driven_lanedir_consec": 0.16492648525961995, "sim_compute_sim_state": 0.03823161937973716, "sim_compute_performance-ego": 0.06774818626317111, "sim_compute_robot_state-ego": 0.07197147878733548, "sim_compute_robot_state-npc0": 0.06710418516939337, "sim_compute_robot_state-npc1": 0.06846741925586354, "sim_compute_robot_state-npc2": 0.06601326844908974, "sim_compute_robot_state-npc3": 0.0649129558693279}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.11434936553255484, "sim_physics": 0.16921517252922058, "survival_time": 1.2000000000000004, "driven_lanedir": 0.07551485562861782, "sim_render-ego": 0.0635385513305664, "in-drivable-lane": 0, "agent_compute-ego": 0.15803448359171549, "deviation-heading": 0.6356811413845974, "set_robot_commands": 0.09147721529006958, "deviation-center-line": 0.10260554899178596, "driven_lanedir_consec": 0.07551485562861782, "sim_compute_sim_state": 0.038631935914357506, "sim_compute_performance-ego": 0.06741986672083537, "sim_compute_robot_state-ego": 0.07049128413200378, "sim_compute_robot_state-npc0": 0.06994844476381938, "sim_compute_robot_state-npc1": 0.060924917459487915, "sim_compute_robot_state-npc2": 0.06348322828610738, "sim_compute_robot_state-npc3": 0.06721251209576924}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.13053227120634986, "sim_physics": 0.17430565907404974, "survival_time": 1.3000000000000005, "driven_lanedir": 0.08750298597938899, "sim_render-ego": 0.054193927691533014, "in-drivable-lane": 0.10000000000000007, "agent_compute-ego": 0.14487847915062538, "deviation-heading": 0.5751540795888518, "set_robot_commands": 0.08117404350867638, "deviation-center-line": 0.09362617382590456, "driven_lanedir_consec": 0.08750298597938899, "sim_compute_sim_state": 0.03716414708357591, "sim_compute_performance-ego": 0.06306320887345535, "sim_compute_robot_state-ego": 0.06506070723900428, "sim_compute_robot_state-npc0": 0.06549240992619441, "sim_compute_robot_state-npc1": 0.06359499234419602, "sim_compute_robot_state-npc2": 0.060685579593365006, "sim_compute_robot_state-npc3": 0.06601856305049016}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.15661494768192794, "sim_physics": 0.18751576851154195, "survival_time": 1.4500000000000006, "driven_lanedir": 0.05751065867736016, "sim_render-ego": 0.06519345579476192, "in-drivable-lane": 0.4000000000000003, "agent_compute-ego": 0.21044018350798507, "deviation-heading": 0.7355024095111723, "set_robot_commands": 0.10136878901514514, "deviation-center-line": 0.03603645325283269, "driven_lanedir_consec": 0.05751065867736016, "sim_compute_sim_state": 0.04110631449469205, "sim_compute_performance-ego": 0.07505028001193342, "sim_compute_robot_state-ego": 0.07901070035737136, "sim_compute_robot_state-npc0": 0.06968087163464777, "sim_compute_robot_state-npc1": 0.0711324379361909, "sim_compute_robot_state-npc2": 0.07002425193786621, "sim_compute_robot_state-npc3": 0.07170964109486547}}
set_robot_commands_max0.10136878901514514
set_robot_commands_mean0.09146845322906295
set_robot_commands_median0.09147721529006958
set_robot_commands_min0.08117404350867638
sim_compute_performance-ego_max0.07505028001193342
sim_compute_performance-ego_mean0.06844930516705895
sim_compute_performance-ego_median0.06774818626317111
sim_compute_performance-ego_min0.06306320887345535
sim_compute_robot_state-ego_max0.07901070035737136
sim_compute_robot_state-ego_mean0.07120712183441673
sim_compute_robot_state-ego_median0.07049128413200378
sim_compute_robot_state-ego_min0.06506070723900428
sim_compute_robot_state-npc0_max0.06994844476381938
sim_compute_robot_state-npc0_mean0.06752576118015205
sim_compute_robot_state-npc0_median0.06710418516939337
sim_compute_robot_state-npc0_min0.06540289440670528
sim_compute_robot_state-npc1_max0.0711324379361909
sim_compute_robot_state-npc1_mean0.06601287870407602
sim_compute_robot_state-npc1_median0.06594462652464171
sim_compute_robot_state-npc1_min0.060924917459487915
sim_compute_robot_state-npc2_max0.07002425193786621
sim_compute_robot_state-npc2_mean0.06568632178500942
sim_compute_robot_state-npc2_median0.06601326844908974
sim_compute_robot_state-npc2_min0.060685579593365006
sim_compute_robot_state-npc3_max0.07170964109486547
sim_compute_robot_state-npc3_mean0.06738216869877448
sim_compute_robot_state-npc3_median0.06705717138341956
sim_compute_robot_state-npc3_min0.0649129558693279
sim_compute_sim_state_max0.04110631449469205
sim_compute_sim_state_mean0.03831380820614746
sim_compute_sim_state_median0.03823161937973716
sim_compute_sim_state_min0.036435024158374685
sim_physics_max0.18751576851154195
sim_physics_mean0.17273695677799894
sim_physics_median0.17249367043778702
sim_physics_min0.16015451333739542
sim_render-ego_max0.06519345579476192
sim_render-ego_mean0.06111952457769885
sim_render-ego_median0.06261696056886153
sim_render-ego_min0.054193927691533014
simulation-passed1
survival_time_max4.399999999999992
survival_time_mean2.0399999999999987
survival_time_min1.2000000000000004
241543944InderpalBaseline solution using reinforcement learningaido2-LFV-sim-validation-offseasonstep1-simulationsuccessyes12910:05:29Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.08313679214764313
survival_time_median1.1500000000000004
deviation-center-line_median0.05876755694249432
in-drivable-lane_median0


other stats
agent_compute-ego_max0.1322025838105575
agent_compute-ego_mean0.11348315787557256
agent_compute-ego_median0.11086433584039862
agent_compute-ego_min0.09711940629141672
deviation-center-line_max0.0954786649471541
deviation-center-line_mean0.0712095432582611
deviation-center-line_min0.05147641233064459
deviation-heading_max0.822270867916417
deviation-heading_mean0.627217952569668
deviation-heading_median0.6947115697194624
deviation-heading_min0.4579813273097649
driven_any_max0.2192646210647059
driven_any_mean0.1668771647442949
driven_any_median0.1505766847907309
driven_any_min0.13394597652044343
driven_lanedir_consec_max0.12025014518972688
driven_lanedir_consec_mean0.08779264078422662
driven_lanedir_consec_min0.050553337459390946
driven_lanedir_max0.12025014518972688
driven_lanedir_mean0.08779264078422662
driven_lanedir_median0.08313679214764313
driven_lanedir_min0.050553337459390946
in-drivable-lane_max0.6000000000000005
in-drivable-lane_mean0.2400000000000002
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.2192646210647059, "sim_physics": 0.09794654846191406, "survival_time": 1.7500000000000009, "driven_lanedir": 0.08313679214764313, "sim_render-ego": 0.0365788459777832, "in-drivable-lane": 0.6000000000000005, "agent_compute-ego": 0.09711940629141672, "deviation-heading": 0.6947115697194624, "set_robot_commands": 0.0547999586377825, "deviation-center-line": 0.05876755694249432, "driven_lanedir_consec": 0.08313679214764313, "sim_compute_sim_state": 0.022591045924595425, "sim_compute_performance-ego": 0.0385108402797154, "sim_compute_robot_state-ego": 0.040706239427839006, "sim_compute_robot_state-npc0": 0.03998299326215472, "sim_compute_robot_state-npc1": 0.039105074746268134, "sim_compute_robot_state-npc2": 0.03918213163103376, "sim_compute_robot_state-npc3": 0.039157928739275254}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.1915377963714012, "sim_physics": 0.11220358264061712, "survival_time": 1.5500000000000007, "driven_lanedir": 0.050553337459390946, "sim_render-ego": 0.03869945772232548, "in-drivable-lane": 0.6000000000000004, "agent_compute-ego": 0.10825558631650864, "deviation-heading": 0.6972776593519882, "set_robot_commands": 0.05981957527898973, "deviation-center-line": 0.05147641233064459, "driven_lanedir_consec": 0.050553337459390946, "sim_compute_sim_state": 0.024571134198096492, "sim_compute_performance-ego": 0.04232408154395319, "sim_compute_robot_state-ego": 0.04705765170435752, "sim_compute_robot_state-npc0": 0.04559149280671151, "sim_compute_robot_state-npc1": 0.04363249963329685, "sim_compute_robot_state-npc2": 0.04406344506048387, "sim_compute_robot_state-npc3": 0.04362785431646531}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.1390607449741929, "sim_physics": 0.12688942389054733, "survival_time": 1.1000000000000003, "driven_lanedir": 0.10659137206139936, "sim_render-ego": 0.04551098563454368, "in-drivable-lane": 0, "agent_compute-ego": 0.11086433584039862, "deviation-heading": 0.4579813273097649, "set_robot_commands": 0.06134886091405695, "deviation-center-line": 0.0954786649471541, "driven_lanedir_consec": 0.10659137206139936, "sim_compute_sim_state": 0.025090412660078568, "sim_compute_performance-ego": 0.04613850333473899, "sim_compute_robot_state-ego": 0.04889296401630749, "sim_compute_robot_state-npc0": 0.04711407964879816, "sim_compute_robot_state-npc1": 0.04357458244670521, "sim_compute_robot_state-npc2": 0.04197911782698198, "sim_compute_robot_state-npc3": 0.04244598475369541}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.1505766847907309, "sim_physics": 0.141264241674672, "survival_time": 1.1500000000000004, "driven_lanedir": 0.12025014518972688, "sim_render-ego": 0.04531386624211851, "in-drivable-lane": 0, "agent_compute-ego": 0.1189738771189814, "deviation-heading": 0.4638483385507074, "set_robot_commands": 0.0656194894210152, "deviation-center-line": 0.09311933836637463, "driven_lanedir_consec": 0.12025014518972688, "sim_compute_sim_state": 0.0289258334947669, "sim_compute_performance-ego": 0.05029367363971213, "sim_compute_robot_state-ego": 0.053218654964281166, "sim_compute_robot_state-npc0": 0.0503316651219907, "sim_compute_robot_state-npc1": 0.05206584930419922, "sim_compute_robot_state-npc2": 0.04978123955104662, "sim_compute_robot_state-npc3": 0.04938323601432469}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.13394597652044343, "sim_physics": 0.11948242394820505, "survival_time": 1.1500000000000004, "driven_lanedir": 0.07843155706297278, "sim_render-ego": 0.04875115726305091, "in-drivable-lane": 0, "agent_compute-ego": 0.1322025838105575, "deviation-heading": 0.822270867916417, "set_robot_commands": 0.07180532165195631, "deviation-center-line": 0.057205743704637824, "driven_lanedir_consec": 0.07843155706297278, "sim_compute_sim_state": 0.029245127802309784, "sim_compute_performance-ego": 0.05332376645958942, "sim_compute_robot_state-ego": 0.05393238689588464, "sim_compute_robot_state-npc0": 0.05342482483905295, "sim_compute_robot_state-npc1": 0.05180203396341075, "sim_compute_robot_state-npc2": 0.05104405983634617, "sim_compute_robot_state-npc3": 0.05008102499920389}}
set_robot_commands_max0.07180532165195631
set_robot_commands_mean0.06267864118076014
set_robot_commands_median0.06134886091405695
set_robot_commands_min0.0547999586377825
sim_compute_performance-ego_max0.05332376645958942
sim_compute_performance-ego_mean0.046118173051541825
sim_compute_performance-ego_median0.04613850333473899
sim_compute_performance-ego_min0.0385108402797154
sim_compute_robot_state-ego_max0.05393238689588464
sim_compute_robot_state-ego_mean0.048761579401733965
sim_compute_robot_state-ego_median0.04889296401630749
sim_compute_robot_state-ego_min0.040706239427839006
sim_compute_robot_state-npc0_max0.05342482483905295
sim_compute_robot_state-npc0_mean0.0472890111357416
sim_compute_robot_state-npc0_median0.04711407964879816
sim_compute_robot_state-npc0_min0.03998299326215472
sim_compute_robot_state-npc1_max0.05206584930419922
sim_compute_robot_state-npc1_mean0.04603600801877603
sim_compute_robot_state-npc1_median0.04363249963329685
sim_compute_robot_state-npc1_min0.039105074746268134
sim_compute_robot_state-npc2_max0.05104405983634617
sim_compute_robot_state-npc2_mean0.04520999878117848
sim_compute_robot_state-npc2_median0.04406344506048387
sim_compute_robot_state-npc2_min0.03918213163103376
sim_compute_robot_state-npc3_max0.05008102499920389
sim_compute_robot_state-npc3_mean0.044939205764592906
sim_compute_robot_state-npc3_median0.04362785431646531
sim_compute_robot_state-npc3_min0.039157928739275254
sim_compute_sim_state_max0.029245127802309784
sim_compute_sim_state_mean0.026084710815969435
sim_compute_sim_state_median0.025090412660078568
sim_compute_sim_state_min0.022591045924595425
sim_physics_max0.141264241674672
sim_physics_mean0.1195572441231911
sim_physics_median0.11948242394820505
sim_physics_min0.09794654846191406
sim_render-ego_max0.04875115726305091
sim_render-ego_mean0.042970862567964355
sim_render-ego_median0.04531386624211851
sim_render-ego_min0.0365788459777832
simulation-passed1
survival_time_max1.7500000000000009
survival_time_mean1.3400000000000003
survival_time_min1.1000000000000003
241503940kene4192CNN-Adam-More-Data-Less-One-400aido2-LFV-sim-validation-offseasonstep1-simulationerroryes12910:04:12
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "experiment_manager.py", line 135, in main
    physics_dt=config.physics_dt)
  File "experiment_manager.py", line 305, in run_episode
    sim_ci.write_topic_and_expect_zero('set_robot_commands', commands)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 102, in write_topic_and_expect_zero
    nickname=self.nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 283, in read_until_over
    raise RemoteNodeAborted(m)
zuper_nodes.structures.RemoteNodeAborted: External node "simulator" aborted:

error in simulator |Exception while handling a message on topic "set_robot_commands".
                   |
                   || Traceback (most recent call last):
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 274, in loop
                   ||     handle_message_node(parsed, receiver0, context0)
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 428, in handle_message_node
                   ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/utils.py", line 18, in call_if_fun_exists
                   ||     f(**kwargs)
                   ||   File "gym_bridge.py", line 301, in on_received_set_robot_commands
                   ||     raise Exception(msg)
                   || Exception: Received invalid PWM commands. They should be between -1 and +1. Received left = {l}, right = {r}.
                   ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
    yield cie
  File "experiment_manager.py", line 441, in <module>
    wrap(cie)
  File "experiment_manager.py", line 429, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 186, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

 > Traceback (most recent call last):
 >   File "experiment_manager.py", line 135, in main
 >     physics_dt=config.physics_dt)
 >   File "experiment_manager.py", line 305, in run_episode
 >     sim_ci.write_topic_and_expect_zero('set_robot_commands', commands)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 102, in write_topic_and_expect_zero
 >     nickname=self.nickname)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
 >     others = read_until_over(fpout, timeout=timeout, nickname=nickname)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 283, in read_until_over
 >     raise RemoteNodeAborted(m)
 > zuper_nodes.structures.RemoteNodeAborted: External node "simulator" aborted:
 > 
 > error in simulator |Exception while handling a message on topic "set_robot_commands".
 >                    |
 >                    || Traceback (most recent call last):
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 274, in loop
 >                    ||     handle_message_node(parsed, receiver0, context0)
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 428, in handle_message_node
 >                    ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/utils.py", line 18, in call_if_fun_exists
 >                    ||     f(**kwargs)
 >                    ||   File "gym_bridge.py", line 301, in on_received_set_robot_commands
 >                    ||     raise Exception(msg)
 >                    || Exception: Received invalid PWM commands. They should be between -1 and +1. Received left = {l}, right = {r}.
 >                    ||
 > 
Hidden. If you are the author, please login using the top-right link or use the dashboard.
241433936kene4192CNN-Adam-More-Data-Less-One-300aido2-LFVI-sim-testing-offseasonstep1-simulationerroryes12910:37:53
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
Hidden. If you are the author, please login using the top-right link or use the dashboard.
241413928gadeseaido_LF-tensorflow_modifaido2-LF-sim-validation-offseasonstep1-simulationsuccessyes12910:14:04Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0
survival_time_median14.950000000000076
deviation-center-line_median0.8791250519425075
in-drivable-lane_median0


other stats
agent_compute-ego_max0.07758502960205078
agent_compute-ego_mean0.07594386688868204
agent_compute-ego_median0.07615749994913737
agent_compute-ego_min0.07480955441792805
deviation-center-line_max1.1518259299248657
deviation-center-line_mean0.7501216125180884
deviation-center-line_min0.25213161298160436
deviation-heading_max4.612311799738734
deviation-heading_mean2.597716698919712
deviation-heading_median2.4213367613149206
deviation-heading_min1.055344347110816
driven_any_max1.328474932138796e-13
driven_any_mean2.656949864277592e-14
driven_any_median0
driven_any_min0
driven_lanedir_consec_max0
driven_lanedir_consec_mean0
driven_lanedir_consec_min0
driven_lanedir_max0
driven_lanedir_mean0
driven_lanedir_median0
driven_lanedir_min0
in-drivable-lane_max0
in-drivable-lane_mean0
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.328474932138796e-13, "sim_physics": 0.054884865283966064, "survival_time": 14.950000000000076, "driven_lanedir": 0, "sim_render-ego": 0.036498675346374514, "in-drivable-lane": 0, "agent_compute-ego": 0.07492612361907959, "deviation-heading": 1.3094334271540409, "set_robot_commands": 0.054569859504699704, "deviation-center-line": 1.1518259299248657, "driven_lanedir_consec": 0, "sim_compute_sim_state": 0.02300134261449178, "sim_compute_performance-ego": 0.03879517237345378, "sim_compute_robot_state-ego": 0.04059458573659261}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0, "sim_physics": 0.05530176957448323, "survival_time": 14.950000000000076, "driven_lanedir": 0, "sim_render-ego": 0.035991378625233966, "in-drivable-lane": 0, "agent_compute-ego": 0.07615749994913737, "deviation-heading": 2.4213367613149206, "set_robot_commands": 0.053935476144154865, "deviation-center-line": 0.25213161298160436, "driven_lanedir_consec": 0, "sim_compute_sim_state": 0.02387633005777995, "sim_compute_performance-ego": 0.03908871094385783, "sim_compute_robot_state-ego": 0.04032535711924235}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0, "sim_physics": 0.054826050599416094, "survival_time": 14.950000000000076, "driven_lanedir": 0, "sim_render-ego": 0.035448341369628905, "in-drivable-lane": 0, "agent_compute-ego": 0.07480955441792805, "deviation-heading": 3.590157159280048, "set_robot_commands": 0.0554386830329895, "deviation-center-line": 0.8791250519425075, "driven_lanedir_consec": 0, "sim_compute_sim_state": 0.02298421541849772, "sim_compute_performance-ego": 0.03877959648768107, "sim_compute_robot_state-ego": 0.04022638479868571}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0, "sim_physics": 0.057835851510365806, "survival_time": 14.950000000000076, "driven_lanedir": 0, "sim_render-ego": 0.03584970633188884, "in-drivable-lane": 0, "agent_compute-ego": 0.07624112685521443, "deviation-heading": 4.612311799738734, "set_robot_commands": 0.054311936696370446, "deviation-center-line": 0.9357839616685772, "driven_lanedir_consec": 0, "sim_compute_sim_state": 0.022914016246795656, "sim_compute_performance-ego": 0.03859936396280925, "sim_compute_robot_state-ego": 0.04024292627970378}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0, "sim_physics": 0.05806056976318359, "survival_time": 14.950000000000076, "driven_lanedir": 0, "sim_render-ego": 0.03616939465204875, "in-drivable-lane": 0, "agent_compute-ego": 0.07758502960205078, "deviation-heading": 1.055344347110816, "set_robot_commands": 0.055087499618530274, "deviation-center-line": 0.5317415060728867, "driven_lanedir_consec": 0, "sim_compute_sim_state": 0.02302017688751221, "sim_compute_performance-ego": 0.03873713175455729, "sim_compute_robot_state-ego": 0.04032743295033773}}
set_robot_commands_max0.0554386830329895
set_robot_commands_mean0.05466869099934896
set_robot_commands_median0.054569859504699704
set_robot_commands_min0.053935476144154865
sim_compute_performance-ego_max0.03908871094385783
sim_compute_performance-ego_mean0.03879999510447184
sim_compute_performance-ego_median0.03877959648768107
sim_compute_performance-ego_min0.03859936396280925
sim_compute_robot_state-ego_max0.04059458573659261
sim_compute_robot_state-ego_mean0.04034333737691243
sim_compute_robot_state-ego_median0.04032535711924235
sim_compute_robot_state-ego_min0.04022638479868571
sim_compute_sim_state_max0.02387633005777995
sim_compute_sim_state_mean0.023159216245015463
sim_compute_sim_state_median0.02300134261449178
sim_compute_sim_state_min0.022914016246795656
sim_physics_max0.05806056976318359
sim_physics_mean0.056181821346282954
sim_physics_median0.05530176957448323
sim_physics_min0.054826050599416094
sim_render-ego_max0.036498675346374514
sim_render-ego_mean0.03599149926503499
sim_render-ego_median0.035991378625233966
sim_render-ego_min0.035448341369628905
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean14.950000000000076
survival_time_min14.950000000000076
241363919ekunniiBaseline solution using reinforcement learningaido2-LF-sim-validation-offseasonstep1-simulationerroryes12910:00:47
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
Hidden. If you are the author, please login using the top-right link or use the dashboard.
241353925ekunniiBaseline solution using reinforcement learningaido2-LFVI-sim-validation-offseasonstep1-simulationerroryes12910:02:04
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
Hidden. If you are the author, please login using the top-right link or use the dashboard.
241313916gadeseaido_LF-tensorflow_modifaido2-LF-sim-testing-offseasonstep1-simulationerroryes12910:00:46
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "experiment_manager.py", line 135, in main
    physics_dt=config.physics_dt)
  File "experiment_manager.py", line 305, in run_episode
    sim_ci.write_topic_and_expect_zero('set_robot_commands', commands)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 102, in write_topic_and_expect_zero
    nickname=self.nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 283, in read_until_over
    raise RemoteNodeAborted(m)
zuper_nodes.structures.RemoteNodeAborted: External node "simulator" aborted:

error in simulator |Exception while handling a message on topic "set_robot_commands".
                   |
                   || Traceback (most recent call last):
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 274, in loop
                   ||     handle_message_node(parsed, receiver0, context0)
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 428, in handle_message_node
                   ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/utils.py", line 18, in call_if_fun_exists
                   ||     f(**kwargs)
                   ||   File "gym_bridge.py", line 301, in on_received_set_robot_commands
                   ||     raise Exception(msg)
                   || Exception: Received invalid PWM commands. They should be between -1 and +1. Received left = {l}, right = {r}.
                   ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
    yield cie
  File "experiment_manager.py", line 441, in <module>
    wrap(cie)
  File "experiment_manager.py", line 429, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 186, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

 > Traceback (most recent call last):
 >   File "experiment_manager.py", line 135, in main
 >     physics_dt=config.physics_dt)
 >   File "experiment_manager.py", line 305, in run_episode
 >     sim_ci.write_topic_and_expect_zero('set_robot_commands', commands)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 102, in write_topic_and_expect_zero
 >     nickname=self.nickname)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
 >     others = read_until_over(fpout, timeout=timeout, nickname=nickname)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 283, in read_until_over
 >     raise RemoteNodeAborted(m)
 > zuper_nodes.structures.RemoteNodeAborted: External node "simulator" aborted:
 > 
 > error in simulator |Exception while handling a message on topic "set_robot_commands".
 >                    |
 >                    || Traceback (most recent call last):
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 274, in loop
 >                    ||     handle_message_node(parsed, receiver0, context0)
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 428, in handle_message_node
 >                    ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/utils.py", line 18, in call_if_fun_exists
 >                    ||     f(**kwargs)
 >                    ||   File "gym_bridge.py", line 301, in on_received_set_robot_commands
 >                    ||     raise Exception(msg)
 >                    || Exception: Received invalid PWM commands. They should be between -1 and +1. Received left = {l}, right = {r}.
 >                    ||
 > 
Hidden. If you are the author, please login using the top-right link or use the dashboard.
241303915gadeseaido_LF-tensorflow_modifaido2-LF-sim-testing-offseasonstep1-simulationerroryes12910:00:47
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "experiment_manager.py", line 135, in main
    physics_dt=config.physics_dt)
  File "experiment_manager.py", line 305, in run_episode
    sim_ci.write_topic_and_expect_zero('set_robot_commands', commands)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 102, in write_topic_and_expect_zero
    nickname=self.nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 283, in read_until_over
    raise RemoteNodeAborted(m)
zuper_nodes.structures.RemoteNodeAborted: External node "simulator" aborted:

error in simulator |Exception while handling a message on topic "set_robot_commands".
                   |
                   || Traceback (most recent call last):
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 274, in loop
                   ||     handle_message_node(parsed, receiver0, context0)
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 428, in handle_message_node
                   ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/utils.py", line 18, in call_if_fun_exists
                   ||     f(**kwargs)
                   ||   File "gym_bridge.py", line 301, in on_received_set_robot_commands
                   ||     raise Exception(msg)
                   || Exception: Received invalid PWM commands. They should be between -1 and +1. Received left = {l}, right = {r}.
                   ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
    yield cie
  File "experiment_manager.py", line 441, in <module>
    wrap(cie)
  File "experiment_manager.py", line 429, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 186, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

 > Traceback (most recent call last):
 >   File "experiment_manager.py", line 135, in main
 >     physics_dt=config.physics_dt)
 >   File "experiment_manager.py", line 305, in run_episode
 >     sim_ci.write_topic_and_expect_zero('set_robot_commands', commands)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 102, in write_topic_and_expect_zero
 >     nickname=self.nickname)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
 >     others = read_until_over(fpout, timeout=timeout, nickname=nickname)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 283, in read_until_over
 >     raise RemoteNodeAborted(m)
 > zuper_nodes.structures.RemoteNodeAborted: External node "simulator" aborted:
 > 
 > error in simulator |Exception while handling a message on topic "set_robot_commands".
 >                    |
 >                    || Traceback (most recent call last):
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 274, in loop
 >                    ||     handle_message_node(parsed, receiver0, context0)
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 428, in handle_message_node
 >                    ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/utils.py", line 18, in call_if_fun_exists
 >                    ||     f(**kwargs)
 >                    ||   File "gym_bridge.py", line 301, in on_received_set_robot_commands
 >                    ||     raise Exception(msg)
 >                    || Exception: Received invalid PWM commands. They should be between -1 and +1. Received left = {l}, right = {r}.
 >                    ||
 > 
Hidden. If you are the author, please login using the top-right link or use the dashboard.
241273912gadesechallenge-aido_LF-template-tensorflowaido2-LF-sim-testing-offseasonstep1-simulationerroryes12910:02:16
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "experiment_manager.py", line 135, in main
    physics_dt=config.physics_dt)
  File "experiment_manager.py", line 305, in run_episode
    sim_ci.write_topic_and_expect_zero('set_robot_commands', commands)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 102, in write_topic_and_expect_zero
    nickname=self.nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 283, in read_until_over
    raise RemoteNodeAborted(m)
zuper_nodes.structures.RemoteNodeAborted: External node "simulator" aborted:

error in simulator |Exception while handling a message on topic "set_robot_commands".
                   |
                   || Traceback (most recent call last):
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 274, in loop
                   ||     handle_message_node(parsed, receiver0, context0)
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 428, in handle_message_node
                   ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/utils.py", line 18, in call_if_fun_exists
                   ||     f(**kwargs)
                   ||   File "gym_bridge.py", line 301, in on_received_set_robot_commands
                   ||     raise Exception(msg)
                   || Exception: Received invalid PWM commands. They should be between -1 and +1. Received left = {l}, right = {r}.
                   ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
    yield cie
  File "experiment_manager.py", line 441, in <module>
    wrap(cie)
  File "experiment_manager.py", line 429, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 186, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

 > Traceback (most recent call last):
 >   File "experiment_manager.py", line 135, in main
 >     physics_dt=config.physics_dt)
 >   File "experiment_manager.py", line 305, in run_episode
 >     sim_ci.write_topic_and_expect_zero('set_robot_commands', commands)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 102, in write_topic_and_expect_zero
 >     nickname=self.nickname)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
 >     others = read_until_over(fpout, timeout=timeout, nickname=nickname)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 283, in read_until_over
 >     raise RemoteNodeAborted(m)
 > zuper_nodes.structures.RemoteNodeAborted: External node "simulator" aborted:
 > 
 > error in simulator |Exception while handling a message on topic "set_robot_commands".
 >                    |
 >                    || Traceback (most recent call last):
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 274, in loop
 >                    ||     handle_message_node(parsed, receiver0, context0)
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 428, in handle_message_node
 >                    ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/utils.py", line 18, in call_if_fun_exists
 >                    ||     f(**kwargs)
 >                    ||   File "gym_bridge.py", line 301, in on_received_set_robot_commands
 >                    ||     raise Exception(msg)
 >                    || Exception: Received invalid PWM commands. They should be between -1 and +1. Received left = {l}, right = {r}.
 >                    ||
 > 
Hidden. If you are the author, please login using the top-right link or use the dashboard.
241063901gadesechallenge-aido_LF-template-tensorflowaido2-LF-sim-validation-offseasonstep1-simulationerroryes12910:01:10
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "experiment_manager.py", line 135, in main
    physics_dt=config.physics_dt)
  File "experiment_manager.py", line 305, in run_episode
    sim_ci.write_topic_and_expect_zero('set_robot_commands', commands)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 102, in write_topic_and_expect_zero
    nickname=self.nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 283, in read_until_over
    raise RemoteNodeAborted(m)
zuper_nodes.structures.RemoteNodeAborted: External node "simulator" aborted:

error in simulator |Exception while handling a message on topic "set_robot_commands".
                   |
                   || Traceback (most recent call last):
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 274, in loop
                   ||     handle_message_node(parsed, receiver0, context0)
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 428, in handle_message_node
                   ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/utils.py", line 18, in call_if_fun_exists
                   ||     f(**kwargs)
                   ||   File "gym_bridge.py", line 301, in on_received_set_robot_commands
                   ||     raise Exception(msg)
                   || Exception: Received invalid PWM commands. They should be between -1 and +1. Received left = {l}, right = {r}.
                   ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
    yield cie
  File "experiment_manager.py", line 441, in <module>
    wrap(cie)
  File "experiment_manager.py", line 429, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 186, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

 > Traceback (most recent call last):
 >   File "experiment_manager.py", line 135, in main
 >     physics_dt=config.physics_dt)
 >   File "experiment_manager.py", line 305, in run_episode
 >     sim_ci.write_topic_and_expect_zero('set_robot_commands', commands)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 102, in write_topic_and_expect_zero
 >     nickname=self.nickname)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
 >     others = read_until_over(fpout, timeout=timeout, nickname=nickname)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 283, in read_until_over
 >     raise RemoteNodeAborted(m)
 > zuper_nodes.structures.RemoteNodeAborted: External node "simulator" aborted:
 > 
 > error in simulator |Exception while handling a message on topic "set_robot_commands".
 >                    |
 >                    || Traceback (most recent call last):
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 274, in loop
 >                    ||     handle_message_node(parsed, receiver0, context0)
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 428, in handle_message_node
 >                    ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/utils.py", line 18, in call_if_fun_exists
 >                    ||     f(**kwargs)
 >                    ||   File "gym_bridge.py", line 301, in on_received_set_robot_commands
 >                    ||     raise Exception(msg)
 >                    || Exception: Received invalid PWM commands. They should be between -1 and +1. Received left = {l}, right = {r}.
 >                    ||
 > 
Hidden. If you are the author, please login using the top-right link or use the dashboard.
241023904gadesechallenge-aido_LF-template-tensorflowaido2-LFV-sim-validation-offseasonstep1-simulationerroryes12910:03:08
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "experiment_manager.py", line 135, in main
    physics_dt=config.physics_dt)
  File "experiment_manager.py", line 305, in run_episode
    sim_ci.write_topic_and_expect_zero('set_robot_commands', commands)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 102, in write_topic_and_expect_zero
    nickname=self.nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 283, in read_until_over
    raise RemoteNodeAborted(m)
zuper_nodes.structures.RemoteNodeAborted: External node "simulator" aborted:

error in simulator |Exception while handling a message on topic "set_robot_commands".
                   |
                   || Traceback (most recent call last):
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 274, in loop
                   ||     handle_message_node(parsed, receiver0, context0)
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 428, in handle_message_node
                   ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/utils.py", line 18, in call_if_fun_exists
                   ||     f(**kwargs)
                   ||   File "gym_bridge.py", line 301, in on_received_set_robot_commands
                   ||     raise Exception(msg)
                   || Exception: Received invalid PWM commands. They should be between -1 and +1. Received left = {l}, right = {r}.
                   ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
    yield cie
  File "experiment_manager.py", line 441, in <module>
    wrap(cie)
  File "experiment_manager.py", line 429, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 186, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

 > Traceback (most recent call last):
 >   File "experiment_manager.py", line 135, in main
 >     physics_dt=config.physics_dt)
 >   File "experiment_manager.py", line 305, in run_episode
 >     sim_ci.write_topic_and_expect_zero('set_robot_commands', commands)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 102, in write_topic_and_expect_zero
 >     nickname=self.nickname)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
 >     others = read_until_over(fpout, timeout=timeout, nickname=nickname)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 283, in read_until_over
 >     raise RemoteNodeAborted(m)
 > zuper_nodes.structures.RemoteNodeAborted: External node "simulator" aborted:
 > 
 > error in simulator |Exception while handling a message on topic "set_robot_commands".
 >                    |
 >                    || Traceback (most recent call last):
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 274, in loop
 >                    ||     handle_message_node(parsed, receiver0, context0)
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 428, in handle_message_node
 >                    ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/utils.py", line 18, in call_if_fun_exists
 >                    ||     f(**kwargs)
 >                    ||   File "gym_bridge.py", line 301, in on_received_set_robot_commands
 >                    ||     raise Exception(msg)
 >                    || Exception: Received invalid PWM commands. They should be between -1 and +1. Received left = {l}, right = {r}.
 >                    ||
 > 
Hidden. If you are the author, please login using the top-right link or use the dashboard.
240963894chuyjChuyj Submissionaido2-LF-sim-validation-offseasonstep1-simulationfailedyes12910:00:44
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "experiment_manager.py", line 296, in run_episode
    agent.write_topic_and_expect_zero('observations', recv.data.observations)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 102, in write_topic_and_expect_zero
    nickname=self.nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 283, in read_until_over
    raise RemoteNodeAborted(m)
zuper_nodes.structures.RemoteNodeAborted: External node "agent" aborted:

error in agent |Exception while handling a message on topic "observations".
               |
               || Traceback (most recent call last):
               ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 274, in loop
               ||     handle_message_node(parsed, receiver0, context0)
               ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 428, in handle_message_node
               ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
               ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/utils.py", line 18, in call_if_fun_exists
               ||     f(**kwargs)
               ||   File "solution.py", line 38, in on_received_observations
               ||     print(f"on_received_obs:{Duckiebot1Observations.shape}")
               || AttributeError: type object 'Duckiebot1Observations' has no attribute 'shape'
               ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
    yield cie
  File "experiment_manager.py", line 441, in <module>
    wrap(cie)
  File "experiment_manager.py", line 429, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 135, in main
    physics_dt=config.physics_dt)
  File "experiment_manager.py", line 301, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.
Hidden. If you are the author, please login using the top-right link or use the dashboard.
240913889kene4192ResNet-Dropout-GDSaido2-LFV-sim-validation-offseasonstep1-simulationsuccessyes12910:10:20Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.45666589362836785
survival_time_median5.449999999999989
deviation-center-line_median0.25332645511657703
in-drivable-lane_median1.7499999999999938


other stats
agent_compute-ego_max0.10970165068844714
agent_compute-ego_mean0.10797798669116215
agent_compute-ego_median0.10751995252906728
agent_compute-ego_min0.10630135938345668
deviation-center-line_max0.4425928614168368
deviation-center-line_mean0.2608568329442013
deviation-center-line_min0.13996123501341126
deviation-heading_max2.4759093115044557
deviation-heading_mean1.3592444529938548
deviation-heading_median1.0383502495387735
deviation-heading_min0.8804169749426534
driven_any_max1.0912724466754036
driven_any_mean0.8134022489246592
driven_any_median0.7715990675788054
driven_any_min0.5869546514040958
driven_lanedir_consec_max0.686747113215187
driven_lanedir_consec_mean0.4646650979244666
driven_lanedir_consec_min0.27134103181085756
driven_lanedir_max0.6897013567087782
driven_lanedir_mean0.46584152187477573
driven_lanedir_median0.45666589362836785
driven_lanedir_min0.27134103181085756
in-drivable-lane_max2.3499999999999917
in-drivable-lane_mean1.8299999999999936
in-drivable-lane_min1.3499999999999952
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0912724466754036, "sim_physics": 0.08685293855338261, "survival_time": 7.249999999999982, "driven_lanedir": 0.6370399227084125, "sim_render-ego": 0.03625481046479324, "in-drivable-lane": 2.3499999999999917, "agent_compute-ego": 0.1068322494112212, "deviation-heading": 1.3970386661756726, "set_robot_commands": 0.05478235935342723, "deviation-center-line": 0.3227088214526142, "driven_lanedir_consec": 0.6341120464504577, "sim_compute_sim_state": 0.023101074942227063, "sim_compute_performance-ego": 0.038954968288027005, "sim_compute_robot_state-ego": 0.041509669402550006, "sim_compute_robot_state-npc0": 0.040779094038338494, "sim_compute_robot_state-npc1": 0.040366661137547985, "sim_compute_robot_state-npc2": 0.04013377222521552, "sim_compute_robot_state-npc3": 0.04015175885167615}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.7715990675788054, "sim_physics": 0.09906378142330624, "survival_time": 5.449999999999989, "driven_lanedir": 0.45666589362836785, "sim_render-ego": 0.036337299084444656, "in-drivable-lane": 1.949999999999993, "agent_compute-ego": 0.10751995252906728, "deviation-heading": 0.8804169749426534, "set_robot_commands": 0.056602659575436094, "deviation-center-line": 0.25332645511657703, "driven_lanedir_consec": 0.45666589362836785, "sim_compute_sim_state": 0.023046224489124544, "sim_compute_performance-ego": 0.03904854923213294, "sim_compute_robot_state-ego": 0.04160633218397788, "sim_compute_robot_state-npc0": 0.041497832044548946, "sim_compute_robot_state-npc1": 0.04037978452280027, "sim_compute_robot_state-npc2": 0.04032363804108506, "sim_compute_robot_state-npc3": 0.04037997700752468}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.5870196211677848, "sim_physics": 0.084742609276829, "survival_time": 4.149999999999993, "driven_lanedir": 0.27134103181085756, "sim_render-ego": 0.03555839320263231, "in-drivable-lane": 1.7499999999999938, "agent_compute-ego": 0.10630135938345668, "deviation-heading": 1.0383502495387735, "set_robot_commands": 0.053939555064741386, "deviation-center-line": 0.14569479172156735, "driven_lanedir_consec": 0.27134103181085756, "sim_compute_sim_state": 0.023113948753081173, "sim_compute_performance-ego": 0.03875514685389507, "sim_compute_robot_state-ego": 0.04140622931790639, "sim_compute_robot_state-npc0": 0.040646981043987965, "sim_compute_robot_state-npc1": 0.040715415793729115, "sim_compute_robot_state-npc2": 0.03999407607388784, "sim_compute_robot_state-npc3": 0.04013380372380636}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.5869546514040958, "sim_physics": 0.08696071498365288, "survival_time": 4.149999999999993, "driven_lanedir": 0.2744594045174624, "sim_render-ego": 0.03662548294986587, "in-drivable-lane": 1.7499999999999938, "agent_compute-ego": 0.10970165068844714, "deviation-heading": 1.0045070628077175, "set_robot_commands": 0.05427464232387313, "deviation-center-line": 0.13996123501341126, "driven_lanedir_consec": 0.2744594045174624, "sim_compute_sim_state": 0.02354213128606957, "sim_compute_performance-ego": 0.03947412249553634, "sim_compute_robot_state-ego": 0.04214339371187141, "sim_compute_robot_state-npc0": 0.0413097559687603, "sim_compute_robot_state-npc1": 0.041119397404682206, "sim_compute_robot_state-npc2": 0.04079440990126276, "sim_compute_robot_state-npc3": 0.04087833324110651}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.0301654577972064, "sim_physics": 0.08793604719466057, "survival_time": 6.8999999999999835, "driven_lanedir": 0.6897013567087782, "sim_render-ego": 0.03670671884564386, "in-drivable-lane": 1.3499999999999952, "agent_compute-ego": 0.10953472144361856, "deviation-heading": 2.4759093115044557, "set_robot_commands": 0.05552416953487672, "deviation-center-line": 0.4425928614168368, "driven_lanedir_consec": 0.686747113215187, "sim_compute_sim_state": 0.02330841707146686, "sim_compute_performance-ego": 0.039201212965923805, "sim_compute_robot_state-ego": 0.041675386221512505, "sim_compute_robot_state-npc0": 0.041089653968811035, "sim_compute_robot_state-npc1": 0.04058444327202397, "sim_compute_robot_state-npc2": 0.04051257389179175, "sim_compute_robot_state-npc3": 0.040469242178875466}}
set_robot_commands_max0.056602659575436094
set_robot_commands_mean0.05502467717047091
set_robot_commands_median0.05478235935342723
set_robot_commands_min0.053939555064741386
sim_compute_performance-ego_max0.03947412249553634
sim_compute_performance-ego_mean0.03908679996710303
sim_compute_performance-ego_median0.03904854923213294
sim_compute_performance-ego_min0.03875514685389507
sim_compute_robot_state-ego_max0.04214339371187141
sim_compute_robot_state-ego_mean0.04166820216756364
sim_compute_robot_state-ego_median0.04160633218397788
sim_compute_robot_state-ego_min0.04140622931790639
sim_compute_robot_state-npc0_max0.041497832044548946
sim_compute_robot_state-npc0_mean0.04106466341288935
sim_compute_robot_state-npc0_median0.041089653968811035
sim_compute_robot_state-npc0_min0.040646981043987965
sim_compute_robot_state-npc1_max0.041119397404682206
sim_compute_robot_state-npc1_mean0.040633140426156705
sim_compute_robot_state-npc1_median0.04058444327202397
sim_compute_robot_state-npc1_min0.040366661137547985
sim_compute_robot_state-npc2_max0.04079440990126276
sim_compute_robot_state-npc2_mean0.04035169402664858
sim_compute_robot_state-npc2_median0.04032363804108506
sim_compute_robot_state-npc2_min0.03999407607388784
sim_compute_robot_state-npc3_max0.04087833324110651
sim_compute_robot_state-npc3_mean0.04040262300059783
sim_compute_robot_state-npc3_median0.04037997700752468
sim_compute_robot_state-npc3_min0.04013380372380636
sim_compute_sim_state_max0.02354213128606957
sim_compute_sim_state_mean0.023222359308393843
sim_compute_sim_state_median0.023113948753081173
sim_compute_sim_state_min0.023046224489124544
sim_physics_max0.09906378142330624
sim_physics_mean0.08911121828636627
sim_physics_median0.08696071498365288
sim_physics_min0.084742609276829
sim_render-ego_max0.03670671884564386
sim_render-ego_mean0.03629654090947598
sim_render-ego_median0.036337299084444656
sim_render-ego_min0.03555839320263231
simulation-passed1
survival_time_max7.249999999999982
survival_time_mean5.5799999999999885
survival_time_min4.149999999999993
240903881chuyjBaseline solution using reinforcement learningaido2-LF-sim-testing-offseasonstep1-simulationsuccessyes12910:08:28Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.09300630371175034
survival_time_median1.3500000000000003
deviation-center-line_median0.07026189516599242
in-drivable-lane_median0


other stats
agent_compute-ego_max0.14801534016927084
agent_compute-ego_mean0.1253962636023895
agent_compute-ego_median0.12913731166294642
agent_compute-ego_min0.10698240995407104
deviation-center-line_max0.10994671013441548
deviation-center-line_mean0.07308725720183315
deviation-center-line_min0.036299447868137776
deviation-heading_max0.8879303311639637
deviation-heading_mean0.7031357916312373
deviation-heading_median0.7370462562658814
deviation-heading_min0.44449776512206174
driven_any_max0.2469379752413027
driven_any_mean0.16418076521060082
driven_any_median0.16197115773273257
driven_any_min0.10289015653777456
driven_lanedir_consec_max0.13014387086739854
driven_lanedir_consec_mean0.09023606361011167
driven_lanedir_consec_min0.06403097401086644
driven_lanedir_max0.13014387086739854
driven_lanedir_mean0.09023606361011167
driven_lanedir_median0.09300630371175034
driven_lanedir_min0.06403097401086644
in-drivable-lane_max0.6000000000000005
in-drivable-lane_mean0.2033333333333335
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.2469379752413027, "sim_physics": 0.086747828282808, "survival_time": 1.900000000000001, "driven_lanedir": 0.11354785188431515, "sim_render-ego": 0.046632547127573115, "in-drivable-lane": 0.5500000000000005, "agent_compute-ego": 0.13183859774940893, "deviation-heading": 0.7856156369263251, "set_robot_commands": 0.07214874970285516, "deviation-center-line": 0.07026189516599242, "driven_lanedir_consec": 0.11354785188431515, "sim_compute_sim_state": 0.029638911548413728, "sim_compute_performance-ego": 0.04857612283606278, "sim_compute_robot_state-ego": 0.05137309902592709}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.19572712360742137, "sim_physics": 0.07790074926434142, "survival_time": 1.6500000000000008, "driven_lanedir": 0.10740086241935388, "sim_render-ego": 0.0467098770719586, "in-drivable-lane": 0.30000000000000027, "agent_compute-ego": 0.12172386863014915, "deviation-heading": 0.7370462562658814, "set_robot_commands": 0.07589691335504706, "deviation-center-line": 0.045483793290576384, "driven_lanedir_consec": 0.10740086241935388, "sim_compute_sim_state": 0.029599348704020183, "sim_compute_performance-ego": 0.05294145959796327, "sim_compute_robot_state-ego": 0.05197790174773245}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.10584939081680976, "sim_physics": 0.07113023996353149, "survival_time": 1.0000000000000002, "driven_lanedir": 0.06829141196592747, "sim_render-ego": 0.03653477430343628, "in-drivable-lane": 0, "agent_compute-ego": 0.10811865329742432, "deviation-heading": 0.6178428375857117, "set_robot_commands": 0.06227314472198486, "deviation-center-line": 0.09007528077482532, "driven_lanedir_consec": 0.06829141196592747, "sim_compute_sim_state": 0.02512909173965454, "sim_compute_performance-ego": 0.04211246967315674, "sim_compute_robot_state-ego": 0.04441527128219605}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.19981989687228763, "sim_physics": 0.08635971695184708, "survival_time": 1.6000000000000008, "driven_lanedir": 0.07162783241331594, "sim_render-ego": 0.039785005152225494, "in-drivable-lane": 0.4500000000000004, "agent_compute-ego": 0.10698240995407104, "deviation-heading": 0.8879303311639637, "set_robot_commands": 0.059373125433921814, "deviation-center-line": 0.056089002240840825, "driven_lanedir_consec": 0.07162783241331594, "sim_compute_sim_state": 0.02523992210626602, "sim_compute_performance-ego": 0.04368913173675537, "sim_compute_robot_state-ego": 0.0512683242559433}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.1882671163422387, "sim_physics": 0.09761250681347317, "survival_time": 1.800000000000001, "driven_lanedir": 0.0710868958526154, "sim_render-ego": 0.05024376180436877, "in-drivable-lane": 0.6000000000000005, "agent_compute-ego": 0.13688632514741686, "deviation-heading": 0.6237244123429082, "set_robot_commands": 0.0745668543709649, "deviation-center-line": 0.036299447868137776, "driven_lanedir_consec": 0.0710868958526154, "sim_compute_sim_state": 0.04544980658425225, "sim_compute_performance-ego": 0.05491766002443102, "sim_compute_robot_state-ego": 0.056443783971998424}, "ETHZ_autolab_technical_track-5-0": {"driven_any": 0.20666279677098, "sim_physics": 0.07772032419840495, "survival_time": 1.6500000000000008, "driven_lanedir": 0.06403097401086644, "sim_render-ego": 0.04247909603696881, "in-drivable-lane": 0.5500000000000005, "agent_compute-ego": 0.1133374734358354, "deviation-heading": 0.8799366941227552, "set_robot_commands": 0.06122269774928237, "deviation-center-line": 0.05992367774039761, "driven_lanedir_consec": 0.06403097401086644, "sim_compute_sim_state": 0.026656663779056435, "sim_compute_performance-ego": 0.044763312195286606, "sim_compute_robot_state-ego": 0.04626092766270493}, "ETHZ_autolab_technical_track-6-0": {"driven_any": 0.14433723356179745, "sim_physics": 0.08459572281156268, "survival_time": 1.4000000000000006, "driven_lanedir": 0.1040498411435844, "sim_render-ego": 0.043480822018214633, "in-drivable-lane": 0, "agent_compute-ego": 0.12913731166294642, "deviation-heading": 0.7314277977076952, "set_robot_commands": 0.06925622054508754, "deviation-center-line": 0.10599987205296645, "driven_lanedir_consec": 0.1040498411435844, "sim_compute_sim_state": 0.02863689831324986, "sim_compute_performance-ego": 0.04932528734207153, "sim_compute_robot_state-ego": 0.05071265356881278}, "ETHZ_autolab_technical_track-7-0": {"driven_any": 0.10289015653777456, "sim_physics": 0.07960901762309827, "survival_time": 0.9500000000000004, "driven_lanedir": 0.0678830990979673, "sim_render-ego": 0.05772904345863744, "in-drivable-lane": 0, "agent_compute-ego": 0.13322172666850843, "deviation-heading": 0.5648891662813488, "set_robot_commands": 0.06689288741663883, "deviation-center-line": 0.0795382497762156, "driven_lanedir_consec": 0.0678830990979673, "sim_compute_sim_state": 0.0344229120957224, "sim_compute_performance-ego": 0.06015332121598093, "sim_compute_robot_state-ego": 0.05611028169330798}, "ETHZ_autolab_technical_track-8-0": {"driven_any": 0.14464565765338278, "sim_physics": 0.08210282855563694, "survival_time": 1.3500000000000003, "driven_lanedir": 0.0758055641320925, "sim_render-ego": 0.05060914710715965, "in-drivable-lane": 0.15000000000000013, "agent_compute-ego": 0.13717630174424914, "deviation-heading": 0.7936379391592215, "set_robot_commands": 0.07092245419820149, "deviation-center-line": 0.0488344749801295, "driven_lanedir_consec": 0.0758055641320925, "sim_compute_sim_state": 0.032085816065470375, "sim_compute_performance-ego": 0.05226207662511755, "sim_compute_robot_state-ego": 0.05526671586213289}, "ETHZ_autolab_technical_track-9-0": {"driven_any": 0.1328319597501586, "sim_physics": 0.09062718351682028, "survival_time": 1.2000000000000004, "driven_lanedir": 0.09366638770493108, "sim_render-ego": 0.0475704570611318, "in-drivable-lane": 0, "agent_compute-ego": 0.14801534016927084, "deviation-heading": 0.626366363066711, "set_robot_commands": 0.07677748799324036, "deviation-center-line": 0.08333870695408575, "driven_lanedir_consec": 0.09366638770493108, "sim_compute_sim_state": 0.030582964420318604, "sim_compute_performance-ego": 0.048565427462259926, "sim_compute_robot_state-ego": 0.05036798119544983}, "ETHZ_autolab_technical_track-10-0": {"driven_any": 0.16197115773273257, "sim_physics": 0.0935445785522461, "survival_time": 1.2500000000000004, "driven_lanedir": 0.13014387086739854, "sim_render-ego": 0.048301477432250974, "in-drivable-lane": 0, "agent_compute-ego": 0.1326344108581543, "deviation-heading": 0.5084743744419903, "set_robot_commands": 0.07192572593688965, "deviation-center-line": 0.10994671013441548, "driven_lanedir_consec": 0.13014387086739854, "sim_compute_sim_state": 0.03314057350158692, "sim_compute_performance-ego": 0.05167938232421875, "sim_compute_robot_state-ego": 0.0529127025604248}, "ETHZ_autolab_technical_track-11-0": {"driven_any": 0.12374095271042829, "sim_physics": 0.08472345272699992, "survival_time": 1.2000000000000004, "driven_lanedir": 0.06771510962277494, "sim_render-ego": 0.0476699968179067, "in-drivable-lane": 0, "agent_compute-ego": 0.11551529169082642, "deviation-heading": 0.8089737931429815, "set_robot_commands": 0.06218854586283366, "deviation-center-line": 0.07620363543986901, "driven_lanedir_consec": 0.06771510962277494, "sim_compute_sim_state": 0.02895253896713257, "sim_compute_performance-ego": 0.05052704612414042, "sim_compute_robot_state-ego": 0.054268101851145424}, "ETHZ_autolab_technical_track-12-0": {"driven_any": 0.2262700823731645, "sim_physics": 0.07529842853546143, "survival_time": 1.800000000000001, "driven_lanedir": 0.10983855690349932, "sim_render-ego": 0.043977591726515025, "in-drivable-lane": 0.4500000000000004, "agent_compute-ego": 0.11579836739434136, "deviation-heading": 0.7654963773468593, "set_robot_commands": 0.060591565238104925, "deviation-center-line": 0.061983761828166874, "driven_lanedir_consec": 0.10983855690349932, "sim_compute_sim_state": 0.028356975979275174, "sim_compute_performance-ego": 0.049280908372667104, "sim_compute_robot_state-ego": 0.05036523607042101}, "ETHZ_autolab_technical_track-13-0": {"driven_any": 0.16596450105613075, "sim_physics": 0.08287342071533203, "survival_time": 1.2500000000000004, "driven_lanedir": 0.11544639242128252, "sim_render-ego": 0.04659250259399414, "in-drivable-lane": 0, "agent_compute-ego": 0.1295858383178711, "deviation-heading": 0.7711771297921475, "set_robot_commands": 0.07684094429016114, "deviation-center-line": 0.06353009651971579, "driven_lanedir_consec": 0.11544639242128252, "sim_compute_sim_state": 0.03306610107421875, "sim_compute_performance-ego": 0.0525583553314209, "sim_compute_robot_state-ego": 0.05170239448547363}, "ETHZ_autolab_technical_track-14-0": {"driven_any": 0.11679547713240308, "sim_physics": 0.08638334274291992, "survival_time": 1.1000000000000003, "driven_lanedir": 0.09300630371175034, "sim_render-ego": 0.04657817970622669, "in-drivable-lane": 0, "agent_compute-ego": 0.12097203731536864, "deviation-heading": 0.44449776512206174, "set_robot_commands": 0.06690068678422408, "deviation-center-line": 0.10880025326116258, "driven_lanedir_consec": 0.09300630371175034, "sim_compute_sim_state": 0.03095875003121116, "sim_compute_performance-ego": 0.05211740190332586, "sim_compute_robot_state-ego": 0.05258902636441318}}
set_robot_commands_max0.07684094429016114
set_robot_commands_mean0.06851853357329586
set_robot_commands_median0.06925622054508754
set_robot_commands_min0.059373125433921814
sim_compute_performance-ego_max0.06015332121598093
sim_compute_performance-ego_mean0.05023129085099058
sim_compute_performance-ego_median0.05052704612414042
sim_compute_performance-ego_min0.04211246967315674
sim_compute_robot_state-ego_max0.056443783971998424
sim_compute_robot_state-ego_mean0.051735626773205576
sim_compute_robot_state-ego_median0.05170239448547363
sim_compute_robot_state-ego_min0.04441527128219605
sim_compute_sim_state_max0.04544980658425225
sim_compute_sim_state_mean0.030794484993989936
sim_compute_sim_state_median0.029638911548413728
sim_compute_sim_state_min0.02512909173965454
sim_physics_max0.09761250681347317
sim_physics_mean0.08381528941696557
sim_physics_median0.08459572281156268
sim_physics_min0.07113023996353149
sim_render-ego_max0.05772904345863744
sim_render-ego_mean0.04632628529457121
sim_render-ego_median0.046632547127573115
sim_render-ego_min0.03653477430343628
simulation-passed1
survival_time_max1.900000000000001
survival_time_mean1.4066666666666672
survival_time_min0.9500000000000004
240853888chuyjBaseline solution using reinforcement learningaido2-LFVI-sim-validation-offseasonstep1-simulationerroryes12910:05:31
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
Hidden. If you are the author, please login using the top-right link or use the dashboard.
240843879chuyjChuyj Submissionaido2-LF-sim-validation-offseasonstep1-simulationerroryes12910:01:52
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
Hidden. If you are the author, please login using the top-right link or use the dashboard.
240743869kene4192Baseline-IL-logs-tensorflowaido2-LFV-sim-validation-offseasonstep1-simulationsuccessyes12910:15:23Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.45636437422784915
survival_time_median8.649999999999988
deviation-center-line_median0.4311785162839246
in-drivable-lane_median2.299999999999992


other stats
agent_compute-ego_max0.12268276634456228
agent_compute-ego_mean0.12208369441902012
agent_compute-ego_median0.1225238087576187
agent_compute-ego_min0.12077296675974232
deviation-center-line_max0.9088854268142452
deviation-center-line_mean0.5986365356813155
deviation-center-line_min0.37564804861275336
deviation-heading_max4.201945109163213
deviation-heading_mean2.4228734465614012
deviation-heading_median2.2302979057944925
deviation-heading_min1.1336786145374231
driven_any_max0.8955257816530534
driven_any_mean0.5880326060855007
driven_any_median0.5278877561210948
driven_any_min0.4705143843374088
driven_lanedir_consec_max0.5152090074378766
driven_lanedir_consec_mean0.3627920394806733
driven_lanedir_consec_min0.17480460052515134
driven_lanedir_max0.5152090074378766
driven_lanedir_mean0.36608941005895024
driven_lanedir_median0.45636437422784915
driven_lanedir_min0.17480460052515134
in-drivable-lane_max5.5500000000000655
in-drivable-lane_mean2.4000000000000083
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.5024128743307011, "sim_physics": 0.08547406290706835, "survival_time": 7.599999999999981, "driven_lanedir": 0.17480460052515134, "sim_render-ego": 0.03583336660736486, "in-drivable-lane": 4.149999999999985, "agent_compute-ego": 0.12258098627391614, "deviation-heading": 1.1336786145374231, "set_robot_commands": 0.055266813228004856, "deviation-center-line": 0.37564804861275336, "driven_lanedir_consec": 0.17480460052515134, "sim_compute_sim_state": 0.022465840766304417, "sim_compute_performance-ego": 0.038641499845605144, "sim_compute_robot_state-ego": 0.04036120678249158, "sim_compute_robot_state-npc0": 0.04006241183531912, "sim_compute_robot_state-npc1": 0.03942519269491497, "sim_compute_robot_state-npc2": 0.039244541996403745, "sim_compute_robot_state-npc3": 0.03939867333361977}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.5438222339852451, "sim_physics": 0.08745535755656776, "survival_time": 9.55, "driven_lanedir": 0.5152090074378766, "sim_render-ego": 0.03503860104146428, "in-drivable-lane": 0, "agent_compute-ego": 0.12185794395926113, "deviation-heading": 2.735425563790408, "set_robot_commands": 0.055516565033278543, "deviation-center-line": 0.9088854268142452, "driven_lanedir_consec": 0.5152090074378766, "sim_compute_sim_state": 0.02241874739761752, "sim_compute_performance-ego": 0.0384227493046466, "sim_compute_robot_state-ego": 0.040321315146241515, "sim_compute_robot_state-npc0": 0.04046992481691051, "sim_compute_robot_state-npc1": 0.0393408767840001, "sim_compute_robot_state-npc2": 0.039136850397000135, "sim_compute_robot_state-npc3": 0.039288167554046474}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.8955257816530534, "sim_physics": 0.08792518456158471, "survival_time": 12.850000000000048, "driven_lanedir": 0.4592920284641715, "sim_render-ego": 0.03523501904558115, "in-drivable-lane": 5.5500000000000655, "agent_compute-ego": 0.1225238087576187, "deviation-heading": 2.2302979057944925, "set_robot_commands": 0.054407366518844424, "deviation-center-line": 0.4311785162839246, "driven_lanedir_consec": 0.4592920284641715, "sim_compute_sim_state": 0.022443917938707404, "sim_compute_performance-ego": 0.03845612733744462, "sim_compute_robot_state-ego": 0.04053906522372353, "sim_compute_robot_state-npc0": 0.040240739570053634, "sim_compute_robot_state-npc1": 0.03952933007177212, "sim_compute_robot_state-npc2": 0.03916288164339177, "sim_compute_robot_state-npc3": 0.03936556526659064}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.5278877561210948, "sim_physics": 0.08301354654180179, "survival_time": 7.94999999999998, "driven_lanedir": 0.22477703963970264, "sim_render-ego": 0.03539052999244546, "in-drivable-lane": 2.299999999999992, "agent_compute-ego": 0.12268276634456228, "deviation-heading": 4.201945109163213, "set_robot_commands": 0.05447112389330594, "deviation-center-line": 0.38406107755178015, "driven_lanedir_consec": 0.208290186748318, "sim_compute_sim_state": 0.022604126600349474, "sim_compute_performance-ego": 0.03846659150513463, "sim_compute_robot_state-ego": 0.04017748622774328, "sim_compute_robot_state-npc0": 0.04011150276136098, "sim_compute_robot_state-npc1": 0.03938994167735742, "sim_compute_robot_state-npc2": 0.03919571150773726, "sim_compute_robot_state-npc3": 0.03969250085218897}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.4705143843374088, "sim_physics": 0.0838875577628957, "survival_time": 8.649999999999988, "driven_lanedir": 0.45636437422784915, "sim_render-ego": 0.03565651695163264, "in-drivable-lane": 0, "agent_compute-ego": 0.12077296675974232, "deviation-heading": 1.8130200395214708, "set_robot_commands": 0.05521230752757519, "deviation-center-line": 0.8934096091438738, "driven_lanedir_consec": 0.45636437422784915, "sim_compute_sim_state": 0.022390546137197855, "sim_compute_performance-ego": 0.03819861853053804, "sim_compute_robot_state-ego": 0.04011638316115892, "sim_compute_robot_state-npc0": 0.03984622872633741, "sim_compute_robot_state-npc1": 0.03920341916166978, "sim_compute_robot_state-npc2": 0.03895784251262687, "sim_compute_robot_state-npc3": 0.03974945558977954}}
set_robot_commands_max0.055516565033278543
set_robot_commands_mean0.05497483524020179
set_robot_commands_median0.05521230752757519
set_robot_commands_min0.054407366518844424
sim_compute_performance-ego_max0.038641499845605144
sim_compute_performance-ego_mean0.03843711730467381
sim_compute_performance-ego_median0.03845612733744462
sim_compute_performance-ego_min0.03819861853053804
sim_compute_robot_state-ego_max0.04053906522372353
sim_compute_robot_state-ego_mean0.04030309130827177
sim_compute_robot_state-ego_median0.040321315146241515
sim_compute_robot_state-ego_min0.04011638316115892
sim_compute_robot_state-npc0_max0.04046992481691051
sim_compute_robot_state-npc0_mean0.04014616154199633
sim_compute_robot_state-npc0_median0.04011150276136098
sim_compute_robot_state-npc0_min0.03984622872633741
sim_compute_robot_state-npc1_max0.03952933007177212
sim_compute_robot_state-npc1_mean0.03937775207794288
sim_compute_robot_state-npc1_median0.03938994167735742
sim_compute_robot_state-npc1_min0.03920341916166978
sim_compute_robot_state-npc2_max0.039244541996403745
sim_compute_robot_state-npc2_mean0.03913956561143196
sim_compute_robot_state-npc2_median0.03916288164339177
sim_compute_robot_state-npc2_min0.03895784251262687
sim_compute_robot_state-npc3_max0.03974945558977954
sim_compute_robot_state-npc3_mean0.03949887251924508
sim_compute_robot_state-npc3_median0.03939867333361977
sim_compute_robot_state-npc3_min0.039288167554046474
sim_compute_sim_state_max0.022604126600349474
sim_compute_sim_state_mean0.022464635768035333
sim_compute_sim_state_median0.022443917938707404
sim_compute_sim_state_min0.022390546137197855
sim_physics_max0.08792518456158471
sim_physics_mean0.08555114186598367
sim_physics_median0.08547406290706835
sim_physics_min0.08301354654180179
sim_render-ego_max0.03583336660736486
sim_render-ego_mean0.035430806727697675
sim_render-ego_median0.03539052999244546
sim_render-ego_min0.03503860104146428
simulation-passed1
survival_time_max12.850000000000048
survival_time_mean9.32
survival_time_min7.599999999999981
240733868kene4192Baseline-IL-logs-tensorflow-keneaido2-LFV-sim-validation-offseasonstep1-simulationfailedyes12910:00:44
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "experiment_manager.py", line 297, in run_episode
    r: MsgReceived = agent.write_topic_and_expect('get_commands', expect='commands')
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 93, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 174, in read_one
    nickname=self.nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 283, in read_until_over
    raise RemoteNodeAborted(m)
zuper_nodes.structures.RemoteNodeAborted: External node "agent" aborted:

error in agent |Exception while handling a message on topic "get_commands".
               |
               || Traceback (most recent call last):
               ||   File "/usr/local/lib/python3.7/dist-packages/tensorflow/python/framework/importer.py", line 426, in import_graph_def
               ||     graph._c_graph, serialized, options)  # pylint: disable=protected-access
               || tensorflow.python.framework.errors_impl.InvalidArgumentError: NodeDef mentions attr 'explicit_paddings' not in Op<name=Conv2D; signature=input:T, filter:T -> output:T; attr=T:type,allowed=[DT_HALF, DT_BFLOAT16, DT_FLOAT, DT_DOUBLE]; attr=strides:list(int); attr=use_cudnn_on_gpu:bool,default=true; attr=padding:string,allowed=["SAME", "VALID"]; attr=data_format:string,default="NHWC",allowed=["NHWC", "NCHW"]; attr=dilations:list(int),default=[1, 1, 1, 1]>; NodeDef: {{node prefix/ConvNet/conv_layer_1/Conv2D}}. (Check whether your GraphDef-interpreting binary is up to date with your GraphDef-generating binary.).
               ||
               || During handling of the above exception, another exception occurred:
               ||
               || Traceback (most recent call last):
               ||   File "/workspace/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 274, in loop
               ||     handle_message_node(parsed, receiver0, context0)
               ||   File "/workspace/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 428, in handle_message_node
               ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
               ||   File "/workspace/src/zuper-nodes/src/zuper_nodes_wrapper/utils.py", line 18, in call_if_fun_exists
               ||     f(**kwargs)
               ||   File "imitation_agent.py", line 69, in on_received_get_commands
               ||     pwm_left, pwm_right = self.compute_action(self.config.current_image)
               ||   File "imitation_agent.py", line 41, in compute_action
               ||     graph = load_graph(frozen_model_filename)
               ||   File "/workspace/graph_utils.py", line 14, in load_graph
               ||     tf.import_graph_def(graph_def, name="prefix")
               ||   File "/usr/local/lib/python3.7/dist-packages/tensorflow/python/util/deprecation.py", line 507, in new_func
               ||     return func(*args, **kwargs)
               ||   File "/usr/local/lib/python3.7/dist-packages/tensorflow/python/framework/importer.py", line 430, in import_graph_def
               ||     raise ValueError(str(e))
               || ValueError: NodeDef mentions attr 'explicit_paddings' not in Op<name=Conv2D; signature=input:T, filter:T -> output:T; attr=T:type,allowed=[DT_HALF, DT_BFLOAT16, DT_FLOAT, DT_DOUBLE]; attr=strides:list(int); attr=use_cudnn_on_gpu:bool,default=true; attr=padding:string,allowed=["SAME", "VALID"]; attr=data_format:string,default="NHWC",allowed=["NHWC", "NCHW"]; attr=dilations:list(int),default=[1, 1, 1, 1]>; NodeDef: {{node prefix/ConvNet/conv_layer_1/Conv2D}}. (Check whether your GraphDef-interpreting binary is up to date with your GraphDef-generating binary.).
               ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
    yield cie
  File "experiment_manager.py", line 441, in <module>
    wrap(cie)
  File "experiment_manager.py", line 429, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 135, in main
    physics_dt=config.physics_dt)
  File "experiment_manager.py", line 301, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.
Hidden. If you are the author, please login using the top-right link or use the dashboard.
240713866kene4192Baseline-IL-logs-tensorflow-keneaido2-LFV-sim-validation-offseasonstep1-simulationfailedyes12910:02:53
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "experiment_manager.py", line 297, in run_episode
    r: MsgReceived = agent.write_topic_and_expect('get_commands', expect='commands')
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 93, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 174, in read_one
    nickname=self.nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 283, in read_until_over
    raise RemoteNodeAborted(m)
zuper_nodes.structures.RemoteNodeAborted: External node "agent" aborted:

error in agent |Exception while handling a message on topic "get_commands".
               |
               || Traceback (most recent call last):
               ||   File "/usr/local/lib/python3.7/dist-packages/tensorflow/python/framework/importer.py", line 426, in import_graph_def
               ||     graph._c_graph, serialized, options)  # pylint: disable=protected-access
               || tensorflow.python.framework.errors_impl.InvalidArgumentError: NodeDef mentions attr 'explicit_paddings' not in Op<name=Conv2D; signature=input:T, filter:T -> output:T; attr=T:type,allowed=[DT_HALF, DT_BFLOAT16, DT_FLOAT, DT_DOUBLE]; attr=strides:list(int); attr=use_cudnn_on_gpu:bool,default=true; attr=padding:string,allowed=["SAME", "VALID"]; attr=data_format:string,default="NHWC",allowed=["NHWC", "NCHW"]; attr=dilations:list(int),default=[1, 1, 1, 1]>; NodeDef: {{node prefix/ConvNet/conv_layer_1/Conv2D}}. (Check whether your GraphDef-interpreting binary is up to date with your GraphDef-generating binary.).
               ||
               || During handling of the above exception, another exception occurred:
               ||
               || Traceback (most recent call last):
               ||   File "/workspace/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 274, in loop
               ||     handle_message_node(parsed, receiver0, context0)
               ||   File "/workspace/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 428, in handle_message_node
               ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
               ||   File "/workspace/src/zuper-nodes/src/zuper_nodes_wrapper/utils.py", line 18, in call_if_fun_exists
               ||     f(**kwargs)
               ||   File "imitation_agent.py", line 69, in on_received_get_commands
               ||     pwm_left, pwm_right = self.compute_action(self.config.current_image)
               ||   File "imitation_agent.py", line 41, in compute_action
               ||     graph = load_graph(frozen_model_filename)
               ||   File "/workspace/graph_utils.py", line 14, in load_graph
               ||     tf.import_graph_def(graph_def, name="prefix")
               ||   File "/usr/local/lib/python3.7/dist-packages/tensorflow/python/util/deprecation.py", line 507, in new_func
               ||     return func(*args, **kwargs)
               ||   File "/usr/local/lib/python3.7/dist-packages/tensorflow/python/framework/importer.py", line 430, in import_graph_def
               ||     raise ValueError(str(e))
               || ValueError: NodeDef mentions attr 'explicit_paddings' not in Op<name=Conv2D; signature=input:T, filter:T -> output:T; attr=T:type,allowed=[DT_HALF, DT_BFLOAT16, DT_FLOAT, DT_DOUBLE]; attr=strides:list(int); attr=use_cudnn_on_gpu:bool,default=true; attr=padding:string,allowed=["SAME", "VALID"]; attr=data_format:string,default="NHWC",allowed=["NHWC", "NCHW"]; attr=dilations:list(int),default=[1, 1, 1, 1]>; NodeDef: {{node prefix/ConvNet/conv_layer_1/Conv2D}}. (Check whether your GraphDef-interpreting binary is up to date with your GraphDef-generating binary.).
               ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
    yield cie
  File "experiment_manager.py", line 441, in <module>
    wrap(cie)
  File "experiment_manager.py", line 429, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 135, in main
    physics_dt=config.physics_dt)
  File "experiment_manager.py", line 301, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.
Hidden. If you are the author, please login using the top-right link or use the dashboard.
240693861kene4192Baseline-IL-logs-tensorflow-keneaido2-LFV-sim-testing-offseasonstep1-simulationfailedyes12910:01:06
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "experiment_manager.py", line 297, in run_episode
    r: MsgReceived = agent.write_topic_and_expect('get_commands', expect='commands')
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 93, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 174, in read_one
    nickname=self.nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 283, in read_until_over
    raise RemoteNodeAborted(m)
zuper_nodes.structures.RemoteNodeAborted: External node "agent" aborted:

error in agent |Exception while handling a message on topic "get_commands".
               |
               || Traceback (most recent call last):
               ||   File "/usr/local/lib/python3.7/dist-packages/tensorflow/python/framework/importer.py", line 426, in import_graph_def
               ||     graph._c_graph, serialized, options)  # pylint: disable=protected-access
               || tensorflow.python.framework.errors_impl.InvalidArgumentError: NodeDef mentions attr 'explicit_paddings' not in Op<name=Conv2D; signature=input:T, filter:T -> output:T; attr=T:type,allowed=[DT_HALF, DT_BFLOAT16, DT_FLOAT, DT_DOUBLE]; attr=strides:list(int); attr=use_cudnn_on_gpu:bool,default=true; attr=padding:string,allowed=["SAME", "VALID"]; attr=data_format:string,default="NHWC",allowed=["NHWC", "NCHW"]; attr=dilations:list(int),default=[1, 1, 1, 1]>; NodeDef: {{node prefix/ConvNet/conv_layer_1/Conv2D}}. (Check whether your GraphDef-interpreting binary is up to date with your GraphDef-generating binary.).
               ||
               || During handling of the above exception, another exception occurred:
               ||
               || Traceback (most recent call last):
               ||   File "/workspace/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 274, in loop
               ||     handle_message_node(parsed, receiver0, context0)
               ||   File "/workspace/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 428, in handle_message_node
               ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
               ||   File "/workspace/src/zuper-nodes/src/zuper_nodes_wrapper/utils.py", line 18, in call_if_fun_exists
               ||     f(**kwargs)
               ||   File "imitation_agent.py", line 69, in on_received_get_commands
               ||     pwm_left, pwm_right = self.compute_action(self.config.current_image)
               ||   File "imitation_agent.py", line 41, in compute_action
               ||     graph = load_graph(frozen_model_filename)
               ||   File "/workspace/graph_utils.py", line 14, in load_graph
               ||     tf.import_graph_def(graph_def, name="prefix")
               ||   File "/usr/local/lib/python3.7/dist-packages/tensorflow/python/util/deprecation.py", line 507, in new_func
               ||     return func(*args, **kwargs)
               ||   File "/usr/local/lib/python3.7/dist-packages/tensorflow/python/framework/importer.py", line 430, in import_graph_def
               ||     raise ValueError(str(e))
               || ValueError: NodeDef mentions attr 'explicit_paddings' not in Op<name=Conv2D; signature=input:T, filter:T -> output:T; attr=T:type,allowed=[DT_HALF, DT_BFLOAT16, DT_FLOAT, DT_DOUBLE]; attr=strides:list(int); attr=use_cudnn_on_gpu:bool,default=true; attr=padding:string,allowed=["SAME", "VALID"]; attr=data_format:string,default="NHWC",allowed=["NHWC", "NCHW"]; attr=dilations:list(int),default=[1, 1, 1, 1]>; NodeDef: {{node prefix/ConvNet/conv_layer_1/Conv2D}}. (Check whether your GraphDef-interpreting binary is up to date with your GraphDef-generating binary.).
               ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
    yield cie
  File "experiment_manager.py", line 441, in <module>
    wrap(cie)
  File "experiment_manager.py", line 429, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 135, in main
    physics_dt=config.physics_dt)
  File "experiment_manager.py", line 301, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.
Hidden. If you are the author, please login using the top-right link or use the dashboard.
240653865kene4192Baseline-IL-logs-tensorflow-keneaido2-LFVI-sim-validation-offseasonstep1-simulationfailedyes12910:03:07
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "experiment_manager.py", line 297, in run_episode
    r: MsgReceived = agent.write_topic_and_expect('get_commands', expect='commands')
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 93, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 174, in read_one
    nickname=self.nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 283, in read_until_over
    raise RemoteNodeAborted(m)
zuper_nodes.structures.RemoteNodeAborted: External node "agent" aborted:

error in agent |Exception while handling a message on topic "get_commands".
               |
               || Traceback (most recent call last):
               ||   File "/usr/local/lib/python3.7/dist-packages/tensorflow/python/framework/importer.py", line 426, in import_graph_def
               ||     graph._c_graph, serialized, options)  # pylint: disable=protected-access
               || tensorflow.python.framework.errors_impl.InvalidArgumentError: NodeDef mentions attr 'explicit_paddings' not in Op<name=Conv2D; signature=input:T, filter:T -> output:T; attr=T:type,allowed=[DT_HALF, DT_BFLOAT16, DT_FLOAT, DT_DOUBLE]; attr=strides:list(int); attr=use_cudnn_on_gpu:bool,default=true; attr=padding:string,allowed=["SAME", "VALID"]; attr=data_format:string,default="NHWC",allowed=["NHWC", "NCHW"]; attr=dilations:list(int),default=[1, 1, 1, 1]>; NodeDef: {{node prefix/ConvNet/conv_layer_1/Conv2D}}. (Check whether your GraphDef-interpreting binary is up to date with your GraphDef-generating binary.).
               ||
               || During handling of the above exception, another exception occurred:
               ||
               || Traceback (most recent call last):
               ||   File "/workspace/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 274, in loop
               ||     handle_message_node(parsed, receiver0, context0)
               ||   File "/workspace/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 428, in handle_message_node
               ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
               ||   File "/workspace/src/zuper-nodes/src/zuper_nodes_wrapper/utils.py", line 18, in call_if_fun_exists
               ||     f(**kwargs)
               ||   File "imitation_agent.py", line 69, in on_received_get_commands
               ||     pwm_left, pwm_right = self.compute_action(self.config.current_image)
               ||   File "imitation_agent.py", line 41, in compute_action
               ||     graph = load_graph(frozen_model_filename)
               ||   File "/workspace/graph_utils.py", line 14, in load_graph
               ||     tf.import_graph_def(graph_def, name="prefix")
               ||   File "/usr/local/lib/python3.7/dist-packages/tensorflow/python/util/deprecation.py", line 507, in new_func
               ||     return func(*args, **kwargs)
               ||   File "/usr/local/lib/python3.7/dist-packages/tensorflow/python/framework/importer.py", line 430, in import_graph_def
               ||     raise ValueError(str(e))
               || ValueError: NodeDef mentions attr 'explicit_paddings' not in Op<name=Conv2D; signature=input:T, filter:T -> output:T; attr=T:type,allowed=[DT_HALF, DT_BFLOAT16, DT_FLOAT, DT_DOUBLE]; attr=strides:list(int); attr=use_cudnn_on_gpu:bool,default=true; attr=padding:string,allowed=["SAME", "VALID"]; attr=data_format:string,default="NHWC",allowed=["NHWC", "NCHW"]; attr=dilations:list(int),default=[1, 1, 1, 1]>; NodeDef: {{node prefix/ConvNet/conv_layer_1/Conv2D}}. (Check whether your GraphDef-interpreting binary is up to date with your GraphDef-generating binary.).
               ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
    yield cie
  File "experiment_manager.py", line 441, in <module>
    wrap(cie)
  File "experiment_manager.py", line 429, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 135, in main
    physics_dt=config.physics_dt)
  File "experiment_manager.py", line 301, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.
Hidden. If you are the author, please login using the top-right link or use the dashboard.
240643856kene4192Baseline-IL-logs-tensorflow-keneaido2-LFV-sim-validation-offseasonstep1-simulationfailedyes12910:02:51
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "experiment_manager.py", line 297, in run_episode
    r: MsgReceived = agent.write_topic_and_expect('get_commands', expect='commands')
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 93, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 174, in read_one
    nickname=self.nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 283, in read_until_over
    raise RemoteNodeAborted(m)
zuper_nodes.structures.RemoteNodeAborted: External node "agent" aborted:

error in agent |Exception while handling a message on topic "get_commands".
               |
               || Traceback (most recent call last):
               ||   File "/usr/local/lib/python3.7/dist-packages/tensorflow/python/framework/importer.py", line 426, in import_graph_def
               ||     graph._c_graph, serialized, options)  # pylint: disable=protected-access
               || tensorflow.python.framework.errors_impl.InvalidArgumentError: NodeDef mentions attr 'explicit_paddings' not in Op<name=Conv2D; signature=input:T, filter:T -> output:T; attr=T:type,allowed=[DT_HALF, DT_BFLOAT16, DT_FLOAT, DT_DOUBLE]; attr=strides:list(int); attr=use_cudnn_on_gpu:bool,default=true; attr=padding:string,allowed=["SAME", "VALID"]; attr=data_format:string,default="NHWC",allowed=["NHWC", "NCHW"]; attr=dilations:list(int),default=[1, 1, 1, 1]>; NodeDef: {{node prefix/ConvNet/conv_layer_1/Conv2D}}. (Check whether your GraphDef-interpreting binary is up to date with your GraphDef-generating binary.).
               ||
               || During handling of the above exception, another exception occurred:
               ||
               || Traceback (most recent call last):
               ||   File "/workspace/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 274, in loop
               ||     handle_message_node(parsed, receiver0, context0)
               ||   File "/workspace/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 428, in handle_message_node
               ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
               ||   File "/workspace/src/zuper-nodes/src/zuper_nodes_wrapper/utils.py", line 18, in call_if_fun_exists
               ||     f(**kwargs)
               ||   File "imitation_agent.py", line 69, in on_received_get_commands
               ||     pwm_left, pwm_right = self.compute_action(self.config.current_image)
               ||   File "imitation_agent.py", line 41, in compute_action
               ||     graph = load_graph(frozen_model_filename)
               ||   File "/workspace/graph_utils.py", line 14, in load_graph
               ||     tf.import_graph_def(graph_def, name="prefix")
               ||   File "/usr/local/lib/python3.7/dist-packages/tensorflow/python/util/deprecation.py", line 507, in new_func
               ||     return func(*args, **kwargs)
               ||   File "/usr/local/lib/python3.7/dist-packages/tensorflow/python/framework/importer.py", line 430, in import_graph_def
               ||     raise ValueError(str(e))
               || ValueError: NodeDef mentions attr 'explicit_paddings' not in Op<name=Conv2D; signature=input:T, filter:T -> output:T; attr=T:type,allowed=[DT_HALF, DT_BFLOAT16, DT_FLOAT, DT_DOUBLE]; attr=strides:list(int); attr=use_cudnn_on_gpu:bool,default=true; attr=padding:string,allowed=["SAME", "VALID"]; attr=data_format:string,default="NHWC",allowed=["NHWC", "NCHW"]; attr=dilations:list(int),default=[1, 1, 1, 1]>; NodeDef: {{node prefix/ConvNet/conv_layer_1/Conv2D}}. (Check whether your GraphDef-interpreting binary is up to date with your GraphDef-generating binary.).
               ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
    yield cie
  File "experiment_manager.py", line 441, in <module>
    wrap(cie)
  File "experiment_manager.py", line 429, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 135, in main
    physics_dt=config.physics_dt)
  File "experiment_manager.py", line 301, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.
Hidden. If you are the author, please login using the top-right link or use the dashboard.
240573848jagwarchallenge-aido_LF-template-pytorchaido2-LF-sim-testing-offseasonstep1-simulationhost-erroryes12910:08:36
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 544, in get_cr
    uploaded = upload_files(wd, aws_config, copy_to_machine_cache=copy_to_machine_cache)
  File "/project/src/duckietown_challenges_runner/runner.py", line 1123, in upload_files
    uploaded = upload(aws_config, toupload, copy_to_machine_cache=copy_to_machine_cache)
  File "/project/src/duckietown_challenges_runner/runner.py", line 1361, in upload
    sha256hex = compute_sha256hex(realfile)
  File "/project/src/duckietown_challenges_runner/runner.py", line 1408, in compute_sha256hex
    res: bytes = subprocess.check_output(cmd)
  File "/usr/lib/python3.6/subprocess.py", line 336, in check_output
    **kwargs).stdout
  File "/usr/lib/python3.6/subprocess.py", line 418, in run
    output=stdout, stderr=stderr)
subprocess.CalledProcessError: Command '['shasum', '-a', '256', '/tmp/duckietown/DT18/evaluator/executions/aido2-LF-sim-testing-offseason/submission3848/step1-simulation-ip-172-31-42-167-7227-job24057/tmp/tmpl1qgv5wi/episodes/ETHZ_autolab_technical_track-6-0/camera.mp4']' returned non-zero exit status 1.
Hidden. If you are the author, please login using the top-right link or use the dashboard.
240563849jagwarchallenge-aido_LF-template-pytorchaido2-LF-sim-validation-offseasonstep1-simulationsuccessyes12910:04:26Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.11625373188552056
survival_time_median1.4500000000000006
deviation-center-line_median0.07024506747576006
in-drivable-lane_median0.05000000000000005


other stats
agent_compute-ego_max0.16975932285703463
agent_compute-ego_mean0.16086828715734824
agent_compute-ego_median0.16106406334907775
agent_compute-ego_min0.15250553908171477
deviation-center-line_max0.09965909160382908
deviation-center-line_mean0.07785012798678762
deviation-center-line_min0.06382064595539545
deviation-heading_max0.968269231110289
deviation-heading_mean0.8318545652290827
deviation-heading_median0.885486168547169
deviation-heading_min0.5016197567471753
driven_any_max0.2094901948184788
driven_any_mean0.1845683090371713
driven_any_median0.19574639516462844
driven_any_min0.14206951858565578
driven_lanedir_consec_max0.14082402440929165
driven_lanedir_consec_mean0.11325795992373412
driven_lanedir_consec_min0.06858394686549474
driven_lanedir_max0.14082402440929165
driven_lanedir_mean0.11325795992373412
driven_lanedir_median0.11625373188552056
driven_lanedir_min0.06858394686549474
in-drivable-lane_max0.15000000000000013
in-drivable-lane_mean0.05000000000000005
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.19574639516462844, "sim_physics": 0.11965363601158405, "survival_time": 1.4500000000000006, "driven_lanedir": 0.10427155634647356, "sim_render-ego": 0.06520772802418676, "in-drivable-lane": 0.05000000000000005, "agent_compute-ego": 0.16975932285703463, "deviation-heading": 0.9630529380006068, "set_robot_commands": 0.0872659601014236, "deviation-center-line": 0.08810099620917924, "driven_lanedir_consec": 0.10427155634647356, "sim_compute_sim_state": 0.04211558144668053, "sim_compute_performance-ego": 0.07047092503514783, "sim_compute_robot_state-ego": 0.0753754500685067}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.2093992838752257, "sim_physics": 0.11730228700945454, "survival_time": 1.5500000000000007, "driven_lanedir": 0.14082402440929165, "sim_render-ego": 0.060718513304187406, "in-drivable-lane": 0, "agent_compute-ego": 0.16106406334907775, "deviation-heading": 0.885486168547169, "set_robot_commands": 0.09277856734491163, "deviation-center-line": 0.0674248386897742, "driven_lanedir_consec": 0.14082402440929165, "sim_compute_sim_state": 0.037933741846392234, "sim_compute_performance-ego": 0.06854627978417181, "sim_compute_robot_state-ego": 0.07176111590477728}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.14206951858565578, "sim_physics": 0.11170458793640135, "survival_time": 1.0500000000000005, "driven_lanedir": 0.11625373188552056, "sim_render-ego": 0.05927668298993792, "in-drivable-lane": 0, "agent_compute-ego": 0.1664267721630278, "deviation-heading": 0.5016197567471753, "set_robot_commands": 0.0913049266451881, "deviation-center-line": 0.09965909160382908, "driven_lanedir_consec": 0.11625373188552056, "sim_compute_sim_state": 0.03948166256859189, "sim_compute_performance-ego": 0.06645964440845308, "sim_compute_robot_state-ego": 0.07321344103131976}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.16613615274186797, "sim_physics": 0.1152166525522868, "survival_time": 1.3500000000000003, "driven_lanedir": 0.06858394686549474, "sim_render-ego": 0.055583450529310435, "in-drivable-lane": 0.15000000000000013, "agent_compute-ego": 0.15250553908171477, "deviation-heading": 0.968269231110289, "set_robot_commands": 0.08067478073967828, "deviation-center-line": 0.06382064595539545, "driven_lanedir_consec": 0.06858394686549474, "sim_compute_sim_state": 0.038197075879132306, "sim_compute_performance-ego": 0.06488500701056586, "sim_compute_robot_state-ego": 0.06500245023656774}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.2094901948184788, "sim_physics": 0.11443663412524809, "survival_time": 1.5500000000000007, "driven_lanedir": 0.13635654011189002, "sim_render-ego": 0.05997775446984076, "in-drivable-lane": 0.05000000000000005, "agent_compute-ego": 0.15458573833588632, "deviation-heading": 0.8408447317401738, "set_robot_commands": 0.08502098052732406, "deviation-center-line": 0.07024506747576006, "driven_lanedir_consec": 0.13635654011189002, "sim_compute_sim_state": 0.03761930619516681, "sim_compute_performance-ego": 0.06656668263096963, "sim_compute_robot_state-ego": 0.07040172238503734}}
set_robot_commands_max0.09277856734491163
set_robot_commands_mean0.08740904307170513
set_robot_commands_median0.0872659601014236
set_robot_commands_min0.08067478073967828
sim_compute_performance-ego_max0.07047092503514783
sim_compute_performance-ego_mean0.06738570777386163
sim_compute_performance-ego_median0.06656668263096963
sim_compute_performance-ego_min0.06488500701056586
sim_compute_robot_state-ego_max0.0753754500685067
sim_compute_robot_state-ego_mean0.07115083592524177
sim_compute_robot_state-ego_median0.07176111590477728
sim_compute_robot_state-ego_min0.06500245023656774
sim_compute_sim_state_max0.04211558144668053
sim_compute_sim_state_mean0.039069473587192746
sim_compute_sim_state_median0.038197075879132306
sim_compute_sim_state_min0.03761930619516681
sim_physics_max0.11965363601158405
sim_physics_mean0.11566275952699497
sim_physics_median0.1152166525522868
sim_physics_min0.11170458793640135
sim_render-ego_max0.06520772802418676
sim_render-ego_mean0.06015282586349265
sim_render-ego_median0.05997775446984076
sim_render-ego_min0.055583450529310435
simulation-passed1
survival_time_max1.5500000000000007
survival_time_mean1.3900000000000006
survival_time_min1.0500000000000005
240543852jagwarchallenge-aido_LF-template-pytorchaido2-LFV-sim-validation-offseasonstep1-simulationsuccessyes12910:07:14Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.0819383221144574
survival_time_median1.3000000000000005
deviation-center-line_median0.07077390798309896
in-drivable-lane_median0.20000000000000015


other stats
agent_compute-ego_max0.17414705506686506
agent_compute-ego_mean0.15810703215069807
agent_compute-ego_median0.15347544046548697
agent_compute-ego_min0.14671557396650314
deviation-center-line_max0.09800504654144594
deviation-center-line_mean0.07045069903959204
deviation-center-line_min0.030135435176982937
deviation-heading_max0.8551283501446498
deviation-heading_mean0.6719909238299641
deviation-heading_median0.6870076329772088
deviation-heading_min0.4521897011097954
driven_any_max0.20041782579608844
driven_any_mean0.16516350978113747
driven_any_median0.14502263548424654
driven_any_min0.1423779403214888
driven_lanedir_consec_max0.11509937785817526
driven_lanedir_consec_mean0.08240530779959436
driven_lanedir_consec_min0.05282981528380293
driven_lanedir_max0.11509937785817526
driven_lanedir_mean0.08240530779959436
driven_lanedir_median0.0819383221144574
driven_lanedir_min0.05282981528380293
in-drivable-lane_max0.5500000000000005
in-drivable-lane_mean0.2100000000000002
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.19560426654016289, "sim_physics": 0.20608437472376331, "survival_time": 1.4500000000000006, "driven_lanedir": 0.0819383221144574, "sim_render-ego": 0.06778819807644548, "in-drivable-lane": 0.20000000000000015, "agent_compute-ego": 0.17414705506686506, "deviation-heading": 0.8551283501446498, "set_robot_commands": 0.09356327714591192, "deviation-center-line": 0.07077390798309896, "driven_lanedir_consec": 0.0819383221144574, "sim_compute_sim_state": 0.0385485681994208, "sim_compute_performance-ego": 0.07141706039165628, "sim_compute_robot_state-ego": 0.0771245709780989, "sim_compute_robot_state-npc0": 0.07363201831949168, "sim_compute_robot_state-npc1": 0.07464429427837503, "sim_compute_robot_state-npc2": 0.068607733167451, "sim_compute_robot_state-npc3": 0.07009597482352421}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.20041782579608844, "sim_physics": 0.19276969134807587, "survival_time": 1.6000000000000008, "driven_lanedir": 0.053388466723951034, "sim_render-ego": 0.054685547947883606, "in-drivable-lane": 0.5500000000000005, "agent_compute-ego": 0.14671557396650314, "deviation-heading": 0.8324616964471786, "set_robot_commands": 0.07870610803365707, "deviation-center-line": 0.05641878674318129, "driven_lanedir_consec": 0.053388466723951034, "sim_compute_sim_state": 0.03493325412273407, "sim_compute_performance-ego": 0.05989177525043487, "sim_compute_robot_state-ego": 0.06696608662605286, "sim_compute_robot_state-npc0": 0.06143356114625931, "sim_compute_robot_state-npc1": 0.06332977861166, "sim_compute_robot_state-npc2": 0.06112276017665863, "sim_compute_robot_state-npc3": 0.06364889442920685}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.14502263548424654, "sim_physics": 0.16786829284999685, "survival_time": 1.1500000000000004, "driven_lanedir": 0.11509937785817526, "sim_render-ego": 0.05559926447661027, "in-drivable-lane": 0, "agent_compute-ego": 0.14872488768204398, "deviation-heading": 0.4521897011097954, "set_robot_commands": 0.09000758502794348, "deviation-center-line": 0.09800504654144594, "driven_lanedir_consec": 0.11509937785817526, "sim_compute_sim_state": 0.03772831999737283, "sim_compute_performance-ego": 0.05576241534689198, "sim_compute_robot_state-ego": 0.05968075213224992, "sim_compute_robot_state-npc0": 0.0684490618498429, "sim_compute_robot_state-npc1": 0.06388718148936397, "sim_compute_robot_state-npc2": 0.06374618281488834, "sim_compute_robot_state-npc3": 0.061319952425749405}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.1423948807637008, "sim_physics": 0.17129621903101602, "survival_time": 1.2000000000000004, "driven_lanedir": 0.1087705570175852, "sim_render-ego": 0.054846485455830894, "in-drivable-lane": 0, "agent_compute-ego": 0.16747220357259116, "deviation-heading": 0.5331672384709879, "set_robot_commands": 0.08396690090497334, "deviation-center-line": 0.09692031875325116, "driven_lanedir_consec": 0.1087705570175852, "sim_compute_sim_state": 0.035669416189193726, "sim_compute_performance-ego": 0.057942996422449745, "sim_compute_robot_state-ego": 0.062318642934163414, "sim_compute_robot_state-npc0": 0.06539532542228699, "sim_compute_robot_state-npc1": 0.0644575556119283, "sim_compute_robot_state-npc2": 0.06464587648709615, "sim_compute_robot_state-npc3": 0.06303100784619649}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.1423779403214888, "sim_physics": 0.1671090951332679, "survival_time": 1.3000000000000005, "driven_lanedir": 0.05282981528380293, "sim_render-ego": 0.06030139556297889, "in-drivable-lane": 0.30000000000000027, "agent_compute-ego": 0.15347544046548697, "deviation-heading": 0.6870076329772088, "set_robot_commands": 0.08243260016808143, "deviation-center-line": 0.030135435176982937, "driven_lanedir_consec": 0.05282981528380293, "sim_compute_sim_state": 0.03926129524524395, "sim_compute_performance-ego": 0.06409441507779635, "sim_compute_robot_state-ego": 0.06766114785121037, "sim_compute_robot_state-npc0": 0.06311380863189697, "sim_compute_robot_state-npc1": 0.05971040175511287, "sim_compute_robot_state-npc2": 0.05896378480471098, "sim_compute_robot_state-npc3": 0.06268228017366849}}
set_robot_commands_max0.09356327714591192
set_robot_commands_mean0.08573529425611344
set_robot_commands_median0.08396690090497334
set_robot_commands_min0.07870610803365707
sim_compute_performance-ego_max0.07141706039165628
sim_compute_performance-ego_mean0.06182173249784585
sim_compute_performance-ego_median0.05989177525043487
sim_compute_performance-ego_min0.05576241534689198
sim_compute_robot_state-ego_max0.0771245709780989
sim_compute_robot_state-ego_mean0.06675024010435508
sim_compute_robot_state-ego_median0.06696608662605286
sim_compute_robot_state-ego_min0.05968075213224992
sim_compute_robot_state-npc0_max0.07363201831949168
sim_compute_robot_state-npc0_mean0.06640475507395557
sim_compute_robot_state-npc0_median0.06539532542228699
sim_compute_robot_state-npc0_min0.06143356114625931
sim_compute_robot_state-npc1_max0.07464429427837503
sim_compute_robot_state-npc1_mean0.06520584234928803
sim_compute_robot_state-npc1_median0.06388718148936397
sim_compute_robot_state-npc1_min0.05971040175511287
sim_compute_robot_state-npc2_max0.068607733167451
sim_compute_robot_state-npc2_mean0.06341726749016102
sim_compute_robot_state-npc2_median0.06374618281488834
sim_compute_robot_state-npc2_min0.05896378480471098
sim_compute_robot_state-npc3_max0.07009597482352421
sim_compute_robot_state-npc3_mean0.06415562193966909
sim_compute_robot_state-npc3_median0.06303100784619649
sim_compute_robot_state-npc3_min0.061319952425749405
sim_compute_sim_state_max0.03926129524524395
sim_compute_sim_state_mean0.03722817075079308
sim_compute_sim_state_median0.03772831999737283
sim_compute_sim_state_min0.03493325412273407
sim_physics_max0.20608437472376331
sim_physics_mean0.181025534617224
sim_physics_median0.17129621903101602
sim_physics_min0.1671090951332679
sim_render-ego_max0.06778819807644548
sim_render-ego_mean0.05864417830394984
sim_render-ego_median0.05559926447661027
sim_render-ego_min0.054685547947883606
simulation-passed1
survival_time_max1.6000000000000008
survival_time_mean1.3400000000000003
survival_time_min1.1500000000000004
240493842kene4192kene-template-randomaido2-LFV-sim-testing-offseasonstep1-simulationerroryes12910:02:00
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
Hidden. If you are the author, please login using the top-right link or use the dashboard.
240473843kene4192kene-template-randomaido2-LFV-sim-validation-offseasonstep1-simulationsuccessyes12910:08:21Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.5723310224856362
survival_time_median2.6999999999999984
deviation-center-line_median0.11519544839797546
in-drivable-lane_median0.5999999999999979


other stats
agent_compute-ego_max0.16231069564819336
agent_compute-ego_mean0.15128819758289083
agent_compute-ego_median0.15210639547418664
agent_compute-ego_min0.13974570286901375
deviation-center-line_max0.1743913456502906
deviation-center-line_mean0.12651756552531995
deviation-center-line_min0.09047885846140293
deviation-heading_max0.5020407942599273
deviation-heading_mean0.3641979127291371
deviation-heading_median0.34764983431811214
deviation-heading_min0.19401296908406307
driven_any_max1.6169932854589035
driven_any_mean1.0272530755098266
driven_any_median1.0243289631429708
driven_any_min0.4119037580118998
driven_lanedir_consec_max1.2433038249708377
driven_lanedir_consec_mean0.7800316850006626
driven_lanedir_consec_min0.3792793194470208
driven_lanedir_max1.2433038249708377
driven_lanedir_mean0.7800316850006626
driven_lanedir_median0.5723310224856362
driven_lanedir_min0.3792793194470208
in-drivable-lane_max0.9999999999999976
in-drivable-lane_mean0.4899999999999984
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0243289631429708, "sim_physics": 0.1633225988458704, "survival_time": 2.6999999999999984, "driven_lanedir": 0.5723310224856362, "sim_render-ego": 0.059476772944132485, "in-drivable-lane": 0.9999999999999976, "agent_compute-ego": 0.15210639547418664, "deviation-heading": 0.19401296908406307, "set_robot_commands": 0.09054977805526168, "deviation-center-line": 0.15907928712407893, "driven_lanedir_consec": 0.5723310224856362, "sim_compute_sim_state": 0.03930593419958044, "sim_compute_performance-ego": 0.06233612696329752, "sim_compute_robot_state-ego": 0.06939459288561786, "sim_compute_robot_state-npc0": 0.06632724956229881, "sim_compute_robot_state-npc1": 0.06937612427605523, "sim_compute_robot_state-npc2": 0.06878949094701696, "sim_compute_robot_state-npc3": 0.06956363607335973}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.4119037580118998, "sim_physics": 0.20505611419677736, "survival_time": 1.2500000000000004, "driven_lanedir": 0.3792793194470208, "sim_render-ego": 0.06617661476135255, "in-drivable-lane": 0, "agent_compute-ego": 0.16231069564819336, "deviation-heading": 0.47860435001913393, "set_robot_commands": 0.10179373741149902, "deviation-center-line": 0.09344288799285194, "driven_lanedir_consec": 0.3792793194470208, "sim_compute_sim_state": 0.043011751174926754, "sim_compute_performance-ego": 0.0762082290649414, "sim_compute_robot_state-ego": 0.08063323974609375, "sim_compute_robot_state-npc0": 0.0743963623046875, "sim_compute_robot_state-npc1": 0.07485847473144532, "sim_compute_robot_state-npc2": 0.07597770690917968, "sim_compute_robot_state-npc3": 0.07454434394836426}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.579862082650716, "sim_physics": 0.17613514473563746, "survival_time": 3.7999999999999945, "driven_lanedir": 1.2433038249708377, "sim_render-ego": 0.060132625855897605, "in-drivable-lane": 0.5999999999999979, "agent_compute-ego": 0.13974570286901375, "deviation-heading": 0.5020407942599273, "set_robot_commands": 0.08798848014128835, "deviation-center-line": 0.1743913456502906, "driven_lanedir_consec": 1.2433038249708377, "sim_compute_sim_state": 0.037200209341551126, "sim_compute_performance-ego": 0.07145665821276213, "sim_compute_robot_state-ego": 0.06995841390208195, "sim_compute_robot_state-npc0": 0.06377959251403809, "sim_compute_robot_state-npc1": 0.06602493085359272, "sim_compute_robot_state-npc2": 0.06932620939455535, "sim_compute_robot_state-npc3": 0.06616252974459999}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.6169932854589035, "sim_physics": 0.18737847291970555, "survival_time": 3.949999999999994, "driven_lanedir": 1.2126117310470583, "sim_render-ego": 0.06109425387805021, "in-drivable-lane": 0.849999999999997, "agent_compute-ego": 0.15262396727936178, "deviation-heading": 0.34764983431811214, "set_robot_commands": 0.09570898285394984, "deviation-center-line": 0.11519544839797546, "driven_lanedir_consec": 1.2126117310470583, "sim_compute_sim_state": 0.03940281083312216, "sim_compute_performance-ego": 0.06668576409545125, "sim_compute_robot_state-ego": 0.07513675508619863, "sim_compute_robot_state-npc0": 0.07176095322717595, "sim_compute_robot_state-npc1": 0.06829976130135451, "sim_compute_robot_state-npc2": 0.06925340543819379, "sim_compute_robot_state-npc3": 0.0657697055913225}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.5031772882846431, "sim_physics": 0.1711898786681039, "survival_time": 1.4000000000000006, "driven_lanedir": 0.4926325270527603, "sim_render-ego": 0.05929947750908988, "in-drivable-lane": 0, "agent_compute-ego": 0.14965422664369857, "deviation-heading": 0.29868161596444953, "set_robot_commands": 0.0934708033289228, "deviation-center-line": 0.09047885846140293, "driven_lanedir_consec": 0.4926325270527603, "sim_compute_sim_state": 0.03752040011542184, "sim_compute_performance-ego": 0.06353692497525897, "sim_compute_robot_state-ego": 0.08188389028821673, "sim_compute_robot_state-npc0": 0.07103140865053449, "sim_compute_robot_state-npc1": 0.07125016621180943, "sim_compute_robot_state-npc2": 0.07379370076315743, "sim_compute_robot_state-npc3": 0.06655193226678031}}
set_robot_commands_max0.10179373741149902
set_robot_commands_mean0.09390235635818436
set_robot_commands_median0.0934708033289228
set_robot_commands_min0.08798848014128835
sim_compute_performance-ego_max0.0762082290649414
sim_compute_performance-ego_mean0.06804474066234226
sim_compute_performance-ego_median0.06668576409545125
sim_compute_performance-ego_min0.06233612696329752
sim_compute_robot_state-ego_max0.08188389028821673
sim_compute_robot_state-ego_mean0.07540137838164178
sim_compute_robot_state-ego_median0.07513675508619863
sim_compute_robot_state-ego_min0.06939459288561786
sim_compute_robot_state-npc0_max0.0743963623046875
sim_compute_robot_state-npc0_mean0.06945911325174696
sim_compute_robot_state-npc0_median0.07103140865053449
sim_compute_robot_state-npc0_min0.06377959251403809
sim_compute_robot_state-npc1_max0.07485847473144532
sim_compute_robot_state-npc1_mean0.06996189147485143
sim_compute_robot_state-npc1_median0.06937612427605523
sim_compute_robot_state-npc1_min0.06602493085359272
sim_compute_robot_state-npc2_max0.07597770690917968
sim_compute_robot_state-npc2_mean0.07142810269042064
sim_compute_robot_state-npc2_median0.06932620939455535
sim_compute_robot_state-npc2_min0.06878949094701696
sim_compute_robot_state-npc3_max0.07454434394836426
sim_compute_robot_state-npc3_mean0.06851842952488535
sim_compute_robot_state-npc3_median0.06655193226678031
sim_compute_robot_state-npc3_min0.0657697055913225
sim_compute_sim_state_max0.043011751174926754
sim_compute_sim_state_mean0.03928822113292047
sim_compute_sim_state_median0.03930593419958044
sim_compute_sim_state_min0.037200209341551126
sim_physics_max0.20505611419677736
sim_physics_mean0.18061644187321896
sim_physics_median0.17613514473563746
sim_physics_min0.1633225988458704
sim_render-ego_max0.06617661476135255
sim_render-ego_mean0.061235948989704546
sim_render-ego_median0.060132625855897605
sim_render-ego_min0.05929947750908988
simulation-passed1
survival_time_max3.949999999999994
survival_time_mean2.6199999999999974
survival_time_min1.2500000000000004
240403830movehoonchallenge-aido_LF-template-pytorchaido2-LFV-sim-testing-offseasonstep1-simulationsuccessyes12910:37:46Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.05619252710304179
survival_time_median1.5500000000000007
deviation-center-line_median0.07150011916070365
in-drivable-lane_median0.6000000000000004


other stats
agent_compute-ego_max0.16363341410954793
agent_compute-ego_mean0.11574671522941628
agent_compute-ego_median0.11757416560732084
agent_compute-ego_min0.09233924058767463
deviation-center-line_max0.67455409294423
deviation-center-line_mean0.2062292765429776
deviation-center-line_min0.0252460442318012
deviation-heading_max5.951946366406269
deviation-heading_mean2.992326580684763
deviation-heading_median0.660032058750875
deviation-heading_min0.475064368099676
driven_any_max1.549300856112976
driven_any_mean0.756381258447249
driven_any_median0.13902285579015622
driven_any_min0.09785778688038418
driven_lanedir_consec_max0.5128275283186512
driven_lanedir_consec_mean0.2448402237322826
driven_lanedir_consec_min0.03539412568615141
driven_lanedir_max0.5128275283186512
driven_lanedir_mean0.2448402237322826
driven_lanedir_median0.05619252710304179
driven_lanedir_min0.03539412568615141
in-drivable-lane_max7.400000000000042
in-drivable-lane_mean3.650000000000019
in-drivable-lane_min0.40000000000000024
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.520449431210659, "sim_physics": 0.15357592344284057, "survival_time": 14.950000000000076, "driven_lanedir": 0.4761497610365853, "sim_render-ego": 0.05812755823135376, "in-drivable-lane": 7.400000000000042, "agent_compute-ego": 0.15606792052586874, "deviation-heading": 5.703725350250262, "set_robot_commands": 0.08969576597213745, "deviation-center-line": 0.67455409294423, "driven_lanedir_consec": 0.4761497610365853, "sim_compute_sim_state": 0.03624515453974406, "sim_compute_performance-ego": 0.06333513975143433, "sim_compute_robot_state-ego": 0.0677087124188741, "sim_compute_robot_state-npc0": 0.06804217179616293, "sim_compute_robot_state-npc1": 0.06287844101587932, "sim_compute_robot_state-npc2": 0.06436240275700887, "sim_compute_robot_state-npc3": 0.06611492077509562}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.5007181505792806, "sim_physics": 0.15405097166697185, "survival_time": 14.950000000000076, "driven_lanedir": 0.5128275283186512, "sim_render-ego": 0.056550753911336266, "in-drivable-lane": 7.250000000000039, "agent_compute-ego": 0.16363341410954793, "deviation-heading": 5.951946366406269, "set_robot_commands": 0.08858625888824463, "deviation-center-line": 0.6486559452884139, "driven_lanedir_consec": 0.5128275283186512, "sim_compute_sim_state": 0.03634945392608643, "sim_compute_performance-ego": 0.06272190332412719, "sim_compute_robot_state-ego": 0.06941298802693685, "sim_compute_robot_state-npc0": 0.06595839897791544, "sim_compute_robot_state-npc1": 0.0645911447207133, "sim_compute_robot_state-npc2": 0.06565740585327148, "sim_compute_robot_state-npc3": 0.06607284625371297}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.11253832201412475, "sim_physics": 0.1473619054864954, "survival_time": 1.3500000000000003, "driven_lanedir": 0.03932019861766678, "sim_render-ego": 0.06759012186968769, "in-drivable-lane": 0.40000000000000024, "agent_compute-ego": 0.13401043856585468, "deviation-heading": 0.4791709020455639, "set_robot_commands": 0.0827018243295175, "deviation-center-line": 0.07150011916070365, "driven_lanedir_consec": 0.03932019861766678, "sim_compute_sim_state": 0.02831494366681134, "sim_compute_performance-ego": 0.05273879015887225, "sim_compute_robot_state-ego": 0.054263282705236365, "sim_compute_robot_state-npc0": 0.050477036723384154, "sim_compute_robot_state-npc1": 0.04830805460611979, "sim_compute_robot_state-npc2": 0.051373702508431894, "sim_compute_robot_state-npc3": 0.04924785649334943}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.09785778688038418, "sim_physics": 0.12603880677904403, "survival_time": 1.4000000000000006, "driven_lanedir": 0.03658928646741266, "sim_render-ego": 0.03883779048919678, "in-drivable-lane": 0.4500000000000003, "agent_compute-ego": 0.12104438883917672, "deviation-heading": 0.475064368099676, "set_robot_commands": 0.06639944655554635, "deviation-center-line": 0.06487951268102517, "driven_lanedir_consec": 0.03658928646741266, "sim_compute_sim_state": 0.02553622211728777, "sim_compute_performance-ego": 0.040439026696341376, "sim_compute_robot_state-ego": 0.04547431639262608, "sim_compute_robot_state-npc0": 0.046820376600537984, "sim_compute_robot_state-npc1": 0.04576652390616281, "sim_compute_robot_state-npc2": 0.04686811140605381, "sim_compute_robot_state-npc3": 0.045682319572993686}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.13902285579015622, "sim_physics": 0.11336714990677373, "survival_time": 1.5500000000000007, "driven_lanedir": 0.04511625552223309, "sim_render-ego": 0.04513412906277564, "in-drivable-lane": 0.6000000000000004, "agent_compute-ego": 0.130077761988486, "deviation-heading": 0.660032058750875, "set_robot_commands": 0.07208092751041535, "deviation-center-line": 0.0252460442318012, "driven_lanedir_consec": 0.04511625552223309, "sim_compute_sim_state": 0.030574229455763293, "sim_compute_performance-ego": 0.047448519737489765, "sim_compute_robot_state-ego": 0.052729491264589375, "sim_compute_robot_state-npc0": 0.05188827360829999, "sim_compute_robot_state-npc1": 0.05176391140107186, "sim_compute_robot_state-npc2": 0.053771018981933594, "sim_compute_robot_state-npc3": 0.053046787938764016}, "ETHZ_autolab_technical_track-5-0": {"driven_any": 1.5231332255954098, "sim_physics": 0.11337181488672891, "survival_time": 14.950000000000076, "driven_lanedir": 0.46154987075899934, "sim_render-ego": 0.04284192403157552, "in-drivable-lane": 7.250000000000042, "agent_compute-ego": 0.1198224933942159, "deviation-heading": 5.846279732457238, "set_robot_commands": 0.06863049030303955, "deviation-center-line": 0.19487592557061875, "driven_lanedir_consec": 0.46154987075899934, "sim_compute_sim_state": 0.027536209424336752, "sim_compute_performance-ego": 0.04710146347681681, "sim_compute_robot_state-ego": 0.04930564324061076, "sim_compute_robot_state-npc0": 0.05037042856216431, "sim_compute_robot_state-npc1": 0.04956636110941569, "sim_compute_robot_state-npc2": 0.04895167509714762, "sim_compute_robot_state-npc3": 0.04918215433756511}, "ETHZ_autolab_technical_track-6-0": {"driven_any": 0.12250839159386852, "sim_physics": 0.12772474617793642, "survival_time": 1.4500000000000006, "driven_lanedir": 0.05619252710304179, "sim_render-ego": 0.04367977175219306, "in-drivable-lane": 0.4500000000000004, "agent_compute-ego": 0.13004909712692786, "deviation-heading": 0.5552112406757185, "set_robot_commands": 0.0724709938312399, "deviation-center-line": 0.06029425998802036, "driven_lanedir_consec": 0.05619252710304179, "sim_compute_sim_state": 0.029237969168301285, "sim_compute_performance-ego": 0.048412692957911, "sim_compute_robot_state-ego": 0.05017775502698175, "sim_compute_robot_state-npc0": 0.05222282738521181, "sim_compute_robot_state-npc1": 0.04961733160347774, "sim_compute_robot_state-npc2": 0.048100372840618265, "sim_compute_robot_state-npc3": 0.04701910347774111}, "ETHZ_autolab_technical_track-7-0": {"driven_any": 0.11630928031024144, "sim_physics": 0.11538097776215651, "survival_time": 1.4500000000000006, "driven_lanedir": 0.0474967363266976, "sim_render-ego": 0.03910641834653657, "in-drivable-lane": 0.4500000000000004, "agent_compute-ego": 0.11757416560732084, "deviation-heading": 0.5030055899666701, "set_robot_commands": 0.06500858273999445, "deviation-center-line": 0.06487076640014555, "driven_lanedir_consec": 0.0474967363266976, "sim_compute_sim_state": 0.025905395376271213, "sim_compute_performance-ego": 0.04349142107470282, "sim_compute_robot_state-ego": 0.04523434310123838, "sim_compute_robot_state-npc0": 0.04470735582812079, "sim_compute_robot_state-npc1": 0.04745567256006701, "sim_compute_robot_state-npc2": 0.04347459201155038, "sim_compute_robot_state-npc3": 0.04311674216697956}, "ETHZ_autolab_technical_track-8-0": {"driven_any": 1.4173505343595274, "sim_physics": 0.08691491921742757, "survival_time": 14.950000000000076, "driven_lanedir": 0.4648112553924002, "sim_render-ego": 0.03542586167653402, "in-drivable-lane": 7.250000000000042, "agent_compute-ego": 0.09706971089045206, "deviation-heading": 5.70587525882846, "set_robot_commands": 0.05512343883514404, "deviation-center-line": 0.17941614396429134, "driven_lanedir_consec": 0.4648112553924002, "sim_compute_sim_state": 0.02249463478724162, "sim_compute_performance-ego": 0.0382056721051534, "sim_compute_robot_state-ego": 0.04035648028055827, "sim_compute_robot_state-npc0": 0.040192278226216634, "sim_compute_robot_state-npc1": 0.04291801611582438, "sim_compute_robot_state-npc2": 0.039559539953867594, "sim_compute_robot_state-npc3": 0.03960151354471842}, "ETHZ_autolab_technical_track-9-0": {"driven_any": 1.549300856112976, "sim_physics": 0.08637301524480184, "survival_time": 14.950000000000076, "driven_lanedir": 0.5021161672433161, "sim_render-ego": 0.03440210501352946, "in-drivable-lane": 7.250000000000042, "agent_compute-ego": 0.09415711164474488, "deviation-heading": 5.914564142579523, "set_robot_commands": 0.05417873064676921, "deviation-center-line": 0.2599067842059366, "driven_lanedir_consec": 0.5021161672433161, "sim_compute_sim_state": 0.021880664825439457, "sim_compute_performance-ego": 0.03747548818588257, "sim_compute_robot_state-ego": 0.0396323815981547, "sim_compute_robot_state-npc0": 0.03898825883865356, "sim_compute_robot_state-npc1": 0.03846743901570638, "sim_compute_robot_state-npc2": 0.03816656986872355, "sim_compute_robot_state-npc3": 0.03838402430216471}, "ETHZ_autolab_technical_track-10-0": {"driven_any": 1.4753623571873176, "sim_physics": 0.08769421946721447, "survival_time": 14.850000000000076, "driven_lanedir": 0.43921059175913646, "sim_render-ego": 0.03594921494172478, "in-drivable-lane": 7.400000000000042, "agent_compute-ego": 0.09418090104254008, "deviation-heading": 5.785997466850599, "set_robot_commands": 0.05346408355918396, "deviation-center-line": 0.16129015706442756, "driven_lanedir_consec": 0.43921059175913646, "sim_compute_sim_state": 0.02190391222635905, "sim_compute_performance-ego": 0.037550302466960866, "sim_compute_robot_state-ego": 0.04084114675168638, "sim_compute_robot_state-npc0": 0.03899870496807677, "sim_compute_robot_state-npc1": 0.038403901186856354, "sim_compute_robot_state-npc2": 0.03838756670454135, "sim_compute_robot_state-npc3": 0.03856651068536521}, "ETHZ_autolab_technical_track-11-0": {"driven_any": 0.1062414247922028, "sim_physics": 0.08574439929081844, "survival_time": 1.3000000000000005, "driven_lanedir": 0.03539412568615141, "sim_render-ego": 0.03405158336345966, "in-drivable-lane": 0.40000000000000024, "agent_compute-ego": 0.09233924058767463, "deviation-heading": 0.5469586710936079, "set_robot_commands": 0.05391481289496789, "deviation-center-line": 0.06768869117415303, "driven_lanedir_consec": 0.03539412568615141, "sim_compute_sim_state": 0.02190543138063871, "sim_compute_performance-ego": 0.03741241418398344, "sim_compute_robot_state-ego": 0.0394969811806312, "sim_compute_robot_state-npc0": 0.038795021864084095, "sim_compute_robot_state-npc1": 0.038312636888944186, "sim_compute_robot_state-npc2": 0.03814960443056547, "sim_compute_robot_state-npc3": 0.03826470558459942}, "ETHZ_autolab_technical_track-12-0": {"driven_any": 1.4144272744009805, "sim_physics": 0.0870790688196818, "survival_time": 14.950000000000076, "driven_lanedir": 0.4637785754440843, "sim_render-ego": 0.0348508087793986, "in-drivable-lane": 7.35000000000004, "agent_compute-ego": 0.09484684546788534, "deviation-heading": 5.626897126940251, "set_robot_commands": 0.05315001885096232, "deviation-center-line": 0.4964700492703755, "driven_lanedir_consec": 0.4637785754440843, "sim_compute_sim_state": 0.021866169770558674, "sim_compute_performance-ego": 0.03748757123947143, "sim_compute_robot_state-ego": 0.03958635171254476, "sim_compute_robot_state-npc0": 0.0388403590520223, "sim_compute_robot_state-npc1": 0.038857120672861734, "sim_compute_robot_state-npc2": 0.03832295020421346, "sim_compute_robot_state-npc3": 0.03830404837926229}, "ETHZ_autolab_technical_track-13-0": {"driven_any": 0.12083257660815765, "sim_physics": 0.08946015153612409, "survival_time": 1.4000000000000006, "driven_lanedir": 0.042197402673734175, "sim_render-ego": 0.03497825350080218, "in-drivable-lane": 0.4500000000000003, "agent_compute-ego": 0.0966081704412188, "deviation-heading": 0.5229829866540693, "set_robot_commands": 0.053070204598563056, "deviation-center-line": 0.061918832249083615, "driven_lanedir_consec": 0.042197402673734175, "sim_compute_sim_state": 0.02204619986670358, "sim_compute_performance-ego": 0.03740223816462925, "sim_compute_robot_state-ego": 0.03991428443363735, "sim_compute_robot_state-npc0": 0.03886995996747698, "sim_compute_robot_state-npc1": 0.03862914868763515, "sim_compute_robot_state-npc2": 0.0382178681237357, "sim_compute_robot_state-npc3": 0.03828510216304234}, "ETHZ_autolab_technical_track-14-0": {"driven_any": 0.12966640927345294, "sim_physics": 0.0859628438949585, "survival_time": 1.5000000000000009, "driven_lanedir": 0.04985307363412872, "sim_render-ego": 0.03415618737538655, "in-drivable-lane": 0.4000000000000003, "agent_compute-ego": 0.09471906820933024, "deviation-heading": 0.6071874486726682, "set_robot_commands": 0.052899408340454104, "deviation-center-line": 0.06187182395143777, "driven_lanedir_consec": 0.04985307363412872, "sim_compute_sim_state": 0.02197280724843343, "sim_compute_performance-ego": 0.03885881900787354, "sim_compute_robot_state-ego": 0.039401976267496745, "sim_compute_robot_state-npc0": 0.03872841993967692, "sim_compute_robot_state-npc1": 0.038318204879760745, "sim_compute_robot_state-npc2": 0.038157113393147785, "sim_compute_robot_state-npc3": 0.038229330380757647}}
set_robot_commands_max0.08969576597213745
set_robot_commands_mean0.06542499919041199
set_robot_commands_median0.06500858273999445
set_robot_commands_min0.052899408340454104
sim_compute_performance-ego_max0.06333513975143433
sim_compute_performance-ego_mean0.044672097502110014
sim_compute_performance-ego_median0.040439026696341376
sim_compute_performance-ego_min0.03740223816462925
sim_compute_robot_state-ego_max0.06941298802693685
sim_compute_robot_state-ego_mean0.047569075626786875
sim_compute_robot_state-ego_median0.04523434310123838
sim_compute_robot_state-ego_min0.039401976267496745
sim_compute_robot_state-npc0_max0.06804217179616293
sim_compute_robot_state-npc0_mean0.04692665815586698
sim_compute_robot_state-npc0_median0.04470735582812079
sim_compute_robot_state-npc0_min0.03872841993967692
sim_compute_robot_state-npc1_max0.0645911447207133
sim_compute_robot_state-npc1_mean0.046256927224699755
sim_compute_robot_state-npc1_median0.04576652390616281
sim_compute_robot_state-npc1_min0.038312636888944186
sim_compute_robot_state-npc2_max0.06565740585327148
sim_compute_robot_state-npc2_mean0.04610136627565406
sim_compute_robot_state-npc2_median0.04347459201155038
sim_compute_robot_state-npc2_min0.03814960443056547
sim_compute_robot_state-npc3_max0.06611492077509562
sim_compute_robot_state-npc3_mean0.04594119773707409
sim_compute_robot_state-npc3_median0.04311674216697956
sim_compute_robot_state-npc3_min0.038229330380757647
sim_compute_sim_state_max0.03634945392608643
sim_compute_sim_state_mean0.026251293185331776
sim_compute_sim_state_median0.02553622211728777
sim_compute_sim_state_min0.021866169770558674
sim_physics_max0.15405097166697185
sim_physics_mean0.11067339423866496
sim_physics_median0.11336714990677373
sim_physics_min0.08574439929081844
sim_render-ego_max0.06759012186968769
sim_render-ego_mean0.04237883215636603
sim_render-ego_median0.03883779048919678
sim_render-ego_min0.03405158336345966
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean7.730000000000036
survival_time_min1.3000000000000005
240373834movehoonchallenge-aido_LF-template-pytorchaido2-LFVI-sim-validation-offseasonstep1-simulationsuccessyes12910:05:52Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.07383424331709154
survival_time_median1.3500000000000003
deviation-center-line_median0.05705265581440869
in-drivable-lane_median0.30000000000000027


other stats
agent_compute-ego_max0.17874737467084612
agent_compute-ego_mean0.1606283118232848
agent_compute-ego_median0.1673769746507917
agent_compute-ego_min0.12412693765428331
deviation-center-line_max0.09818380750852644
deviation-center-line_mean0.0677207387718659
deviation-center-line_min0.03656547923061833
deviation-heading_max0.7771855002132214
deviation-heading_mean0.6583715316956857
deviation-heading_median0.6682300029207968
deviation-heading_min0.5403861725297875
driven_any_max0.20784381121866372
driven_any_mean0.15914885559001862
driven_any_median0.1417168846318984
driven_any_min0.12319961026820576
driven_lanedir_consec_max0.0953976952757818
driven_lanedir_consec_mean0.07130341266563955
driven_lanedir_consec_min0.0436590552126539
driven_lanedir_max0.0953976952757818
driven_lanedir_mean0.07130341266563955
driven_lanedir_median0.07383424331709154
driven_lanedir_min0.0436590552126539
in-drivable-lane_max0.7500000000000007
in-drivable-lane_mean0.3400000000000003
in-drivable-lane_min0
per-episodes
details{"udem1-0-0": {"driven_any": 0.20784381121866372, "sim_physics": 0.16911689213344028, "survival_time": 1.7500000000000009, "driven_lanedir": 0.07383424331709154, "sim_render-ego": 0.05449119976588658, "in-drivable-lane": 0.6500000000000006, "agent_compute-ego": 0.17874737467084612, "deviation-heading": 0.6682300029207968, "set_robot_commands": 0.09517807279314314, "deviation-center-line": 0.05705265581440869, "driven_lanedir_consec": 0.07383424331709154, "sim_compute_sim_state": 0.03626397677830288, "sim_compute_performance-ego": 0.06300899641854422, "sim_compute_robot_state-ego": 0.06642934254237584, "sim_compute_robot_state-npc0": 0.06494290488106864, "sim_compute_robot_state-npc1": 0.06091593333653041, "sim_compute_robot_state-npc2": 0.06288292067391532, "sim_compute_robot_state-npc3": 0.07792319570268903}, "udem1-1-0": {"driven_any": 0.19357951605083903, "sim_physics": 0.199284873689924, "survival_time": 1.7500000000000009, "driven_lanedir": 0.0436590552126539, "sim_render-ego": 0.05764995983668736, "in-drivable-lane": 0.7500000000000007, "agent_compute-ego": 0.1673769746507917, "deviation-heading": 0.7771855002132214, "set_robot_commands": 0.0989567416054862, "deviation-center-line": 0.05316634304862935, "driven_lanedir_consec": 0.0436590552126539, "sim_compute_sim_state": 0.03772200856889997, "sim_compute_performance-ego": 0.06320146151951381, "sim_compute_robot_state-ego": 0.07055085727146694, "sim_compute_robot_state-npc0": 0.06637706075395856, "sim_compute_robot_state-npc1": 0.06363024711608886, "sim_compute_robot_state-npc2": 0.06438001905168805, "sim_compute_robot_state-npc3": 0.06601973942347936}, "udem1-2-0": {"driven_any": 0.12319961026820576, "sim_physics": 0.2378211228743843, "survival_time": 1.1500000000000004, "driven_lanedir": 0.0909348778873702, "sim_render-ego": 0.05719819276229195, "in-drivable-lane": 0, "agent_compute-ego": 0.16761250081269638, "deviation-heading": 0.5500801984102511, "set_robot_commands": 0.0926177916319474, "deviation-center-line": 0.09818380750852644, "driven_lanedir_consec": 0.0909348778873702, "sim_compute_sim_state": 0.037220571352087936, "sim_compute_performance-ego": 0.06499089365420134, "sim_compute_robot_state-ego": 0.07251958225084387, "sim_compute_robot_state-npc0": 0.0686053296794062, "sim_compute_robot_state-npc1": 0.06713612183280614, "sim_compute_robot_state-npc2": 0.06670742449553116, "sim_compute_robot_state-npc3": 0.06639506505883258}, "udem1-3-0": {"driven_any": 0.1294044557804862, "sim_physics": 0.1794763129690419, "survival_time": 1.1500000000000004, "driven_lanedir": 0.0953976952757818, "sim_render-ego": 0.05026697075885275, "in-drivable-lane": 0, "agent_compute-ego": 0.16527777132780655, "deviation-heading": 0.5403861725297875, "set_robot_commands": 0.08696698105853537, "deviation-center-line": 0.09363540825714668, "driven_lanedir_consec": 0.0953976952757818, "sim_compute_sim_state": 0.03274481192879055, "sim_compute_performance-ego": 0.05597413104513417, "sim_compute_robot_state-ego": 0.06083795298700747, "sim_compute_robot_state-npc0": 0.06421364908633025, "sim_compute_robot_state-npc1": 0.06535506248474121, "sim_compute_robot_state-npc2": 0.06313301169353983, "sim_compute_robot_state-npc3": 0.07008324498715608}, "udem1-4-0": {"driven_any": 0.1417168846318984, "sim_physics": 0.13775081987734197, "survival_time": 1.3500000000000003, "driven_lanedir": 0.05269119163530034, "sim_render-ego": 0.04435784728438766, "in-drivable-lane": 0.30000000000000027, "agent_compute-ego": 0.12412693765428331, "deviation-heading": 0.7559757844043717, "set_robot_commands": 0.0783363801461679, "deviation-center-line": 0.03656547923061833, "driven_lanedir_consec": 0.05269119163530034, "sim_compute_sim_state": 0.030198229683770075, "sim_compute_performance-ego": 0.04664537641737196, "sim_compute_robot_state-ego": 0.05089267094930013, "sim_compute_robot_state-npc0": 0.05352564211244936, "sim_compute_robot_state-npc1": 0.04939112839875398, "sim_compute_robot_state-npc2": 0.050411109571103695, "sim_compute_robot_state-npc3": 0.050608414190786856}}
set_robot_commands_max0.0989567416054862
set_robot_commands_mean0.090411193447056
set_robot_commands_median0.0926177916319474
set_robot_commands_min0.0783363801461679
sim_compute_performance-ego_max0.06499089365420134
sim_compute_performance-ego_mean0.0587641718109531
sim_compute_performance-ego_median0.06300899641854422
sim_compute_performance-ego_min0.04664537641737196
sim_compute_robot_state-ego_max0.07251958225084387
sim_compute_robot_state-ego_mean0.06424608120019884
sim_compute_robot_state-ego_median0.06642934254237584
sim_compute_robot_state-ego_min0.05089267094930013
sim_compute_robot_state-npc0_max0.0686053296794062
sim_compute_robot_state-npc0_mean0.06353291730264261
sim_compute_robot_state-npc0_median0.06494290488106864
sim_compute_robot_state-npc0_min0.05352564211244936
sim_compute_robot_state-npc1_max0.06713612183280614
sim_compute_robot_state-npc1_mean0.06128569863378412
sim_compute_robot_state-npc1_median0.06363024711608886
sim_compute_robot_state-npc1_min0.04939112839875398
sim_compute_robot_state-npc2_max0.06670742449553116
sim_compute_robot_state-npc2_mean0.0615028970971556
sim_compute_robot_state-npc2_median0.06313301169353983
sim_compute_robot_state-npc2_min0.050411109571103695
sim_compute_robot_state-npc3_max0.07792319570268903
sim_compute_robot_state-npc3_mean0.06620593187258879
sim_compute_robot_state-npc3_median0.06639506505883258
sim_compute_robot_state-npc3_min0.050608414190786856
sim_compute_sim_state_max0.03772200856889997
sim_compute_sim_state_mean0.03482991966237028
sim_compute_sim_state_median0.03626397677830288
sim_compute_sim_state_min0.030198229683770075
sim_physics_max0.2378211228743843
sim_physics_mean0.18469000430882648
sim_physics_median0.1794763129690419
sim_physics_min0.13775081987734197
sim_render-ego_max0.05764995983668736
sim_render-ego_mean0.052792834081621255
sim_render-ego_median0.05449119976588658
sim_render-ego_min0.04435784728438766
simulation-passed1
survival_time_max1.7500000000000009
survival_time_mean1.4300000000000006
survival_time_min1.1500000000000004
240353825dcharrezPredictorLastaido2-PREDstep1-simulationsuccessno12910:00:30Hidden. If you are the author, please login using the top-right link or use the dashboard.
error_L10.1263750130726308
error_L20.023816452751950105


240303824movehoonPredictorLastaido2-PREDstep1-simulationsuccessno12910:00:28Hidden. If you are the author, please login using the top-right link or use the dashboard.
error_L10.11856790268534818
error_L20.02192530636895919


240253819Philippe LaferrièrePredictorLastaido2-PREDstep1-simulationsuccessno12910:00:30Hidden. If you are the author, please login using the top-right link or use the dashboard.
error_L10.11536419350005156
error_L20.021206786063720628


240213811AmaurXLet's do this one todayaido2-LFV-sim-testing-offseasonstep1-simulationsuccessyes12910:20:09Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.47061816984274774
survival_time_median2.4499999999999993
deviation-center-line_median0.09047885846140293
in-drivable-lane_median0.7999999999999974


other stats
agent_compute-ego_max0.15490049362182615
agent_compute-ego_mean0.1456960371013701
agent_compute-ego_median0.14437071323394776
agent_compute-ego_min0.13737282947618135
deviation-center-line_max0.1743913456502906
deviation-center-line_mean0.11122054568266285
deviation-center-line_min0.05649185041622204
deviation-heading_max0.8583234710357402
deviation-heading_mean0.371509805944231
deviation-heading_median0.3477435217829391
deviation-heading_min0.1892537419842091
driven_any_max1.6169932854589035
driven_any_mean0.8549136794030617
driven_any_median0.9441796518284096
driven_any_min0.28668385087664994
driven_lanedir_consec_max1.2433038249708377
driven_lanedir_consec_mean0.5622432991481365
driven_lanedir_consec_min0.24216121529728207
driven_lanedir_max1.2433038249708377
driven_lanedir_mean0.5622432991481365
driven_lanedir_median0.47061816984274774
driven_lanedir_min0.24216121529728207
in-drivable-lane_max1.3499999999999996
in-drivable-lane_mean0.5899999999999992
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0243289631429708, "sim_physics": 0.14457240811100713, "survival_time": 2.6999999999999984, "driven_lanedir": 0.5723310224856362, "sim_render-ego": 0.054441346062554255, "in-drivable-lane": 0.9999999999999976, "agent_compute-ego": 0.1380183387685705, "deviation-heading": 0.19401296908406307, "set_robot_commands": 0.08253905949769197, "deviation-center-line": 0.15907928712407893, "driven_lanedir_consec": 0.5723310224856362, "sim_compute_sim_state": 0.03582359684838189, "sim_compute_performance-ego": 0.06477907410374394, "sim_compute_robot_state-ego": 0.06567731610050907, "sim_compute_robot_state-npc0": 0.062410694581490976, "sim_compute_robot_state-npc1": 0.05984913419794153, "sim_compute_robot_state-npc2": 0.059104857621369536, "sim_compute_robot_state-npc3": 0.0693692719494855}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.4119037580118998, "sim_physics": 0.1896437549591065, "survival_time": 1.2500000000000004, "driven_lanedir": 0.3792793194470208, "sim_render-ego": 0.0549664306640625, "in-drivable-lane": 0, "agent_compute-ego": 0.1511079978942871, "deviation-heading": 0.47860435001913393, "set_robot_commands": 0.09153096199035644, "deviation-center-line": 0.09344288799285194, "driven_lanedir_consec": 0.3792793194470208, "sim_compute_sim_state": 0.035165834426879886, "sim_compute_performance-ego": 0.0656983184814453, "sim_compute_robot_state-ego": 0.07345609664916992, "sim_compute_robot_state-npc0": 0.06581464767456055, "sim_compute_robot_state-npc1": 0.0680873966217041, "sim_compute_robot_state-npc2": 0.0686650276184082, "sim_compute_robot_state-npc3": 0.06469029426574707}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.579862082650716, "sim_physics": 0.18416582283220792, "survival_time": 3.7999999999999945, "driven_lanedir": 1.2433038249708377, "sim_render-ego": 0.06020417338923404, "in-drivable-lane": 0.5999999999999979, "agent_compute-ego": 0.1547418707295468, "deviation-heading": 0.5020407942599273, "set_robot_commands": 0.09182849369551006, "deviation-center-line": 0.1743913456502906, "driven_lanedir_consec": 1.2433038249708377, "sim_compute_sim_state": 0.03796993431292082, "sim_compute_performance-ego": 0.06892933343586169, "sim_compute_robot_state-ego": 0.07456099045904059, "sim_compute_robot_state-npc0": 0.06911055978975798, "sim_compute_robot_state-npc1": 0.06830665312315289, "sim_compute_robot_state-npc2": 0.06938967892998144, "sim_compute_robot_state-npc3": 0.06763688200398495}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.6169932854589035, "sim_physics": 0.1758499930176554, "survival_time": 3.949999999999994, "driven_lanedir": 1.2126117310470583, "sim_render-ego": 0.05715300463422944, "in-drivable-lane": 0.849999999999997, "agent_compute-ego": 0.14191963401021837, "deviation-heading": 0.34764983431811214, "set_robot_commands": 0.0884618065025233, "deviation-center-line": 0.11519544839797546, "driven_lanedir_consec": 1.2126117310470583, "sim_compute_sim_state": 0.03715092320985432, "sim_compute_performance-ego": 0.06487847581694398, "sim_compute_robot_state-ego": 0.0688384062127222, "sim_compute_robot_state-npc0": 0.06655381601068038, "sim_compute_robot_state-npc1": 0.0637691292581679, "sim_compute_robot_state-npc2": 0.06270368793342687, "sim_compute_robot_state-npc3": 0.06492069099522844}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.5031772882846431, "sim_physics": 0.18644426550183976, "survival_time": 1.4000000000000006, "driven_lanedir": 0.4926325270527603, "sim_render-ego": 0.06348412377493722, "in-drivable-lane": 0, "agent_compute-ego": 0.14642901931490218, "deviation-heading": 0.29868161596444953, "set_robot_commands": 0.09115604843412128, "deviation-center-line": 0.09047885846140293, "driven_lanedir_consec": 0.4926325270527603, "sim_compute_sim_state": 0.03799478496823992, "sim_compute_performance-ego": 0.07842214618410383, "sim_compute_robot_state-ego": 0.08461907080241612, "sim_compute_robot_state-npc0": 0.06538815157754081, "sim_compute_robot_state-npc1": 0.06816862310682024, "sim_compute_robot_state-npc2": 0.0801080550466265, "sim_compute_robot_state-npc3": 0.0691582305090768}, "ETHZ_autolab_technical_track-5-0": {"driven_any": 1.0440585337030532, "sim_physics": 0.17198358641730416, "survival_time": 2.6999999999999984, "driven_lanedir": 0.5009536316076031, "sim_render-ego": 0.05898628411469636, "in-drivable-lane": 1.0000000000000009, "agent_compute-ego": 0.1540774769253201, "deviation-heading": 0.8583234710357402, "set_robot_commands": 0.09305791060129802, "deviation-center-line": 0.1636702708892767, "driven_lanedir_consec": 0.5009536316076031, "sim_compute_sim_state": 0.037748230828179255, "sim_compute_performance-ego": 0.06823840847721806, "sim_compute_robot_state-ego": 0.07831386283591941, "sim_compute_robot_state-npc0": 0.06665530469682482, "sim_compute_robot_state-npc1": 0.06747843159569634, "sim_compute_robot_state-npc2": 0.06419946529247143, "sim_compute_robot_state-npc3": 0.0622190413651643}, "ETHZ_autolab_technical_track-6-0": {"driven_any": 1.045672984989961, "sim_physics": 0.1580219754466304, "survival_time": 2.6999999999999984, "driven_lanedir": 0.636422849544542, "sim_render-ego": 0.05955469166790998, "in-drivable-lane": 0.7999999999999974, "agent_compute-ego": 0.14819739041505037, "deviation-heading": 0.39273667682101354, "set_robot_commands": 0.09131286320862948, "deviation-center-line": 0.08970073753261001, "driven_lanedir_consec": 0.636422849544542, "sim_compute_sim_state": 0.038524349530537925, "sim_compute_performance-ego": 0.06429988366586191, "sim_compute_robot_state-ego": 0.07411954579529939, "sim_compute_robot_state-npc0": 0.07103748674745913, "sim_compute_robot_state-npc1": 0.06879680686526829, "sim_compute_robot_state-npc2": 0.06804309950934516, "sim_compute_robot_state-npc3": 0.0676783941410206}, "ETHZ_autolab_technical_track-7-0": {"driven_any": 0.877256228857091, "sim_physics": 0.18525716463724773, "survival_time": 2.25, "driven_lanedir": 0.38713958773684665, "sim_render-ego": 0.055891826417711045, "in-drivable-lane": 0.9999999999999996, "agent_compute-ego": 0.14014821582370335, "deviation-heading": 0.384474040685185, "set_robot_commands": 0.08578039275275337, "deviation-center-line": 0.07500609722918031, "driven_lanedir_consec": 0.38713958773684665, "sim_compute_sim_state": 0.03633508152431912, "sim_compute_performance-ego": 0.06373834080166287, "sim_compute_robot_state-ego": 0.06935877799987793, "sim_compute_robot_state-npc0": 0.06444903479682075, "sim_compute_robot_state-npc1": 0.06377460161844889, "sim_compute_robot_state-npc2": 0.06452424791124133, "sim_compute_robot_state-npc3": 0.06049550374348958}, "ETHZ_autolab_technical_track-8-0": {"driven_any": 0.8433010974171573, "sim_physics": 0.15554473711096722, "survival_time": 2.3, "driven_lanedir": 0.24216121529728207, "sim_render-ego": 0.0547945032949033, "in-drivable-lane": 1.3499999999999996, "agent_compute-ego": 0.14252261493517004, "deviation-heading": 0.34566993689777425, "set_robot_commands": 0.08384197691212529, "deviation-center-line": 0.07136114712800473, "driven_lanedir_consec": 0.24216121529728207, "sim_compute_sim_state": 0.03499943277110224, "sim_compute_performance-ego": 0.063835885213769, "sim_compute_robot_state-ego": 0.06966765548871912, "sim_compute_robot_state-npc0": 0.060037846150605576, "sim_compute_robot_state-npc1": 0.06194913905599843, "sim_compute_robot_state-npc2": 0.061233359834422234, "sim_compute_robot_state-npc3": 0.06351341890252155}, "ETHZ_autolab_technical_track-9-0": {"driven_any": 0.9785013113851152, "sim_physics": 0.17428080558776857, "survival_time": 2.499999999999999, "driven_lanedir": 0.9700080716683566, "sim_render-ego": 0.05718729972839356, "in-drivable-lane": 0, "agent_compute-ego": 0.14437071323394776, "deviation-heading": 0.3477435217829391, "set_robot_commands": 0.09319132328033448, "deviation-center-line": 0.15723242276422936, "driven_lanedir_consec": 0.9700080716683566, "sim_compute_sim_state": 0.03674973487854004, "sim_compute_performance-ego": 0.06508312702178955, "sim_compute_robot_state-ego": 0.0697386360168457, "sim_compute_robot_state-npc0": 0.06593659400939941, "sim_compute_robot_state-npc1": 0.06584096908569335, "sim_compute_robot_state-npc2": 0.06328247547149658, "sim_compute_robot_state-npc3": 0.06283201694488526}, "ETHZ_autolab_technical_track-10-0": {"driven_any": 0.3129292149411446, "sim_physics": 0.19032766819000244, "survival_time": 1.0000000000000002, "driven_lanedir": 0.2864579763812336, "sim_render-ego": 0.054708456993103026, "in-drivable-lane": 0, "agent_compute-ego": 0.1379152297973633, "deviation-heading": 0.38016104491567027, "set_robot_commands": 0.08132275342941284, "deviation-center-line": 0.05649185041622204, "driven_lanedir_consec": 0.2864579763812336, "sim_compute_sim_state": 0.03937950134277344, "sim_compute_performance-ego": 0.056161558628082274, "sim_compute_robot_state-ego": 0.06101411581039429, "sim_compute_robot_state-npc0": 0.06086570024490357, "sim_compute_robot_state-npc1": 0.060111498832702635, "sim_compute_robot_state-npc2": 0.060692989826202394, "sim_compute_robot_state-npc3": 0.06275250911712646}, "ETHZ_autolab_technical_track-11-0": {"driven_any": 0.28668385087664994, "sim_physics": 0.1837275404679148, "survival_time": 0.9500000000000004, "driven_lanedir": 0.278237107094367, "sim_render-ego": 0.057871529930516294, "in-drivable-lane": 0, "agent_compute-ego": 0.14319327003077456, "deviation-heading": 0.19732996798555608, "set_robot_commands": 0.09725716239527651, "deviation-center-line": 0.08671144489080887, "driven_lanedir_consec": 0.278237107094367, "sim_compute_sim_state": 0.038558156866776314, "sim_compute_performance-ego": 0.06474228909141139, "sim_compute_robot_state-ego": 0.06653420548689992, "sim_compute_robot_state-npc0": 0.06477884242409154, "sim_compute_robot_state-npc1": 0.06340068265011436, "sim_compute_robot_state-npc2": 0.06229994171544125, "sim_compute_robot_state-npc3": 0.06110197619387978}, "ETHZ_autolab_technical_track-12-0": {"driven_any": 1.0034139953700494, "sim_physics": 0.1596747589111328, "survival_time": 2.499999999999999, "driven_lanedir": 0.47061816984274774, "sim_render-ego": 0.06129908084869385, "in-drivable-lane": 1.1499999999999986, "agent_compute-ego": 0.15490049362182615, "deviation-heading": 0.2263485117662671, "set_robot_commands": 0.09682887077331542, "deviation-center-line": 0.1594122934983136, "driven_lanedir_consec": 0.47061816984274774, "sim_compute_sim_state": 0.03829436302185059, "sim_compute_performance-ego": 0.06720079898834229, "sim_compute_robot_state-ego": 0.07471795082092285, "sim_compute_robot_state-npc0": 0.07501360416412353, "sim_compute_robot_state-npc1": 0.06613888263702393, "sim_compute_robot_state-npc2": 0.06960060119628907, "sim_compute_robot_state-npc3": 0.0668506669998169}, "ETHZ_autolab_technical_track-13-0": {"driven_any": 0.351442944128162, "sim_physics": 0.1979970173402266, "survival_time": 1.1000000000000003, "driven_lanedir": 0.34114611245347204, "sim_render-ego": 0.06210316311229359, "in-drivable-lane": 0, "agent_compute-ego": 0.15052546154369006, "deviation-heading": 0.1892537419842091, "set_robot_commands": 0.09406846219843085, "deviation-center-line": 0.08918370733714856, "driven_lanedir_consec": 0.34114611245347204, "sim_compute_sim_state": 0.03684248707511208, "sim_compute_performance-ego": 0.0688642913644964, "sim_compute_robot_state-ego": 0.06672258810563521, "sim_compute_robot_state-npc0": 0.06770364804701372, "sim_compute_robot_state-npc1": 0.06814177469773726, "sim_compute_robot_state-npc2": 0.0650750615380027, "sim_compute_robot_state-npc3": 0.0683983564376831}, "ETHZ_autolab_technical_track-14-0": {"driven_any": 0.9441796518284096, "sim_physics": 0.19275997122939753, "survival_time": 2.4499999999999993, "driven_lanedir": 0.4203463405922858, "sim_render-ego": 0.054923115944375794, "in-drivable-lane": 1.0999999999999988, "agent_compute-ego": 0.13737282947618135, "deviation-heading": 0.4296166116434236, "set_robot_commands": 0.08814426830836705, "deviation-center-line": 0.08695038592754878, "driven_lanedir_consec": 0.4203463405922858, "sim_compute_sim_state": 0.03414844006908183, "sim_compute_performance-ego": 0.06097612089040328, "sim_compute_robot_state-ego": 0.06554427438852739, "sim_compute_robot_state-npc0": 0.06166401687933474, "sim_compute_robot_state-npc1": 0.06144505131001375, "sim_compute_robot_state-npc2": 0.06232723411248655, "sim_compute_robot_state-npc3": 0.06330297917735819}}
set_robot_commands_max0.09725716239527651
set_robot_commands_mean0.0900214902653431
set_robot_commands_median0.09131286320862948
set_robot_commands_min0.08132275342941284
sim_compute_performance-ego_max0.07842214618410383
sim_compute_performance-ego_mean0.06572320347767571
sim_compute_performance-ego_median0.06487847581694398
sim_compute_performance-ego_min0.056161558628082274
sim_compute_robot_state-ego_max0.08461907080241612
sim_compute_robot_state-ego_mean0.07085889953152662
sim_compute_robot_state-ego_median0.06966765548871912
sim_compute_robot_state-ego_min0.06101411581039429
sim_compute_robot_state-npc0_max0.07501360416412353
sim_compute_robot_state-npc0_mean0.0658279965196405
sim_compute_robot_state-npc0_median0.06581464767456055
sim_compute_robot_state-npc0_min0.060037846150605576
sim_compute_robot_state-npc1_max0.06879680686526829
sim_compute_robot_state-npc1_mean0.0650172516437656
sim_compute_robot_state-npc1_median0.06584096908569335
sim_compute_robot_state-npc1_min0.05984913419794153
sim_compute_robot_state-npc2_max0.0801080550466265
sim_compute_robot_state-npc2_mean0.06541665223714742
sim_compute_robot_state-npc2_median0.06419946529247143
sim_compute_robot_state-npc2_min0.059104857621369536
sim_compute_robot_state-npc3_max0.0693692719494855
sim_compute_robot_state-npc3_mean0.0649946821830979
sim_compute_robot_state-npc3_median0.06469029426574707
sim_compute_robot_state-npc3_min0.06049550374348958
sim_compute_sim_state_max0.03937950134277344
sim_compute_sim_state_mean0.03704565677830331
sim_compute_sim_state_median0.03715092320985432
sim_compute_sim_state_min0.03414844006908183
sim_physics_max0.1979970173402266
sim_physics_mean0.17668343131736058
sim_physics_median0.1837275404679148
sim_physics_min0.14457240811100713
sim_render-ego_max0.06348412377493722
sim_render-ego_mean0.05783793537184094
sim_render-ego_median0.05718729972839356
sim_render-ego_min0.054441346062554255
simulation-passed1
survival_time_max3.949999999999994
survival_time_mean2.2366666666666655
survival_time_min0.9500000000000004
240183812AmaurXLet's do this one todayaido2-LFV-sim-validation-offseasonstep1-simulationsuccessyes12910:07:58Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.5723310224856362
survival_time_median2.6999999999999984
deviation-center-line_median0.11519544839797546
in-drivable-lane_median0.5999999999999979


other stats
agent_compute-ego_max0.1589952196393694
agent_compute-ego_mean0.1443899867802169
agent_compute-ego_median0.14387595176696777
agent_compute-ego_min0.1272968053817749
deviation-center-line_max0.1743913456502906
deviation-center-line_mean0.12651756552531995
deviation-center-line_min0.09047885846140293
deviation-heading_max0.5020407942599273
deviation-heading_mean0.3641979127291371
deviation-heading_median0.34764983431811214
deviation-heading_min0.19401296908406307
driven_any_max1.6169932854589035
driven_any_mean1.0272530755098266
driven_any_median1.0243289631429708
driven_any_min0.4119037580118998
driven_lanedir_consec_max1.2433038249708377
driven_lanedir_consec_mean0.7800316850006626
driven_lanedir_consec_min0.3792793194470208
driven_lanedir_max1.2433038249708377
driven_lanedir_mean0.7800316850006626
driven_lanedir_median0.5723310224856362
driven_lanedir_min0.3792793194470208
in-drivable-lane_max0.9999999999999976
in-drivable-lane_mean0.4899999999999984
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0243289631429708, "sim_physics": 0.1386045394120393, "survival_time": 2.6999999999999984, "driven_lanedir": 0.5723310224856362, "sim_render-ego": 0.05365012310169361, "in-drivable-lane": 0.9999999999999976, "agent_compute-ego": 0.1272968053817749, "deviation-heading": 0.19401296908406307, "set_robot_commands": 0.08360874211346661, "deviation-center-line": 0.15907928712407893, "driven_lanedir_consec": 0.5723310224856362, "sim_compute_sim_state": 0.030434882199322735, "sim_compute_performance-ego": 0.05939118950455277, "sim_compute_robot_state-ego": 0.06362844396520544, "sim_compute_robot_state-npc0": 0.05890295240614149, "sim_compute_robot_state-npc1": 0.06061981342456959, "sim_compute_robot_state-npc2": 0.05585845752998635, "sim_compute_robot_state-npc3": 0.05371559107745135}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.4119037580118998, "sim_physics": 0.17676926612854005, "survival_time": 1.2500000000000004, "driven_lanedir": 0.3792793194470208, "sim_render-ego": 0.05732707977294922, "in-drivable-lane": 0, "agent_compute-ego": 0.14387595176696777, "deviation-heading": 0.47860435001913393, "set_robot_commands": 0.08809575080871582, "deviation-center-line": 0.09344288799285194, "driven_lanedir_consec": 0.3792793194470208, "sim_compute_sim_state": 0.038383712768554686, "sim_compute_performance-ego": 0.0675126838684082, "sim_compute_robot_state-ego": 0.07254491806030273, "sim_compute_robot_state-npc0": 0.06259063720703124, "sim_compute_robot_state-npc1": 0.05928920745849609, "sim_compute_robot_state-npc2": 0.06364901542663574, "sim_compute_robot_state-npc3": 0.06614619255065918}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.579862082650716, "sim_physics": 0.16564353202518664, "survival_time": 3.7999999999999945, "driven_lanedir": 1.2433038249708377, "sim_render-ego": 0.06097643626363654, "in-drivable-lane": 0.5999999999999979, "agent_compute-ego": 0.15265919032849765, "deviation-heading": 0.5020407942599273, "set_robot_commands": 0.09170702256654438, "deviation-center-line": 0.1743913456502906, "driven_lanedir_consec": 1.2433038249708377, "sim_compute_sim_state": 0.03777066657417699, "sim_compute_performance-ego": 0.06716087931080868, "sim_compute_robot_state-ego": 0.07071869310579802, "sim_compute_robot_state-npc0": 0.06850385979602211, "sim_compute_robot_state-npc1": 0.06672239303588867, "sim_compute_robot_state-npc2": 0.06498376946700246, "sim_compute_robot_state-npc3": 0.06363452421991449}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.6169932854589035, "sim_physics": 0.1672186911860599, "survival_time": 3.949999999999994, "driven_lanedir": 1.2126117310470583, "sim_render-ego": 0.05605304090282585, "in-drivable-lane": 0.849999999999997, "agent_compute-ego": 0.13912276678447483, "deviation-heading": 0.34764983431811214, "set_robot_commands": 0.08500884756257263, "deviation-center-line": 0.11519544839797546, "driven_lanedir_consec": 1.2126117310470583, "sim_compute_sim_state": 0.036784003052530406, "sim_compute_performance-ego": 0.06535746176031572, "sim_compute_robot_state-ego": 0.06858903245080876, "sim_compute_robot_state-npc0": 0.06409105469908895, "sim_compute_robot_state-npc1": 0.06202624417558501, "sim_compute_robot_state-npc2": 0.06290957293932951, "sim_compute_robot_state-npc3": 0.06163346616527702}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.5031772882846431, "sim_physics": 0.19311797618865967, "survival_time": 1.4000000000000006, "driven_lanedir": 0.4926325270527603, "sim_render-ego": 0.0674223814691816, "in-drivable-lane": 0, "agent_compute-ego": 0.1589952196393694, "deviation-heading": 0.29868161596444953, "set_robot_commands": 0.09666510139192852, "deviation-center-line": 0.09047885846140293, "driven_lanedir_consec": 0.4926325270527603, "sim_compute_sim_state": 0.038140339510781426, "sim_compute_performance-ego": 0.07641136646270752, "sim_compute_robot_state-ego": 0.08577047075544085, "sim_compute_robot_state-npc0": 0.07334305558885847, "sim_compute_robot_state-npc1": 0.06730685915265765, "sim_compute_robot_state-npc2": 0.06725857087544032, "sim_compute_robot_state-npc3": 0.06931218930653163}}
set_robot_commands_max0.09666510139192852
set_robot_commands_mean0.0890170928886456
set_robot_commands_median0.08809575080871582
set_robot_commands_min0.08360874211346661
sim_compute_performance-ego_max0.07641136646270752
sim_compute_performance-ego_mean0.06716671618135858
sim_compute_performance-ego_median0.06716087931080868
sim_compute_performance-ego_min0.05939118950455277
sim_compute_robot_state-ego_max0.08577047075544085
sim_compute_robot_state-ego_mean0.07225031166751117
sim_compute_robot_state-ego_median0.07071869310579802
sim_compute_robot_state-ego_min0.06362844396520544
sim_compute_robot_state-npc0_max0.07334305558885847
sim_compute_robot_state-npc0_mean0.06548631193942844
sim_compute_robot_state-npc0_median0.06409105469908895
sim_compute_robot_state-npc0_min0.05890295240614149
sim_compute_robot_state-npc1_max0.06730685915265765
sim_compute_robot_state-npc1_mean0.06319290344943941
sim_compute_robot_state-npc1_median0.06202624417558501
sim_compute_robot_state-npc1_min0.05928920745849609
sim_compute_robot_state-npc2_max0.06725857087544032
sim_compute_robot_state-npc2_mean0.06293187724767887
sim_compute_robot_state-npc2_median0.06364901542663574
sim_compute_robot_state-npc2_min0.05585845752998635
sim_compute_robot_state-npc3_max0.06931218930653163
sim_compute_robot_state-npc3_mean0.06288839266396673
sim_compute_robot_state-npc3_median0.06363452421991449
sim_compute_robot_state-npc3_min0.05371559107745135
sim_compute_sim_state_max0.038383712768554686
sim_compute_sim_state_mean0.036302720821073255
sim_compute_sim_state_median0.03777066657417699
sim_compute_sim_state_min0.030434882199322735
sim_physics_max0.19311797618865967
sim_physics_mean0.16827080098809713
sim_physics_median0.1672186911860599
sim_physics_min0.1386045394120393
sim_render-ego_max0.0674223814691816
sim_render-ego_mean0.05908581230205736
sim_render-ego_median0.05732707977294922
sim_render-ego_min0.05365012310169361
simulation-passed1
survival_time_max3.949999999999994
survival_time_mean2.6199999999999974
survival_time_min1.2500000000000004
240173808chuyjBaseline solution using reinforcement learningaido2-LF-sim-validation-offseasonstep1-simulationfailedyes12910:02:17
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "experiment_manager.py", line 296, in run_episode
    agent.write_topic_and_expect_zero('observations', recv.data.observations)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 102, in write_topic_and_expect_zero
    nickname=self.nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 283, in read_until_over
    raise RemoteNodeAborted(m)
zuper_nodes.structures.RemoteNodeAborted: External node "agent" aborted:

error in agent |Exception while handling a message on topic "observations".
               |
               || Traceback (most recent call last):
               ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 274, in loop
               ||     handle_message_node(parsed, receiver0, context0)
               ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 428, in handle_message_node
               ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
               ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/utils.py", line 18, in call_if_fun_exists
               ||     f(**kwargs)
               ||   File "solution.py", line 38, in on_received_observations
               ||     print(f"on_received_obs:{Duckiebot1Observations.shape}")
               || AttributeError: type object 'Duckiebot1Observations' has no attribute 'shape'
               ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
    yield cie
  File "experiment_manager.py", line 441, in <module>
    wrap(cie)
  File "experiment_manager.py", line 429, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 135, in main
    physics_dt=config.physics_dt)
  File "experiment_manager.py", line 301, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.
Hidden. If you are the author, please login using the top-right link or use the dashboard.
240163807chuyjBaseline solution using reinforcement learningaido2-LF-sim-validation-offseasonstep1-simulationsuccessyes12910:05:26Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.2970674355257206
survival_time_median3.949999999999994
deviation-center-line_median0.24025421116283985
in-drivable-lane_median1.1


other stats
agent_compute-ego_max0.10040280486963972
agent_compute-ego_mean0.09702737088559864
agent_compute-ego_median0.0965848930420414
agent_compute-ego_min0.09535973167419434
deviation-center-line_max0.4061793754210388
deviation-center-line_mean0.25189118162533297
deviation-center-line_min0.15515493126262506
deviation-heading_max2.647670858343001
deviation-heading_mean1.1252774021173737
deviation-heading_median0.6747565568469233
deviation-heading_min0.5052265076591098
driven_any_max3.2880508883115636
driven_any_mean1.8578266103841456
driven_any_median1.6706165070497003
driven_any_min1.1319608299029815
driven_lanedir_consec_max2.3342334664816917
driven_lanedir_consec_mean1.2690510285465983
driven_lanedir_consec_min0.6051744314078786
driven_lanedir_max2.3342334664816917
driven_lanedir_mean1.2899546004169025
driven_lanedir_median1.2970674355257206
driven_lanedir_min0.7096922907593997
in-drivable-lane_max2.3499999999999934
in-drivable-lane_mean1.389999999999996
in-drivable-lane_min0.6999999999999975
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.1319608299029815, "sim_physics": 0.05300341033935547, "survival_time": 6.249999999999986, "driven_lanedir": 0.7096922907593997, "sim_render-ego": 0.03633154296875, "in-drivable-lane": 2.3499999999999934, "agent_compute-ego": 0.09535973167419434, "deviation-heading": 2.647670858343001, "set_robot_commands": 0.054799161911010745, "deviation-center-line": 0.29980146209532654, "driven_lanedir_consec": 0.6051744314078786, "sim_compute_sim_state": 0.02317292022705078, "sim_compute_performance-ego": 0.03870099067687988, "sim_compute_robot_state-ego": 0.04071904563903809}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.4527301541173807, "sim_physics": 0.05605689556367936, "survival_time": 3.099999999999997, "driven_lanedir": 0.7944486342774126, "sim_render-ego": 0.03648869452937957, "in-drivable-lane": 1.1, "agent_compute-ego": 0.0965848930420414, "deviation-heading": 0.6747565568469233, "set_robot_commands": 0.054535369719228434, "deviation-center-line": 0.15806592818483473, "driven_lanedir_consec": 0.7944486342774126, "sim_compute_sim_state": 0.02423794807926301, "sim_compute_performance-ego": 0.0385343567017586, "sim_compute_robot_state-ego": 0.04058572553819226}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 3.2880508883115636, "sim_physics": 0.05646739267323115, "survival_time": 7.299999999999982, "driven_lanedir": 2.3342334664816917, "sim_render-ego": 0.036066349238565526, "in-drivable-lane": 1.949999999999993, "agent_compute-ego": 0.0971947189879744, "deviation-heading": 1.2629759937588492, "set_robot_commands": 0.055597088108324026, "deviation-center-line": 0.4061793754210388, "driven_lanedir_consec": 2.3342334664816917, "sim_compute_sim_state": 0.023705583729156075, "sim_compute_performance-ego": 0.03895185744925721, "sim_compute_robot_state-ego": 0.040644637525898135}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.6706165070497003, "sim_physics": 0.05653592906420744, "survival_time": 3.949999999999994, "driven_lanedir": 1.2970674355257206, "sim_render-ego": 0.03599302678168574, "in-drivable-lane": 0.849999999999997, "agent_compute-ego": 0.10040280486963972, "deviation-heading": 0.535757093978986, "set_robot_commands": 0.05501183980627905, "deviation-center-line": 0.24025421116283985, "driven_lanedir_consec": 1.2970674355257206, "sim_compute_sim_state": 0.023166505596305752, "sim_compute_performance-ego": 0.039199469964715496, "sim_compute_robot_state-ego": 0.04064590417886082}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.745774672539102, "sim_physics": 0.05590164661407471, "survival_time": 3.4999999999999956, "driven_lanedir": 1.3143311750402882, "sim_render-ego": 0.03624299253736223, "in-drivable-lane": 0.6999999999999975, "agent_compute-ego": 0.0955947058541434, "deviation-heading": 0.5052265076591098, "set_robot_commands": 0.05462308951786586, "deviation-center-line": 0.15515493126262506, "driven_lanedir_consec": 1.3143311750402882, "sim_compute_sim_state": 0.023116132191249306, "sim_compute_performance-ego": 0.03843733583177839, "sim_compute_robot_state-ego": 0.040599523271833145}}
set_robot_commands_max0.055597088108324026
set_robot_commands_mean0.054913309812541625
set_robot_commands_median0.054799161911010745
set_robot_commands_min0.054535369719228434
sim_compute_performance-ego_max0.039199469964715496
sim_compute_performance-ego_mean0.038764802124877915
sim_compute_performance-ego_median0.03870099067687988
sim_compute_performance-ego_min0.03843733583177839
sim_compute_robot_state-ego_max0.04071904563903809
sim_compute_robot_state-ego_mean0.04063896723076449
sim_compute_robot_state-ego_median0.040644637525898135
sim_compute_robot_state-ego_min0.04058572553819226
sim_compute_sim_state_max0.02423794807926301
sim_compute_sim_state_mean0.023479817964604983
sim_compute_sim_state_median0.02317292022705078
sim_compute_sim_state_min0.023116132191249306
sim_physics_max0.05653592906420744
sim_physics_mean0.055593054850909616
sim_physics_median0.05605689556367936
sim_physics_min0.05300341033935547
sim_render-ego_max0.03648869452937957
sim_render-ego_mean0.03622452121114862
sim_render-ego_median0.03624299253736223
sim_render-ego_min0.03599302678168574
simulation-passed1
survival_time_max7.299999999999982
survival_time_mean4.819999999999991
survival_time_min3.099999999999997
240153806chuyjBaseline solution using reinforcement learningaido2-LF-sim-validation-offseasonstep1-simulationsuccessyes12910:03:46Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.6855098869645495
survival_time_median2.5999999999999988
deviation-center-line_median0.12793042492891543
in-drivable-lane_median1.0000000000000009


other stats
agent_compute-ego_max0.0984562219575394
agent_compute-ego_mean0.096470371236175
agent_compute-ego_median0.09590721130371094
agent_compute-ego_min0.09588342242770724
deviation-center-line_max0.16679643269696504
deviation-center-line_mean0.13737866514037766
deviation-center-line_min0.12414245792704968
deviation-heading_max0.6791831831911687
deviation-heading_mean0.33884697450451134
deviation-heading_median0.21409351211459093
deviation-heading_min0.18215304654123532
driven_any_max1.604140759595854
driven_any_mean1.2096054895409938
driven_any_median1.2668379264292713
driven_any_min0.5682626539104457
driven_lanedir_consec_max1.1193879233836466
driven_lanedir_consec_mean0.7576280848276593
driven_lanedir_consec_min0.5641809645311522
driven_lanedir_max1.1193879233836466
driven_lanedir_mean0.7576280848276593
driven_lanedir_median0.6855098869645495
driven_lanedir_min0.5641809645311522
in-drivable-lane_max1.5499999999999945
in-drivable-lane_mean0.859999999999998
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0137664315009025, "sim_physics": 0.05875971705414528, "survival_time": 2.1500000000000004, "driven_lanedir": 0.6855098869645495, "sim_render-ego": 0.0364763293155404, "in-drivable-lane": 0.5499999999999996, "agent_compute-ego": 0.0984562219575394, "deviation-heading": 0.2039272936686647, "set_robot_commands": 0.05511888237886651, "deviation-center-line": 0.12591626222493102, "driven_lanedir_consec": 0.6855098869645495, "sim_compute_sim_state": 0.02294494384943053, "sim_compute_performance-ego": 0.03841918568278468, "sim_compute_robot_state-ego": 0.040881467420001365}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.2668379264292713, "sim_physics": 0.055738549966078535, "survival_time": 2.5999999999999988, "driven_lanedir": 0.6094197005359626, "sim_render-ego": 0.0383343008848337, "in-drivable-lane": 1.0000000000000009, "agent_compute-ego": 0.09590721130371094, "deviation-heading": 0.6791831831911687, "set_robot_commands": 0.05498377176431509, "deviation-center-line": 0.12414245792704968, "driven_lanedir_consec": 0.6094197005359626, "sim_compute_sim_state": 0.02285874806917631, "sim_compute_performance-ego": 0.03857610317376944, "sim_compute_robot_state-ego": 0.04049638142952552}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.5682626539104457, "sim_physics": 0.06095984246995714, "survival_time": 1.3500000000000003, "driven_lanedir": 0.5641809645311522, "sim_render-ego": 0.03600402231569643, "in-drivable-lane": 0, "agent_compute-ego": 0.09588342242770724, "deviation-heading": 0.18215304654123532, "set_robot_commands": 0.05470576992741338, "deviation-center-line": 0.14210774792402706, "driven_lanedir_consec": 0.5641809645311522, "sim_compute_sim_state": 0.023037071581240052, "sim_compute_performance-ego": 0.038295993098506224, "sim_compute_robot_state-ego": 0.04055567140932436}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.604140759595854, "sim_physics": 0.05493602237185916, "survival_time": 3.699999999999995, "driven_lanedir": 0.809641948722986, "sim_render-ego": 0.03844661648209031, "in-drivable-lane": 1.5499999999999945, "agent_compute-ego": 0.09588521235697978, "deviation-heading": 0.414877837006897, "set_robot_commands": 0.05556973573323842, "deviation-center-line": 0.12793042492891543, "driven_lanedir_consec": 0.809641948722986, "sim_compute_sim_state": 0.023032265740471916, "sim_compute_performance-ego": 0.0385152681453808, "sim_compute_robot_state-ego": 0.04064293165464659}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.5950196762684965, "sim_physics": 0.05641588023011113, "survival_time": 3.5499999999999954, "driven_lanedir": 1.1193879233836466, "sim_render-ego": 0.0362303592789341, "in-drivable-lane": 1.1999999999999955, "agent_compute-ego": 0.09621978813493756, "deviation-heading": 0.21409351211459093, "set_robot_commands": 0.05563468664464816, "deviation-center-line": 0.16679643269696504, "driven_lanedir_consec": 1.1193879233836466, "sim_compute_sim_state": 0.023199262753338883, "sim_compute_performance-ego": 0.038837902982470016, "sim_compute_robot_state-ego": 0.0443235350326753}}
set_robot_commands_max0.05563468664464816
set_robot_commands_mean0.05520256928969631
set_robot_commands_median0.05511888237886651
set_robot_commands_min0.05470576992741338
sim_compute_performance-ego_max0.038837902982470016
sim_compute_performance-ego_mean0.03852889061658223
sim_compute_performance-ego_median0.0385152681453808
sim_compute_performance-ego_min0.038295993098506224
sim_compute_robot_state-ego_max0.0443235350326753
sim_compute_robot_state-ego_mean0.04137999738923463
sim_compute_robot_state-ego_median0.04064293165464659
sim_compute_robot_state-ego_min0.04049638142952552
sim_compute_sim_state_max0.023199262753338883
sim_compute_sim_state_mean0.023014458398731535
sim_compute_sim_state_median0.023032265740471916
sim_compute_sim_state_min0.02285874806917631
sim_physics_max0.06095984246995714
sim_physics_mean0.05736200241843024
sim_physics_median0.05641588023011113
sim_physics_min0.05493602237185916
sim_render-ego_max0.03844661648209031
sim_render-ego_mean0.037098325655418984
sim_render-ego_median0.0364763293155404
sim_render-ego_min0.03600402231569643
simulation-passed1
survival_time_max3.699999999999995
survival_time_mean2.6699999999999977
survival_time_min1.3500000000000003
239893788felipecer13challenge-aido_LF-template-randomaido2-LFVI-sim-validation-offseasonstep1-simulationsuccessyes12910:07:57Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.493517638549009
survival_time_median2.3999999999999995
deviation-center-line_median0.09791133281082
in-drivable-lane_median0.549999999999998


other stats
agent_compute-ego_max0.14947347981589182
agent_compute-ego_mean0.1363077549816327
agent_compute-ego_median0.14229384209345847
agent_compute-ego_min0.11264621714750926
deviation-center-line_max0.2348196785686717
deviation-center-line_mean0.13547481992266058
deviation-center-line_min0.06216029860587694
deviation-heading_max0.8115272458314897
deviation-heading_mean0.49959867397150787
deviation-heading_median0.46504862964833654
deviation-heading_min0.30044835691402494
driven_any_max2.1864003300000694
driven_any_mean1.1068208197848532
driven_any_median0.9410513078477724
driven_any_min0.34749292376309954
driven_lanedir_consec_max1.826231945363564
driven_lanedir_consec_mean0.804744013449103
driven_lanedir_consec_min0.3325249708009643
driven_lanedir_max1.826231945363564
driven_lanedir_mean0.804828147320482
driven_lanedir_median0.493517638549009
driven_lanedir_min0.3325249708009643
in-drivable-lane_max1.3499999999999952
in-drivable-lane_mean0.5599999999999984
in-drivable-lane_min0
per-episodes
details{"udem1-0-0": {"driven_any": 1.5811782993597916, "sim_physics": 0.19407301914842823, "survival_time": 3.949999999999994, "driven_lanedir": 0.9217908232230632, "sim_render-ego": 0.060520986967448946, "in-drivable-lane": 1.3499999999999952, "agent_compute-ego": 0.1482754115816913, "deviation-heading": 0.5694288623982039, "set_robot_commands": 0.09916533095927178, "deviation-center-line": 0.2348196785686717, "driven_lanedir_consec": 0.9213701538661684, "sim_compute_sim_state": 0.03712070440944237, "sim_compute_performance-ego": 0.06775676449642906, "sim_compute_robot_state-ego": 0.07034035272236112, "sim_compute_robot_state-npc0": 0.06628528124169458, "sim_compute_robot_state-npc1": 0.06680799737761292, "sim_compute_robot_state-npc2": 0.06554390207121644, "sim_compute_robot_state-npc3": 0.06759585006327569}, "udem1-1-0": {"driven_any": 0.47798123795353353, "sim_physics": 0.2124412911278861, "survival_time": 1.4000000000000006, "driven_lanedir": 0.4500753586658095, "sim_render-ego": 0.06811869995934623, "in-drivable-lane": 0, "agent_compute-ego": 0.14947347981589182, "deviation-heading": 0.46504862964833654, "set_robot_commands": 0.09324975524629864, "deviation-center-line": 0.09791133281082, "driven_lanedir_consec": 0.4500753586658095, "sim_compute_sim_state": 0.03833797999790737, "sim_compute_performance-ego": 0.07171557630811419, "sim_compute_robot_state-ego": 0.07972225121089391, "sim_compute_robot_state-npc0": 0.06490887914385114, "sim_compute_robot_state-npc1": 0.06500063623700823, "sim_compute_robot_state-npc2": 0.06676739454269409, "sim_compute_robot_state-npc3": 0.06743172236851283}, "udem1-2-0": {"driven_any": 2.1864003300000694, "sim_physics": 0.1817907939836817, "survival_time": 5.14999999999999, "driven_lanedir": 1.826231945363564, "sim_render-ego": 0.06045508847653287, "in-drivable-lane": 0.549999999999998, "agent_compute-ego": 0.14229384209345847, "deviation-heading": 0.8115272458314897, "set_robot_commands": 0.08312763519657468, "deviation-center-line": 0.1927316041609401, "driven_lanedir_consec": 1.826231945363564, "sim_compute_sim_state": 0.035817465735870656, "sim_compute_performance-ego": 0.06313097129747705, "sim_compute_robot_state-ego": 0.06926587947363992, "sim_compute_robot_state-npc0": 0.06430929146924065, "sim_compute_robot_state-npc1": 0.06562385281312813, "sim_compute_robot_state-npc2": 0.06527653018247734, "sim_compute_robot_state-npc3": 0.06307925529850339}, "udem1-3-0": {"driven_any": 0.9410513078477724, "sim_physics": 0.14384466409683228, "survival_time": 2.3999999999999995, "driven_lanedir": 0.493517638549009, "sim_render-ego": 0.046836654345194496, "in-drivable-lane": 0.8999999999999988, "agent_compute-ego": 0.11264621714750926, "deviation-heading": 0.35154027506548424, "set_robot_commands": 0.07099344333012898, "deviation-center-line": 0.08975118546699407, "driven_lanedir_consec": 0.493517638549009, "sim_compute_sim_state": 0.028764143586158752, "sim_compute_performance-ego": 0.05199195941289266, "sim_compute_robot_state-ego": 0.05249966184298197, "sim_compute_robot_state-npc0": 0.05060990651448568, "sim_compute_robot_state-npc1": 0.052147080500920616, "sim_compute_robot_state-npc2": 0.05272684494654337, "sim_compute_robot_state-npc3": 0.05006362497806549}, "udem1-4-0": {"driven_any": 0.34749292376309954, "sim_physics": 0.1341072264171782, "survival_time": 1.0500000000000005, "driven_lanedir": 0.3325249708009643, "sim_render-ego": 0.04733263878595261, "in-drivable-lane": 0, "agent_compute-ego": 0.12884982426961264, "deviation-heading": 0.30044835691402494, "set_robot_commands": 0.0733969665708996, "deviation-center-line": 0.06216029860587694, "driven_lanedir_consec": 0.3325249708009643, "sim_compute_sim_state": 0.02747821807861328, "sim_compute_performance-ego": 0.054478656677972706, "sim_compute_robot_state-ego": 0.0495168822152274, "sim_compute_robot_state-npc0": 0.05257193247477213, "sim_compute_robot_state-npc1": 0.05250067937941778, "sim_compute_robot_state-npc2": 0.05608508700416202, "sim_compute_robot_state-npc3": 0.04951449802943638}}
set_robot_commands_max0.09916533095927178
set_robot_commands_mean0.08398662626063473
set_robot_commands_median0.08312763519657468
set_robot_commands_min0.07099344333012898
sim_compute_performance-ego_max0.07171557630811419
sim_compute_performance-ego_mean0.06181478563857713
sim_compute_performance-ego_median0.06313097129747705
sim_compute_performance-ego_min0.05199195941289266
sim_compute_robot_state-ego_max0.07972225121089391
sim_compute_robot_state-ego_mean0.06426900549302086
sim_compute_robot_state-ego_median0.06926587947363992
sim_compute_robot_state-ego_min0.0495168822152274
sim_compute_robot_state-npc0_max0.06628528124169458
sim_compute_robot_state-npc0_mean0.05973705816880883
sim_compute_robot_state-npc0_median0.06430929146924065
sim_compute_robot_state-npc0_min0.05060990651448568
sim_compute_robot_state-npc1_max0.06680799737761292
sim_compute_robot_state-npc1_mean0.06041604926161753
sim_compute_robot_state-npc1_median0.06500063623700823
sim_compute_robot_state-npc1_min0.052147080500920616
sim_compute_robot_state-npc2_max0.06676739454269409
sim_compute_robot_state-npc2_mean0.06127995174941866
sim_compute_robot_state-npc2_median0.06527653018247734
sim_compute_robot_state-npc2_min0.05272684494654337
sim_compute_robot_state-npc3_max0.06759585006327569
sim_compute_robot_state-npc3_mean0.059536990147558755
sim_compute_robot_state-npc3_median0.06307925529850339
sim_compute_robot_state-npc3_min0.04951449802943638
sim_compute_sim_state_max0.03833797999790737
sim_compute_sim_state_mean0.033503702361598484
sim_compute_sim_state_median0.035817465735870656
sim_compute_sim_state_min0.02747821807861328
sim_physics_max0.2124412911278861
sim_physics_mean0.1732513989548013
sim_physics_median0.1817907939836817
sim_physics_min0.1341072264171782
sim_render-ego_max0.06811869995934623
sim_render-ego_mean0.056652813706895025
sim_render-ego_median0.06045508847653287
sim_render-ego_min0.046836654345194496
simulation-passed1
survival_time_max5.14999999999999
survival_time_mean2.789999999999997
survival_time_min1.0500000000000005
237493762Julian ZillyBaseline-IL-logs-tensorflowaido2-LFVI-sim-testingstep1-simulationerroryes12910:39:36
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
Hidden. If you are the author, please login using the top-right link or use the dashboard.
237363747sebaido2-LF-sim-validationstep1-simulationsuccessyes12910:04:15Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.5723310224856362
survival_time_median2.549999999999999
deviation-center-line_median0.13005513204193506
in-drivable-lane_median0.29999999999999893


other stats
agent_compute-ego_max0.12199536491842831
agent_compute-ego_mean0.11335889166846198
agent_compute-ego_median0.11389463036148637
agent_compute-ego_min0.10476522352181228
deviation-center-line_max0.2072381278624381
deviation-center-line_mean0.13189395308989768
deviation-center-line_min0.0788839760023766
deviation-heading_max0.5289022616823588
deviation-heading_mean0.3206717506075888
deviation-heading_median0.23606825392187256
deviation-heading_min0.19401296908406307
driven_any_max1.618214457700942
driven_any_mean0.8613785859332687
driven_any_median0.9933867744747804
driven_any_min0.23626560261560617
driven_lanedir_consec_max0.8010406009604816
driven_lanedir_consec_mean0.5597645764431625
driven_lanedir_consec_min0.2264965947033466
driven_lanedir_max0.8010406009604816
driven_lanedir_mean0.5597645764431625
driven_lanedir_median0.5723310224856362
driven_lanedir_min0.2264965947033466
in-drivable-lane_max1.7999999999999936
in-drivable-lane_mean0.619999999999998
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0243289631429708, "sim_physics": 0.05849235146133988, "survival_time": 2.6999999999999984, "driven_lanedir": 0.5723310224856362, "sim_render-ego": 0.04956727999228018, "in-drivable-lane": 0.9999999999999976, "agent_compute-ego": 0.11389463036148637, "deviation-heading": 0.19401296908406307, "set_robot_commands": 0.05561636553870307, "deviation-center-line": 0.15907928712407893, "driven_lanedir_consec": 0.5723310224856362, "sim_compute_sim_state": 0.023923617822152597, "sim_compute_performance-ego": 0.0403083430396186, "sim_compute_robot_state-ego": 0.04170925970430727}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.9933867744747804, "sim_physics": 0.07938395294488645, "survival_time": 2.549999999999999, "driven_lanedir": 0.8010406009604816, "sim_render-ego": 0.04314203823313994, "in-drivable-lane": 0.29999999999999893, "agent_compute-ego": 0.10476522352181228, "deviation-heading": 0.5289022616823588, "set_robot_commands": 0.06453849755081476, "deviation-center-line": 0.13005513204193506, "driven_lanedir_consec": 0.8010406009604816, "sim_compute_sim_state": 0.028622996573354684, "sim_compute_performance-ego": 0.047435671675438974, "sim_compute_robot_state-ego": 0.05377449241338992}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.23626560261560617, "sim_physics": 0.0802910888896269, "survival_time": 0.8500000000000002, "driven_lanedir": 0.2264965947033466, "sim_render-ego": 0.04947386068456313, "in-drivable-lane": 0, "agent_compute-ego": 0.12199536491842831, "deviation-heading": 0.23048898560984332, "set_robot_commands": 0.0760809954474954, "deviation-center-line": 0.0788839760023766, "driven_lanedir_consec": 0.2264965947033466, "sim_compute_sim_state": 0.028622991898480585, "sim_compute_performance-ego": 0.05031184589161592, "sim_compute_robot_state-ego": 0.05045732329873478}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.4346971317320432, "sim_physics": 0.07461433410644532, "survival_time": 1.2500000000000004, "driven_lanedir": 0.40985475638935265, "sim_render-ego": 0.04038871765136719, "in-drivable-lane": 0, "agent_compute-ego": 0.10781005859375, "deviation-heading": 0.4138862827398061, "set_robot_commands": 0.06237324714660644, "deviation-center-line": 0.08421324241865966, "driven_lanedir_consec": 0.40985475638935265, "sim_compute_sim_state": 0.02543781280517578, "sim_compute_performance-ego": 0.04478235244750976, "sim_compute_robot_state-ego": 0.04548724174499512}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.618214457700942, "sim_physics": 0.07276426387738578, "survival_time": 3.949999999999994, "driven_lanedir": 0.7890999076769956, "sim_render-ego": 0.04550890681109851, "in-drivable-lane": 1.7999999999999936, "agent_compute-ego": 0.11832918094683297, "deviation-heading": 0.23606825392187256, "set_robot_commands": 0.0712078311775304, "deviation-center-line": 0.2072381278624381, "driven_lanedir_consec": 0.7890999076769956, "sim_compute_sim_state": 0.02830149553999116, "sim_compute_performance-ego": 0.04868088492864295, "sim_compute_robot_state-ego": 0.05106089990350265}}
set_robot_commands_max0.0760809954474954
set_robot_commands_mean0.06596338737223002
set_robot_commands_median0.06453849755081476
set_robot_commands_min0.05561636553870307
sim_compute_performance-ego_max0.05031184589161592
sim_compute_performance-ego_mean0.04630381959656524
sim_compute_performance-ego_median0.047435671675438974
sim_compute_performance-ego_min0.0403083430396186
sim_compute_robot_state-ego_max0.05377449241338992
sim_compute_robot_state-ego_mean0.04849784341298595
sim_compute_robot_state-ego_median0.05045732329873478
sim_compute_robot_state-ego_min0.04170925970430727
sim_compute_sim_state_max0.028622996573354684
sim_compute_sim_state_mean0.02698178292783096
sim_compute_sim_state_median0.02830149553999116
sim_compute_sim_state_min0.023923617822152597
sim_physics_max0.0802910888896269
sim_physics_mean0.07310919825593686
sim_physics_median0.07461433410644532
sim_physics_min0.05849235146133988
sim_render-ego_max0.04956727999228018
sim_render-ego_mean0.045616160674489786
sim_render-ego_median0.04550890681109851
sim_render-ego_min0.04038871765136719
simulation-passed1
survival_time_max3.949999999999994
survival_time_mean2.2599999999999985
survival_time_min0.8500000000000002
237203744JBRRussiacolcnt fixaido2-LF-sim-validationstep1-simulationsuccessyes12910:12:35Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.9705669376900432
survival_time_median14.950000000000076
deviation-center-line_median0.7422340304530037
in-drivable-lane_median0


other stats
agent_compute-ego_max0.052840578556060794
agent_compute-ego_mean0.05209226701167692
agent_compute-ego_median0.05201107347515267
agent_compute-ego_min0.05160330040286286
deviation-center-line_max1.2082307329342523
deviation-center-line_mean0.7139712903877511
deviation-center-line_min0.2976033703881105
deviation-heading_max2.9019980388351496
deviation-heading_mean2.055183686097723
deviation-heading_median2.5826051961665573
deviation-heading_min0.4783500635159773
driven_any_max2.081962678438535
driven_any_mean1.4615878586790547
driven_any_median2.046539141116722
driven_any_min0.4601374492136299
driven_lanedir_consec_max2.0148048229342077
driven_lanedir_consec_mean1.4072865603571754
driven_lanedir_consec_min0.4546187992944528
driven_lanedir_max2.0148048229342077
driven_lanedir_mean1.4072865603571754
driven_lanedir_median1.9705669376900432
driven_lanedir_min0.4546187992944528
in-drivable-lane_max0.09999999999999964
in-drivable-lane_mean0.019999999999999928
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 2.046539141116722, "sim_physics": 0.07620734691619874, "survival_time": 14.950000000000076, "driven_lanedir": 1.9705669376900432, "sim_render-ego": 0.03715049187342326, "in-drivable-lane": 0, "agent_compute-ego": 0.05169507503509521, "deviation-heading": 2.5826051961665573, "set_robot_commands": 0.06983069737752279, "deviation-center-line": 1.2082307329342523, "driven_lanedir_consec": 1.9705669376900432, "sim_compute_sim_state": 0.028919689655303955, "sim_compute_performance-ego": 0.04263082106908162, "sim_compute_robot_state-ego": 0.04909709771474202}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.6517876053649976, "sim_physics": 0.06956413779595885, "survival_time": 4.94999999999999, "driven_lanedir": 0.5863186782911962, "sim_render-ego": 0.036590648419929275, "in-drivable-lane": 0.09999999999999964, "agent_compute-ego": 0.05160330040286286, "deviation-heading": 1.5432802419840048, "set_robot_commands": 0.06694418974597045, "deviation-center-line": 0.2976033703881105, "driven_lanedir_consec": 0.5863186782911962, "sim_compute_sim_state": 0.02893591890431414, "sim_compute_performance-ego": 0.04280408945950595, "sim_compute_robot_state-ego": 0.04876386035572399}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.4601374492136299, "sim_physics": 0.07476299917194205, "survival_time": 3.5499999999999954, "driven_lanedir": 0.4546187992944528, "sim_render-ego": 0.03668399595878494, "in-drivable-lane": 0, "agent_compute-ego": 0.05201107347515267, "deviation-heading": 0.4783500635159773, "set_robot_commands": 0.0682686684836804, "deviation-center-line": 0.3215696732608136, "driven_lanedir_consec": 0.4546187992944528, "sim_compute_sim_state": 0.027644476420442824, "sim_compute_performance-ego": 0.04014250594125667, "sim_compute_robot_state-ego": 0.04766347710515412}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 2.0675124192613885, "sim_physics": 0.0773093072573344, "survival_time": 14.950000000000076, "driven_lanedir": 2.010123563575976, "sim_render-ego": 0.0363422171274821, "in-drivable-lane": 0, "agent_compute-ego": 0.052311307589213055, "deviation-heading": 2.769684889986926, "set_robot_commands": 0.0689547069867452, "deviation-center-line": 1.0002186449025752, "driven_lanedir_consec": 2.010123563575976, "sim_compute_sim_state": 0.0297066330909729, "sim_compute_performance-ego": 0.042552579243977866, "sim_compute_robot_state-ego": 0.05000249306360881}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 2.081962678438535, "sim_physics": 0.07434181213378906, "survival_time": 14.950000000000076, "driven_lanedir": 2.0148048229342077, "sim_render-ego": 0.036698753833770754, "in-drivable-lane": 0, "agent_compute-ego": 0.052840578556060794, "deviation-heading": 2.9019980388351496, "set_robot_commands": 0.06718560616175334, "deviation-center-line": 0.7422340304530037, "driven_lanedir_consec": 2.0148048229342077, "sim_compute_sim_state": 0.02859974861145019, "sim_compute_performance-ego": 0.0429000186920166, "sim_compute_robot_state-ego": 0.04926316102345785}}
set_robot_commands_max0.06983069737752279
set_robot_commands_mean0.06823677375113443
set_robot_commands_median0.0682686684836804
set_robot_commands_min0.06694418974597045
sim_compute_performance-ego_max0.0429000186920166
sim_compute_performance-ego_mean0.04220600288116774
sim_compute_performance-ego_median0.04263082106908162
sim_compute_performance-ego_min0.04014250594125667
sim_compute_robot_state-ego_max0.05000249306360881
sim_compute_robot_state-ego_mean0.04895801785253736
sim_compute_robot_state-ego_median0.04909709771474202
sim_compute_robot_state-ego_min0.04766347710515412
sim_compute_sim_state_max0.0297066330909729
sim_compute_sim_state_mean0.028761293336496803
sim_compute_sim_state_median0.028919689655303955
sim_compute_sim_state_min0.027644476420442824
sim_physics_max0.0773093072573344
sim_physics_mean0.07443712065504461
sim_physics_median0.07476299917194205
sim_physics_min0.06956413779595885
sim_render-ego_max0.03715049187342326
sim_render-ego_mean0.036693221442678066
sim_render-ego_median0.03668399595878494
sim_render-ego_min0.0363422171274821
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean10.670000000000044
survival_time_min3.5499999999999954
237133738jp18813100494LF sim test - whaido2-LF-sim-testingstep1-simulationerroryes12910:17:39
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
Hidden. If you are the author, please login using the top-right link or use the dashboard.
237083733jp18813100494Second test -RGB- TH-jpaido2-LF-sim-testingstep1-simulationerroryes12910:02:11
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
Hidden. If you are the author, please login using the top-right link or use the dashboard.
236853724jp18813100494Second test -RGB- TH-jpaido2-LF-sim-testingstep1-simulationsuccessyes12910:31:42Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.709012048590294
survival_time_median14.950000000000076
deviation-center-line_median0.38447320334523055
in-drivable-lane_median0


other stats
agent_compute-ego_max0.0996611918846186
agent_compute-ego_mean0.09810469418239014
agent_compute-ego_median0.0980234138170878
agent_compute-ego_min0.09696349541346232
deviation-center-line_max1.438868052751231
deviation-center-line_mean0.48208775053432856
deviation-center-line_min0.0617584420153499
deviation-heading_max5.564545696826533
deviation-heading_mean2.359945341123894
deviation-heading_median1.5742087652078072
deviation-heading_min0.2871123077880753
driven_any_max2.136133509270581
driven_any_mean0.7241300030505512
driven_any_median0.754356812754684
driven_any_min0.01207028324337977
driven_lanedir_consec_max2.0900359741350343
driven_lanedir_consec_mean0.6788604458460102
driven_lanedir_consec_min0.011972988324831402
driven_lanedir_max2.0900359741350343
driven_lanedir_mean0.6788604458460102
driven_lanedir_median0.709012048590294
driven_lanedir_min0.011972988324831402
in-drivable-lane_max3.7000000000000526
in-drivable-lane_mean0.3833333333333363
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0126610440005843, "sim_physics": 0.05420453638970098, "survival_time": 3.949999999999994, "driven_lanedir": 0.6609181258806545, "sim_render-ego": 0.03471648240391212, "in-drivable-lane": 1.7499999999999938, "agent_compute-ego": 0.0976023100599458, "deviation-heading": 0.858940841687016, "set_robot_commands": 0.05373997929729993, "deviation-center-line": 0.13529134746320506, "driven_lanedir_consec": 0.6609181258806545, "sim_compute_sim_state": 0.022649535649939427, "sim_compute_performance-ego": 0.03844546064545837, "sim_compute_robot_state-ego": 0.040026024927066854}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.7595522424314712, "sim_physics": 0.05649709065755208, "survival_time": 14.950000000000076, "driven_lanedir": 0.7352279124260795, "sim_render-ego": 0.035350757439931234, "in-drivable-lane": 0, "agent_compute-ego": 0.0980234138170878, "deviation-heading": 4.795891064811469, "set_robot_commands": 0.05499387820561727, "deviation-center-line": 0.360545942209073, "driven_lanedir_consec": 0.7352279124260795, "sim_compute_sim_state": 0.023203980922698975, "sim_compute_performance-ego": 0.038593909740448, "sim_compute_robot_state-ego": 0.03988143603006999}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.9535561139978752, "sim_physics": 0.05531730810801188, "survival_time": 14.950000000000076, "driven_lanedir": 0.9462743954342976, "sim_render-ego": 0.03514857848485311, "in-drivable-lane": 0, "agent_compute-ego": 0.09724403381347656, "deviation-heading": 1.812369823698207, "set_robot_commands": 0.05373850822448731, "deviation-center-line": 0.27508255291473815, "driven_lanedir_consec": 0.9462743954342976, "sim_compute_sim_state": 0.022386131286621095, "sim_compute_performance-ego": 0.0378109057744344, "sim_compute_robot_state-ego": 0.040115397771199546}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.9792418325527504, "sim_physics": 0.05794432878494263, "survival_time": 14.950000000000076, "driven_lanedir": 0.9743230583614304, "sim_render-ego": 0.03464421351750692, "in-drivable-lane": 0, "agent_compute-ego": 0.09696349541346232, "deviation-heading": 5.564545696826533, "set_robot_commands": 0.05381812175114949, "deviation-center-line": 0.5179984751883532, "driven_lanedir_consec": 0.9743230583614304, "sim_compute_sim_state": 0.022425337632497152, "sim_compute_performance-ego": 0.03873747825622559, "sim_compute_robot_state-ego": 0.03999961455663045}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.754356812754684, "sim_physics": 0.05876517375310262, "survival_time": 14.950000000000076, "driven_lanedir": 0.7468731885941198, "sim_render-ego": 0.03517238696416219, "in-drivable-lane": 0, "agent_compute-ego": 0.09744280894597372, "deviation-heading": 5.256343632028708, "set_robot_commands": 0.05396216948827108, "deviation-center-line": 0.38447320334523055, "driven_lanedir_consec": 0.7468731885941198, "sim_compute_sim_state": 0.022570263544718423, "sim_compute_performance-ego": 0.03904949982961019, "sim_compute_robot_state-ego": 0.03985714276631673}, "ETHZ_autolab_technical_track-5-0": {"driven_any": 1.0129391163110788, "sim_physics": 0.055006386131368656, "survival_time": 4.6499999999999915, "driven_lanedir": 0.8692143577854579, "sim_render-ego": 0.03456300048417942, "in-drivable-lane": 0.1999999999999993, "agent_compute-ego": 0.09755104331560031, "deviation-heading": 1.002728981635512, "set_robot_commands": 0.053575708020117976, "deviation-center-line": 0.24064776928315793, "driven_lanedir_consec": 0.8692143577854579, "sim_compute_sim_state": 0.02249879990854571, "sim_compute_performance-ego": 0.0401685494248585, "sim_compute_robot_state-ego": 0.03994862751294208}, "ETHZ_autolab_technical_track-6-0": {"driven_any": 0.06203930329353196, "sim_physics": 0.05754446268081665, "survival_time": 14.950000000000076, "driven_lanedir": 0.061569482784165075, "sim_render-ego": 0.03534478743871053, "in-drivable-lane": 0, "agent_compute-ego": 0.09858973026275634, "deviation-heading": 1.645525881043571, "set_robot_commands": 0.054133090972900394, "deviation-center-line": 0.7779901747567166, "driven_lanedir_consec": 0.061569482784165075, "sim_compute_sim_state": 0.02257569392522176, "sim_compute_performance-ego": 0.039389306704203285, "sim_compute_robot_state-ego": 0.040039972464243574}, "ETHZ_autolab_technical_track-7-0": {"driven_any": 0.15136862047452393, "sim_physics": 0.05534584023231684, "survival_time": 2.1500000000000004, "driven_lanedir": 0.09773519546862808, "sim_render-ego": 0.0343180867128594, "in-drivable-lane": 0.04999999999999982, "agent_compute-ego": 0.09841010736864668, "deviation-heading": 0.8050995867641144, "set_robot_commands": 0.05409701480421909, "deviation-center-line": 0.13271573895151803, "driven_lanedir_consec": 0.09773519546862808, "sim_compute_sim_state": 0.02252128512360329, "sim_compute_performance-ego": 0.03775852225547613, "sim_compute_robot_state-ego": 0.039420116779416106}, "ETHZ_autolab_technical_track-8-0": {"driven_any": 0.39366644863819766, "sim_physics": 0.057451059420903526, "survival_time": 1.2000000000000004, "driven_lanedir": 0.3769299980029403, "sim_render-ego": 0.034979045391082764, "in-drivable-lane": 0, "agent_compute-ego": 0.09956639011700948, "deviation-heading": 0.2871123077880753, "set_robot_commands": 0.05402557055155436, "deviation-center-line": 0.0617584420153499, "driven_lanedir_consec": 0.3769299980029403, "sim_compute_sim_state": 0.022832214832305908, "sim_compute_performance-ego": 0.03849690159161886, "sim_compute_robot_state-ego": 0.03986928860346476}, "ETHZ_autolab_technical_track-9-0": {"driven_any": 0.01207028324337977, "sim_physics": 0.056538570721944174, "survival_time": 14.950000000000076, "driven_lanedir": 0.011972988324831402, "sim_render-ego": 0.035556633472442624, "in-drivable-lane": 0, "agent_compute-ego": 0.09887064536412556, "deviation-heading": 1.5742087652078072, "set_robot_commands": 0.054431983629862464, "deviation-center-line": 0.5186473247667536, "driven_lanedir_consec": 0.011972988324831402, "sim_compute_sim_state": 0.022678641478220626, "sim_compute_performance-ego": 0.03810760656992594, "sim_compute_robot_state-ego": 0.04011669635772705}, "ETHZ_autolab_technical_track-10-0": {"driven_any": 0.7184318050350545, "sim_physics": 0.054263792037963866, "survival_time": 14.950000000000076, "driven_lanedir": 0.709012048590294, "sim_render-ego": 0.035081058343251544, "in-drivable-lane": 0, "agent_compute-ego": 0.09806182702382406, "deviation-heading": 1.349317653307769, "set_robot_commands": 0.05443323055903117, "deviation-center-line": 1.438868052751231, "driven_lanedir_consec": 0.709012048590294, "sim_compute_sim_state": 0.02238067626953125, "sim_compute_performance-ego": 0.03780695676803589, "sim_compute_robot_state-ego": 0.03987501303354899}, "ETHZ_autolab_technical_track-11-0": {"driven_any": 0.18588476350540203, "sim_physics": 0.05472529967625936, "survival_time": 14.950000000000076, "driven_lanedir": 0.17552793266900713, "sim_render-ego": 0.03484431743621826, "in-drivable-lane": 3.7000000000000526, "agent_compute-ego": 0.09733277161916096, "deviation-heading": 4.3552318393211715, "set_robot_commands": 0.053373096783955895, "deviation-center-line": 0.34688256652617033, "driven_lanedir_consec": 0.17552793266900713, "sim_compute_sim_state": 0.02230413834253947, "sim_compute_performance-ego": 0.03769482692082723, "sim_compute_robot_state-ego": 0.03941885550816854}, "ETHZ_autolab_technical_track-12-0": {"driven_any": 0.0626005991626111, "sim_physics": 0.05314427693684896, "survival_time": 14.950000000000076, "driven_lanedir": 0.06235658463734717, "sim_render-ego": 0.035106648604075114, "in-drivable-lane": 0, "agent_compute-ego": 0.09825180530548096, "deviation-heading": 1.4015827358155828, "set_robot_commands": 0.05376312096913655, "deviation-center-line": 0.7257497630175758, "driven_lanedir_consec": 0.06235658463734717, "sim_compute_sim_state": 0.022611144383748373, "sim_compute_performance-ego": 0.038234810034434, "sim_compute_robot_state-ego": 0.03958297888437907}, "ETHZ_autolab_technical_track-13-0": {"driven_any": 2.136133509270581, "sim_physics": 0.052472587919583286, "survival_time": 6.849999999999984, "driven_lanedir": 2.0900359741350343, "sim_render-ego": 0.034677773496530354, "in-drivable-lane": 0.04999999999999982, "agent_compute-ego": 0.0996611918846186, "deviation-heading": 1.1788561841133236, "set_robot_commands": 0.053573258601836045, "deviation-center-line": 0.38841158383151136, "driven_lanedir_consec": 2.0900359741350343, "sim_compute_sim_state": 0.022490000202708, "sim_compute_performance-ego": 0.0378209657042566, "sim_compute_robot_state-ego": 0.039261551669044215}, "ETHZ_autolab_technical_track-14-0": {"driven_any": 1.6674475510865443, "sim_physics": 0.054576791922251386, "survival_time": 14.950000000000076, "driven_lanedir": 1.6649354445958648, "sim_render-ego": 0.035544300079345705, "in-drivable-lane": 0, "agent_compute-ego": 0.0979988384246826, "deviation-heading": 3.5114251228095523, "set_robot_commands": 0.05351172129313151, "deviation-center-line": 0.9262533209943434, "driven_lanedir_consec": 1.6649354445958648, "sim_compute_sim_state": 0.022145510514577228, "sim_compute_performance-ego": 0.03733561833699544, "sim_compute_robot_state-ego": 0.039485049247741696}}
set_robot_commands_max0.05499387820561727
set_robot_commands_mean0.05394469687683804
set_robot_commands_median0.05381812175114949
set_robot_commands_min0.053373096783955895
sim_compute_performance-ego_max0.0401685494248585
sim_compute_performance-ego_mean0.03836342123712056
sim_compute_performance-ego_median0.038234810034434
sim_compute_performance-ego_min0.03733561833699544
sim_compute_robot_state-ego_max0.04011669635772705
sim_compute_robot_state-ego_mean0.039793184407463975
sim_compute_robot_state-ego_median0.03987501303354899
sim_compute_robot_state-ego_min0.039261551669044215
sim_compute_sim_state_max0.023203980922698975
sim_compute_sim_state_mean0.022551556934498448
sim_compute_sim_state_median0.02252128512360329
sim_compute_sim_state_min0.022145510514577228
sim_physics_max0.05876517375310262
sim_physics_mean0.05558650035823779
sim_physics_median0.05531730810801188
sim_physics_min0.052472587919583286
sim_render-ego_max0.035556633472442624
sim_render-ego_mean0.035003204684604085
sim_render-ego_median0.035081058343251544
sim_render-ego_min0.0343180867128594
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean11.22000000000005
survival_time_min1.2000000000000004
236823720jp18813100494final test2 - whaido2-LF-sim-testingstep1-simulationfailedyes12910:02:38
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "experiment_manager.py", line 297, in run_episode
    r: MsgReceived = agent.write_topic_and_expect('get_commands', expect='commands')
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 93, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 174, in read_one
    nickname=self.nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 283, in read_until_over
    raise RemoteNodeAborted(m)
zuper_nodes.structures.RemoteNodeAborted: External node "agent" aborted:

error in agent |Exception while handling a message on topic "get_commands".
               |
               || Traceback (most recent call last):
               ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 274, in loop
               ||     handle_message_node(parsed, receiver0, context0)
               ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 428, in handle_message_node
               ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
               ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/utils.py", line 18, in call_if_fun_exists
               ||     f(**kwargs)
               ||   File "solution.py", line 60, in on_received_get_commands
               ||     action = self.compute_action(self.current_image)
               ||   File "solution.py", line 47, in compute_action
               ||     if action[0]<1e-2:
               || UnboundLocalError: local variable 'action' referenced before assignment
               ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
    yield cie
  File "experiment_manager.py", line 441, in <module>
    wrap(cie)
  File "experiment_manager.py", line 429, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 135, in main
    physics_dt=config.physics_dt)
  File "experiment_manager.py", line 301, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.
Hidden. If you are the author, please login using the top-right link or use the dashboard.
236723717jp18813100494Second test -RGB- TH-jpaido2-LF-sim-testingstep1-simulationfailedyes12910:03:15
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "experiment_manager.py", line 297, in run_episode
    r: MsgReceived = agent.write_topic_and_expect('get_commands', expect='commands')
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 93, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 174, in read_one
    nickname=self.nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 283, in read_until_over
    raise RemoteNodeAborted(m)
zuper_nodes.structures.RemoteNodeAborted: External node "agent" aborted:

error in agent |Exception while handling a message on topic "get_commands".
               |
               || Traceback (most recent call last):
               ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 274, in loop
               ||     handle_message_node(parsed, receiver0, context0)
               ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 428, in handle_message_node
               ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
               ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/utils.py", line 18, in call_if_fun_exists
               ||     f(**kwargs)
               ||   File "solution.py", line 58, in on_received_get_commands
               ||     action = (action + np.random.normal(0,0.2,size=env.action_space.shape[0])).clip(env.action_space.low, env.action_space.high)
               || NameError: name 'env' is not defined
               ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
    yield cie
  File "experiment_manager.py", line 441, in <module>
    wrap(cie)
  File "experiment_manager.py", line 429, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 135, in main
    physics_dt=config.physics_dt)
  File "experiment_manager.py", line 301, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.
Hidden. If you are the author, please login using the top-right link or use the dashboard.
236203710ierosodinBaseline solution using reinforcement learningaido2-LF-sim-testingstep1-simulationerroryes12910:41:41
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
Hidden. If you are the author, please login using the top-right link or use the dashboard.
236173705ierosodinBaseline solution using reinforcement learningaido2-LF-sim-testingstep1-simulationerroryes12910:51:05
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
Hidden. If you are the author, please login using the top-right link or use the dashboard.
235903692Manfred Diazchallenge-aido_LF-template-tensorflowaido2-LF-sim-validationstep1-simulationsuccessyes12910:11:58Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.6514023258687487
survival_time_median4.449999999999992
deviation-center-line_median0.23739122357818904
in-drivable-lane_median0.849999999999997


other stats
agent_compute-ego_max0.14946525361802843
agent_compute-ego_mean0.14370166347578034
agent_compute-ego_median0.14363891463125905
agent_compute-ego_min0.13956740379333496
deviation-center-line_max0.5170746666829398
deviation-center-line_mean0.286490123346237
deviation-center-line_min0.11858883250573632
deviation-heading_max2.8602914150984016
deviation-heading_mean1.7467146270959322
deviation-heading_median1.883489448082707
deviation-heading_min0.7774267019988155
driven_any_max1.806170835824281
driven_any_mean1.0870136375050108
driven_any_median1.098380589429692
driven_any_min0.5292009749888434
driven_lanedir_consec_max1.342369046619216
driven_lanedir_consec_mean0.7701808073457285
driven_lanedir_consec_min0.42382714508842456
driven_lanedir_max1.342369046619216
driven_lanedir_mean0.7701808073457285
driven_lanedir_median0.6514023258687487
driven_lanedir_min0.42382714508842456
in-drivable-lane_max1.099999999999996
in-drivable-lane_mean0.6399999999999977
in-drivable-lane_min0.09999999999999964
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.5292009749888434, "sim_physics": 0.1206768936581082, "survival_time": 2.25, "driven_lanedir": 0.42382714508842456, "sim_render-ego": 0.06719823413425022, "in-drivable-lane": 0.14999999999999947, "agent_compute-ego": 0.14946525361802843, "deviation-heading": 0.7774267019988155, "set_robot_commands": 0.09415511025322808, "deviation-center-line": 0.14559773692031788, "driven_lanedir_consec": 0.42382714508842456, "sim_compute_sim_state": 0.038673920101589626, "sim_compute_performance-ego": 0.06957403288947211, "sim_compute_robot_state-ego": 0.0786970615386963}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.098380589429692, "sim_physics": 0.10529749580983364, "survival_time": 4.449999999999992, "driven_lanedir": 0.6514023258687487, "sim_render-ego": 0.05653299374526806, "in-drivable-lane": 0.9999999999999964, "agent_compute-ego": 0.14373021715142753, "deviation-heading": 1.883489448082707, "set_robot_commands": 0.09079486868354712, "deviation-center-line": 0.23739122357818904, "driven_lanedir_consec": 0.6514023258687487, "sim_compute_sim_state": 0.03746234165148789, "sim_compute_performance-ego": 0.06657439671205671, "sim_compute_robot_state-ego": 0.0706902246796683}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.806170835824281, "sim_physics": 0.1079913126368101, "survival_time": 7.349999999999982, "driven_lanedir": 1.342369046619216, "sim_render-ego": 0.060333362241991526, "in-drivable-lane": 1.099999999999996, "agent_compute-ego": 0.1421065281848518, "deviation-heading": 2.8602914150984016, "set_robot_commands": 0.1044308701340033, "deviation-center-line": 0.5170746666829398, "driven_lanedir_consec": 1.342369046619216, "sim_compute_sim_state": 0.03852646042700528, "sim_compute_performance-ego": 0.06795510629407403, "sim_compute_robot_state-ego": 0.07096199437874515}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.1615700603052233, "sim_physics": 0.1115765380859375, "survival_time": 4.99999999999999, "driven_lanedir": 0.9798601952252768, "sim_render-ego": 0.06322489500045776, "in-drivable-lane": 0.09999999999999964, "agent_compute-ego": 0.13956740379333496, "deviation-heading": 2.2145663289769866, "set_robot_commands": 0.08822371244430542, "deviation-center-line": 0.4137981570440021, "driven_lanedir_consec": 0.9798601952252768, "sim_compute_sim_state": 0.03742807388305664, "sim_compute_performance-ego": 0.06537937641143798, "sim_compute_robot_state-ego": 0.06835029125213624}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.8397457269770152, "sim_physics": 0.1080409942134734, "survival_time": 3.099999999999997, "driven_lanedir": 0.45344532392697623, "sim_render-ego": 0.05873402472465269, "in-drivable-lane": 0.849999999999997, "agent_compute-ego": 0.14363891463125905, "deviation-heading": 0.9977992413227512, "set_robot_commands": 0.09034750538487588, "deviation-center-line": 0.11858883250573632, "driven_lanedir_consec": 0.45344532392697623, "sim_compute_sim_state": 0.03952567038997527, "sim_compute_performance-ego": 0.06798774965347783, "sim_compute_robot_state-ego": 0.0664678196753225}}
set_robot_commands_max0.1044308701340033
set_robot_commands_mean0.09359041337999197
set_robot_commands_median0.09079486868354712
set_robot_commands_min0.08822371244430542
sim_compute_performance-ego_max0.06957403288947211
sim_compute_performance-ego_mean0.06749413239210374
sim_compute_performance-ego_median0.06795510629407403
sim_compute_performance-ego_min0.06537937641143798
sim_compute_robot_state-ego_max0.0786970615386963
sim_compute_robot_state-ego_mean0.0710334783049137
sim_compute_robot_state-ego_median0.0706902246796683
sim_compute_robot_state-ego_min0.0664678196753225
sim_compute_sim_state_max0.03952567038997527
sim_compute_sim_state_mean0.03832329329062294
sim_compute_sim_state_median0.03852646042700528
sim_compute_sim_state_min0.03742807388305664
sim_physics_max0.1206768936581082
sim_physics_mean0.11071664688083258
sim_physics_median0.1080409942134734
sim_physics_min0.10529749580983364
sim_render-ego_max0.06719823413425022
sim_render-ego_mean0.06120470196932405
sim_render-ego_median0.060333362241991526
sim_render-ego_min0.05653299374526806
simulation-passed1
survival_time_max7.349999999999982
survival_time_mean4.429999999999993
survival_time_min2.25
234623652MYFtestaido2-LFV-sim-testingstep1-simulationerroryes12910:39:56
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
Hidden. If you are the author, please login using the top-right link or use the dashboard.
234553649ierosodinBaseline solution using reinforcement learningaido2-LF-sim-validationstep1-simulationerroryes12910:05:48
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
Hidden. If you are the author, please login using the top-right link or use the dashboard.
234083638awoo424HKDUCKaido2-LF-sim-validationstep1-simulationsuccessyes12910:12:14Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.3985434806544852
survival_time_median8.999999999999993
deviation-center-line_median0.4195350258812748
in-drivable-lane_median3.3999999999999906


other stats
agent_compute-ego_max0.19601535229455855
agent_compute-ego_mean0.18925902155089003
agent_compute-ego_median0.18951765537261964
agent_compute-ego_min0.18307086096869576
deviation-center-line_max0.7391797512240016
deviation-center-line_mean0.4218625236504649
deviation-center-line_min0.2125450582078782
deviation-heading_max4.112199519161604
deviation-heading_mean1.5034026457446608
deviation-heading_median0.8501527311300738
deviation-heading_min0.548078208681167
driven_any_max1.5491560058468408
driven_any_mean0.8296669819222954
driven_any_median1.00574171915957
driven_any_min0.22605035291042525
driven_lanedir_consec_max0.6196900440864868
driven_lanedir_consec_mean0.3797273266028719
driven_lanedir_consec_min0.217880906877971
driven_lanedir_max0.6196900440864868
driven_lanedir_mean0.3797273266028719
driven_lanedir_median0.3985434806544852
driven_lanedir_min0.217880906877971
in-drivable-lane_max10.950000000000085
in-drivable-lane_mean3.830000000000015
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.00574171915957, "sim_physics": 0.05352273252275255, "survival_time": 8.999999999999993, "driven_lanedir": 0.4085994677356664, "sim_render-ego": 0.036618582407633465, "in-drivable-lane": 4.8, "agent_compute-ego": 0.18307086096869576, "deviation-heading": 0.6410804492719147, "set_robot_commands": 0.054311830467647974, "deviation-center-line": 0.5196983327237378, "driven_lanedir_consec": 0.4085994677356664, "sim_compute_sim_state": 0.023450280560387504, "sim_compute_performance-ego": 0.03950999975204468, "sim_compute_robot_state-ego": 0.04130300283432007}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.0751999436658484, "sim_physics": 0.05734101563942533, "survival_time": 11.900000000000034, "driven_lanedir": 0.6196900440864868, "sim_render-ego": 0.03815067114950228, "in-drivable-lane": 3.3999999999999906, "agent_compute-ego": 0.1844912256513323, "deviation-heading": 4.112199519161604, "set_robot_commands": 0.05450275966099331, "deviation-center-line": 0.7391797512240016, "driven_lanedir_consec": 0.6196900440864868, "sim_compute_sim_state": 0.023438489737630897, "sim_compute_performance-ego": 0.03898641241698706, "sim_compute_robot_state-ego": 0.04115447176604712}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.22605035291042525, "sim_physics": 0.056062868663242886, "survival_time": 2.1000000000000005, "driven_lanedir": 0.217880906877971, "sim_render-ego": 0.03547638370877221, "in-drivable-lane": 0, "agent_compute-ego": 0.19601535229455855, "deviation-heading": 0.548078208681167, "set_robot_commands": 0.05333755697522845, "deviation-center-line": 0.21835445021543207, "driven_lanedir_consec": 0.217880906877971, "sim_compute_sim_state": 0.023101710137866792, "sim_compute_performance-ego": 0.03867136864435105, "sim_compute_robot_state-ego": 0.0407523995354062}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.29218688802879217, "sim_physics": 0.05828401020595005, "survival_time": 2.799999999999998, "driven_lanedir": 0.2539227336597505, "sim_render-ego": 0.036623703581946235, "in-drivable-lane": 0, "agent_compute-ego": 0.19320001346724375, "deviation-heading": 1.3655023204785444, "set_robot_commands": 0.054644682577678134, "deviation-center-line": 0.2125450582078782, "driven_lanedir_consec": 0.2539227336597505, "sim_compute_sim_state": 0.02348941990307399, "sim_compute_performance-ego": 0.03930684072630746, "sim_compute_robot_state-ego": 0.04065151725496565}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.5491560058468408, "sim_physics": 0.057543240388234454, "survival_time": 14.950000000000076, "driven_lanedir": 0.3985434806544852, "sim_render-ego": 0.03616609970728557, "in-drivable-lane": 10.950000000000085, "agent_compute-ego": 0.18951765537261964, "deviation-heading": 0.8501527311300738, "set_robot_commands": 0.05370533227920532, "deviation-center-line": 0.4195350258812748, "driven_lanedir_consec": 0.3985434806544852, "sim_compute_sim_state": 0.023257683118184408, "sim_compute_performance-ego": 0.03863510926564535, "sim_compute_robot_state-ego": 0.04151976744333903}}
set_robot_commands_max0.054644682577678134
set_robot_commands_mean0.054100432392150635
set_robot_commands_median0.054311830467647974
set_robot_commands_min0.05333755697522845
sim_compute_performance-ego_max0.03950999975204468
sim_compute_performance-ego_mean0.03902194616106712
sim_compute_performance-ego_median0.03898641241698706
sim_compute_performance-ego_min0.03863510926564535
sim_compute_robot_state-ego_max0.04151976744333903
sim_compute_robot_state-ego_mean0.04107623176681561
sim_compute_robot_state-ego_median0.04115447176604712
sim_compute_robot_state-ego_min0.04065151725496565
sim_compute_sim_state_max0.02348941990307399
sim_compute_sim_state_mean0.023347516691428715
sim_compute_sim_state_median0.023438489737630897
sim_compute_sim_state_min0.023101710137866792
sim_physics_max0.05828401020595005
sim_physics_mean0.056550773483921055
sim_physics_median0.05734101563942533
sim_physics_min0.05352273252275255
sim_render-ego_max0.03815067114950228
sim_render-ego_mean0.036607088111027954
sim_render-ego_median0.036618582407633465
sim_render-ego_min0.03547638370877221
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean8.15000000000002
survival_time_min2.1000000000000005
234013634awoo424Baseline-IL-logs-tensorflowaido2-LF-sim-validationstep1-simulationsuccessyes12910:15:11Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.2932968863301235
survival_time_median12.000000000000036
deviation-center-line_median0.5428480558509712
in-drivable-lane_median0


other stats
agent_compute-ego_max0.14416495561599732
agent_compute-ego_mean0.14213884926394943
agent_compute-ego_median0.14128753070917605
agent_compute-ego_min0.14045836687088012
deviation-center-line_max1.2545102713230998
deviation-center-line_mean0.622210109555386
deviation-center-line_min0.28009223675992184
deviation-heading_max1.8536757404464157
deviation-heading_mean1.5817646483482783
deviation-heading_median1.7334473101384278
deviation-heading_min1.2491895377385989
driven_any_max1.6803424467176225
driven_any_mean1.3016697591247863
driven_any_median1.356331216069872
driven_any_min1.0019717789023883
driven_lanedir_consec_max1.671543605018729
driven_lanedir_consec_mean1.2020197376945547
driven_lanedir_consec_min0.7166359896439909
driven_lanedir_max1.671543605018729
driven_lanedir_mean1.2020197376945547
driven_lanedir_median1.2932968863301235
driven_lanedir_min0.7166359896439909
in-drivable-lane_max2.8500000000000405
in-drivable-lane_mean0.6200000000000088
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.103080333151624, "sim_physics": 0.05468600260186519, "survival_time": 11.050000000000022, "driven_lanedir": 0.7166359896439909, "sim_render-ego": 0.03667079161734602, "in-drivable-lane": 2.8500000000000405, "agent_compute-ego": 0.14128753070917605, "deviation-heading": 1.7600329620639388, "set_robot_commands": 0.05528489065386052, "deviation-center-line": 0.387653382470645, "driven_lanedir_consec": 0.7166359896439909, "sim_compute_sim_state": 0.022879539032327645, "sim_compute_performance-ego": 0.038152635367207935, "sim_compute_robot_state-ego": 0.04012442282422096}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.356331216069872, "sim_physics": 0.054363184173901874, "survival_time": 12.000000000000036, "driven_lanedir": 1.343815051014507, "sim_render-ego": 0.034600035349528, "in-drivable-lane": 0, "agent_compute-ego": 0.14416495561599732, "deviation-heading": 1.3124776913540108, "set_robot_commands": 0.05461906393369039, "deviation-center-line": 0.5428480558509712, "driven_lanedir_consec": 1.343815051014507, "sim_compute_sim_state": 0.02261511584122976, "sim_compute_performance-ego": 0.03852868676185608, "sim_compute_robot_state-ego": 0.04001905620098114}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.6803424467176225, "sim_physics": 0.05571472326914469, "survival_time": 14.950000000000076, "driven_lanedir": 1.671543605018729, "sim_render-ego": 0.03503158728281657, "in-drivable-lane": 0, "agent_compute-ego": 0.14045836687088012, "deviation-heading": 1.2491895377385989, "set_robot_commands": 0.05436585982640584, "deviation-center-line": 1.2545102713230998, "driven_lanedir_consec": 1.671543605018729, "sim_compute_sim_state": 0.02255563497543335, "sim_compute_performance-ego": 0.03810618082682292, "sim_compute_robot_state-ego": 0.03945291916529337}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.0019717789023883, "sim_physics": 0.053666700396621435, "survival_time": 11.400000000000029, "driven_lanedir": 0.9848071564654224, "sim_render-ego": 0.0350069612787481, "in-drivable-lane": 0, "agent_compute-ego": 0.14411154546235738, "deviation-heading": 1.7334473101384278, "set_robot_commands": 0.05475003572932461, "deviation-center-line": 0.6459466013722925, "driven_lanedir_consec": 0.9848071564654224, "sim_compute_sim_state": 0.02248706629401759, "sim_compute_performance-ego": 0.0381512349111992, "sim_compute_robot_state-ego": 0.03922048890799807}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.366623020782425, "sim_physics": 0.053456055323282875, "survival_time": 14.950000000000076, "driven_lanedir": 1.2932968863301235, "sim_render-ego": 0.03487984418869019, "in-drivable-lane": 0.25000000000000355, "agent_compute-ego": 0.14067184766133625, "deviation-heading": 1.8536757404464157, "set_robot_commands": 0.05490405162175496, "deviation-center-line": 0.28009223675992184, "driven_lanedir_consec": 1.2932968863301235, "sim_compute_sim_state": 0.0224370543162028, "sim_compute_performance-ego": 0.03797109603881836, "sim_compute_robot_state-ego": 0.03966047128041585}}
set_robot_commands_max0.05528489065386052
set_robot_commands_mean0.05478478035300727
set_robot_commands_median0.05475003572932461
set_robot_commands_min0.05436585982640584
sim_compute_performance-ego_max0.03852868676185608
sim_compute_performance-ego_mean0.038181966781180895
sim_compute_performance-ego_median0.0381512349111992
sim_compute_performance-ego_min0.03797109603881836
sim_compute_robot_state-ego_max0.04012442282422096
sim_compute_robot_state-ego_mean0.03969547167578188
sim_compute_robot_state-ego_median0.03966047128041585
sim_compute_robot_state-ego_min0.03922048890799807
sim_compute_sim_state_max0.022879539032327645
sim_compute_sim_state_mean0.02259488209184223
sim_compute_sim_state_median0.02255563497543335
sim_compute_sim_state_min0.0224370543162028
sim_physics_max0.05571472326914469
sim_physics_mean0.05437733315296321
sim_physics_median0.054363184173901874
sim_physics_min0.053456055323282875
sim_render-ego_max0.03667079161734602
sim_render-ego_mean0.03523784394342578
sim_render-ego_median0.0350069612787481
sim_render-ego_min0.034600035349528
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean12.870000000000047
survival_time_min11.050000000000022
233903632enickyaido2-LFVI-sim-testingstep1-simulationsuccessyes12910:24:15Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.4443672320455454
survival_time_median2.499999999999999
deviation-center-line_median0.15455097642444732
in-drivable-lane_median0.7000000000000006


other stats
agent_compute-ego_max0.12579487787710653
agent_compute-ego_mean0.10108475088377546
agent_compute-ego_median0.09728738239833289
agent_compute-ego_min0.09507711483882024
deviation-center-line_max1.068229629093837
deviation-center-line_mean0.25274867543065366
deviation-center-line_min0.054904029848945685
deviation-heading_max3.507487670047857
deviation-heading_mean0.9951171151839956
deviation-heading_median0.4411806188695786
deviation-heading_min0.13989224355569133
driven_any_max3.207709657944666
driven_any_mean1.2513357364761413
driven_any_median1.008977359835069
driven_any_min0.37149985167138017
driven_lanedir_consec_max2.3108240053208213
driven_lanedir_consec_mean0.8535592430911254
driven_lanedir_consec_min0.17855427696068582
driven_lanedir_max2.3527222534487895
driven_lanedir_mean0.927270844605768
driven_lanedir_median0.4443672320455454
driven_lanedir_min0.17855427696068582
in-drivable-lane_max7.450000000000026
in-drivable-lane_mean1.6266666666666665
in-drivable-lane_min0
per-episodes
details{"udem1-0-0": {"driven_any": 2.50162892780929, "sim_physics": 0.1303127762433645, "survival_time": 7.399999999999982, "driven_lanedir": 2.1208268912576216, "sim_render-ego": 0.04695734140035268, "in-drivable-lane": 3.4499999999999877, "agent_compute-ego": 0.12579487787710653, "deviation-heading": 0.36159719377172606, "set_robot_commands": 0.06898449562691353, "deviation-center-line": 0.28905228033842156, "driven_lanedir_consec": 2.120743097074997, "sim_compute_sim_state": 0.028648276586790342, "sim_compute_performance-ego": 0.05047347900029775, "sim_compute_robot_state-ego": 0.05037268271317353, "sim_compute_robot_state-npc0": 0.05097346853565525, "sim_compute_robot_state-npc1": 0.0496539602408538, "sim_compute_robot_state-npc2": 0.050061113125569115, "sim_compute_robot_state-npc3": 0.04985267084998053}, "udem1-1-0": {"driven_any": 0.46051146883057115, "sim_physics": 0.13298135454004462, "survival_time": 1.1000000000000003, "driven_lanedir": 0.43495908029179065, "sim_render-ego": 0.04310985044999556, "in-drivable-lane": 0, "agent_compute-ego": 0.10952236435630104, "deviation-heading": 0.3681646786246837, "set_robot_commands": 0.06221373514695601, "deviation-center-line": 0.07726482156623102, "driven_lanedir_consec": 0.43495908029179065, "sim_compute_sim_state": 0.025588566606695003, "sim_compute_performance-ego": 0.04710344834761186, "sim_compute_robot_state-ego": 0.04837015542117032, "sim_compute_robot_state-npc0": 0.04974007606506348, "sim_compute_robot_state-npc1": 0.0468057935888117, "sim_compute_robot_state-npc2": 0.04548823833465576, "sim_compute_robot_state-npc3": 0.04403805732727051}, "udem1-2-0": {"driven_any": 2.4755270458423686, "sim_physics": 0.1217907802113947, "survival_time": 10.600000000000016, "driven_lanedir": 2.1506205729307473, "sim_render-ego": 0.043521931711232885, "in-drivable-lane": 1.7999999999999936, "agent_compute-ego": 0.12083262542508684, "deviation-heading": 3.451647136461856, "set_robot_commands": 0.0674754594856838, "deviation-center-line": 1.068229629093837, "driven_lanedir_consec": 1.7413838620089876, "sim_compute_sim_state": 0.02754419817114776, "sim_compute_performance-ego": 0.04666406928368334, "sim_compute_robot_state-ego": 0.04895027965869544, "sim_compute_robot_state-npc0": 0.04968261381365218, "sim_compute_robot_state-npc1": 0.04972328779832373, "sim_compute_robot_state-npc2": 0.05014199130939988, "sim_compute_robot_state-npc3": 0.04844863347287448}, "udem1-3-0": {"driven_any": 3.207709657944666, "sim_physics": 0.10023000280735855, "survival_time": 11.800000000000033, "driven_lanedir": 2.3527222534487895, "sim_render-ego": 0.0356690782611653, "in-drivable-lane": 7.450000000000026, "agent_compute-ego": 0.09610077385175024, "deviation-heading": 0.4411806188695786, "set_robot_commands": 0.05528494766203024, "deviation-center-line": 0.3742483665016732, "driven_lanedir_consec": 2.3108240053208213, "sim_compute_sim_state": 0.022265896958819892, "sim_compute_performance-ego": 0.038034861370668575, "sim_compute_robot_state-ego": 0.04034038721504858, "sim_compute_robot_state-npc0": 0.03982664467924732, "sim_compute_robot_state-npc1": 0.03922452259871919, "sim_compute_robot_state-npc2": 0.03899813708612474, "sim_compute_robot_state-npc3": 0.039018103631876286}, "udem1-4-0": {"driven_any": 0.400811386017319, "sim_physics": 0.10934990644454956, "survival_time": 1.0000000000000002, "driven_lanedir": 0.38693847040587825, "sim_render-ego": 0.035493326187133786, "in-drivable-lane": 0, "agent_compute-ego": 0.0954519271850586, "deviation-heading": 0.2638670899443274, "set_robot_commands": 0.054077553749084475, "deviation-center-line": 0.060733287044270105, "driven_lanedir_consec": 0.38693847040587825, "sim_compute_sim_state": 0.022308659553527833, "sim_compute_performance-ego": 0.038115501403808594, "sim_compute_robot_state-ego": 0.040381121635437014, "sim_compute_robot_state-npc0": 0.03984323740005493, "sim_compute_robot_state-npc1": 0.03899335861206055, "sim_compute_robot_state-npc2": 0.03885066509246826, "sim_compute_robot_state-npc3": 0.03912315368652344}, "udem1-5-0": {"driven_any": 1.1301285156014205, "sim_physics": 0.10505011081695556, "survival_time": 2.499999999999999, "driven_lanedir": 0.3805698593940634, "sim_render-ego": 0.03573078632354736, "in-drivable-lane": 1.0500000000000005, "agent_compute-ego": 0.09628181457519532, "deviation-heading": 0.924976817672808, "set_robot_commands": 0.0547673749923706, "deviation-center-line": 0.1205488749427968, "driven_lanedir_consec": 0.3805698593940634, "sim_compute_sim_state": 0.02251267433166504, "sim_compute_performance-ego": 0.03866978645324707, "sim_compute_robot_state-ego": 0.04052900791168213, "sim_compute_robot_state-npc0": 0.04008974075317383, "sim_compute_robot_state-npc1": 0.039516873359680176, "sim_compute_robot_state-npc2": 0.03927776336669922, "sim_compute_robot_state-npc3": 0.03932257175445557}, "udem1-6-0": {"driven_any": 0.8796785144013353, "sim_physics": 0.12079187896516588, "survival_time": 1.800000000000001, "driven_lanedir": 0.8770246919234508, "sim_render-ego": 0.0354907578892178, "in-drivable-lane": 0, "agent_compute-ego": 0.0972089370091756, "deviation-heading": 0.13989224355569133, "set_robot_commands": 0.053935719860924616, "deviation-center-line": 0.15455097642444732, "driven_lanedir_consec": 0.8770246919234508, "sim_compute_sim_state": 0.022196325990888808, "sim_compute_performance-ego": 0.03794503211975098, "sim_compute_robot_state-ego": 0.04126464658313327, "sim_compute_robot_state-npc0": 0.03960323996014065, "sim_compute_robot_state-npc1": 0.03883483674791125, "sim_compute_robot_state-npc2": 0.03868100378248426, "sim_compute_robot_state-npc3": 0.03876482778125339}, "udem1-7-0": {"driven_any": 1.008977359835069, "sim_physics": 0.11556951896004054, "survival_time": 2.3, "driven_lanedir": 0.8934759392227924, "sim_render-ego": 0.03565124843431556, "in-drivable-lane": 0, "agent_compute-ego": 0.09798097610473631, "deviation-heading": 1.0583693635822085, "set_robot_commands": 0.05415734000827955, "deviation-center-line": 0.15983372236288246, "driven_lanedir_consec": 0.8770842728627053, "sim_compute_sim_state": 0.02212951494299847, "sim_compute_performance-ego": 0.03800359497899595, "sim_compute_robot_state-ego": 0.04024951354317043, "sim_compute_robot_state-npc0": 0.03961937842161759, "sim_compute_robot_state-npc1": 0.03878322373265806, "sim_compute_robot_state-npc2": 0.03870572214541228, "sim_compute_robot_state-npc3": 0.03885953322700832}, "udem1-8-0": {"driven_any": 1.7854758389187866, "sim_physics": 0.10307882485851164, "survival_time": 6.199999999999986, "driven_lanedir": 1.2770502106053638, "sim_render-ego": 0.03547324865095077, "in-drivable-lane": 0.7000000000000006, "agent_compute-ego": 0.09789155375572944, "deviation-heading": 1.9536260214987975, "set_robot_commands": 0.054199653287087715, "deviation-center-line": 0.5971886468995992, "driven_lanedir_consec": 1.2770502106053638, "sim_compute_sim_state": 0.022464085009790236, "sim_compute_performance-ego": 0.03824980797306184, "sim_compute_robot_state-ego": 0.04056805372238159, "sim_compute_robot_state-npc0": 0.040431601385916435, "sim_compute_robot_state-npc1": 0.039307578917472594, "sim_compute_robot_state-npc2": 0.03910266199419575, "sim_compute_robot_state-npc3": 0.039195724071994904}, "udem1-9-0": {"driven_any": 0.4605114688305781, "sim_physics": 0.12386540933088824, "survival_time": 1.1000000000000003, "driven_lanedir": 0.4443672320455454, "sim_render-ego": 0.03590524196624756, "in-drivable-lane": 0, "agent_compute-ego": 0.09735300324179907, "deviation-heading": 0.2921306476839709, "set_robot_commands": 0.05389658971266313, "deviation-center-line": 0.06393804025783281, "driven_lanedir_consec": 0.4443672320455454, "sim_compute_sim_state": 0.022110364653847435, "sim_compute_performance-ego": 0.038040778853676536, "sim_compute_robot_state-ego": 0.04074032740159468, "sim_compute_robot_state-npc0": 0.03951588543978604, "sim_compute_robot_state-npc1": 0.03916941989551891, "sim_compute_robot_state-npc2": 0.03889300606467507, "sim_compute_robot_state-npc3": 0.03867713971571489}, "udem1-10-0": {"driven_any": 0.37149985167138017, "sim_physics": 0.1119976796601948, "survival_time": 0.9500000000000004, "driven_lanedir": 0.3517991142132264, "sim_render-ego": 0.03666752263119346, "in-drivable-lane": 0, "agent_compute-ego": 0.098503966080515, "deviation-heading": 0.31076793256366336, "set_robot_commands": 0.05368198846515856, "deviation-center-line": 0.054904029848945685, "driven_lanedir_consec": 0.3517991142132264, "sim_compute_sim_state": 0.022528824053312604, "sim_compute_performance-ego": 0.03859118411415502, "sim_compute_robot_state-ego": 0.04058632097746197, "sim_compute_robot_state-npc0": 0.03987253339667069, "sim_compute_robot_state-npc1": 0.03933215141296387, "sim_compute_robot_state-npc2": 0.03958532684727719, "sim_compute_robot_state-npc3": 0.03924484001962762}, "udem1-11-0": {"driven_any": 0.4307612897755775, "sim_physics": 0.10577259744916644, "survival_time": 1.0500000000000005, "driven_lanedir": 0.4261291824030562, "sim_render-ego": 0.03615953808739072, "in-drivable-lane": 0, "agent_compute-ego": 0.09728738239833289, "deviation-heading": 0.1541202345559414, "set_robot_commands": 0.05390955152965728, "deviation-center-line": 0.09941469755038562, "driven_lanedir_consec": 0.4261291824030562, "sim_compute_sim_state": 0.02273197401137579, "sim_compute_performance-ego": 0.03836211704072498, "sim_compute_robot_state-ego": 0.040588185900733584, "sim_compute_robot_state-npc0": 0.05611964634486607, "sim_compute_robot_state-npc1": 0.03938428560892741, "sim_compute_robot_state-npc2": 0.039196196056547616, "sim_compute_robot_state-npc3": 0.03936022803896949}, "udem1-12-0": {"driven_any": 1.3824591937553763, "sim_physics": 0.10541878400310394, "survival_time": 6.199999999999986, "driven_lanedir": 0.3402246555815205, "sim_render-ego": 0.03534124166734757, "in-drivable-lane": 4.799999999999987, "agent_compute-ego": 0.09544034158029864, "deviation-heading": 0.9247813938323732, "set_robot_commands": 0.05343397202030305, "deviation-center-line": 0.16225221199578418, "driven_lanedir_consec": 0.3402246555815205, "sim_compute_sim_state": 0.022105830331002514, "sim_compute_performance-ego": 0.03774715623547954, "sim_compute_robot_state-ego": 0.04032877952821793, "sim_compute_robot_state-npc0": 0.039503928153745586, "sim_compute_robot_state-npc1": 0.038867089056199594, "sim_compute_robot_state-npc2": 0.038661237685911114, "sim_compute_robot_state-npc3": 0.038693595317102245}, "udem1-13-0": {"driven_any": 1.628837292636662, "sim_physics": 0.09903453557919233, "survival_time": 9.750000000000004, "driven_lanedir": 1.2938002384019889, "sim_render-ego": 0.03524814874697954, "in-drivable-lane": 4.050000000000004, "agent_compute-ego": 0.09507711483882024, "deviation-heading": 3.507487670047857, "set_robot_commands": 0.053537992330697864, "deviation-center-line": 0.43117857132256254, "driven_lanedir_consec": 0.6557366352747889, "sim_compute_sim_state": 0.02230414121578901, "sim_compute_performance-ego": 0.038157142736972904, "sim_compute_robot_state-ego": 0.04021897927308694, "sim_compute_robot_state-npc0": 0.03988419679495005, "sim_compute_robot_state-npc1": 0.039271280093070786, "sim_compute_robot_state-npc2": 0.03896530591524564, "sim_compute_robot_state-npc3": 0.0393251590239696}, "udem1-14-0": {"driven_any": 0.6455182352717241, "sim_physics": 0.11480471323121268, "survival_time": 2.6499999999999986, "driven_lanedir": 0.17855427696068582, "sim_render-ego": 0.035964025641387364, "in-drivable-lane": 1.099999999999998, "agent_compute-ego": 0.09554360497672602, "deviation-heading": 0.7741476850944534, "set_robot_commands": 0.05371708689995531, "deviation-center-line": 0.077891975310135, "driven_lanedir_consec": 0.17855427696068582, "sim_compute_sim_state": 0.02211646313937205, "sim_compute_performance-ego": 0.037973520890721736, "sim_compute_robot_state-ego": 0.040326248924687225, "sim_compute_robot_state-npc0": 0.03950341692510641, "sim_compute_robot_state-npc1": 0.038845548089945094, "sim_compute_robot_state-npc2": 0.03881252486750765, "sim_compute_robot_state-npc3": 0.03934516097014805}}
set_robot_commands_max0.06898449562691353
set_robot_commands_mean0.05648489738518439
set_robot_commands_median0.054077553749084475
set_robot_commands_min0.05343397202030305
sim_compute_performance-ego_max0.05047347900029775
sim_compute_performance-ego_mean0.04014209872019044
sim_compute_performance-ego_median0.038157142736972904
sim_compute_performance-ego_min0.03774715623547954
sim_compute_robot_state-ego_max0.05037268271317353
sim_compute_robot_state-ego_mean0.04225431269397831
sim_compute_robot_state-ego_median0.04056805372238159
sim_compute_robot_state-ego_min0.04021897927308694
sim_compute_robot_state-npc0_max0.05611964634486607
sim_compute_robot_state-npc0_mean0.0429473072046431
sim_compute_robot_state-npc0_median0.03987253339667069
sim_compute_robot_state-npc0_min0.03950341692510641
sim_compute_robot_state-npc1_max0.04972328779832373
sim_compute_robot_state-npc1_mean0.04104754731687445
sim_compute_robot_state-npc1_median0.039271280093070786
sim_compute_robot_state-npc1_min0.03878322373265806
sim_compute_robot_state-npc2_max0.05014199130939988
sim_compute_robot_state-npc2_mean0.040894726244944904
sim_compute_robot_state-npc2_median0.03899813708612474
sim_compute_robot_state-npc2_min0.038661237685911114
sim_compute_robot_state-npc3_max0.04985267084998053
sim_compute_robot_state-npc3_mean0.04075129325925129
sim_compute_robot_state-npc3_median0.03924484001962762
sim_compute_robot_state-npc3_min0.03867713971571489
sim_compute_sim_state_max0.028648276586790342
sim_compute_sim_state_mean0.02330371970380152
sim_compute_sim_state_median0.022308659553527833
sim_compute_sim_state_min0.022105830331002514
sim_physics_max0.13298135454004462
sim_physics_mean0.11333659154007628
sim_physics_median0.1119976796601948
sim_physics_min0.09903453557919233
sim_render-ego_max0.04695734140035268
sim_render-ego_mean0.03749221920323052
sim_render-ego_median0.03573078632354736
sim_render-ego_min0.03524814874697954
simulation-passed1
survival_time_max11.800000000000033
survival_time_mean4.426666666666667
survival_time_min0.9500000000000004
233793620MYFtestaido2-LFVI-sim-testingstep1-simulationerroryes12910:23:36
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
Hidden. If you are the author, please login using the top-right link or use the dashboard.
233563609riza.veliogluaido2-LFV-sim-testingstep1-simulationerroryes12910:05:22
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
Hidden. If you are the author, please login using the top-right link or use the dashboard.
233553604MYFtestaido2-LFV-sim-testingstep1-simulationerroryes12910:29:31
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
Hidden. If you are the author, please login using the top-right link or use the dashboard.
233533602MYFtestaido2-LFV-sim-testingstep1-simulationerroryes12910:10:24
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
Hidden. If you are the author, please login using the top-right link or use the dashboard.
233323597Victor Adolfo Romero Canoaido2-LFV-sim-testingstep1-simulationsuccessyes12910:13:27Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.47061816984274774
survival_time_median2.4499999999999993
deviation-center-line_median0.09047885846140293
in-drivable-lane_median0.7999999999999974


other stats
agent_compute-ego_max0.12117403966409188
agent_compute-ego_mean0.0943884288169612
agent_compute-ego_median0.08579270044962566
agent_compute-ego_min0.0847318172454834
deviation-center-line_max0.1743913456502906
deviation-center-line_mean0.11122054568266285
deviation-center-line_min0.05649185041622204
deviation-heading_max0.8583234710357402
deviation-heading_mean0.371509805944231
deviation-heading_median0.3477435217829391
deviation-heading_min0.1892537419842091
driven_any_max1.6169932854589035
driven_any_mean0.8549136794030617
driven_any_median0.9441796518284096
driven_any_min0.28668385087664994
driven_lanedir_consec_max1.2433038249708377
driven_lanedir_consec_mean0.5622432991481365
driven_lanedir_consec_min0.24216121529728207
driven_lanedir_max1.2433038249708377
driven_lanedir_mean0.5622432991481365
driven_lanedir_median0.47061816984274774
driven_lanedir_min0.24216121529728207
in-drivable-lane_max1.3499999999999996
in-drivable-lane_mean0.5899999999999992
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0243289631429708, "sim_physics": 0.11150115066104466, "survival_time": 2.6999999999999984, "driven_lanedir": 0.5723310224856362, "sim_render-ego": 0.04608925625129982, "in-drivable-lane": 0.9999999999999976, "agent_compute-ego": 0.12117403966409188, "deviation-heading": 0.19401296908406307, "set_robot_commands": 0.06987743024472837, "deviation-center-line": 0.15907928712407893, "driven_lanedir_consec": 0.5723310224856362, "sim_compute_sim_state": 0.02789100452705666, "sim_compute_performance-ego": 0.04859203762478299, "sim_compute_robot_state-ego": 0.05176416591361717, "sim_compute_robot_state-npc0": 0.05264091933215106, "sim_compute_robot_state-npc1": 0.051717678705851235, "sim_compute_robot_state-npc2": 0.05222060503783049, "sim_compute_robot_state-npc3": 0.05050568668930619}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.4119037580118998, "sim_physics": 0.1309053611755371, "survival_time": 1.2500000000000004, "driven_lanedir": 0.3792793194470208, "sim_render-ego": 0.04664741516113281, "in-drivable-lane": 0, "agent_compute-ego": 0.11681883811950684, "deviation-heading": 0.47860435001913393, "set_robot_commands": 0.07168488502502442, "deviation-center-line": 0.09344288799285194, "driven_lanedir_consec": 0.3792793194470208, "sim_compute_sim_state": 0.030660943984985353, "sim_compute_performance-ego": 0.052088136672973635, "sim_compute_robot_state-ego": 0.05363428115844727, "sim_compute_robot_state-npc0": 0.051275386810302734, "sim_compute_robot_state-npc1": 0.04797172546386719, "sim_compute_robot_state-npc2": 0.05204931259155274, "sim_compute_robot_state-npc3": 0.05395244598388672}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.579862082650716, "sim_physics": 0.12064300712786225, "survival_time": 3.7999999999999945, "driven_lanedir": 1.2433038249708377, "sim_render-ego": 0.043275378252330576, "in-drivable-lane": 0.5999999999999979, "agent_compute-ego": 0.10630479298139874, "deviation-heading": 0.5020407942599273, "set_robot_commands": 0.06280541106274254, "deviation-center-line": 0.1743913456502906, "driven_lanedir_consec": 1.2433038249708377, "sim_compute_sim_state": 0.02797605175721018, "sim_compute_performance-ego": 0.04827641185961271, "sim_compute_robot_state-ego": 0.04914965127643786, "sim_compute_robot_state-npc0": 0.04643561965540836, "sim_compute_robot_state-npc1": 0.04619423652950086, "sim_compute_robot_state-npc2": 0.046722440343154106, "sim_compute_robot_state-npc3": 0.047222987601631565}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.6169932854589035, "sim_physics": 0.12712318685990345, "survival_time": 3.949999999999994, "driven_lanedir": 1.2126117310470583, "sim_render-ego": 0.043375664119479025, "in-drivable-lane": 0.849999999999997, "agent_compute-ego": 0.11014933525761472, "deviation-heading": 0.34764983431811214, "set_robot_commands": 0.06800885441937024, "deviation-center-line": 0.11519544839797546, "driven_lanedir_consec": 1.2126117310470583, "sim_compute_sim_state": 0.027159917203685904, "sim_compute_performance-ego": 0.04722817638252355, "sim_compute_robot_state-ego": 0.05012507378300534, "sim_compute_robot_state-npc0": 0.05246663998953904, "sim_compute_robot_state-npc1": 0.051373901246469234, "sim_compute_robot_state-npc2": 0.04975870892971377, "sim_compute_robot_state-npc3": 0.049436035035531734}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.5031772882846431, "sim_physics": 0.10010761874062676, "survival_time": 1.4000000000000006, "driven_lanedir": 0.4926325270527603, "sim_render-ego": 0.04044470616749355, "in-drivable-lane": 0, "agent_compute-ego": 0.10578417778015135, "deviation-heading": 0.29868161596444953, "set_robot_commands": 0.060710276876177104, "deviation-center-line": 0.09047885846140293, "driven_lanedir_consec": 0.4926325270527603, "sim_compute_sim_state": 0.023120462894439697, "sim_compute_performance-ego": 0.04603620086397443, "sim_compute_robot_state-ego": 0.04451092651912144, "sim_compute_robot_state-npc0": 0.04329056399209159, "sim_compute_robot_state-npc1": 0.04232628004891532, "sim_compute_robot_state-npc2": 0.04309627839497158, "sim_compute_robot_state-npc3": 0.04184817416327341}, "ETHZ_autolab_technical_track-5-0": {"driven_any": 1.0440585337030532, "sim_physics": 0.08194327354431152, "survival_time": 2.6999999999999984, "driven_lanedir": 0.5009536316076031, "sim_render-ego": 0.03521350578025535, "in-drivable-lane": 1.0000000000000009, "agent_compute-ego": 0.08624926761344627, "deviation-heading": 0.8583234710357402, "set_robot_commands": 0.0536988134737368, "deviation-center-line": 0.1636702708892767, "driven_lanedir_consec": 0.5009536316076031, "sim_compute_sim_state": 0.022231746602941443, "sim_compute_performance-ego": 0.0406493654957524, "sim_compute_robot_state-ego": 0.04001951217651367, "sim_compute_robot_state-npc0": 0.039231057520265934, "sim_compute_robot_state-npc1": 0.03960601930265074, "sim_compute_robot_state-npc2": 0.03868971047578035, "sim_compute_robot_state-npc3": 0.03861169903366654}, "ETHZ_autolab_technical_track-6-0": {"driven_any": 1.045672984989961, "sim_physics": 0.0844954737910518, "survival_time": 2.6999999999999984, "driven_lanedir": 0.636422849544542, "sim_render-ego": 0.03490696571491383, "in-drivable-lane": 0.7999999999999974, "agent_compute-ego": 0.08579270044962566, "deviation-heading": 0.39273667682101354, "set_robot_commands": 0.0532834044209233, "deviation-center-line": 0.08970073753261001, "driven_lanedir_consec": 0.636422849544542, "sim_compute_sim_state": 0.022049034083331073, "sim_compute_performance-ego": 0.037778125868903265, "sim_compute_robot_state-ego": 0.03988954755995008, "sim_compute_robot_state-npc0": 0.039292494455973305, "sim_compute_robot_state-npc1": 0.03864149252573649, "sim_compute_robot_state-npc2": 0.03863577489499693, "sim_compute_robot_state-npc3": 0.0385353167851766}, "ETHZ_autolab_technical_track-7-0": {"driven_any": 0.877256228857091, "sim_physics": 0.11228564580281576, "survival_time": 2.25, "driven_lanedir": 0.38713958773684665, "sim_render-ego": 0.03631012704637315, "in-drivable-lane": 0.9999999999999996, "agent_compute-ego": 0.08685203658209907, "deviation-heading": 0.384474040685185, "set_robot_commands": 0.05411349402533637, "deviation-center-line": 0.07500609722918031, "driven_lanedir_consec": 0.38713958773684665, "sim_compute_sim_state": 0.022988091574774848, "sim_compute_performance-ego": 0.03919310569763183, "sim_compute_robot_state-ego": 0.04229167302449544, "sim_compute_robot_state-npc0": 0.04039191669887966, "sim_compute_robot_state-npc1": 0.040125799179077146, "sim_compute_robot_state-npc2": 0.03963661193847656, "sim_compute_robot_state-npc3": 0.04009330007765028}, "ETHZ_autolab_technical_track-8-0": {"driven_any": 0.8433010974171573, "sim_physics": 0.08624698804772418, "survival_time": 2.3, "driven_lanedir": 0.24216121529728207, "sim_render-ego": 0.03493636587391729, "in-drivable-lane": 1.3499999999999996, "agent_compute-ego": 0.08536121119623599, "deviation-heading": 0.34566993689777425, "set_robot_commands": 0.05324211327925972, "deviation-center-line": 0.07136114712800473, "driven_lanedir_consec": 0.24216121529728207, "sim_compute_sim_state": 0.02224360859912375, "sim_compute_performance-ego": 0.037977228993954865, "sim_compute_robot_state-ego": 0.04002940654754639, "sim_compute_robot_state-npc0": 0.039358786914659584, "sim_compute_robot_state-npc1": 0.03873440493708071, "sim_compute_robot_state-npc2": 0.038615936818330185, "sim_compute_robot_state-npc3": 0.03882363568181577}, "ETHZ_autolab_technical_track-9-0": {"driven_any": 0.9785013113851152, "sim_physics": 0.10017043590545656, "survival_time": 2.499999999999999, "driven_lanedir": 0.9700080716683566, "sim_render-ego": 0.034849538803100585, "in-drivable-lane": 0, "agent_compute-ego": 0.08571155071258545, "deviation-heading": 0.3477435217829391, "set_robot_commands": 0.053426289558410646, "deviation-center-line": 0.15723242276422936, "driven_lanedir_consec": 0.9700080716683566, "sim_compute_sim_state": 0.02205103874206543, "sim_compute_performance-ego": 0.03853568077087402, "sim_compute_robot_state-ego": 0.0427286434173584, "sim_compute_robot_state-npc0": 0.03912705421447754, "sim_compute_robot_state-npc1": 0.03872065067291259, "sim_compute_robot_state-npc2": 0.0386264181137085, "sim_compute_robot_state-npc3": 0.0386556339263916}, "ETHZ_autolab_technical_track-10-0": {"driven_any": 0.3129292149411446, "sim_physics": 0.1122372031211853, "survival_time": 1.0000000000000002, "driven_lanedir": 0.2864579763812336, "sim_render-ego": 0.0351258397102356, "in-drivable-lane": 0, "agent_compute-ego": 0.0855568528175354, "deviation-heading": 0.38016104491567027, "set_robot_commands": 0.05282052755355835, "deviation-center-line": 0.05649185041622204, "driven_lanedir_consec": 0.2864579763812336, "sim_compute_sim_state": 0.0220969557762146, "sim_compute_performance-ego": 0.037859654426574706, "sim_compute_robot_state-ego": 0.03998314142227173, "sim_compute_robot_state-npc0": 0.039096271991729735, "sim_compute_robot_state-npc1": 0.038419461250305174, "sim_compute_robot_state-npc2": 0.03839997053146362, "sim_compute_robot_state-npc3": 0.0385094404220581}, "ETHZ_autolab_technical_track-11-0": {"driven_any": 0.28668385087664994, "sim_physics": 0.08870715844003778, "survival_time": 0.9500000000000004, "driven_lanedir": 0.278237107094367, "sim_render-ego": 0.03434359399895919, "in-drivable-lane": 0, "agent_compute-ego": 0.0847318172454834, "deviation-heading": 0.19732996798555608, "set_robot_commands": 0.05273724857129549, "deviation-center-line": 0.08671144489080887, "driven_lanedir_consec": 0.278237107094367, "sim_compute_sim_state": 0.02198984748438785, "sim_compute_performance-ego": 0.037758864854511465, "sim_compute_robot_state-ego": 0.03959963196202328, "sim_compute_robot_state-npc0": 0.03901698714808414, "sim_compute_robot_state-npc1": 0.03854633632459139, "sim_compute_robot_state-npc2": 0.03842009996113024, "sim_compute_robot_state-npc3": 0.038662734784578025}, "ETHZ_autolab_technical_track-12-0": {"driven_any": 1.0034139953700494, "sim_physics": 0.082181396484375, "survival_time": 2.499999999999999, "driven_lanedir": 0.47061816984274774, "sim_render-ego": 0.03448686599731445, "in-drivable-lane": 1.1499999999999986, "agent_compute-ego": 0.0849280023574829, "deviation-heading": 0.2263485117662671, "set_robot_commands": 0.05235579967498779, "deviation-center-line": 0.1594122934983136, "driven_lanedir_consec": 0.47061816984274774, "sim_compute_sim_state": 0.02206511974334717, "sim_compute_performance-ego": 0.037347850799560545, "sim_compute_robot_state-ego": 0.03948755264282226, "sim_compute_robot_state-npc0": 0.03905360221862793, "sim_compute_robot_state-npc1": 0.03832610607147217, "sim_compute_robot_state-npc2": 0.03896951675415039, "sim_compute_robot_state-npc3": 0.03840787410736084}, "ETHZ_autolab_technical_track-13-0": {"driven_any": 0.351442944128162, "sim_physics": 0.1042057600888339, "survival_time": 1.1000000000000003, "driven_lanedir": 0.34114611245347204, "sim_render-ego": 0.035158601674166595, "in-drivable-lane": 0, "agent_compute-ego": 0.0850601087916981, "deviation-heading": 0.1892537419842091, "set_robot_commands": 0.05273234844207764, "deviation-center-line": 0.08918370733714856, "driven_lanedir_consec": 0.34114611245347204, "sim_compute_sim_state": 0.022030754522843796, "sim_compute_performance-ego": 0.03761691396886653, "sim_compute_robot_state-ego": 0.03987704623829235, "sim_compute_robot_state-npc0": 0.03899142958901145, "sim_compute_robot_state-npc1": 0.03853940963745117, "sim_compute_robot_state-npc2": 0.03844360871748491, "sim_compute_robot_state-npc3": 0.03821939771825617}, "ETHZ_autolab_technical_track-14-0": {"driven_any": 0.9441796518284096, "sim_physics": 0.10011285178515376, "survival_time": 2.4499999999999993, "driven_lanedir": 0.4203463405922858, "sim_render-ego": 0.034939201510682395, "in-drivable-lane": 1.0999999999999988, "agent_compute-ego": 0.08535170068546218, "deviation-heading": 0.4296166116434236, "set_robot_commands": 0.052632229668753486, "deviation-center-line": 0.08695038592754878, "driven_lanedir_consec": 0.4203463405922858, "sim_compute_sim_state": 0.02192103619478187, "sim_compute_performance-ego": 0.03753426610207071, "sim_compute_robot_state-ego": 0.03961390378523846, "sim_compute_robot_state-npc0": 0.046734848800970584, "sim_compute_robot_state-npc1": 0.03838518687656948, "sim_compute_robot_state-npc2": 0.03809822822103695, "sim_compute_robot_state-npc3": 0.03828405847354811}}
set_robot_commands_max0.07168488502502442
set_robot_commands_mean0.05760860841975882
set_robot_commands_median0.053426289558410646
set_robot_commands_min0.05235579967498779
sim_compute_performance-ego_max0.052088136672973635
sim_compute_performance-ego_mean0.041631468025504506
sim_compute_performance-ego_median0.03853568077087402
sim_compute_performance-ego_min0.037347850799560545
sim_compute_robot_state-ego_max0.05363428115844727
sim_compute_robot_state-ego_mean0.043513610495142734
sim_compute_robot_state-ego_median0.04002940654754639
sim_compute_robot_state-ego_min0.03948755264282226
sim_compute_robot_state-npc0_max0.05264091933215106
sim_compute_robot_state-npc0_mean0.04309357195547817
sim_compute_robot_state-npc0_median0.039358786914659584
sim_compute_robot_state-npc0_min0.03899142958901145
sim_compute_robot_state-npc1_max0.051717678705851235
sim_compute_robot_state-npc1_mean0.041841912584830054
sim_compute_robot_state-npc1_median0.03873440493708071
sim_compute_robot_state-npc1_min0.03832610607147217
sim_compute_robot_state-npc2_max0.05222060503783049
sim_compute_robot_state-npc2_mean0.04202554811491875
sim_compute_robot_state-npc2_median0.03868971047578035
sim_compute_robot_state-npc2_min0.03809822822103695
sim_compute_robot_state-npc3_max0.05395244598388672
sim_compute_robot_state-npc3_mean0.041984561365608776
sim_compute_robot_state-npc3_median0.038662734784578025
sim_compute_robot_state-npc3_min0.03821939771825617
sim_compute_sim_state_max0.030660943984985353
sim_compute_sim_state_mean0.02389837424607931
sim_compute_sim_state_median0.022231746602941443
sim_compute_sim_state_min0.02192103619478187
sim_physics_max0.1309053611755371
sim_physics_mean0.10285776743839464
sim_physics_median0.10017043590545656
sim_physics_min0.08194327354431152
sim_render-ego_max0.04664741516113281
sim_render-ego_mean0.038006868404110286
sim_render-ego_median0.035158601674166595
sim_render-ego_min0.03434359399895919
simulation-passed1
survival_time_max3.949999999999994
survival_time_mean2.2366666666666655
survival_time_min0.9500000000000004
232923513Bea Baselineschallenge-aido_LF-template-pytorchaido2-LFVI-sim-validationstep1-simulationsuccessyes12910:08:12Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.126519619846877
survival_time_median1.2500000000000004
deviation-center-line_median0.09099610507857396
in-drivable-lane_median0


other stats
agent_compute-ego_max0.17437504952953709
agent_compute-ego_mean0.15807920630602
agent_compute-ego_median0.15490864753723144
agent_compute-ego_min0.1480963627497355
deviation-center-line_max0.1133884355221843
deviation-center-line_mean0.08992195278247239
deviation-center-line_min0.06389265570941403
deviation-heading_max0.9918498881185052
deviation-heading_mean0.6989804307508887
deviation-heading_median0.7489263178993967
deviation-heading_min0.4286232289812193
driven_any_max0.2071389909002107
driven_any_mean0.18601213728065524
driven_any_median0.1843375442846786
driven_any_min0.16473283374657466
driven_lanedir_consec_max0.15677666245360866
driven_lanedir_consec_mean0.1267139230659188
driven_lanedir_consec_min0.09642465400829003
driven_lanedir_max0.15677666245360866
driven_lanedir_mean0.1267139230659188
driven_lanedir_median0.126519619846877
driven_lanedir_min0.09642465400829003
in-drivable-lane_max0.20000000000000015
in-drivable-lane_mean0.04000000000000003
in-drivable-lane_min0
per-episodes
details{"udem1-0-0": {"driven_any": 0.2041346079356744, "sim_physics": 0.20655958114131803, "survival_time": 1.5500000000000007, "driven_lanedir": 0.09642465400829003, "sim_render-ego": 0.06199335282848727, "in-drivable-lane": 0.20000000000000015, "agent_compute-ego": 0.17437504952953709, "deviation-heading": 0.8654299790414866, "set_robot_commands": 0.08897796753914125, "deviation-center-line": 0.07535448141486417, "driven_lanedir_consec": 0.09642465400829003, "sim_compute_sim_state": 0.03978893064683483, "sim_compute_performance-ego": 0.0695214117726972, "sim_compute_robot_state-ego": 0.07844278120225476, "sim_compute_robot_state-npc0": 0.06974702496682444, "sim_compute_robot_state-npc1": 0.06656402926291188, "sim_compute_robot_state-npc2": 0.06976249141077842, "sim_compute_robot_state-npc3": 0.06549476808117281}, "udem1-1-0": {"driven_any": 0.2071389909002107, "sim_physics": 0.19499941225405093, "survival_time": 1.3500000000000003, "driven_lanedir": 0.126519619846877, "sim_render-ego": 0.061435558177806715, "in-drivable-lane": 0, "agent_compute-ego": 0.1538143687778049, "deviation-heading": 0.9918498881185052, "set_robot_commands": 0.07576971583896214, "deviation-center-line": 0.09099610507857396, "driven_lanedir_consec": 0.126519619846877, "sim_compute_sim_state": 0.03699239978083858, "sim_compute_performance-ego": 0.06923903359307183, "sim_compute_robot_state-ego": 0.0686461572293882, "sim_compute_robot_state-npc0": 0.06295571503815828, "sim_compute_robot_state-npc1": 0.05931214933042173, "sim_compute_robot_state-npc2": 0.05754051385102449, "sim_compute_robot_state-npc3": 0.06738716584664804}, "udem1-2-0": {"driven_any": 0.1843375442846786, "sim_physics": 0.21084897994995117, "survival_time": 1.2500000000000004, "driven_lanedir": 0.15677666245360866, "sim_render-ego": 0.057331695556640624, "in-drivable-lane": 0, "agent_compute-ego": 0.15490864753723144, "deviation-heading": 0.4286232289812193, "set_robot_commands": 0.08966363906860352, "deviation-center-line": 0.1133884355221843, "driven_lanedir_consec": 0.15677666245360866, "sim_compute_sim_state": 0.036446666717529295, "sim_compute_performance-ego": 0.059206151962280275, "sim_compute_robot_state-ego": 0.06776450157165527, "sim_compute_robot_state-npc0": 0.06362541198730469, "sim_compute_robot_state-npc1": 0.0653553295135498, "sim_compute_robot_state-npc2": 0.06928662300109863, "sim_compute_robot_state-npc3": 0.06553478240966797}, "udem1-3-0": {"driven_any": 0.1697167095361378, "sim_physics": 0.19585787773132324, "survival_time": 1.2500000000000004, "driven_lanedir": 0.1403138163611315, "sim_render-ego": 0.06261606216430664, "in-drivable-lane": 0, "agent_compute-ego": 0.15920160293579105, "deviation-heading": 0.4600727397138359, "set_robot_commands": 0.09010379791259764, "deviation-center-line": 0.10597808618732547, "driven_lanedir_consec": 0.1403138163611315, "sim_compute_sim_state": 0.032850522994995114, "sim_compute_performance-ego": 0.06647941589355469, "sim_compute_robot_state-ego": 0.07230002403259278, "sim_compute_robot_state-npc0": 0.06809094429016113, "sim_compute_robot_state-npc1": 0.06808688163757325, "sim_compute_robot_state-npc2": 0.06462312698364257, "sim_compute_robot_state-npc3": 0.06273202896118164}, "udem1-4-0": {"driven_any": 0.16473283374657466, "sim_physics": 0.1806030571460724, "survival_time": 1.2000000000000004, "driven_lanedir": 0.11353486265968682, "sim_render-ego": 0.055715968211491905, "in-drivable-lane": 0, "agent_compute-ego": 0.1480963627497355, "deviation-heading": 0.7489263178993967, "set_robot_commands": 0.08113818367322286, "deviation-center-line": 0.06389265570941403, "driven_lanedir_consec": 0.11353486265968682, "sim_compute_sim_state": 0.03428687651952108, "sim_compute_performance-ego": 0.06407466530799866, "sim_compute_robot_state-ego": 0.06794539093971252, "sim_compute_robot_state-npc0": 0.05488091707229614, "sim_compute_robot_state-npc1": 0.0593599279721578, "sim_compute_robot_state-npc2": 0.05697957674662272, "sim_compute_robot_state-npc3": 0.0595604677995046}}
set_robot_commands_max0.09010379791259764
set_robot_commands_mean0.08513066080650547
set_robot_commands_median0.08897796753914125
set_robot_commands_min0.07576971583896214
sim_compute_performance-ego_max0.0695214117726972
sim_compute_performance-ego_mean0.06570413570592053
sim_compute_performance-ego_median0.06647941589355469
sim_compute_performance-ego_min0.059206151962280275
sim_compute_robot_state-ego_max0.07844278120225476
sim_compute_robot_state-ego_mean0.0710197709951207
sim_compute_robot_state-ego_median0.0686461572293882
sim_compute_robot_state-ego_min0.06776450157165527
sim_compute_robot_state-npc0_max0.06974702496682444
sim_compute_robot_state-npc0_mean0.06386000267094893
sim_compute_robot_state-npc0_median0.06362541198730469
sim_compute_robot_state-npc0_min0.05488091707229614
sim_compute_robot_state-npc1_max0.06808688163757325
sim_compute_robot_state-npc1_mean0.06373566354332288
sim_compute_robot_state-npc1_median0.0653553295135498
sim_compute_robot_state-npc1_min0.05931214933042173
sim_compute_robot_state-npc2_max0.06976249141077842
sim_compute_robot_state-npc2_mean0.06363846639863338
sim_compute_robot_state-npc2_median0.06462312698364257
sim_compute_robot_state-npc2_min0.05697957674662272
sim_compute_robot_state-npc3_max0.06738716584664804
sim_compute_robot_state-npc3_mean0.064141842619635
sim_compute_robot_state-npc3_median0.06549476808117281
sim_compute_robot_state-npc3_min0.0595604677995046
sim_compute_sim_state_max0.03978893064683483
sim_compute_sim_state_mean0.03607307933194378
sim_compute_sim_state_median0.036446666717529295
sim_compute_sim_state_min0.032850522994995114
sim_physics_max0.21084897994995117
sim_physics_mean0.19777378164454312
sim_physics_median0.19585787773132324
sim_physics_min0.1806030571460724
sim_render-ego_max0.06261606216430664
sim_render-ego_mean0.05981852738774664
sim_render-ego_median0.061435558177806715
sim_render-ego_min0.055715968211491905
simulation-passed1
survival_time_max1.5500000000000007
survival_time_mean1.3200000000000005
survival_time_min1.2000000000000004
231693575Bhairav Mehtachallenge-aido_LF-template-pytorchaido2-LFVI-sim-testingstep1-simulationerroryes12910:01:32
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
Hidden. If you are the author, please login using the top-right link or use the dashboard.