Duckietown Challenges Home Challenges Submissions

Evaluator 1583

ID1583
evaluatorip-172-31-46-148-10490
ownerI don't have one 😀
machineip-172-31-46-148
processip-172-31-46-148-10490
versiond-c:5.0.7;d-c-r:5.0.10;d-s:5.0.3
first heard
last heard
statusinactive
# evaluating
# success31 24485
# timeout
# failed4 24923
# error14 24437
# aborted1 24577
# host-error4 24648
arm
x86_64
Mac
gpu available
Number of processors
Processor frequency (MHz)
Free % of processors
RAM total (MB)
RAM free (MB)
Disk (MB)
Disk available (MB)
Docker Hub
P1
P2
Cloud simulations
PI Camera
# Duckiebots
Map 3x3 avaiable
Number of duckies
gpu cores
AIDO 2 Map LF public
AIDO 2 Map LF private
AIDO 2 Map LFV public
AIDO 2 Map LFV private
AIDO 2 Map LFVI public
AIDO 2 Map LFVI private
AIDO 3 Map LF public
AIDO 3 Map LF private
AIDO 3 Map LFV public
AIDO 3 Map LFV private
AIDO 3 Map LFVI public
AIDO 3 Map LFVI private
AIDO 5 Map large loop
ETU track
for 2021, map is ETH_small_inter
IPFS mountpoint /ipfs available
IPNS mountpoint /ipns available

Evaluator jobs

Job IDsubmissionuseruser labelchallengestepstatusup to dateevaluatordate starteddate completeddurationmessage
251194392Jeick Hincapie Barrera 🇨🇴challenge-aido_LF-template-ros - Template solution using ROSaido3-LFV-sim-testingstep1-simulationsuccessnoip-172-31-46-148-104900:16:44
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.30314311735235044
survival_time_median2.6499999999999986
deviation-center-line_median0.1192462800776758
in-drivable-lane_median0.9499999999999966


other stats
agent_compute-ego_max0.02522888637724377
agent_compute-ego_mean0.01763903903108693
agent_compute-ego_median0.01436751133927675
agent_compute-ego_min0.013377151489257812
deviation-center-line_max0.2294363663374862
deviation-center-line_mean0.12653708755488868
deviation-center-line_min0.06426934298501713
deviation-heading_max0.6986268167330367
deviation-heading_mean0.44799520296706863
deviation-heading_median0.41847631252347706
deviation-heading_min0.2596285487829773
driven_any_max1.5997333541177865
driven_any_mean0.8095342605803051
driven_any_median0.7336463183586179
driven_any_min0.26903550091980144
driven_lanedir_consec_max1.021002447119848
driven_lanedir_consec_mean0.4489048090243791
driven_lanedir_consec_min0.2407721645627201
driven_lanedir_max1.021002447119848
driven_lanedir_mean0.4489048090243791
driven_lanedir_median0.30314311735235044
driven_lanedir_min0.2407721645627201
in-drivable-lane_max4.799999999999986
in-drivable-lane_mean1.1466666666666634
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.9226822529128632, "sim_physics": 0.14396603006712147, "survival_time": 3.5499999999999954, "driven_lanedir": 0.36592094708219225, "sim_render-ego": 0.011952672206180195, "in-drivable-lane": 1.8999999999999944, "agent_compute-ego": 0.02215176568904393, "deviation-heading": 0.2596285487829773, "set_robot_commands": 0.008356295840840943, "deviation-center-line": 0.16987818035809085, "driven_lanedir_consec": 0.36592094708219225, "sim_compute_sim_state": 0.004573818663476219, "sim_compute_performance-ego": 0.0071815201933954805, "sim_compute_robot_state-ego": 0.008913406184021855, "sim_compute_robot_state-npc0": 0.008227663980403416, "sim_compute_robot_state-npc1": 0.0078273894081653, "sim_compute_robot_state-npc2": 0.007619485049180581, "sim_compute_robot_state-npc3": 0.007724926505290287}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.3642886245953953, "sim_physics": 0.20324229449033737, "survival_time": 1.6000000000000008, "driven_lanedir": 0.3026144243018116, "sim_render-ego": 0.01319439709186554, "in-drivable-lane": 0.05000000000000005, "agent_compute-ego": 0.022965870797634125, "deviation-heading": 0.6986268167330367, "set_robot_commands": 0.009772434830665588, "deviation-center-line": 0.10463456752710912, "driven_lanedir_consec": 0.3026144243018116, "sim_compute_sim_state": 0.005103863775730133, "sim_compute_performance-ego": 0.007755450904369354, "sim_compute_robot_state-ego": 0.009694069623947144, "sim_compute_robot_state-npc0": 0.008496269583702087, "sim_compute_robot_state-npc1": 0.008531950414180756, "sim_compute_robot_state-npc2": 0.009007543325424194, "sim_compute_robot_state-npc3": 0.008994616568088531}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.7336463183586179, "sim_physics": 0.1715197333922753, "survival_time": 2.5999999999999988, "driven_lanedir": 0.727268775640014, "sim_render-ego": 0.012089903538043682, "in-drivable-lane": 0, "agent_compute-ego": 0.022365267460162826, "deviation-heading": 0.27230767118055227, "set_robot_commands": 0.008476793766021729, "deviation-center-line": 0.2294363663374862, "driven_lanedir_consec": 0.727268775640014, "sim_compute_sim_state": 0.004764717358809251, "sim_compute_performance-ego": 0.006900058342860295, "sim_compute_robot_state-ego": 0.007896143656510573, "sim_compute_robot_state-npc0": 0.008167331035320576, "sim_compute_robot_state-npc1": 0.008034619001241831, "sim_compute_robot_state-npc2": 0.007536411285400391, "sim_compute_robot_state-npc3": 0.007359605569105882}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.2972979671834337, "sim_physics": 0.18458674543647355, "survival_time": 4.6499999999999915, "driven_lanedir": 0.97716132702229, "sim_render-ego": 0.012424279284733598, "in-drivable-lane": 0.9499999999999966, "agent_compute-ego": 0.023964323023314117, "deviation-heading": 0.49111273392260785, "set_robot_commands": 0.008644416768063781, "deviation-center-line": 0.18038572117738352, "driven_lanedir_consec": 0.97716132702229, "sim_compute_sim_state": 0.005038399850168536, "sim_compute_performance-ego": 0.007637372580907678, "sim_compute_robot_state-ego": 0.00918906734835717, "sim_compute_robot_state-npc0": 0.0083813718570176, "sim_compute_robot_state-npc1": 0.008564377343782814, "sim_compute_robot_state-npc2": 0.008653827892836703, "sim_compute_robot_state-npc3": 0.008097981893888084}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.26903550091980144, "sim_physics": 0.1886016527811686, "survival_time": 1.0500000000000005, "driven_lanedir": 0.2407721645627201, "sim_render-ego": 0.013798645564488, "in-drivable-lane": 0, "agent_compute-ego": 0.02522888637724377, "deviation-heading": 0.41847631252347706, "set_robot_commands": 0.007964066096714564, "deviation-center-line": 0.06426934298501713, "driven_lanedir_consec": 0.2407721645627201, "sim_compute_sim_state": 0.0052694933755057195, "sim_compute_performance-ego": 0.008360737846011207, "sim_compute_robot_state-ego": 0.009824786867414202, "sim_compute_robot_state-npc0": 0.008254516692388626, "sim_compute_robot_state-npc1": 0.00831929842631022, "sim_compute_robot_state-npc2": 0.008502120063418434, "sim_compute_robot_state-npc3": 0.008581922167823428}, "ETHZ_autolab_technical_track-5-0": {"driven_any": 1.5997333541177865, "sim_physics": 0.14189116619835215, "survival_time": 6.0499999999999865, "driven_lanedir": 0.26415979567759074, "sim_render-ego": 0.010006989329314427, "in-drivable-lane": 4.799999999999986, "agent_compute-ego": 0.02109342567191636, "deviation-heading": 0.39392468133084674, "set_robot_commands": 0.007882478808568528, "deviation-center-line": 0.1277842828221673, "driven_lanedir_consec": 0.26415979567759074, "sim_compute_sim_state": 0.0043377580721516255, "sim_compute_performance-ego": 0.006057526454452641, "sim_compute_robot_state-ego": 0.0075004967776211824, "sim_compute_robot_state-npc0": 0.007402242707812096, "sim_compute_robot_state-npc1": 0.007142151682830054, "sim_compute_robot_state-npc2": 0.0070679759191087455, "sim_compute_robot_state-npc3": 0.0071793745371921}, "ETHZ_autolab_technical_track-6-0": {"driven_any": 1.0951392646085552, "sim_physics": 0.08590284131822132, "survival_time": 4.199999999999993, "driven_lanedir": 0.5659790827231916, "sim_render-ego": 0.007131633304414295, "in-drivable-lane": 1.7499999999999938, "agent_compute-ego": 0.014062285423278809, "deviation-heading": 0.5971215168818821, "set_robot_commands": 0.0048579687163943334, "deviation-center-line": 0.11288019725884532, "driven_lanedir_consec": 0.5659790827231916, "sim_compute_sim_state": 0.0028214000520252044, "sim_compute_performance-ego": 0.003908285072871617, "sim_compute_robot_state-ego": 0.005066286949884324, "sim_compute_robot_state-npc0": 0.00468253805523827, "sim_compute_robot_state-npc1": 0.004544760499681745, "sim_compute_robot_state-npc2": 0.004534863290332612, "sim_compute_robot_state-npc3": 0.004523754119873047}, "ETHZ_autolab_technical_track-7-0": {"driven_any": 1.045244117645196, "sim_physics": 0.10808972410253576, "survival_time": 3.699999999999995, "driven_lanedir": 1.021002447119848, "sim_render-ego": 0.007094947067466942, "in-drivable-lane": 0, "agent_compute-ego": 0.01416865232828501, "deviation-heading": 0.6206310196168163, "set_robot_commands": 0.0047635194417592645, "deviation-center-line": 0.143630204236955, "driven_lanedir_consec": 1.021002447119848, "sim_compute_sim_state": 0.002797858135120289, "sim_compute_performance-ego": 0.003891445494986869, "sim_compute_robot_state-ego": 0.005112722113325789, "sim_compute_robot_state-npc0": 0.004677482553430506, "sim_compute_robot_state-npc1": 0.004502312557117359, "sim_compute_robot_state-npc2": 0.004486412615389438, "sim_compute_robot_state-npc3": 0.004471695100938952}, "ETHZ_autolab_technical_track-8-0": {"driven_any": 1.0535850482576203, "sim_physics": 0.08814028236601087, "survival_time": 3.599999999999995, "driven_lanedir": 0.30314311735235044, "sim_render-ego": 0.007132609685262044, "in-drivable-lane": 2.2999999999999945, "agent_compute-ego": 0.014003644386927286, "deviation-heading": 0.40636604380954594, "set_robot_commands": 0.004859056737687852, "deviation-center-line": 0.10907487511555888, "driven_lanedir_consec": 0.30314311735235044, "sim_compute_sim_state": 0.002817915545569526, "sim_compute_performance-ego": 0.00392165117793613, "sim_compute_robot_state-ego": 0.005109584993786282, "sim_compute_robot_state-npc0": 0.004729708035786946, "sim_compute_robot_state-npc1": 0.004591070943408542, "sim_compute_robot_state-npc2": 0.0045545101165771484, "sim_compute_robot_state-npc3": 0.004536615477667915}, "ETHZ_autolab_technical_track-9-0": {"driven_any": 1.479979900188255, "sim_physics": 0.13144428262086671, "survival_time": 5.349999999999989, "driven_lanedir": 0.5481518397312493, "sim_render-ego": 0.007133806977316598, "in-drivable-lane": 2.9499999999999895, "agent_compute-ego": 0.01436751133927675, "deviation-heading": 0.551444452143596, "set_robot_commands": 0.0048581261501134, "deviation-center-line": 0.10072735470855042, "driven_lanedir_consec": 0.5481518397312493, "sim_compute_sim_state": 0.002799069770028658, "sim_compute_performance-ego": 0.0038944761329722183, "sim_compute_robot_state-ego": 0.005099958348497052, "sim_compute_robot_state-npc0": 0.004746940648444345, "sim_compute_robot_state-npc1": 0.004529271170357677, "sim_compute_robot_state-npc2": 0.004497129226399359, "sim_compute_robot_state-npc3": 0.004472050711373302}, "ETHZ_autolab_technical_track-10-0": {"driven_any": 0.29610946631760215, "sim_physics": 0.12260667483011882, "survival_time": 1.3500000000000003, "driven_lanedir": 0.27060744077321397, "sim_render-ego": 0.007486723087452076, "in-drivable-lane": 0, "agent_compute-ego": 0.014660640999122902, "deviation-heading": 0.5373504765871612, "set_robot_commands": 0.005006622385095667, "deviation-center-line": 0.08269292286428997, "driven_lanedir_consec": 0.27060744077321397, "sim_compute_sim_state": 0.002883310671205874, "sim_compute_performance-ego": 0.0039849987736454715, "sim_compute_robot_state-ego": 0.0051688529826976635, "sim_compute_robot_state-npc0": 0.004924050083866826, "sim_compute_robot_state-npc1": 0.0045849040702537255, "sim_compute_robot_state-npc2": 0.004582820115266023, "sim_compute_robot_state-npc3": 0.004608286751641167}, "ETHZ_autolab_technical_track-11-0": {"driven_any": 0.2779147140642616, "sim_physics": 0.08792939186096191, "survival_time": 1.2500000000000004, "driven_lanedir": 0.2638710416011838, "sim_render-ego": 0.007144441604614258, "in-drivable-lane": 0, "agent_compute-ego": 0.013377151489257812, "deviation-heading": 0.31056899459809534, "set_robot_commands": 0.004993095397949219, "deviation-center-line": 0.1192462800776758, "driven_lanedir_consec": 0.2638710416011838, "sim_compute_sim_state": 0.0028054237365722655, "sim_compute_performance-ego": 0.0039023876190185545, "sim_compute_robot_state-ego": 0.005096569061279297, "sim_compute_robot_state-npc0": 0.004748268127441406, "sim_compute_robot_state-npc1": 0.004535646438598633, "sim_compute_robot_state-npc2": 0.004490814208984375, "sim_compute_robot_state-npc3": 0.004497060775756836}, "ETHZ_autolab_technical_track-12-0": {"driven_any": 0.7174039891727134, "sim_physics": 0.0896929255071676, "survival_time": 2.6499999999999986, "driven_lanedir": 0.29766819613667395, "sim_render-ego": 0.007143133091476728, "in-drivable-lane": 1.249999999999998, "agent_compute-ego": 0.013916051612710052, "deviation-heading": 0.31225938815789966, "set_robot_commands": 0.004889033875375424, "deviation-center-line": 0.14209620948179827, "driven_lanedir_consec": 0.29766819613667395, "sim_compute_sim_state": 0.002783622381822118, "sim_compute_performance-ego": 0.0038827905115091576, "sim_compute_robot_state-ego": 0.005027339143573113, "sim_compute_robot_state-npc0": 0.004726198484312813, "sim_compute_robot_state-npc1": 0.004519251157652657, "sim_compute_robot_state-npc2": 0.004501428244248876, "sim_compute_robot_state-npc3": 0.00449051946963904}, "ETHZ_autolab_technical_track-13-0": {"driven_any": 0.3170173854101933, "sim_physics": 0.11529111862182616, "survival_time": 1.5500000000000007, "driven_lanedir": 0.30712670008511367, "sim_render-ego": 0.007103343163767169, "in-drivable-lane": 0, "agent_compute-ego": 0.014127539050194524, "deviation-heading": 0.299628345931933, "set_robot_commands": 0.004842981215446226, "deviation-center-line": 0.13363659833059607, "driven_lanedir_consec": 0.30712670008511367, "sim_compute_sim_state": 0.0027571493579495337, "sim_compute_performance-ego": 0.003874732602027155, "sim_compute_robot_state-ego": 0.005018441907821163, "sim_compute_robot_state-npc0": 0.004655299648161857, "sim_compute_robot_state-npc1": 0.0045262305967269404, "sim_compute_robot_state-npc2": 0.004479131390971522, "sim_compute_robot_state-npc3": 0.00449138302956858}, "ETHZ_autolab_technical_track-14-0": {"driven_any": 0.6739360049522841, "sim_physics": 0.11324420162275724, "survival_time": 2.549999999999999, "driven_lanedir": 0.27812483555624423, "sim_render-ego": 0.007036475574269015, "in-drivable-lane": 1.2499999999999984, "agent_compute-ego": 0.014132569817935718, "deviation-heading": 0.5504810423056019, "set_robot_commands": 0.004746165930056104, "deviation-center-line": 0.07768321004180687, "driven_lanedir_consec": 0.27812483555624423, "sim_compute_sim_state": 0.002710856643377566, "sim_compute_performance-ego": 0.003855032079360065, "sim_compute_robot_state-ego": 0.004975346957936007, "sim_compute_robot_state-npc0": 0.0045785015704585055, "sim_compute_robot_state-npc1": 0.004443865196377623, "sim_compute_robot_state-npc2": 0.00443566546720617, "sim_compute_robot_state-npc3": 0.004441135069903205}}
set_robot_commands_max0.009772434830665588
set_robot_commands_mean0.006327537064050175
set_robot_commands_median0.004993095397949219
set_robot_commands_min0.004746165930056104
sim_compute_performance-ego_max0.008360737846011207
sim_compute_performance-ego_mean0.005267231052421593
sim_compute_performance-ego_median0.00392165117793613
sim_compute_performance-ego_min0.003855032079360065
sim_compute_robot_state-ego_max0.009824786867414202
sim_compute_robot_state-ego_mean0.0065795381944448545
sim_compute_robot_state-ego_median0.005112722113325789
sim_compute_robot_state-ego_min0.004975346957936007
sim_compute_robot_state-npc0_max0.008496269583702087
sim_compute_robot_state-npc0_mean0.006093225537585724
sim_compute_robot_state-npc0_median0.004748268127441406
sim_compute_robot_state-npc0_min0.0045785015704585055
sim_compute_robot_state-npc1_max0.008564377343782814
sim_compute_robot_state-npc1_mean0.005946473260445726
sim_compute_robot_state-npc1_median0.0045849040702537255
sim_compute_robot_state-npc1_min0.004443865196377623
sim_compute_robot_state-npc2_max0.009007543325424194
sim_compute_robot_state-npc2_mean0.005930009214049637
sim_compute_robot_state-npc2_median0.0045545101165771484
sim_compute_robot_state-npc2_min0.00443566546720617
sim_compute_robot_state-npc3_max0.008994616568088531
sim_compute_robot_state-npc3_mean0.005898061849850023
sim_compute_robot_state-npc3_median0.004536615477667915
sim_compute_robot_state-npc3_min0.004441135069903205
sim_compute_sim_state_max0.0052694933755057195
sim_compute_sim_state_mean0.003617643825967501
sim_compute_sim_state_median0.0028214000520252044
sim_compute_sim_state_min0.002710856643377566
sim_physics_max0.20324229449033737
sim_physics_mean0.131743271014413
sim_physics_median0.12260667483011882
sim_physics_min0.08590284131822132
sim_render-ego_max0.013798645564488
sim_render-ego_mean0.009191600038044303
sim_render-ego_median0.007144441604614258
sim_render-ego_min0.007036475574269015
simulation-passed1
survival_time_max6.0499999999999865
survival_time_mean3.046666666666663
survival_time_min1.0500000000000005
No reset possible
251024384Soroush Saryazdi 🇨🇦bluejayaido3-LFVI-sim-testingstep1-simulationfailednoip-172-31-46-148-104900:06:17
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.7/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 177, in read_one
    nickname=self.nickname)
  File "/usr/local/lib/python3.7/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 258, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/usr/local/lib/python3.7/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 296, in read_until_over
    raise TimeoutError(msg) from None
TimeoutError: Timeout while reading output of node "agent".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "experiment_manager.py", line 299, in run_episode
    r: MsgReceived = agent.write_topic_and_expect('get_commands', expect='commands')
  File "/usr/local/lib/python3.7/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 96, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/usr/local/lib/python3.7/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 239, in read_one
    raise TimeoutError(msg) from e
TimeoutError: Timeout detected on /fifos/agent-out after 273 messages. Expected topic "commands".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.7/site-packages/duckietown_challenges/cie_concrete.py", line 675, in scoring_context
    yield cie
  File "experiment_manager.py", line 444, in <module>
    wrap(cie)
  File "experiment_manager.py", line 432, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 136, in main
    physics_dt=config.physics_dt)
  File "experiment_manager.py", line 303, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
250774371Jeick Hincapie Barrera 🇨🇴challenge-aido_LF-template-tensorflowaido3-LFVI-sim-validationstep1-simulationsuccessnoip-172-31-46-148-104900:06:14
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.23279911916867957
survival_time_median1.3000000000000005
deviation-center-line_median0.08326610983907688
in-drivable-lane_median0


other stats
agent_compute-ego_max0.03019812473883996
agent_compute-ego_mean0.02439936166255542
agent_compute-ego_median0.02593370044932646
agent_compute-ego_min0.01822272630838247
deviation-center-line_max0.12644900767925296
deviation-center-line_mean0.0954965413011307
deviation-center-line_min0.07501189860184128
deviation-heading_max1.0469903646829732
deviation-heading_mean0.5894314486258233
deviation-heading_median0.5281354193817083
deviation-heading_min0.3919075698382696
driven_any_max0.32882650138918784
driven_any_mean0.23594537181172415
driven_any_median0.2519831125896044
driven_any_min0.12704996350033768
driven_lanedir_consec_max0.258482402836014
driven_lanedir_consec_mean0.1938651124142014
driven_lanedir_consec_min0.0889833382507077
driven_lanedir_max0.258482402836014
driven_lanedir_mean0.1938651124142014
driven_lanedir_median0.23279911916867957
driven_lanedir_min0.0889833382507077
in-drivable-lane_max0.05000000000000005
in-drivable-lane_mean0.010000000000000007
in-drivable-lane_min0
per-episodes
details{"udem1-0-0": {"driven_any": 0.32882650138918784, "sim_physics": 0.10953842676602878, "survival_time": 1.3000000000000005, "driven_lanedir": 0.258482402836014, "sim_render-ego": 0.00727995542379526, "in-drivable-lane": 0.05000000000000005, "agent_compute-ego": 0.01822272630838247, "deviation-heading": 0.5400423748919866, "set_robot_commands": 0.005146127480726976, "deviation-center-line": 0.08326610983907688, "driven_lanedir_consec": 0.258482402836014, "sim_compute_sim_state": 0.002881316038278433, "sim_compute_performance-ego": 0.004112133612999549, "sim_compute_robot_state-ego": 0.005118571794950045, "sim_compute_robot_state-npc0": 0.004820676950307993, "sim_compute_robot_state-npc1": 0.004684246503389799, "sim_compute_robot_state-npc2": 0.004645164196307843, "sim_compute_robot_state-npc3": 0.004598590043874888}, "udem1-1-0": {"driven_any": 0.30611070619876396, "sim_physics": 0.1202400267124176, "survival_time": 2.000000000000001, "driven_lanedir": 0.24500864779094433, "sim_render-ego": 0.00826842188835144, "in-drivable-lane": 0, "agent_compute-ego": 0.020880258083343504, "deviation-heading": 1.0469903646829732, "set_robot_commands": 0.00618855357170105, "deviation-center-line": 0.11576414920194916, "driven_lanedir_consec": 0.24500864779094433, "sim_compute_sim_state": 0.003314638137817383, "sim_compute_performance-ego": 0.0045329868793487545, "sim_compute_robot_state-ego": 0.005836582183837891, "sim_compute_robot_state-npc0": 0.005762320756912231, "sim_compute_robot_state-npc1": 0.0054528117179870605, "sim_compute_robot_state-npc2": 0.00545470118522644, "sim_compute_robot_state-npc3": 0.005363351106643677}, "udem1-2-0": {"driven_any": 0.12704996350033768, "sim_physics": 0.2689353297738468, "survival_time": 0.8500000000000002, "driven_lanedir": 0.0889833382507077, "sim_render-ego": 0.011415635838228114, "in-drivable-lane": 0, "agent_compute-ego": 0.02593370044932646, "deviation-heading": 0.3919075698382696, "set_robot_commands": 0.008915340199190028, "deviation-center-line": 0.07699154118353316, "driven_lanedir_consec": 0.0889833382507077, "sim_compute_sim_state": 0.0049977022058823525, "sim_compute_performance-ego": 0.0060299424564137175, "sim_compute_robot_state-ego": 0.007994315203498392, "sim_compute_robot_state-npc0": 0.007535233217127183, "sim_compute_robot_state-npc1": 0.007600223316865808, "sim_compute_robot_state-npc2": 0.008144981720868279, "sim_compute_robot_state-npc3": 0.007857673308428596}, "udem1-3-0": {"driven_any": 0.16575657538072677, "sim_physics": 0.22502669004293588, "survival_time": 1.3000000000000005, "driven_lanedir": 0.14405205402466148, "sim_render-ego": 0.012921617581294132, "in-drivable-lane": 0, "agent_compute-ego": 0.03019812473883996, "deviation-heading": 0.5281354193817083, "set_robot_commands": 0.009939753092252292, "deviation-center-line": 0.12644900767925296, "driven_lanedir_consec": 0.14405205402466148, "sim_compute_sim_state": 0.004743841978219839, "sim_compute_performance-ego": 0.0071203341850867635, "sim_compute_robot_state-ego": 0.009168377289405236, "sim_compute_robot_state-npc0": 0.008616126500643216, "sim_compute_robot_state-npc1": 0.008648514747619629, "sim_compute_robot_state-npc2": 0.008827420381399302, "sim_compute_robot_state-npc3": 0.008121563838078426}, "udem1-4-0": {"driven_any": 0.2519831125896044, "sim_physics": 0.18245777487754825, "survival_time": 1.2000000000000004, "driven_lanedir": 0.23279911916867957, "sim_render-ego": 0.011919945478439333, "in-drivable-lane": 0, "agent_compute-ego": 0.026761998732884724, "deviation-heading": 0.44008151433417886, "set_robot_commands": 0.00953011711438497, "deviation-center-line": 0.07501189860184128, "driven_lanedir_consec": 0.23279911916867957, "sim_compute_sim_state": 0.004305879275004069, "sim_compute_performance-ego": 0.00694619615872701, "sim_compute_robot_state-ego": 0.008589009443918863, "sim_compute_robot_state-npc0": 0.00816418727238973, "sim_compute_robot_state-npc1": 0.008210211992263794, "sim_compute_robot_state-npc2": 0.007620195547739665, "sim_compute_robot_state-npc3": 0.0075476765632629395}}
set_robot_commands_max0.009939753092252292
set_robot_commands_mean0.007943978291651064
set_robot_commands_median0.008915340199190028
set_robot_commands_min0.005146127480726976
sim_compute_performance-ego_max0.0071203341850867635
sim_compute_performance-ego_mean0.005748318658515159
sim_compute_performance-ego_median0.0060299424564137175
sim_compute_performance-ego_min0.004112133612999549
sim_compute_robot_state-ego_max0.009168377289405236
sim_compute_robot_state-ego_mean0.0073413711831220845
sim_compute_robot_state-ego_median0.007994315203498392
sim_compute_robot_state-ego_min0.005118571794950045
sim_compute_robot_state-npc0_max0.008616126500643216
sim_compute_robot_state-npc0_mean0.00697970893947607
sim_compute_robot_state-npc0_median0.007535233217127183
sim_compute_robot_state-npc0_min0.004820676950307993
sim_compute_robot_state-npc1_max0.008648514747619629
sim_compute_robot_state-npc1_mean0.006919201655625218
sim_compute_robot_state-npc1_median0.007600223316865808
sim_compute_robot_state-npc1_min0.004684246503389799
sim_compute_robot_state-npc2_max0.008827420381399302
sim_compute_robot_state-npc2_mean0.006938492606308305
sim_compute_robot_state-npc2_median0.007620195547739665
sim_compute_robot_state-npc2_min0.004645164196307843
sim_compute_robot_state-npc3_max0.008121563838078426
sim_compute_robot_state-npc3_mean0.006697770972057706
sim_compute_robot_state-npc3_median0.0075476765632629395
sim_compute_robot_state-npc3_min0.004598590043874888
sim_compute_sim_state_max0.0049977022058823525
sim_compute_sim_state_mean0.004048675527040415
sim_compute_sim_state_median0.004305879275004069
sim_compute_sim_state_min0.002881316038278433
sim_physics_max0.2689353297738468
sim_physics_mean0.18123964963455547
sim_physics_median0.18245777487754825
sim_physics_min0.10953842676602878
sim_render-ego_max0.012921617581294132
sim_render-ego_mean0.010361115242021657
sim_render-ego_median0.011415635838228114
sim_render-ego_min0.00727995542379526
simulation-passed1
survival_time_max2.000000000000001
survival_time_mean1.3300000000000003
survival_time_min0.8500000000000002
No reset possible
250214358Soroush Saryazdi 🇨🇦bluejayaido3-LF-sim-validationstep1-simulationerrornoip-172-31-46-148-104900:02:48
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
250094354Manfred Diazchallenge-aido_LF-template-tensorflowaido3-LFVI-sim-testingstep1-simulationsuccessnoip-172-31-46-148-104900:13:22
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.24787865390402164
survival_time_median1.3000000000000005
deviation-center-line_median0.08406695642094758
in-drivable-lane_median0


other stats
agent_compute-ego_max0.025211357602886127
agent_compute-ego_mean0.02106462807255053
agent_compute-ego_median0.020957063226138845
agent_compute-ego_min0.017628009502704326
deviation-center-line_max0.28151647351415443
deviation-center-line_mean0.1120438431589583
deviation-center-line_min0.04613030954798494
deviation-heading_max1.570425526127554
deviation-heading_mean0.6882072280941055
deviation-heading_median0.5403856056648768
deviation-heading_min0.3240106540052327
driven_any_max0.8236546036636551
driven_any_mean0.3146445334296759
driven_any_median0.28437105105585897
driven_any_min0.09781315214408784
driven_lanedir_consec_max0.6959984454470771
driven_lanedir_consec_mean0.24807818190005324
driven_lanedir_consec_min0.05667933720888674
driven_lanedir_max0.6959984454470771
driven_lanedir_mean0.24807818190005324
driven_lanedir_median0.24787865390402164
driven_lanedir_min0.05667933720888674
in-drivable-lane_max0.09999999999999964
in-drivable-lane_mean0.023333333333333303
in-drivable-lane_min0
per-episodes
details{"udem1-0-0": {"driven_any": 0.2164496819997817, "sim_physics": 0.14173041071210588, "survival_time": 1.0500000000000005, "driven_lanedir": 0.13945007709067325, "sim_render-ego": 0.009682621274675642, "in-drivable-lane": 0, "agent_compute-ego": 0.024246874309721448, "deviation-heading": 0.6176166035675221, "set_robot_commands": 0.006728195008777436, "deviation-center-line": 0.0711155479148531, "driven_lanedir_consec": 0.13945007709067325, "sim_compute_sim_state": 0.0038199538276309057, "sim_compute_performance-ego": 0.0056106022426060265, "sim_compute_robot_state-ego": 0.007176683062598819, "sim_compute_robot_state-npc0": 0.00681524049668085, "sim_compute_robot_state-npc1": 0.006028981435866583, "sim_compute_robot_state-npc2": 0.00593641826084682, "sim_compute_robot_state-npc3": 0.005873010272071475}, "udem1-1-0": {"driven_any": 0.3162538371726985, "sim_physics": 0.14220888383926883, "survival_time": 1.5500000000000007, "driven_lanedir": 0.24787865390402164, "sim_render-ego": 0.0096698114948888, "in-drivable-lane": 0.05000000000000005, "agent_compute-ego": 0.02119143547550325, "deviation-heading": 0.7394086814823118, "set_robot_commands": 0.00680757338000882, "deviation-center-line": 0.09587823431367654, "driven_lanedir_consec": 0.24787865390402164, "sim_compute_sim_state": 0.003587607414491715, "sim_compute_performance-ego": 0.005313296471872638, "sim_compute_robot_state-ego": 0.00684310543921686, "sim_compute_robot_state-npc0": 0.006501482379051947, "sim_compute_robot_state-npc1": 0.0059383992225893086, "sim_compute_robot_state-npc2": 0.0060163005705802675, "sim_compute_robot_state-npc3": 0.005907558625744235}, "udem1-2-0": {"driven_any": 0.15294714803757067, "sim_physics": 0.17383616110857794, "survival_time": 0.8500000000000002, "driven_lanedir": 0.12075959472851672, "sim_render-ego": 0.008729009067311007, "in-drivable-lane": 0, "agent_compute-ego": 0.020957063226138845, "deviation-heading": 0.3240106540052327, "set_robot_commands": 0.005749856724458582, "deviation-center-line": 0.0740616280179011, "driven_lanedir_consec": 0.12075959472851672, "sim_compute_sim_state": 0.0031546424416934744, "sim_compute_performance-ego": 0.004603848737828872, "sim_compute_robot_state-ego": 0.006102085113525391, "sim_compute_robot_state-npc0": 0.00523983730989344, "sim_compute_robot_state-npc1": 0.005158831091488109, "sim_compute_robot_state-npc2": 0.005100600859698127, "sim_compute_robot_state-npc3": 0.0051692373612347775}, "udem1-3-0": {"driven_any": 0.1808990157670769, "sim_physics": 0.13754770755767823, "survival_time": 1.0000000000000002, "driven_lanedir": 0.1478158035133874, "sim_render-ego": 0.00790252685546875, "in-drivable-lane": 0, "agent_compute-ego": 0.018341457843780516, "deviation-heading": 0.38834834511636984, "set_robot_commands": 0.005790221691131592, "deviation-center-line": 0.08138463233823515, "driven_lanedir_consec": 0.1478158035133874, "sim_compute_sim_state": 0.0030598044395446777, "sim_compute_performance-ego": 0.004155373573303223, "sim_compute_robot_state-ego": 0.00551689863204956, "sim_compute_robot_state-npc0": 0.005250477790832519, "sim_compute_robot_state-npc1": 0.004954791069030762, "sim_compute_robot_state-npc2": 0.0049041748046875, "sim_compute_robot_state-npc3": 0.0048841357231140135}, "udem1-4-0": {"driven_any": 0.25925790469978144, "sim_physics": 0.11305732910449688, "survival_time": 1.3000000000000005, "driven_lanedir": 0.24101976449359963, "sim_render-ego": 0.007777599187997671, "in-drivable-lane": 0, "agent_compute-ego": 0.017628009502704326, "deviation-heading": 0.4567981553787506, "set_robot_commands": 0.005697901432330792, "deviation-center-line": 0.08406695642094758, "driven_lanedir_consec": 0.24101976449359963, "sim_compute_sim_state": 0.003105631241431603, "sim_compute_performance-ego": 0.004220852485069862, "sim_compute_robot_state-ego": 0.005507084039541392, "sim_compute_robot_state-npc0": 0.005214260174677922, "sim_compute_robot_state-npc1": 0.00499872060922476, "sim_compute_robot_state-npc2": 0.0049852774693415714, "sim_compute_robot_state-npc3": 0.004962114187387319}, "udem1-5-0": {"driven_any": 0.31773042902809695, "sim_physics": 0.13638251478021796, "survival_time": 2.2, "driven_lanedir": 0.2482494575962808, "sim_render-ego": 0.009695811705155806, "in-drivable-lane": 0, "agent_compute-ego": 0.021590926430442116, "deviation-heading": 0.8523908055078188, "set_robot_commands": 0.007111327214674516, "deviation-center-line": 0.11430062803813022, "driven_lanedir_consec": 0.2482494575962808, "sim_compute_sim_state": 0.003772659735246138, "sim_compute_performance-ego": 0.005772552706978538, "sim_compute_robot_state-ego": 0.007074366916309704, "sim_compute_robot_state-npc0": 0.0065940510142933235, "sim_compute_robot_state-npc1": 0.006332722577181729, "sim_compute_robot_state-npc2": 0.006217138333754106, "sim_compute_robot_state-npc3": 0.006286686116998846}, "udem1-6-0": {"driven_any": 0.4948379167126347, "sim_physics": 0.21128028514338473, "survival_time": 2.549999999999999, "driven_lanedir": 0.4467062038974268, "sim_render-ego": 0.01099410244062835, "in-drivable-lane": 0.04999999999999982, "agent_compute-ego": 0.025211357602886127, "deviation-heading": 0.7927572834059632, "set_robot_commands": 0.008307195177265242, "deviation-center-line": 0.23250448823121844, "driven_lanedir_consec": 0.4467062038974268, "sim_compute_sim_state": 0.004150082083309398, "sim_compute_performance-ego": 0.006160240547329772, "sim_compute_robot_state-ego": 0.008028091168871113, "sim_compute_robot_state-npc0": 0.007202756171133004, "sim_compute_robot_state-npc1": 0.007075150807698567, "sim_compute_robot_state-npc2": 0.007023446700152229, "sim_compute_robot_state-npc3": 0.007096295263253006}, "udem1-7-0": {"driven_any": 0.09781315214408784, "sim_physics": 0.13927534047295065, "survival_time": 0.8500000000000002, "driven_lanedir": 0.05667933720888674, "sim_render-ego": 0.009536210228415096, "in-drivable-lane": 0, "agent_compute-ego": 0.02037499932681813, "deviation-heading": 0.4093351054605934, "set_robot_commands": 0.007582916932947496, "deviation-center-line": 0.06123480195658379, "driven_lanedir_consec": 0.05667933720888674, "sim_compute_sim_state": 0.0033909012289608225, "sim_compute_performance-ego": 0.005371023626888499, "sim_compute_robot_state-ego": 0.00680697665495031, "sim_compute_robot_state-npc0": 0.006342130548813764, "sim_compute_robot_state-npc1": 0.006077920689302332, "sim_compute_robot_state-npc2": 0.006011878742891199, "sim_compute_robot_state-npc3": 0.0061877615311566525}, "udem1-8-0": {"driven_any": 0.22677767757368172, "sim_physics": 0.1486774730682373, "survival_time": 1.2500000000000004, "driven_lanedir": 0.1555271094360431, "sim_render-ego": 0.010073251724243164, "in-drivable-lane": 0.05000000000000005, "agent_compute-ego": 0.022002315521240233, "deviation-heading": 0.5403856056648768, "set_robot_commands": 0.007204694747924805, "deviation-center-line": 0.04988219908638025, "driven_lanedir_consec": 0.1555271094360431, "sim_compute_sim_state": 0.003787240982055664, "sim_compute_performance-ego": 0.005586662292480469, "sim_compute_robot_state-ego": 0.006951866149902344, "sim_compute_robot_state-npc0": 0.006701021194458008, "sim_compute_robot_state-npc1": 0.006343002319335937, "sim_compute_robot_state-npc2": 0.006423254013061524, "sim_compute_robot_state-npc3": 0.0062516117095947265}, "udem1-9-0": {"driven_any": 0.3617588076092274, "sim_physics": 0.15628461043039957, "survival_time": 2.3999999999999995, "driven_lanedir": 0.28097274884859824, "sim_render-ego": 0.00893560548623403, "in-drivable-lane": 0, "agent_compute-ego": 0.020520736773808796, "deviation-heading": 1.163334077004252, "set_robot_commands": 0.0070768992106119795, "deviation-center-line": 0.12672580792060167, "driven_lanedir_consec": 0.28097274884859824, "sim_compute_sim_state": 0.0034587730964024863, "sim_compute_performance-ego": 0.00490984320640564, "sim_compute_robot_state-ego": 0.006420205036799113, "sim_compute_robot_state-npc0": 0.006445104877154033, "sim_compute_robot_state-npc1": 0.0058783044417699175, "sim_compute_robot_state-npc2": 0.005928392211596171, "sim_compute_robot_state-npc3": 0.005790059765179952}, "udem1-10-0": {"driven_any": 0.33040428753217427, "sim_physics": 0.12293528688365016, "survival_time": 1.4500000000000006, "driven_lanedir": 0.279505065742355, "sim_render-ego": 0.008835422581639784, "in-drivable-lane": 0, "agent_compute-ego": 0.019979920880547886, "deviation-heading": 0.5328739579892513, "set_robot_commands": 0.00669375781355233, "deviation-center-line": 0.04613030954798494, "driven_lanedir_consec": 0.279505065742355, "sim_compute_sim_state": 0.00342773569041285, "sim_compute_performance-ego": 0.0049329626149144665, "sim_compute_robot_state-ego": 0.006250743208260372, "sim_compute_robot_state-npc0": 0.005831825322118299, "sim_compute_robot_state-npc1": 0.005638739158367288, "sim_compute_robot_state-npc2": 0.005734509435193292, "sim_compute_robot_state-npc3": 0.005850167110048491}, "udem1-11-0": {"driven_any": 0.28437105105585897, "sim_physics": 0.13183702872349665, "survival_time": 1.3000000000000005, "driven_lanedir": 0.2630230008841483, "sim_render-ego": 0.009820800561171312, "in-drivable-lane": 0.05000000000000005, "agent_compute-ego": 0.021082144517164964, "deviation-heading": 0.32499162161948286, "set_robot_commands": 0.0071803789872389575, "deviation-center-line": 0.11850332822021542, "driven_lanedir_consec": 0.2630230008841483, "sim_compute_sim_state": 0.003761034745436448, "sim_compute_performance-ego": 0.005633262487558218, "sim_compute_robot_state-ego": 0.007215426518366887, "sim_compute_robot_state-npc0": 0.006361704606276292, "sim_compute_robot_state-npc1": 0.0064389705657958984, "sim_compute_robot_state-npc2": 0.006778047635005071, "sim_compute_robot_state-npc3": 0.006312012672424316}, "udem1-12-0": {"driven_any": 0.4968693395659833, "sim_physics": 0.1336827139923538, "survival_time": 3.4499999999999957, "driven_lanedir": 0.2809239719586052, "sim_render-ego": 0.008094953454059103, "in-drivable-lane": 0.09999999999999964, "agent_compute-ego": 0.020745847536169964, "deviation-heading": 1.570425526127554, "set_robot_commands": 0.005984009176060773, "deviation-center-line": 0.1669486423366726, "driven_lanedir_consec": 0.2809239719586052, "sim_compute_sim_state": 0.003168365229731021, "sim_compute_performance-ego": 0.004434202028357465, "sim_compute_robot_state-ego": 0.005793167197186014, "sim_compute_robot_state-npc0": 0.005479905916296918, "sim_compute_robot_state-npc1": 0.00528390165688335, "sim_compute_robot_state-npc2": 0.0052427036174829455, "sim_compute_robot_state-npc3": 0.005221733148547186}, "udem1-13-0": {"driven_any": 0.15964314888282974, "sim_physics": 0.12680002450942993, "survival_time": 1.0000000000000002, "driven_lanedir": 0.116663493751179, "sim_render-ego": 0.008927583694458008, "in-drivable-lane": 0.04999999999999993, "agent_compute-ego": 0.019662106037139897, "deviation-heading": 0.39844324835607936, "set_robot_commands": 0.006855714321136475, "deviation-center-line": 0.07640396952681901, "driven_lanedir_consec": 0.116663493751179, "sim_compute_sim_state": 0.0035794854164123537, "sim_compute_performance-ego": 0.004991376399993896, "sim_compute_robot_state-ego": 0.006317317485809326, "sim_compute_robot_state-npc0": 0.006072700023651123, "sim_compute_robot_state-npc1": 0.005859518051147461, "sim_compute_robot_state-npc2": 0.005734539031982422, "sim_compute_robot_state-npc3": 0.005709326267242432}, "udem1-14-0": {"driven_any": 0.8236546036636551, "sim_physics": 0.14745006390980311, "survival_time": 2.799999999999998, "driven_lanedir": 0.6959984454470771, "sim_render-ego": 0.010098797934395928, "in-drivable-lane": 0, "agent_compute-ego": 0.022434226104191372, "deviation-heading": 1.2119887507255251, "set_robot_commands": 0.006942357335771833, "deviation-center-line": 0.28151647351415443, "driven_lanedir_consec": 0.6959984454470771, "sim_compute_sim_state": 0.00376921466418675, "sim_compute_performance-ego": 0.00573053104536874, "sim_compute_robot_state-ego": 0.007056738649095807, "sim_compute_robot_state-npc0": 0.0066657960414886475, "sim_compute_robot_state-npc1": 0.006320493561880929, "sim_compute_robot_state-npc2": 0.00625687837600708, "sim_compute_robot_state-npc3": 0.006366108145032611}}
set_robot_commands_max0.008307195177265242
set_robot_commands_mean0.006780866610259443
set_robot_commands_median0.006855714321136475
set_robot_commands_min0.005697901432330792
sim_compute_performance-ego_max0.006160240547329772
sim_compute_performance-ego_mean0.005161775364463754
sim_compute_performance-ego_median0.005313296471872638
sim_compute_performance-ego_min0.004155373573303223
sim_compute_robot_state-ego_max0.008028091168871113
sim_compute_robot_state-ego_mean0.006604050351498868
sim_compute_robot_state-ego_median0.00680697665495031
sim_compute_robot_state-ego_min0.005507084039541392
sim_compute_robot_state-npc0_max0.007202756171133004
sim_compute_robot_state-npc0_mean0.0061812195911213385
sim_compute_robot_state-npc0_median0.006361704606276292
sim_compute_robot_state-npc0_min0.005214260174677922
sim_compute_robot_state-npc1_max0.007075150807698567
sim_compute_robot_state-npc1_mean0.0058885631505041945
sim_compute_robot_state-npc1_median0.0059383992225893086
sim_compute_robot_state-npc1_min0.004954791069030762
sim_compute_robot_state-npc2_max0.007023446700152229
sim_compute_robot_state-npc2_mean0.0058862373374853555
sim_compute_robot_state-npc2_median0.00593641826084682
sim_compute_robot_state-npc2_min0.0049041748046875
sim_compute_robot_state-npc3_max0.007096295263253006
sim_compute_robot_state-npc3_mean0.0058578545266020025
sim_compute_robot_state-npc3_median0.005873010272071475
sim_compute_robot_state-npc3_min0.0048841357231140135
sim_compute_sim_state_max0.004150082083309398
sim_compute_sim_state_mean0.0035328754824630873
sim_compute_sim_state_median0.0035794854164123537
sim_compute_sim_state_min0.0030598044395446777
sim_physics_max0.21128028514338473
sim_physics_mean0.1441990556157368
sim_physics_median0.13927534047295065
sim_physics_min0.11305732910449688
sim_render-ego_max0.01099410244062835
sim_render-ego_mean0.00925160717938283
sim_render-ego_median0.009536210228415096
sim_render-ego_min0.007777599187997671
simulation-passed1
survival_time_max3.4499999999999957
survival_time_mean1.6666666666666663
survival_time_min0.8500000000000002
No reset possible
249984135Andrea Censi 🇨🇭rotationaido3-LF-sim-testingstep1-simulationsuccessnoip-172-31-46-148-104900:33:56
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median-0.0014713911579260497
survival_time_median14.950000000000076
deviation-center-line_median0.3550429130563084
in-drivable-lane_median7.600000000000043


other stats
agent_compute-ego_max0.02402843713760376
agent_compute-ego_mean0.02086972861819797
agent_compute-ego_median0.021431962649027508
agent_compute-ego_min0.015649839242299398
deviation-center-line_max0.6007136359417561
deviation-center-line_mean0.33945586938036626
deviation-center-line_min0.017558302483544185
deviation-heading_max5.87668078883977
deviation-heading_mean5.668498743454
deviation-heading_median5.709677935349316
deviation-heading_min5.445457843647877
driven_any_max0.026478672834058543
driven_any_mean0.023389442379013872
driven_any_median0.023285267728314855
driven_any_min0.01977949840933559
driven_lanedir_consec_max0.0021599934447711355
driven_lanedir_consec_mean-0.0011081890688221148
driven_lanedir_consec_min-0.004544743757038283
driven_lanedir_max0.0021599934447711355
driven_lanedir_mean-0.0011081890688221148
driven_lanedir_median-0.0014713911579260497
driven_lanedir_min-0.004544743757038283
in-drivable-lane_max7.700000000000042
in-drivable-lane_mean7.596666666666709
in-drivable-lane_min7.500000000000043
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.026478672834058543, "sim_physics": 0.0934485960006714, "survival_time": 14.950000000000076, "driven_lanedir": 0.0021599934447711355, "sim_render-ego": 0.011349767049153648, "in-drivable-lane": 7.600000000000043, "agent_compute-ego": 0.02174961566925049, "deviation-heading": 5.657649106857694, "set_robot_commands": 0.008705344200134277, "deviation-center-line": 0.5610133203215761, "driven_lanedir_consec": 0.0021599934447711355, "sim_compute_sim_state": 0.0047456137339274085, "sim_compute_performance-ego": 0.007105363210042318, "sim_compute_robot_state-ego": 0.00859549363454183}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.025930195541195415, "sim_physics": 0.10899044990539553, "survival_time": 14.950000000000076, "driven_lanedir": -0.003361806018059577, "sim_render-ego": 0.012793304920196534, "in-drivable-lane": 7.600000000000044, "agent_compute-ego": 0.023559234937032065, "deviation-heading": 5.445457843647877, "set_robot_commands": 0.011423887411753335, "deviation-center-line": 0.13860669343031343, "driven_lanedir_consec": -0.003361806018059577, "sim_compute_sim_state": 0.0065447425842285155, "sim_compute_performance-ego": 0.007541698614756266, "sim_compute_robot_state-ego": 0.009177485307057698}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.023804404672436115, "sim_physics": 0.09946645895640056, "survival_time": 14.950000000000076, "driven_lanedir": 0.002118105955655203, "sim_render-ego": 0.01172428607940674, "in-drivable-lane": 7.550000000000042, "agent_compute-ego": 0.021157659689585367, "deviation-heading": 5.87668078883977, "set_robot_commands": 0.008776252269744872, "deviation-center-line": 0.47845174752595304, "driven_lanedir_consec": 0.002118105955655203, "sim_compute_sim_state": 0.004896779855092366, "sim_compute_performance-ego": 0.006917165915171305, "sim_compute_robot_state-ego": 0.00846639315287272}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.022165452661378815, "sim_physics": 0.10918662707010904, "survival_time": 14.950000000000076, "driven_lanedir": -0.002690854798440334, "sim_render-ego": 0.012530859311421711, "in-drivable-lane": 7.700000000000042, "agent_compute-ego": 0.023813656171162923, "deviation-heading": 5.721005148732665, "set_robot_commands": 0.010334980487823489, "deviation-center-line": 0.44901648578509457, "driven_lanedir_consec": -0.002690854798440334, "sim_compute_sim_state": 0.0053110877672831215, "sim_compute_performance-ego": 0.007448509534200032, "sim_compute_robot_state-ego": 0.009536418914794922}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.025942472252179608, "sim_physics": 0.08717778285344442, "survival_time": 14.950000000000076, "driven_lanedir": -0.0005547867508171045, "sim_render-ego": 0.01032163937886556, "in-drivable-lane": 7.650000000000044, "agent_compute-ego": 0.020671615600585936, "deviation-heading": 5.453097843541614, "set_robot_commands": 0.008374176025390624, "deviation-center-line": 0.28665447981951625, "driven_lanedir_consec": -0.0005547867508171045, "sim_compute_sim_state": 0.004537370204925537, "sim_compute_performance-ego": 0.0060090438524882, "sim_compute_robot_state-ego": 0.007798934777577718}, "ETHZ_autolab_technical_track-5-0": {"driven_any": 0.026249880775222677, "sim_physics": 0.1154158926010132, "survival_time": 14.950000000000076, "driven_lanedir": -0.0017675599932500674, "sim_render-ego": 0.012749481995900471, "in-drivable-lane": 7.650000000000041, "agent_compute-ego": 0.02359823147455851, "deviation-heading": 5.813994332249984, "set_robot_commands": 0.009888599713643392, "deviation-center-line": 0.6007136359417561, "driven_lanedir_consec": -0.0017675599932500674, "sim_compute_sim_state": 0.005321191151936849, "sim_compute_performance-ego": 0.0075613991419474285, "sim_compute_robot_state-ego": 0.009519137541453044}, "ETHZ_autolab_technical_track-6-0": {"driven_any": 0.023285267728314855, "sim_physics": 0.10064404646555584, "survival_time": 14.950000000000076, "driven_lanedir": -0.00391925832851836, "sim_render-ego": 0.011713394323984782, "in-drivable-lane": 7.600000000000044, "agent_compute-ego": 0.021756125291188557, "deviation-heading": 5.466476436400959, "set_robot_commands": 0.009009886582692464, "deviation-center-line": 0.3550429130563084, "driven_lanedir_consec": -0.00391925832851836, "sim_compute_sim_state": 0.004670461813608805, "sim_compute_performance-ego": 0.007108654975891113, "sim_compute_robot_state-ego": 0.008667229811350504}, "ETHZ_autolab_technical_track-7-0": {"driven_any": 0.023561644755171383, "sim_physics": 0.09597643216451009, "survival_time": 14.950000000000076, "driven_lanedir": 0.002049277100081514, "sim_render-ego": 0.011405719916025797, "in-drivable-lane": 7.550000000000042, "agent_compute-ego": 0.02127616246541341, "deviation-heading": 5.8549580693835415, "set_robot_commands": 0.00874337593714396, "deviation-center-line": 0.41169203827872664, "driven_lanedir_consec": 0.002049277100081514, "sim_compute_sim_state": 0.004661821524302165, "sim_compute_performance-ego": 0.006885912418365479, "sim_compute_robot_state-ego": 0.00859840472539266}, "ETHZ_autolab_technical_track-8-0": {"driven_any": 0.024191972983620167, "sim_physics": 0.0970692483584086, "survival_time": 14.950000000000076, "driven_lanedir": 0.0002979654230168549, "sim_render-ego": 0.011449035803476969, "in-drivable-lane": 7.600000000000043, "agent_compute-ego": 0.021431962649027508, "deviation-heading": 5.709677935349316, "set_robot_commands": 0.008811908562978109, "deviation-center-line": 0.017558302483544185, "driven_lanedir_consec": 0.0002979654230168549, "sim_compute_sim_state": 0.00473883310953776, "sim_compute_performance-ego": 0.006965916156768798, "sim_compute_robot_state-ego": 0.008492881457010906}, "ETHZ_autolab_technical_track-9-0": {"driven_any": 0.02125816620692523, "sim_physics": 0.1056002140045166, "survival_time": 14.950000000000076, "driven_lanedir": -4.181733071773053e-05, "sim_render-ego": 0.01219291845957438, "in-drivable-lane": 7.500000000000043, "agent_compute-ego": 0.02402843713760376, "deviation-heading": 5.783324089492346, "set_robot_commands": 0.009932926495869954, "deviation-center-line": 0.2514968415228168, "driven_lanedir_consec": -4.181733071773053e-05, "sim_compute_sim_state": 0.005370894273122152, "sim_compute_performance-ego": 0.007405803203582763, "sim_compute_robot_state-ego": 0.009305289586385093}, "ETHZ_autolab_technical_track-10-0": {"driven_any": 0.02143429212019909, "sim_physics": 0.10935483694076538, "survival_time": 14.950000000000076, "driven_lanedir": 0.000713963463023104, "sim_render-ego": 0.011770021120707196, "in-drivable-lane": 7.600000000000045, "agent_compute-ego": 0.02333330233891805, "deviation-heading": 5.526728061201507, "set_robot_commands": 0.009704981644948324, "deviation-center-line": 0.46282395191752784, "driven_lanedir_consec": 0.000713963463023104, "sim_compute_sim_state": 0.0051195454597473145, "sim_compute_performance-ego": 0.00702340841293335, "sim_compute_robot_state-ego": 0.008942606449127198}, "ETHZ_autolab_technical_track-11-0": {"driven_any": 0.01977949840933559, "sim_physics": 0.06933528741200765, "survival_time": 14.950000000000076, "driven_lanedir": -0.0014713911579260497, "sim_render-ego": 0.008405664761861165, "in-drivable-lane": 7.550000000000041, "agent_compute-ego": 0.01657941420873006, "deviation-heading": 5.8066732640248135, "set_robot_commands": 0.0064725740750630695, "deviation-center-line": 0.16800033110632376, "driven_lanedir_consec": -0.0014713911579260497, "sim_compute_sim_state": 0.0035557103157043456, "sim_compute_performance-ego": 0.004917572339375814, "sim_compute_robot_state-ego": 0.0061673529942830405}, "ETHZ_autolab_technical_track-12-0": {"driven_any": 0.02098156490232138, "sim_physics": 0.06387256463368733, "survival_time": 14.950000000000076, "driven_lanedir": -0.001808663823426926, "sim_render-ego": 0.008269263903299967, "in-drivable-lane": 7.650000000000043, "agent_compute-ego": 0.017458497683207196, "deviation-heading": 5.515473779841324, "set_robot_commands": 0.006267249584197998, "deviation-center-line": 0.3169911817232478, "driven_lanedir_consec": -0.001808663823426926, "sim_compute_sim_state": 0.0034752575556437175, "sim_compute_performance-ego": 0.004857493241628011, "sim_compute_robot_state-ego": 0.006034406820933024}, "ETHZ_autolab_technical_track-13-0": {"driven_any": 0.022551048035817287, "sim_physics": 0.06874412139256796, "survival_time": 14.950000000000076, "driven_lanedir": -0.004544743757038283, "sim_render-ego": 0.008254639307657878, "in-drivable-lane": 7.600000000000042, "agent_compute-ego": 0.015649839242299398, "deviation-heading": 5.790764092245773, "set_robot_commands": 0.006532427469889323, "deviation-center-line": 0.03881032426772201, "driven_lanedir_consec": -0.004544743757038283, "sim_compute_sim_state": 0.0034636767705281575, "sim_compute_performance-ego": 0.00496074120203654, "sim_compute_robot_state-ego": 0.006030463377634685}, "ETHZ_autolab_technical_track-14-0": {"driven_any": 0.02322710180703199, "sim_physics": 0.06709758520126342, "survival_time": 14.950000000000076, "driven_lanedir": -0.0038012594606851025, "sim_render-ego": 0.00909953991572062, "in-drivable-lane": 7.550000000000044, "agent_compute-ego": 0.016982174714406332, "deviation-heading": 5.60552036000081, "set_robot_commands": 0.006749735673268636, "deviation-center-line": 0.5549657935250677, "driven_lanedir_consec": -0.0038012594606851025, "sim_compute_sim_state": 0.003730469544728597, "sim_compute_performance-ego": 0.005323333740234375, "sim_compute_robot_state-ego": 0.006509703795115153}}
set_robot_commands_max0.011423887411753335
set_robot_commands_mean0.008648553742302788
set_robot_commands_median0.008776252269744872
set_robot_commands_min0.006267249584197998
sim_compute_performance-ego_max0.0075613991419474285
sim_compute_performance-ego_mean0.006535467730628119
sim_compute_performance-ego_median0.006965916156768798
sim_compute_performance-ego_min0.004857493241628011
sim_compute_robot_state-ego_max0.009536418914794922
sim_compute_robot_state-ego_mean0.008122813489702013
sim_compute_robot_state-ego_median0.00859549363454183
sim_compute_robot_state-ego_min0.006030463377634685
sim_compute_sim_state_max0.0065447425842285155
sim_compute_sim_state_mean0.00467623037762112
sim_compute_sim_state_median0.00473883310953776
sim_compute_sim_state_min0.0034636767705281575
sim_physics_max0.1154158926010132
sim_physics_mean0.09275867626402112
sim_physics_median0.0970692483584086
sim_physics_min0.06387256463368733
sim_render-ego_max0.012793304920196534
sim_render-ego_mean0.01093530241648356
sim_render-ego_median0.011449035803476969
sim_render-ego_min0.008254639307657878
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean14.950000000000076
survival_time_min14.950000000000076
No reset possible
249874155Andrea Censi 🇨🇭minimal_agent_python2 (Python 2)aido3-LFV-sim-testingstep1-simulationsuccessnoip-172-31-46-148-104900:20:11
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.4295977528045558
survival_time_median3.7499999999999942
deviation-center-line_median0.16525966154163726
in-drivable-lane_median0.9499999999999966


other stats
agent_compute-ego_max0.01143241697742093
agent_compute-ego_mean0.009763810345683192
agent_compute-ego_median0.009770285593320244
agent_compute-ego_min0.008050536456173414
deviation-center-line_max0.44830395948846297
deviation-center-line_mean0.17891237550140934
deviation-center-line_min0.10012774388669717
deviation-heading_max1.272726254754917
deviation-heading_mean0.5883512828498624
deviation-heading_median0.5156622477370731
deviation-heading_min0.2495279988048577
driven_any_max2.0298273185719493
driven_any_mean1.0098349503422042
driven_any_median1.0248273191286312
driven_any_min0.3648701917101209
driven_lanedir_consec_max1.211071354427033
driven_lanedir_consec_mean0.6125599618319294
driven_lanedir_consec_min0.32721267753615213
driven_lanedir_max1.211071354427033
driven_lanedir_mean0.6125599618319294
driven_lanedir_median0.4295977528045558
driven_lanedir_min0.32721267753615213
in-drivable-lane_max4.249999999999985
in-drivable-lane_mean1.2033333333333296
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.9948273195001778, "sim_physics": 0.17428085901965834, "survival_time": 3.649999999999995, "driven_lanedir": 0.6707441932890994, "sim_render-ego": 0.012027469399857197, "in-drivable-lane": 0.9499999999999966, "agent_compute-ego": 0.009770285593320244, "deviation-heading": 0.5590533399929921, "set_robot_commands": 0.008876274709832179, "deviation-center-line": 0.14435558631904788, "driven_lanedir_consec": 0.6707441932890994, "sim_compute_sim_state": 0.0048916013273474284, "sim_compute_performance-ego": 0.007029147997294387, "sim_compute_robot_state-ego": 0.008577529698202056, "sim_compute_robot_state-npc0": 0.00818026555727606, "sim_compute_robot_state-npc1": 0.008267402648925781, "sim_compute_robot_state-npc2": 0.008245402819489779, "sim_compute_robot_state-npc3": 0.008679788406581094}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.4548365617710475, "sim_physics": 0.1824543282792375, "survival_time": 1.850000000000001, "driven_lanedir": 0.4295977528045558, "sim_render-ego": 0.01150542336541253, "in-drivable-lane": 0, "agent_compute-ego": 0.009079649641707136, "deviation-heading": 0.6191860504142408, "set_robot_commands": 0.007973213453550596, "deviation-center-line": 0.13177328856984177, "driven_lanedir_consec": 0.4295977528045558, "sim_compute_sim_state": 0.004431260598672403, "sim_compute_performance-ego": 0.00613305375382707, "sim_compute_robot_state-ego": 0.007865937980445655, "sim_compute_robot_state-npc0": 0.007690159050193992, "sim_compute_robot_state-npc1": 0.007258737409437024, "sim_compute_robot_state-npc2": 0.007288642831750818, "sim_compute_robot_state-npc3": 0.0070827844980600714}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.57982731857201, "sim_physics": 0.2077805293457849, "survival_time": 5.599999999999988, "driven_lanedir": 1.2014595555356244, "sim_render-ego": 0.013269813997404916, "in-drivable-lane": 1.1999999999999955, "agent_compute-ego": 0.010540783405303957, "deviation-heading": 0.5156622477370731, "set_robot_commands": 0.01044051774910518, "deviation-center-line": 0.2085822874042474, "driven_lanedir_consec": 1.2014595555356244, "sim_compute_sim_state": 0.0049663760832377845, "sim_compute_performance-ego": 0.007408231496810913, "sim_compute_robot_state-ego": 0.009573248880250114, "sim_compute_robot_state-npc0": 0.008657082915306091, "sim_compute_robot_state-npc1": 0.008438602089881897, "sim_compute_robot_state-npc2": 0.00882507860660553, "sim_compute_robot_state-npc3": 0.00841678466115679}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.5798273185720382, "sim_physics": 0.1776766585452216, "survival_time": 5.599999999999988, "driven_lanedir": 1.2017887891468408, "sim_render-ego": 0.012865339006696428, "in-drivable-lane": 1.1999999999999955, "agent_compute-ego": 0.009823294622557504, "deviation-heading": 0.5031987685845647, "set_robot_commands": 0.008993061525481088, "deviation-center-line": 0.2031955759348632, "driven_lanedir_consec": 1.2017887891468408, "sim_compute_sim_state": 0.004796492201941354, "sim_compute_performance-ego": 0.007759296468326024, "sim_compute_robot_state-ego": 0.00932486355304718, "sim_compute_robot_state-npc0": 0.008584842085838318, "sim_compute_robot_state-npc1": 0.008309130157743181, "sim_compute_robot_state-npc2": 0.007997487272535051, "sim_compute_robot_state-npc3": 0.008125343493052892}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.3798605253583843, "sim_physics": 0.16936207562685013, "survival_time": 1.6000000000000008, "driven_lanedir": 0.366714522485295, "sim_render-ego": 0.011590100824832916, "in-drivable-lane": 0, "agent_compute-ego": 0.00932709127664566, "deviation-heading": 0.42218734391092383, "set_robot_commands": 0.008252277970314026, "deviation-center-line": 0.10686452122645386, "driven_lanedir_consec": 0.366714522485295, "sim_compute_sim_state": 0.00513661652803421, "sim_compute_performance-ego": 0.006947651505470276, "sim_compute_robot_state-ego": 0.008792281150817871, "sim_compute_robot_state-npc0": 0.00782378762960434, "sim_compute_robot_state-npc1": 0.007942691445350647, "sim_compute_robot_state-npc2": 0.007575362920761108, "sim_compute_robot_state-npc3": 0.007699497044086456}, "ETHZ_autolab_technical_track-5-0": {"driven_any": 1.0548273189057833, "sim_physics": 0.18132503620989912, "survival_time": 3.8499999999999943, "driven_lanedir": 0.3963714216744775, "sim_render-ego": 0.012095723833356584, "in-drivable-lane": 1.7499999999999971, "agent_compute-ego": 0.010504861930748084, "deviation-heading": 1.272726254754917, "set_robot_commands": 0.010420839507858475, "deviation-center-line": 0.20372147663934215, "driven_lanedir_consec": 0.3963714216744775, "sim_compute_sim_state": 0.004995974627408114, "sim_compute_performance-ego": 0.00717089083287623, "sim_compute_robot_state-ego": 0.008773918275709277, "sim_compute_robot_state-npc0": 0.008953537259783064, "sim_compute_robot_state-npc1": 0.00863589249648057, "sim_compute_robot_state-npc2": 0.008299220692027699, "sim_compute_robot_state-npc3": 0.00833691559828721}, "ETHZ_autolab_technical_track-6-0": {"driven_any": 0.9948273195001682, "sim_physics": 0.14980585934364632, "survival_time": 3.649999999999995, "driven_lanedir": 0.6530046235032079, "sim_render-ego": 0.010334174926966836, "in-drivable-lane": 0.849999999999997, "agent_compute-ego": 0.008050536456173414, "deviation-heading": 0.8187446392859457, "set_robot_commands": 0.008371095134787364, "deviation-center-line": 0.19436286934102945, "driven_lanedir_consec": 0.6530046235032079, "sim_compute_sim_state": 0.004382509074799002, "sim_compute_performance-ego": 0.006123291303033698, "sim_compute_robot_state-ego": 0.00830667639431888, "sim_compute_robot_state-npc0": 0.007231829917594178, "sim_compute_robot_state-npc1": 0.007226685955099864, "sim_compute_robot_state-npc2": 0.007205182558869662, "sim_compute_robot_state-npc3": 0.006827426283326867}, "ETHZ_autolab_technical_track-7-0": {"driven_any": 2.0298273185719493, "sim_physics": 0.17705139475809015, "survival_time": 7.099999999999983, "driven_lanedir": 0.741234184731216, "sim_render-ego": 0.012280208963743398, "in-drivable-lane": 4.249999999999985, "agent_compute-ego": 0.00923667827122648, "deviation-heading": 0.5416787058937298, "set_robot_commands": 0.008334789477603537, "deviation-center-line": 0.21649269357451997, "driven_lanedir_consec": 0.741234184731216, "sim_compute_sim_state": 0.004639931128058635, "sim_compute_performance-ego": 0.007168887366711254, "sim_compute_robot_state-ego": 0.009320534450907103, "sim_compute_robot_state-npc0": 0.008112219017995914, "sim_compute_robot_state-npc1": 0.007947676618334273, "sim_compute_robot_state-npc2": 0.007911128057560451, "sim_compute_robot_state-npc3": 0.008033379702500894}, "ETHZ_autolab_technical_track-8-0": {"driven_any": 1.0248273191286528, "sim_physics": 0.1932771142323812, "survival_time": 3.7499999999999942, "driven_lanedir": 0.38223306402252977, "sim_render-ego": 0.012051916122436524, "in-drivable-lane": 2.099999999999994, "agent_compute-ego": 0.010269873936971027, "deviation-heading": 0.41826512024881946, "set_robot_commands": 0.0107635498046875, "deviation-center-line": 0.14440586530294292, "driven_lanedir_consec": 0.38223306402252977, "sim_compute_sim_state": 0.004778143564860026, "sim_compute_performance-ego": 0.007018254597981771, "sim_compute_robot_state-ego": 0.009344393412272136, "sim_compute_robot_state-npc0": 0.008720792134602865, "sim_compute_robot_state-npc1": 0.008419853846232096, "sim_compute_robot_state-npc2": 0.008353630701700846, "sim_compute_robot_state-npc3": 0.008323399225870769}, "ETHZ_autolab_technical_track-9-0": {"driven_any": 0.4548365617710395, "sim_physics": 0.17154341775017817, "survival_time": 1.850000000000001, "driven_lanedir": 0.43889108545437505, "sim_render-ego": 0.012665555283829972, "in-drivable-lane": 0, "agent_compute-ego": 0.010039097553974871, "deviation-heading": 0.491310634741224, "set_robot_commands": 0.009479619361258842, "deviation-center-line": 0.11665316537398888, "driven_lanedir_consec": 0.43889108545437505, "sim_compute_sim_state": 0.005105031503213418, "sim_compute_performance-ego": 0.007466773729066591, "sim_compute_robot_state-ego": 0.00918734395826185, "sim_compute_robot_state-npc0": 0.009045691103548616, "sim_compute_robot_state-npc1": 0.008713677122786239, "sim_compute_robot_state-npc2": 0.008663828308517868, "sim_compute_robot_state-npc3": 0.008696575422544737}, "ETHZ_autolab_technical_track-10-0": {"driven_any": 0.3648701917101209, "sim_physics": 0.24813573591170773, "survival_time": 1.5500000000000007, "driven_lanedir": 0.34552145550754965, "sim_render-ego": 0.012300529787617346, "in-drivable-lane": 0, "agent_compute-ego": 0.01143241697742093, "deviation-heading": 0.5070424162880827, "set_robot_commands": 0.00980234146118164, "deviation-center-line": 0.10012774388669717, "driven_lanedir_consec": 0.34552145550754965, "sim_compute_sim_state": 0.005009020528485698, "sim_compute_performance-ego": 0.00778651237487793, "sim_compute_robot_state-ego": 0.009893055885068832, "sim_compute_robot_state-npc0": 0.008414922222014396, "sim_compute_robot_state-npc1": 0.009026942714568107, "sim_compute_robot_state-npc2": 0.009435745977586316, "sim_compute_robot_state-npc3": 0.008240015276016728}, "ETHZ_autolab_technical_track-11-0": {"driven_any": 0.4098472254790875, "sim_physics": 0.1460332800360287, "survival_time": 1.7000000000000008, "driven_lanedir": 0.4054410153244894, "sim_render-ego": 0.012983420315910788, "in-drivable-lane": 0, "agent_compute-ego": 0.009723894736346076, "deviation-heading": 0.2495279988048577, "set_robot_commands": 0.00843637129839729, "deviation-center-line": 0.16731811540993266, "driven_lanedir_consec": 0.4054410153244894, "sim_compute_sim_state": 0.00458382157718434, "sim_compute_performance-ego": 0.007698262439054602, "sim_compute_robot_state-ego": 0.00850242726943072, "sim_compute_robot_state-npc0": 0.008089619524338666, "sim_compute_robot_state-npc1": 0.007557988166809082, "sim_compute_robot_state-npc2": 0.006879476939930636, "sim_compute_robot_state-npc3": 0.00808100139393526}, "ETHZ_autolab_technical_track-12-0": {"driven_any": 1.0248273191286312, "sim_physics": 0.1543134562174479, "survival_time": 3.7499999999999942, "driven_lanedir": 0.32721267753615213, "sim_render-ego": 0.012524592081705728, "in-drivable-lane": 2.299999999999994, "agent_compute-ego": 0.009997561772664388, "deviation-heading": 0.3112188917063982, "set_robot_commands": 0.009297183354695638, "deviation-center-line": 0.16525966154163726, "driven_lanedir_consec": 0.32721267753615213, "sim_compute_sim_state": 0.005005420049031576, "sim_compute_performance-ego": 0.007223930358886719, "sim_compute_robot_state-ego": 0.009092044830322266, "sim_compute_robot_state-npc0": 0.008926909764607747, "sim_compute_robot_state-npc1": 0.008424593607584635, "sim_compute_robot_state-npc2": 0.008578758239746093, "sim_compute_robot_state-npc3": 0.008345543543497721}, "ETHZ_autolab_technical_track-13-0": {"driven_any": 1.5798273185719856, "sim_physics": 0.18149432965687343, "survival_time": 5.599999999999988, "driven_lanedir": 1.211071354427033, "sim_render-ego": 0.011829557163374764, "in-drivable-lane": 0.849999999999997, "agent_compute-ego": 0.009515638862337384, "deviation-heading": 1.0143384205991224, "set_robot_commands": 0.008930423430034093, "deviation-center-line": 0.44830395948846297, "driven_lanedir_consec": 1.211071354427033, "sim_compute_sim_state": 0.0047884924071175715, "sim_compute_performance-ego": 0.006789264934403556, "sim_compute_robot_state-ego": 0.008945056370326452, "sim_compute_robot_state-npc0": 0.008490581597600664, "sim_compute_robot_state-npc1": 0.008013695478439331, "sim_compute_robot_state-npc2": 0.007946693471499853, "sim_compute_robot_state-npc3": 0.00816478899547032}, "ETHZ_autolab_technical_track-14-0": {"driven_any": 1.2198273185919868, "sim_physics": 0.186129784042185, "survival_time": 4.399999999999992, "driven_lanedir": 0.41711373203649504, "sim_render-ego": 0.012284655462611803, "in-drivable-lane": 2.5999999999999917, "agent_compute-ego": 0.00914549014785073, "deviation-heading": 0.5811284097850438, "set_robot_commands": 0.009057513692162254, "deviation-center-line": 0.13226882250813252, "driven_lanedir_consec": 0.41711373203649504, "sim_compute_sim_state": 0.0048633001067421655, "sim_compute_performance-ego": 0.007208685983311047, "sim_compute_robot_state-ego": 0.009013430638746782, "sim_compute_robot_state-npc0": 0.00813564658164978, "sim_compute_robot_state-npc1": 0.008105513724413786, "sim_compute_robot_state-npc2": 0.008169724182649092, "sim_compute_robot_state-npc3": 0.007824201475490223}}
set_robot_commands_max0.0107635498046875
set_robot_commands_mean0.00916193812872998
set_robot_commands_median0.008993061525481088
set_robot_commands_min0.007973213453550596
sim_compute_performance-ego_max0.00778651237487793
sim_compute_performance-ego_mean0.0071288090094621375
sim_compute_performance-ego_median0.00717089083287623
sim_compute_performance-ego_min0.006123291303033698
sim_compute_robot_state-ego_max0.009893055885068832
sim_compute_robot_state-ego_mean0.00896751618320848
sim_compute_robot_state-ego_median0.009013430638746782
sim_compute_robot_state-ego_min0.007865937980445655
sim_compute_robot_state-npc0_max0.009045691103548616
sim_compute_robot_state-npc0_mean0.008337192424130313
sim_compute_robot_state-npc0_median0.008414922222014396
sim_compute_robot_state-npc0_min0.007231829917594178
sim_compute_robot_state-npc1_max0.009026942714568107
sim_compute_robot_state-npc1_mean0.008152605565472435
sim_compute_robot_state-npc1_median0.008267402648925781
sim_compute_robot_state-npc1_min0.007226685955099864
sim_compute_robot_state-npc2_max0.009435745977586316
sim_compute_robot_state-npc2_mean0.008091690905415387
sim_compute_robot_state-npc2_median0.008169724182649092
sim_compute_robot_state-npc2_min0.006879476939930636
sim_compute_robot_state-npc3_max0.008696575422544737
sim_compute_robot_state-npc3_mean0.008058496334658535
sim_compute_robot_state-npc3_median0.00816478899547032
sim_compute_robot_state-npc3_min0.006827426283326867
sim_compute_sim_state_max0.00513661652803421
sim_compute_sim_state_mean0.004824932753742249
sim_compute_sim_state_median0.0048633001067421655
sim_compute_sim_state_min0.004382509074799002
sim_physics_max0.24813573591170773
sim_physics_mean0.1800442572650127
sim_physics_median0.1776766585452216
sim_physics_min0.1460332800360287
sim_render-ego_max0.013269813997404916
sim_render-ego_mean0.012173898702383851
sim_render-ego_median0.012280208963743398
sim_render-ego_min0.010334174926966836
simulation-passed1
survival_time_max7.099999999999983
survival_time_mean3.6999999999999944
survival_time_min1.5500000000000007
No reset possible
249594186Liam Paull 🇨🇦challenge-aido_LF-template-ros - Template solution using ROSaido3-LF-sim-testingstep1-simulationerrornoip-172-31-46-148-104900:09:08
Unexpected exception [...]
Unexpected exception:
Traceback (most recent call last):
  File "experiment_manager.py", line 174, in main
    make_video1(fn, out_video)
  File "/usr/local/lib/python3.7/site-packages/aido_schemas/utils_video.py", line 63, in make_video1
    pg("video_aido", dict(filename=fn, output=output))
  File "/project/src/procgraph/src/procgraph/scripts/pgmain.py", line 244, in pg
    model.init()
  File "/project/src/procgraph/src/procgraph/core/model.py", line 218, in init
    block.init()
  File "/usr/local/lib/python3.7/site-packages/aido_schemas/utils_video.py", line 20, in init
    self.ld = log_summary(fn)
  File "/usr/local/lib/python3.7/site-packages/aido_schemas/utils_drawing.py", line 40, in log_summary
    with open(filename, "rb") as f:
FileNotFoundError: [Errno 2] No such file or directory: '/challenges/tmp/tmpth8bbhwk/attempts/ETHZ_autolab_technical_track-14-0.attempt14/log.gs2.cbor'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "experiment_manager.py", line 432, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 187, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

 > Traceback (most recent call last):
 >   File "experiment_manager.py", line 174, in main
 >     make_video1(fn, out_video)
 >   File "/usr/local/lib/python3.7/site-packages/aido_schemas/utils_video.py", line 63, in make_video1
 >     pg("video_aido", dict(filename=fn, output=output))
 >   File "/project/src/procgraph/src/procgraph/scripts/pgmain.py", line 244, in pg
 >     model.init()
 >   File "/project/src/procgraph/src/procgraph/core/model.py", line 218, in init
 >     block.init()
 >   File "/usr/local/lib/python3.7/site-packages/aido_schemas/utils_video.py", line 20, in init
 >     self.ld = log_summary(fn)
 >   File "/usr/local/lib/python3.7/site-packages/aido_schemas/utils_drawing.py", line 40, in log_summary
 >     with open(filename, "rb") as f:
 > FileNotFoundError: [Errno 2] No such file or directory: '/challenges/tmp/tmpth8bbhwk/attempts/ETHZ_autolab_technical_track-14-0.attempt14/log.gs2.cbor'
 > 

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.7/site-packages/duckietown_challenges/cie_concrete.py", line 675, in scoring_context
    yield cie
  File "experiment_manager.py", line 444, in <module>
    wrap(cie)
  File "experiment_manager.py", line 436, in wrap
    cie.set_evaluation_dir('episodes', logdir)
  File "/usr/local/lib/python3.7/site-packages/duckietown_challenges/solution_interface.py", line 233, in set_evaluation_dir
    for bn in os.listdir(realdir):
FileNotFoundError: [Errno 2] No such file or directory: '/challenges/tmp/tmpth8bbhwk/episodes'
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
249494193Liam Paull 🇨🇦challenge-aido_LF-baseline-duckietownaido3-LF-sim-testingstep1-simulationerrornoip-172-31-46-148-104900:00:50
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
249464199Manfred Diazchallenge-aido_LF-template-tensorflowaido3-LF-sim-validationstep1-simulationerrornoip-172-31-46-148-104900:00:44
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
249334211Bhairav Mehtachallenge-aido_LF-template-pytorchaido3-LFVI-sim-testingstep1-simulationfailednoip-172-31-46-148-104900:04:19
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "experiment_manager.py", line 298, in run_episode
    agent.write_topic_and_expect_zero('observations', recv.data.observations)
  File "/usr/local/lib/python3.7/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 105, in write_topic_and_expect_zero
    nickname=self.nickname)
  File "/usr/local/lib/python3.7/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 258, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/usr/local/lib/python3.7/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 296, in read_until_over
    raise TimeoutError(msg) from None
TimeoutError: Timeout while reading output of node "agent".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.7/site-packages/duckietown_challenges/cie_concrete.py", line 675, in scoring_context
    yield cie
  File "experiment_manager.py", line 444, in <module>
    wrap(cie)
  File "experiment_manager.py", line 432, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 136, in main
    physics_dt=config.physics_dt)
  File "experiment_manager.py", line 303, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
249284218Manfred DiazBaseline-IL-logs-tensorflowaido3-LFV-sim-validationstep1-simulationfailednoip-172-31-46-148-104900:00:58
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "experiment_manager.py", line 299, in run_episode
    r: MsgReceived = agent.write_topic_and_expect('get_commands', expect='commands')
  File "/usr/local/lib/python3.7/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 96, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/usr/local/lib/python3.7/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 177, in read_one
    nickname=self.nickname)
  File "/usr/local/lib/python3.7/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 258, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/usr/local/lib/python3.7/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 286, in read_until_over
    raise RemoteNodeAborted(m)
zuper_nodes.structures.RemoteNodeAborted: External node "agent" aborted:

error in agent |Exception while handling a message on topic "get_commands".
               |
               || Traceback (most recent call last):
               ||   File "/usr/local/lib/python3.7/dist-packages/tensorflow/python/client/session.py", line 1334, in _do_call
               ||     return fn(*args)
               ||   File "/usr/local/lib/python3.7/dist-packages/tensorflow/python/client/session.py", line 1319, in _run_fn
               ||     options, feed_dict, fetch_list, target_list, run_metadata)
               ||   File "/usr/local/lib/python3.7/dist-packages/tensorflow/python/client/session.py", line 1407, in _call_tf_sessionrun
               ||     run_metadata)
               || tensorflow.python.framework.errors_impl.FailedPreconditionError: Attempting to use uninitialized value prefix/ConvNet/conv_layer_1/kernel
               || 	 [[{{node prefix/ConvNet/conv_layer_1/kernel/read}}]]
               ||
               || During handling of the above exception, another exception occurred:
               ||
               || Traceback (most recent call last):
               ||   File "/usr/local/lib/python3.7/dist-packages/zuper_nodes_wrapper/wrapper.py", line 277, in loop
               ||     handle_message_node(parsed, receiver0, context0)
               ||   File "/usr/local/lib/python3.7/dist-packages/zuper_nodes_wrapper/wrapper.py", line 431, in handle_message_node
               ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
               ||   File "/usr/local/lib/python3.7/dist-packages/zuper_nodes_wrapper/utils.py", line 19, in call_if_fun_exists
               ||     f(**kwargs)
               ||   File "imitation_agent.py", line 69, in on_received_get_commands
               ||     pwm_left, pwm_right = self.compute_action(self.config.current_image)
               ||   File "imitation_agent.py", line 58, in compute_action
               ||     x: observation
               ||   File "/usr/local/lib/python3.7/dist-packages/tensorflow/python/client/session.py", line 929, in run
               ||     run_metadata_ptr)
               ||   File "/usr/local/lib/python3.7/dist-packages/tensorflow/python/client/session.py", line 1152, in _run
               ||     feed_dict_tensor, options, run_metadata)
               ||   File "/usr/local/lib/python3.7/dist-packages/tensorflow/python/client/session.py", line 1328, in _do_run
               ||     run_metadata)
               ||   File "/usr/local/lib/python3.7/dist-packages/tensorflow/python/client/session.py", line 1348, in _do_call
               ||     raise type(e)(node_def, op, message)
               || tensorflow.python.framework.errors_impl.FailedPreconditionError: Attempting to use uninitialized value prefix/ConvNet/conv_layer_1/kernel
               || 	 [[node prefix/ConvNet/conv_layer_1/kernel/read (defined at /workspace/graph_utils.py:14) ]]
               ||
               || Caused by op 'prefix/ConvNet/conv_layer_1/kernel/read', defined at:
               ||   File "imitation_agent.py", line 134, in <module>
               ||     main()
               ||   File "imitation_agent.py", line 130, in main
               ||     wrap_direct(node=node, protocol=protocol)
               ||   File "/usr/local/lib/python3.7/dist-packages/zuper_nodes_wrapper/interface.py", line 22, in wrap_direct
               ||     run_loop(node, protocol, args)
               ||   File "/usr/local/lib/python3.7/dist-packages/zuper_nodes_wrapper/wrapper.py", line 196, in run_loop
               ||     config=config)
               ||   File "/usr/local/lib/python3.7/dist-packages/zuper_nodes_wrapper/wrapper.py", line 277, in loop
               ||     handle_message_node(parsed, receiver0, context0)
               ||   File "/usr/local/lib/python3.7/dist-packages/zuper_nodes_wrapper/wrapper.py", line 431, in handle_message_node
               ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
               ||   File "/usr/local/lib/python3.7/dist-packages/zuper_nodes_wrapper/utils.py", line 19, in call_if_fun_exists
               ||     f(**kwargs)
               ||   File "imitation_agent.py", line 69, in on_received_get_commands
               ||     pwm_left, pwm_right = self.compute_action(self.config.current_image)
               ||   File "imitation_agent.py", line 41, in compute_action
               ||     graph = load_graph(frozen_model_filename)
               ||   File "/workspace/graph_utils.py", line 14, in load_graph
               ||     tf.import_graph_def(graph_def, name="prefix")
               ||   File "/usr/local/lib/python3.7/dist-packages/tensorflow/python/util/deprecation.py", line 507, in new_func
               ||     return func(*args, **kwargs)
               ||   File "/usr/local/lib/python3.7/dist-packages/tensorflow/python/framework/importer.py", line 442, in import_graph_def
               ||     _ProcessNewOps(graph)
               ||   File "/usr/local/lib/python3.7/dist-packages/tensorflow/python/framework/importer.py", line 235, in _ProcessNewOps
               ||     for new_op in graph._add_new_tf_operations(compute_devices=False):  # pylint: disable=protected-access
               ||   File "/usr/local/lib/python3.7/dist-packages/tensorflow/python/framework/ops.py", line 3433, in _add_new_tf_operations
               ||     for c_op in c_api_util.new_tf_operations(self)
               ||   File "/usr/local/lib/python3.7/dist-packages/tensorflow/python/framework/ops.py", line 3433, in <listcomp>
               ||     for c_op in c_api_util.new_tf_operations(self)
               ||   File "/usr/local/lib/python3.7/dist-packages/tensorflow/python/framework/ops.py", line 3325, in _create_op_from_tf_operation
               ||     ret = Operation(c_op, self)
               ||   File "/usr/local/lib/python3.7/dist-packages/tensorflow/python/framework/ops.py", line 1801, in __init__
               ||     self._traceback = tf_stack.extract_stack()
               ||
               || FailedPreconditionError (see above for traceback): Attempting to use uninitialized value prefix/ConvNet/conv_layer_1/kernel
               || 	 [[node prefix/ConvNet/conv_layer_1/kernel/read (defined at /workspace/graph_utils.py:14) ]]
               ||
               ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.7/site-packages/duckietown_challenges/cie_concrete.py", line 675, in scoring_context
    yield cie
  File "experiment_manager.py", line 444, in <module>
    wrap(cie)
  File "experiment_manager.py", line 432, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 136, in main
    physics_dt=config.physics_dt)
  File "experiment_manager.py", line 303, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
249234226Manfred DiazBaseline-IL-logs-tensorflowaido3-LFV-sim-validationstep1-simulationfailednoip-172-31-46-148-104900:02:03
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "experiment_manager.py", line 299, in run_episode
    r: MsgReceived = agent.write_topic_and_expect('get_commands', expect='commands')
  File "/usr/local/lib/python3.7/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 96, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/usr/local/lib/python3.7/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 177, in read_one
    nickname=self.nickname)
  File "/usr/local/lib/python3.7/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 258, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/usr/local/lib/python3.7/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 286, in read_until_over
    raise RemoteNodeAborted(m)
zuper_nodes.structures.RemoteNodeAborted: External node "agent" aborted:

error in agent |Exception while handling a message on topic "get_commands".
               |
               || Traceback (most recent call last):
               ||   File "/usr/local/lib/python3.7/dist-packages/tensorflow/python/client/session.py", line 1334, in _do_call
               ||     return fn(*args)
               ||   File "/usr/local/lib/python3.7/dist-packages/tensorflow/python/client/session.py", line 1319, in _run_fn
               ||     options, feed_dict, fetch_list, target_list, run_metadata)
               ||   File "/usr/local/lib/python3.7/dist-packages/tensorflow/python/client/session.py", line 1407, in _call_tf_sessionrun
               ||     run_metadata)
               || tensorflow.python.framework.errors_impl.FailedPreconditionError: Attempting to use uninitialized value prefix/ConvNet/fc_layer_2/bias
               || 	 [[{{node prefix/ConvNet/fc_layer_2/bias/read}}]]
               ||
               || During handling of the above exception, another exception occurred:
               ||
               || Traceback (most recent call last):
               ||   File "/usr/local/lib/python3.7/dist-packages/zuper_nodes_wrapper/wrapper.py", line 277, in loop
               ||     handle_message_node(parsed, receiver0, context0)
               ||   File "/usr/local/lib/python3.7/dist-packages/zuper_nodes_wrapper/wrapper.py", line 431, in handle_message_node
               ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
               ||   File "/usr/local/lib/python3.7/dist-packages/zuper_nodes_wrapper/utils.py", line 19, in call_if_fun_exists
               ||     f(**kwargs)
               ||   File "imitation_agent.py", line 71, in on_received_get_commands
               ||     pwm_left, pwm_right = self.compute_action(self.config.current_image)
               ||   File "imitation_agent.py", line 60, in compute_action
               ||     x: observation
               ||   File "/usr/local/lib/python3.7/dist-packages/tensorflow/python/client/session.py", line 929, in run
               ||     run_metadata_ptr)
               ||   File "/usr/local/lib/python3.7/dist-packages/tensorflow/python/client/session.py", line 1152, in _run
               ||     feed_dict_tensor, options, run_metadata)
               ||   File "/usr/local/lib/python3.7/dist-packages/tensorflow/python/client/session.py", line 1328, in _do_run
               ||     run_metadata)
               ||   File "/usr/local/lib/python3.7/dist-packages/tensorflow/python/client/session.py", line 1348, in _do_call
               ||     raise type(e)(node_def, op, message)
               || tensorflow.python.framework.errors_impl.FailedPreconditionError: Attempting to use uninitialized value prefix/ConvNet/fc_layer_2/bias
               || 	 [[node prefix/ConvNet/fc_layer_2/bias/read (defined at /workspace/graph_utils.py:14) ]]
               ||
               || Caused by op 'prefix/ConvNet/fc_layer_2/bias/read', defined at:
               ||   File "imitation_agent.py", line 136, in <module>
               ||     main()
               ||   File "imitation_agent.py", line 132, in main
               ||     wrap_direct(node=node, protocol=protocol)
               ||   File "/usr/local/lib/python3.7/dist-packages/zuper_nodes_wrapper/interface.py", line 22, in wrap_direct
               ||     run_loop(node, protocol, args)
               ||   File "/usr/local/lib/python3.7/dist-packages/zuper_nodes_wrapper/wrapper.py", line 196, in run_loop
               ||     config=config)
               ||   File "/usr/local/lib/python3.7/dist-packages/zuper_nodes_wrapper/wrapper.py", line 277, in loop
               ||     handle_message_node(parsed, receiver0, context0)
               ||   File "/usr/local/lib/python3.7/dist-packages/zuper_nodes_wrapper/wrapper.py", line 431, in handle_message_node
               ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
               ||   File "/usr/local/lib/python3.7/dist-packages/zuper_nodes_wrapper/utils.py", line 19, in call_if_fun_exists
               ||     f(**kwargs)
               ||   File "imitation_agent.py", line 71, in on_received_get_commands
               ||     pwm_left, pwm_right = self.compute_action(self.config.current_image)
               ||   File "imitation_agent.py", line 43, in compute_action
               ||     graph = load_graph(frozen_model_filename)
               ||   File "/workspace/graph_utils.py", line 14, in load_graph
               ||     tf.import_graph_def(graph_def, name="prefix")
               ||   File "/usr/local/lib/python3.7/dist-packages/tensorflow/python/util/deprecation.py", line 507, in new_func
               ||     return func(*args, **kwargs)
               ||   File "/usr/local/lib/python3.7/dist-packages/tensorflow/python/framework/importer.py", line 442, in import_graph_def
               ||     _ProcessNewOps(graph)
               ||   File "/usr/local/lib/python3.7/dist-packages/tensorflow/python/framework/importer.py", line 235, in _ProcessNewOps
               ||     for new_op in graph._add_new_tf_operations(compute_devices=False):  # pylint: disable=protected-access
               ||   File "/usr/local/lib/python3.7/dist-packages/tensorflow/python/framework/ops.py", line 3433, in _add_new_tf_operations
               ||     for c_op in c_api_util.new_tf_operations(self)
               ||   File "/usr/local/lib/python3.7/dist-packages/tensorflow/python/framework/ops.py", line 3433, in <listcomp>
               ||     for c_op in c_api_util.new_tf_operations(self)
               ||   File "/usr/local/lib/python3.7/dist-packages/tensorflow/python/framework/ops.py", line 3325, in _create_op_from_tf_operation
               ||     ret = Operation(c_op, self)
               ||   File "/usr/local/lib/python3.7/dist-packages/tensorflow/python/framework/ops.py", line 1801, in __init__
               ||     self._traceback = tf_stack.extract_stack()
               ||
               || FailedPreconditionError (see above for traceback): Attempting to use uninitialized value prefix/ConvNet/fc_layer_2/bias
               || 	 [[node prefix/ConvNet/fc_layer_2/bias/read (defined at /workspace/graph_utils.py:14) ]]
               ||
               ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.7/site-packages/duckietown_challenges/cie_concrete.py", line 675, in scoring_context
    yield cie
  File "experiment_manager.py", line 444, in <module>
    wrap(cie)
  File "experiment_manager.py", line 432, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 136, in main
    physics_dt=config.physics_dt)
  File "experiment_manager.py", line 303, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
249204230Andrea Censi 🇨🇭challenge-aido_LF-template-pytorchaido3-LF-sim-testingstep1-simulationerrornoip-172-31-46-148-104900:00:34
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
249144235Andrea Censi 🇨🇭challenge-aido_LF-template-pytorchaido3-LFVI-sim-testingstep1-simulationerrornoip-172-31-46-148-104900:01:50
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
248944261Gianmarco Bernasconichallenge-aido_LF-baseline-duckietownaido3-LF-sim-testingstep1-simulationsuccessnoip-172-31-46-148-104900:35:53
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.0533687807052226
survival_time_median8.349999999999984
deviation-center-line_median0.5167968376302899
in-drivable-lane_median0.34999999999999876


other stats
agent_compute-ego_max0.06026226690370742
agent_compute-ego_mean0.05491065210356996
agent_compute-ego_median0.055441513206019546
agent_compute-ego_min0.038781317504676616
deviation-center-line_max1.2647373535855482
deviation-center-line_mean0.5921007394832388
deviation-center-line_min0.2183768867273121
deviation-heading_max6.090910817107411
deviation-heading_mean2.3673425509562755
deviation-heading_median2.285975241154279
deviation-heading_min0.6980510166477553
driven_any_max2.349143977538615
driven_any_mean1.419537170513894
driven_any_median1.2882071112718438
driven_any_min0.47668805800380254
driven_lanedir_consec_max2.3013650383253177
driven_lanedir_consec_mean1.0898082856484888
driven_lanedir_consec_min0.44651752386129306
driven_lanedir_max2.3013650383253177
driven_lanedir_mean1.134185830771407
driven_lanedir_median1.0533687807052226
driven_lanedir_min0.44651752386129306
in-drivable-lane_max3.599999999999995
in-drivable-lane_mean1.1366666666666736
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.533332094741882, "sim_physics": 0.11287666655875542, "survival_time": 3.699999999999995, "driven_lanedir": 0.4511894817829587, "sim_render-ego": 0.013582016970660237, "in-drivable-lane": 0, "agent_compute-ego": 0.038781317504676616, "deviation-heading": 1.3400199199614828, "set_robot_commands": 0.01059791526278934, "deviation-center-line": 0.2597608669394471, "driven_lanedir_consec": 0.4511894817829587, "sim_compute_sim_state": 0.005767007131834288, "sim_compute_performance-ego": 0.008349318762083311, "sim_compute_robot_state-ego": 0.010010941608532055}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 2.348796971422613, "sim_physics": 0.13927457571029664, "survival_time": 14.950000000000076, "driven_lanedir": 1.923681742048859, "sim_render-ego": 0.014701298077901204, "in-drivable-lane": 1.349999999999998, "agent_compute-ego": 0.05688845078150431, "deviation-heading": 5.089980262943026, "set_robot_commands": 0.011593077977498372, "deviation-center-line": 0.8600301462407306, "driven_lanedir_consec": 1.923681742048859, "sim_compute_sim_state": 0.006044263044993082, "sim_compute_performance-ego": 0.008847944736480713, "sim_compute_robot_state-ego": 0.011501872539520263}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.778416332519034, "sim_physics": 0.12790275038334362, "survival_time": 11.400000000000029, "driven_lanedir": 1.2592074805717888, "sim_render-ego": 0.014069577058156332, "in-drivable-lane": 2.5000000000000355, "agent_compute-ego": 0.0576096072531583, "deviation-heading": 2.854359449279568, "set_robot_commands": 0.011261264483133951, "deviation-center-line": 0.6568294023803197, "driven_lanedir_consec": 1.2592074805717888, "sim_compute_sim_state": 0.005704688398461593, "sim_compute_performance-ego": 0.008437107529556542, "sim_compute_robot_state-ego": 0.010882586763616194}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.1196077920030725, "sim_physics": 0.13539820174648337, "survival_time": 7.299999999999982, "driven_lanedir": 1.0533687807052226, "sim_render-ego": 0.015337648457043792, "in-drivable-lane": 0.2499999999999991, "agent_compute-ego": 0.06026226690370742, "deviation-heading": 1.1850458661960783, "set_robot_commands": 0.012047566779672282, "deviation-center-line": 0.4159631142662444, "driven_lanedir_consec": 1.0533687807052226, "sim_compute_sim_state": 0.006020325503937185, "sim_compute_performance-ego": 0.00863859914753535, "sim_compute_robot_state-ego": 0.011896358777398933}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.1919099773840565, "sim_physics": 0.12437412969527706, "survival_time": 7.7499999999999805, "driven_lanedir": 1.0909167109476483, "sim_render-ego": 0.01379849987645303, "in-drivable-lane": 0.34999999999999876, "agent_compute-ego": 0.054864771135391725, "deviation-heading": 1.48513639285636, "set_robot_commands": 0.010649845677037391, "deviation-center-line": 0.3480205772164413, "driven_lanedir_consec": 1.0909167109476483, "sim_compute_sim_state": 0.005472741588469474, "sim_compute_performance-ego": 0.00816905883050734, "sim_compute_robot_state-ego": 0.010045969870782668}, "ETHZ_autolab_technical_track-5-0": {"driven_any": 2.0194140670531966, "sim_physics": 0.15137235970460167, "survival_time": 12.900000000000048, "driven_lanedir": 1.5563470799043058, "sim_render-ego": 0.014333721279173858, "in-drivable-lane": 1.500000000000008, "agent_compute-ego": 0.058034915332646334, "deviation-heading": 4.486297579353951, "set_robot_commands": 0.010800028956213664, "deviation-center-line": 0.8686423992295469, "driven_lanedir_consec": 1.2056968433585644, "sim_compute_sim_state": 0.005623480146245439, "sim_compute_performance-ego": 0.008511314096376878, "sim_compute_robot_state-ego": 0.01087658349857774}, "ETHZ_autolab_technical_track-6-0": {"driven_any": 0.47668805800380254, "sim_physics": 0.12245109948244962, "survival_time": 3.2999999999999963, "driven_lanedir": 0.44651752386129306, "sim_render-ego": 0.01331308755007657, "in-drivable-lane": 0, "agent_compute-ego": 0.055441513206019546, "deviation-heading": 0.7154711599165025, "set_robot_commands": 0.009961417227080374, "deviation-center-line": 0.25784465118992994, "driven_lanedir_consec": 0.44651752386129306, "sim_compute_sim_state": 0.005383563764167555, "sim_compute_performance-ego": 0.007459611603707978, "sim_compute_robot_state-ego": 0.00976412585287383}, "ETHZ_autolab_technical_track-7-0": {"driven_any": 1.2882071112718438, "sim_physics": 0.14051639248511036, "survival_time": 8.349999999999984, "driven_lanedir": 0.8322123700741391, "sim_render-ego": 0.014132810923867596, "in-drivable-lane": 1.9999999999999956, "agent_compute-ego": 0.05813811353580681, "deviation-heading": 2.5173435801994453, "set_robot_commands": 0.010895366440276184, "deviation-center-line": 0.5167968376302899, "driven_lanedir_consec": 0.8322123700741391, "sim_compute_sim_state": 0.005487430595352265, "sim_compute_performance-ego": 0.008366883157969948, "sim_compute_robot_state-ego": 0.010763980671317275}, "ETHZ_autolab_technical_track-8-0": {"driven_any": 2.349143977538615, "sim_physics": 0.1239751402537028, "survival_time": 14.950000000000076, "driven_lanedir": 2.3013650383253177, "sim_render-ego": 0.01380650281906128, "in-drivable-lane": 0, "agent_compute-ego": 0.053850194613138835, "deviation-heading": 2.285975241154279, "set_robot_commands": 0.010882568359375, "deviation-center-line": 1.2647373535855482, "driven_lanedir_consec": 2.3013650383253177, "sim_compute_sim_state": 0.005582954088846842, "sim_compute_performance-ego": 0.008266965548197428, "sim_compute_robot_state-ego": 0.010696303844451903}, "ETHZ_autolab_technical_track-9-0": {"driven_any": 0.5168510257374714, "sim_physics": 0.11686421448076276, "survival_time": 3.5499999999999954, "driven_lanedir": 0.45776757047856487, "sim_render-ego": 0.0134317203306816, "in-drivable-lane": 0, "agent_compute-ego": 0.05780889282763844, "deviation-heading": 1.0440626121681604, "set_robot_commands": 0.009392842440538004, "deviation-center-line": 0.2183768867273121, "driven_lanedir_consec": 0.45776757047856487, "sim_compute_sim_state": 0.005238805018680196, "sim_compute_performance-ego": 0.00828829953368281, "sim_compute_robot_state-ego": 0.009831129665106115}, "ETHZ_autolab_technical_track-10-0": {"driven_any": 1.031192667491212, "sim_physics": 0.12921733149775752, "survival_time": 6.749999999999984, "driven_lanedir": 1.0045442547054488, "sim_render-ego": 0.013762375160499857, "in-drivable-lane": 0, "agent_compute-ego": 0.05306865021034523, "deviation-heading": 0.952398058221365, "set_robot_commands": 0.010327618210404009, "deviation-center-line": 0.6461931187655771, "driven_lanedir_consec": 1.0045442547054488, "sim_compute_sim_state": 0.005281859857064706, "sim_compute_performance-ego": 0.007912513944837782, "sim_compute_robot_state-ego": 0.010445854398939344}, "ETHZ_autolab_technical_track-11-0": {"driven_any": 0.5490194322690597, "sim_physics": 0.1415066909790039, "survival_time": 3.7499999999999942, "driven_lanedir": 0.4831074812904173, "sim_render-ego": 0.01439371109008789, "in-drivable-lane": 0.2499999999999991, "agent_compute-ego": 0.05777853647867839, "deviation-heading": 0.6980510166477553, "set_robot_commands": 0.01171651840209961, "deviation-center-line": 0.2529617279346824, "driven_lanedir_consec": 0.4831074812904173, "sim_compute_sim_state": 0.005604902903238933, "sim_compute_performance-ego": 0.008092838923136393, "sim_compute_robot_state-ego": 0.010862480799357095}, "ETHZ_autolab_technical_track-12-0": {"driven_any": 1.4730637269854705, "sim_physics": 0.11982551624900416, "survival_time": 9.5, "driven_lanedir": 0.7732115273684559, "sim_render-ego": 0.01340186595916748, "in-drivable-lane": 3.599999999999995, "agent_compute-ego": 0.054561364023309, "deviation-heading": 2.4239696679266696, "set_robot_commands": 0.01067894508964137, "deviation-center-line": 0.4111092119789217, "driven_lanedir_consec": 0.679143430378673, "sim_compute_sim_state": 0.005596361662212171, "sim_compute_performance-ego": 0.008065080642700196, "sim_compute_robot_state-ego": 0.010360110433478105}, "ETHZ_autolab_technical_track-13-0": {"driven_any": 2.268290167501214, "sim_physics": 0.12011140605570124, "survival_time": 14.45000000000007, "driven_lanedir": 1.5257561676275575, "sim_render-ego": 0.013535464923687048, "in-drivable-lane": 2.550000000000036, "agent_compute-ego": 0.05194849786461431, "deviation-heading": 6.090910817107411, "set_robot_commands": 0.010936956504636984, "deviation-center-line": 0.7181952663720172, "driven_lanedir_consec": 1.3048113243193145, "sim_compute_sim_state": 0.005576018231137813, "sim_compute_performance-ego": 0.008151476770948787, "sim_compute_robot_state-ego": 0.010365946482622087}, "ETHZ_autolab_technical_track-14-0": {"driven_any": 2.3491241557858644, "sim_physics": 0.11896368741989136, "survival_time": 14.950000000000076, "driven_lanedir": 1.8535942518791235, "sim_render-ego": 0.013877026240030925, "in-drivable-lane": 2.7000000000000384, "agent_compute-ego": 0.05462268988291422, "deviation-heading": 2.3411166404120727, "set_robot_commands": 0.01120129903157552, "deviation-center-line": 1.186049531791573, "driven_lanedir_consec": 1.8535942518791235, "sim_compute_sim_state": 0.0054829772313435875, "sim_compute_performance-ego": 0.008423519134521485, "sim_compute_robot_state-ego": 0.010509741306304932}}
set_robot_commands_max0.012047566779672282
set_robot_commands_mean0.01086288205613147
set_robot_commands_median0.010882568359375
set_robot_commands_min0.009392842440538004
sim_compute_performance-ego_max0.008847944736480713
sim_compute_performance-ego_mean0.00826536882414953
sim_compute_performance-ego_median0.00828829953368281
sim_compute_performance-ego_min0.007459611603707978
sim_compute_robot_state-ego_max0.011896358777398933
sim_compute_robot_state-ego_mean0.01058759910085857
sim_compute_robot_state-ego_median0.010509741306304932
sim_compute_robot_state-ego_min0.00976412585287383
sim_compute_sim_state_max0.006044263044993082
sim_compute_sim_state_mean0.005591158611065675
sim_compute_sim_state_median0.005582954088846842
sim_compute_sim_state_min0.005238805018680196
sim_physics_max0.15137235970460167
sim_physics_mean0.1283086775134761
sim_physics_median0.12437412969527706
sim_physics_min0.11287666655875542
sim_render-ego_max0.015337648457043792
sim_render-ego_mean0.01396515511443658
sim_render-ego_median0.01380650281906128
sim_render-ego_min0.01331308755007657
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean9.17000000000002
survival_time_min3.2999999999999963
No reset possible
248754274Riza Velioglu 🇩🇪Uni Bielefeldaido3-LFVI-sim-testingstep1-simulationerrornoip-172-31-46-148-104900:03:00
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
248684282Liam Paull 🇨🇦challenge-aido_LF-template-randomaido3-LF-sim-validationstep1-simulationsuccessnoip-172-31-46-148-104900:04:32
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.5723310224856362
survival_time_median2.549999999999999
deviation-center-line_median0.13005513204193506
in-drivable-lane_median0.29999999999999893


other stats
agent_compute-ego_max0.029161761788760916
agent_compute-ego_mean0.024324319701979697
agent_compute-ego_median0.023717164993286133
agent_compute-ego_min0.019354577158011643
deviation-center-line_max0.2072381278624381
deviation-center-line_mean0.13189395308989765
deviation-center-line_min0.0788839760023766
deviation-heading_max0.5289022616823588
deviation-heading_mean0.3206717506075888
deviation-heading_median0.23606825392187256
deviation-heading_min0.19401296908406307
driven_any_max1.6182144577009443
driven_any_mean0.861378585933269
driven_any_median0.9933867744747804
driven_any_min0.23626560261560617
driven_lanedir_consec_max0.8010406009604816
driven_lanedir_consec_mean0.5597645764431625
driven_lanedir_consec_min0.2264965947033466
driven_lanedir_max0.8010406009604816
driven_lanedir_mean0.5597645764431625
driven_lanedir_median0.5723310224856362
driven_lanedir_min0.2264965947033466
in-drivable-lane_max1.7999999999999936
in-drivable-lane_mean0.619999999999998
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0243289631429704, "sim_physics": 0.10942414071824816, "survival_time": 2.6999999999999984, "driven_lanedir": 0.5723310224856362, "sim_render-ego": 0.012141598595513238, "in-drivable-lane": 0.9999999999999976, "agent_compute-ego": 0.022909650096186885, "deviation-heading": 0.19401296908406307, "set_robot_commands": 0.009425114702295376, "deviation-center-line": 0.15907928712407876, "driven_lanedir_consec": 0.5723310224856362, "sim_compute_sim_state": 0.004990524715847439, "sim_compute_performance-ego": 0.007579304553844311, "sim_compute_robot_state-ego": 0.009298510021633573}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.9933867744747804, "sim_physics": 0.07865348516726027, "survival_time": 2.549999999999999, "driven_lanedir": 0.8010406009604816, "sim_render-ego": 0.00937192580279182, "in-drivable-lane": 0.29999999999999893, "agent_compute-ego": 0.019354577158011643, "deviation-heading": 0.5289022616823588, "set_robot_commands": 0.007475408853269091, "deviation-center-line": 0.13005513204193506, "driven_lanedir_consec": 0.8010406009604816, "sim_compute_sim_state": 0.004009634840722177, "sim_compute_performance-ego": 0.005817385280833524, "sim_compute_robot_state-ego": 0.0068637343013987825}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.23626560261560617, "sim_physics": 0.20626038663527543, "survival_time": 0.8500000000000002, "driven_lanedir": 0.2264965947033466, "sim_render-ego": 0.019779303494621727, "in-drivable-lane": 0, "agent_compute-ego": 0.029161761788760916, "deviation-heading": 0.23048898560984332, "set_robot_commands": 0.01434636116027832, "deviation-center-line": 0.0788839760023766, "driven_lanedir_consec": 0.2264965947033466, "sim_compute_sim_state": 0.008187448277192958, "sim_compute_performance-ego": 0.010985809213974896, "sim_compute_robot_state-ego": 0.013616393594180836}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.4346971317320432, "sim_physics": 0.1109779167175293, "survival_time": 1.2500000000000004, "driven_lanedir": 0.40985475638935265, "sim_render-ego": 0.012265844345092774, "in-drivable-lane": 0, "agent_compute-ego": 0.023717164993286133, "deviation-heading": 0.4138862827398061, "set_robot_commands": 0.009635896682739255, "deviation-center-line": 0.08421324241865966, "driven_lanedir_consec": 0.40985475638935265, "sim_compute_sim_state": 0.004774284362792969, "sim_compute_performance-ego": 0.007048873901367187, "sim_compute_robot_state-ego": 0.009031810760498048}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.6182144577009443, "sim_physics": 0.1383622537685346, "survival_time": 3.949999999999994, "driven_lanedir": 0.7890999076769956, "sim_render-ego": 0.013848669921295551, "in-drivable-lane": 1.7999999999999936, "agent_compute-ego": 0.0264784444736529, "deviation-heading": 0.23606825392187256, "set_robot_commands": 0.01134397108343583, "deviation-center-line": 0.2072381278624381, "driven_lanedir_consec": 0.7890999076769956, "sim_compute_sim_state": 0.006332098683224449, "sim_compute_performance-ego": 0.008808860295935523, "sim_compute_robot_state-ego": 0.010615258277217043}}
set_robot_commands_max0.01434636116027832
set_robot_commands_mean0.010445350496403574
set_robot_commands_median0.009635896682739255
set_robot_commands_min0.007475408853269091
sim_compute_performance-ego_max0.010985809213974896
sim_compute_performance-ego_mean0.008048046649191088
sim_compute_performance-ego_median0.007579304553844311
sim_compute_performance-ego_min0.005817385280833524
sim_compute_robot_state-ego_max0.013616393594180836
sim_compute_robot_state-ego_mean0.009885141390985655
sim_compute_robot_state-ego_median0.009298510021633573
sim_compute_robot_state-ego_min0.0068637343013987825
sim_compute_sim_state_max0.008187448277192958
sim_compute_sim_state_mean0.005658798175955998
sim_compute_sim_state_median0.004990524715847439
sim_compute_sim_state_min0.004009634840722177
sim_physics_max0.20626038663527543
sim_physics_mean0.12873563660136955
sim_physics_median0.1109779167175293
sim_physics_min0.07865348516726027
sim_render-ego_max0.019779303494621727
sim_render-ego_mean0.013481468431863024
sim_render-ego_median0.012265844345092774
sim_render-ego_min0.00937192580279182
simulation-passed1
survival_time_max3.949999999999994
survival_time_mean2.2599999999999985
survival_time_min0.8500000000000002
No reset possible
248604294Liam Paull 🇨🇦challenge-aido_LF-template-randomaido3-LF-sim-validationstep1-simulationsuccessnoip-172-31-46-148-104900:04:58
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.5723310224856362
survival_time_median2.549999999999999
deviation-center-line_median0.13005513204193506
in-drivable-lane_median0.29999999999999893


other stats
agent_compute-ego_max0.025785449184948885
agent_compute-ego_mean0.024723843696083804
agent_compute-ego_median0.024894401138904048
agent_compute-ego_min0.02330122274511001
deviation-center-line_max0.2072381278624381
deviation-center-line_mean0.13189395308989765
deviation-center-line_min0.0788839760023766
deviation-heading_max0.5289022616823588
deviation-heading_mean0.3206717506075888
deviation-heading_median0.23606825392187256
deviation-heading_min0.19401296908406307
driven_any_max1.6182144577009443
driven_any_mean0.861378585933269
driven_any_median0.9933867744747804
driven_any_min0.23626560261560617
driven_lanedir_consec_max0.8010406009604816
driven_lanedir_consec_mean0.5597645764431625
driven_lanedir_consec_min0.2264965947033466
driven_lanedir_max0.8010406009604816
driven_lanedir_mean0.5597645764431625
driven_lanedir_median0.5723310224856362
driven_lanedir_min0.2264965947033466
in-drivable-lane_max1.7999999999999936
in-drivable-lane_mean0.619999999999998
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0243289631429704, "sim_physics": 0.12122464621508564, "survival_time": 2.6999999999999984, "driven_lanedir": 0.5723310224856362, "sim_render-ego": 0.014182700051201714, "in-drivable-lane": 0.9999999999999976, "agent_compute-ego": 0.025575721705401382, "deviation-heading": 0.19401296908406307, "set_robot_commands": 0.01054286073755335, "deviation-center-line": 0.15907928712407876, "driven_lanedir_consec": 0.5723310224856362, "sim_compute_sim_state": 0.005591158513669614, "sim_compute_performance-ego": 0.008844516895435474, "sim_compute_robot_state-ego": 0.010529668242843062}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.9933867744747804, "sim_physics": 0.13003221680136287, "survival_time": 2.549999999999999, "driven_lanedir": 0.8010406009604816, "sim_render-ego": 0.014554991441614488, "in-drivable-lane": 0.29999999999999893, "agent_compute-ego": 0.024894401138904048, "deviation-heading": 0.5289022616823588, "set_robot_commands": 0.011493622087964823, "deviation-center-line": 0.13005513204193506, "driven_lanedir_consec": 0.8010406009604816, "sim_compute_sim_state": 0.005721877602969899, "sim_compute_performance-ego": 0.008540714488309972, "sim_compute_robot_state-ego": 0.011028813380821078}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.23626560261560617, "sim_physics": 0.15813338055330164, "survival_time": 0.8500000000000002, "driven_lanedir": 0.2264965947033466, "sim_render-ego": 0.014049936743343578, "in-drivable-lane": 0, "agent_compute-ego": 0.02330122274511001, "deviation-heading": 0.23048898560984332, "set_robot_commands": 0.011180456946877871, "deviation-center-line": 0.0788839760023766, "driven_lanedir_consec": 0.2264965947033466, "sim_compute_sim_state": 0.005565993926104377, "sim_compute_performance-ego": 0.00842421195086311, "sim_compute_robot_state-ego": 0.010841622072107652}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.4346971317320432, "sim_physics": 0.12145353317260742, "survival_time": 1.2500000000000004, "driven_lanedir": 0.40985475638935265, "sim_render-ego": 0.01225069046020508, "in-drivable-lane": 0, "agent_compute-ego": 0.024062423706054686, "deviation-heading": 0.4138862827398061, "set_robot_commands": 0.010047502517700197, "deviation-center-line": 0.08421324241865966, "driven_lanedir_consec": 0.40985475638935265, "sim_compute_sim_state": 0.004982948303222656, "sim_compute_performance-ego": 0.0074024486541748044, "sim_compute_robot_state-ego": 0.009578962326049803}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.6182144577009443, "sim_physics": 0.15075545371333254, "survival_time": 3.949999999999994, "driven_lanedir": 0.7890999076769956, "sim_render-ego": 0.015049529981009568, "in-drivable-lane": 1.7999999999999936, "agent_compute-ego": 0.025785449184948885, "deviation-heading": 0.23606825392187256, "set_robot_commands": 0.011783862415748306, "deviation-center-line": 0.2072381278624381, "driven_lanedir_consec": 0.7890999076769956, "sim_compute_sim_state": 0.006003826479368572, "sim_compute_performance-ego": 0.00876702839815164, "sim_compute_robot_state-ego": 0.011617461337318905}}
set_robot_commands_max0.011783862415748306
set_robot_commands_mean0.011009660941168911
set_robot_commands_median0.011180456946877871
set_robot_commands_min0.010047502517700197
sim_compute_performance-ego_max0.008844516895435474
sim_compute_performance-ego_mean0.008395784077387
sim_compute_performance-ego_median0.008540714488309972
sim_compute_performance-ego_min0.0074024486541748044
sim_compute_robot_state-ego_max0.011617461337318905
sim_compute_robot_state-ego_mean0.0107193054718281
sim_compute_robot_state-ego_median0.010841622072107652
sim_compute_robot_state-ego_min0.009578962326049803
sim_compute_sim_state_max0.006003826479368572
sim_compute_sim_state_mean0.0055731609650670234
sim_compute_sim_state_median0.005591158513669614
sim_compute_sim_state_min0.004982948303222656
sim_physics_max0.15813338055330164
sim_physics_mean0.13631984609113804
sim_physics_median0.13003221680136287
sim_physics_min0.12122464621508564
sim_render-ego_max0.015049529981009568
sim_render-ego_mean0.014017569735474886
sim_render-ego_median0.014182700051201714
sim_render-ego_min0.01225069046020508
simulation-passed1
survival_time_max3.949999999999994
survival_time_mean2.2599999999999985
survival_time_min0.8500000000000002
No reset possible
248434319Tanli Chou 🇹🇼challenge-aido_LF-template-randomaido3-LFVI-sim-testingstep1-simulationsuccessnoip-172-31-46-148-104900:25:53
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.6537162971975778
survival_time_median2.5999999999999988
deviation-center-line_median0.14884708769804722
in-drivable-lane_median0.549999999999998


other stats
agent_compute-ego_max0.02712122293619009
agent_compute-ego_mean0.02567292387442466
agent_compute-ego_median0.025925129652023315
agent_compute-ego_min0.023904746228998356
deviation-center-line_max0.5141120095458045
deviation-center-line_mean0.17690002270053232
deviation-center-line_min0.06216029860587694
deviation-heading_max1.992943725008188
deviation-heading_mean0.6929778233956081
deviation-heading_median0.4928440244444201
deviation-heading_min0.24234723632033853
driven_any_max3.534324402241835
driven_any_mean1.3470385992234173
driven_any_median1.001633421251193
driven_any_min0.3412551960104244
driven_lanedir_consec_max2.4943080534418787
driven_lanedir_consec_mean0.8813910855277101
driven_lanedir_consec_min0.3199180625488627
driven_lanedir_max2.4943080534418787
driven_lanedir_mean0.8962528018383177
driven_lanedir_median0.7206363324756618
driven_lanedir_min0.3199180625488627
in-drivable-lane_max3.549999999999991
in-drivable-lane_mean0.839999999999998
in-drivable-lane_min0
per-episodes
details{"udem1-0-0": {"driven_any": 1.5811782993597916, "sim_physics": 0.2328994545755507, "survival_time": 3.949999999999994, "driven_lanedir": 0.9217908232230632, "sim_render-ego": 0.014934856680375112, "in-drivable-lane": 1.3499999999999952, "agent_compute-ego": 0.026225926000860673, "deviation-heading": 0.5694288623982039, "set_robot_commands": 0.01020592979238003, "deviation-center-line": 0.2348196785686717, "driven_lanedir_consec": 0.9213701538661684, "sim_compute_sim_state": 0.005902284308324886, "sim_compute_performance-ego": 0.008611437640612639, "sim_compute_robot_state-ego": 0.010515729083290582, "sim_compute_robot_state-npc0": 0.009581086001818694, "sim_compute_robot_state-npc1": 0.010068154033226305, "sim_compute_robot_state-npc2": 0.009340657463556603, "sim_compute_robot_state-npc3": 0.009533221208596532}, "udem1-1-0": {"driven_any": 0.47798123795353264, "sim_physics": 0.2629835435322353, "survival_time": 1.4000000000000006, "driven_lanedir": 0.4500753586658095, "sim_render-ego": 0.015133976936340332, "in-drivable-lane": 0, "agent_compute-ego": 0.026447747434888567, "deviation-heading": 0.46504862964833654, "set_robot_commands": 0.012180541242871963, "deviation-center-line": 0.09791133281082, "driven_lanedir_consec": 0.4500753586658095, "sim_compute_sim_state": 0.005672855036599296, "sim_compute_performance-ego": 0.00890575987952096, "sim_compute_robot_state-ego": 0.01124554021017892, "sim_compute_robot_state-npc0": 0.010466328689030238, "sim_compute_robot_state-npc1": 0.00943824223109654, "sim_compute_robot_state-npc2": 0.009857032980237688, "sim_compute_robot_state-npc3": 0.00950796263558524}, "udem1-2-0": {"driven_any": 2.1864003300000703, "sim_physics": 0.23646590084705535, "survival_time": 5.14999999999999, "driven_lanedir": 1.8262319453635671, "sim_render-ego": 0.014820027119905044, "in-drivable-lane": 0.549999999999998, "agent_compute-ego": 0.02695831974733223, "deviation-heading": 0.8115272458314912, "set_robot_commands": 0.011989461565480648, "deviation-center-line": 0.19273160416094068, "driven_lanedir_consec": 1.8262319453635671, "sim_compute_sim_state": 0.006121952556869359, "sim_compute_performance-ego": 0.008549190261988963, "sim_compute_robot_state-ego": 0.01094762561390701, "sim_compute_robot_state-npc0": 0.010694848680959164, "sim_compute_robot_state-npc1": 0.010641216074378745, "sim_compute_robot_state-npc2": 0.010373928014514516, "sim_compute_robot_state-npc3": 0.01021000713977999}, "udem1-3-0": {"driven_any": 0.9410513078477728, "sim_physics": 0.24180807173252103, "survival_time": 2.3999999999999995, "driven_lanedir": 0.493517638549009, "sim_render-ego": 0.014787410696347557, "in-drivable-lane": 0.8999999999999988, "agent_compute-ego": 0.025925129652023315, "deviation-heading": 0.35154027506548413, "set_robot_commands": 0.011031533281008402, "deviation-center-line": 0.08975118546699376, "driven_lanedir_consec": 0.493517638549009, "sim_compute_sim_state": 0.0060162196556727094, "sim_compute_performance-ego": 0.008431499203046164, "sim_compute_robot_state-ego": 0.01039770245552063, "sim_compute_robot_state-npc0": 0.009738822778066, "sim_compute_robot_state-npc1": 0.010129541158676147, "sim_compute_robot_state-npc2": 0.009780153632164, "sim_compute_robot_state-npc3": 0.009449556469917296}, "udem1-4-0": {"driven_any": 0.34749292376309954, "sim_physics": 0.27728421347481863, "survival_time": 1.0500000000000005, "driven_lanedir": 0.3325249708009643, "sim_render-ego": 0.014013721829368955, "in-drivable-lane": 0, "agent_compute-ego": 0.024386065346854075, "deviation-heading": 0.30044835691402494, "set_robot_commands": 0.011720623288835798, "deviation-center-line": 0.06216029860587694, "driven_lanedir_consec": 0.3325249708009643, "sim_compute_sim_state": 0.005716959635416667, "sim_compute_performance-ego": 0.00819948741367885, "sim_compute_robot_state-ego": 0.011407352629162017, "sim_compute_robot_state-npc0": 0.009531543368384953, "sim_compute_robot_state-npc1": 0.00906054178873698, "sim_compute_robot_state-npc2": 0.009396428153628397, "sim_compute_robot_state-npc3": 0.009583246140252976}, "udem1-5-0": {"driven_any": 3.534324402241835, "sim_physics": 0.22148943375684543, "survival_time": 8.349999999999984, "driven_lanedir": 2.4943080534418787, "sim_render-ego": 0.01311654816130678, "in-drivable-lane": 2, "agent_compute-ego": 0.024105116278825407, "deviation-heading": 1.992943725008188, "set_robot_commands": 0.010912669632963078, "deviation-center-line": 0.5141120095458045, "driven_lanedir_consec": 2.4943080534418787, "sim_compute_sim_state": 0.005488718341210645, "sim_compute_performance-ego": 0.007829887424400467, "sim_compute_robot_state-ego": 0.009856413938328175, "sim_compute_robot_state-npc0": 0.009554381855947529, "sim_compute_robot_state-npc1": 0.009173675925431852, "sim_compute_robot_state-npc2": 0.009303871029151414, "sim_compute_robot_state-npc3": 0.00910873470192184}, "udem1-6-0": {"driven_any": 2.1760405509894407, "sim_physics": 0.25625881870973455, "survival_time": 5.14999999999999, "driven_lanedir": 1.9748003483573369, "sim_render-ego": 0.014632734280188108, "in-drivable-lane": 0.29999999999999893, "agent_compute-ego": 0.02636923836272897, "deviation-heading": 0.7877172510198454, "set_robot_commands": 0.011428059883488035, "deviation-center-line": 0.30661477465861414, "driven_lanedir_consec": 1.9748003483573369, "sim_compute_sim_state": 0.005671545139794211, "sim_compute_performance-ego": 0.008561659785150324, "sim_compute_robot_state-ego": 0.0106073814688377, "sim_compute_robot_state-npc0": 0.009625476540871036, "sim_compute_robot_state-npc1": 0.010160473943914025, "sim_compute_robot_state-npc2": 0.009477821368615604, "sim_compute_robot_state-npc3": 0.009778617655189292}, "udem1-7-0": {"driven_any": 1.0050236108346402, "sim_physics": 0.29737703800201415, "survival_time": 2.499999999999999, "driven_lanedir": 0.8701796426684152, "sim_render-ego": 0.014347786903381348, "in-drivable-lane": 0, "agent_compute-ego": 0.02675278663635254, "deviation-heading": 0.9227446658975218, "set_robot_commands": 0.01146270751953125, "deviation-center-line": 0.14884708769804722, "driven_lanedir_consec": 0.8546116490381102, "sim_compute_sim_state": 0.005896916389465332, "sim_compute_performance-ego": 0.008430290222167968, "sim_compute_robot_state-ego": 0.011347970962524411, "sim_compute_robot_state-npc0": 0.010518455505371092, "sim_compute_robot_state-npc1": 0.010101070404052734, "sim_compute_robot_state-npc2": 0.010314731597900391, "sim_compute_robot_state-npc3": 0.0099973726272583}, "udem1-8-0": {"driven_any": 0.997041660301958, "sim_physics": 0.2295065109546368, "survival_time": 2.5999999999999988, "driven_lanedir": 0.8041152574540316, "sim_render-ego": 0.014399780676915096, "in-drivable-lane": 0.29999999999999893, "agent_compute-ego": 0.026173761257758502, "deviation-heading": 0.6817155913229234, "set_robot_commands": 0.011401346096625697, "deviation-center-line": 0.1898768080806288, "driven_lanedir_consec": 0.8041152574540316, "sim_compute_sim_state": 0.006008409536801851, "sim_compute_performance-ego": 0.008320890940152682, "sim_compute_robot_state-ego": 0.010824446494762717, "sim_compute_robot_state-npc0": 0.009853794024540828, "sim_compute_robot_state-npc1": 0.00946561648295476, "sim_compute_robot_state-npc2": 0.009812565950246958, "sim_compute_robot_state-npc3": 0.009861822311694805}, "udem1-9-0": {"driven_any": 0.43749987104723, "sim_physics": 0.2944037180680495, "survival_time": 1.3000000000000005, "driven_lanedir": 0.4177527119659043, "sim_render-ego": 0.013292578550485464, "in-drivable-lane": 0, "agent_compute-ego": 0.02552198446713961, "deviation-heading": 0.3796137446285097, "set_robot_commands": 0.01054849074437068, "deviation-center-line": 0.08207813392324871, "driven_lanedir_consec": 0.4177527119659043, "sim_compute_sim_state": 0.005536657113295335, "sim_compute_performance-ego": 0.007932525414686937, "sim_compute_robot_state-ego": 0.010242388798640324, "sim_compute_robot_state-npc0": 0.009810264293964092, "sim_compute_robot_state-npc1": 0.009335141915541427, "sim_compute_robot_state-npc2": 0.00933085955106295, "sim_compute_robot_state-npc3": 0.00937194090623122}, "udem1-10-0": {"driven_any": 0.3412551960104244, "sim_physics": 0.2119555581699718, "survival_time": 1.1000000000000003, "driven_lanedir": 0.3199180625488627, "sim_render-ego": 0.013061285018920898, "in-drivable-lane": 0, "agent_compute-ego": 0.023904746228998356, "deviation-heading": 0.3796986873122644, "set_robot_commands": 0.009505651213906029, "deviation-center-line": 0.06276575300040536, "driven_lanedir_consec": 0.3199180625488627, "sim_compute_sim_state": 0.005044655366377397, "sim_compute_performance-ego": 0.006809191270308061, "sim_compute_robot_state-ego": 0.010416746139526367, "sim_compute_robot_state-npc0": 0.009097088466991076, "sim_compute_robot_state-npc1": 0.00818710977380926, "sim_compute_robot_state-npc2": 0.008070523088628595, "sim_compute_robot_state-npc3": 0.008443626490506258}, "udem1-11-0": {"driven_any": 0.9951985237696338, "sim_physics": 0.22678287506103512, "survival_time": 2.499999999999999, "driven_lanedir": 0.7206363324756618, "sim_render-ego": 0.014347190856933596, "in-drivable-lane": 0.549999999999998, "agent_compute-ego": 0.02448599338531494, "deviation-heading": 0.30074636349085415, "set_robot_commands": 0.011234612464904785, "deviation-center-line": 0.16567670185555416, "driven_lanedir_consec": 0.718507549745529, "sim_compute_sim_state": 0.005683860778808594, "sim_compute_performance-ego": 0.008767452239990235, "sim_compute_robot_state-ego": 0.01035959243774414, "sim_compute_robot_state-npc0": 0.01009045124053955, "sim_compute_robot_state-npc1": 0.010083632469177246, "sim_compute_robot_state-npc2": 0.00980984687805176, "sim_compute_robot_state-npc3": 0.010080037117004394}, "udem1-12-0": {"driven_any": 1.9646878702534365, "sim_physics": 0.24706111055739385, "survival_time": 4.699999999999991, "driven_lanedir": 0.35162821871931205, "sim_render-ego": 0.014200050780113709, "in-drivable-lane": 3.549999999999991, "agent_compute-ego": 0.025440837474579505, "deviation-heading": 0.24234723632033853, "set_robot_commands": 0.0114913265755836, "deviation-center-line": 0.13126670634798973, "driven_lanedir_consec": 0.35162821871931205, "sim_compute_sim_state": 0.005405874962502337, "sim_compute_performance-ego": 0.008041772436588369, "sim_compute_robot_state-ego": 0.010279723938475264, "sim_compute_robot_state-npc0": 0.010156347396525931, "sim_compute_robot_state-npc1": 0.009664535522460938, "sim_compute_robot_state-npc2": 0.00944522593883758, "sim_compute_robot_state-npc3": 0.009787435227252068}, "udem1-13-0": {"driven_any": 1.001633421251193, "sim_physics": 0.23025143146514893, "survival_time": 2.5999999999999988, "driven_lanedir": 0.6537162971975778, "sim_render-ego": 0.014790438688718356, "in-drivable-lane": 0.5999999999999979, "agent_compute-ego": 0.02712122293619009, "deviation-heading": 0.4928440244444201, "set_robot_commands": 0.011087454282320462, "deviation-center-line": 0.13361893417935136, "driven_lanedir_consec": 0.6537162971975778, "sim_compute_sim_state": 0.005312131001399114, "sim_compute_performance-ego": 0.008314559092888465, "sim_compute_robot_state-ego": 0.010340933616344746, "sim_compute_robot_state-npc0": 0.00981269432948186, "sim_compute_robot_state-npc1": 0.009989665104792668, "sim_compute_robot_state-npc2": 0.010294749186589168, "sim_compute_robot_state-npc3": 0.009732076754936803}, "udem1-14-0": {"driven_any": 2.218769782727205, "sim_physics": 0.24805805569603329, "survival_time": 5.249999999999989, "driven_lanedir": 0.8125963661433687, "sim_render-ego": 0.014459185373215448, "in-drivable-lane": 2.499999999999993, "agent_compute-ego": 0.025274982906523205, "deviation-heading": 1.7163026916317137, "set_robot_commands": 0.011347618557157973, "deviation-center-line": 0.2412693316050378, "driven_lanedir_consec": 0.6077880672015876, "sim_compute_sim_state": 0.0057108311426071895, "sim_compute_performance-ego": 0.008515203566778274, "sim_compute_robot_state-ego": 0.010552785510108584, "sim_compute_robot_state-npc0": 0.01009461312066941, "sim_compute_robot_state-npc1": 0.009725336801438104, "sim_compute_robot_state-npc2": 0.009828712826683407, "sim_compute_robot_state-npc3": 0.010126411347162157}}
set_robot_commands_max0.012180541242871963
set_robot_commands_mean0.011169868409428563
set_robot_commands_median0.011347618557157973
set_robot_commands_min0.009505651213906029
sim_compute_performance-ego_max0.00890575987952096
sim_compute_performance-ego_mean0.008281387119463956
sim_compute_performance-ego_median0.008430290222167968
sim_compute_performance-ego_min0.006809191270308061
sim_compute_robot_state-ego_max0.011407352629162017
sim_compute_robot_state-ego_mean0.01062282221982344
sim_compute_robot_state-ego_median0.010515729083290582
sim_compute_robot_state-ego_min0.009856413938328175
sim_compute_robot_state-npc0_max0.010694848680959164
sim_compute_robot_state-npc0_mean0.009908413086210764
sim_compute_robot_state-npc0_median0.00981269432948186
sim_compute_robot_state-npc0_min0.009097088466991076
sim_compute_robot_state-npc1_max0.010641216074378745
sim_compute_robot_state-npc1_mean0.009681596908645848
sim_compute_robot_state-npc1_median0.009725336801438104
sim_compute_robot_state-npc1_min0.00818710977380926
sim_compute_robot_state-npc2_max0.010373928014514516
sim_compute_robot_state-npc2_mean0.009629140510657936
sim_compute_robot_state-npc2_median0.009780153632164
sim_compute_robot_state-npc2_min0.008070523088628595
sim_compute_robot_state-npc3_max0.01021000713977999
sim_compute_robot_state-npc3_mean0.009638137915552613
sim_compute_robot_state-npc3_median0.009732076754936803
sim_compute_robot_state-npc3_min0.008443626490506258
sim_compute_sim_state_max0.006121952556869359
sim_compute_sim_state_mean0.005679324731009661
sim_compute_sim_state_median0.005683860778808594
sim_compute_sim_state_min0.005044655366377397
sim_physics_max0.29737703800201415
sim_physics_mean0.2476390489735363
sim_physics_median0.24180807173252103
sim_physics_min0.2119555581699718
sim_render-ego_max0.015133976936340332
sim_render-ego_mean0.014289171503501051
sim_render-ego_median0.014399780676915096
sim_render-ego_min0.013061285018920898
simulation-passed1
survival_time_max8.349999999999984
survival_time_mean3.3333333333333286
survival_time_min1.0500000000000005
No reset possible
248424320Tanli Chou 🇹🇼challenge-aido_LF-template-randomaido3-LFVI-sim-validationstep1-simulationsuccessnoip-172-31-46-148-104900:08:13
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.493517638549009
survival_time_median2.3999999999999995
deviation-center-line_median0.09791133281082
in-drivable-lane_median0.549999999999998


other stats
agent_compute-ego_max0.028331150611241657
agent_compute-ego_mean0.02642854724255065
agent_compute-ego_median0.026523789273032655
agent_compute-ego_min0.025171893314250463
deviation-center-line_max0.2348196785686717
deviation-center-line_mean0.1354748199226606
deviation-center-line_min0.06216029860587694
deviation-heading_max0.8115272458314912
deviation-heading_mean0.49959867397150814
deviation-heading_median0.46504862964833654
deviation-heading_min0.30044835691402494
driven_any_max2.1864003300000703
driven_any_mean1.1068208197848537
driven_any_median0.9410513078477728
driven_any_min0.34749292376309954
driven_lanedir_consec_max1.8262319453635671
driven_lanedir_consec_mean0.8047440134491037
driven_lanedir_consec_min0.3325249708009643
driven_lanedir_max1.8262319453635671
driven_lanedir_mean0.8048281473204828
driven_lanedir_median0.493517638549009
driven_lanedir_min0.3325249708009643
in-drivable-lane_max1.3499999999999952
in-drivable-lane_mean0.5599999999999984
in-drivable-lane_min0
per-episodes
details{"udem1-0-0": {"driven_any": 1.5811782993597916, "sim_physics": 0.22825751727140403, "survival_time": 3.949999999999994, "driven_lanedir": 0.9217908232230632, "sim_render-ego": 0.014147236377378051, "in-drivable-lane": 1.3499999999999952, "agent_compute-ego": 0.026523789273032655, "deviation-heading": 0.5694288623982039, "set_robot_commands": 0.010944982118244411, "deviation-center-line": 0.2348196785686717, "driven_lanedir_consec": 0.9213701538661684, "sim_compute_sim_state": 0.005569065673441826, "sim_compute_performance-ego": 0.008051153979723967, "sim_compute_robot_state-ego": 0.01040825964529303, "sim_compute_robot_state-npc0": 0.009780802304231668, "sim_compute_robot_state-npc1": 0.00945416583290583, "sim_compute_robot_state-npc2": 0.00970839850510223, "sim_compute_robot_state-npc3": 0.009522981281521957}, "udem1-1-0": {"driven_any": 0.47798123795353264, "sim_physics": 0.2224755883216858, "survival_time": 1.4000000000000006, "driven_lanedir": 0.4500753586658095, "sim_render-ego": 0.015454999038151332, "in-drivable-lane": 0, "agent_compute-ego": 0.02550807169505528, "deviation-heading": 0.46504862964833654, "set_robot_commands": 0.01041030032294137, "deviation-center-line": 0.09791133281082, "driven_lanedir_consec": 0.4500753586658095, "sim_compute_sim_state": 0.006029248237609863, "sim_compute_performance-ego": 0.008276173046657018, "sim_compute_robot_state-ego": 0.010429518563406808, "sim_compute_robot_state-npc0": 0.009739492620740618, "sim_compute_robot_state-npc1": 0.009725519589015416, "sim_compute_robot_state-npc2": 0.010187992027827672, "sim_compute_robot_state-npc3": 0.009580893175942556}, "udem1-2-0": {"driven_any": 2.1864003300000703, "sim_physics": 0.20651160629050244, "survival_time": 5.14999999999999, "driven_lanedir": 1.8262319453635671, "sim_render-ego": 0.014397352644540732, "in-drivable-lane": 0.549999999999998, "agent_compute-ego": 0.025171893314250463, "deviation-heading": 0.8115272458314912, "set_robot_commands": 0.010185107444096538, "deviation-center-line": 0.19273160416094068, "driven_lanedir_consec": 1.8262319453635671, "sim_compute_sim_state": 0.00562989827498649, "sim_compute_performance-ego": 0.00791880690935746, "sim_compute_robot_state-ego": 0.010128363822270366, "sim_compute_robot_state-npc0": 0.009819220570684637, "sim_compute_robot_state-npc1": 0.009454245706206389, "sim_compute_robot_state-npc2": 0.009221796850556309, "sim_compute_robot_state-npc3": 0.009590352623208056}, "udem1-3-0": {"driven_any": 0.9410513078477728, "sim_physics": 0.2854232043027878, "survival_time": 2.3999999999999995, "driven_lanedir": 0.493517638549009, "sim_render-ego": 0.014916335542996723, "in-drivable-lane": 0.8999999999999988, "agent_compute-ego": 0.028331150611241657, "deviation-heading": 0.35154027506548413, "set_robot_commands": 0.011922587951024374, "deviation-center-line": 0.08975118546699376, "driven_lanedir_consec": 0.493517638549009, "sim_compute_sim_state": 0.0056145936250686646, "sim_compute_performance-ego": 0.008656427264213562, "sim_compute_robot_state-ego": 0.011375372608502706, "sim_compute_robot_state-npc0": 0.010520060857137045, "sim_compute_robot_state-npc1": 0.0105073352654775, "sim_compute_robot_state-npc2": 0.010156149665514628, "sim_compute_robot_state-npc3": 0.010190889239311218}, "udem1-4-0": {"driven_any": 0.34749292376309954, "sim_physics": 0.22955909229460217, "survival_time": 1.0500000000000005, "driven_lanedir": 0.3325249708009643, "sim_render-ego": 0.015505745297386532, "in-drivable-lane": 0, "agent_compute-ego": 0.026607831319173176, "deviation-heading": 0.30044835691402494, "set_robot_commands": 0.011854455584571474, "deviation-center-line": 0.06216029860587694, "driven_lanedir_consec": 0.3325249708009643, "sim_compute_sim_state": 0.006099201384044829, "sim_compute_performance-ego": 0.00844905489966983, "sim_compute_robot_state-ego": 0.01029735519772484, "sim_compute_robot_state-npc0": 0.010483378455752418, "sim_compute_robot_state-npc1": 0.010082074574061803, "sim_compute_robot_state-npc2": 0.010187137694585891, "sim_compute_robot_state-npc3": 0.01045991125560942}}
set_robot_commands_max0.011922587951024374
set_robot_commands_mean0.011063486684175634
set_robot_commands_median0.010944982118244411
set_robot_commands_min0.010185107444096538
sim_compute_performance-ego_max0.008656427264213562
sim_compute_performance-ego_mean0.008270323219924366
sim_compute_performance-ego_median0.008276173046657018
sim_compute_performance-ego_min0.00791880690935746
sim_compute_robot_state-ego_max0.011375372608502706
sim_compute_robot_state-ego_mean0.01052777396743955
sim_compute_robot_state-ego_median0.01040825964529303
sim_compute_robot_state-ego_min0.010128363822270366
sim_compute_robot_state-npc0_max0.010520060857137045
sim_compute_robot_state-npc0_mean0.010068590961709275
sim_compute_robot_state-npc0_median0.009819220570684637
sim_compute_robot_state-npc0_min0.009739492620740618
sim_compute_robot_state-npc1_max0.0105073352654775
sim_compute_robot_state-npc1_mean0.009844668193533388
sim_compute_robot_state-npc1_median0.009725519589015416
sim_compute_robot_state-npc1_min0.00945416583290583
sim_compute_robot_state-npc2_max0.010187992027827672
sim_compute_robot_state-npc2_mean0.009892294948717344
sim_compute_robot_state-npc2_median0.010156149665514628
sim_compute_robot_state-npc2_min0.009221796850556309
sim_compute_robot_state-npc3_max0.01045991125560942
sim_compute_robot_state-npc3_mean0.009869005515118642
sim_compute_robot_state-npc3_median0.009590352623208056
sim_compute_robot_state-npc3_min0.009522981281521957
sim_compute_sim_state_max0.006099201384044829
sim_compute_sim_state_mean0.005788401439030334
sim_compute_sim_state_median0.00562989827498649
sim_compute_sim_state_min0.005569065673441826
sim_physics_max0.2854232043027878
sim_physics_mean0.2344454016961965
sim_physics_median0.22825751727140403
sim_physics_min0.20651160629050244
sim_render-ego_max0.015505745297386532
sim_render-ego_mean0.014884333780090676
sim_render-ego_median0.014916335542996723
sim_render-ego_min0.014147236377378051
simulation-passed1
survival_time_max5.14999999999999
survival_time_mean2.789999999999997
survival_time_min1.0500000000000005
No reset possible
248334335Soroush Saryazdi 🇨🇦challenge-aido_LF-template-randomaido3-LFVI-sim-validationstep1-simulationsuccessnoip-172-31-46-148-104900:08:22
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.493517638549009
survival_time_median2.3999999999999995
deviation-center-line_median0.09791133281082
in-drivable-lane_median0.549999999999998


other stats
agent_compute-ego_max0.026669196712160573
agent_compute-ego_mean0.025736697792300194
agent_compute-ego_median0.02563553520395786
agent_compute-ego_min0.024877741223289857
deviation-center-line_max0.2348196785686717
deviation-center-line_mean0.1354748199226606
deviation-center-line_min0.06216029860587694
deviation-heading_max0.8115272458314912
deviation-heading_mean0.49959867397150814
deviation-heading_median0.46504862964833654
deviation-heading_min0.30044835691402494
driven_any_max2.1864003300000703
driven_any_mean1.1068208197848537
driven_any_median0.9410513078477728
driven_any_min0.34749292376309954
driven_lanedir_consec_max1.8262319453635671
driven_lanedir_consec_mean0.8047440134491037
driven_lanedir_consec_min0.3325249708009643
driven_lanedir_max1.8262319453635671
driven_lanedir_mean0.8048281473204828
driven_lanedir_median0.493517638549009
driven_lanedir_min0.3325249708009643
in-drivable-lane_max1.3499999999999952
in-drivable-lane_mean0.5599999999999984
in-drivable-lane_min0
per-episodes
details{"udem1-0-0": {"driven_any": 1.5811782993597916, "sim_physics": 0.20988182478313205, "survival_time": 3.949999999999994, "driven_lanedir": 0.9217908232230632, "sim_render-ego": 0.0139176966268805, "in-drivable-lane": 1.3499999999999952, "agent_compute-ego": 0.02563553520395786, "deviation-heading": 0.5694288623982039, "set_robot_commands": 0.010022269019597694, "deviation-center-line": 0.2348196785686717, "driven_lanedir_consec": 0.9213701538661684, "sim_compute_sim_state": 0.00534815727909909, "sim_compute_performance-ego": 0.008082247987578187, "sim_compute_robot_state-ego": 0.01011059254030638, "sim_compute_robot_state-npc0": 0.008991262580775008, "sim_compute_robot_state-npc1": 0.008687263802637029, "sim_compute_robot_state-npc2": 0.008631166023544119, "sim_compute_robot_state-npc3": 0.009008721460269976}, "udem1-1-0": {"driven_any": 0.47798123795353264, "sim_physics": 0.2061114481517247, "survival_time": 1.4000000000000006, "driven_lanedir": 0.4500753586658095, "sim_render-ego": 0.013214383806501116, "in-drivable-lane": 0, "agent_compute-ego": 0.02490156888961792, "deviation-heading": 0.46504862964833654, "set_robot_commands": 0.010292300156184606, "deviation-center-line": 0.09791133281082, "driven_lanedir_consec": 0.4500753586658095, "sim_compute_sim_state": 0.005271409239087786, "sim_compute_performance-ego": 0.007533396993364606, "sim_compute_robot_state-ego": 0.009614297321864538, "sim_compute_robot_state-npc0": 0.009283074310847692, "sim_compute_robot_state-npc1": 0.009091028145381383, "sim_compute_robot_state-npc2": 0.008627031530652727, "sim_compute_robot_state-npc3": 0.00848846776144845}, "udem1-2-0": {"driven_any": 2.1864003300000703, "sim_physics": 0.2440896798106073, "survival_time": 5.14999999999999, "driven_lanedir": 1.8262319453635671, "sim_render-ego": 0.01495725668749763, "in-drivable-lane": 0.549999999999998, "agent_compute-ego": 0.026669196712160573, "deviation-heading": 0.8115272458314912, "set_robot_commands": 0.01155030843123649, "deviation-center-line": 0.19273160416094068, "driven_lanedir_consec": 1.8262319453635671, "sim_compute_sim_state": 0.005848444781257111, "sim_compute_performance-ego": 0.008418439661414878, "sim_compute_robot_state-ego": 0.011344955962838478, "sim_compute_robot_state-npc0": 0.010735701588751045, "sim_compute_robot_state-npc1": 0.010849830016349126, "sim_compute_robot_state-npc2": 0.010094385702633164, "sim_compute_robot_state-npc3": 0.010290828723351932}, "udem1-3-0": {"driven_any": 0.9410513078477728, "sim_physics": 0.29107477764288586, "survival_time": 2.3999999999999995, "driven_lanedir": 0.493517638549009, "sim_render-ego": 0.014649281899134316, "in-drivable-lane": 0.8999999999999988, "agent_compute-ego": 0.026599446932474773, "deviation-heading": 0.35154027506548413, "set_robot_commands": 0.012152870496114096, "deviation-center-line": 0.08975118546699376, "driven_lanedir_consec": 0.493517638549009, "sim_compute_sim_state": 0.005589693784713745, "sim_compute_performance-ego": 0.008362213770548502, "sim_compute_robot_state-ego": 0.01179508368174235, "sim_compute_robot_state-npc0": 0.009957810242970783, "sim_compute_robot_state-npc1": 0.010677600900332132, "sim_compute_robot_state-npc2": 0.010012616713841757, "sim_compute_robot_state-npc3": 0.010129461685816446}, "udem1-4-0": {"driven_any": 0.34749292376309954, "sim_physics": 0.23122180075872512, "survival_time": 1.0500000000000005, "driven_lanedir": 0.3325249708009643, "sim_render-ego": 0.014258555003574916, "in-drivable-lane": 0, "agent_compute-ego": 0.024877741223289857, "deviation-heading": 0.30044835691402494, "set_robot_commands": 0.010633196149553572, "deviation-center-line": 0.06216029860587694, "driven_lanedir_consec": 0.3325249708009643, "sim_compute_sim_state": 0.005206618990216937, "sim_compute_performance-ego": 0.008051338649931409, "sim_compute_robot_state-ego": 0.012179635819934665, "sim_compute_robot_state-npc0": 0.010307346071515764, "sim_compute_robot_state-npc1": 0.008482240495227632, "sim_compute_robot_state-npc2": 0.008813869385492234, "sim_compute_robot_state-npc3": 0.008940696716308594}}
set_robot_commands_max0.012152870496114096
set_robot_commands_mean0.010930188850537292
set_robot_commands_median0.010633196149553572
set_robot_commands_min0.010022269019597694
sim_compute_performance-ego_max0.008418439661414878
sim_compute_performance-ego_mean0.008089527412567516
sim_compute_performance-ego_median0.008082247987578187
sim_compute_performance-ego_min0.007533396993364606
sim_compute_robot_state-ego_max0.012179635819934665
sim_compute_robot_state-ego_mean0.011008913065337285
sim_compute_robot_state-ego_median0.011344955962838478
sim_compute_robot_state-ego_min0.009614297321864538
sim_compute_robot_state-npc0_max0.010735701588751045
sim_compute_robot_state-npc0_mean0.00985503895897206
sim_compute_robot_state-npc0_median0.009957810242970783
sim_compute_robot_state-npc0_min0.008991262580775008
sim_compute_robot_state-npc1_max0.010849830016349126
sim_compute_robot_state-npc1_mean0.00955759267198546
sim_compute_robot_state-npc1_median0.009091028145381383
sim_compute_robot_state-npc1_min0.008482240495227632
sim_compute_robot_state-npc2_max0.010094385702633164
sim_compute_robot_state-npc2_mean0.0092358138712328
sim_compute_robot_state-npc2_median0.008813869385492234
sim_compute_robot_state-npc2_min0.008627031530652727
sim_compute_robot_state-npc3_max0.010290828723351932
sim_compute_robot_state-npc3_mean0.00937163526943908
sim_compute_robot_state-npc3_median0.009008721460269976
sim_compute_robot_state-npc3_min0.00848846776144845
sim_compute_sim_state_max0.005848444781257111
sim_compute_sim_state_mean0.005452864814874934
sim_compute_sim_state_median0.00534815727909909
sim_compute_sim_state_min0.005206618990216937
sim_physics_max0.29107477764288586
sim_physics_mean0.23647590622941503
sim_physics_median0.23122180075872512
sim_physics_min0.2061114481517247
sim_render-ego_max0.01495725668749763
sim_render-ego_mean0.014199434804717696
sim_render-ego_median0.014258555003574916
sim_render-ego_min0.013214383806501116
simulation-passed1
survival_time_max5.14999999999999
survival_time_mean2.789999999999997
survival_time_min1.0500000000000005
No reset possible
248214339Soroush Saryazdi 🇨🇦challenge-aido_LF-baseline-duckietownaido3-LF-sim-validationstep1-simulationerrornoip-172-31-46-148-104900:05:50
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
248014343Soroush Saryazdi 🇨🇦challenge-aido_LF-baseline-duckietownaido3-LFVI-sim-testingstep1-simulationerrornoip-172-31-46-148-104900:26:44
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
247974336Gianmarco Bernasconibaseline-IL-sim-tensorflowaido3-LF-sim-validationstep1-simulationerrornoip-172-31-46-148-104900:03:26
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
247964334Soroush Saryazdi 🇨🇦challenge-aido_LF-template-randomaido3-LFVI-sim-testingstep1-simulationsuccessnoip-172-31-46-148-104900:18:03
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.6537162971975778
survival_time_median2.5999999999999988
deviation-center-line_median0.14884708769804722
in-drivable-lane_median0.549999999999998


other stats
agent_compute-ego_max0.025795539220174152
agent_compute-ego_mean0.019879260974675836
agent_compute-ego_median0.020511651039123537
agent_compute-ego_min0.013542299087230977
deviation-center-line_max0.5141120095458045
deviation-center-line_mean0.17690002270053232
deviation-center-line_min0.06216029860587694
deviation-heading_max1.992943725008188
deviation-heading_mean0.6929778233956081
deviation-heading_median0.4928440244444201
deviation-heading_min0.24234723632033853
driven_any_max3.534324402241835
driven_any_mean1.3470385992234173
driven_any_median1.001633421251193
driven_any_min0.3412551960104244
driven_lanedir_consec_max2.4943080534418787
driven_lanedir_consec_mean0.8813910855277101
driven_lanedir_consec_min0.3199180625488627
driven_lanedir_max2.4943080534418787
driven_lanedir_mean0.8962528018383177
driven_lanedir_median0.7206363324756618
driven_lanedir_min0.3199180625488627
in-drivable-lane_max3.549999999999991
in-drivable-lane_mean0.839999999999998
in-drivable-lane_min0
per-episodes
details{"udem1-0-0": {"driven_any": 1.5811782993597916, "sim_physics": 0.20847417131254944, "survival_time": 3.949999999999994, "driven_lanedir": 0.9217908232230632, "sim_render-ego": 0.013457932049715066, "in-drivable-lane": 1.3499999999999952, "agent_compute-ego": 0.025785521615909624, "deviation-heading": 0.5694288623982039, "set_robot_commands": 0.00884787644012065, "deviation-center-line": 0.2348196785686717, "driven_lanedir_consec": 0.9213701538661684, "sim_compute_sim_state": 0.005314265625386299, "sim_compute_performance-ego": 0.007515831838680219, "sim_compute_robot_state-ego": 0.00938637648956685, "sim_compute_robot_state-npc0": 0.008936239194266404, "sim_compute_robot_state-npc1": 0.009043358549287048, "sim_compute_robot_state-npc2": 0.008879214902467366, "sim_compute_robot_state-npc3": 0.00858369356469263}, "udem1-1-0": {"driven_any": 0.47798123795353264, "sim_physics": 0.1739244290760585, "survival_time": 1.4000000000000006, "driven_lanedir": 0.4500753586658095, "sim_render-ego": 0.01232053552355085, "in-drivable-lane": 0, "agent_compute-ego": 0.024767134870801653, "deviation-heading": 0.46504862964833654, "set_robot_commands": 0.009094817297799249, "deviation-center-line": 0.09791133281082, "driven_lanedir_consec": 0.4500753586658095, "sim_compute_sim_state": 0.005007198878696987, "sim_compute_performance-ego": 0.006744597639356341, "sim_compute_robot_state-ego": 0.008799024990626745, "sim_compute_robot_state-npc0": 0.00836827073778425, "sim_compute_robot_state-npc1": 0.008127204009464808, "sim_compute_robot_state-npc2": 0.00789400509425572, "sim_compute_robot_state-npc3": 0.007977477141789027}, "udem1-2-0": {"driven_any": 2.1864003300000703, "sim_physics": 0.2036408915103061, "survival_time": 5.14999999999999, "driven_lanedir": 1.8262319453635671, "sim_render-ego": 0.011931961022534417, "in-drivable-lane": 0.549999999999998, "agent_compute-ego": 0.024125902398118695, "deviation-heading": 0.8115272458314912, "set_robot_commands": 0.008739878830400486, "deviation-center-line": 0.19273160416094068, "driven_lanedir_consec": 1.8262319453635671, "sim_compute_sim_state": 0.005037812353337853, "sim_compute_performance-ego": 0.006749086009645925, "sim_compute_robot_state-ego": 0.009118519940422575, "sim_compute_robot_state-npc0": 0.008503214826861632, "sim_compute_robot_state-npc1": 0.008263599525377589, "sim_compute_robot_state-npc2": 0.008008202302803113, "sim_compute_robot_state-npc3": 0.00801715341586511}, "udem1-3-0": {"driven_any": 0.9410513078477728, "sim_physics": 0.1643239160378774, "survival_time": 2.3999999999999995, "driven_lanedir": 0.493517638549009, "sim_render-ego": 0.011052737633387247, "in-drivable-lane": 0.8999999999999988, "agent_compute-ego": 0.02044547100861867, "deviation-heading": 0.35154027506548413, "set_robot_commands": 0.007564345995585124, "deviation-center-line": 0.08975118546699376, "driven_lanedir_consec": 0.493517638549009, "sim_compute_sim_state": 0.004416416088740031, "sim_compute_performance-ego": 0.005904947717984517, "sim_compute_robot_state-ego": 0.00792992115020752, "sim_compute_robot_state-npc0": 0.007367293039957683, "sim_compute_robot_state-npc1": 0.00706656277179718, "sim_compute_robot_state-npc2": 0.006954297423362732, "sim_compute_robot_state-npc3": 0.006941244006156921}, "udem1-4-0": {"driven_any": 0.34749292376309954, "sim_physics": 0.2079759438832601, "survival_time": 1.0500000000000005, "driven_lanedir": 0.3325249708009643, "sim_render-ego": 0.012930427278791156, "in-drivable-lane": 0, "agent_compute-ego": 0.025795539220174152, "deviation-heading": 0.30044835691402494, "set_robot_commands": 0.009482372374761672, "deviation-center-line": 0.06216029860587694, "driven_lanedir_consec": 0.3325249708009643, "sim_compute_sim_state": 0.00506856327965146, "sim_compute_performance-ego": 0.007906868344261533, "sim_compute_robot_state-ego": 0.009453887031191871, "sim_compute_robot_state-npc0": 0.009048268908546084, "sim_compute_robot_state-npc1": 0.008166801361810593, "sim_compute_robot_state-npc2": 0.007512399128505162, "sim_compute_robot_state-npc3": 0.0077177683512369795}, "udem1-5-0": {"driven_any": 3.534324402241835, "sim_physics": 0.1787804857699457, "survival_time": 8.349999999999984, "driven_lanedir": 2.4943080534418787, "sim_render-ego": 0.012123865995578425, "in-drivable-lane": 2, "agent_compute-ego": 0.0222145597377937, "deviation-heading": 1.992943725008188, "set_robot_commands": 0.008489116223272449, "deviation-center-line": 0.5141120095458045, "driven_lanedir_consec": 2.4943080534418787, "sim_compute_sim_state": 0.004912719041287542, "sim_compute_performance-ego": 0.0067428214821272986, "sim_compute_robot_state-ego": 0.008993498579470698, "sim_compute_robot_state-npc0": 0.00840767414983875, "sim_compute_robot_state-npc1": 0.007857701021754098, "sim_compute_robot_state-npc2": 0.007716547229332838, "sim_compute_robot_state-npc3": 0.008080870805386298}, "udem1-6-0": {"driven_any": 2.1760405509894407, "sim_physics": 0.16973702652940473, "survival_time": 5.14999999999999, "driven_lanedir": 1.9748003483573369, "sim_render-ego": 0.011052515900250776, "in-drivable-lane": 0.29999999999999893, "agent_compute-ego": 0.02135211287192928, "deviation-heading": 0.7877172510198454, "set_robot_commands": 0.0072481794264710065, "deviation-center-line": 0.30661477465861414, "driven_lanedir_consec": 1.9748003483573369, "sim_compute_sim_state": 0.004517006642610124, "sim_compute_performance-ego": 0.0062288288931244785, "sim_compute_robot_state-ego": 0.007775179390768403, "sim_compute_robot_state-npc0": 0.007495861609005234, "sim_compute_robot_state-npc1": 0.007311971442213336, "sim_compute_robot_state-npc2": 0.007114084021559039, "sim_compute_robot_state-npc3": 0.007099609930538437}, "udem1-7-0": {"driven_any": 1.0050236108346402, "sim_physics": 0.1791413927078247, "survival_time": 2.499999999999999, "driven_lanedir": 0.8701796426684152, "sim_render-ego": 0.011415753364562988, "in-drivable-lane": 0, "agent_compute-ego": 0.020511651039123537, "deviation-heading": 0.9227446658975218, "set_robot_commands": 0.0075095748901367184, "deviation-center-line": 0.14884708769804722, "driven_lanedir_consec": 0.8546116490381102, "sim_compute_sim_state": 0.004534025192260743, "sim_compute_performance-ego": 0.006457734107971192, "sim_compute_robot_state-ego": 0.008374729156494141, "sim_compute_robot_state-npc0": 0.007232513427734375, "sim_compute_robot_state-npc1": 0.006880793571472168, "sim_compute_robot_state-npc2": 0.006716256141662598, "sim_compute_robot_state-npc3": 0.007249746322631836}, "udem1-8-0": {"driven_any": 0.997041660301958, "sim_physics": 0.12245162633749154, "survival_time": 2.5999999999999988, "driven_lanedir": 0.8041152574540316, "sim_render-ego": 0.009026596179375282, "in-drivable-lane": 0.29999999999999893, "agent_compute-ego": 0.01780017064167903, "deviation-heading": 0.6817155913229234, "set_robot_commands": 0.00646435755949754, "deviation-center-line": 0.1898768080806288, "driven_lanedir_consec": 0.8041152574540316, "sim_compute_sim_state": 0.003558777845822848, "sim_compute_performance-ego": 0.004959615377279429, "sim_compute_robot_state-ego": 0.006350531027867244, "sim_compute_robot_state-npc0": 0.006045717459458571, "sim_compute_robot_state-npc1": 0.005778693235837496, "sim_compute_robot_state-npc2": 0.005786460179548997, "sim_compute_robot_state-npc3": 0.0057980051407447225}, "udem1-9-0": {"driven_any": 0.43749987104723, "sim_physics": 0.13210483697744516, "survival_time": 1.3000000000000005, "driven_lanedir": 0.4177527119659043, "sim_render-ego": 0.00830986866584191, "in-drivable-lane": 0, "agent_compute-ego": 0.015418364451481746, "deviation-heading": 0.3796137446285097, "set_robot_commands": 0.005902226154620831, "deviation-center-line": 0.08207813392324871, "driven_lanedir_consec": 0.4177527119659043, "sim_compute_sim_state": 0.003091894663297213, "sim_compute_performance-ego": 0.00424662003150353, "sim_compute_robot_state-ego": 0.0057240449465238135, "sim_compute_robot_state-npc0": 0.0053511857986450195, "sim_compute_robot_state-npc1": 0.005074317638690655, "sim_compute_robot_state-npc2": 0.005053795300997221, "sim_compute_robot_state-npc3": 0.005003644869877742}, "udem1-10-0": {"driven_any": 0.3412551960104244, "sim_physics": 0.14795682647011496, "survival_time": 1.1000000000000003, "driven_lanedir": 0.3199180625488627, "sim_render-ego": 0.010904810645363548, "in-drivable-lane": 0, "agent_compute-ego": 0.020553502169522373, "deviation-heading": 0.3796986873122644, "set_robot_commands": 0.008160721171985973, "deviation-center-line": 0.06276575300040536, "driven_lanedir_consec": 0.3199180625488627, "sim_compute_sim_state": 0.003804889592257413, "sim_compute_performance-ego": 0.005723433061079545, "sim_compute_robot_state-ego": 0.007536497983065518, "sim_compute_robot_state-npc0": 0.006875731728293679, "sim_compute_robot_state-npc1": 0.006638841195539994, "sim_compute_robot_state-npc2": 0.006716403094204989, "sim_compute_robot_state-npc3": 0.0067910931327126245}, "udem1-11-0": {"driven_any": 0.9951985237696338, "sim_physics": 0.10443029403686524, "survival_time": 2.499999999999999, "driven_lanedir": 0.7206363324756618, "sim_render-ego": 0.008278284072875976, "in-drivable-lane": 0.549999999999998, "agent_compute-ego": 0.015648732185363768, "deviation-heading": 0.30074636349085415, "set_robot_commands": 0.005828948020935059, "deviation-center-line": 0.16567670185555416, "driven_lanedir_consec": 0.718507549745529, "sim_compute_sim_state": 0.0034515523910522462, "sim_compute_performance-ego": 0.004476838111877442, "sim_compute_robot_state-ego": 0.0061119508743286135, "sim_compute_robot_state-npc0": 0.00540776252746582, "sim_compute_robot_state-npc1": 0.005330266952514648, "sim_compute_robot_state-npc2": 0.005293045043945312, "sim_compute_robot_state-npc3": 0.00538093090057373}, "udem1-12-0": {"driven_any": 1.9646878702534365, "sim_physics": 0.11039307523281015, "survival_time": 4.699999999999991, "driven_lanedir": 0.35162821871931205, "sim_render-ego": 0.008618714961599796, "in-drivable-lane": 3.549999999999991, "agent_compute-ego": 0.016647678740481113, "deviation-heading": 0.24234723632033853, "set_robot_commands": 0.005799925073664239, "deviation-center-line": 0.13126670634798973, "driven_lanedir_consec": 0.35162821871931205, "sim_compute_sim_state": 0.003474390253107598, "sim_compute_performance-ego": 0.004713380590398261, "sim_compute_robot_state-ego": 0.006149423883316365, "sim_compute_robot_state-npc0": 0.005651370007941064, "sim_compute_robot_state-npc1": 0.0055569486415132565, "sim_compute_robot_state-npc2": 0.005501795322337049, "sim_compute_robot_state-npc3": 0.005475886324618725}, "udem1-13-0": {"driven_any": 1.001633421251193, "sim_physics": 0.08963054877061111, "survival_time": 2.5999999999999988, "driven_lanedir": 0.6537162971975778, "sim_render-ego": 0.006859504259549654, "in-drivable-lane": 0.5999999999999979, "agent_compute-ego": 0.013542299087230977, "deviation-heading": 0.4928440244444201, "set_robot_commands": 0.004180014133453369, "deviation-center-line": 0.13361893417935136, "driven_lanedir_consec": 0.6537162971975778, "sim_compute_sim_state": 0.00264585935152494, "sim_compute_performance-ego": 0.003606567016014686, "sim_compute_robot_state-ego": 0.004673160039461576, "sim_compute_robot_state-npc0": 0.004323028601132906, "sim_compute_robot_state-npc1": 0.004203947690817026, "sim_compute_robot_state-npc2": 0.004191430715414194, "sim_compute_robot_state-npc3": 0.00419689600284283}, "udem1-14-0": {"driven_any": 2.218769782727205, "sim_physics": 0.08898757071722121, "survival_time": 5.249999999999989, "driven_lanedir": 0.8125963661433687, "sim_render-ego": 0.006795767375401088, "in-drivable-lane": 2.499999999999993, "agent_compute-ego": 0.01358027458190918, "deviation-heading": 1.7163026916317137, "set_robot_commands": 0.004272408712477911, "deviation-center-line": 0.2412693316050378, "driven_lanedir_consec": 0.6077880672015876, "sim_compute_sim_state": 0.002681641351609003, "sim_compute_performance-ego": 0.0035841419583275205, "sim_compute_robot_state-ego": 0.004701030822027297, "sim_compute_robot_state-npc0": 0.004363466444469634, "sim_compute_robot_state-npc1": 0.004226552872430711, "sim_compute_robot_state-npc2": 0.004217240923926944, "sim_compute_robot_state-npc3": 0.004225231352306548}}
set_robot_commands_max0.009482372374761672
set_robot_commands_mean0.007172317487012151
set_robot_commands_median0.0075095748901367184
set_robot_commands_min0.004180014133453369
sim_compute_performance-ego_max0.007906868344261533
sim_compute_performance-ego_mean0.005704087478642128
sim_compute_performance-ego_median0.005904947717984517
sim_compute_performance-ego_min0.0035841419583275205
sim_compute_robot_state-ego_max0.009453887031191871
sim_compute_robot_state-ego_mean0.007405185087022617
sim_compute_robot_state-ego_median0.007775179390768403
sim_compute_robot_state-ego_min0.004673160039461576
sim_compute_robot_state-npc0_max0.009048268908546084
sim_compute_robot_state-npc0_mean0.006891839897426741
sim_compute_robot_state-npc0_median0.007232513427734375
sim_compute_robot_state-npc0_min0.004323028601132906
sim_compute_robot_state-npc1_max0.009043358549287048
sim_compute_robot_state-npc1_mean0.006635170698701373
sim_compute_robot_state-npc1_median0.006880793571472168
sim_compute_robot_state-npc1_min0.004203947690817026
sim_compute_robot_state-npc2_max0.008879214902467366
sim_compute_robot_state-npc2_mean0.006503678454954886
sim_compute_robot_state-npc2_median0.006716403094204989
sim_compute_robot_state-npc2_min0.004191430715414194
sim_compute_robot_state-npc3_max0.00858369356469263
sim_compute_robot_state-npc3_mean0.006569283417464944
sim_compute_robot_state-npc3_median0.006941244006156921
sim_compute_robot_state-npc3_min0.00419689600284283
sim_compute_sim_state_max0.005314265625386299
sim_compute_sim_state_mean0.00410113417004282
sim_compute_sim_state_median0.004416416088740031
sim_compute_sim_state_min0.00264585935152494
sim_physics_max0.20847417131254944
sim_physics_mean0.15213020235798574
sim_physics_median0.1643239160378774
sim_physics_min0.08898757071722121
sim_render-ego_max0.013457932049715066
sim_render-ego_mean0.010338618328558544
sim_render-ego_median0.011052515900250776
sim_render-ego_min0.006795767375401088
simulation-passed1
survival_time_max8.349999999999984
survival_time_mean3.3333333333333286
survival_time_min1.0500000000000005
No reset possible
247714317Tanli Chou 🇹🇼challenge-aido_LF-template-randomaido3-LFV-sim-testingstep1-simulationerrornoip-172-31-46-148-104900:10:43
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
247563257Liu Sam 🇹🇼PredictorLastaido2-PREDstep1-simulationhost-erroryesip-172-31-46-148-104900:00:04
Error while running [...]

stderr | Pulling solution   ... 
stderr | Pulling evaluation ... done
stderr | 
stderr | ERROR: for solution  pull access denied for coolcat647/aido-submissions, repository does not exist or may require 'docker login'
stderr | pull access denied for coolcat647/aido-submissions, repository does not exist or may require 'docker login'
stderr |
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
247543265Liu Sam 🇹🇼challenge-aido_LF-template-randomaido2-PREDstep1-simulationhost-erroryesip-172-31-46-148-104900:00:05
Error while running [...]

stderr | Pulling solution   ... 
stderr | Pulling evaluation ... done
stderr | 
stderr | ERROR: for solution  pull access denied for coolcat647/aido-submissions, repository does not exist or may require 'docker login'
stderr | pull access denied for coolcat647/aido-submissions, repository does not exist or may require 'docker login'
stderr |
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
247464301Frank (Chude) Qian 🇨🇦Frank test submissionaido3-LF-sim-testingstep1-simulationsuccessnoip-172-31-46-148-104900:09:23
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.6624558951504921
survival_time_median2.000000000000001
deviation-center-line_median0.08490920096961363
in-drivable-lane_median0.1999999999999993


other stats
agent_compute-ego_max0.028835010528564457
agent_compute-ego_mean0.022551956045560175
agent_compute-ego_median0.02143436128442938
agent_compute-ego_min0.017479634284973143
deviation-center-line_max0.2115306175656672
deviation-center-line_mean0.1059365171201285
deviation-center-line_min0.06902532930783761
deviation-heading_max0.5529773614884596
deviation-heading_mean0.31722659171317497
deviation-heading_median0.3145505780820485
deviation-heading_min0.17790279511896667
driven_any_max2.1696546375441756
driven_any_mean0.9422938839630692
driven_any_median0.9996632207705836
driven_any_min0.28362940600638153
driven_lanedir_consec_max2.0004202552910058
driven_lanedir_consec_mean0.7454689984048328
driven_lanedir_consec_min0.275488859799796
driven_lanedir_max2.0004202552910058
driven_lanedir_mean0.7454689984048328
driven_lanedir_median0.6624558951504921
driven_lanedir_min0.275488859799796
in-drivable-lane_max0.7500000000000002
in-drivable-lane_mean0.27333333333333293
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.9996632207705848, "sim_physics": 0.1046244502067566, "survival_time": 2.000000000000001, "driven_lanedir": 0.6856800730956207, "sim_render-ego": 0.011978137493133544, "in-drivable-lane": 0.4500000000000002, "agent_compute-ego": 0.028835010528564457, "deviation-heading": 0.3145505780820485, "set_robot_commands": 0.008764487504959107, "deviation-center-line": 0.08877415228107144, "driven_lanedir_consec": 0.6856800730956207, "sim_compute_sim_state": 0.004522335529327392, "sim_compute_performance-ego": 0.00679100751876831, "sim_compute_robot_state-ego": 0.008762508630752563}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.0296612854712826, "sim_physics": 0.09917542411059868, "survival_time": 2.0500000000000007, "driven_lanedir": 0.8723011611746517, "sim_render-ego": 0.012607562832716034, "in-drivable-lane": 0.1499999999999997, "agent_compute-ego": 0.02828299708482696, "deviation-heading": 0.5268865240013682, "set_robot_commands": 0.009120307317594202, "deviation-center-line": 0.1481817317993273, "driven_lanedir_consec": 0.8723011611746517, "sim_compute_sim_state": 0.005494792286942645, "sim_compute_performance-ego": 0.0068526384307117, "sim_compute_robot_state-ego": 0.009357580324498618}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.28362940600638153, "sim_physics": 0.05742339789867401, "survival_time": 0.8000000000000002, "driven_lanedir": 0.275488859799796, "sim_render-ego": 0.007313236594200134, "in-drivable-lane": 0, "agent_compute-ego": 0.019487202167510983, "deviation-heading": 0.19211543327251043, "set_robot_commands": 0.005180656909942627, "deviation-center-line": 0.07504719484739283, "driven_lanedir_consec": 0.275488859799796, "sim_compute_sim_state": 0.002969205379486084, "sim_compute_performance-ego": 0.003855824470520019, "sim_compute_robot_state-ego": 0.0050421953201293945}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.4605114688305756, "sim_physics": 0.08929819410497492, "survival_time": 1.1000000000000003, "driven_lanedir": 0.43876913939124096, "sim_render-ego": 0.013360652056607332, "in-drivable-lane": 0, "agent_compute-ego": 0.024799682877280495, "deviation-heading": 0.3393674233921455, "set_robot_commands": 0.00747227668762207, "deviation-center-line": 0.07142284970145178, "driven_lanedir_consec": 0.43876913939124096, "sim_compute_sim_state": 0.004740140654823997, "sim_compute_performance-ego": 0.006699399514631791, "sim_compute_robot_state-ego": 0.009673942219127308}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.5996546887300096, "sim_physics": 0.0733678698539734, "survival_time": 2.9999999999999973, "driven_lanedir": 1.1449045921439405, "sim_render-ego": 0.010564740498860676, "in-drivable-lane": 0.7499999999999973, "agent_compute-ego": 0.025304838021596273, "deviation-heading": 0.17790279511896667, "set_robot_commands": 0.007610627015431722, "deviation-center-line": 0.2115306175656672, "driven_lanedir_consec": 1.1449045921439405, "sim_compute_sim_state": 0.004025789101918539, "sim_compute_performance-ego": 0.005684387683868408, "sim_compute_robot_state-ego": 0.0070609450340271}, "ETHZ_autolab_technical_track-5-0": {"driven_any": 0.4605114688305744, "sim_physics": 0.06608291105790572, "survival_time": 1.1000000000000003, "driven_lanedir": 0.43495812661747424, "sim_render-ego": 0.009510885585438122, "in-drivable-lane": 0, "agent_compute-ego": 0.02143436128442938, "deviation-heading": 0.3681646786246838, "set_robot_commands": 0.004982243884693493, "deviation-center-line": 0.07726482156623121, "driven_lanedir_consec": 0.43495812661747424, "sim_compute_sim_state": 0.003987106409939853, "sim_compute_performance-ego": 0.0052099444649436255, "sim_compute_robot_state-ego": 0.0063564343885941935}, "ETHZ_autolab_technical_track-6-0": {"driven_any": 1.02966128547129, "sim_physics": 0.06681594616029321, "survival_time": 2.0500000000000007, "driven_lanedir": 0.5601770218273892, "sim_render-ego": 0.012152369429425497, "in-drivable-lane": 0.7500000000000002, "agent_compute-ego": 0.024573488933284107, "deviation-heading": 0.32355444237015635, "set_robot_commands": 0.0064716920620057645, "deviation-center-line": 0.08490920096961363, "driven_lanedir_consec": 0.5601770218273892, "sim_compute_sim_state": 0.003602679182843464, "sim_compute_performance-ego": 0.0050576489146162825, "sim_compute_robot_state-ego": 0.006322098941337772}, "ETHZ_autolab_technical_track-7-0": {"driven_any": 0.31273308909619457, "sim_physics": 0.06499949623556699, "survival_time": 0.8500000000000002, "driven_lanedir": 0.3050503874991314, "sim_render-ego": 0.00992738499360926, "in-drivable-lane": 0, "agent_compute-ego": 0.02007518095128677, "deviation-heading": 0.18880886527581872, "set_robot_commands": 0.0061986867119284235, "deviation-center-line": 0.07728062202497794, "driven_lanedir_consec": 0.3050503874991314, "sim_compute_sim_state": 0.003908353693345014, "sim_compute_performance-ego": 0.005018430597641889, "sim_compute_robot_state-ego": 0.006173807031968061}, "ETHZ_autolab_technical_track-8-0": {"driven_any": 0.6997653880805514, "sim_physics": 0.05612762769063314, "survival_time": 1.5000000000000009, "driven_lanedir": 0.6932401426939361, "sim_render-ego": 0.007385611534118652, "in-drivable-lane": 0, "agent_compute-ego": 0.017479634284973143, "deviation-heading": 0.20499704380051056, "set_robot_commands": 0.005012106895446777, "deviation-center-line": 0.0893147083916865, "driven_lanedir_consec": 0.6932401426939361, "sim_compute_sim_state": 0.0031430323918660483, "sim_compute_performance-ego": 0.003997206687927246, "sim_compute_robot_state-ego": 0.005342849095662435}, "ETHZ_autolab_technical_track-9-0": {"driven_any": 0.9996632207705836, "sim_physics": 0.07647941708564758, "survival_time": 2.000000000000001, "driven_lanedir": 0.6624558951504921, "sim_render-ego": 0.00985233187675476, "in-drivable-lane": 0.4500000000000002, "agent_compute-ego": 0.02270888686180115, "deviation-heading": 0.3376863277046913, "set_robot_commands": 0.007129794359207154, "deviation-center-line": 0.08436164061098934, "driven_lanedir_consec": 0.6624558951504921, "sim_compute_sim_state": 0.003985828161239624, "sim_compute_performance-ego": 0.005716067552566528, "sim_compute_robot_state-ego": 0.006798338890075683}, "ETHZ_autolab_technical_track-10-0": {"driven_any": 1.5996546887300176, "sim_physics": 0.06129570802052816, "survival_time": 2.9999999999999973, "driven_lanedir": 1.2183806352793682, "sim_render-ego": 0.009106719493865966, "in-drivable-lane": 0.5999999999999979, "agent_compute-ego": 0.02077552874883016, "deviation-heading": 0.28606515891922396, "set_robot_commands": 0.005928488572438558, "deviation-center-line": 0.11803705330676682, "driven_lanedir_consec": 1.2183806352793682, "sim_compute_sim_state": 0.003734735647837321, "sim_compute_performance-ego": 0.0048439224561055505, "sim_compute_robot_state-ego": 0.006308495998382568}, "ETHZ_autolab_technical_track-11-0": {"driven_any": 0.999663220770584, "sim_physics": 0.06484254002571106, "survival_time": 2.000000000000001, "driven_lanedir": 0.6472595776031794, "sim_render-ego": 0.009395575523376463, "in-drivable-lane": 0.40000000000000013, "agent_compute-ego": 0.020228087902069092, "deviation-heading": 0.5529773614884596, "set_robot_commands": 0.00648726224899292, "deviation-center-line": 0.11678925740610405, "driven_lanedir_consec": 0.6472595776031794, "sim_compute_sim_state": 0.0038114547729492182, "sim_compute_performance-ego": 0.005008167028427124, "sim_compute_robot_state-ego": 0.006425970792770385}, "ETHZ_autolab_technical_track-12-0": {"driven_any": 0.9996632207705816, "sim_physics": 0.07753775715827942, "survival_time": 2.000000000000001, "driven_lanedir": 0.7633687986487552, "sim_render-ego": 0.010034793615341186, "in-drivable-lane": 0.3500000000000001, "agent_compute-ego": 0.023823577165603637, "deviation-heading": 0.2265255398365549, "set_robot_commands": 0.006942373514175415, "deviation-center-line": 0.07499156567757533, "driven_lanedir_consec": 0.7633687986487552, "sim_compute_sim_state": 0.003931570053100586, "sim_compute_performance-ego": 0.005440717935562134, "sim_compute_robot_state-ego": 0.006881111860275268}, "ETHZ_autolab_technical_track-13-0": {"driven_any": 0.49031796957265295, "sim_physics": 0.06602651139964229, "survival_time": 1.1500000000000004, "driven_lanedir": 0.4795803098565079, "sim_render-ego": 0.009681743124256964, "in-drivable-lane": 0, "agent_compute-ego": 0.02040260771046514, "deviation-heading": 0.24111734124432463, "set_robot_commands": 0.00716139959252399, "deviation-center-line": 0.06902532930783761, "driven_lanedir_consec": 0.4795803098565079, "sim_compute_sim_state": 0.003847681957742442, "sim_compute_performance-ego": 0.005169225775677225, "sim_compute_robot_state-ego": 0.006725663724152938}, "ETHZ_autolab_technical_track-14-0": {"driven_any": 2.1696546375441756, "sim_physics": 0.05384119251106359, "survival_time": 3.949999999999994, "driven_lanedir": 2.0004202552910058, "sim_render-ego": 0.007744924931586543, "in-drivable-lane": 0.1999999999999993, "agent_compute-ego": 0.020068256160880947, "deviation-heading": 0.477679362566162, "set_robot_commands": 0.0056261080729810495, "deviation-center-line": 0.2021170113452346, "driven_lanedir_consec": 2.0004202552910058, "sim_compute_sim_state": 0.0031289239472980742, "sim_compute_performance-ego": 0.004185522658915459, "sim_compute_robot_state-ego": 0.005418831789040867}}
set_robot_commands_max0.009120307317594202
set_robot_commands_mean0.006672567423329551
set_robot_commands_median0.00648726224899292
set_robot_commands_min0.004982243884693493
sim_compute_performance-ego_max0.0068526384307117
sim_compute_performance-ego_mean0.005302007446058887
sim_compute_performance-ego_median0.005169225775677225
sim_compute_performance-ego_min0.003855824470520019
sim_compute_robot_state-ego_max0.009673942219127308
sim_compute_robot_state-ego_mean0.00684338493605301
sim_compute_robot_state-ego_median0.006425970792770385
sim_compute_robot_state-ego_min0.0050421953201293945
sim_compute_sim_state_max0.005494792286942645
sim_compute_sim_state_mean0.003922241944710687
sim_compute_sim_state_median0.003908353693345014
sim_compute_sim_state_min0.002969205379486084
sim_physics_max0.1046244502067566
sim_physics_mean0.07186256290134992
sim_physics_median0.06608291105790572
sim_physics_min0.05384119251106359
sim_render-ego_max0.013360652056607332
sim_render-ego_mean0.01004111130555274
sim_render-ego_median0.00985233187675476
sim_render-ego_min0.007313236594200134
simulation-passed1
survival_time_max3.949999999999994
survival_time_mean1.9033333333333329
survival_time_min0.8000000000000002
No reset possible
247383264Liu Sam 🇹🇼challenge-aido_LF-template-randomaido2-PREDstep1-simulationhost-erroryesip-172-31-46-148-104900:00:05
Error while running [...]

stderr | Pulling solution   ... 
stderr | Pulling evaluation ... done
stderr | 
stderr | ERROR: for solution  pull access denied for coolcat647/aido-submissions, repository does not exist or may require 'docker login'
stderr | pull access denied for coolcat647/aido-submissions, repository does not exist or may require 'docker login'
stderr |
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
247212445Claudio RuchPredictorMeanaido2-PREDstep1-simulationsuccessyesip-172-31-46-148-104900:00:51
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
error_L10.2829229848048663
error_L20.09709522146733436


No reset possible
246973157 PredictorLastaido2-PREDstep1-simulationsuccessyesip-172-31-46-148-104900:01:14
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
error_L10.11606527945229374
error_L20.02165399847147753


No reset possible
246593203Masaya Kambara 🇯🇵PredictorLastaido2-PREDstep1-simulationsuccessyesip-172-31-46-148-104900:01:56
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
error_L10.11491110680140793
error_L20.02109426817307931


No reset possible
246483254Michael Su 🇹🇼PredictorLastaido2-PREDstep1-simulationhost-erroryesip-172-31-46-148-104900:00:16
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 1569, in upload
    aws_object.load()
  File "/usr/local/lib/python3.6/dist-packages/boto3/resources/factory.py", line 505, in do_action
    response = action(self, *args, **kwargs)
  File "/usr/local/lib/python3.6/dist-packages/boto3/resources/action.py", line 83, in __call__
    response = getattr(parent.meta.client, operation_name)(**params)
  File "/usr/local/lib/python3.6/dist-packages/botocore/client.py", line 357, in _api_call
    return self._make_api_call(operation_name, kwargs)
  File "/usr/local/lib/python3.6/dist-packages/botocore/client.py", line 661, in _make_api_call
    raise error_class(parsed_response, operation_name)
botocore.exceptions.ClientError: An error occurred (404) when calling the HeadObject operation: Not Found

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 641, in get_cr
    wd, aws_config, copy_to_machine_cache=copy_to_machine_cache
  File "/project/src/duckietown_challenges_runner/runner.py", line 1301, in upload_files
    aws_config, toupload, copy_to_machine_cache=copy_to_machine_cache
  File "/project/src/duckietown_challenges_runner/runner.py", line 1579, in upload
    aws_object.upload_file(realfile, ExtraArgs={"ContentType": mime_type})
  File "/usr/local/lib/python3.6/dist-packages/boto3/s3/inject.py", line 280, in object_upload_file
    ExtraArgs=ExtraArgs, Callback=Callback, Config=Config)
  File "/usr/local/lib/python3.6/dist-packages/boto3/s3/inject.py", line 131, in upload_file
    extra_args=ExtraArgs, callback=Callback)
  File "/usr/local/lib/python3.6/dist-packages/boto3/s3/transfer.py", line 279, in upload_file
    future.result()
  File "/usr/local/lib/python3.6/dist-packages/s3transfer/futures.py", line 73, in result
    return self._coordinator.result()
  File "/usr/local/lib/python3.6/dist-packages/s3transfer/futures.py", line 233, in result
    raise self._exception
  File "/usr/local/lib/python3.6/dist-packages/s3transfer/tasks.py", line 255, in _main
    self._submit(transfer_future=transfer_future, **kwargs)
  File "/usr/local/lib/python3.6/dist-packages/s3transfer/upload.py", line 549, in _submit
    upload_input_manager.provide_transfer_size(transfer_future)
  File "/usr/local/lib/python3.6/dist-packages/s3transfer/upload.py", line 237, in provide_transfer_size
    transfer_future.meta.call_args.fileobj))
  File "/usr/local/lib/python3.6/dist-packages/s3transfer/utils.py", line 228, in get_file_size
    return os.path.getsize(filename)
  File "/usr/lib/python3.6/genericpath.py", line 50, in getsize
    return os.stat(filename).st_size
FileNotFoundError: [Errno 2] No such file or directory: '/tmp/duckietown/DT18/evaluator/executions/aido2-PRED/submission3254/step1-simulation-ip-172-31-46-148-10490-job24648/logs/challenges-runner/stdout.log'
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
246403280Hsiao-Sheng Chen 🇹🇼PredictorLastaido2-PREDstep1-simulationsuccessyesip-172-31-46-148-104900:00:17
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
error_L10.11110580463131574
error_L20.020183494948141582


No reset possible
246273558Karthikk Subramanian 🇸🇬PredictorLastaido2-PREDstep1-simulationsuccessyesip-172-31-46-148-104900:00:21
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
error_L10.1066996680259363
error_L20.019124346874291695


No reset possible
246243484Riza Velioglu 🇩🇪PredictorLastaido2-PREDstep1-simulationsuccessyesip-172-31-46-148-104900:00:18
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
error_L10.10685778088159265
error_L20.017933633450747978


No reset possible
246153824Donghoon LeePredictorLastaido2-PREDstep1-simulationsuccessyesip-172-31-46-148-104900:00:23
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
error_L10.11666829595067764
error_L20.02093808388891301


No reset possible
246074027Frank (Chude) Qian 🇨🇦PredictorLastaido2-PREDstep1-simulationsuccessyesip-172-31-46-148-104900:00:21
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
error_L10.10375649487850191
error_L20.01629343732305054


No reset possible
246024056Zoltán L?rinczPredictorLastaido2-PREDstep1-simulationsuccessyesip-172-31-46-148-104900:00:15
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
error_L10.1064694582423837
error_L20.018023563171349604


No reset possible
245974058Zoltán L?rinczPredictorLastaido2-PREDstep1-simulationsuccessyesip-172-31-46-148-104900:00:16
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
error_L10.12645548203814602
error_L20.026161962080551052


No reset possible
245934070Amaury Camus 🇨🇭PredictorLastaido2-PREDstep1-simulationsuccessyesip-172-31-46-148-104900:00:17
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
error_L10.11300113391670108
error_L20.019310988593449253


No reset possible
245854077Sergio Duvan Mendoza Rojas 🇨🇴PredictorLastaido2-PREDstep1-simulationsuccessyesip-172-31-46-148-104900:00:19
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
error_L10.11721203093235408
error_L20.02058930492918922


No reset possible
245824079Lison Abecassis 🇨🇭PredictorLastaido2-PREDstep1-simulationsuccessyesip-172-31-46-148-104900:00:23
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
error_L10.13093008173887427
error_L20.025999710757652412


No reset possible
245774083Alexander Hatteland 🇨🇭PredictorLastaido2-PREDstep1-simulationabortedyesip-172-31-46-148-104900:00:23
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
error_L10.11080438795106023
error_L20.01971486766648127


No reset possible
245744090Martin Ziran Xu 🇨🇭PredictorLastaido2-PREDstep1-simulationsuccessyesip-172-31-46-148-104900:00:19
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
error_L10.1019988608149525
error_L20.016545936381914206


No reset possible
245654092Vincenzo Polizzi 🇮🇹PredictorLastaido2-PREDstep1-simulationsuccessyesip-172-31-46-148-104900:00:23
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
error_L10.12301817457245656
error_L20.022623440362653343


No reset possible
245614100Paula WulkopPredictorLastaido2-PREDstep1-simulationsuccessyesip-172-31-46-148-104900:00:18
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
error_L10.10688951759064078
error_L20.017972857235557266


No reset possible
245464159yang yi chun 🇹🇼PredictorLastaido2-PREDstep1-simulationsuccessyesip-172-31-46-148-104900:00:34
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
error_L10.1119703011722141
error_L20.020340264155336334


No reset possible
245024273Riza Velioglu 🇩🇪Uni Bielefeldaido3-LFV-sim-validationstep1-simulationerrornoip-172-31-46-148-104900:01:54
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
244914264Gianmarco Bernasconichallenge-aido_LF-baseline-duckietownaido3-LFV-sim-testingstep1-simulationerrornoip-172-31-46-148-104900:06:52
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
244854257Anastasiya Nikolskaya 🇷🇺betaaido3-LF-sim-validationstep1-simulationsuccessnoip-172-31-46-148-104900:10:40
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.2346215890575758
survival_time_median12.600000000000044
deviation-center-line_median0.5327811431801165
in-drivable-lane_median1.500000000000021


other stats
agent_compute-ego_max0.049086325096361565
agent_compute-ego_mean0.04835433723457978
agent_compute-ego_median0.04858511827123447
agent_compute-ego_min0.04750986660228056
deviation-center-line_max1.0823806510958154
deviation-center-line_mean0.6154038586748859
deviation-center-line_min0.3563951323460155
deviation-heading_max4.068434097499754
deviation-heading_mean2.531629616081064
deviation-heading_median1.9606459038788029
deviation-heading_min1.708245141481415
driven_any_max1.6804045547637294
driven_any_mean1.55254590894251
driven_any_median1.6579834231059254
driven_any_min1.1294903010119302
driven_lanedir_consec_max1.6370699656006726
driven_lanedir_consec_mean1.2163816208164708
driven_lanedir_consec_min0.6330805363590217
driven_lanedir_max1.6370699656006726
driven_lanedir_mean1.230142049469048
driven_lanedir_median1.2669308715238552
driven_lanedir_min0.6488270688767828
in-drivable-lane_max2.5999999999999943
in-drivable-lane_mean1.4100000000000117
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.1294903010119302, "sim_physics": 0.04630580381913619, "survival_time": 8.249999999999982, "driven_lanedir": 0.6488270688767828, "sim_render-ego": 0.006881332397460938, "in-drivable-lane": 2.5999999999999943, "agent_compute-ego": 0.049086325096361565, "deviation-heading": 1.9606459038788029, "set_robot_commands": 0.004471466758034446, "deviation-center-line": 0.3563951323460155, "driven_lanedir_consec": 0.6330805363590217, "sim_compute_sim_state": 0.0027898239366935963, "sim_compute_performance-ego": 0.0038394927978515625, "sim_compute_robot_state-ego": 0.004730250618674539}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.6579834231059254, "sim_physics": 0.04421732505162557, "survival_time": 14.950000000000076, "driven_lanedir": 1.6370699656006726, "sim_render-ego": 0.0068849428494771325, "in-drivable-lane": 0, "agent_compute-ego": 0.047841781775156654, "deviation-heading": 1.7707278168376466, "set_robot_commands": 0.0044628167152404785, "deviation-center-line": 0.5869637383119799, "driven_lanedir_consec": 1.6370699656006726, "sim_compute_sim_state": 0.002821087042490641, "sim_compute_performance-ego": 0.0037285534540812174, "sim_compute_robot_state-ego": 0.00475226879119873}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.6262197218361274, "sim_physics": 0.046529782843266136, "survival_time": 11.050000000000022, "driven_lanedir": 1.3800459992377818, "sim_render-ego": 0.006914447335635915, "in-drivable-lane": 1.200000000000017, "agent_compute-ego": 0.04750986660228056, "deviation-heading": 1.708245141481415, "set_robot_commands": 0.004435506881092469, "deviation-center-line": 0.518498628440502, "driven_lanedir_consec": 1.3800459992377818, "sim_compute_sim_state": 0.002823550237250005, "sim_compute_performance-ego": 0.003724038870625906, "sim_compute_robot_state-ego": 0.004744083093841691}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.6686315439948372, "sim_physics": 0.04642041273943082, "survival_time": 12.700000000000044, "driven_lanedir": 1.2178363421061482, "sim_render-ego": 0.006875270933616819, "in-drivable-lane": 1.500000000000021, "agent_compute-ego": 0.04858511827123447, "deviation-heading": 4.068434097499754, "set_robot_commands": 0.004430090348551592, "deviation-center-line": 1.0823806510958154, "driven_lanedir_consec": 1.1970900138273026, "sim_compute_sim_state": 0.0028442782679880697, "sim_compute_performance-ego": 0.003733167498130498, "sim_compute_robot_state-ego": 0.004778923950796052}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.6804045547637294, "sim_physics": 0.04635285952734568, "survival_time": 12.600000000000044, "driven_lanedir": 1.2669308715238552, "sim_render-ego": 0.0068998705773126515, "in-drivable-lane": 1.7500000000000249, "agent_compute-ego": 0.04874859442786565, "deviation-heading": 3.150095120707702, "set_robot_commands": 0.0044163550649370465, "deviation-center-line": 0.5327811431801165, "driven_lanedir_consec": 1.2346215890575758, "sim_compute_sim_state": 0.0028414007217165025, "sim_compute_performance-ego": 0.0037230243758549766, "sim_compute_robot_state-ego": 0.0047881338331434466}}
set_robot_commands_max0.004471466758034446
set_robot_commands_mean0.004443247153571206
set_robot_commands_median0.004435506881092469
set_robot_commands_min0.0044163550649370465
sim_compute_performance-ego_max0.0038394927978515625
sim_compute_performance-ego_mean0.003749655399308832
sim_compute_performance-ego_median0.0037285534540812174
sim_compute_performance-ego_min0.0037230243758549766
sim_compute_robot_state-ego_max0.0047881338331434466
sim_compute_robot_state-ego_mean0.004758732057530892
sim_compute_robot_state-ego_median0.00475226879119873
sim_compute_robot_state-ego_min0.004730250618674539
sim_compute_sim_state_max0.0028442782679880697
sim_compute_sim_state_mean0.0028240280412277627
sim_compute_sim_state_median0.002823550237250005
sim_compute_sim_state_min0.0027898239366935963
sim_physics_max0.046529782843266136
sim_physics_mean0.04596523679616088
sim_physics_median0.04635285952734568
sim_physics_min0.04421732505162557
sim_render-ego_max0.006914447335635915
sim_render-ego_mean0.0068911728187006915
sim_render-ego_median0.0068849428494771325
sim_render-ego_min0.006875270933616819
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean11.910000000000036
survival_time_min8.249999999999982
No reset possible
244374236Andrea Censi 🇨🇭challenge-aido_LF-template-pytorchaido3-LFVI-sim-validationstep1-simulationerrornoip-172-31-46-148-104900:03:11
Unexpected exception [...]
Unexpected exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.7/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 150, in _write
    self.fpin.write(j)
BrokenPipeError: [Errno 32] Broken pipe

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.7/site-packages/duckietown_challenges/cie_concrete.py", line 675, in scoring_context
    yield cie
  File "experiment_manager.py", line 444, in <module>
    wrap(cie)
  File "experiment_manager.py", line 432, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 77, in main
    agent_ci._get_node_protocol(timeout=config.timeout_initialization)
  File "/usr/local/lib/python3.7/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 61, in _get_node_protocol
    self._write(j)
  File "/usr/local/lib/python3.7/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 162, in _write
    raise RemoteNodeAborted(msg) from e
zuper_nodes.structures.RemoteNodeAborted: While attempting to write to node "agent", I reckon that the pipe is closed and the node exited.

I could not read any aborted message: The remote node "agent" aborted with the following error:

error in agent |Unexpected error:
               |
               || Traceback (most recent call last):
               ||   File "/usr/local/lib/python3.7/site-packages/zuper_nodes_wrapper/wrapper.py", line 214, in loop
               ||     node_name=node_name, tout=tout)
               ||   File "/usr/local/lib/python3.7/site-packages/zuper_nodes_wrapper/wrapper.py", line 39, in __init__
               ||     self.pc = LanguageChecker(protocol.interaction)
               ||   File "/usr/local/lib/python3.7/site-packages/zuper_nodes/language_recognize.py", line 123, in __init__
               ||     self.g.node[n]['label'] = 'start'
               || AttributeError: 'MultiDiGraph' object has no attribute 'node'
               ||
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible