Duckietown Challenges Home Challenges Submissions

Evaluator 1287

ID1287
evaluatorip-172-31-38-104-8195
ownerI don't have one 😀
machineip-172-31-38-104
processip-172-31-38-104-8195
versiond-c:4.0.30;d-c-r:4.0.46;d-s:4.0.22
first heard
last heard
statusinactive
# evaluating
# success13 23234
# timeout
# failed1 23684
# error7 23291
# aborted
# host-error
arm
x86_64
Mac
gpu available
Number of processors
Processor frequency (MHz)
Free % of processors
RAM total (MB)
RAM free (MB)
Disk (MB)
Disk available (MB)
Docker Hub
P1
P2
Cloud simulations
PI Camera
# Duckiebots
Map 3x3 avaiable
Number of duckies
gpu cores
AIDO 2 Map LF public
AIDO 2 Map LF private
AIDO 2 Map LFV public
AIDO 2 Map LFV private
AIDO 2 Map LFVI public
AIDO 2 Map LFVI private
AIDO 3 Map LF public
AIDO 3 Map LF private
AIDO 3 Map LFV public
AIDO 3 Map LFV private
AIDO 3 Map LFVI public
AIDO 3 Map LFVI private
AIDO 5 Map large loop
ETU track
for 2021, map is ETH_small_inter
IPFS mountpoint /ipfs available
IPNS mountpoint /ipns available

Evaluator jobs

Job IDsubmissionuseruser labelchallengestepstatusup to dateevaluatordate starteddate completeddurationmessage
237423753sebastian glatzaido2-LFVI-sim-validationstep1-simulationsuccessyesip-172-31-38-104-81950:09:44
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.493517638549009
survival_time_median2.3999999999999995
deviation-center-line_median0.09791133281082
in-drivable-lane_median0.549999999999998


other stats
agent_compute-ego_max0.16275066634019217
agent_compute-ego_mean0.15598075624508892
agent_compute-ego_median0.15584966974351014
agent_compute-ego_min0.15079549380711146
deviation-center-line_max0.2348196785686717
deviation-center-line_mean0.13547481992266058
deviation-center-line_min0.06216029860587694
deviation-heading_max0.8115272458314897
deviation-heading_mean0.49959867397150787
deviation-heading_median0.46504862964833654
deviation-heading_min0.30044835691402494
driven_any_max2.1864003300000694
driven_any_mean1.1068208197848532
driven_any_median0.9410513078477724
driven_any_min0.34749292376309954
driven_lanedir_consec_max1.826231945363564
driven_lanedir_consec_mean0.804744013449103
driven_lanedir_consec_min0.3325249708009643
driven_lanedir_max1.826231945363564
driven_lanedir_mean0.804828147320482
driven_lanedir_median0.493517638549009
driven_lanedir_min0.3325249708009643
in-drivable-lane_max1.3499999999999952
in-drivable-lane_mean0.5599999999999984
in-drivable-lane_min0
per-episodes
details{"udem1-0-0": {"driven_any": 1.5811782993597916, "sim_physics": 0.2289619898494286, "survival_time": 3.949999999999994, "driven_lanedir": 0.9217908232230632, "sim_render-ego": 0.06589702714847613, "in-drivable-lane": 1.3499999999999952, "agent_compute-ego": 0.15708605549003504, "deviation-heading": 0.5694288623982039, "set_robot_commands": 0.0974175205713586, "deviation-center-line": 0.2348196785686717, "driven_lanedir_consec": 0.9213701538661684, "sim_compute_sim_state": 0.042563043063199975, "sim_compute_performance-ego": 0.07227260251588459, "sim_compute_robot_state-ego": 0.07974776738806616, "sim_compute_robot_state-npc0": 0.07331953471219993, "sim_compute_robot_state-npc1": 0.07457353797140001, "sim_compute_robot_state-npc2": 0.07210149946092051, "sim_compute_robot_state-npc3": 0.07453828521921665}, "udem1-1-0": {"driven_any": 0.47798123795353353, "sim_physics": 0.21167136941637313, "survival_time": 1.4000000000000006, "driven_lanedir": 0.4500753586658095, "sim_render-ego": 0.06022615092141288, "in-drivable-lane": 0, "agent_compute-ego": 0.15342189584459578, "deviation-heading": 0.46504862964833654, "set_robot_commands": 0.09718927315303258, "deviation-center-line": 0.09791133281082, "driven_lanedir_consec": 0.4500753586658095, "sim_compute_sim_state": 0.04033459084374564, "sim_compute_performance-ego": 0.06975534984043666, "sim_compute_robot_state-ego": 0.07460546493530273, "sim_compute_robot_state-npc0": 0.06709679535457067, "sim_compute_robot_state-npc1": 0.06897331987108503, "sim_compute_robot_state-npc2": 0.0689149158341544, "sim_compute_robot_state-npc3": 0.06808392490659441}, "udem1-2-0": {"driven_any": 2.1864003300000694, "sim_physics": 0.21255492006690757, "survival_time": 5.14999999999999, "driven_lanedir": 1.826231945363564, "sim_render-ego": 0.06540823445736783, "in-drivable-lane": 0.549999999999998, "agent_compute-ego": 0.15584966974351014, "deviation-heading": 0.8115272458314897, "set_robot_commands": 0.09881255464646424, "deviation-center-line": 0.1927316041609401, "driven_lanedir_consec": 1.826231945363564, "sim_compute_sim_state": 0.04096901995464436, "sim_compute_performance-ego": 0.07004700586633775, "sim_compute_robot_state-ego": 0.08000342128346268, "sim_compute_robot_state-npc0": 0.07106386110620591, "sim_compute_robot_state-npc1": 0.07179116971284441, "sim_compute_robot_state-npc2": 0.06946643347879058, "sim_compute_robot_state-npc3": 0.07071224925587478}, "udem1-3-0": {"driven_any": 0.9410513078477724, "sim_physics": 0.23265916605790457, "survival_time": 2.3999999999999995, "driven_lanedir": 0.493517638549009, "sim_render-ego": 0.06686831017335255, "in-drivable-lane": 0.8999999999999988, "agent_compute-ego": 0.16275066634019217, "deviation-heading": 0.35154027506548424, "set_robot_commands": 0.0973177303870519, "deviation-center-line": 0.08975118546699407, "driven_lanedir_consec": 0.493517638549009, "sim_compute_sim_state": 0.041187435388565063, "sim_compute_performance-ego": 0.07184908787409465, "sim_compute_robot_state-ego": 0.07971994578838348, "sim_compute_robot_state-npc0": 0.07038092116514842, "sim_compute_robot_state-npc1": 0.07521671056747437, "sim_compute_robot_state-npc2": 0.07098160187403361, "sim_compute_robot_state-npc3": 0.07215447723865509}, "udem1-4-0": {"driven_any": 0.34749292376309954, "sim_physics": 0.20810831160772417, "survival_time": 1.0500000000000005, "driven_lanedir": 0.3325249708009643, "sim_render-ego": 0.0642451558794294, "in-drivable-lane": 0, "agent_compute-ego": 0.15079549380711146, "deviation-heading": 0.30044835691402494, "set_robot_commands": 0.09185652505783808, "deviation-center-line": 0.06216029860587694, "driven_lanedir_consec": 0.3325249708009643, "sim_compute_sim_state": 0.038988715126400904, "sim_compute_performance-ego": 0.0661499954405285, "sim_compute_robot_state-ego": 0.0765129043942406, "sim_compute_robot_state-npc0": 0.06940915471031553, "sim_compute_robot_state-npc1": 0.067810853322347, "sim_compute_robot_state-npc2": 0.07110753513517834, "sim_compute_robot_state-npc3": 0.06917503901890346}}
set_robot_commands_max0.09881255464646424
set_robot_commands_mean0.09651872076314907
set_robot_commands_median0.0973177303870519
set_robot_commands_min0.09185652505783808
sim_compute_performance-ego_max0.07227260251588459
sim_compute_performance-ego_mean0.07001480830745643
sim_compute_performance-ego_median0.07004700586633775
sim_compute_performance-ego_min0.0661499954405285
sim_compute_robot_state-ego_max0.08000342128346268
sim_compute_robot_state-ego_mean0.07811790075789113
sim_compute_robot_state-ego_median0.07971994578838348
sim_compute_robot_state-ego_min0.07460546493530273
sim_compute_robot_state-npc0_max0.07331953471219993
sim_compute_robot_state-npc0_mean0.07025405340968809
sim_compute_robot_state-npc0_median0.07038092116514842
sim_compute_robot_state-npc0_min0.06709679535457067
sim_compute_robot_state-npc1_max0.07521671056747437
sim_compute_robot_state-npc1_mean0.07167311828903017
sim_compute_robot_state-npc1_median0.07179116971284441
sim_compute_robot_state-npc1_min0.067810853322347
sim_compute_robot_state-npc2_max0.07210149946092051
sim_compute_robot_state-npc2_mean0.07051439715661549
sim_compute_robot_state-npc2_median0.07098160187403361
sim_compute_robot_state-npc2_min0.0689149158341544
sim_compute_robot_state-npc3_max0.07453828521921665
sim_compute_robot_state-npc3_mean0.07093279512784886
sim_compute_robot_state-npc3_median0.07071224925587478
sim_compute_robot_state-npc3_min0.06808392490659441
sim_compute_sim_state_max0.042563043063199975
sim_compute_sim_state_mean0.040808560875311185
sim_compute_sim_state_median0.04096901995464436
sim_compute_sim_state_min0.038988715126400904
sim_physics_max0.23265916605790457
sim_physics_mean0.2187911513996676
sim_physics_median0.21255492006690757
sim_physics_min0.20810831160772417
sim_render-ego_max0.06686831017335255
sim_render-ego_mean0.06452897571600777
sim_render-ego_median0.06540823445736783
sim_render-ego_min0.06022615092141288
simulation-passed1
survival_time_max5.14999999999999
survival_time_mean2.789999999999997
survival_time_min1.0500000000000005
No reset possible
237073733jiang pengSecond test -RGB- TH-jpaido2-LF-sim-testingstep1-simulationerroryesip-172-31-38-104-81950:01:48
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
236933729jiang pengLF sim test - whaido2-LF-sim-testingstep1-simulationerroryesip-172-31-38-104-81950:32:36
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
236843722jiang pengLF sim test - whaido2-LF-sim-testingstep1-simulationfailedyesip-172-31-38-104-81950:00:49
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "experiment_manager.py", line 297, in run_episode
    r: MsgReceived = agent.write_topic_and_expect('get_commands', expect='commands')
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 93, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 174, in read_one
    nickname=self.nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 283, in read_until_over
    raise RemoteNodeAborted(m)
zuper_nodes.structures.RemoteNodeAborted: External node "agent" aborted:

error in agent |Exception while handling a message on topic "get_commands".
               |
               || Traceback (most recent call last):
               ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 274, in loop
               ||     handle_message_node(parsed, receiver0, context0)
               ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 428, in handle_message_node
               ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
               ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/utils.py", line 18, in call_if_fun_exists
               ||     f(**kwargs)
               ||   File "solution.py", line 60, in on_received_get_commands
               ||     action = self.compute_action(self.current_image)
               ||   File "solution.py", line 47, in compute_action
               ||     if action[0]<1e-2:
               || UnboundLocalError: local variable 'action' referenced before assignment
               ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
    yield cie
  File "experiment_manager.py", line 441, in <module>
    wrap(cie)
  File "experiment_manager.py", line 429, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 135, in main
    physics_dt=config.physics_dt)
  File "experiment_manager.py", line 301, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
236713713jiang pengfinal test - whaido2-LF-sim-validationstep1-simulationsuccessyesip-172-31-38-104-81950:14:38
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.6912525517385508
survival_time_median14.950000000000076
deviation-center-line_median0.5856694382097689
in-drivable-lane_median0


other stats
agent_compute-ego_max0.12299171845118204
agent_compute-ego_mean0.1112096702257792
agent_compute-ego_median0.10807116587956746
agent_compute-ego_min0.10708727916081746
deviation-center-line_max0.9883485803129552
deviation-center-line_mean0.5671016039329928
deviation-center-line_min0.17956999202268023
deviation-heading_max2.2773018805429825
deviation-heading_mean1.7565102855033623
deviation-heading_median1.955263012301971
deviation-heading_min1.139922335843313
driven_any_max3.7034231259716504
driven_any_mean1.452978448961732
driven_any_median0.6946434589759861
driven_any_min0.07847797221096862
driven_lanedir_consec_max3.653920498105707
driven_lanedir_consec_mean1.407378691062942
driven_lanedir_consec_min0.07704592676249566
driven_lanedir_max3.653920498105707
driven_lanedir_mean1.407378691062942
driven_lanedir_median0.6912525517385508
driven_lanedir_min0.07704592676249566
in-drivable-lane_max0.25000000000000355
in-drivable-lane_mean0.05000000000000071
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.07847797221096862, "sim_physics": 0.059150099754333496, "survival_time": 14.950000000000076, "driven_lanedir": 0.07704592676249566, "sim_render-ego": 0.03667732954025269, "in-drivable-lane": 0, "agent_compute-ego": 0.10807116587956746, "deviation-heading": 2.2773018805429825, "set_robot_commands": 0.0561806050936381, "deviation-center-line": 0.9883485803129552, "driven_lanedir_consec": 0.07704592676249566, "sim_compute_sim_state": 0.023732573986053468, "sim_compute_performance-ego": 0.040075796445210775, "sim_compute_robot_state-ego": 0.04182314872741699}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 3.7034231259716504, "sim_physics": 0.06724542617797852, "survival_time": 14.950000000000076, "driven_lanedir": 3.653920498105707, "sim_render-ego": 0.04167417287826538, "in-drivable-lane": 0, "agent_compute-ego": 0.12299171845118204, "deviation-heading": 1.9755734030639072, "set_robot_commands": 0.06470476786295573, "deviation-center-line": 0.5930166553012554, "driven_lanedir_consec": 3.653920498105707, "sim_compute_sim_state": 0.027473459243774413, "sim_compute_performance-ego": 0.04627676089604696, "sim_compute_robot_state-ego": 0.04816345373789469}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 2.47243226930661, "sim_physics": 0.059934345881144206, "survival_time": 14.950000000000076, "driven_lanedir": 2.3025185855451795, "sim_render-ego": 0.03745662609736125, "in-drivable-lane": 0.25000000000000355, "agent_compute-ego": 0.11039520184199016, "deviation-heading": 1.955263012301971, "set_robot_commands": 0.05701921304066976, "deviation-center-line": 0.5856694382097689, "driven_lanedir_consec": 2.3025185855451795, "sim_compute_sim_state": 0.024681289196014405, "sim_compute_performance-ego": 0.042010335127512614, "sim_compute_robot_state-ego": 0.043128767013549806}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.6946434589759861, "sim_physics": 0.05859216213226318, "survival_time": 14.950000000000076, "driven_lanedir": 0.6912525517385508, "sim_render-ego": 0.0364788031578064, "in-drivable-lane": 0, "agent_compute-ego": 0.10750298579533894, "deviation-heading": 1.4344907957646382, "set_robot_commands": 0.056360523700714114, "deviation-center-line": 0.17956999202268023, "driven_lanedir_consec": 0.6912525517385508, "sim_compute_sim_state": 0.02366034984588623, "sim_compute_performance-ego": 0.040190888245900475, "sim_compute_robot_state-ego": 0.046364441712697345}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.31591541834344405, "sim_physics": 0.05685055414835612, "survival_time": 14.950000000000076, "driven_lanedir": 0.31215589316277725, "sim_render-ego": 0.036761704285939535, "in-drivable-lane": 0, "agent_compute-ego": 0.10708727916081746, "deviation-heading": 1.139922335843313, "set_robot_commands": 0.05568891763687134, "deviation-center-line": 0.4889033538183034, "driven_lanedir_consec": 0.31215589316277725, "sim_compute_sim_state": 0.023925457000732425, "sim_compute_performance-ego": 0.04004067103068034, "sim_compute_robot_state-ego": 0.041805512110392254}}
set_robot_commands_max0.06470476786295573
set_robot_commands_mean0.05799080546696981
set_robot_commands_median0.056360523700714114
set_robot_commands_min0.05568891763687134
sim_compute_performance-ego_max0.04627676089604696
sim_compute_performance-ego_mean0.04171889034907024
sim_compute_performance-ego_median0.040190888245900475
sim_compute_performance-ego_min0.04004067103068034
sim_compute_robot_state-ego_max0.04816345373789469
sim_compute_robot_state-ego_mean0.04425706466039022
sim_compute_robot_state-ego_median0.043128767013549806
sim_compute_robot_state-ego_min0.041805512110392254
sim_compute_sim_state_max0.027473459243774413
sim_compute_sim_state_mean0.02469462585449219
sim_compute_sim_state_median0.023925457000732425
sim_compute_sim_state_min0.02366034984588623
sim_physics_max0.06724542617797852
sim_physics_mean0.06035451761881511
sim_physics_median0.059150099754333496
sim_physics_min0.05685055414835612
sim_render-ego_max0.04167417287826538
sim_render-ego_mean0.037809727191925054
sim_render-ego_median0.036761704285939535
sim_render-ego_min0.0364788031578064
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean14.950000000000076
survival_time_min14.950000000000076
No reset possible
236313711Anastasiya Nikolskaya 🇷🇺submission-val-icra2019aido2-LF-sim-validationstep1-simulationsuccessyesip-172-31-38-104-81950:14:23
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.8443537278627076
survival_time_median14.950000000000076
deviation-center-line_median0.9494594762983838
in-drivable-lane_median0


other stats
agent_compute-ego_max0.05401053826014201
agent_compute-ego_mean0.0516334863183668
agent_compute-ego_median0.05078894774119059
agent_compute-ego_min0.04972055966675046
deviation-center-line_max1.1845657413724575
deviation-center-line_mean0.9873368284961244
deviation-center-line_min0.7087408626389159
deviation-heading_max4.412260932893545
deviation-heading_mean2.58970932782026
deviation-heading_median2.537620913913574
deviation-heading_min1.5922328873344374
driven_any_max2.106584658062461
driven_any_mean1.913445862775776
driven_any_median2.070512166114907
driven_any_min1.5229259483384026
driven_lanedir_consec_max2.054007467950516
driven_lanedir_consec_mean1.7918060915772926
driven_lanedir_consec_min1.4564810558499484
driven_lanedir_max2.054007467950516
driven_lanedir_mean1.7918060915772926
driven_lanedir_median1.8443537278627076
driven_lanedir_min1.4564810558499484
in-drivable-lane_max1.2500000000000178
in-drivable-lane_mean0.39000000000000307
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 2.0800383017863697, "sim_physics": 0.06626305023829142, "survival_time": 14.950000000000076, "driven_lanedir": 2.054007467950516, "sim_render-ego": 0.03927275021870931, "in-drivable-lane": 0, "agent_compute-ego": 0.05078894774119059, "deviation-heading": 1.5922328873344374, "set_robot_commands": 0.06298741896947226, "deviation-center-line": 1.1648070394475087, "driven_lanedir_consec": 2.054007467950516, "sim_compute_sim_state": 0.026256767114003494, "sim_compute_performance-ego": 0.04340080976486206, "sim_compute_robot_state-ego": 0.04722751379013061}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 2.070512166114907, "sim_physics": 0.05845173120498657, "survival_time": 14.950000000000076, "driven_lanedir": 1.8443537278627076, "sim_render-ego": 0.03863433519999186, "in-drivable-lane": 0.6999999999999975, "agent_compute-ego": 0.04976036389668782, "deviation-heading": 4.412260932893545, "set_robot_commands": 0.05826234976450602, "deviation-center-line": 0.9291110227233562, "driven_lanedir_consec": 1.8443537278627076, "sim_compute_sim_state": 0.02542612870534261, "sim_compute_performance-ego": 0.04209377686182658, "sim_compute_robot_state-ego": 0.04514986753463745}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.787168239576739, "sim_physics": 0.06025380013959681, "survival_time": 12.650000000000045, "driven_lanedir": 1.564979333784439, "sim_render-ego": 0.03837593459329115, "in-drivable-lane": 1.2500000000000178, "agent_compute-ego": 0.04972055966675046, "deviation-heading": 1.753045423772966, "set_robot_commands": 0.059974832497095405, "deviation-center-line": 1.1845657413724575, "driven_lanedir_consec": 1.564979333784439, "sim_compute_sim_state": 0.02595710000501791, "sim_compute_performance-ego": 0.042473860880131775, "sim_compute_robot_state-ego": 0.044956569143905944}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.5229259483384026, "sim_physics": 0.07456745820886948, "survival_time": 11.050000000000022, "driven_lanedir": 1.4564810558499484, "sim_render-ego": 0.038672405130722946, "in-drivable-lane": 0, "agent_compute-ego": 0.05388702202706316, "deviation-heading": 2.537620913913574, "set_robot_commands": 0.07075956612151132, "deviation-center-line": 0.7087408626389159, "driven_lanedir_consec": 1.4564810558499484, "sim_compute_sim_state": 0.02849553181574895, "sim_compute_performance-ego": 0.04548960142006162, "sim_compute_robot_state-ego": 0.05048958532411049}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 2.106584658062461, "sim_physics": 0.07986258427302043, "survival_time": 14.950000000000076, "driven_lanedir": 2.039208872438853, "sim_render-ego": 0.03862844467163086, "in-drivable-lane": 0, "agent_compute-ego": 0.05401053826014201, "deviation-heading": 2.6533864811867747, "set_robot_commands": 0.071475563844045, "deviation-center-line": 0.9494594762983838, "driven_lanedir_consec": 2.039208872438853, "sim_compute_sim_state": 0.029705804189046225, "sim_compute_performance-ego": 0.04792870362599691, "sim_compute_robot_state-ego": 0.05206767002741496}}
set_robot_commands_max0.071475563844045
set_robot_commands_mean0.064691946239326
set_robot_commands_median0.06298741896947226
set_robot_commands_min0.05826234976450602
sim_compute_performance-ego_max0.04792870362599691
sim_compute_performance-ego_mean0.04427735051057578
sim_compute_performance-ego_median0.04340080976486206
sim_compute_performance-ego_min0.04209377686182658
sim_compute_robot_state-ego_max0.05206767002741496
sim_compute_robot_state-ego_mean0.04797824116403989
sim_compute_robot_state-ego_median0.04722751379013061
sim_compute_robot_state-ego_min0.044956569143905944
sim_compute_sim_state_max0.029705804189046225
sim_compute_sim_state_mean0.02716826636583184
sim_compute_sim_state_median0.026256767114003494
sim_compute_sim_state_min0.02542612870534261
sim_physics_max0.07986258427302043
sim_physics_mean0.06787972481295294
sim_physics_median0.06626305023829142
sim_physics_min0.05845173120498657
sim_render-ego_max0.03927275021870931
sim_render-ego_mean0.038716773962869225
sim_render-ego_median0.03863433519999186
sim_render-ego_min0.03837593459329115
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean13.71000000000006
survival_time_min11.050000000000022
No reset possible
235963697Manfred Diazchallenge-aido_LF-template-tensorflowaido2-LFVI-sim-testingstep1-simulationerroryesip-172-31-38-104-81950:14:54
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
235313672Tony Hsu 🇹🇼Baseline solution using reinforcement learningaido2-LF-sim-validationstep1-simulationsuccessyesip-172-31-38-104-81950:07:30
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median-0.6826486805691453
survival_time_median6.499999999999985
deviation-center-line_median0.2581686887797329
in-drivable-lane_median2.5499999999999945


other stats
agent_compute-ego_max0.23849978630359356
agent_compute-ego_mean0.23716986463924808
agent_compute-ego_median0.2377555459961855
agent_compute-ego_min0.23553824424743652
deviation-center-line_max0.35961834310404656
deviation-center-line_mean0.22473175999111672
deviation-center-line_min0.07713763397341812
deviation-heading_max1.5584889794923484
deviation-heading_mean0.7339973707581253
deviation-heading_median0.4508343875841429
deviation-heading_min0.24962443260127012
driven_any_max2.449827318571936
driven_any_mean1.5618274620498216
driven_any_median1.849827318571977
driven_any_min0.6048280352423057
driven_lanedir_consec_max-0.23358305537327073
driven_lanedir_consec_mean-0.6947679106813627
driven_lanedir_consec_min-1.464400941246145
driven_lanedir_max-0.23358305537327073
driven_lanedir_mean-0.6947679106813627
driven_lanedir_median-0.6826486805691453
driven_lanedir_min-1.464400941246145
in-drivable-lane_max5.649999999999988
in-drivable-lane_mean2.6799999999999926
in-drivable-lane_min0.7999999999999989
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 2.449827318571936, "sim_physics": 0.0602187619489782, "survival_time": 8.499999999999986, "driven_lanedir": -0.7519324673460295, "sim_render-ego": 0.03619329789105584, "in-drivable-lane": 5.649999999999988, "agent_compute-ego": 0.23845627448138068, "deviation-heading": 0.24962443260127012, "set_robot_commands": 0.05500256033504711, "deviation-center-line": 0.35961834310404656, "driven_lanedir_consec": -0.7519324673460295, "sim_compute_sim_state": 0.024999329623054057, "sim_compute_performance-ego": 0.04044606264899759, "sim_compute_robot_state-ego": 0.0436049643684836}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.6048280352423057, "sim_physics": 0.06278461091061856, "survival_time": 2.3499999999999996, "driven_lanedir": -0.34127440887222266, "sim_render-ego": 0.038019504952938, "in-drivable-lane": 0.7999999999999989, "agent_compute-ego": 0.2355994721676441, "deviation-heading": 0.4508343875841429, "set_robot_commands": 0.055151619809739136, "deviation-center-line": 0.07713763397341812, "driven_lanedir_consec": -0.34127440887222266, "sim_compute_sim_state": 0.026381528123896172, "sim_compute_performance-ego": 0.03869092210810235, "sim_compute_robot_state-ego": 0.04506349563598633}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.8948273185719915, "sim_physics": 0.05894148260130918, "survival_time": 6.649999999999984, "driven_lanedir": -0.6826486805691453, "sim_render-ego": 0.03621622135764674, "in-drivable-lane": 3.4499999999999877, "agent_compute-ego": 0.2377555459961855, "deviation-heading": 1.5584889794923484, "set_robot_commands": 0.05586996472867808, "deviation-center-line": 0.2581686887797329, "driven_lanedir_consec": -0.6826486805691453, "sim_compute_sim_state": 0.024085801346857744, "sim_compute_performance-ego": 0.04159368608230935, "sim_compute_robot_state-ego": 0.04235796820848508}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.0098273192908982, "sim_physics": 0.06043777272507951, "survival_time": 3.699999999999995, "driven_lanedir": -0.23358305537327073, "sim_render-ego": 0.03707217525791477, "in-drivable-lane": 2.5499999999999945, "agent_compute-ego": 0.23553824424743652, "deviation-heading": 0.35479321536451575, "set_robot_commands": 0.056018603814614785, "deviation-center-line": 0.12362662790346164, "driven_lanedir_consec": -0.23358305537327073, "sim_compute_sim_state": 0.02363950819582553, "sim_compute_performance-ego": 0.040856844670063744, "sim_compute_robot_state-ego": 0.04236484540475381}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.849827318571977, "sim_physics": 0.05861117289616512, "survival_time": 6.499999999999985, "driven_lanedir": -1.464400941246145, "sim_render-ego": 0.03624730476966271, "in-drivable-lane": 0.9499999999999966, "agent_compute-ego": 0.23849978630359356, "deviation-heading": 1.056245838748349, "set_robot_commands": 0.05599433458768405, "deviation-center-line": 0.3051075061949243, "driven_lanedir_consec": -1.464400941246145, "sim_compute_sim_state": 0.024221486311692457, "sim_compute_performance-ego": 0.04094644693227915, "sim_compute_robot_state-ego": 0.04195879422701322}}
set_robot_commands_max0.056018603814614785
set_robot_commands_mean0.05560741665515263
set_robot_commands_median0.05586996472867808
set_robot_commands_min0.05500256033504711
sim_compute_performance-ego_max0.04159368608230935
sim_compute_performance-ego_mean0.04050679248835043
sim_compute_performance-ego_median0.040856844670063744
sim_compute_performance-ego_min0.03869092210810235
sim_compute_robot_state-ego_max0.04506349563598633
sim_compute_robot_state-ego_mean0.04307001356894441
sim_compute_robot_state-ego_median0.04236484540475381
sim_compute_robot_state-ego_min0.04195879422701322
sim_compute_sim_state_max0.026381528123896172
sim_compute_sim_state_mean0.02466553072026519
sim_compute_sim_state_median0.024221486311692457
sim_compute_sim_state_min0.02363950819582553
sim_physics_max0.06278461091061856
sim_physics_mean0.060198760216430114
sim_physics_median0.0602187619489782
sim_physics_min0.05861117289616512
sim_render-ego_max0.038019504952938
sim_render-ego_mean0.036749700845843614
sim_render-ego_median0.03624730476966271
sim_render-ego_min0.03619329789105584
simulation-passed1
survival_time_max8.499999999999986
survival_time_mean5.53999999999999
survival_time_min2.3499999999999996
No reset possible
235303671Tony Hsu 🇹🇼Baseline solution using reinforcement learningaido2-LF-sim-validationstep1-simulationsuccessyesip-172-31-38-104-81950:15:53
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.6642436660663087
survival_time_median14.950000000000076
deviation-center-line_median0.6127901567591342
in-drivable-lane_median0


other stats
agent_compute-ego_max0.34218456904093425
agent_compute-ego_mean0.3415056241048127
agent_compute-ego_median0.3416841395696004
agent_compute-ego_min0.3399956961895557
deviation-center-line_max1.3019541099294043
deviation-center-line_mean0.8511498118650721
deviation-center-line_min0.5066981329943391
deviation-heading_max4.055717681436225
deviation-heading_mean2.2639447928188265
deviation-heading_median2.4218493396621237
deviation-heading_min1.055344347110816
driven_any_max0.8769654767822298
driven_any_mean0.6687654736799274
driven_any_median0.8769654767821278
driven_any_min0.2619654676188363
driven_lanedir_consec_max0.8747874033840302
driven_lanedir_consec_mean0.6098641630266942
driven_lanedir_consec_min0.25444128804097765
driven_lanedir_max0.8747874033840302
driven_lanedir_mean0.6098641630266942
driven_lanedir_median0.6642436660663087
driven_lanedir_min0.25444128804097765
in-drivable-lane_max2.900000000000041
in-drivable-lane_mean0.5800000000000083
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.8769654767821669, "sim_physics": 0.05725287040074666, "survival_time": 14.950000000000076, "driven_lanedir": 0.6642436660663087, "sim_render-ego": 0.0364969801902771, "in-drivable-lane": 2.900000000000041, "agent_compute-ego": 0.34213475942611693, "deviation-heading": 2.6581344254089676, "set_robot_commands": 0.05543755372365316, "deviation-center-line": 0.6127901567591342, "driven_lanedir_consec": 0.6642436660663087, "sim_compute_sim_state": 0.02433251698811849, "sim_compute_performance-ego": 0.04072442452112834, "sim_compute_robot_state-ego": 0.042332228819529215}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.8769654767822298, "sim_physics": 0.0567271089553833, "survival_time": 14.950000000000076, "driven_lanedir": 0.8261690326522699, "sim_render-ego": 0.036037964820861815, "in-drivable-lane": 0, "agent_compute-ego": 0.3416841395696004, "deviation-heading": 4.055717681436225, "set_robot_commands": 0.0549937359491984, "deviation-center-line": 1.281715573033011, "driven_lanedir_consec": 0.8261690326522699, "sim_compute_sim_state": 0.02486409346262614, "sim_compute_performance-ego": 0.04115449746449788, "sim_compute_robot_state-ego": 0.042871346473693846}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.2619654676188363, "sim_physics": 0.05659596209830426, "survival_time": 4.699999999999991, "driven_lanedir": 0.25444128804097765, "sim_render-ego": 0.035589735558692444, "in-drivable-lane": 0, "agent_compute-ego": 0.3399956961895557, "deviation-heading": 1.128678170475998, "set_robot_commands": 0.05543308308783998, "deviation-center-line": 0.5066981329943391, "driven_lanedir_consec": 0.25444128804097765, "sim_compute_sim_state": 0.023814480355445377, "sim_compute_performance-ego": 0.04131417578839241, "sim_compute_robot_state-ego": 0.04131063501885597}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.4509654704342765, "sim_physics": 0.05842102561027381, "survival_time": 7.84999999999998, "driven_lanedir": 0.4296794249898848, "sim_render-ego": 0.0362675432946272, "in-drivable-lane": 0, "agent_compute-ego": 0.34152895629785623, "deviation-heading": 2.4218493396621237, "set_robot_commands": 0.05463498565042095, "deviation-center-line": 0.5525910866094718, "driven_lanedir_consec": 0.4296794249898848, "sim_compute_sim_state": 0.024779467066382142, "sim_compute_performance-ego": 0.03995154921416264, "sim_compute_robot_state-ego": 0.0430960488167538}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.8769654767821278, "sim_physics": 0.06038496414820353, "survival_time": 14.950000000000076, "driven_lanedir": 0.8747874033840302, "sim_render-ego": 0.036974581082661946, "in-drivable-lane": 0, "agent_compute-ego": 0.34218456904093425, "deviation-heading": 1.055344347110816, "set_robot_commands": 0.05528920968373616, "deviation-center-line": 1.3019541099294043, "driven_lanedir_consec": 0.8747874033840302, "sim_compute_sim_state": 0.024992005030314127, "sim_compute_performance-ego": 0.040080232620239256, "sim_compute_robot_state-ego": 0.04289302825927734}}
set_robot_commands_max0.05543755372365316
set_robot_commands_mean0.05515771361896974
set_robot_commands_median0.05528920968373616
set_robot_commands_min0.05463498565042095
sim_compute_performance-ego_max0.04131417578839241
sim_compute_performance-ego_mean0.040644975921684104
sim_compute_performance-ego_median0.04072442452112834
sim_compute_performance-ego_min0.03995154921416264
sim_compute_robot_state-ego_max0.0430960488167538
sim_compute_robot_state-ego_mean0.04250065747762203
sim_compute_robot_state-ego_median0.042871346473693846
sim_compute_robot_state-ego_min0.04131063501885597
sim_compute_sim_state_max0.024992005030314127
sim_compute_sim_state_mean0.024556512580577256
sim_compute_sim_state_median0.024779467066382142
sim_compute_sim_state_min0.023814480355445377
sim_physics_max0.06038496414820353
sim_physics_mean0.05787638624258231
sim_physics_median0.05725287040074666
sim_physics_min0.05659596209830426
sim_render-ego_max0.036974581082661946
sim_render-ego_mean0.036273360989424096
sim_render-ego_median0.0362675432946272
sim_render-ego_min0.035589735558692444
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean11.48000000000004
survival_time_min4.699999999999991
No reset possible
235103666FANG MEIYI 🇸🇬testaido2-LF-sim-validationstep1-simulationsuccessyesip-172-31-38-104-81950:12:17
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median3.0566895520678683
survival_time_median14.950000000000076
deviation-center-line_median0.8000481924773624
in-drivable-lane_median0


other stats
agent_compute-ego_max0.10815826108900169
agent_compute-ego_mean0.09800491875578456
agent_compute-ego_median0.09595902601877848
agent_compute-ego_min0.09449682394663492
deviation-center-line_max0.9689175181275544
deviation-center-line_mean0.7386418624785049
deviation-center-line_min0.21173064294001984
deviation-heading_max2.969979483570134
deviation-heading_mean1.969718573294534
deviation-heading_median2.204794915960431
deviation-heading_min0.7432315410724977
driven_any_max3.6030984300888127
driven_any_mean2.777493742886162
driven_any_median3.1420305121837586
driven_any_min0.5966368135905582
driven_lanedir_consec_max3.5789403542328433
driven_lanedir_consec_mean2.725238282649623
driven_lanedir_consec_min0.5689389373841223
driven_lanedir_max3.5789403542328433
driven_lanedir_mean2.725238282649623
driven_lanedir_median3.0566895520678683
driven_lanedir_min0.5689389373841223
in-drivable-lane_max0
in-drivable-lane_mean0
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.5966368135905582, "sim_physics": 0.06098366591889979, "survival_time": 2.9499999999999975, "driven_lanedir": 0.5689389373841223, "sim_render-ego": 0.03720683162495241, "in-drivable-lane": 0, "agent_compute-ego": 0.10815826108900169, "deviation-heading": 0.7432315410724977, "set_robot_commands": 0.05785312490948176, "deviation-center-line": 0.21173064294001984, "driven_lanedir_consec": 0.5689389373841223, "sim_compute_sim_state": 0.02393820326207048, "sim_compute_performance-ego": 0.04045956417665643, "sim_compute_robot_state-ego": 0.04205685954982952}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 3.6030984300888127, "sim_physics": 0.05728063662846883, "survival_time": 14.950000000000076, "driven_lanedir": 3.5789403542328433, "sim_render-ego": 0.03685953219731649, "in-drivable-lane": 0, "agent_compute-ego": 0.09449682394663492, "deviation-heading": 1.298282373510626, "set_robot_commands": 0.05678742647171021, "deviation-center-line": 0.7539995636423925, "driven_lanedir_consec": 3.5789403542328433, "sim_compute_sim_state": 0.024184927145640057, "sim_compute_performance-ego": 0.04091736634572347, "sim_compute_robot_state-ego": 0.04270686705907186}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 3.423343716595387, "sim_physics": 0.061343157291412355, "survival_time": 14.950000000000076, "driven_lanedir": 3.367575253355822, "sim_render-ego": 0.03681981245676677, "in-drivable-lane": 0, "agent_compute-ego": 0.09611534198125204, "deviation-heading": 2.204794915960431, "set_robot_commands": 0.057691887219746905, "deviation-center-line": 0.8000481924773624, "driven_lanedir_consec": 3.367575253355822, "sim_compute_sim_state": 0.023656593163808182, "sim_compute_performance-ego": 0.04082956234614055, "sim_compute_robot_state-ego": 0.04235322952270508}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 3.1223592419722954, "sim_physics": 0.060771422386169435, "survival_time": 14.950000000000076, "driven_lanedir": 3.0566895520678683, "sim_render-ego": 0.03698256492614746, "in-drivable-lane": 0, "agent_compute-ego": 0.0952951407432556, "deviation-heading": 2.6323045523589816, "set_robot_commands": 0.05785882790883382, "deviation-center-line": 0.9689175181275544, "driven_lanedir_consec": 3.0566895520678683, "sim_compute_sim_state": 0.023707932631174725, "sim_compute_performance-ego": 0.040625632603963215, "sim_compute_robot_state-ego": 0.04235120455423991}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 3.1420305121837586, "sim_physics": 0.06143288771311442, "survival_time": 14.950000000000076, "driven_lanedir": 3.0540473162074595, "sim_render-ego": 0.03673139333724976, "in-drivable-lane": 0, "agent_compute-ego": 0.09595902601877848, "deviation-heading": 2.969979483570134, "set_robot_commands": 0.05742727120717366, "deviation-center-line": 0.9585133952051956, "driven_lanedir_consec": 3.0540473162074595, "sim_compute_sim_state": 0.02398708740870158, "sim_compute_performance-ego": 0.041267796357472734, "sim_compute_robot_state-ego": 0.04210669199625651}}
set_robot_commands_max0.05785882790883382
set_robot_commands_mean0.05752370754338927
set_robot_commands_median0.057691887219746905
set_robot_commands_min0.05678742647171021
sim_compute_performance-ego_max0.041267796357472734
sim_compute_performance-ego_mean0.04081998436599128
sim_compute_performance-ego_median0.04082956234614055
sim_compute_performance-ego_min0.04045956417665643
sim_compute_robot_state-ego_max0.04270686705907186
sim_compute_robot_state-ego_mean0.04231497053642057
sim_compute_robot_state-ego_median0.04235120455423991
sim_compute_robot_state-ego_min0.04205685954982952
sim_compute_sim_state_max0.024184927145640057
sim_compute_sim_state_mean0.023894948722279003
sim_compute_sim_state_median0.02393820326207048
sim_compute_sim_state_min0.023656593163808182
sim_physics_max0.06143288771311442
sim_physics_mean0.06036235398761296
sim_physics_median0.06098366591889979
sim_physics_min0.05728063662846883
sim_render-ego_max0.03720683162495241
sim_render-ego_mean0.03692002690848657
sim_render-ego_median0.03685953219731649
sim_render-ego_min0.03673139333724976
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean12.55000000000006
survival_time_min2.9499999999999975
No reset possible
235023664Hui-Kuo Yang 🇹🇼Baseline solution using reinforcement learningaido2-LF-sim-validationstep1-simulationerroryesip-172-31-38-104-81950:00:27
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
234883661jiang pengRL-TH-xyzaido2-LF-sim-validationstep1-simulationsuccessyesip-172-31-38-104-81950:07:24
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.2716505619864509
survival_time_median6.8999999999999835
deviation-center-line_median0.2447015744035076
in-drivable-lane_median1.649999999999994


other stats
agent_compute-ego_max0.10284648945457056
agent_compute-ego_mean0.10208125807517653
agent_compute-ego_median0.10224942366282146
agent_compute-ego_min0.10141625139448378
deviation-center-line_max0.3233946791443165
deviation-center-line_mean0.25269386695357127
deviation-center-line_min0.2035165316000184
deviation-heading_max1.0865573324409477
deviation-heading_mean0.7514760261389386
deviation-heading_median0.652792515157392
deviation-heading_min0.38168788924040487
driven_any_max2.572039895430136
driven_any_mean1.5937171668276118
driven_any_median1.6059482679887973
driven_any_min1.0189512979685746
driven_lanedir_consec_max1.404956996152074
driven_lanedir_consec_mean1.0980602133100767
driven_lanedir_consec_min0.66575836897275
driven_lanedir_max1.404956996152074
driven_lanedir_mean1.0980602133100767
driven_lanedir_median1.2716505619864509
driven_lanedir_min0.66575836897275
in-drivable-lane_max4.900000000000032
in-drivable-lane_mean1.9400000000000035
in-drivable-lane_min0.6999999999999975
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0800965569347067, "sim_physics": 0.05950226281818591, "survival_time": 4.749999999999991, "driven_lanedir": 0.66575836897275, "sim_render-ego": 0.036840777648122686, "in-drivable-lane": 1.649999999999994, "agent_compute-ego": 0.10284648945457056, "deviation-heading": 0.38168788924040487, "set_robot_commands": 0.05676897450497276, "deviation-center-line": 0.2758536730512279, "driven_lanedir_consec": 0.66575836897275, "sim_compute_sim_state": 0.02391592075950221, "sim_compute_performance-ego": 0.04063398963526676, "sim_compute_robot_state-ego": 0.042379682942440634}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.0189512979685746, "sim_physics": 0.05752625200483534, "survival_time": 4.499999999999992, "driven_lanedir": 0.8074827780868857, "sim_render-ego": 0.037110757827758786, "in-drivable-lane": 0.7999999999999972, "agent_compute-ego": 0.10141625139448378, "deviation-heading": 0.652792515157392, "set_robot_commands": 0.05637216567993164, "deviation-center-line": 0.2035165316000184, "driven_lanedir_consec": 0.8074827780868857, "sim_compute_sim_state": 0.02396213478512234, "sim_compute_performance-ego": 0.04003926383124457, "sim_compute_robot_state-ego": 0.04280171129438612}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.6059482679887973, "sim_physics": 0.05793840643288432, "survival_time": 6.8999999999999835, "driven_lanedir": 1.404956996152074, "sim_render-ego": 0.03703906570655712, "in-drivable-lane": 0.6999999999999975, "agent_compute-ego": 0.10224942366282146, "deviation-heading": 1.0865573324409477, "set_robot_commands": 0.05609669028848842, "deviation-center-line": 0.3233946791443165, "driven_lanedir_consec": 1.404956996152074, "sim_compute_sim_state": 0.024211627849634144, "sim_compute_performance-ego": 0.04117174597753995, "sim_compute_robot_state-ego": 0.04255924708601357}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 2.572039895430136, "sim_physics": 0.061171860189481814, "survival_time": 10.85000000000002, "driven_lanedir": 1.3404523613522228, "sim_render-ego": 0.03704599191516226, "in-drivable-lane": 4.900000000000032, "agent_compute-ego": 0.1016150103186682, "deviation-heading": 0.9960906661348286, "set_robot_commands": 0.05691262544025474, "deviation-center-line": 0.216002876568786, "driven_lanedir_consec": 1.3404523613522228, "sim_compute_sim_state": 0.024369551838817685, "sim_compute_performance-ego": 0.040282176936277045, "sim_compute_robot_state-ego": 0.042438179666545534}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.691549815815845, "sim_physics": 0.05824106150660022, "survival_time": 7.249999999999982, "driven_lanedir": 1.2716505619864509, "sim_render-ego": 0.03682125683488517, "in-drivable-lane": 1.649999999999994, "agent_compute-ego": 0.1022791155453386, "deviation-heading": 0.6402517277211202, "set_robot_commands": 0.0579462692655366, "deviation-center-line": 0.2447015744035076, "driven_lanedir_consec": 1.2716505619864509, "sim_compute_sim_state": 0.02404162965971848, "sim_compute_performance-ego": 0.040504590396223394, "sim_compute_robot_state-ego": 0.04249955045765843}}
set_robot_commands_max0.0579462692655366
set_robot_commands_mean0.056819345035836834
set_robot_commands_median0.05676897450497276
set_robot_commands_min0.05609669028848842
sim_compute_performance-ego_max0.04117174597753995
sim_compute_performance-ego_mean0.04052635335531034
sim_compute_performance-ego_median0.040504590396223394
sim_compute_performance-ego_min0.04003926383124457
sim_compute_robot_state-ego_max0.04280171129438612
sim_compute_robot_state-ego_mean0.04253567428940886
sim_compute_robot_state-ego_median0.04249955045765843
sim_compute_robot_state-ego_min0.042379682942440634
sim_compute_sim_state_max0.024369551838817685
sim_compute_sim_state_mean0.024100172978558973
sim_compute_sim_state_median0.02404162965971848
sim_compute_sim_state_min0.02391592075950221
sim_physics_max0.061171860189481814
sim_physics_mean0.05887596859039752
sim_physics_median0.05824106150660022
sim_physics_min0.05752625200483534
sim_render-ego_max0.037110757827758786
sim_render-ego_mean0.0369715699864972
sim_render-ego_median0.03703906570655712
sim_render-ego_min0.03682125683488517
simulation-passed1
survival_time_max10.85000000000002
survival_time_mean6.849999999999994
survival_time_min4.499999999999992
No reset possible
234813658FANG MEIYI 🇸🇬testaido2-LFV-sim-testingstep1-simulationerroryesip-172-31-38-104-81950:40:47
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
234673655jiang pengRL-TH-xyzaido2-LF-sim-validationstep1-simulationerroryesip-172-31-38-104-81950:01:36
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
234563650FANG MEIYI 🇸🇬testaido2-LFV-sim-validationstep1-simulationsuccessyesip-172-31-38-104-81950:18:14
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median2.875832145594744
survival_time_median14.950000000000076
deviation-center-line_median0.6069514178093958
in-drivable-lane_median0


other stats
agent_compute-ego_max0.09577773651986753
agent_compute-ego_mean0.0940212717086264
agent_compute-ego_median0.09340290546417236
agent_compute-ego_min0.0932431666056315
deviation-center-line_max0.9448837385551468
deviation-center-line_mean0.6474866379345012
deviation-center-line_min0.2907610385363255
deviation-heading_max3.4417527969793023
deviation-heading_mean2.273883328415077
deviation-heading_median2.399621758834101
deviation-heading_min0.6881627241759958
driven_any_max3.226342904209878
driven_any_mean2.628165124376695
driven_any_median2.9467589306029436
driven_any_min1.1461805701796384
driven_lanedir_consec_max3.185897978423222
driven_lanedir_consec_mean2.5709040894270325
driven_lanedir_consec_min1.1276421764450857
driven_lanedir_max3.185897978423222
driven_lanedir_mean2.5709040894270325
driven_lanedir_median2.875832145594744
driven_lanedir_min1.1276421764450857
in-drivable-lane_max0
in-drivable-lane_mean0
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 2.8681342173857223, "sim_physics": 0.09564684152603148, "survival_time": 14.950000000000076, "driven_lanedir": 2.761915970364638, "sim_render-ego": 0.03706425269444784, "in-drivable-lane": 0, "agent_compute-ego": 0.09441913366317747, "deviation-heading": 3.4417527969793023, "set_robot_commands": 0.056747674147288006, "deviation-center-line": 0.9448837385551468, "driven_lanedir_consec": 2.761915970364638, "sim_compute_sim_state": 0.023119885921478272, "sim_compute_performance-ego": 0.0399861478805542, "sim_compute_robot_state-ego": 0.0427366296450297, "sim_compute_robot_state-npc0": 0.04169817050298055, "sim_compute_robot_state-npc1": 0.04068521499633789, "sim_compute_robot_state-npc2": 0.040513075192769366, "sim_compute_robot_state-npc3": 0.04048619111378988}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 3.226342904209878, "sim_physics": 0.09832290649414062, "survival_time": 14.950000000000076, "driven_lanedir": 3.185897978423222, "sim_render-ego": 0.03640777746836344, "in-drivable-lane": 0, "agent_compute-ego": 0.0932634162902832, "deviation-heading": 2.0524909725929343, "set_robot_commands": 0.05644656260808309, "deviation-center-line": 0.5947986358961092, "driven_lanedir_consec": 3.185897978423222, "sim_compute_sim_state": 0.023140071233113606, "sim_compute_performance-ego": 0.041030884583791095, "sim_compute_robot_state-ego": 0.043180012702941896, "sim_compute_robot_state-npc0": 0.04221584002176921, "sim_compute_robot_state-npc1": 0.0407292636235555, "sim_compute_robot_state-npc2": 0.040341094334920245, "sim_compute_robot_state-npc3": 0.040589478015899655}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 2.9467589306029436, "sim_physics": 0.09350997845331828, "survival_time": 14.950000000000076, "driven_lanedir": 2.875832145594744, "sim_render-ego": 0.036616048018137615, "in-drivable-lane": 0, "agent_compute-ego": 0.0932431666056315, "deviation-heading": 2.787388389493054, "set_robot_commands": 0.05587346235911051, "deviation-center-line": 0.8000383588755289, "driven_lanedir_consec": 2.875832145594744, "sim_compute_sim_state": 0.022854170004526775, "sim_compute_performance-ego": 0.03955451567967733, "sim_compute_robot_state-ego": 0.04194686571756999, "sim_compute_robot_state-npc0": 0.041242364247639975, "sim_compute_robot_state-npc1": 0.0405605133374532, "sim_compute_robot_state-npc2": 0.04028119246164958, "sim_compute_robot_state-npc3": 0.04029939730962118}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.1461805701796384, "sim_physics": 0.1003644713815653, "survival_time": 5.299999999999989, "driven_lanedir": 1.1276421764450857, "sim_render-ego": 0.03688864213115764, "in-drivable-lane": 0, "agent_compute-ego": 0.09577773651986753, "deviation-heading": 0.6881627241759958, "set_robot_commands": 0.05569437989648783, "deviation-center-line": 0.2907610385363255, "driven_lanedir_consec": 1.1276421764450857, "sim_compute_sim_state": 0.022728159742535285, "sim_compute_performance-ego": 0.039778363029911834, "sim_compute_robot_state-ego": 0.04159190744723914, "sim_compute_robot_state-npc0": 0.041463082691408554, "sim_compute_robot_state-npc1": 0.03988920742610715, "sim_compute_robot_state-npc2": 0.04047644588182557, "sim_compute_robot_state-npc3": 0.03973420610967672}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 2.953408999505292, "sim_physics": 0.08775602261225382, "survival_time": 14.950000000000076, "driven_lanedir": 2.90323217630747, "sim_render-ego": 0.03600869258244832, "in-drivable-lane": 0, "agent_compute-ego": 0.09340290546417236, "deviation-heading": 2.399621758834101, "set_robot_commands": 0.05573075771331787, "deviation-center-line": 0.6069514178093958, "driven_lanedir_consec": 2.90323217630747, "sim_compute_sim_state": 0.023192698955535888, "sim_compute_performance-ego": 0.039416490395863854, "sim_compute_robot_state-ego": 0.04150325854619344, "sim_compute_robot_state-npc0": 0.04084794998168945, "sim_compute_robot_state-npc1": 0.04029186089833577, "sim_compute_robot_state-npc2": 0.039770573774973554, "sim_compute_robot_state-npc3": 0.040068914890289305}}
set_robot_commands_max0.056747674147288006
set_robot_commands_mean0.056098567344857464
set_robot_commands_median0.05587346235911051
set_robot_commands_min0.05569437989648783
sim_compute_performance-ego_max0.041030884583791095
sim_compute_performance-ego_mean0.03995328031395966
sim_compute_performance-ego_median0.039778363029911834
sim_compute_performance-ego_min0.039416490395863854
sim_compute_robot_state-ego_max0.043180012702941896
sim_compute_robot_state-ego_mean0.042191734811794834
sim_compute_robot_state-ego_median0.04194686571756999
sim_compute_robot_state-ego_min0.04150325854619344
sim_compute_robot_state-npc0_max0.04221584002176921
sim_compute_robot_state-npc0_mean0.041493481489097546
sim_compute_robot_state-npc0_median0.041463082691408554
sim_compute_robot_state-npc0_min0.04084794998168945
sim_compute_robot_state-npc1_max0.0407292636235555
sim_compute_robot_state-npc1_mean0.040431212056357906
sim_compute_robot_state-npc1_median0.0405605133374532
sim_compute_robot_state-npc1_min0.03988920742610715
sim_compute_robot_state-npc2_max0.040513075192769366
sim_compute_robot_state-npc2_mean0.040276476329227665
sim_compute_robot_state-npc2_median0.040341094334920245
sim_compute_robot_state-npc2_min0.039770573774973554
sim_compute_robot_state-npc3_max0.040589478015899655
sim_compute_robot_state-npc3_mean0.040235637487855344
sim_compute_robot_state-npc3_median0.04029939730962118
sim_compute_robot_state-npc3_min0.03973420610967672
sim_compute_sim_state_max0.023192698955535888
sim_compute_sim_state_mean0.02300699717143797
sim_compute_sim_state_median0.023119885921478272
sim_compute_sim_state_min0.022728159742535285
sim_physics_max0.1003644713815653
sim_physics_mean0.0951200440934619
sim_physics_median0.09564684152603148
sim_physics_min0.08775602261225382
sim_render-ego_max0.03706425269444784
sim_render-ego_mean0.03659708257891097
sim_render-ego_median0.036616048018137615
sim_render-ego_min0.03600869258244832
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean13.020000000000062
survival_time_min5.299999999999989
No reset possible
233973630Nicky Eichmannaido2-LFV-sim-validationstep1-simulationsuccessyesip-172-31-38-104-81950:18:18
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.6697553564194623
survival_time_median2.9999999999999973
deviation-center-line_median0.11447341980984076
in-drivable-lane_median0.5999999999999979


other stats
agent_compute-ego_max0.18232433206027315
agent_compute-ego_mean0.1790441273971112
agent_compute-ego_median0.18156765699386596
agent_compute-ego_min0.1704831918080648
deviation-center-line_max1.2014897108761136
deviation-center-line_mean0.3920810192933445
deviation-center-line_min0.060729943710471815
deviation-heading_max4.104723098073349
deviation-heading_mean1.739374497369051
deviation-heading_median0.385143276702924
deviation-heading_min0.26386254410083276
driven_any_max4.195250725420027
driven_any_mean1.660108235317677
driven_any_median1.59965468873004
driven_any_min0.395863871925736
driven_lanedir_consec_max2.1916754525991835
driven_lanedir_consec_mean0.9830364490092398
driven_lanedir_consec_min0.3821716634736127
driven_lanedir_max3.863920776131067
driven_lanedir_mean1.4656675803279549
driven_lanedir_median1.2187176370157662
driven_lanedir_min0.3821716634736127
in-drivable-lane_max1.599999999999996
in-drivable-lane_mean0.7099999999999982
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.63324936491237, "sim_physics": 0.17817485455385187, "survival_time": 9.700000000000005, "driven_lanedir": 1.4106656894811538, "sim_render-ego": 0.06482639263585671, "in-drivable-lane": 1.349999999999997, "agent_compute-ego": 0.18232433206027315, "deviation-heading": 3.6638367185139735, "set_robot_commands": 0.10242250039405427, "deviation-center-line": 0.4976721883398765, "driven_lanedir_consec": 0.6697553564194623, "sim_compute_sim_state": 0.0416782762586456, "sim_compute_performance-ego": 0.07408169372794554, "sim_compute_robot_state-ego": 0.07955620829592046, "sim_compute_robot_state-npc0": 0.07251564497800217, "sim_compute_robot_state-npc1": 0.07311698702192798, "sim_compute_robot_state-npc2": 0.07353804406431533, "sim_compute_robot_state-npc3": 0.07217343566343956}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.47652252560021285, "sim_physics": 0.2138379911581675, "survival_time": 1.2000000000000004, "driven_lanedir": 0.45286213553817456, "sim_render-ego": 0.06737763683001201, "in-drivable-lane": 0, "agent_compute-ego": 0.1704831918080648, "deviation-heading": 0.385143276702924, "set_robot_commands": 0.1014177401860555, "deviation-center-line": 0.08603983373041983, "driven_lanedir_consec": 0.45286213553817456, "sim_compute_sim_state": 0.042846232652664185, "sim_compute_performance-ego": 0.07414995630582173, "sim_compute_robot_state-ego": 0.08128565549850464, "sim_compute_robot_state-npc0": 0.07844612995783488, "sim_compute_robot_state-npc1": 0.08256131410598755, "sim_compute_robot_state-npc2": 0.0770610769589742, "sim_compute_robot_state-npc3": 0.07518879572550456}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 4.195250725420027, "sim_physics": 0.19054237365722657, "survival_time": 14.950000000000076, "driven_lanedir": 3.863920776131067, "sim_render-ego": 0.06343243757883708, "in-drivable-lane": 1.599999999999996, "agent_compute-ego": 0.18214876413345335, "deviation-heading": 4.104723098073349, "set_robot_commands": 0.10018253882726032, "deviation-center-line": 1.2014897108761136, "driven_lanedir_consec": 2.1916754525991835, "sim_compute_sim_state": 0.04082900762557983, "sim_compute_performance-ego": 0.07220370054244996, "sim_compute_robot_state-ego": 0.08045154015223185, "sim_compute_robot_state-npc0": 0.07216775973637898, "sim_compute_robot_state-npc1": 0.0740470854441325, "sim_compute_robot_state-npc2": 0.0731364115079244, "sim_compute_robot_state-npc3": 0.07342266480127971}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.59965468873004, "sim_physics": 0.18647064367930097, "survival_time": 2.9999999999999973, "driven_lanedir": 1.2187176370157662, "sim_render-ego": 0.06578483581542968, "in-drivable-lane": 0.5999999999999979, "agent_compute-ego": 0.18156765699386596, "deviation-heading": 0.2793068494541745, "set_robot_commands": 0.09891111056009928, "deviation-center-line": 0.11447341980984076, "driven_lanedir_consec": 1.2187176370157662, "sim_compute_sim_state": 0.04218066136042277, "sim_compute_performance-ego": 0.07188159624735514, "sim_compute_robot_state-ego": 0.07628792921702067, "sim_compute_robot_state-npc0": 0.07367452383041381, "sim_compute_robot_state-npc1": 0.07152643998463949, "sim_compute_robot_state-npc2": 0.07362274726231893, "sim_compute_robot_state-npc3": 0.07284259796142578}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.395863871925736, "sim_physics": 0.2092786908149719, "survival_time": 1.0000000000000002, "driven_lanedir": 0.3821716634736127, "sim_render-ego": 0.06693024635314941, "in-drivable-lane": 0, "agent_compute-ego": 0.17869669198989868, "deviation-heading": 0.26386254410083276, "set_robot_commands": 0.09791141748428343, "deviation-center-line": 0.060729943710471815, "driven_lanedir_consec": 0.3821716634736127, "sim_compute_sim_state": 0.03968710899353027, "sim_compute_performance-ego": 0.07550700902938842, "sim_compute_robot_state-ego": 0.08728275299072266, "sim_compute_robot_state-npc0": 0.06877789497375489, "sim_compute_robot_state-npc1": 0.06725764274597168, "sim_compute_robot_state-npc2": 0.06685656309127808, "sim_compute_robot_state-npc3": 0.07465946674346924}}
set_robot_commands_max0.10242250039405427
set_robot_commands_mean0.10016906149035056
set_robot_commands_median0.10018253882726032
set_robot_commands_min0.09791141748428343
sim_compute_performance-ego_max0.07550700902938842
sim_compute_performance-ego_mean0.07356479117059216
sim_compute_performance-ego_median0.07408169372794554
sim_compute_performance-ego_min0.07188159624735514
sim_compute_robot_state-ego_max0.08728275299072266
sim_compute_robot_state-ego_mean0.08097281723088005
sim_compute_robot_state-ego_median0.08045154015223185
sim_compute_robot_state-ego_min0.07628792921702067
sim_compute_robot_state-npc0_max0.07844612995783488
sim_compute_robot_state-npc0_mean0.07311639069527695
sim_compute_robot_state-npc0_median0.07251564497800217
sim_compute_robot_state-npc0_min0.06877789497375489
sim_compute_robot_state-npc1_max0.08256131410598755
sim_compute_robot_state-npc1_mean0.07370189386053184
sim_compute_robot_state-npc1_median0.07311698702192798
sim_compute_robot_state-npc1_min0.06725764274597168
sim_compute_robot_state-npc2_max0.0770610769589742
sim_compute_robot_state-npc2_mean0.07284296857696218
sim_compute_robot_state-npc2_median0.07353804406431533
sim_compute_robot_state-npc2_min0.06685656309127808
sim_compute_robot_state-npc3_max0.07518879572550456
sim_compute_robot_state-npc3_mean0.07365739217902376
sim_compute_robot_state-npc3_median0.07342266480127971
sim_compute_robot_state-npc3_min0.07217343566343956
sim_compute_sim_state_max0.042846232652664185
sim_compute_sim_state_mean0.041444257378168536
sim_compute_sim_state_median0.0416782762586456
sim_compute_sim_state_min0.03968710899353027
sim_physics_max0.2138379911581675
sim_physics_mean0.19566091077270376
sim_physics_median0.19054237365722657
sim_physics_min0.17817485455385187
sim_render-ego_max0.06737763683001201
sim_render-ego_mean0.065670309842657
sim_render-ego_median0.06578483581542968
sim_render-ego_min0.06343243757883708
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean5.970000000000015
survival_time_min1.0000000000000002
No reset possible
233273601Victor Adolfo Romero Cano 🇨🇴aido2-LFVI-sim-validationstep1-simulationsuccessyesip-172-31-38-104-81950:07:25
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.493517638549009
survival_time_median2.3999999999999995
deviation-center-line_median0.09791133281082
in-drivable-lane_median0.549999999999998


other stats
agent_compute-ego_max0.12238176379884992
agent_compute-ego_mean0.12073286167581246
agent_compute-ego_median0.12109008921852596
agent_compute-ego_min0.1184714294615246
deviation-center-line_max0.2348196785686717
deviation-center-line_mean0.13547481992266058
deviation-center-line_min0.06216029860587694
deviation-heading_max0.8115272458314897
deviation-heading_mean0.49959867397150787
deviation-heading_median0.46504862964833654
deviation-heading_min0.30044835691402494
driven_any_max2.1864003300000694
driven_any_mean1.1068208197848532
driven_any_median0.9410513078477724
driven_any_min0.34749292376309954
driven_lanedir_consec_max1.826231945363564
driven_lanedir_consec_mean0.804744013449103
driven_lanedir_consec_min0.3325249708009643
driven_lanedir_max1.826231945363564
driven_lanedir_mean0.804828147320482
driven_lanedir_median0.493517638549009
driven_lanedir_min0.3325249708009643
in-drivable-lane_max1.3499999999999952
in-drivable-lane_mean0.5599999999999984
in-drivable-lane_min0
per-episodes
details{"udem1-0-0": {"driven_any": 1.5811782993597916, "sim_physics": 0.15567465069927747, "survival_time": 3.949999999999994, "driven_lanedir": 0.9217908232230632, "sim_render-ego": 0.04951083811023568, "in-drivable-lane": 1.3499999999999952, "agent_compute-ego": 0.12109008921852596, "deviation-heading": 0.5694288623982039, "set_robot_commands": 0.07237382780147504, "deviation-center-line": 0.2348196785686717, "driven_lanedir_consec": 0.9213701538661684, "sim_compute_sim_state": 0.029739075069186053, "sim_compute_performance-ego": 0.053876852687401104, "sim_compute_robot_state-ego": 0.05687181859076777, "sim_compute_robot_state-npc0": 0.05380977256388604, "sim_compute_robot_state-npc1": 0.05413021920602533, "sim_compute_robot_state-npc2": 0.05286799201482459, "sim_compute_robot_state-npc3": 0.05345060251936128}, "udem1-1-0": {"driven_any": 0.47798123795353353, "sim_physics": 0.15063682624271937, "survival_time": 1.4000000000000006, "driven_lanedir": 0.4500753586658095, "sim_render-ego": 0.04413501705442156, "in-drivable-lane": 0, "agent_compute-ego": 0.12238176379884992, "deviation-heading": 0.46504862964833654, "set_robot_commands": 0.07063668114798409, "deviation-center-line": 0.09791133281082, "driven_lanedir_consec": 0.4500753586658095, "sim_compute_sim_state": 0.030832460948399136, "sim_compute_performance-ego": 0.0536426135471889, "sim_compute_robot_state-ego": 0.07304881300245013, "sim_compute_robot_state-npc0": 0.05389633349009922, "sim_compute_robot_state-npc1": 0.05117864268166678, "sim_compute_robot_state-npc2": 0.05334403685161045, "sim_compute_robot_state-npc3": 0.05224385431834629}, "udem1-2-0": {"driven_any": 2.1864003300000694, "sim_physics": 0.14476219658712738, "survival_time": 5.14999999999999, "driven_lanedir": 1.826231945363564, "sim_render-ego": 0.05486726760864258, "in-drivable-lane": 0.549999999999998, "agent_compute-ego": 0.11987009326231132, "deviation-heading": 0.8115272458314897, "set_robot_commands": 0.07189440495759539, "deviation-center-line": 0.1927316041609401, "driven_lanedir_consec": 1.826231945363564, "sim_compute_sim_state": 0.029779769841907097, "sim_compute_performance-ego": 0.053934085716321634, "sim_compute_robot_state-ego": 0.05564596815016663, "sim_compute_robot_state-npc0": 0.05332775949274452, "sim_compute_robot_state-npc1": 0.05178909625821901, "sim_compute_robot_state-npc2": 0.05781273471498952, "sim_compute_robot_state-npc3": 0.052253579630435094}, "udem1-3-0": {"driven_any": 0.9410513078477724, "sim_physics": 0.15443012615044913, "survival_time": 2.3999999999999995, "driven_lanedir": 0.493517638549009, "sim_render-ego": 0.0474599152803421, "in-drivable-lane": 0.8999999999999988, "agent_compute-ego": 0.12185093263785043, "deviation-heading": 0.35154027506548424, "set_robot_commands": 0.07704814771811168, "deviation-center-line": 0.08975118546699407, "driven_lanedir_consec": 0.493517638549009, "sim_compute_sim_state": 0.02955976128578186, "sim_compute_performance-ego": 0.05350936452547709, "sim_compute_robot_state-ego": 0.05878822008768717, "sim_compute_robot_state-npc0": 0.05492584407329559, "sim_compute_robot_state-npc1": 0.05308798452218374, "sim_compute_robot_state-npc2": 0.054682706793149315, "sim_compute_robot_state-npc3": 0.05256756146748861}, "udem1-4-0": {"driven_any": 0.34749292376309954, "sim_physics": 0.14996260688418434, "survival_time": 1.0500000000000005, "driven_lanedir": 0.3325249708009643, "sim_render-ego": 0.04708605720883324, "in-drivable-lane": 0, "agent_compute-ego": 0.1184714294615246, "deviation-heading": 0.30044835691402494, "set_robot_commands": 0.07113661084856306, "deviation-center-line": 0.06216029860587694, "driven_lanedir_consec": 0.3325249708009643, "sim_compute_sim_state": 0.03099935395377023, "sim_compute_performance-ego": 0.05382235844930013, "sim_compute_robot_state-ego": 0.05617092904590425, "sim_compute_robot_state-npc0": 0.0573054381779262, "sim_compute_robot_state-npc1": 0.05603303228105817, "sim_compute_robot_state-npc2": 0.05441466967264811, "sim_compute_robot_state-npc3": 0.0562785580044701}}
set_robot_commands_max0.07704814771811168
set_robot_commands_mean0.07261793449474585
set_robot_commands_median0.07189440495759539
set_robot_commands_min0.07063668114798409
sim_compute_performance-ego_max0.053934085716321634
sim_compute_performance-ego_mean0.05375705498513776
sim_compute_performance-ego_median0.05382235844930013
sim_compute_performance-ego_min0.05350936452547709
sim_compute_robot_state-ego_max0.07304881300245013
sim_compute_robot_state-ego_mean0.06010514977539518
sim_compute_robot_state-ego_median0.05687181859076777
sim_compute_robot_state-ego_min0.05564596815016663
sim_compute_robot_state-npc0_max0.0573054381779262
sim_compute_robot_state-npc0_mean0.05465302955959032
sim_compute_robot_state-npc0_median0.05389633349009922
sim_compute_robot_state-npc0_min0.05332775949274452
sim_compute_robot_state-npc1_max0.05603303228105817
sim_compute_robot_state-npc1_mean0.0532437949898306
sim_compute_robot_state-npc1_median0.05308798452218374
sim_compute_robot_state-npc1_min0.05117864268166678
sim_compute_robot_state-npc2_max0.05781273471498952
sim_compute_robot_state-npc2_mean0.054624428009444406
sim_compute_robot_state-npc2_median0.05441466967264811
sim_compute_robot_state-npc2_min0.05286799201482459
sim_compute_robot_state-npc3_max0.0562785580044701
sim_compute_robot_state-npc3_mean0.053358831188020275
sim_compute_robot_state-npc3_median0.05256756146748861
sim_compute_robot_state-npc3_min0.05224385431834629
sim_compute_sim_state_max0.03099935395377023
sim_compute_sim_state_mean0.03018208421980887
sim_compute_sim_state_median0.029779769841907097
sim_compute_sim_state_min0.02955976128578186
sim_physics_max0.15567465069927747
sim_physics_mean0.15109328131275154
sim_physics_median0.15063682624271937
sim_physics_min0.14476219658712738
sim_render-ego_max0.05486726760864258
sim_render-ego_mean0.04861181905249503
sim_render-ego_median0.0474599152803421
sim_render-ego_min0.04413501705442156
simulation-passed1
survival_time_max5.14999999999999
survival_time_mean2.789999999999997
survival_time_min1.0500000000000005
No reset possible
233183591Anastasiya Nikolskaya 🇷🇺Submission 01aido2-LF-sim-validationstep1-simulationsuccessyesip-172-31-38-104-81950:16:25
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median2.4055509321567055
survival_time_median14.950000000000076
deviation-center-line_median1.012052427002036
in-drivable-lane_median1.5499999999999945


other stats
agent_compute-ego_max0.23205574720333785
agent_compute-ego_mean0.13571118157949205
agent_compute-ego_median0.1591726811726888
agent_compute-ego_min0.06225216627120972
deviation-center-line_max1.2938441457795835
deviation-center-line_mean1.0126764862762063
deviation-center-line_min0.7453848580572333
deviation-heading_max3.244287913887844
deviation-heading_mean2.176587315606926
deviation-heading_median2.0927185696562045
deviation-heading_min1.1813024775899617
driven_any_max2.7577232052151692
driven_any_mean2.55966563875203
driven_any_median2.7576664736375385
driven_any_min1.7765734299255234
driven_lanedir_consec_max2.6862863278014255
driven_lanedir_consec_mean2.3228628647401597
driven_lanedir_consec_min1.7485682235280542
driven_lanedir_max2.6862863278014255
driven_lanedir_mean2.3228628647401597
driven_lanedir_median2.4055509321567055
driven_lanedir_min1.7485682235280542
in-drivable-lane_max1.550000000000022
in-drivable-lane_mean0.9300000000000044
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 2.748676758283861, "sim_physics": 0.07020657857259115, "survival_time": 14.950000000000076, "driven_lanedir": 2.4055509321567055, "sim_render-ego": 0.039527182579040525, "in-drivable-lane": 1.550000000000022, "agent_compute-ego": 0.06397287527720133, "deviation-heading": 2.0927185696562045, "set_robot_commands": 0.06632815519968668, "deviation-center-line": 1.0381481905981165, "driven_lanedir_consec": 2.4055509321567055, "sim_compute_sim_state": 0.027379529476165773, "sim_compute_performance-ego": 0.045120027065277096, "sim_compute_robot_state-ego": 0.04968891064325968}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 2.757688326698057, "sim_physics": 0.06098102251688639, "survival_time": 14.950000000000076, "driven_lanedir": 2.342494392672166, "sim_render-ego": 0.03849021991093953, "in-drivable-lane": 1.5499999999999945, "agent_compute-ego": 0.1591726811726888, "deviation-heading": 3.244287913887844, "set_robot_commands": 0.05869038263956706, "deviation-center-line": 1.012052427002036, "driven_lanedir_consec": 2.342494392672166, "sim_compute_sim_state": 0.02552770455678304, "sim_compute_performance-ego": 0.04269798278808594, "sim_compute_robot_state-ego": 0.045367733637491865}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 2.7577232052151692, "sim_physics": 0.06264216661453247, "survival_time": 14.950000000000076, "driven_lanedir": 2.431414447542446, "sim_render-ego": 0.038783708413441975, "in-drivable-lane": 1.550000000000006, "agent_compute-ego": 0.06225216627120972, "deviation-heading": 1.557934038592222, "set_robot_commands": 0.05807448625564575, "deviation-center-line": 1.2938441457795835, "driven_lanedir_consec": 2.431414447542446, "sim_compute_sim_state": 0.025533403555552166, "sim_compute_performance-ego": 0.04259433587392171, "sim_compute_robot_state-ego": 0.045708870887756346}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 2.7576664736375385, "sim_physics": 0.0584238322575887, "survival_time": 14.950000000000076, "driven_lanedir": 2.6862863278014255, "sim_render-ego": 0.038725692431132, "in-drivable-lane": 0, "agent_compute-ego": 0.16110243797302246, "deviation-heading": 2.8066935783083986, "set_robot_commands": 0.05826729456583659, "deviation-center-line": 0.9739528099440622, "driven_lanedir_consec": 2.6862863278014255, "sim_compute_sim_state": 0.02540361960728963, "sim_compute_performance-ego": 0.042087003389994306, "sim_compute_robot_state-ego": 0.045882778962453206}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.7765734299255234, "sim_physics": 0.0663701852162679, "survival_time": 9.750000000000004, "driven_lanedir": 1.7485682235280542, "sim_render-ego": 0.039004887067354645, "in-drivable-lane": 0, "agent_compute-ego": 0.23205574720333785, "deviation-heading": 1.1813024775899617, "set_robot_commands": 0.059115983278323445, "deviation-center-line": 0.7453848580572333, "driven_lanedir_consec": 1.7485682235280542, "sim_compute_sim_state": 0.025984519567245092, "sim_compute_performance-ego": 0.04203359285990397, "sim_compute_robot_state-ego": 0.045313137005536984}}
set_robot_commands_max0.06632815519968668
set_robot_commands_mean0.0600952603878119
set_robot_commands_median0.05869038263956706
set_robot_commands_min0.05807448625564575
sim_compute_performance-ego_max0.045120027065277096
sim_compute_performance-ego_mean0.0429065883954366
sim_compute_performance-ego_median0.04259433587392171
sim_compute_performance-ego_min0.04203359285990397
sim_compute_robot_state-ego_max0.04968891064325968
sim_compute_robot_state-ego_mean0.04639228622729962
sim_compute_robot_state-ego_median0.045708870887756346
sim_compute_robot_state-ego_min0.045313137005536984
sim_compute_sim_state_max0.027379529476165773
sim_compute_sim_state_mean0.025965755352607135
sim_compute_sim_state_median0.025533403555552166
sim_compute_sim_state_min0.02540361960728963
sim_physics_max0.07020657857259115
sim_physics_mean0.06372475703557332
sim_physics_median0.06264216661453247
sim_physics_min0.0584238322575887
sim_render-ego_max0.039527182579040525
sim_render-ego_mean0.038906338080381735
sim_render-ego_median0.038783708413441975
sim_render-ego_min0.03849021991093953
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean13.910000000000062
survival_time_min9.750000000000004
No reset possible
232913512Bea Baselines 🐤challenge-aido_LF-template-pytorchaido2-LFVI-sim-testingstep1-simulationerroryesip-172-31-38-104-81950:12:36
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
232352364Andrea Censi 🇨🇭random_agentaido2-LFV-sim-testingstep1-simulationsuccessyesip-172-31-38-104-81950:13:00
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.47061816984274774
survival_time_median2.4499999999999993
deviation-center-line_median0.09047885846140293
in-drivable-lane_median0.7999999999999974


other stats
agent_compute-ego_max0.09273098707199096
agent_compute-ego_mean0.08230540420316697
agent_compute-ego_median0.08123965012399774
agent_compute-ego_min0.07971321105957031
deviation-center-line_max0.1743913456502906
deviation-center-line_mean0.11122054568266285
deviation-center-line_min0.05649185041622204
deviation-heading_max0.8583234710357402
deviation-heading_mean0.371509805944231
deviation-heading_median0.3477435217829391
deviation-heading_min0.1892537419842091
driven_any_max1.6169932854589035
driven_any_mean0.8549136794030617
driven_any_median0.9441796518284096
driven_any_min0.28668385087664994
driven_lanedir_consec_max1.2433038249708377
driven_lanedir_consec_mean0.5622432991481365
driven_lanedir_consec_min0.24216121529728207
driven_lanedir_max1.2433038249708377
driven_lanedir_mean0.5622432991481365
driven_lanedir_median0.47061816984274774
driven_lanedir_min0.24216121529728207
in-drivable-lane_max1.3499999999999996
in-drivable-lane_mean0.5899999999999992
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0243289631429708, "sim_physics": 0.09381542823932788, "survival_time": 2.6999999999999984, "driven_lanedir": 0.5723310224856362, "sim_render-ego": 0.03893580701616075, "in-drivable-lane": 0.9999999999999976, "agent_compute-ego": 0.08201687424271195, "deviation-heading": 0.19401296908406307, "set_robot_commands": 0.05803256123154252, "deviation-center-line": 0.15907928712407893, "driven_lanedir_consec": 0.5723310224856362, "sim_compute_sim_state": 0.02465939963305438, "sim_compute_performance-ego": 0.042388982243008085, "sim_compute_robot_state-ego": 0.044423968703658494, "sim_compute_robot_state-npc0": 0.04388406100096526, "sim_compute_robot_state-npc1": 0.04251080972177011, "sim_compute_robot_state-npc2": 0.04284393787384033, "sim_compute_robot_state-npc3": 0.04230967274418584}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.4119037580118998, "sim_physics": 0.1115969467163086, "survival_time": 1.2500000000000004, "driven_lanedir": 0.3792793194470208, "sim_render-ego": 0.03789063453674316, "in-drivable-lane": 0, "agent_compute-ego": 0.07971321105957031, "deviation-heading": 0.47860435001913393, "set_robot_commands": 0.055962953567504886, "deviation-center-line": 0.09344288799285194, "driven_lanedir_consec": 0.3792793194470208, "sim_compute_sim_state": 0.02420210838317871, "sim_compute_performance-ego": 0.04079850196838379, "sim_compute_robot_state-ego": 0.0443079662322998, "sim_compute_robot_state-npc0": 0.042649965286254886, "sim_compute_robot_state-npc1": 0.043189687728881834, "sim_compute_robot_state-npc2": 0.041452159881591795, "sim_compute_robot_state-npc3": 0.04299847602844238}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.579862082650716, "sim_physics": 0.10508913429159868, "survival_time": 3.7999999999999945, "driven_lanedir": 1.2433038249708377, "sim_render-ego": 0.03863061729230379, "in-drivable-lane": 0.5999999999999979, "agent_compute-ego": 0.08146321773529053, "deviation-heading": 0.5020407942599273, "set_robot_commands": 0.05644265287800839, "deviation-center-line": 0.1743913456502906, "driven_lanedir_consec": 1.2433038249708377, "sim_compute_sim_state": 0.024169128192098516, "sim_compute_performance-ego": 0.04165795916005185, "sim_compute_robot_state-ego": 0.043673072990618254, "sim_compute_robot_state-npc0": 0.04352562992196334, "sim_compute_robot_state-npc1": 0.042055986429515635, "sim_compute_robot_state-npc2": 0.04230459112870066, "sim_compute_robot_state-npc3": 0.0418746879226283}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.6169932854589035, "sim_physics": 0.10383457473561732, "survival_time": 3.949999999999994, "driven_lanedir": 1.2126117310470583, "sim_render-ego": 0.03770413278024408, "in-drivable-lane": 0.849999999999997, "agent_compute-ego": 0.0809011308452751, "deviation-heading": 0.34764983431811214, "set_robot_commands": 0.05753641188899173, "deviation-center-line": 0.11519544839797546, "driven_lanedir_consec": 1.2126117310470583, "sim_compute_sim_state": 0.023772583732122102, "sim_compute_performance-ego": 0.0410875881774516, "sim_compute_robot_state-ego": 0.04254104819478867, "sim_compute_robot_state-npc0": 0.043224153639395024, "sim_compute_robot_state-npc1": 0.04145054575763171, "sim_compute_robot_state-npc2": 0.04139711283430268, "sim_compute_robot_state-npc3": 0.04131410997125167}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.5031772882846431, "sim_physics": 0.1004319361277989, "survival_time": 1.4000000000000006, "driven_lanedir": 0.4926325270527603, "sim_render-ego": 0.037190062659127374, "in-drivable-lane": 0, "agent_compute-ego": 0.08169209957122803, "deviation-heading": 0.29868161596444953, "set_robot_commands": 0.05633191551480975, "deviation-center-line": 0.09047885846140293, "driven_lanedir_consec": 0.4926325270527603, "sim_compute_sim_state": 0.023633761065346853, "sim_compute_performance-ego": 0.04033600432532174, "sim_compute_robot_state-ego": 0.04220713887895856, "sim_compute_robot_state-npc0": 0.04253906011581421, "sim_compute_robot_state-npc1": 0.0409467305455889, "sim_compute_robot_state-npc2": 0.04128919328962054, "sim_compute_robot_state-npc3": 0.04037755727767944}, "ETHZ_autolab_technical_track-5-0": {"driven_any": 1.0440585337030532, "sim_physics": 0.09213305844200982, "survival_time": 2.6999999999999984, "driven_lanedir": 0.5009536316076031, "sim_render-ego": 0.03791122966342502, "in-drivable-lane": 1.0000000000000009, "agent_compute-ego": 0.08043166443153664, "deviation-heading": 0.8583234710357402, "set_robot_commands": 0.0562767364360668, "deviation-center-line": 0.1636702708892767, "driven_lanedir_consec": 0.5009536316076031, "sim_compute_sim_state": 0.02366626262664795, "sim_compute_performance-ego": 0.03985828823513455, "sim_compute_robot_state-ego": 0.04296978756233498, "sim_compute_robot_state-npc0": 0.04253504011366102, "sim_compute_robot_state-npc1": 0.0424619162524188, "sim_compute_robot_state-npc2": 0.04153762040314851, "sim_compute_robot_state-npc3": 0.04147899150848389}, "ETHZ_autolab_technical_track-6-0": {"driven_any": 1.045672984989961, "sim_physics": 0.0927717376638342, "survival_time": 2.6999999999999984, "driven_lanedir": 0.636422849544542, "sim_render-ego": 0.03722485348030373, "in-drivable-lane": 0.7999999999999974, "agent_compute-ego": 0.08008499498720523, "deviation-heading": 0.39273667682101354, "set_robot_commands": 0.05655577447679308, "deviation-center-line": 0.08970073753261001, "driven_lanedir_consec": 0.636422849544542, "sim_compute_sim_state": 0.023874658125418204, "sim_compute_performance-ego": 0.04099614531905563, "sim_compute_robot_state-ego": 0.04310697096365469, "sim_compute_robot_state-npc0": 0.04190852023937084, "sim_compute_robot_state-npc1": 0.04254287702065927, "sim_compute_robot_state-npc2": 0.04070967215078848, "sim_compute_robot_state-npc3": 0.04214137571829336}, "ETHZ_autolab_technical_track-7-0": {"driven_any": 0.877256228857091, "sim_physics": 0.11584308942159018, "survival_time": 2.25, "driven_lanedir": 0.38713958773684665, "sim_render-ego": 0.03911176787482368, "in-drivable-lane": 0.9999999999999996, "agent_compute-ego": 0.08053103023105197, "deviation-heading": 0.384474040685185, "set_robot_commands": 0.056720140245225696, "deviation-center-line": 0.07500609722918031, "driven_lanedir_consec": 0.38713958773684665, "sim_compute_sim_state": 0.02436809009975857, "sim_compute_performance-ego": 0.04111679924858941, "sim_compute_robot_state-ego": 0.04488192134433323, "sim_compute_robot_state-npc0": 0.04252863989935981, "sim_compute_robot_state-npc1": 0.04219637446933323, "sim_compute_robot_state-npc2": 0.0415876653459337, "sim_compute_robot_state-npc3": 0.04180100758870443}, "ETHZ_autolab_technical_track-8-0": {"driven_any": 0.8433010974171573, "sim_physics": 0.09731057415837828, "survival_time": 2.3, "driven_lanedir": 0.24216121529728207, "sim_render-ego": 0.03915119689443837, "in-drivable-lane": 1.3499999999999996, "agent_compute-ego": 0.08154135165007217, "deviation-heading": 0.34566993689777425, "set_robot_commands": 0.05786226106726605, "deviation-center-line": 0.07136114712800473, "driven_lanedir_consec": 0.24216121529728207, "sim_compute_sim_state": 0.024352882219397503, "sim_compute_performance-ego": 0.041433774906656014, "sim_compute_robot_state-ego": 0.04383506982222847, "sim_compute_robot_state-npc0": 0.04288636083188264, "sim_compute_robot_state-npc1": 0.04225253022235373, "sim_compute_robot_state-npc2": 0.0420362897541212, "sim_compute_robot_state-npc3": 0.04293013655621072}, "ETHZ_autolab_technical_track-9-0": {"driven_any": 0.9785013113851152, "sim_physics": 0.11084618091583252, "survival_time": 2.499999999999999, "driven_lanedir": 0.9700080716683566, "sim_render-ego": 0.03906970024108887, "in-drivable-lane": 0, "agent_compute-ego": 0.08178653717041015, "deviation-heading": 0.3477435217829391, "set_robot_commands": 0.05836556911468506, "deviation-center-line": 0.15723242276422936, "driven_lanedir_consec": 0.9700080716683566, "sim_compute_sim_state": 0.024625420570373535, "sim_compute_performance-ego": 0.042728304862976074, "sim_compute_robot_state-ego": 0.04457656860351562, "sim_compute_robot_state-npc0": 0.04342511177062988, "sim_compute_robot_state-npc1": 0.0429574966430664, "sim_compute_robot_state-npc2": 0.04248351097106934, "sim_compute_robot_state-npc3": 0.04297650337219238}, "ETHZ_autolab_technical_track-10-0": {"driven_any": 0.3129292149411446, "sim_physics": 0.12055598497390747, "survival_time": 1.0000000000000002, "driven_lanedir": 0.2864579763812336, "sim_render-ego": 0.03864039182662963, "in-drivable-lane": 0, "agent_compute-ego": 0.09273098707199096, "deviation-heading": 0.38016104491567027, "set_robot_commands": 0.05679248571395874, "deviation-center-line": 0.05649185041622204, "driven_lanedir_consec": 0.2864579763812336, "sim_compute_sim_state": 0.024163079261779782, "sim_compute_performance-ego": 0.04164844751358032, "sim_compute_robot_state-ego": 0.043072950839996335, "sim_compute_robot_state-npc0": 0.042217469215393065, "sim_compute_robot_state-npc1": 0.04246331453323364, "sim_compute_robot_state-npc2": 0.041651594638824466, "sim_compute_robot_state-npc3": 0.04174659252166748}, "ETHZ_autolab_technical_track-11-0": {"driven_any": 0.28668385087664994, "sim_physics": 0.09589512724625436, "survival_time": 0.9500000000000004, "driven_lanedir": 0.278237107094367, "sim_render-ego": 0.036544272774144224, "in-drivable-lane": 0, "agent_compute-ego": 0.08123965012399774, "deviation-heading": 0.19732996798555608, "set_robot_commands": 0.05615556867499101, "deviation-center-line": 0.08671144489080887, "driven_lanedir_consec": 0.278237107094367, "sim_compute_sim_state": 0.024162819511012023, "sim_compute_performance-ego": 0.041020217694734275, "sim_compute_robot_state-ego": 0.04313403681704873, "sim_compute_robot_state-npc0": 0.04288162683185778, "sim_compute_robot_state-npc1": 0.04184385349876002, "sim_compute_robot_state-npc2": 0.041947051098472195, "sim_compute_robot_state-npc3": 0.04087298794796592}, "ETHZ_autolab_technical_track-12-0": {"driven_any": 1.0034139953700494, "sim_physics": 0.09184821605682374, "survival_time": 2.499999999999999, "driven_lanedir": 0.47061816984274774, "sim_render-ego": 0.03766915798187256, "in-drivable-lane": 1.1499999999999986, "agent_compute-ego": 0.0806904125213623, "deviation-heading": 0.2263485117662671, "set_robot_commands": 0.05655341625213623, "deviation-center-line": 0.1594122934983136, "driven_lanedir_consec": 0.47061816984274774, "sim_compute_sim_state": 0.024083428382873535, "sim_compute_performance-ego": 0.0403921365737915, "sim_compute_robot_state-ego": 0.043624353408813474, "sim_compute_robot_state-npc0": 0.04169531345367432, "sim_compute_robot_state-npc1": 0.04195714950561523, "sim_compute_robot_state-npc2": 0.041856703758239744, "sim_compute_robot_state-npc3": 0.04175406455993652}, "ETHZ_autolab_technical_track-13-0": {"driven_any": 0.351442944128162, "sim_physics": 0.11767477338964288, "survival_time": 1.1000000000000003, "driven_lanedir": 0.34114611245347204, "sim_render-ego": 0.03891458294608376, "in-drivable-lane": 0, "agent_compute-ego": 0.08103394508361816, "deviation-heading": 0.1892537419842091, "set_robot_commands": 0.057267156514254486, "deviation-center-line": 0.08918370733714856, "driven_lanedir_consec": 0.34114611245347204, "sim_compute_sim_state": 0.02411584420637651, "sim_compute_performance-ego": 0.041258562694896354, "sim_compute_robot_state-ego": 0.043608817187222565, "sim_compute_robot_state-npc0": 0.042932737957347526, "sim_compute_robot_state-npc1": 0.04274197058244185, "sim_compute_robot_state-npc2": 0.04198368029160933, "sim_compute_robot_state-npc3": 0.04158584638075395}, "ETHZ_autolab_technical_track-14-0": {"driven_any": 0.9441796518284096, "sim_physics": 0.10962223520084304, "survival_time": 2.4499999999999993, "driven_lanedir": 0.4203463405922858, "sim_render-ego": 0.03838856852784449, "in-drivable-lane": 1.0999999999999988, "agent_compute-ego": 0.08872395632218341, "deviation-heading": 0.4296166116434236, "set_robot_commands": 0.056527726504267475, "deviation-center-line": 0.08695038592754878, "driven_lanedir_consec": 0.4203463405922858, "sim_compute_sim_state": 0.024063270919176996, "sim_compute_performance-ego": 0.04065101487295968, "sim_compute_robot_state-ego": 0.042978904685195614, "sim_compute_robot_state-npc0": 0.04244661331176758, "sim_compute_robot_state-npc1": 0.04182218532173001, "sim_compute_robot_state-npc2": 0.04172826786430515, "sim_compute_robot_state-npc3": 0.041336667780973474}}
set_robot_commands_max0.05836556911468506
set_robot_commands_mean0.0568922220053668
set_robot_commands_median0.05655577447679308
set_robot_commands_min0.055962953567504886
sim_compute_performance-ego_max0.042728304862976074
sim_compute_performance-ego_mean0.04115818185310605
sim_compute_performance-ego_median0.0410875881774516
sim_compute_performance-ego_min0.03985828823513455
sim_compute_robot_state-ego_max0.04488192134433323
sim_compute_robot_state-ego_mean0.043529505082311154
sim_compute_robot_state-ego_median0.043608817187222565
sim_compute_robot_state-ego_min0.04220713887895856
sim_compute_robot_state-npc0_max0.04388406100096526
sim_compute_robot_state-npc0_mean0.042752020239289146
sim_compute_robot_state-npc0_median0.042649965286254886
sim_compute_robot_state-npc0_min0.04169531345367432
sim_compute_robot_state-npc1_max0.043189687728881834
sim_compute_robot_state-npc1_mean0.0422262285488667
sim_compute_robot_state-npc1_median0.04225253022235373
sim_compute_robot_state-npc1_min0.0409467305455889
sim_compute_robot_state-npc2_max0.04284393787384033
sim_compute_robot_state-npc2_mean0.04178727008563787
sim_compute_robot_state-npc2_median0.04172826786430515
sim_compute_robot_state-npc2_min0.04070967215078848
sim_compute_robot_state-npc3_max0.04299847602844238
sim_compute_robot_state-npc3_mean0.041833245191957975
sim_compute_robot_state-npc3_median0.04175406455993652
sim_compute_robot_state-npc3_min0.04037755727767944
sim_compute_sim_state_max0.02465939963305438
sim_compute_sim_state_mean0.02412751579524101
sim_compute_sim_state_median0.024162819511012023
sim_compute_sim_state_min0.023633761065346853
sim_physics_max0.12055598497390747
sim_physics_mean0.10395126650531786
sim_physics_median0.10383457473561732
sim_physics_min0.09184821605682374
sim_render-ego_max0.03915119689443837
sim_render-ego_mean0.03819846509968223
sim_render-ego_median0.03838856852784449
sim_render-ego_min0.036544272774144224
simulation-passed1
survival_time_max3.949999999999994
survival_time_mean2.2366666666666655
survival_time_min0.9500000000000004
No reset possible
232343578Andrea Censi 🇨🇭rotationaido2-LF-sim-validationstep1-simulationsuccessyesip-172-31-38-104-81950:03:37
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.6618324868125249
survival_time_median2.1000000000000005
deviation-center-line_median0.09250602665006584
in-drivable-lane_median0.09999999999999964


other stats
agent_compute-ego_max0.12142992587316603
agent_compute-ego_mean0.09832239629573768
agent_compute-ego_median0.09366029500961304
agent_compute-ego_min0.0909568468729655
deviation-center-line_max0.21439068356235536
deviation-center-line_mean0.12258369343422797
deviation-center-line_min0.0744010530149505
deviation-heading_max0.5686442582449269
deviation-heading_mean0.3103675930817716
deviation-heading_median0.25395078679676
deviation-heading_min0.17582209342949345
driven_any_max1.575892401948956
driven_any_mean0.8642098067399473
driven_any_median1.0038564958116647
driven_any_min0.26972689326339405
driven_lanedir_consec_max1.1723086623342591
driven_lanedir_consec_mean0.6830346826605466
driven_lanedir_consec_min0.2605911739016977
driven_lanedir_max1.1723086623342591
driven_lanedir_mean0.6830346826605466
driven_lanedir_median0.6618324868125249
driven_lanedir_min0.2605911739016977
in-drivable-lane_max0.6999999999999975
in-drivable-lane_mean0.2699999999999994
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0038564958116647, "sim_physics": 0.06473492440723237, "survival_time": 2.1000000000000005, "driven_lanedir": 0.6618324868125249, "sim_render-ego": 0.03759881995973133, "in-drivable-lane": 0.5499999999999998, "agent_compute-ego": 0.12142992587316603, "deviation-heading": 0.25395078679676, "set_robot_commands": 0.056443271182832266, "deviation-center-line": 0.09250602665006584, "driven_lanedir_consec": 0.6618324868125249, "sim_compute_sim_state": 0.025539494696117583, "sim_compute_performance-ego": 0.042700279326665966, "sim_compute_robot_state-ego": 0.043583461216517856}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.0061450567009285, "sim_physics": 0.06495699428376697, "survival_time": 2.1000000000000005, "driven_lanedir": 0.8764382022560809, "sim_render-ego": 0.0369821446282523, "in-drivable-lane": 0.09999999999999964, "agent_compute-ego": 0.0909568468729655, "deviation-heading": 0.5686442582449269, "set_robot_commands": 0.0557427860441662, "deviation-center-line": 0.1563855108175075, "driven_lanedir_consec": 0.8764382022560809, "sim_compute_sim_state": 0.02388955865587507, "sim_compute_performance-ego": 0.043273942811148505, "sim_compute_robot_state-ego": 0.04203191825321743}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.26972689326339405, "sim_physics": 0.06284527480602264, "survival_time": 0.8000000000000002, "driven_lanedir": 0.2605911739016977, "sim_render-ego": 0.03763195872306824, "in-drivable-lane": 0, "agent_compute-ego": 0.09366029500961304, "deviation-heading": 0.20274263769041717, "set_robot_commands": 0.05764622986316681, "deviation-center-line": 0.07523519312626054, "driven_lanedir_consec": 0.2605911739016977, "sim_compute_sim_state": 0.02409045398235321, "sim_compute_performance-ego": 0.04087270796298981, "sim_compute_robot_state-ego": 0.04281044006347656}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.4654281859747942, "sim_physics": 0.07073059289351753, "survival_time": 1.1500000000000004, "driven_lanedir": 0.4440028879981699, "sim_render-ego": 0.03830528259277344, "in-drivable-lane": 0, "agent_compute-ego": 0.09367629756098209, "deviation-heading": 0.3506781892472603, "set_robot_commands": 0.05835827537204908, "deviation-center-line": 0.0744010530149505, "driven_lanedir_consec": 0.4440028879981699, "sim_compute_sim_state": 0.02589185341544773, "sim_compute_performance-ego": 0.0422467563463294, "sim_compute_robot_state-ego": 0.04248345416525136}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.575892401948956, "sim_physics": 0.056726674879750895, "survival_time": 3.099999999999997, "driven_lanedir": 1.1723086623342591, "sim_render-ego": 0.03718087750096475, "in-drivable-lane": 0.6999999999999975, "agent_compute-ego": 0.09188861616196171, "deviation-heading": 0.17582209342949345, "set_robot_commands": 0.05622445383379536, "deviation-center-line": 0.21439068356235536, "driven_lanedir_consec": 1.1723086623342591, "sim_compute_sim_state": 0.02363250332493936, "sim_compute_performance-ego": 0.04074618124192761, "sim_compute_robot_state-ego": 0.042489440210403934}}
set_robot_commands_max0.05835827537204908
set_robot_commands_mean0.056883003259201946
set_robot_commands_median0.056443271182832266
set_robot_commands_min0.0557427860441662
sim_compute_performance-ego_max0.043273942811148505
sim_compute_performance-ego_mean0.04196797353781226
sim_compute_performance-ego_median0.0422467563463294
sim_compute_performance-ego_min0.04074618124192761
sim_compute_robot_state-ego_max0.043583461216517856
sim_compute_robot_state-ego_mean0.04267974278177343
sim_compute_robot_state-ego_median0.042489440210403934
sim_compute_robot_state-ego_min0.04203191825321743
sim_compute_sim_state_max0.02589185341544773
sim_compute_sim_state_mean0.02460877281494659
sim_compute_sim_state_median0.02409045398235321
sim_compute_sim_state_min0.02363250332493936
sim_physics_max0.07073059289351753
sim_physics_mean0.06399889225405808
sim_physics_median0.06473492440723237
sim_physics_min0.056726674879750895
sim_render-ego_max0.03830528259277344
sim_render-ego_mean0.03753981668095801
sim_render-ego_median0.03759881995973133
sim_render-ego_min0.0369821446282523
simulation-passed1
survival_time_max3.099999999999997
survival_time_mean1.8499999999999996
survival_time_min0.8000000000000002
No reset possible