Duckietown Challenges Home Challenges Submissions

Evaluator 534

ID534
evaluatoridsc-rudolf-15605
ownerAndrea Censi 🇨🇭
machineidsc-rudolf
processidsc-rudolf-15605
versiond-c:4.0.7;d-c-r:4.0.9;d-s:4.0.10
first heard
last heard
statusinactive
# evaluating
# success11 17120
# timeout1 17125
# failed1 17185
# error2 17118
# aborted1 17144
# host-error
arm
x86_64
Mac
gpu available
Number of processors
Processor frequency (MHz)
Free % of processors
RAM total (MB)
RAM free (MB)
Disk (MB)
Disk available (MB)
Docker Hub
P1
P2
Cloud simulations
PI Camera
# Duckiebots
Map 3x3 avaiable
Number of duckies
gpu cores
AIDO 2 Map LF public
AIDO 2 Map LF private
AIDO 2 Map LFV public
AIDO 2 Map LFV private
AIDO 2 Map LFVI public
AIDO 2 Map LFVI private
AIDO 3 Map LF public
AIDO 3 Map LF private
AIDO 3 Map LFV public
AIDO 3 Map LFV private
AIDO 3 Map LFVI public
AIDO 3 Map LFVI private
AIDO 5 Map large loop
ETU track
for 2021, map is ETH_small_inter
IPFS mountpoint /ipfs available
IPNS mountpoint /ipns available

Evaluator jobs

Job IDsubmissionuseruser labelchallengestepstatusup to dateevaluatordate starteddate completeddurationmessage
171922328Konstantin ChaikaMinimal agentaido2_LFV_r1-v4step1-simulationsuccessyesidsc-rudolf-156050:12:20
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.8516119779536884
survival_time_median3.399999999999996
deviation-center-line_median0.16534908678864438
in-drivable-lane_median1.3499999999999952


other stats
agent_compute-ego_max0.16466726541519164
agent_compute-ego_mean0.16278967373142034
agent_compute-ego_median0.16287611461267237
agent_compute-ego_min0.16083803543677697
deviation-center-line_max0.2078435673968125
deviation-center-line_mean0.15835662027727432
deviation-center-line_min0.1128230942788872
deviation-heading_max0.3886055345167397
deviation-heading_mean0.352177996344455
deviation-heading_median0.37092376484647793
deviation-heading_min0.30707254041461957
driven_any_max1.4782765184420794
driven_any_mean1.1315473506196985
driven_any_median1.0097725221691731
driven_any_min0.9477327875430378
driven_lanedir_consec_max0.9654696798546664
driven_lanedir_consec_mean0.7930140409285634
driven_lanedir_consec_min0.5879893173150568
driven_lanedir_max0.9654696798546664
driven_lanedir_mean0.7930140409285634
driven_lanedir_median0.8516119779536884
driven_lanedir_min0.5879893173150568
in-drivable-lane_max2.0499999999999927
in-drivable-lane_mean1.079999999999996
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0097725221691731, "sim_physics": 0.0034583701806909896, "survival_time": 3.399999999999996, "driven_lanedir": 0.5879893173150568, "sim_render-ego": 0.0696311873548171, "in-drivable-lane": 1.3499999999999952, "agent_compute-ego": 0.1629501931807574, "deviation-heading": 0.3886055345167397, "set_robot_commands": 0.07958668119767133, "deviation-center-line": 0.1128230942788872, "driven_lanedir_consec": 0.5879893173150568, "sim_compute_sim_state": 0.036879823488347674, "sim_compute_performance-ego": 0.06618010997772217, "sim_compute_robot_state-ego": 0.23372080045587876, "sim_compute_robot_state-npc0": 0.07887515600989847, "sim_compute_robot_state-npc1": 0.07278916064430685, "sim_compute_robot_state-npc2": 0.0681953885976006, "sim_compute_robot_state-npc3": 0.06751353951061473}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.9477327875430378, "sim_physics": 0.0035576668996659534, "survival_time": 3.149999999999997, "driven_lanedir": 0.941649338159904, "sim_render-ego": 0.07482014383588519, "in-drivable-lane": 0, "agent_compute-ego": 0.16261676001170325, "deviation-heading": 0.31560468369522693, "set_robot_commands": 0.07946584338233584, "deviation-center-line": 0.18553797137348788, "driven_lanedir_consec": 0.941649338159904, "sim_compute_sim_state": 0.04264332756163582, "sim_compute_performance-ego": 0.07286037339104547, "sim_compute_robot_state-ego": 0.09262894827222068, "sim_compute_robot_state-npc0": 0.079998565098596, "sim_compute_robot_state-npc1": 0.07502158861311656, "sim_compute_robot_state-npc2": 0.07490456293499659, "sim_compute_robot_state-npc3": 0.07617571240379697}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.9705553879075428, "sim_physics": 0.003603671147273137, "survival_time": 3.2499999999999964, "driven_lanedir": 0.9654696798546664, "sim_render-ego": 0.07312437204214242, "in-drivable-lane": 0, "agent_compute-ego": 0.16083803543677697, "deviation-heading": 0.30707254041461957, "set_robot_commands": 0.07904102985675518, "deviation-center-line": 0.2078435673968125, "driven_lanedir_consec": 0.9654696798546664, "sim_compute_sim_state": 0.04285439711350661, "sim_compute_performance-ego": 0.07061676612267127, "sim_compute_robot_state-ego": 0.08771842076228215, "sim_compute_robot_state-npc0": 0.07868605393629807, "sim_compute_robot_state-npc1": 0.07590109751774715, "sim_compute_robot_state-npc2": 0.07476538878220779, "sim_compute_robot_state-npc3": 0.07572948382450984}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.251399537036658, "sim_physics": 0.003682026048985923, "survival_time": 4.099999999999993, "driven_lanedir": 0.6183498913595016, "sim_render-ego": 0.07589350967872434, "in-drivable-lane": 1.999999999999993, "agent_compute-ego": 0.16287611461267237, "deviation-heading": 0.37092376484647793, "set_robot_commands": 0.07964064435261052, "deviation-center-line": 0.1202293815485396, "driven_lanedir_consec": 0.6183498913595016, "sim_compute_sim_state": 0.04445785429419541, "sim_compute_performance-ego": 0.07131063356632139, "sim_compute_robot_state-ego": 0.08846533880001162, "sim_compute_robot_state-npc0": 0.07952063548855665, "sim_compute_robot_state-npc1": 0.0781278842832984, "sim_compute_robot_state-npc2": 0.07819222822421934, "sim_compute_robot_state-npc3": 0.07766900702220637}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.4782765184420794, "sim_physics": 0.003646295070648194, "survival_time": 4.99999999999999, "driven_lanedir": 0.8516119779536884, "sim_render-ego": 0.07538965463638306, "in-drivable-lane": 2.0499999999999927, "agent_compute-ego": 0.16466726541519164, "deviation-heading": 0.3786834582492112, "set_robot_commands": 0.08226442098617553, "deviation-center-line": 0.16534908678864438, "driven_lanedir_consec": 0.8516119779536884, "sim_compute_sim_state": 0.042849006652832033, "sim_compute_performance-ego": 0.07292433261871338, "sim_compute_robot_state-ego": 0.08830947637557983, "sim_compute_robot_state-npc0": 0.08047030448913574, "sim_compute_robot_state-npc1": 0.0789538311958313, "sim_compute_robot_state-npc2": 0.07575830936431885, "sim_compute_robot_state-npc3": 0.07687018871307373}}
set_robot_commands_max0.08226442098617553
set_robot_commands_mean0.07999972395510968
set_robot_commands_median0.07958668119767133
set_robot_commands_min0.07904102985675518
sim_compute_performance-ego_max0.07292433261871338
sim_compute_performance-ego_mean0.07077844313529473
sim_compute_performance-ego_median0.07131063356632139
sim_compute_performance-ego_min0.06618010997772217
sim_compute_robot_state-ego_max0.23372080045587876
sim_compute_robot_state-ego_mean0.11816859693319462
sim_compute_robot_state-ego_median0.08846533880001162
sim_compute_robot_state-ego_min0.08771842076228215
sim_compute_robot_state-npc0_max0.08047030448913574
sim_compute_robot_state-npc0_mean0.07951014300449698
sim_compute_robot_state-npc0_median0.07952063548855665
sim_compute_robot_state-npc0_min0.07868605393629807
sim_compute_robot_state-npc1_max0.0789538311958313
sim_compute_robot_state-npc1_mean0.07615871245086006
sim_compute_robot_state-npc1_median0.07590109751774715
sim_compute_robot_state-npc1_min0.07278916064430685
sim_compute_robot_state-npc2_max0.07819222822421934
sim_compute_robot_state-npc2_mean0.07436317558066863
sim_compute_robot_state-npc2_median0.07490456293499659
sim_compute_robot_state-npc2_min0.0681953885976006
sim_compute_robot_state-npc3_max0.07766900702220637
sim_compute_robot_state-npc3_mean0.07479158629484033
sim_compute_robot_state-npc3_median0.07617571240379697
sim_compute_robot_state-npc3_min0.06751353951061473
sim_compute_sim_state_max0.04445785429419541
sim_compute_sim_state_mean0.04193688182210351
sim_compute_sim_state_median0.042849006652832033
sim_compute_sim_state_min0.036879823488347674
sim_physics_max0.003682026048985923
sim_physics_mean0.0035896058694528396
sim_physics_median0.003603671147273137
sim_physics_min0.0034583701806909896
sim_render-ego_max0.07589350967872434
sim_render-ego_mean0.07377177350959044
sim_render-ego_median0.07482014383588519
sim_render-ego_min0.0696311873548171
simulation-passed1
survival_time_max4.99999999999999
survival_time_mean3.779999999999995
survival_time_min3.149999999999997
No reset possible
171862253Julian ZillyBaseline solution using imitation learning from logsaido2_LF_r2-v4step1-simulationsuccessyesidsc-rudolf-156050:07:47
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.2469151058065284
survival_time_median4.549999999999992
deviation-center-line_median0.04673004722572329
in-drivable-lane_median0.849999999999997


other stats
agent_compute-ego_max0.23555966523977423
agent_compute-ego_mean0.22302934553022444
agent_compute-ego_median0.23014935556348864
agent_compute-ego_min0.2072117203160336
deviation-center-line_max0.061457877720478366
deviation-center-line_mean0.05095058286703961
deviation-center-line_min0.042501106286433485
deviation-heading_max0.36517707596691096
deviation-heading_mean0.3372931031687029
deviation-heading_median0.34410295297602933
deviation-heading_min0.298864949256562
driven_any_max1.5853517251659737
driven_any_mean1.347864839296439
driven_any_median1.584670967044581
driven_any_min0.9919467599574832
driven_lanedir_consec_max1.3525881201642544
driven_lanedir_consec_mean1.0530227741105436
driven_lanedir_consec_min0.6573330891045548
driven_lanedir_max1.3525881201642544
driven_lanedir_mean1.0530227741105436
driven_lanedir_median1.2469151058065284
driven_lanedir_min0.6573330891045548
in-drivable-lane_max0.849999999999997
in-drivable-lane_mean0.7499999999999973
in-drivable-lane_min0.5999999999999979
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.9919467599574832, "sim_physics": 0.004287251254968476, "survival_time": 2.849999999999998, "driven_lanedir": 0.6573330891045548, "sim_render-ego": 0.06315779685974121, "in-drivable-lane": 0.849999999999997, "agent_compute-ego": 0.2072117203160336, "deviation-heading": 0.34410295297602933, "set_robot_commands": 0.07814210339596397, "deviation-center-line": 0.042501106286433485, "driven_lanedir_consec": 0.6573330891045548, "sim_compute_sim_state": 0.04085655379713627, "sim_compute_performance-ego": 0.06508303525155051, "sim_compute_robot_state-ego": 0.3012176187414872}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.9926024685247504, "sim_physics": 0.0026083410831919886, "survival_time": 2.849999999999998, "driven_lanedir": 0.7613569691244798, "sim_render-ego": 0.05898722431115937, "in-drivable-lane": 0.5999999999999979, "agent_compute-ego": 0.21071600495723256, "deviation-heading": 0.298864949256562, "set_robot_commands": 0.07725640765407629, "deviation-center-line": 0.05733461368242161, "driven_lanedir_consec": 0.7613569691244798, "sim_compute_sim_state": 0.043356100718180336, "sim_compute_performance-ego": 0.061631871942888224, "sim_compute_robot_state-ego": 0.0756362237428364}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.5853517251659737, "sim_physics": 0.003139545629312704, "survival_time": 4.549999999999992, "driven_lanedir": 1.3525881201642544, "sim_render-ego": 0.056749273132491895, "in-drivable-lane": 0.5999999999999979, "agent_compute-ego": 0.23014935556348864, "deviation-heading": 0.3131585902966368, "set_robot_commands": 0.08109266417367118, "deviation-center-line": 0.061457877720478366, "driven_lanedir_consec": 1.3525881201642544, "sim_compute_sim_state": 0.04230534113370455, "sim_compute_performance-ego": 0.06022455142094539, "sim_compute_robot_state-ego": 0.0733658926827567}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.5847522757894064, "sim_physics": 0.002739450433752039, "survival_time": 4.549999999999992, "driven_lanedir": 1.2469205863529005, "sim_render-ego": 0.05922895997435182, "in-drivable-lane": 0.849999999999997, "agent_compute-ego": 0.23150998157459304, "deviation-heading": 0.3651619473473758, "set_robot_commands": 0.07979523742591942, "deviation-center-line": 0.04672926942014128, "driven_lanedir_consec": 1.2469205863529005, "sim_compute_sim_state": 0.04418608382507995, "sim_compute_performance-ego": 0.06209033924144703, "sim_compute_robot_state-ego": 0.07881901290390518}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.584670967044581, "sim_physics": 0.002798046384538923, "survival_time": 4.549999999999992, "driven_lanedir": 1.2469151058065284, "sim_render-ego": 0.061275330218640005, "in-drivable-lane": 0.849999999999997, "agent_compute-ego": 0.23555966523977423, "deviation-heading": 0.36517707596691096, "set_robot_commands": 0.07996899479038112, "deviation-center-line": 0.04673004722572329, "driven_lanedir_consec": 1.2469151058065284, "sim_compute_sim_state": 0.04438006222903074, "sim_compute_performance-ego": 0.06479465830457079, "sim_compute_robot_state-ego": 0.07670148650368491}}
set_robot_commands_max0.08109266417367118
set_robot_commands_mean0.07925108148800239
set_robot_commands_median0.07979523742591942
set_robot_commands_min0.07725640765407629
sim_compute_performance-ego_max0.06508303525155051
sim_compute_performance-ego_mean0.06276489123228039
sim_compute_performance-ego_median0.06209033924144703
sim_compute_performance-ego_min0.06022455142094539
sim_compute_robot_state-ego_max0.3012176187414872
sim_compute_robot_state-ego_mean0.12114804691493408
sim_compute_robot_state-ego_median0.07670148650368491
sim_compute_robot_state-ego_min0.0733658926827567
sim_compute_sim_state_max0.04438006222903074
sim_compute_sim_state_mean0.04301682834062637
sim_compute_sim_state_median0.043356100718180336
sim_compute_sim_state_min0.04085655379713627
sim_physics_max0.004287251254968476
sim_physics_mean0.003114526957152826
sim_physics_median0.002798046384538923
sim_physics_min0.0026083410831919886
sim_render-ego_max0.06315779685974121
sim_render-ego_mean0.05987971689927686
sim_render-ego_median0.05922895997435182
sim_render-ego_min0.056749273132491895
simulation-passed1
survival_time_max4.549999999999992
survival_time_mean3.869999999999995
survival_time_min2.849999999999998
No reset possible
171852261Bhairav MehtaPyTorch templateaido2_LF_r2-v4step1-simulationfailedyesidsc-rudolf-156050:00:58
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "experiment_manager.py", line 277, in run_episode
    r: MsgReceived = agent.read_one(expect_topic='commands')
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 165, in read_one
    raise RemoteNodeAborted(m)  # XXX
zuper_nodes_wrapper.wrapper_outside.RemoteNodeAborted: I was waiting for a message from component "agent" but it aborted with the following error.

agent error |Exception while handling a message on topic "get_commands".
            |
            || Traceback (most recent call last):
            ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 426, in loop
            ||     handle_message_node(parsed, protocol, pc, node, context_data)
            ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 500, in handle_message_node
            ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
            ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 583, in call_if_fun_exists
            ||     f(**kwargs)
            ||   File "solution.py", line 48, in on_received_get_commands
            ||     pwm_left, pwm_right = compute_action(self.config.current_image)
            || NameError: name 'compute_action' is not defined
            ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
    yield cie
  File "experiment_manager.py", line 404, in <module>
    wrap(cie)
  File "experiment_manager.py", line 393, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 127, in main
    physics_dt=config.physics_dt)
  File "experiment_manager.py", line 280, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
171832263Bhairav MehtaPyTorch templateaido2_LF_r2-v4step1-simulationerroryesidsc-rudolf-156050:00:37
The result file is n [...]
The result file is not found. This usually means that the evaluator did not finish
and some times that there was an import error.

Check the evaluator log to see what happened.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
171752285Andrea Censi 🇨🇭Minimal agentaido2_LFV_r1-v4step1-simulationsuccessyesidsc-rudolf-156050:12:08
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.8516119779536884
survival_time_median3.399999999999996
deviation-center-line_median0.16534908678864438
in-drivable-lane_median1.3499999999999952


other stats
agent_compute-ego_max0.1597585502792807
agent_compute-ego_mean0.1535779791117515
agent_compute-ego_median0.1533345627784729
agent_compute-ego_min0.15038177416874812
deviation-center-line_max0.2078435673968125
deviation-center-line_mean0.15835662027727432
deviation-center-line_min0.1128230942788872
deviation-heading_max0.3886055345167397
deviation-heading_mean0.352177996344455
deviation-heading_median0.37092376484647793
deviation-heading_min0.30707254041461957
driven_any_max1.4782765184420794
driven_any_mean1.1315473506196985
driven_any_median1.0097725221691731
driven_any_min0.9477327875430378
driven_lanedir_consec_max0.9654696798546664
driven_lanedir_consec_mean0.7930140409285634
driven_lanedir_consec_min0.5879893173150568
driven_lanedir_max0.9654696798546664
driven_lanedir_mean0.7930140409285634
driven_lanedir_median0.8516119779536884
driven_lanedir_min0.5879893173150568
in-drivable-lane_max2.0499999999999927
in-drivable-lane_mean1.079999999999996
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0097725221691731, "sim_physics": 0.0035431560348061952, "survival_time": 3.399999999999996, "driven_lanedir": 0.5879893173150568, "sim_render-ego": 0.07288482609917135, "in-drivable-lane": 1.3499999999999952, "agent_compute-ego": 0.1597585502792807, "deviation-heading": 0.3886055345167397, "set_robot_commands": 0.07818323023178998, "deviation-center-line": 0.1128230942788872, "driven_lanedir_consec": 0.5879893173150568, "sim_compute_sim_state": 0.041945103336783016, "sim_compute_performance-ego": 0.06982927813249476, "sim_compute_robot_state-ego": 0.2474263450678657, "sim_compute_robot_state-npc0": 0.07532463354222915, "sim_compute_robot_state-npc1": 0.07325531454647288, "sim_compute_robot_state-npc2": 0.07231041263131534, "sim_compute_robot_state-npc3": 0.07224584327024572}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.9477327875430378, "sim_physics": 0.0031811963944208053, "survival_time": 3.149999999999997, "driven_lanedir": 0.941649338159904, "sim_render-ego": 0.0673018145182776, "in-drivable-lane": 0, "agent_compute-ego": 0.1507986613682338, "deviation-heading": 0.31560468369522693, "set_robot_commands": 0.07652542326185438, "deviation-center-line": 0.18553797137348788, "driven_lanedir_consec": 0.941649338159904, "sim_compute_sim_state": 0.03888016276889377, "sim_compute_performance-ego": 0.06451143537248884, "sim_compute_robot_state-ego": 0.08592956028287373, "sim_compute_robot_state-npc0": 0.07479964740692623, "sim_compute_robot_state-npc1": 0.07220191804189531, "sim_compute_robot_state-npc2": 0.06938323520478748, "sim_compute_robot_state-npc3": 0.07033605424184648}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.9705553879075428, "sim_physics": 0.0033553526951716497, "survival_time": 3.2499999999999964, "driven_lanedir": 0.9654696798546664, "sim_render-ego": 0.06721986990708571, "in-drivable-lane": 0, "agent_compute-ego": 0.15038177416874812, "deviation-heading": 0.30707254041461957, "set_robot_commands": 0.07674947518568773, "deviation-center-line": 0.2078435673968125, "driven_lanedir_consec": 0.9654696798546664, "sim_compute_sim_state": 0.03780358387873723, "sim_compute_performance-ego": 0.06493794001065768, "sim_compute_robot_state-ego": 0.08109519298260029, "sim_compute_robot_state-npc0": 0.07625717016366812, "sim_compute_robot_state-npc1": 0.07046283208406888, "sim_compute_robot_state-npc2": 0.06840849289527307, "sim_compute_robot_state-npc3": 0.0676666993361253}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.251399537036658, "sim_physics": 0.0034607794226669685, "survival_time": 4.099999999999993, "driven_lanedir": 0.6183498913595016, "sim_render-ego": 0.07238588100526391, "in-drivable-lane": 1.999999999999993, "agent_compute-ego": 0.15361634696402202, "deviation-heading": 0.37092376484647793, "set_robot_commands": 0.07792461209180879, "deviation-center-line": 0.1202293815485396, "driven_lanedir_consec": 0.6183498913595016, "sim_compute_sim_state": 0.03877081522127477, "sim_compute_performance-ego": 0.07176155869553728, "sim_compute_robot_state-ego": 0.08652885657985036, "sim_compute_robot_state-npc0": 0.07524166165328608, "sim_compute_robot_state-npc1": 0.07158690836371445, "sim_compute_robot_state-npc2": 0.0700546037860033, "sim_compute_robot_state-npc3": 0.06985915579446932}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.4782765184420794, "sim_physics": 0.0034970688819885255, "survival_time": 4.99999999999999, "driven_lanedir": 0.8516119779536884, "sim_render-ego": 0.07154616832733154, "in-drivable-lane": 2.0499999999999927, "agent_compute-ego": 0.1533345627784729, "deviation-heading": 0.3786834582492112, "set_robot_commands": 0.07727946996688843, "deviation-center-line": 0.16534908678864438, "driven_lanedir_consec": 0.8516119779536884, "sim_compute_sim_state": 0.04004054069519043, "sim_compute_performance-ego": 0.06815290212631225, "sim_compute_robot_state-ego": 0.08395183324813843, "sim_compute_robot_state-npc0": 0.07585148334503174, "sim_compute_robot_state-npc1": 0.07268509149551391, "sim_compute_robot_state-npc2": 0.07279006481170654, "sim_compute_robot_state-npc3": 0.07242671966552734}}
set_robot_commands_max0.07818323023178998
set_robot_commands_mean0.07733244214760587
set_robot_commands_median0.07727946996688843
set_robot_commands_min0.07652542326185438
sim_compute_performance-ego_max0.07176155869553728
sim_compute_performance-ego_mean0.06783862286749817
sim_compute_performance-ego_median0.06815290212631225
sim_compute_performance-ego_min0.06451143537248884
sim_compute_robot_state-ego_max0.2474263450678657
sim_compute_robot_state-ego_mean0.1169863576322657
sim_compute_robot_state-ego_median0.08592956028287373
sim_compute_robot_state-ego_min0.08109519298260029
sim_compute_robot_state-npc0_max0.07625717016366812
sim_compute_robot_state-npc0_mean0.07549491922222826
sim_compute_robot_state-npc0_median0.07532463354222915
sim_compute_robot_state-npc0_min0.07479964740692623
sim_compute_robot_state-npc1_max0.07325531454647288
sim_compute_robot_state-npc1_mean0.07203841290633309
sim_compute_robot_state-npc1_median0.07220191804189531
sim_compute_robot_state-npc1_min0.07046283208406888
sim_compute_robot_state-npc2_max0.07279006481170654
sim_compute_robot_state-npc2_mean0.07058936186581714
sim_compute_robot_state-npc2_median0.0700546037860033
sim_compute_robot_state-npc2_min0.06840849289527307
sim_compute_robot_state-npc3_max0.07242671966552734
sim_compute_robot_state-npc3_mean0.07050689446164284
sim_compute_robot_state-npc3_median0.07033605424184648
sim_compute_robot_state-npc3_min0.0676666993361253
sim_compute_sim_state_max0.041945103336783016
sim_compute_sim_state_mean0.039488041180175834
sim_compute_sim_state_median0.03888016276889377
sim_compute_sim_state_min0.03780358387873723
sim_physics_max0.0035431560348061952
sim_physics_mean0.003407510685810829
sim_physics_median0.0034607794226669685
sim_physics_min0.0031811963944208053
sim_render-ego_max0.07288482609917135
sim_render-ego_mean0.07026771197142603
sim_render-ego_median0.07154616832733154
sim_render-ego_min0.06721986990708571
simulation-passed1
survival_time_max4.99999999999999
survival_time_mean3.779999999999995
survival_time_min3.149999999999997
No reset possible
171722291Andrea Censi 🇨🇭Minimal agentaido2_LF_r2-v4step1-simulationsuccessyesidsc-rudolf-156050:07:22
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.6859990822522983
survival_time_median3.399999999999996
deviation-center-line_median0.1202293815485396
in-drivable-lane_median1.3499999999999952


other stats
agent_compute-ego_max0.1628502326853135
agent_compute-ego_mean0.1602847151185988
agent_compute-ego_median0.1592213918292333
agent_compute-ego_min0.1580863086188712
deviation-center-line_max0.20784364836514316
deviation-center-line_mean0.14265024925288242
deviation-center-line_min0.1070055904497026
deviation-heading_max0.3886055345167397
deviation-heading_mean0.3621006277452553
deviation-heading_median0.37092376484647793
deviation-heading_min0.30707254041461957
driven_any_max1.4782765184420763
driven_any_mean1.131547350619698
driven_any_median1.0097725221691731
driven_any_min0.9477327875430368
driven_lanedir_consec_max0.9654651499017186
driven_lanedir_consec_mean0.7418830599145954
driven_lanedir_consec_min0.5879893173150568
driven_lanedir_max0.9654651499017186
driven_lanedir_mean0.7418830599145954
driven_lanedir_median0.6859990822522983
driven_lanedir_min0.5879893173150568
in-drivable-lane_max2.0499999999999927
in-drivable-lane_mean1.2399999999999956
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0097725221691731, "sim_physics": 0.0035396323484532975, "survival_time": 3.399999999999996, "driven_lanedir": 0.5879893173150568, "sim_render-ego": 0.07305563197416418, "in-drivable-lane": 1.3499999999999952, "agent_compute-ego": 0.1628502326853135, "deviation-heading": 0.3886055345167397, "set_robot_commands": 0.08097763973123887, "deviation-center-line": 0.1128230942788872, "driven_lanedir_consec": 0.5879893173150568, "sim_compute_sim_state": 0.04330638226340799, "sim_compute_performance-ego": 0.07055494715185727, "sim_compute_robot_state-ego": 0.2339153815718258}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.9477327875430368, "sim_physics": 0.003368294428265284, "survival_time": 3.149999999999997, "driven_lanedir": 0.6859990822522983, "sim_render-ego": 0.06821510148426843, "in-drivable-lane": 0.7999999999999972, "agent_compute-ego": 0.1592213918292333, "deviation-heading": 0.3652178406992292, "set_robot_commands": 0.07929229357885936, "deviation-center-line": 0.1070055904497026, "driven_lanedir_consec": 0.6859990822522983, "sim_compute_sim_state": 0.042393464890737385, "sim_compute_performance-ego": 0.06912823707338363, "sim_compute_robot_state-ego": 0.07345550022427998}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.9705553879075464, "sim_physics": 0.0037119058462289664, "survival_time": 3.2499999999999964, "driven_lanedir": 0.9654651499017186, "sim_render-ego": 0.0760805790240948, "in-drivable-lane": 0, "agent_compute-ego": 0.1628333495213435, "deviation-heading": 0.30707254041461957, "set_robot_commands": 0.08144048910874586, "deviation-center-line": 0.20784364836514316, "driven_lanedir_consec": 0.9654651499017186, "sim_compute_sim_state": 0.04576404278094952, "sim_compute_performance-ego": 0.07515274561368503, "sim_compute_robot_state-ego": 0.07960303379939153}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.251399537036658, "sim_physics": 0.0035605285225844964, "survival_time": 4.099999999999993, "driven_lanedir": 0.6183498913595016, "sim_render-ego": 0.07269389454911394, "in-drivable-lane": 1.999999999999993, "agent_compute-ego": 0.1580863086188712, "deviation-heading": 0.37092376484647793, "set_robot_commands": 0.07903063297271729, "deviation-center-line": 0.1202293815485396, "driven_lanedir_consec": 0.6183498913595016, "sim_compute_sim_state": 0.043493637224523034, "sim_compute_performance-ego": 0.0702712826612519, "sim_compute_robot_state-ego": 0.07492010477112561}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.4782765184420763, "sim_physics": 0.003561890125274658, "survival_time": 4.99999999999999, "driven_lanedir": 0.8516118587444015, "sim_render-ego": 0.07466795444488525, "in-drivable-lane": 2.0499999999999927, "agent_compute-ego": 0.1584322929382324, "deviation-heading": 0.3786834582492101, "set_robot_commands": 0.07988008737564087, "deviation-center-line": 0.16534953162213956, "driven_lanedir_consec": 0.8516118587444015, "sim_compute_sim_state": 0.045462236404418946, "sim_compute_performance-ego": 0.06965257406234741, "sim_compute_robot_state-ego": 0.07723908424377442}}
set_robot_commands_max0.08144048910874586
set_robot_commands_mean0.08012422855344045
set_robot_commands_median0.07988008737564087
set_robot_commands_min0.07903063297271729
sim_compute_performance-ego_max0.07515274561368503
sim_compute_performance-ego_mean0.07095195731250505
sim_compute_performance-ego_median0.0702712826612519
sim_compute_performance-ego_min0.06912823707338363
sim_compute_robot_state-ego_max0.2339153815718258
sim_compute_robot_state-ego_mean0.10782662092207948
sim_compute_robot_state-ego_median0.07723908424377442
sim_compute_robot_state-ego_min0.07345550022427998
sim_compute_sim_state_max0.04576404278094952
sim_compute_sim_state_mean0.04408395271280737
sim_compute_sim_state_median0.043493637224523034
sim_compute_sim_state_min0.042393464890737385
sim_physics_max0.0037119058462289664
sim_physics_mean0.0035484502541613407
sim_physics_median0.0035605285225844964
sim_physics_min0.003368294428265284
sim_render-ego_max0.0760805790240948
sim_render-ego_mean0.07294263229530533
sim_render-ego_median0.07305563197416418
sim_render-ego_min0.06821510148426843
simulation-passed1
survival_time_max4.99999999999999
survival_time_mean3.779999999999995
survival_time_min3.149999999999997
No reset possible
171692294Andrea Censi 🇨🇭Minimal agentaido2_LFV_r1-v4step1-simulationsuccessyesidsc-rudolf-156050:11:44
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.8516119779536884
survival_time_median3.399999999999996
deviation-center-line_median0.16534908678864438
in-drivable-lane_median1.3499999999999952


other stats
agent_compute-ego_max0.16893930196762086
agent_compute-ego_mean0.16587884217599264
agent_compute-ego_median0.16532846408731797
agent_compute-ego_min0.16330221721104213
deviation-center-line_max0.2078435673968125
deviation-center-line_mean0.15835662027727432
deviation-center-line_min0.1128230942788872
deviation-heading_max0.3886055345167397
deviation-heading_mean0.352177996344455
deviation-heading_median0.37092376484647793
deviation-heading_min0.30707254041461957
driven_any_max1.4782765184420794
driven_any_mean1.1315473506196985
driven_any_median1.0097725221691731
driven_any_min0.9477327875430378
driven_lanedir_consec_max0.9654696798546664
driven_lanedir_consec_mean0.7930140409285634
driven_lanedir_consec_min0.5879893173150568
driven_lanedir_max0.9654696798546664
driven_lanedir_mean0.7930140409285634
driven_lanedir_median0.8516119779536884
driven_lanedir_min0.5879893173150568
in-drivable-lane_max2.0499999999999927
in-drivable-lane_mean1.079999999999996
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0097725221691731, "sim_physics": 0.003449583754819982, "survival_time": 3.399999999999996, "driven_lanedir": 0.5879893173150568, "sim_render-ego": 0.07135752719991348, "in-drivable-lane": 1.3499999999999952, "agent_compute-ego": 0.16532846408731797, "deviation-heading": 0.3886055345167397, "set_robot_commands": 0.07992631547591265, "deviation-center-line": 0.1128230942788872, "driven_lanedir_consec": 0.5879893173150568, "sim_compute_sim_state": 0.038148336550768686, "sim_compute_performance-ego": 0.06952812741784488, "sim_compute_robot_state-ego": 0.2393238439279444, "sim_compute_robot_state-npc0": 0.07960770761265475, "sim_compute_robot_state-npc1": 0.07213781861697927, "sim_compute_robot_state-npc2": 0.06959954780690811, "sim_compute_robot_state-npc3": 0.06912961426903219}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.9477327875430378, "sim_physics": 0.003381831305367606, "survival_time": 3.149999999999997, "driven_lanedir": 0.941649338159904, "sim_render-ego": 0.06823644562373085, "in-drivable-lane": 0, "agent_compute-ego": 0.16330221721104213, "deviation-heading": 0.31560468369522693, "set_robot_commands": 0.08026621833680168, "deviation-center-line": 0.18553797137348788, "driven_lanedir_consec": 0.941649338159904, "sim_compute_sim_state": 0.03603666547744993, "sim_compute_performance-ego": 0.0678073905763172, "sim_compute_robot_state-ego": 0.08930568846445235, "sim_compute_robot_state-npc0": 0.07747351177155025, "sim_compute_robot_state-npc1": 0.06939029315161327, "sim_compute_robot_state-npc2": 0.06500769796825591, "sim_compute_robot_state-npc3": 0.06572621587723021}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.9705553879075428, "sim_physics": 0.00349273314842811, "survival_time": 3.2499999999999964, "driven_lanedir": 0.9654696798546664, "sim_render-ego": 0.07048491331247184, "in-drivable-lane": 0, "agent_compute-ego": 0.16820341256948618, "deviation-heading": 0.30707254041461957, "set_robot_commands": 0.08075836621798002, "deviation-center-line": 0.2078435673968125, "driven_lanedir_consec": 0.9654696798546664, "sim_compute_sim_state": 0.03812006803659292, "sim_compute_performance-ego": 0.07006547634418193, "sim_compute_robot_state-ego": 0.0880985296689547, "sim_compute_robot_state-npc0": 0.08022126051095815, "sim_compute_robot_state-npc1": 0.072869689647968, "sim_compute_robot_state-npc2": 0.0709742362682636, "sim_compute_robot_state-npc3": 0.06914595824021559}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.251399537036658, "sim_physics": 0.0033385957159647126, "survival_time": 4.099999999999993, "driven_lanedir": 0.6183498913595016, "sim_render-ego": 0.06891189551934963, "in-drivable-lane": 1.999999999999993, "agent_compute-ego": 0.1636208150444961, "deviation-heading": 0.37092376484647793, "set_robot_commands": 0.08126597869686963, "deviation-center-line": 0.1202293815485396, "driven_lanedir_consec": 0.6183498913595016, "sim_compute_sim_state": 0.0366692659331531, "sim_compute_performance-ego": 0.06829823226463504, "sim_compute_robot_state-ego": 0.08559740171199892, "sim_compute_robot_state-npc0": 0.08004931705753977, "sim_compute_robot_state-npc1": 0.07233711568320669, "sim_compute_robot_state-npc2": 0.06862669165541486, "sim_compute_robot_state-npc3": 0.06807449968849741}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.4782765184420794, "sim_physics": 0.003458263874053955, "survival_time": 4.99999999999999, "driven_lanedir": 0.8516119779536884, "sim_render-ego": 0.06876818656921387, "in-drivable-lane": 2.0499999999999927, "agent_compute-ego": 0.16893930196762086, "deviation-heading": 0.3786834582492112, "set_robot_commands": 0.0805401110649109, "deviation-center-line": 0.16534908678864438, "driven_lanedir_consec": 0.8516119779536884, "sim_compute_sim_state": 0.03640907049179077, "sim_compute_performance-ego": 0.06836693286895752, "sim_compute_robot_state-ego": 0.08638787031173706, "sim_compute_robot_state-npc0": 0.08046381950378417, "sim_compute_robot_state-npc1": 0.07368403434753418, "sim_compute_robot_state-npc2": 0.06946311473846435, "sim_compute_robot_state-npc3": 0.06818427801132203}}
set_robot_commands_max0.08126597869686963
set_robot_commands_mean0.08055139795849497
set_robot_commands_median0.0805401110649109
set_robot_commands_min0.07992631547591265
sim_compute_performance-ego_max0.07006547634418193
sim_compute_performance-ego_mean0.06881323189438732
sim_compute_performance-ego_median0.06836693286895752
sim_compute_performance-ego_min0.0678073905763172
sim_compute_robot_state-ego_max0.2393238439279444
sim_compute_robot_state-ego_mean0.11774266681701748
sim_compute_robot_state-ego_median0.0880985296689547
sim_compute_robot_state-ego_min0.08559740171199892
sim_compute_robot_state-npc0_max0.08046381950378417
sim_compute_robot_state-npc0_mean0.07956312329129742
sim_compute_robot_state-npc0_median0.08004931705753977
sim_compute_robot_state-npc0_min0.07747351177155025
sim_compute_robot_state-npc1_max0.07368403434753418
sim_compute_robot_state-npc1_mean0.07208379028946028
sim_compute_robot_state-npc1_median0.07233711568320669
sim_compute_robot_state-npc1_min0.06939029315161327
sim_compute_robot_state-npc2_max0.0709742362682636
sim_compute_robot_state-npc2_mean0.06873425768746136
sim_compute_robot_state-npc2_median0.06946311473846435
sim_compute_robot_state-npc2_min0.06500769796825591
sim_compute_robot_state-npc3_max0.06914595824021559
sim_compute_robot_state-npc3_mean0.06805211321725949
sim_compute_robot_state-npc3_median0.06818427801132203
sim_compute_robot_state-npc3_min0.06572621587723021
sim_compute_sim_state_max0.038148336550768686
sim_compute_sim_state_mean0.03707668129795109
sim_compute_sim_state_median0.0366692659331531
sim_compute_sim_state_min0.03603666547744993
sim_physics_max0.00349273314842811
sim_physics_mean0.003424201559726873
sim_physics_median0.003449583754819982
sim_physics_min0.0033385957159647126
sim_render-ego_max0.07135752719991348
sim_render-ego_mean0.06955179364493594
sim_render-ego_median0.06891189551934963
sim_render-ego_min0.06823644562373085
simulation-passed1
survival_time_max4.99999999999999
survival_time_mean3.779999999999995
survival_time_min3.149999999999997
No reset possible
171652306Andrea Censi 🇨🇭Minimal agentaido2_LFVI_r1-v4step1-simulationsuccessyesidsc-rudolf-156050:14:25
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.72155331423772
survival_time_median4.249999999999993
deviation-center-line_median0.15741823007542524
in-drivable-lane_median1.7499999999999938


other stats
agent_compute-ego_max0.1677781105041504
agent_compute-ego_mean0.16521743772774283
agent_compute-ego_median0.16483542766976864
agent_compute-ego_min0.1623586741360751
deviation-center-line_max0.32861340027620084
deviation-center-line_mean0.16720563088123774
deviation-center-line_min0.08372346350452832
deviation-heading_max1.6095487863912878
deviation-heading_mean0.7416120746207572
deviation-heading_median0.6111580236941071
deviation-heading_min0.3663194255812494
driven_any_max2.174849274549989
driven_any_mean1.370290316170529
driven_any_median1.2632550932005688
driven_any_min0.9890108043245008
driven_lanedir_consec_max1.0300199271670714
driven_lanedir_consec_mean0.7679244191832472
driven_lanedir_consec_min0.523101221541693
driven_lanedir_max1.0586376106182156
driven_lanedir_mean0.773647955873476
driven_lanedir_median0.72155331423772
driven_lanedir_min0.523101221541693
in-drivable-lane_max3.149999999999989
in-drivable-lane_mean1.7699999999999938
in-drivable-lane_min0.1999999999999993
per-episodes
details{"udem1-0-0": {"driven_any": 2.174849274549989, "sim_physics": 0.0035211250699799636, "survival_time": 7.249999999999982, "driven_lanedir": 1.0586376106182156, "sim_render-ego": 0.07485914559199892, "in-drivable-lane": 3.149999999999989, "agent_compute-ego": 0.16465196938350282, "deviation-heading": 1.6095487863912878, "set_robot_commands": 0.07931229492713665, "deviation-center-line": 0.32861340027620084, "driven_lanedir_consec": 1.0300199271670714, "sim_compute_sim_state": 0.04231998838227371, "sim_compute_performance-ego": 0.07294942263899179, "sim_compute_robot_state-ego": 0.1605490931149187, "sim_compute_robot_state-npc0": 0.07887155763034163, "sim_compute_robot_state-npc1": 0.07586088673821811, "sim_compute_robot_state-npc2": 0.07332222708340348, "sim_compute_robot_state-npc3": 0.07491537127001532}, "udem1-1-0": {"driven_any": 0.9890108043245008, "sim_physics": 0.003661856506810044, "survival_time": 3.2999999999999963, "driven_lanedir": 0.6673090295116273, "sim_render-ego": 0.07595645658897632, "in-drivable-lane": 0.849999999999997, "agent_compute-ego": 0.1623586741360751, "deviation-heading": 0.6111580236941071, "set_robot_commands": 0.07886245395198013, "deviation-center-line": 0.08372346350452832, "driven_lanedir_consec": 0.6673090295116273, "sim_compute_sim_state": 0.04183211109854958, "sim_compute_performance-ego": 0.07350074883663293, "sim_compute_robot_state-ego": 0.09061178294095126, "sim_compute_robot_state-npc0": 0.07822611115195534, "sim_compute_robot_state-npc1": 0.07552951754945697, "sim_compute_robot_state-npc2": 0.07569078965620561, "sim_compute_robot_state-npc3": 0.07554973977984804}, "udem1-2-0": {"driven_any": 1.4132589628801058, "sim_physics": 0.0033858786238000747, "survival_time": 4.699999999999991, "driven_lanedir": 0.523101221541693, "sim_render-ego": 0.06597935646138292, "in-drivable-lane": 2.8999999999999906, "agent_compute-ego": 0.16483542766976864, "deviation-heading": 0.3663194255812494, "set_robot_commands": 0.08057452769989663, "deviation-center-line": 0.10412585673382428, "driven_lanedir_consec": 0.523101221541693, "sim_compute_sim_state": 0.03568743644876683, "sim_compute_performance-ego": 0.0655076782754127, "sim_compute_robot_state-ego": 0.0870287114001335, "sim_compute_robot_state-npc0": 0.08058722983015344, "sim_compute_robot_state-npc1": 0.07156919418497289, "sim_compute_robot_state-npc2": 0.06768672517005433, "sim_compute_robot_state-npc3": 0.06596357010780497}, "udem1-3-0": {"driven_any": 1.2632550932005688, "sim_physics": 0.0034048865823184745, "survival_time": 4.249999999999993, "driven_lanedir": 0.72155331423772, "sim_render-ego": 0.06905896803911994, "in-drivable-lane": 1.7499999999999938, "agent_compute-ego": 0.1677781105041504, "deviation-heading": 0.37503744954470697, "set_robot_commands": 0.08134729721966912, "deviation-center-line": 0.15741823007542524, "driven_lanedir_consec": 0.72155331423772, "sim_compute_sim_state": 0.03788644285763011, "sim_compute_performance-ego": 0.06844074585858513, "sim_compute_robot_state-ego": 0.08717314776252298, "sim_compute_robot_state-npc0": 0.0803974235759062, "sim_compute_robot_state-npc1": 0.07287542399238138, "sim_compute_robot_state-npc2": 0.06844554788926069, "sim_compute_robot_state-npc3": 0.06810976477230296}, "udem1-4-0": {"driven_any": 1.0110774458974832, "sim_physics": 0.003425738390754251, "survival_time": 3.399999999999996, "driven_lanedir": 0.8976386034581241, "sim_render-ego": 0.06875759012558881, "in-drivable-lane": 0.1999999999999993, "agent_compute-ego": 0.16646300694521737, "deviation-heading": 0.7459966878924339, "set_robot_commands": 0.08099676931605619, "deviation-center-line": 0.16214720381621003, "driven_lanedir_consec": 0.8976386034581241, "sim_compute_sim_state": 0.03642116925295662, "sim_compute_performance-ego": 0.06672197229721967, "sim_compute_robot_state-ego": 0.08355654337826897, "sim_compute_robot_state-npc0": 0.08102417693418615, "sim_compute_robot_state-npc1": 0.0725515554932987, "sim_compute_robot_state-npc2": 0.06803922793444465, "sim_compute_robot_state-npc3": 0.06610003990285537}}
set_robot_commands_max0.08134729721966912
set_robot_commands_mean0.08021866862294774
set_robot_commands_median0.08057452769989663
set_robot_commands_min0.07886245395198013
sim_compute_performance-ego_max0.07350074883663293
sim_compute_performance-ego_mean0.06942411358136844
sim_compute_performance-ego_median0.06844074585858513
sim_compute_performance-ego_min0.0655076782754127
sim_compute_robot_state-ego_max0.1605490931149187
sim_compute_robot_state-ego_mean0.10178385571935908
sim_compute_robot_state-ego_median0.08717314776252298
sim_compute_robot_state-ego_min0.08355654337826897
sim_compute_robot_state-npc0_max0.08102417693418615
sim_compute_robot_state-npc0_mean0.07982129982450854
sim_compute_robot_state-npc0_median0.0803974235759062
sim_compute_robot_state-npc0_min0.07822611115195534
sim_compute_robot_state-npc1_max0.07586088673821811
sim_compute_robot_state-npc1_mean0.07367731559166561
sim_compute_robot_state-npc1_median0.07287542399238138
sim_compute_robot_state-npc1_min0.07156919418497289
sim_compute_robot_state-npc2_max0.07569078965620561
sim_compute_robot_state-npc2_mean0.07063690354667376
sim_compute_robot_state-npc2_median0.06844554788926069
sim_compute_robot_state-npc2_min0.06768672517005433
sim_compute_robot_state-npc3_max0.07554973977984804
sim_compute_robot_state-npc3_mean0.07012769716656533
sim_compute_robot_state-npc3_median0.06810976477230296
sim_compute_robot_state-npc3_min0.06596357010780497
sim_compute_sim_state_max0.04231998838227371
sim_compute_sim_state_mean0.03882942960803537
sim_compute_sim_state_median0.03788644285763011
sim_compute_sim_state_min0.03568743644876683
sim_physics_max0.003661856506810044
sim_physics_mean0.003479897034732561
sim_physics_median0.003425738390754251
sim_physics_min0.0033858786238000747
sim_render-ego_max0.07595645658897632
sim_render-ego_mean0.07092230336141338
sim_render-ego_median0.06905896803911994
sim_render-ego_min0.06597935646138292
simulation-passed1
survival_time_max7.249999999999982
survival_time_mean4.579999999999992
survival_time_min3.2999999999999963
No reset possible
171532325FANG MEIYI 🇸🇬Testaido2_LF_r2-v4step1-simulationsuccessyesidsc-rudolf-156050:21:05
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median6.093414518867213
survival_time_median14.950000000000076
deviation-center-line_median0.5939271408979139
in-drivable-lane_median0


other stats
agent_compute-ego_max0.16282434725179906
agent_compute-ego_mean0.16013988356473968
agent_compute-ego_median0.16028155167897545
agent_compute-ego_min0.15766501903533936
deviation-center-line_max0.7789506859242888
deviation-center-line_mean0.6316414758602533
deviation-center-line_min0.4571611116225624
deviation-heading_max2.436309779744569
deviation-heading_mean1.9628528995525696
deviation-heading_median2.1280803535324355
deviation-heading_min1.4799683951517393
driven_any_max7.150167970227457
driven_any_mean5.898295850713298
driven_any_median6.193937813823043
driven_any_min3.4129615780670037
driven_lanedir_consec_max7.089323606734097
driven_lanedir_consec_mean5.803565665203863
driven_lanedir_consec_min3.3380938781157967
driven_lanedir_max7.089323606734097
driven_lanedir_mean5.803565665203863
driven_lanedir_median6.093414518867213
driven_lanedir_min3.3380938781157967
in-drivable-lane_max0
in-drivable-lane_mean0
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 6.013957067397739, "sim_physics": 0.0036030340194702143, "survival_time": 14.950000000000076, "driven_lanedir": 5.907502356436517, "sim_render-ego": 0.0699372148513794, "in-drivable-lane": 0, "agent_compute-ego": 0.16161720355351766, "deviation-heading": 2.436309779744569, "set_robot_commands": 0.07865971644719441, "deviation-center-line": 0.7789506859242888, "driven_lanedir_consec": 5.907502356436517, "sim_compute_sim_state": 0.04442125161488851, "sim_compute_performance-ego": 0.06976161479949951, "sim_compute_robot_state-ego": 0.1261569619178772}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 7.150167970227457, "sim_physics": 0.0034487303098042804, "survival_time": 14.950000000000076, "driven_lanedir": 7.089323606734097, "sim_render-ego": 0.07025390307108562, "in-drivable-lane": 0, "agent_compute-ego": 0.16028155167897545, "deviation-heading": 1.5183558725392026, "set_robot_commands": 0.07958656311035156, "deviation-center-line": 0.4571611116225624, "driven_lanedir_consec": 7.089323606734097, "sim_compute_sim_state": 0.04377541780471802, "sim_compute_performance-ego": 0.0693871013323466, "sim_compute_robot_state-ego": 0.07603950262069702}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 6.720454824051246, "sim_physics": 0.003493035634358724, "survival_time": 14.950000000000076, "driven_lanedir": 6.589493965865691, "sim_render-ego": 0.07108011563618978, "in-drivable-lane": 0, "agent_compute-ego": 0.15766501903533936, "deviation-heading": 2.1280803535324355, "set_robot_commands": 0.07857067902882894, "deviation-center-line": 0.7489407010239184, "driven_lanedir_consec": 6.589493965865691, "sim_compute_sim_state": 0.04378937244415283, "sim_compute_performance-ego": 0.06984488089879354, "sim_compute_robot_state-ego": 0.07635487000147502}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 6.193937813823043, "sim_physics": 0.0035520307223002117, "survival_time": 14.950000000000076, "driven_lanedir": 6.093414518867213, "sim_render-ego": 0.07195269664128622, "in-drivable-lane": 0, "agent_compute-ego": 0.15831129630406698, "deviation-heading": 2.2515500967949036, "set_robot_commands": 0.07951456387837728, "deviation-center-line": 0.5939271408979139, "driven_lanedir_consec": 6.093414518867213, "sim_compute_sim_state": 0.04370074987411499, "sim_compute_performance-ego": 0.06923004627227783, "sim_compute_robot_state-ego": 0.0754578709602356}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 3.4129615780670037, "sim_physics": 0.003607747031421196, "survival_time": 8.199999999999982, "driven_lanedir": 3.3380938781157967, "sim_render-ego": 0.07291875089087137, "in-drivable-lane": 0, "agent_compute-ego": 0.16282434725179906, "deviation-heading": 1.4799683951517393, "set_robot_commands": 0.08163017906793733, "deviation-center-line": 0.5792277398325827, "driven_lanedir_consec": 3.3380938781157967, "sim_compute_sim_state": 0.044461385505955395, "sim_compute_performance-ego": 0.07115032323976843, "sim_compute_robot_state-ego": 0.07956054879397881}}
set_robot_commands_max0.08163017906793733
set_robot_commands_mean0.07959234030653792
set_robot_commands_median0.07951456387837728
set_robot_commands_min0.07857067902882894
sim_compute_performance-ego_max0.07115032323976843
sim_compute_performance-ego_mean0.06987479330853719
sim_compute_performance-ego_median0.06976161479949951
sim_compute_performance-ego_min0.06923004627227783
sim_compute_robot_state-ego_max0.1261569619178772
sim_compute_robot_state-ego_mean0.08671395085885272
sim_compute_robot_state-ego_median0.07635487000147502
sim_compute_robot_state-ego_min0.0754578709602356
sim_compute_sim_state_max0.044461385505955395
sim_compute_sim_state_mean0.044029635448765946
sim_compute_sim_state_median0.04378937244415283
sim_compute_sim_state_min0.04370074987411499
sim_physics_max0.003607747031421196
sim_physics_mean0.0035409155434709253
sim_physics_median0.0035520307223002117
sim_physics_min0.0034487303098042804
sim_render-ego_max0.07291875089087137
sim_render-ego_mean0.07122853621816247
sim_render-ego_median0.07108011563618978
sim_render-ego_min0.0699372148513794
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean13.600000000000056
survival_time_min8.199999999999982
No reset possible
171502329Konstantin ChaikaMinimal agentaido2_LFVI_r1-v4step1-simulationsuccessyesidsc-rudolf-156050:14:37
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.72155331423772
survival_time_median4.249999999999993
deviation-center-line_median0.15741823007542524
in-drivable-lane_median1.7499999999999938


other stats
agent_compute-ego_max0.16026133425692293
agent_compute-ego_mean0.15687718240822218
agent_compute-ego_median0.15841844587615042
agent_compute-ego_min0.15256940336788402
deviation-center-line_max0.32861340027620084
deviation-center-line_mean0.16720563088123774
deviation-center-line_min0.08372346350452832
deviation-heading_max1.6095487863912878
deviation-heading_mean0.7416120746207572
deviation-heading_median0.6111580236941071
deviation-heading_min0.3663194255812494
driven_any_max2.174849274549989
driven_any_mean1.370290316170529
driven_any_median1.2632550932005688
driven_any_min0.9890108043245008
driven_lanedir_consec_max1.0300199271670714
driven_lanedir_consec_mean0.7679244191832472
driven_lanedir_consec_min0.523101221541693
driven_lanedir_max1.0586376106182156
driven_lanedir_mean0.773647955873476
driven_lanedir_median0.72155331423772
driven_lanedir_min0.523101221541693
in-drivable-lane_max3.149999999999989
in-drivable-lane_mean1.7699999999999938
in-drivable-lane_min0.1999999999999993
per-episodes
details{"udem1-0-0": {"driven_any": 2.174849274549989, "sim_physics": 0.0035089032403353986, "survival_time": 7.249999999999982, "driven_lanedir": 1.0586376106182156, "sim_render-ego": 0.0730210961966679, "in-drivable-lane": 3.149999999999989, "agent_compute-ego": 0.15985430355729727, "deviation-heading": 1.6095487863912878, "set_robot_commands": 0.07863938890654465, "deviation-center-line": 0.32861340027620084, "driven_lanedir_consec": 1.0300199271670714, "sim_compute_sim_state": 0.04145848175574993, "sim_compute_performance-ego": 0.06959737415971427, "sim_compute_robot_state-ego": 0.15706436716277025, "sim_compute_robot_state-npc0": 0.0770537491502433, "sim_compute_robot_state-npc1": 0.07366754597630994, "sim_compute_robot_state-npc2": 0.07313495011165225, "sim_compute_robot_state-npc3": 0.07321889647122087}, "udem1-1-0": {"driven_any": 0.9890108043245008, "sim_physics": 0.003599004311995073, "survival_time": 3.2999999999999963, "driven_lanedir": 0.6673090295116273, "sim_render-ego": 0.07287927107377486, "in-drivable-lane": 0.849999999999997, "agent_compute-ego": 0.15841844587615042, "deviation-heading": 0.6111580236941071, "set_robot_commands": 0.07788523399468625, "deviation-center-line": 0.08372346350452832, "driven_lanedir_consec": 0.6673090295116273, "sim_compute_sim_state": 0.042224649227026734, "sim_compute_performance-ego": 0.07077138712911894, "sim_compute_robot_state-ego": 0.08582876306591612, "sim_compute_robot_state-npc0": 0.07745104486292059, "sim_compute_robot_state-npc1": 0.07464819965940533, "sim_compute_robot_state-npc2": 0.074430733016043, "sim_compute_robot_state-npc3": 0.07321982311479973}, "udem1-2-0": {"driven_any": 1.4132589628801058, "sim_physics": 0.003517102687916857, "survival_time": 4.699999999999991, "driven_lanedir": 0.523101221541693, "sim_render-ego": 0.07340402045148484, "in-drivable-lane": 2.8999999999999906, "agent_compute-ego": 0.16026133425692293, "deviation-heading": 0.3663194255812494, "set_robot_commands": 0.07828533142171007, "deviation-center-line": 0.10412585673382428, "driven_lanedir_consec": 0.523101221541693, "sim_compute_sim_state": 0.040964228041628574, "sim_compute_performance-ego": 0.06907250272466782, "sim_compute_robot_state-ego": 0.0882828007353113, "sim_compute_robot_state-npc0": 0.07681023060007298, "sim_compute_robot_state-npc1": 0.07290106124066292, "sim_compute_robot_state-npc2": 0.07158776547046418, "sim_compute_robot_state-npc3": 0.07247500723980843}, "udem1-3-0": {"driven_any": 1.2632550932005688, "sim_physics": 0.0032597738153794234, "survival_time": 4.249999999999993, "driven_lanedir": 0.72155331423772, "sim_render-ego": 0.07101303549373851, "in-drivable-lane": 1.7499999999999938, "agent_compute-ego": 0.15256940336788402, "deviation-heading": 0.37503744954470697, "set_robot_commands": 0.07695945010465734, "deviation-center-line": 0.15741823007542524, "driven_lanedir_consec": 0.72155331423772, "sim_compute_sim_state": 0.038115532257977654, "sim_compute_performance-ego": 0.06773196669185863, "sim_compute_robot_state-ego": 0.08803350504706887, "sim_compute_robot_state-npc0": 0.07386065090403837, "sim_compute_robot_state-npc1": 0.070588420419132, "sim_compute_robot_state-npc2": 0.0698066374834846, "sim_compute_robot_state-npc3": 0.06925818779889276}, "udem1-4-0": {"driven_any": 1.0110774458974832, "sim_physics": 0.0034487457836375516, "survival_time": 3.399999999999996, "driven_lanedir": 0.8976386034581241, "sim_render-ego": 0.071326543303097, "in-drivable-lane": 0.1999999999999993, "agent_compute-ego": 0.1532824249828563, "deviation-heading": 0.7459966878924339, "set_robot_commands": 0.07789353412740371, "deviation-center-line": 0.16214720381621003, "driven_lanedir_consec": 0.8976386034581241, "sim_compute_sim_state": 0.040032239521251005, "sim_compute_performance-ego": 0.06878948912901037, "sim_compute_robot_state-ego": 0.08401425445781034, "sim_compute_robot_state-npc0": 0.0786635209532345, "sim_compute_robot_state-npc1": 0.07272558703142054, "sim_compute_robot_state-npc2": 0.07159088289036471, "sim_compute_robot_state-npc3": 0.07149679169935338}}
set_robot_commands_max0.07863938890654465
set_robot_commands_mean0.0779325877110004
set_robot_commands_median0.07789353412740371
set_robot_commands_min0.07695945010465734
sim_compute_performance-ego_max0.07077138712911894
sim_compute_performance-ego_mean0.06919254396687402
sim_compute_performance-ego_median0.06907250272466782
sim_compute_performance-ego_min0.06773196669185863
sim_compute_robot_state-ego_max0.15706436716277025
sim_compute_robot_state-ego_mean0.10064473809377536
sim_compute_robot_state-ego_median0.08803350504706887
sim_compute_robot_state-ego_min0.08401425445781034
sim_compute_robot_state-npc0_max0.0786635209532345
sim_compute_robot_state-npc0_mean0.07676783929410196
sim_compute_robot_state-npc0_median0.0770537491502433
sim_compute_robot_state-npc0_min0.07386065090403837
sim_compute_robot_state-npc1_max0.07464819965940533
sim_compute_robot_state-npc1_mean0.07290616286538613
sim_compute_robot_state-npc1_median0.07290106124066292
sim_compute_robot_state-npc1_min0.070588420419132
sim_compute_robot_state-npc2_max0.074430733016043
sim_compute_robot_state-npc2_mean0.07211019379440174
sim_compute_robot_state-npc2_median0.07159088289036471
sim_compute_robot_state-npc2_min0.0698066374834846
sim_compute_robot_state-npc3_max0.07321982311479973
sim_compute_robot_state-npc3_mean0.07193374126481504
sim_compute_robot_state-npc3_median0.07247500723980843
sim_compute_robot_state-npc3_min0.06925818779889276
sim_compute_sim_state_max0.042224649227026734
sim_compute_sim_state_mean0.04055902616072678
sim_compute_sim_state_median0.040964228041628574
sim_compute_sim_state_min0.038115532257977654
sim_physics_max0.003599004311995073
sim_physics_mean0.00346670596785286
sim_physics_median0.0035089032403353986
sim_physics_min0.0032597738153794234
sim_render-ego_max0.07340402045148484
sim_render-ego_mean0.07232879330375262
sim_render-ego_median0.07287927107377486
sim_render-ego_min0.07101303549373851
simulation-passed1
survival_time_max7.249999999999982
survival_time_mean4.579999999999992
survival_time_min3.2999999999999963
No reset possible
171442243Andrea Censi 🇨🇭Solution templateaido2_LF_r2-v4step1-simulationabortedyesidsc-rudolf-156050:07:24
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.6859990822522983
survival_time_median3.399999999999996
deviation-center-line_median0.1202293815485396
in-drivable-lane_median1.3499999999999952


other stats
agent_compute-ego_max0.16070545882713505
agent_compute-ego_mean0.1579022280081681
agent_compute-ego_median0.15743075855194577
agent_compute-ego_min0.1562497067451477
deviation-center-line_max0.20784364836514316
deviation-center-line_mean0.14265024925288242
deviation-center-line_min0.1070055904497026
deviation-heading_max0.3886055345167397
deviation-heading_mean0.3621006277452553
deviation-heading_median0.37092376484647793
deviation-heading_min0.30707254041461957
driven_any_max1.4782765184420763
driven_any_mean1.131547350619698
driven_any_median1.0097725221691731
driven_any_min0.9477327875430368
driven_lanedir_consec_max0.9654651499017186
driven_lanedir_consec_mean0.7418830599145954
driven_lanedir_consec_min0.5879893173150568
driven_lanedir_max0.9654651499017186
driven_lanedir_mean0.7418830599145954
driven_lanedir_median0.6859990822522983
driven_lanedir_min0.5879893173150568
in-drivable-lane_max2.0499999999999927
in-drivable-lane_mean1.2399999999999956
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0097725221691731, "sim_physics": 0.0034885301309473373, "survival_time": 3.399999999999996, "driven_lanedir": 0.5879893173150568, "sim_render-ego": 0.06730498285854564, "in-drivable-lane": 1.3499999999999952, "agent_compute-ego": 0.15741070228464463, "deviation-heading": 0.3886055345167397, "set_robot_commands": 0.07965005846584544, "deviation-center-line": 0.1128230942788872, "driven_lanedir_consec": 0.5879893173150568, "sim_compute_sim_state": 0.042586400228388166, "sim_compute_performance-ego": 0.0670889370581683, "sim_compute_robot_state-ego": 0.2610599608982311}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.9477327875430368, "sim_physics": 0.003507905536227756, "survival_time": 3.149999999999997, "driven_lanedir": 0.6859990822522983, "sim_render-ego": 0.06677403525700645, "in-drivable-lane": 0.7999999999999972, "agent_compute-ego": 0.15743075855194577, "deviation-heading": 0.3652178406992292, "set_robot_commands": 0.07874516078404017, "deviation-center-line": 0.1070055904497026, "driven_lanedir_consec": 0.6859990822522983, "sim_compute_sim_state": 0.04286822061690073, "sim_compute_performance-ego": 0.06983311214144268, "sim_compute_robot_state-ego": 0.07862515676589239}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.9705553879075464, "sim_physics": 0.0037124963907095103, "survival_time": 3.2499999999999964, "driven_lanedir": 0.9654651499017186, "sim_render-ego": 0.06935433241037223, "in-drivable-lane": 0, "agent_compute-ego": 0.1577145136319674, "deviation-heading": 0.30707254041461957, "set_robot_commands": 0.08324867762052096, "deviation-center-line": 0.20784364836514316, "driven_lanedir_consec": 0.9654651499017186, "sim_compute_sim_state": 0.04267978301415076, "sim_compute_performance-ego": 0.0694525645329402, "sim_compute_robot_state-ego": 0.07692051300635705}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.251399537036658, "sim_physics": 0.003594052500841094, "survival_time": 4.099999999999993, "driven_lanedir": 0.6183498913595016, "sim_render-ego": 0.06712950438987918, "in-drivable-lane": 1.999999999999993, "agent_compute-ego": 0.16070545882713505, "deviation-heading": 0.37092376484647793, "set_robot_commands": 0.08241661001996296, "deviation-center-line": 0.1202293815485396, "driven_lanedir_consec": 0.6183498913595016, "sim_compute_sim_state": 0.04208975303463819, "sim_compute_performance-ego": 0.07001293868553347, "sim_compute_robot_state-ego": 0.07895814209449582}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.4782765184420763, "sim_physics": 0.0031974315643310547, "survival_time": 4.99999999999999, "driven_lanedir": 0.8516118587444015, "sim_render-ego": 0.06702053070068359, "in-drivable-lane": 2.0499999999999927, "agent_compute-ego": 0.1562497067451477, "deviation-heading": 0.3786834582492101, "set_robot_commands": 0.08211185455322266, "deviation-center-line": 0.16534953162213956, "driven_lanedir_consec": 0.8516118587444015, "sim_compute_sim_state": 0.04313917398452759, "sim_compute_performance-ego": 0.0655730414390564, "sim_compute_robot_state-ego": 0.07536094665527343}}
set_robot_commands_max0.08324867762052096
set_robot_commands_mean0.08123447228871844
set_robot_commands_median0.08211185455322266
set_robot_commands_min0.07874516078404017
sim_compute_performance-ego_max0.07001293868553347
sim_compute_performance-ego_mean0.06839211877142821
sim_compute_performance-ego_median0.0694525645329402
sim_compute_performance-ego_min0.0655730414390564
sim_compute_robot_state-ego_max0.2610599608982311
sim_compute_robot_state-ego_mean0.11418494388404996
sim_compute_robot_state-ego_median0.07862515676589239
sim_compute_robot_state-ego_min0.07536094665527343
sim_compute_sim_state_max0.04313917398452759
sim_compute_sim_state_mean0.04267266617572109
sim_compute_sim_state_median0.04267978301415076
sim_compute_sim_state_min0.04208975303463819
sim_physics_max0.0037124963907095103
sim_physics_mean0.0035000832246113505
sim_physics_median0.003507905536227756
sim_physics_min0.0031974315643310547
sim_render-ego_max0.06935433241037223
sim_render-ego_mean0.06751667712329742
sim_render-ego_median0.06712950438987918
sim_render-ego_min0.06677403525700645
simulation-passed1
survival_time_max4.99999999999999
survival_time_mean3.779999999999995
survival_time_min3.149999999999997
No reset possible
171422335Liam Paull 🇨🇦PredictorLastaido2-PREDstep1-simulationsuccessnoidsc-rudolf-156050:00:29
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
error_L10.11080438040174542
error_L20.020055826470213298


No reset possible
171312325FANG MEIYI 🇸🇬Testaido2_LF_r2-v4step1-simulationsuccessnoidsc-rudolf-156050:19:21
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median3.6632913033091703
survival_time_median11.350000000000026
deviation-center-line_median0.42162067449075247
in-drivable-lane_median2.3500000000000334


other stats
agent_compute-ego_max0.1626291957720786
agent_compute-ego_mean0.15965131286545117
agent_compute-ego_median0.1596937640508016
agent_compute-ego_min0.1571553315107639
deviation-center-line_max0.8436270278050553
deviation-center-line_mean0.5065269756347323
deviation-center-line_min0.3519723049336248
deviation-heading_max1.8946707588191969
deviation-heading_mean1.7055618200519518
deviation-heading_median1.7445593731022224
deviation-heading_min1.5080151151423715
driven_any_max6.7659463129424795
driven_any_mean5.221821278489969
driven_any_median4.7614394072365105
driven_any_min4.5830206314036355
driven_lanedir_consec_max5.661827004720428
driven_lanedir_consec_mean4.130122130948473
driven_lanedir_consec_min3.4023350697668184
driven_lanedir_max5.661827004720428
driven_lanedir_mean4.130122130948473
driven_lanedir_median3.6632913033091703
driven_lanedir_min3.4023350697668184
in-drivable-lane_max4.950000000000035
in-drivable-lane_mean2.420000000000023
in-drivable-lane_min0.05000000000000071
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 4.5830206314036355, "sim_physics": 0.002983972364585305, "survival_time": 11.350000000000026, "driven_lanedir": 4.479589280991947, "sim_render-ego": 0.07018606358162632, "in-drivable-lane": 0.05000000000000071, "agent_compute-ego": 0.1626291957720786, "deviation-heading": 1.8297009971176137, "set_robot_commands": 0.079000131674275, "deviation-center-line": 0.5178068635368335, "driven_lanedir_consec": 4.479589280991947, "sim_compute_sim_state": 0.044601561214430215, "sim_compute_performance-ego": 0.06768849557716941, "sim_compute_robot_state-ego": 0.139615716388047}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 6.7659463129424795, "sim_physics": 0.002886809508005778, "survival_time": 14.950000000000076, "driven_lanedir": 5.661827004720428, "sim_render-ego": 0.06882853349049886, "in-drivable-lane": 2.3500000000000334, "agent_compute-ego": 0.1596937640508016, "deviation-heading": 1.5508628560783553, "set_robot_commands": 0.07775519529978435, "deviation-center-line": 0.8436270278050553, "driven_lanedir_consec": 5.661827004720428, "sim_compute_sim_state": 0.04424352486928304, "sim_compute_performance-ego": 0.06681376457214355, "sim_compute_robot_state-ego": 0.07844706137975056}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 4.7614394072365105, "sim_physics": 0.0030256429543861975, "survival_time": 10.400000000000013, "driven_lanedir": 3.4435679959540018, "sim_render-ego": 0.06669572568856753, "in-drivable-lane": 2.5000000000000133, "agent_compute-ego": 0.1571553315107639, "deviation-heading": 1.7445593731022224, "set_robot_commands": 0.07740175150907956, "deviation-center-line": 0.3519723049336248, "driven_lanedir_consec": 3.4435679959540018, "sim_compute_sim_state": 0.043340470928412214, "sim_compute_performance-ego": 0.06740342539090377, "sim_compute_robot_state-ego": 0.07774481635827285}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 4.66415707955746, "sim_physics": 0.0027881181828109673, "survival_time": 11.150000000000023, "driven_lanedir": 3.6632913033091703, "sim_render-ego": 0.06744879564362256, "in-drivable-lane": 2.250000000000032, "agent_compute-ego": 0.1575456189467768, "deviation-heading": 1.5080151151423715, "set_robot_commands": 0.07809893432754038, "deviation-center-line": 0.39760800740739544, "driven_lanedir_consec": 3.6632913033091703, "sim_compute_sim_state": 0.04386958626888258, "sim_compute_performance-ego": 0.06514589882752286, "sim_compute_robot_state-ego": 0.0781370470876651}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 5.334542961309763, "sim_physics": 0.003081709035710331, "survival_time": 13.450000000000056, "driven_lanedir": 3.4023350697668184, "sim_render-ego": 0.06943931455505825, "in-drivable-lane": 4.950000000000035, "agent_compute-ego": 0.16123265404683507, "deviation-heading": 1.8946707588191969, "set_robot_commands": 0.08221248091375075, "deviation-center-line": 0.42162067449075247, "driven_lanedir_consec": 3.4023350697668184, "sim_compute_sim_state": 0.044457179463042645, "sim_compute_performance-ego": 0.06763722550913304, "sim_compute_robot_state-ego": 0.07831822983837482}}
set_robot_commands_max0.08221248091375075
set_robot_commands_mean0.07889369874488601
set_robot_commands_median0.07809893432754038
set_robot_commands_min0.07740175150907956
sim_compute_performance-ego_max0.06768849557716941
sim_compute_performance-ego_mean0.06693776197537452
sim_compute_performance-ego_median0.06740342539090377
sim_compute_performance-ego_min0.06514589882752286
sim_compute_robot_state-ego_max0.139615716388047
sim_compute_robot_state-ego_mean0.09045257421042208
sim_compute_robot_state-ego_median0.07831822983837482
sim_compute_robot_state-ego_min0.07774481635827285
sim_compute_sim_state_max0.044601561214430215
sim_compute_sim_state_mean0.04410246454881014
sim_compute_sim_state_median0.04424352486928304
sim_compute_sim_state_min0.043340470928412214
sim_physics_max0.003081709035710331
sim_physics_mean0.0029532504090997156
sim_physics_median0.002983972364585305
sim_physics_min0.0027881181828109673
sim_render-ego_max0.07018606358162632
sim_render-ego_mean0.06851968659187471
sim_render-ego_median0.06882853349049886
sim_render-ego_min0.06669572568856753
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean12.26000000000004
survival_time_min10.400000000000013
No reset possible
171252328Konstantin ChaikaMinimal agentaido2_LFV_r1-v4step1-simulationtimeoutnoidsc-rudolf-15605----No reset possible
171202330Nikhil Khedekar 🇮🇳PredictorLastaido2-PREDstep1-simulationsuccessnoidsc-rudolf-156050:00:29
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
error_L10.11782539318564283
error_L20.02170716396206676


No reset possible
171182319FANG MEIYI 🇸🇬Baseline solution using imitation learning from logsaido2_LF_r2-v4step1-simulationerrornoidsc-rudolf-156050:01:44
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "experiment_manager.py", line 89, in main
    raise Exception(msg)  # XXX
Exception: Too many failures: 2

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
    yield cie
  File "experiment_manager.py", line 404, in <module>
    wrap(cie)
  File "experiment_manager.py", line 393, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 176, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Traceback (most recent call last):
  File "experiment_manager.py", line 89, in main
    raise Exception(msg)  # XXX
Exception: Too many failures: 2

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible