Duckietown Challenges Home Challenges Submissions

Evaluator 1299

ID1299
evaluatorip-172-31-40-253-12257
ownerI don't have one 😀
machineip-172-31-40-253
processip-172-31-40-253-12257
versiond-c:4.0.30;d-c-r:4.0.46;d-s:4.0.22
first heard
last heard
statusinactive
# evaluating
# success7 23215
# timeout
# failed1 23673
# error6 23163
# aborted1 23560
# host-error
arm
x86_64
Mac
gpu available
Number of processors
Processor frequency (MHz)
Free % of processors
RAM total (MB)
RAM free (MB)
Disk (MB)
Disk available (MB)
Docker Hub
P1
P2
Cloud simulations
PI Camera
# Duckiebots
Map 3x3 avaiable
Number of duckies
gpu cores
AIDO 2 Map LF public
AIDO 2 Map LF private
AIDO 2 Map LFV public
AIDO 2 Map LFV private
AIDO 2 Map LFVI public
AIDO 2 Map LFVI private
AIDO 3 Map LF public
AIDO 3 Map LF private
AIDO 3 Map LFV public
AIDO 3 Map LFV private
AIDO 3 Map LFVI public
AIDO 3 Map LFVI private
AIDO 5 Map large loop
ETU track
for 2021, map is ETH_small_inter
IPFS mountpoint /ipfs available
IPNS mountpoint /ipns available

Evaluator jobs

Job IDsubmissionuseruser labelchallengestepstatusup to dateevaluatordate starteddate completeddurationmessage
237553760Julian ZillyBaseline-IL-logs-tensorflowaido2-LFV-sim-validationstep1-simulationsuccessyesip-172-31-40-253-122570:31:21
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.200030015745961
survival_time_median12.700000000000044
deviation-center-line_median0.6369252438908614
in-drivable-lane_median2.550000000000036


other stats
agent_compute-ego_max0.2565963864326477
agent_compute-ego_mean0.2427617764626424
agent_compute-ego_median0.25565817036966637
agent_compute-ego_min0.19192849297121348
deviation-center-line_max0.938870820536923
deviation-center-line_mean0.6801285279745213
deviation-center-line_min0.5743492450420823
deviation-heading_max6.140685827056716
deviation-heading_mean2.8263503265771868
deviation-heading_median2.237860847813221
deviation-heading_min1.533681468196535
driven_any_max2.0270175892883313
driven_any_mean1.486994679574725
driven_any_median1.5974579299097054
driven_any_min1.060282232030924
driven_lanedir_consec_max2.012815792682221
driven_lanedir_consec_mean1.2063319448473904
driven_lanedir_consec_min0.6050878885879691
driven_lanedir_max2.012815792682221
driven_lanedir_mean1.228853882204554
driven_lanedir_median1.200030015745961
driven_lanedir_min0.717697575373788
in-drivable-lane_max3.049999999999999
in-drivable-lane_mean1.7000000000000148
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.112366647932209, "sim_physics": 0.16211535637838798, "survival_time": 14.250000000000068, "driven_lanedir": 0.717697575373788, "sim_render-ego": 0.06272407581931666, "in-drivable-lane": 3.049999999999999, "agent_compute-ego": 0.2531179110209147, "deviation-heading": 6.140685827056716, "set_robot_commands": 0.09596583048502604, "deviation-center-line": 0.5919813600784193, "driven_lanedir_consec": 0.6050878885879691, "sim_compute_sim_state": 0.03993736400938871, "sim_compute_performance-ego": 0.06914411260370623, "sim_compute_robot_state-ego": 0.07603546443738435, "sim_compute_robot_state-npc0": 0.06936810309426826, "sim_compute_robot_state-npc1": 0.07039642417640017, "sim_compute_robot_state-npc2": 0.06966890201233981, "sim_compute_robot_state-npc3": 0.06903519044842636}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 2.0270175892883313, "sim_physics": 0.1787663451830546, "survival_time": 14.950000000000076, "driven_lanedir": 2.012815792682221, "sim_render-ego": 0.06322642962137857, "in-drivable-lane": 0, "agent_compute-ego": 0.2565963864326477, "deviation-heading": 1.533681468196535, "set_robot_commands": 0.09736258029937744, "deviation-center-line": 0.938870820536923, "driven_lanedir_consec": 2.012815792682221, "sim_compute_sim_state": 0.03988186359405518, "sim_compute_performance-ego": 0.06922521511713664, "sim_compute_robot_state-ego": 0.07422699133555094, "sim_compute_robot_state-npc0": 0.0706602684656779, "sim_compute_robot_state-npc1": 0.07088910261789957, "sim_compute_robot_state-npc2": 0.0699059534072876, "sim_compute_robot_state-npc3": 0.06998639980951946}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.060282232030924, "sim_physics": 0.1636961930952732, "survival_time": 7.94999999999998, "driven_lanedir": 0.9911603796482747, "sim_render-ego": 0.06197033588241481, "in-drivable-lane": 0.04999999999999982, "agent_compute-ego": 0.25650792151876967, "deviation-heading": 2.2728410202472364, "set_robot_commands": 0.09833477578073176, "deviation-center-line": 0.5743492450420823, "driven_lanedir_consec": 0.9911603796482747, "sim_compute_sim_state": 0.0398378702079725, "sim_compute_performance-ego": 0.07075770396106648, "sim_compute_robot_state-ego": 0.07699142761950223, "sim_compute_robot_state-npc0": 0.07166545196149335, "sim_compute_robot_state-npc1": 0.07144120504271309, "sim_compute_robot_state-npc2": 0.07133140953831703, "sim_compute_robot_state-npc3": 0.07153733871268027}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.6378489987124556, "sim_physics": 0.1629716486442746, "survival_time": 12.700000000000044, "driven_lanedir": 1.200030015745961, "sim_render-ego": 0.06368492907426489, "in-drivable-lane": 2.8500000000000405, "agent_compute-ego": 0.25565817036966637, "deviation-heading": 2.237860847813221, "set_robot_commands": 0.09707628366515392, "deviation-center-line": 0.6585159703243202, "driven_lanedir_consec": 1.200030015745961, "sim_compute_sim_state": 0.038963246533251186, "sim_compute_performance-ego": 0.0719500141819631, "sim_compute_robot_state-ego": 0.0751999785580973, "sim_compute_robot_state-npc0": 0.07216616127434677, "sim_compute_robot_state-npc1": 0.07192177659883274, "sim_compute_robot_state-npc2": 0.07048485879822979, "sim_compute_robot_state-npc3": 0.07262813387893316}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.5974579299097054, "sim_physics": 0.1174510281727496, "survival_time": 12.450000000000042, "driven_lanedir": 1.2225656475725255, "sim_render-ego": 0.04962145659818228, "in-drivable-lane": 2.550000000000036, "agent_compute-ego": 0.19192849297121348, "deviation-heading": 1.946682469572225, "set_robot_commands": 0.07458158860723656, "deviation-center-line": 0.6369252438908614, "driven_lanedir_consec": 1.2225656475725255, "sim_compute_sim_state": 0.030819883308257443, "sim_compute_performance-ego": 0.05341426914475529, "sim_compute_robot_state-ego": 0.05745653550787623, "sim_compute_robot_state-npc0": 0.05504348670622431, "sim_compute_robot_state-npc1": 0.054655737666241135, "sim_compute_robot_state-npc2": 0.053944913258993005, "sim_compute_robot_state-npc3": 0.053512668992620874}}
set_robot_commands_max0.09833477578073176
set_robot_commands_mean0.09266421176750514
set_robot_commands_median0.09707628366515392
set_robot_commands_min0.07458158860723656
sim_compute_performance-ego_max0.0719500141819631
sim_compute_performance-ego_mean0.06689826300172555
sim_compute_performance-ego_median0.06922521511713664
sim_compute_performance-ego_min0.05341426914475529
sim_compute_robot_state-ego_max0.07699142761950223
sim_compute_robot_state-ego_mean0.0719820794916822
sim_compute_robot_state-ego_median0.0751999785580973
sim_compute_robot_state-ego_min0.05745653550787623
sim_compute_robot_state-npc0_max0.07216616127434677
sim_compute_robot_state-npc0_mean0.06778069430040212
sim_compute_robot_state-npc0_median0.0706602684656779
sim_compute_robot_state-npc0_min0.05504348670622431
sim_compute_robot_state-npc1_max0.07192177659883274
sim_compute_robot_state-npc1_mean0.06786084922041734
sim_compute_robot_state-npc1_median0.07088910261789957
sim_compute_robot_state-npc1_min0.054655737666241135
sim_compute_robot_state-npc2_max0.07133140953831703
sim_compute_robot_state-npc2_mean0.06706720740303344
sim_compute_robot_state-npc2_median0.0699059534072876
sim_compute_robot_state-npc2_min0.053944913258993005
sim_compute_robot_state-npc3_max0.07262813387893316
sim_compute_robot_state-npc3_mean0.06733994636843602
sim_compute_robot_state-npc3_median0.06998639980951946
sim_compute_robot_state-npc3_min0.053512668992620874
sim_compute_sim_state_max0.03993736400938871
sim_compute_sim_state_mean0.037888045530585
sim_compute_sim_state_median0.0398378702079725
sim_compute_sim_state_min0.030819883308257443
sim_physics_max0.1787663451830546
sim_physics_mean0.15700011429474797
sim_physics_median0.1629716486442746
sim_physics_min0.1174510281727496
sim_render-ego_max0.06368492907426489
sim_render-ego_mean0.06024544539911144
sim_render-ego_median0.06272407581931666
sim_render-ego_min0.04962145659818228
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean12.460000000000042
survival_time_min7.94999999999998
No reset possible
236733716jiang pengSecond test -RGB- TH-jpaido2-LF-sim-validationstep1-simulationfailedyesip-172-31-40-253-122570:01:56
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "experiment_manager.py", line 297, in run_episode
    r: MsgReceived = agent.write_topic_and_expect('get_commands', expect='commands')
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 93, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 174, in read_one
    nickname=self.nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 283, in read_until_over
    raise RemoteNodeAborted(m)
zuper_nodes.structures.RemoteNodeAborted: External node "agent" aborted:

error in agent |Exception while handling a message on topic "get_commands".
               |
               || Traceback (most recent call last):
               ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 274, in loop
               ||     handle_message_node(parsed, receiver0, context0)
               ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 428, in handle_message_node
               ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
               ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/utils.py", line 18, in call_if_fun_exists
               ||     f(**kwargs)
               ||   File "solution.py", line 58, in on_received_get_commands
               ||     action = (action + np.random.normal(0,0.2,size=env.action_space.shape[0])).clip(env.action_space.low, env.action_space.high)
               || NameError: name 'env' is not defined
               ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
    yield cie
  File "experiment_manager.py", line 441, in <module>
    wrap(cie)
  File "experiment_manager.py", line 429, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 135, in main
    physics_dt=config.physics_dt)
  File "experiment_manager.py", line 301, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
236193705Tony Hsu 🇹🇼Baseline solution using reinforcement learningaido2-LF-sim-testingstep1-simulationsuccessyesip-172-31-40-253-122570:49:14
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.6950573847640089
survival_time_median14.950000000000076
deviation-center-line_median0.307138938696771
in-drivable-lane_median7.200000000000037


other stats
agent_compute-ego_max0.2372602621714274
agent_compute-ego_mean0.2357968071831597
agent_compute-ego_median0.23606083313624063
agent_compute-ego_min0.23351913770039875
deviation-center-line_max0.7441993675765441
deviation-center-line_mean0.36818899156986545
deviation-center-line_min0.10083546877568052
deviation-heading_max5.990117020581061
deviation-heading_mean5.896451626677996
deviation-heading_median5.9380236931489225
deviation-heading_min5.613995197946513
driven_any_max2.1853065485311514
driven_any_mean2.1853065485311425
driven_any_median2.1853065485311416
driven_any_min2.1853065485311323
driven_lanedir_consec_max0.6964859913423234
driven_lanedir_consec_mean0.694822873038991
driven_lanedir_consec_min0.6925369611104519
driven_lanedir_max0.6964859913423234
driven_lanedir_mean0.694822873038991
driven_lanedir_median0.6950573847640089
driven_lanedir_min0.6925369611104519
in-drivable-lane_max7.400000000000038
in-drivable-lane_mean7.236666666666703
in-drivable-lane_min7.200000000000037
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 2.1853065485311434, "sim_physics": 0.056219104131062826, "survival_time": 14.950000000000076, "driven_lanedir": 0.6964859913423234, "sim_render-ego": 0.03618796745936076, "in-drivable-lane": 7.400000000000038, "agent_compute-ego": 0.23680371602376304, "deviation-heading": 5.613995197946513, "set_robot_commands": 0.055389099915822346, "deviation-center-line": 0.7337965812416224, "driven_lanedir_consec": 0.6964859913423234, "sim_compute_sim_state": 0.023894519805908204, "sim_compute_performance-ego": 0.04007806062698365, "sim_compute_robot_state-ego": 0.041775345007578533}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 2.1853065485311514, "sim_physics": 0.05633238315582276, "survival_time": 14.950000000000076, "driven_lanedir": 0.694222936176982, "sim_render-ego": 0.036336069901784264, "in-drivable-lane": 7.200000000000037, "agent_compute-ego": 0.23679224967956544, "deviation-heading": 5.990117020581061, "set_robot_commands": 0.0553994623819987, "deviation-center-line": 0.29799505396684733, "driven_lanedir_consec": 0.694222936176982, "sim_compute_sim_state": 0.023783466815948485, "sim_compute_performance-ego": 0.04018988291422526, "sim_compute_robot_state-ego": 0.04250307003657023}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 2.185306548531138, "sim_physics": 0.057132825056711835, "survival_time": 14.950000000000076, "driven_lanedir": 0.6950573847640089, "sim_render-ego": 0.03620422760645548, "in-drivable-lane": 7.300000000000038, "agent_compute-ego": 0.23586845239003496, "deviation-heading": 5.796667795845188, "set_robot_commands": 0.05573479811350505, "deviation-center-line": 0.307138938696771, "driven_lanedir_consec": 0.6950573847640089, "sim_compute_sim_state": 0.023586674531300863, "sim_compute_performance-ego": 0.039875362714131675, "sim_compute_robot_state-ego": 0.041570406754811606}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 2.1853065485311367, "sim_physics": 0.05415695110956828, "survival_time": 14.950000000000076, "driven_lanedir": 0.6955060473032337, "sim_render-ego": 0.03629589319229126, "in-drivable-lane": 7.200000000000037, "agent_compute-ego": 0.23606083313624063, "deviation-heading": 5.969503120784673, "set_robot_commands": 0.05477304458618164, "deviation-center-line": 0.6234334658421105, "driven_lanedir_consec": 0.6955060473032337, "sim_compute_sim_state": 0.0236421799659729, "sim_compute_performance-ego": 0.04000140031178792, "sim_compute_robot_state-ego": 0.042206497192382814}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 2.1853065485311407, "sim_physics": 0.054609217643737794, "survival_time": 14.950000000000076, "driven_lanedir": 0.6933707706415575, "sim_render-ego": 0.036560664971669515, "in-drivable-lane": 7.200000000000037, "agent_compute-ego": 0.23724227031071984, "deviation-heading": 5.951617305849203, "set_robot_commands": 0.055363043944040936, "deviation-center-line": 0.44374302000365046, "driven_lanedir_consec": 0.6933707706415575, "sim_compute_sim_state": 0.024019014835357667, "sim_compute_performance-ego": 0.039914500713348386, "sim_compute_robot_state-ego": 0.0417566458384196}, "ETHZ_autolab_technical_track-5-0": {"driven_any": 2.1853065485311394, "sim_physics": 0.05440897862116496, "survival_time": 14.950000000000076, "driven_lanedir": 0.6957599080131578, "sim_render-ego": 0.036585330963134766, "in-drivable-lane": 7.300000000000038, "agent_compute-ego": 0.23688955227533975, "deviation-heading": 5.818542702573388, "set_robot_commands": 0.05585407495498657, "deviation-center-line": 0.7441993675765441, "driven_lanedir_consec": 0.6957599080131578, "sim_compute_sim_state": 0.023798503875732423, "sim_compute_performance-ego": 0.03968492031097412, "sim_compute_robot_state-ego": 0.041690038045247395}, "ETHZ_autolab_technical_track-6-0": {"driven_any": 2.185306548531151, "sim_physics": 0.05453683296839396, "survival_time": 14.950000000000076, "driven_lanedir": 0.6947112112972071, "sim_render-ego": 0.03654679695765178, "in-drivable-lane": 7.250000000000037, "agent_compute-ego": 0.2371910301844279, "deviation-heading": 5.9347088906542345, "set_robot_commands": 0.05470743974049886, "deviation-center-line": 0.21723026496478212, "driven_lanedir_consec": 0.6947112112972071, "sim_compute_sim_state": 0.02377872546513875, "sim_compute_performance-ego": 0.04016470034917196, "sim_compute_robot_state-ego": 0.04135100444157918}, "ETHZ_autolab_technical_track-7-0": {"driven_any": 2.1853065485311323, "sim_physics": 0.05217970530192057, "survival_time": 14.950000000000076, "driven_lanedir": 0.6954494436503662, "sim_render-ego": 0.03602260669072469, "in-drivable-lane": 7.200000000000037, "agent_compute-ego": 0.2372602621714274, "deviation-heading": 5.951584056210216, "set_robot_commands": 0.05456499179204305, "deviation-center-line": 0.26967879357000285, "driven_lanedir_consec": 0.6954494436503662, "sim_compute_sim_state": 0.02377602497736613, "sim_compute_performance-ego": 0.0396092168490092, "sim_compute_robot_state-ego": 0.041184771060943606}, "ETHZ_autolab_technical_track-8-0": {"driven_any": 2.185306548531139, "sim_physics": 0.05522885560989379, "survival_time": 14.950000000000076, "driven_lanedir": 0.6951211993980144, "sim_render-ego": 0.03605405489603678, "in-drivable-lane": 7.200000000000037, "agent_compute-ego": 0.23470171531041464, "deviation-heading": 5.9380236931489225, "set_robot_commands": 0.05435485521952311, "deviation-center-line": 0.19127509329278516, "driven_lanedir_consec": 0.6951211993980144, "sim_compute_sim_state": 0.02390628735224406, "sim_compute_performance-ego": 0.03965600887934367, "sim_compute_robot_state-ego": 0.04147425015767416}, "ETHZ_autolab_technical_track-9-0": {"driven_any": 2.185306548531147, "sim_physics": 0.05486394087473551, "survival_time": 14.950000000000076, "driven_lanedir": 0.6957742227582209, "sim_render-ego": 0.03597301403681437, "in-drivable-lane": 7.250000000000037, "agent_compute-ego": 0.23639575004577637, "deviation-heading": 5.84542238624642, "set_robot_commands": 0.05446603775024414, "deviation-center-line": 0.13803594115198106, "driven_lanedir_consec": 0.6957742227582209, "sim_compute_sim_state": 0.02387503385543823, "sim_compute_performance-ego": 0.04110508441925049, "sim_compute_robot_state-ego": 0.041235493024190266}, "ETHZ_autolab_technical_track-10-0": {"driven_any": 2.1853065485311443, "sim_physics": 0.05442051887512207, "survival_time": 14.950000000000076, "driven_lanedir": 0.6925369611104519, "sim_render-ego": 0.03614615281422933, "in-drivable-lane": 7.200000000000037, "agent_compute-ego": 0.23504799286524455, "deviation-heading": 5.954990711277449, "set_robot_commands": 0.055364477634429934, "deviation-center-line": 0.30943438450656163, "driven_lanedir_consec": 0.6925369611104519, "sim_compute_sim_state": 0.023588735262552896, "sim_compute_performance-ego": 0.03963437557220459, "sim_compute_robot_state-ego": 0.0411237112681071}, "ETHZ_autolab_technical_track-11-0": {"driven_any": 2.1853065485311416, "sim_physics": 0.05262575149536133, "survival_time": 14.950000000000076, "driven_lanedir": 0.6949038747368048, "sim_render-ego": 0.0359025247891744, "in-drivable-lane": 7.250000000000037, "agent_compute-ego": 0.234542076587677, "deviation-heading": 5.860593780739516, "set_robot_commands": 0.05444599469502767, "deviation-center-line": 0.10083546877568052, "driven_lanedir_consec": 0.6949038747368048, "sim_compute_sim_state": 0.0235660982131958, "sim_compute_performance-ego": 0.0397027571996053, "sim_compute_robot_state-ego": 0.040931255022684736}, "ETHZ_autolab_technical_track-12-0": {"driven_any": 2.185306548531148, "sim_physics": 0.05420217752456665, "survival_time": 14.950000000000076, "driven_lanedir": 0.6952620692692497, "sim_render-ego": 0.0358279824256897, "in-drivable-lane": 7.200000000000037, "agent_compute-ego": 0.23372559785842895, "deviation-heading": 5.922408824528451, "set_robot_commands": 0.05453328053156535, "deviation-center-line": 0.5431694946909088, "driven_lanedir_consec": 0.6952620692692497, "sim_compute_sim_state": 0.023416763146718342, "sim_compute_performance-ego": 0.03956336180369059, "sim_compute_robot_state-ego": 0.04075065930684407}, "ETHZ_autolab_technical_track-13-0": {"driven_any": 2.185306548531144, "sim_physics": 0.05171666701634725, "survival_time": 14.950000000000076, "driven_lanedir": 0.6941725425290013, "sim_render-ego": 0.035717590649922686, "in-drivable-lane": 7.200000000000037, "agent_compute-ego": 0.2349114712079366, "deviation-heading": 5.949714932679345, "set_robot_commands": 0.05467243909835815, "deviation-center-line": 0.17004088680976326, "driven_lanedir_consec": 0.6941725425290013, "sim_compute_sim_state": 0.023308780988057453, "sim_compute_performance-ego": 0.03931858857472738, "sim_compute_robot_state-ego": 0.041351764996846514}, "ETHZ_autolab_technical_track-14-0": {"driven_any": 2.1853065485311363, "sim_physics": 0.05443073987960816, "survival_time": 14.950000000000076, "driven_lanedir": 0.6940085325942875, "sim_render-ego": 0.03576557000478109, "in-drivable-lane": 7.200000000000037, "agent_compute-ego": 0.23351913770039875, "deviation-heading": 5.948883981105356, "set_robot_commands": 0.05469905932744344, "deviation-center-line": 0.4328281184579712, "driven_lanedir_consec": 0.6940085325942875, "sim_compute_sim_state": 0.02330392201741537, "sim_compute_performance-ego": 0.03938270648320516, "sim_compute_robot_state-ego": 0.040738282203674314}}
set_robot_commands_max0.05585407495498657
set_robot_commands_mean0.05495480664571127
set_robot_commands_median0.05470743974049886
set_robot_commands_min0.05435485521952311
sim_compute_performance-ego_max0.04110508441925049
sim_compute_performance-ego_mean0.03985872851477729
sim_compute_performance-ego_median0.0397027571996053
sim_compute_performance-ego_min0.03931858857472738
sim_compute_robot_state-ego_max0.04250307003657023
sim_compute_robot_state-ego_mean0.04144287962383695
sim_compute_robot_state-ego_median0.041351764996846514
sim_compute_robot_state-ego_min0.040738282203674314
sim_compute_sim_state_max0.024019014835357667
sim_compute_sim_state_mean0.023682982073889844
sim_compute_sim_state_median0.02377602497736613
sim_compute_sim_state_min0.02330392201741537
sim_physics_max0.057132825056711835
sim_physics_mean0.05447097661760118
sim_physics_median0.05443073987960816
sim_physics_min0.05171666701634725
sim_render-ego_max0.036585330963134766
sim_render-ego_mean0.03614176315731472
sim_render-ego_median0.03614615281422933
sim_render-ego_min0.035717590649922686
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean14.950000000000076
survival_time_min14.950000000000076
No reset possible
235683687Tony Hsu 🇹🇼Baseline solution using reinforcement learningaido2-LF-sim-testingstep1-simulationerroryesip-172-31-40-253-122570:37:21
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
235603686Tony Hsu 🇹🇼Baseline solution using reinforcement learningaido2-LF-sim-validationstep1-simulationabortedyesip-172-31-40-253-122570:16:49
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
235463678Tony Hsu 🇹🇼Baseline solution using reinforcement learningaido2-LF-sim-validationstep1-simulationsuccessyesip-172-31-40-253-122570:15:13
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.6935805249478659
survival_time_median14.950000000000076
deviation-center-line_median0.13576341190830038
in-drivable-lane_median7.350000000000037


other stats
agent_compute-ego_max0.23882120185428196
agent_compute-ego_mean0.2364927157825894
agent_compute-ego_median0.236285564104716
agent_compute-ego_min0.23455386718114216
deviation-center-line_max0.42632647013358815
deviation-center-line_mean0.20386004643877892
deviation-center-line_min0.041663353925832584
deviation-heading_max5.801699789039097
deviation-heading_mean4.639978324969698
deviation-heading_median5.704071130785565
deviation-heading_min0.3584582273080204
driven_any_max2.185306548531152
driven_any_mean1.765311046847185
driven_any_median2.185306548531149
driven_any_min0.08532904011133041
driven_lanedir_consec_max0.6948995260115542
driven_lanedir_consec_mean0.5596637088722516
driven_lanedir_consec_min0.023144130689651377
driven_lanedir_max0.6948995260115542
driven_lanedir_mean0.5596637088722516
driven_lanedir_median0.6935805249478659
driven_lanedir_min0.023144130689651377
in-drivable-lane_max7.400000000000038
in-drivable-lane_mean5.9500000000000295
in-drivable-lane_min0.30000000000000027
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 2.185306548531152, "sim_physics": 0.05882202307383219, "survival_time": 14.950000000000076, "driven_lanedir": 0.6935805249478659, "sim_render-ego": 0.03745715777079264, "in-drivable-lane": 7.300000000000036, "agent_compute-ego": 0.2373280398050944, "deviation-heading": 5.801699789039097, "set_robot_commands": 0.05538517236709595, "deviation-center-line": 0.42632647013358815, "driven_lanedir_consec": 0.6935805249478659, "sim_compute_sim_state": 0.024560755093892415, "sim_compute_performance-ego": 0.040364675521850586, "sim_compute_robot_state-ego": 0.042288084824879967}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 2.1853065485311447, "sim_physics": 0.054071175257364906, "survival_time": 14.950000000000076, "driven_lanedir": 0.6945338083100598, "sim_render-ego": 0.036382119655609134, "in-drivable-lane": 7.350000000000037, "agent_compute-ego": 0.2354749059677124, "deviation-heading": 5.704071130785565, "set_robot_commands": 0.054803686141967775, "deviation-center-line": 0.09203990928853956, "driven_lanedir_consec": 0.6945338083100598, "sim_compute_sim_state": 0.024045357704162596, "sim_compute_performance-ego": 0.0403041156133016, "sim_compute_robot_state-ego": 0.0425903582572937}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.08532904011133041, "sim_physics": 0.0594486395517985, "survival_time": 0.9000000000000002, "driven_lanedir": 0.023144130689651377, "sim_render-ego": 0.037938846482170954, "in-drivable-lane": 0.30000000000000027, "agent_compute-ego": 0.23882120185428196, "deviation-heading": 0.3584582273080204, "set_robot_commands": 0.055656989415486656, "deviation-center-line": 0.041663353925832584, "driven_lanedir_consec": 0.023144130689651377, "sim_compute_sim_state": 0.02489516470167372, "sim_compute_performance-ego": 0.0427117215262519, "sim_compute_robot_state-ego": 0.041938967174953885}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 2.185306548531149, "sim_physics": 0.056793514092763266, "survival_time": 14.950000000000076, "driven_lanedir": 0.6921605544021268, "sim_render-ego": 0.03705367008845011, "in-drivable-lane": 7.400000000000038, "agent_compute-ego": 0.236285564104716, "deviation-heading": 5.725118401226187, "set_robot_commands": 0.05560779412587484, "deviation-center-line": 0.3235070869376339, "driven_lanedir_consec": 0.6921605544021268, "sim_compute_sim_state": 0.02424562374750773, "sim_compute_performance-ego": 0.039930724302927656, "sim_compute_robot_state-ego": 0.042770138581593835}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 2.18530654853115, "sim_physics": 0.054882098038991294, "survival_time": 14.950000000000076, "driven_lanedir": 0.6948995260115542, "sim_render-ego": 0.03647448698679606, "in-drivable-lane": 7.400000000000038, "agent_compute-ego": 0.23455386718114216, "deviation-heading": 5.610544076489624, "set_robot_commands": 0.054658969243367515, "deviation-center-line": 0.13576341190830038, "driven_lanedir_consec": 0.6948995260115542, "sim_compute_sim_state": 0.023670446077982583, "sim_compute_performance-ego": 0.04008190949757894, "sim_compute_robot_state-ego": 0.041420278549194334}}
set_robot_commands_max0.055656989415486656
set_robot_commands_mean0.055222522258758545
set_robot_commands_median0.05538517236709595
set_robot_commands_min0.054658969243367515
sim_compute_performance-ego_max0.0427117215262519
sim_compute_performance-ego_mean0.04067862929238214
sim_compute_performance-ego_median0.0403041156133016
sim_compute_performance-ego_min0.039930724302927656
sim_compute_robot_state-ego_max0.042770138581593835
sim_compute_robot_state-ego_mean0.04220156547758315
sim_compute_robot_state-ego_median0.042288084824879967
sim_compute_robot_state-ego_min0.041420278549194334
sim_compute_sim_state_max0.02489516470167372
sim_compute_sim_state_mean0.02428346946504381
sim_compute_sim_state_median0.02424562374750773
sim_compute_sim_state_min0.023670446077982583
sim_physics_max0.0594486395517985
sim_physics_mean0.05680349000295003
sim_physics_median0.056793514092763266
sim_physics_min0.054071175257364906
sim_render-ego_max0.037938846482170954
sim_render-ego_mean0.03706125619676378
sim_render-ego_median0.03705367008845011
sim_render-ego_min0.036382119655609134
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean12.14000000000006
survival_time_min0.9000000000000002
No reset possible
235353675FANG MEIYI 🇸🇬testaido2-LFV-sim-testingstep1-simulationerroryesip-172-31-40-253-122570:48:21
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
235283669Tony Hsu 🇹🇼Baseline solution using reinforcement learningaido2-LF-sim-validationstep1-simulationsuccessyesip-172-31-40-253-122570:17:33
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.4569501890103642
survival_time_median14.950000000000076
deviation-center-line_median1.301168569795478
in-drivable-lane_median1.8000000000000107


other stats
agent_compute-ego_max0.2348476219177246
agent_compute-ego_mean0.23418102741241453
agent_compute-ego_median0.23428011894226075
agent_compute-ego_min0.23339950640996296
deviation-center-line_max1.3125511488831354
deviation-center-line_mean1.1985086282065969
deviation-center-line_min0.8168503090782064
deviation-heading_max9.114488416750689
deviation-heading_mean8.49621536573682
deviation-heading_median8.958328817197787
deviation-heading_min6.498379844353641
driven_any_max4.817677691380996
driven_any_mean4.817677691380984
driven_any_median4.817677691380987
driven_any_min4.817677691380966
driven_lanedir_consec_max1.4959818706634302
driven_lanedir_consec_mean1.447454660198641
driven_lanedir_consec_min1.3598522055779538
driven_lanedir_max3.002156010752614
driven_lanedir_mean2.841506234756632
driven_lanedir_median2.9457788003480623
driven_lanedir_min2.3634970567089493
in-drivable-lane_max4.650000000000027
in-drivable-lane_mean2.380000000000014
in-drivable-lane_min1.7500000000000098
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 4.817677691380996, "sim_physics": 0.05543094555536906, "survival_time": 14.950000000000076, "driven_lanedir": 2.918088194757594, "sim_render-ego": 0.036882936159769696, "in-drivable-lane": 1.9000000000000103, "agent_compute-ego": 0.23339950640996296, "deviation-heading": 8.958328817197787, "set_robot_commands": 0.05549233754475912, "deviation-center-line": 1.2532391684123592, "driven_lanedir_consec": 1.3598522055779538, "sim_compute_sim_state": 0.02381419817606608, "sim_compute_performance-ego": 0.03996768792470296, "sim_compute_robot_state-ego": 0.04159588813781738}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 4.817677691380987, "sim_physics": 0.056117419401804605, "survival_time": 14.950000000000076, "driven_lanedir": 2.9457788003480623, "sim_render-ego": 0.03683682441711426, "in-drivable-lane": 1.8000000000000105, "agent_compute-ego": 0.2338240400950114, "deviation-heading": 9.114488416750689, "set_robot_commands": 0.05619430144627889, "deviation-center-line": 1.301168569795478, "driven_lanedir_consec": 1.46991933974784, "sim_compute_sim_state": 0.023593289057413737, "sim_compute_performance-ego": 0.040067615509033205, "sim_compute_robot_state-ego": 0.0418483559290568}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 4.817677691380966, "sim_physics": 0.054320054054260256, "survival_time": 14.950000000000076, "driven_lanedir": 2.3634970567089493, "sim_render-ego": 0.036332832972208656, "in-drivable-lane": 4.650000000000027, "agent_compute-ego": 0.23428011894226075, "deviation-heading": 6.498379844353641, "set_robot_commands": 0.05583319425582886, "deviation-center-line": 0.8168503090782064, "driven_lanedir_consec": 1.4959818706634302, "sim_compute_sim_state": 0.023834712505340576, "sim_compute_performance-ego": 0.04028303066889445, "sim_compute_robot_state-ego": 0.041512629985809325}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 4.817677691380982, "sim_physics": 0.05970702489217122, "survival_time": 14.950000000000076, "driven_lanedir": 3.002156010752614, "sim_render-ego": 0.03599004586537679, "in-drivable-lane": 1.7500000000000098, "agent_compute-ego": 0.23455384969711304, "deviation-heading": 8.944077312138214, "set_robot_commands": 0.0553072198232015, "deviation-center-line": 1.3087339448638062, "driven_lanedir_consec": 1.4569501890103642, "sim_compute_sim_state": 0.023678666750590008, "sim_compute_performance-ego": 0.03995649973551432, "sim_compute_robot_state-ego": 0.04137231111526489}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 4.817677691380995, "sim_physics": 0.05569718519846598, "survival_time": 14.950000000000076, "driven_lanedir": 2.9780111112159418, "sim_render-ego": 0.03683046499888102, "in-drivable-lane": 1.8000000000000107, "agent_compute-ego": 0.2348476219177246, "deviation-heading": 8.965802438243768, "set_robot_commands": 0.05606562932332357, "deviation-center-line": 1.3125511488831354, "driven_lanedir_consec": 1.4545696959936176, "sim_compute_sim_state": 0.02408143679300944, "sim_compute_performance-ego": 0.03993809382120768, "sim_compute_robot_state-ego": 0.041982343196868895}}
set_robot_commands_max0.05619430144627889
set_robot_commands_mean0.055778536478678385
set_robot_commands_median0.05583319425582886
set_robot_commands_min0.0553072198232015
sim_compute_performance-ego_max0.04028303066889445
sim_compute_performance-ego_mean0.040042585531870525
sim_compute_performance-ego_median0.03996768792470296
sim_compute_performance-ego_min0.03993809382120768
sim_compute_robot_state-ego_max0.041982343196868895
sim_compute_robot_state-ego_mean0.04166230567296345
sim_compute_robot_state-ego_median0.04159588813781738
sim_compute_robot_state-ego_min0.04137231111526489
sim_compute_sim_state_max0.02408143679300944
sim_compute_sim_state_mean0.023800460656483967
sim_compute_sim_state_median0.02381419817606608
sim_compute_sim_state_min0.023593289057413737
sim_physics_max0.05970702489217122
sim_physics_mean0.05625452582041422
sim_physics_median0.05569718519846598
sim_physics_min0.054320054054260256
sim_render-ego_max0.036882936159769696
sim_render-ego_mean0.036574620882670085
sim_render-ego_median0.03683046499888102
sim_render-ego_min0.03599004586537679
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean14.950000000000076
survival_time_min14.950000000000076
No reset possible
233833623Tony Hsu 🇹🇼Baseline solution using reinforcement learningaido2-LF-sim-validationstep1-simulationsuccessyesip-172-31-40-253-122570:16:53
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.6642436660663087
survival_time_median14.950000000000076
deviation-center-line_median0.6127901567591342
in-drivable-lane_median0


other stats
agent_compute-ego_max0.34592669480925153
agent_compute-ego_mean0.3446639890075834
agent_compute-ego_median0.344827934106191
agent_compute-ego_min0.34309169586668625
deviation-center-line_max1.3019541099294043
deviation-center-line_mean0.8511498118650721
deviation-center-line_min0.5066981329943391
deviation-heading_max4.055717681436225
deviation-heading_mean2.2639447928188265
deviation-heading_median2.4218493396621237
deviation-heading_min1.055344347110816
driven_any_max0.8769654767822298
driven_any_mean0.6687654736799274
driven_any_median0.8769654767821278
driven_any_min0.2619654676188363
driven_lanedir_consec_max0.8747874033840302
driven_lanedir_consec_mean0.6098641630266942
driven_lanedir_consec_min0.25444128804097765
driven_lanedir_max0.8747874033840302
driven_lanedir_mean0.6098641630266942
driven_lanedir_median0.6642436660663087
driven_lanedir_min0.25444128804097765
in-drivable-lane_max2.900000000000041
in-drivable-lane_mean0.5800000000000083
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.8769654767821669, "sim_physics": 0.052807665665944414, "survival_time": 14.950000000000076, "driven_lanedir": 0.6642436660663087, "sim_render-ego": 0.03652409315109253, "in-drivable-lane": 2.900000000000041, "agent_compute-ego": 0.344238596757253, "deviation-heading": 2.6581344254089676, "set_robot_commands": 0.05516312837600708, "deviation-center-line": 0.6127901567591342, "driven_lanedir_consec": 0.6642436660663087, "sim_compute_sim_state": 0.024441742102305097, "sim_compute_performance-ego": 0.040415841738382974, "sim_compute_robot_state-ego": 0.04190034071604411}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.8769654767822298, "sim_physics": 0.05659368832906087, "survival_time": 14.950000000000076, "driven_lanedir": 0.8261690326522699, "sim_render-ego": 0.03615845521291097, "in-drivable-lane": 0, "agent_compute-ego": 0.34523502349853513, "deviation-heading": 4.055717681436225, "set_robot_commands": 0.054639139970143635, "deviation-center-line": 1.281715573033011, "driven_lanedir_consec": 0.8261690326522699, "sim_compute_sim_state": 0.02449143091837565, "sim_compute_performance-ego": 0.04036012729008993, "sim_compute_robot_state-ego": 0.0423115332921346}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.2619654676188363, "sim_physics": 0.053960906698348673, "survival_time": 4.699999999999991, "driven_lanedir": 0.25444128804097765, "sim_render-ego": 0.035671130139777, "in-drivable-lane": 0, "agent_compute-ego": 0.34309169586668625, "deviation-heading": 1.128678170475998, "set_robot_commands": 0.05411280723328286, "deviation-center-line": 0.5066981329943391, "driven_lanedir_consec": 0.25444128804097765, "sim_compute_sim_state": 0.02481598549700798, "sim_compute_performance-ego": 0.04031048429773209, "sim_compute_robot_state-ego": 0.04205345346572551}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.4509654704342765, "sim_physics": 0.057842215155340305, "survival_time": 7.84999999999998, "driven_lanedir": 0.4296794249898848, "sim_render-ego": 0.036158458442445016, "in-drivable-lane": 0, "agent_compute-ego": 0.34592669480925153, "deviation-heading": 2.4218493396621237, "set_robot_commands": 0.05404067191348714, "deviation-center-line": 0.5525910866094718, "driven_lanedir_consec": 0.4296794249898848, "sim_compute_sim_state": 0.02435627560706655, "sim_compute_performance-ego": 0.04010236187345663, "sim_compute_robot_state-ego": 0.041986000765660766}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.8769654767821278, "sim_physics": 0.056208542982737225, "survival_time": 14.950000000000076, "driven_lanedir": 0.8747874033840302, "sim_render-ego": 0.03708347558975219, "in-drivable-lane": 0, "agent_compute-ego": 0.344827934106191, "deviation-heading": 1.055344347110816, "set_robot_commands": 0.05488852103551229, "deviation-center-line": 1.3019541099294043, "driven_lanedir_consec": 0.8747874033840302, "sim_compute_sim_state": 0.02433090368906657, "sim_compute_performance-ego": 0.03979408502578735, "sim_compute_robot_state-ego": 0.04183960596720378}}
set_robot_commands_max0.05516312837600708
set_robot_commands_mean0.05456885370568661
set_robot_commands_median0.054639139970143635
set_robot_commands_min0.05404067191348714
sim_compute_performance-ego_max0.040415841738382974
sim_compute_performance-ego_mean0.04019658004508979
sim_compute_performance-ego_median0.04031048429773209
sim_compute_performance-ego_min0.03979408502578735
sim_compute_robot_state-ego_max0.0423115332921346
sim_compute_robot_state-ego_mean0.04201818684135374
sim_compute_robot_state-ego_median0.041986000765660766
sim_compute_robot_state-ego_min0.04183960596720378
sim_compute_sim_state_max0.02481598549700798
sim_compute_sim_state_mean0.024487267562764366
sim_compute_sim_state_median0.024441742102305097
sim_compute_sim_state_min0.02433090368906657
sim_physics_max0.057842215155340305
sim_physics_mean0.0554826037662863
sim_physics_median0.056208542982737225
sim_physics_min0.052807665665944414
sim_render-ego_max0.03708347558975219
sim_render-ego_mean0.03631912250719554
sim_render-ego_median0.036158458442445016
sim_render-ego_min0.035671130139777
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean11.48000000000004
survival_time_min4.699999999999991
No reset possible
233603610Riza Velioglu 🇩🇪aido2-LFV-sim-validationstep1-simulationerroryesip-172-31-40-253-122570:05:52
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
233293597Victor Adolfo Romero Cano 🇨🇴aido2-LFV-sim-testingstep1-simulationsuccessyesip-172-31-40-253-122570:17:17
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.47061816984274774
survival_time_median2.4499999999999993
deviation-center-line_median0.09047885846140293
in-drivable-lane_median0.7999999999999974


other stats
agent_compute-ego_max0.1618283305849348
agent_compute-ego_mean0.12486637783641698
agent_compute-ego_median0.12490508556365967
agent_compute-ego_min0.08946564323023747
deviation-center-line_max0.1743913456502906
deviation-center-line_mean0.11122054568266285
deviation-center-line_min0.05649185041622204
deviation-heading_max0.8583234710357402
deviation-heading_mean0.371509805944231
deviation-heading_median0.3477435217829391
deviation-heading_min0.1892537419842091
driven_any_max1.6169932854589035
driven_any_mean0.8549136794030617
driven_any_median0.9441796518284096
driven_any_min0.28668385087664994
driven_lanedir_consec_max1.2433038249708377
driven_lanedir_consec_mean0.5622432991481365
driven_lanedir_consec_min0.24216121529728207
driven_lanedir_max1.2433038249708377
driven_lanedir_mean0.5622432991481365
driven_lanedir_median0.47061816984274774
driven_lanedir_min0.24216121529728207
in-drivable-lane_max1.3499999999999996
in-drivable-lane_mean0.5899999999999992
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0243289631429708, "sim_physics": 0.16898857664178918, "survival_time": 2.6999999999999984, "driven_lanedir": 0.5723310224856362, "sim_render-ego": 0.06683026861261439, "in-drivable-lane": 0.9999999999999976, "agent_compute-ego": 0.1587619251675076, "deviation-heading": 0.19401296908406307, "set_robot_commands": 0.0993255023603086, "deviation-center-line": 0.15907928712407893, "driven_lanedir_consec": 0.5723310224856362, "sim_compute_sim_state": 0.03867422651361536, "sim_compute_performance-ego": 0.07097240730568215, "sim_compute_robot_state-ego": 0.08232001022056297, "sim_compute_robot_state-npc0": 0.07097821323959916, "sim_compute_robot_state-npc1": 0.07143006059858534, "sim_compute_robot_state-npc2": 0.07100057601928711, "sim_compute_robot_state-npc3": 0.06876463801772506}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.4119037580118998, "sim_physics": 0.1779242992401123, "survival_time": 1.2500000000000004, "driven_lanedir": 0.3792793194470208, "sim_render-ego": 0.061504392623901366, "in-drivable-lane": 0, "agent_compute-ego": 0.15223077774047852, "deviation-heading": 0.47860435001913393, "set_robot_commands": 0.09543315887451172, "deviation-center-line": 0.09344288799285194, "driven_lanedir_consec": 0.3792793194470208, "sim_compute_sim_state": 0.040556106567382816, "sim_compute_performance-ego": 0.07041787147521973, "sim_compute_robot_state-ego": 0.0786213207244873, "sim_compute_robot_state-npc0": 0.07141194343566895, "sim_compute_robot_state-npc1": 0.07022178649902344, "sim_compute_robot_state-npc2": 0.0687658977508545, "sim_compute_robot_state-npc3": 0.06762411117553711}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.579862082650716, "sim_physics": 0.1755074231248153, "survival_time": 3.7999999999999945, "driven_lanedir": 1.2433038249708377, "sim_render-ego": 0.06056161930686549, "in-drivable-lane": 0.5999999999999979, "agent_compute-ego": 0.15126670975434153, "deviation-heading": 0.5020407942599273, "set_robot_commands": 0.09696475455635473, "deviation-center-line": 0.1743913456502906, "driven_lanedir_consec": 1.2433038249708377, "sim_compute_sim_state": 0.0395835700787996, "sim_compute_performance-ego": 0.07104597593608655, "sim_compute_robot_state-ego": 0.07442730351498253, "sim_compute_robot_state-npc0": 0.06867666934665881, "sim_compute_robot_state-npc1": 0.07315662660096821, "sim_compute_robot_state-npc2": 0.07172540614479467, "sim_compute_robot_state-npc3": 0.07204227698476691}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.6169932854589035, "sim_physics": 0.18156606336183187, "survival_time": 3.949999999999994, "driven_lanedir": 1.2126117310470583, "sim_render-ego": 0.06280154819729962, "in-drivable-lane": 0.849999999999997, "agent_compute-ego": 0.15618388562262814, "deviation-heading": 0.34764983431811214, "set_robot_commands": 0.09820696975611432, "deviation-center-line": 0.11519544839797546, "driven_lanedir_consec": 1.2126117310470583, "sim_compute_sim_state": 0.04052547261684756, "sim_compute_performance-ego": 0.06904676292516009, "sim_compute_robot_state-ego": 0.0755108247829389, "sim_compute_robot_state-npc0": 0.07112889048419421, "sim_compute_robot_state-npc1": 0.06768152080004729, "sim_compute_robot_state-npc2": 0.07107075860228719, "sim_compute_robot_state-npc3": 0.07126037983954707}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.5031772882846431, "sim_physics": 0.17801955768040248, "survival_time": 1.4000000000000006, "driven_lanedir": 0.4926325270527603, "sim_render-ego": 0.06673381158283778, "in-drivable-lane": 0, "agent_compute-ego": 0.1618283305849348, "deviation-heading": 0.29868161596444953, "set_robot_commands": 0.1015308243887765, "deviation-center-line": 0.09047885846140293, "driven_lanedir_consec": 0.4926325270527603, "sim_compute_sim_state": 0.04002366747174944, "sim_compute_performance-ego": 0.07286953926086426, "sim_compute_robot_state-ego": 0.07691034248897008, "sim_compute_robot_state-npc0": 0.07170403855187553, "sim_compute_robot_state-npc1": 0.07107428993497576, "sim_compute_robot_state-npc2": 0.06754174402781896, "sim_compute_robot_state-npc3": 0.07069930008479527}, "ETHZ_autolab_technical_track-5-0": {"driven_any": 1.0440585337030532, "sim_physics": 0.139130433400472, "survival_time": 2.6999999999999984, "driven_lanedir": 0.5009536316076031, "sim_render-ego": 0.05098526566116898, "in-drivable-lane": 1.0000000000000009, "agent_compute-ego": 0.1288352056785866, "deviation-heading": 0.8583234710357402, "set_robot_commands": 0.07570576226269757, "deviation-center-line": 0.1636702708892767, "driven_lanedir_consec": 0.5009536316076031, "sim_compute_sim_state": 0.03220364341029414, "sim_compute_performance-ego": 0.05626611797897904, "sim_compute_robot_state-ego": 0.06246420189186379, "sim_compute_robot_state-npc0": 0.058383826856259945, "sim_compute_robot_state-npc1": 0.05760075427867748, "sim_compute_robot_state-npc2": 0.05807882768136484, "sim_compute_robot_state-npc3": 0.05720168572885019}, "ETHZ_autolab_technical_track-6-0": {"driven_any": 1.045672984989961, "sim_physics": 0.11713094181484646, "survival_time": 2.6999999999999984, "driven_lanedir": 0.636422849544542, "sim_render-ego": 0.04735173560954906, "in-drivable-lane": 0.7999999999999974, "agent_compute-ego": 0.12586028046078152, "deviation-heading": 0.39273667682101354, "set_robot_commands": 0.07605825530158149, "deviation-center-line": 0.08970073753261001, "driven_lanedir_consec": 0.636422849544542, "sim_compute_sim_state": 0.029604801425227412, "sim_compute_performance-ego": 0.05213023556603326, "sim_compute_robot_state-ego": 0.05595969712292707, "sim_compute_robot_state-npc0": 0.05501566551349781, "sim_compute_robot_state-npc1": 0.05437892454641837, "sim_compute_robot_state-npc2": 0.054017455489547166, "sim_compute_robot_state-npc3": 0.05379021609271014}, "ETHZ_autolab_technical_track-7-0": {"driven_any": 0.877256228857091, "sim_physics": 0.14458205964830187, "survival_time": 2.25, "driven_lanedir": 0.38713958773684665, "sim_render-ego": 0.05636053615146213, "in-drivable-lane": 0.9999999999999996, "agent_compute-ego": 0.11391476525200736, "deviation-heading": 0.384474040685185, "set_robot_commands": 0.06934172842237685, "deviation-center-line": 0.07500609722918031, "driven_lanedir_consec": 0.38713958773684665, "sim_compute_sim_state": 0.028899611367119684, "sim_compute_performance-ego": 0.05078292952643501, "sim_compute_robot_state-ego": 0.05517738660176595, "sim_compute_robot_state-npc0": 0.05267291069030762, "sim_compute_robot_state-npc1": 0.05162434577941895, "sim_compute_robot_state-npc2": 0.05288161701626248, "sim_compute_robot_state-npc3": 0.0511983765496148}, "ETHZ_autolab_technical_track-8-0": {"driven_any": 0.8433010974171573, "sim_physics": 0.11973430281100066, "survival_time": 2.3, "driven_lanedir": 0.24216121529728207, "sim_render-ego": 0.046415909476902176, "in-drivable-lane": 1.3499999999999996, "agent_compute-ego": 0.1177967994109444, "deviation-heading": 0.34566993689777425, "set_robot_commands": 0.07220072331635849, "deviation-center-line": 0.07136114712800473, "driven_lanedir_consec": 0.24216121529728207, "sim_compute_sim_state": 0.030188135478807533, "sim_compute_performance-ego": 0.053283038346663765, "sim_compute_robot_state-ego": 0.05615060744078263, "sim_compute_robot_state-npc0": 0.05343281186145285, "sim_compute_robot_state-npc1": 0.05300781519516655, "sim_compute_robot_state-npc2": 0.052563320035519806, "sim_compute_robot_state-npc3": 0.05251051032024881}, "ETHZ_autolab_technical_track-9-0": {"driven_any": 0.9785013113851152, "sim_physics": 0.14324655055999755, "survival_time": 2.499999999999999, "driven_lanedir": 0.9700080716683566, "sim_render-ego": 0.04865300178527832, "in-drivable-lane": 0, "agent_compute-ego": 0.12490508556365967, "deviation-heading": 0.3477435217829391, "set_robot_commands": 0.07406127452850342, "deviation-center-line": 0.15723242276422936, "driven_lanedir_consec": 0.9700080716683566, "sim_compute_sim_state": 0.031152448654174804, "sim_compute_performance-ego": 0.05672450065612793, "sim_compute_robot_state-ego": 0.057843565940856934, "sim_compute_robot_state-npc0": 0.05863194942474365, "sim_compute_robot_state-npc1": 0.054951953887939456, "sim_compute_robot_state-npc2": 0.056034913063049314, "sim_compute_robot_state-npc3": 0.05667174339294433}, "ETHZ_autolab_technical_track-10-0": {"driven_any": 0.3129292149411446, "sim_physics": 0.13729169368743896, "survival_time": 1.0000000000000002, "driven_lanedir": 0.2864579763812336, "sim_render-ego": 0.047216367721557614, "in-drivable-lane": 0, "agent_compute-ego": 0.11992512941360474, "deviation-heading": 0.38016104491567027, "set_robot_commands": 0.07246395349502563, "deviation-center-line": 0.05649185041622204, "driven_lanedir_consec": 0.2864579763812336, "sim_compute_sim_state": 0.027284622192382812, "sim_compute_performance-ego": 0.05510591268539429, "sim_compute_robot_state-ego": 0.05663390159606933, "sim_compute_robot_state-npc0": 0.057556116580963136, "sim_compute_robot_state-npc1": 0.04994069337844849, "sim_compute_robot_state-npc2": 0.04885971546173096, "sim_compute_robot_state-npc3": 0.04878963232040405}, "ETHZ_autolab_technical_track-11-0": {"driven_any": 0.28668385087664994, "sim_physics": 0.08864547076978181, "survival_time": 0.9500000000000004, "driven_lanedir": 0.278237107094367, "sim_render-ego": 0.03588430505049856, "in-drivable-lane": 0, "agent_compute-ego": 0.08946564323023747, "deviation-heading": 0.19732996798555608, "set_robot_commands": 0.05729162065606368, "deviation-center-line": 0.08671144489080887, "driven_lanedir_consec": 0.278237107094367, "sim_compute_sim_state": 0.023045025373760023, "sim_compute_performance-ego": 0.040552691409462376, "sim_compute_robot_state-ego": 0.04239591799284283, "sim_compute_robot_state-npc0": 0.04114213742707905, "sim_compute_robot_state-npc1": 0.04090109624360737, "sim_compute_robot_state-npc2": 0.039836456901148745, "sim_compute_robot_state-npc3": 0.03982100988689222}, "ETHZ_autolab_technical_track-12-0": {"driven_any": 1.0034139953700494, "sim_physics": 0.08549656867980956, "survival_time": 2.499999999999999, "driven_lanedir": 0.47061816984274774, "sim_render-ego": 0.036006898880004884, "in-drivable-lane": 1.1499999999999986, "agent_compute-ego": 0.09072487354278563, "deviation-heading": 0.2263485117662671, "set_robot_commands": 0.05557034969329834, "deviation-center-line": 0.1594122934983136, "driven_lanedir_consec": 0.47061816984274774, "sim_compute_sim_state": 0.0232039213180542, "sim_compute_performance-ego": 0.0398978328704834, "sim_compute_robot_state-ego": 0.04185327053070068, "sim_compute_robot_state-npc0": 0.04143343448638916, "sim_compute_robot_state-npc1": 0.040410637855529785, "sim_compute_robot_state-npc2": 0.040426931381225585, "sim_compute_robot_state-npc3": 0.04028162002563476}, "ETHZ_autolab_technical_track-13-0": {"driven_any": 0.351442944128162, "sim_physics": 0.10592057488181374, "survival_time": 1.1000000000000003, "driven_lanedir": 0.34114611245347204, "sim_render-ego": 0.036694570021195846, "in-drivable-lane": 0, "agent_compute-ego": 0.08997488021850586, "deviation-heading": 0.1892537419842091, "set_robot_commands": 0.054913206533952194, "deviation-center-line": 0.08918370733714856, "driven_lanedir_consec": 0.34114611245347204, "sim_compute_sim_state": 0.02277781746604226, "sim_compute_performance-ego": 0.03986619819294323, "sim_compute_robot_state-ego": 0.04160464893687855, "sim_compute_robot_state-npc0": 0.04118304902857, "sim_compute_robot_state-npc1": 0.040000200271606445, "sim_compute_robot_state-npc2": 0.040329575538635254, "sim_compute_robot_state-npc3": 0.039748462763699616}, "ETHZ_autolab_technical_track-14-0": {"driven_any": 0.9441796518284096, "sim_physics": 0.10440803060726243, "survival_time": 2.4499999999999993, "driven_lanedir": 0.4203463405922858, "sim_render-ego": 0.0370489383230404, "in-drivable-lane": 1.0999999999999988, "agent_compute-ego": 0.09132137590525102, "deviation-heading": 0.4296166116434236, "set_robot_commands": 0.05634116153327786, "deviation-center-line": 0.08695038592754878, "driven_lanedir_consec": 0.4203463405922858, "sim_compute_sim_state": 0.02295592366432657, "sim_compute_performance-ego": 0.03927303820240254, "sim_compute_robot_state-ego": 0.042010881462875675, "sim_compute_robot_state-npc0": 0.041423821935848315, "sim_compute_robot_state-npc1": 0.04075269309841857, "sim_compute_robot_state-npc2": 0.04076684737692074, "sim_compute_robot_state-npc3": 0.04032018719887247}}
set_robot_commands_max0.1015308243887765
set_robot_commands_mean0.07702728304528009
set_robot_commands_median0.07406127452850342
set_robot_commands_min0.054913206533952194
sim_compute_performance-ego_max0.07286953926086426
sim_compute_performance-ego_mean0.05588233682252918
sim_compute_performance-ego_median0.05510591268539429
sim_compute_performance-ego_min0.03927303820240254
sim_compute_robot_state-ego_max0.08232001022056297
sim_compute_robot_state-ego_mean0.059992258749967005
sim_compute_robot_state-ego_median0.05663390159606933
sim_compute_robot_state-ego_min0.04160464893687855
sim_compute_robot_state-npc0_max0.07170403855187553
sim_compute_robot_state-npc0_mean0.05698503192420722
sim_compute_robot_state-npc0_median0.057556116580963136
sim_compute_robot_state-npc0_min0.04114213742707905
sim_compute_robot_state-npc1_max0.07315662660096821
sim_compute_robot_state-npc1_mean0.05580889326458877
sim_compute_robot_state-npc1_median0.05437892454641837
sim_compute_robot_state-npc1_min0.040000200271606445
sim_compute_robot_state-npc2_max0.07172540614479467
sim_compute_robot_state-npc2_mean0.055593336166029815
sim_compute_robot_state-npc2_median0.054017455489547166
sim_compute_robot_state-npc2_min0.039836456901148745
sim_compute_robot_state-npc3_max0.07204227698476691
sim_compute_robot_state-npc3_mean0.05538161002548283
sim_compute_robot_state-npc3_median0.05379021609271014
sim_compute_robot_state-npc3_min0.039748462763699616
sim_compute_sim_state_max0.040556106567382816
sim_compute_sim_state_mean0.03137859957323895
sim_compute_sim_state_median0.030188135478807533
sim_compute_sim_state_min0.02277781746604226
sim_physics_max0.18156606336183187
sim_physics_mean0.13783950312731175
sim_physics_median0.139130433400472
sim_physics_min0.08549656867980956
sim_render-ego_max0.06683026861261439
sim_render-ego_mean0.0507366112669451
sim_render-ego_median0.04865300178527832
sim_render-ego_min0.03588430505049856
simulation-passed1
survival_time_max3.949999999999994
survival_time_mean2.2366666666666655
survival_time_min0.9500000000000004
No reset possible
232862894Peter Almasi 🇭🇺Baseline solution using reinforcement learningaido2-LF-sim-validationstep1-simulationerroryesip-172-31-40-253-122570:10:43
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
232153577Nicky EichmannBaseline solution using reinforcement learningaido2-LF-sim-validationstep1-simulationsuccessyesip-172-31-40-253-122570:14:29
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.06255295319332932
survival_time_median14.950000000000076
deviation-center-line_median0.31093684032301805
in-drivable-lane_median7.9000000000000945


other stats
agent_compute-ego_max0.10094804684321086
agent_compute-ego_mean0.10057911030451457
agent_compute-ego_median0.10055952072143556
agent_compute-ego_min0.1002022631963094
deviation-center-line_max1.1288482486575042
deviation-center-line_mean0.46917583208746266
deviation-center-line_min0.1532346013858943
deviation-heading_max5.756062842065952
deviation-heading_mean3.988972711779198
deviation-heading_median3.5191948580378356
deviation-heading_min2.8499982447518546
driven_any_max0.9856040444839966
driven_any_mean0.36658694594808566
driven_any_median0.18587225179110448
driven_any_min5.6912714890136e-14
driven_lanedir_consec_max0.43404164996116495
driven_lanedir_consec_mean0.13308854478705195
driven_lanedir_consec_min0
driven_lanedir_max0.46473795283828107
driven_lanedir_mean0.1392278053624752
driven_lanedir_median0.06255295319332932
driven_lanedir_min0
in-drivable-lane_max11.60000000000008
in-drivable-lane_mean8.230000000000057
in-drivable-lane_min5.199999999999991
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 5.962588178812573e-14, "sim_physics": 0.05457769791285197, "survival_time": 14.950000000000076, "driven_lanedir": 0, "sim_render-ego": 0.03714451471964518, "in-drivable-lane": 7.9000000000000945, "agent_compute-ego": 0.10094804684321086, "deviation-heading": 3.3838262878563494, "set_robot_commands": 0.05588390827178955, "deviation-center-line": 0.543168749563224, "driven_lanedir_consec": 0, "sim_compute_sim_state": 0.02361409584681193, "sim_compute_performance-ego": 0.040052921772003175, "sim_compute_robot_state-ego": 0.042365406354268394}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.9856040444839966, "sim_physics": 0.05291489362716675, "survival_time": 14.950000000000076, "driven_lanedir": 0.46473795283828107, "sim_render-ego": 0.036406403382619225, "in-drivable-lane": 9.40000000000007, "agent_compute-ego": 0.10036077340443927, "deviation-heading": 3.5191948580378356, "set_robot_commands": 0.05614888032277425, "deviation-center-line": 0.1532346013858943, "driven_lanedir_consec": 0.43404164996116495, "sim_compute_sim_state": 0.02411991039911906, "sim_compute_performance-ego": 0.0399307918548584, "sim_compute_robot_state-ego": 0.04215523560841878}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.6614584334652108, "sim_physics": 0.05208930810292562, "survival_time": 14.950000000000076, "driven_lanedir": 0.06255295319332932, "sim_render-ego": 0.03600008010864258, "in-drivable-lane": 5.199999999999991, "agent_compute-ego": 0.1002022631963094, "deviation-heading": 4.435781326184003, "set_robot_commands": 0.05620878060658773, "deviation-center-line": 1.1288482486575042, "driven_lanedir_consec": 0.06255295319332932, "sim_compute_sim_state": 0.02354205052057902, "sim_compute_performance-ego": 0.04002849340438843, "sim_compute_robot_state-ego": 0.04155601501464844}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 5.6912714890136e-14, "sim_physics": 0.05579612890879313, "survival_time": 14.950000000000076, "driven_lanedir": 0, "sim_render-ego": 0.036440374056498206, "in-drivable-lane": 11.60000000000008, "agent_compute-ego": 0.10082494735717772, "deviation-heading": 2.8499982447518546, "set_robot_commands": 0.05578877607981364, "deviation-center-line": 0.20969072050767243, "driven_lanedir_consec": 0, "sim_compute_sim_state": 0.023747427463531492, "sim_compute_performance-ego": 0.0398914114634196, "sim_compute_robot_state-ego": 0.042379779815673826}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.18587225179110448, "sim_physics": 0.05439898490905762, "survival_time": 14.950000000000076, "driven_lanedir": 0.1688481207807655, "sim_render-ego": 0.03634020407994589, "in-drivable-lane": 7.050000000000046, "agent_compute-ego": 0.10055952072143556, "deviation-heading": 5.756062842065952, "set_robot_commands": 0.05643343210220337, "deviation-center-line": 0.31093684032301805, "driven_lanedir_consec": 0.1688481207807655, "sim_compute_sim_state": 0.023831377824147543, "sim_compute_performance-ego": 0.03989755233128866, "sim_compute_robot_state-ego": 0.04194334904352824}}
set_robot_commands_max0.05643343210220337
set_robot_commands_mean0.05609275547663371
set_robot_commands_median0.05614888032277425
set_robot_commands_min0.05578877607981364
sim_compute_performance-ego_max0.040052921772003175
sim_compute_performance-ego_mean0.039960234165191656
sim_compute_performance-ego_median0.0399307918548584
sim_compute_performance-ego_min0.0398914114634196
sim_compute_robot_state-ego_max0.042379779815673826
sim_compute_robot_state-ego_mean0.04207995716730754
sim_compute_robot_state-ego_median0.04215523560841878
sim_compute_robot_state-ego_min0.04155601501464844
sim_compute_sim_state_max0.02411991039911906
sim_compute_sim_state_mean0.02377097241083781
sim_compute_sim_state_median0.023747427463531492
sim_compute_sim_state_min0.02354205052057902
sim_physics_max0.05579612890879313
sim_physics_mean0.05395540269215902
sim_physics_median0.05439898490905762
sim_physics_min0.05208930810292562
sim_render-ego_max0.03714451471964518
sim_render-ego_mean0.036466315269470216
sim_render-ego_median0.036406403382619225
sim_render-ego_min0.03600008010864258
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean14.950000000000076
survival_time_min14.950000000000076
No reset possible
231723569Bhairav Mehtachallenge-aido_LF-template-pytorchaido2-LF-sim-testingstep1-simulationerroryesip-172-31-40-253-122570:01:48
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
231633564Bhairav MehtaBaseline solution using reinforcement learningaido2-LFV-sim-validationstep1-simulationerroryesip-172-31-40-253-122570:01:40
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible