Evaluator 746

step1-simulation

success

2019-04-20 08:53:39+00:00

2019-04-20 09:04:54+00:00

0:11:15

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.9585846921942625
survival_time_median	3.099999999999997
deviation-center-line_median	0.13094298490844536
in-drivable-lane_median	0.4999999999999982

other stats

agent_compute-ego_max	0.15729233196803502
agent_compute-ego_mean	0.14929245876530925
agent_compute-ego_median	0.14807438465856737
agent_compute-ego_min	0.14214948965952948
deviation-center-line_max	0.1934674474960452
deviation-center-line_mean	0.10884100878338444
deviation-center-line_min	0.032459786530846635
deviation-heading_max	0.7356226190209126
deviation-heading_mean	0.3809403978290703
deviation-heading_median	0.2855944786164235
deviation-heading_min	0.22149655353610215
driven_any_max	2.029872313755146
driven_any_mean	1.3151025945779695
driven_any_median	1.2614050434743518
driven_any_min	1.0057903566516673
driven_lanedir_consec_max	1.454438818080216
driven_lanedir_consec_mean	1.0334629747873598
driven_lanedir_consec_min	0.6769768591939229
driven_lanedir_max	1.4545895120774182
driven_lanedir_mean	1.0334931135868004
driven_lanedir_median	0.9585846921942625
driven_lanedir_min	0.6769768591939229
in-drivable-lane_max	1.149999999999996
in-drivable-lane_mean	0.539999999999998
in-drivable-lane_min	0
per-episodes	details {"udem1-0-0": {"driven_any": 1.2614050434743518, "sim_physics": 0.03220579359266493, "survival_time": 3.149999999999997, "driven_lanedir": 0.9585846921942625, "sim_render-ego": 0.06881400517054967, "in-drivable-lane": 0.4999999999999982, "agent_compute-ego": 0.15729233196803502, "deviation-heading": 0.7356226190209126, "set_robot_commands": 0.08039019978235638, "deviation-center-line": 0.1934674474960452, "driven_lanedir_consec": 0.9585846921942625, "sim_compute_sim_state": 0.0363444449409606, "sim_compute_performance-ego": 0.06698849087669737, "sim_compute_robot_state-ego": 0.06662703317309183, "sim_compute_robot_state-npc0": 0.07380376164875334, "sim_compute_robot_state-npc1": 0.06782765615554083, "sim_compute_robot_state-npc2": 0.06700167958698576, "sim_compute_robot_state-npc3": 0.06559476019844176}, "udem1-1-0": {"driven_any": 1.0057903566516673, "sim_physics": 0.02988860186408548, "survival_time": 2.549999999999999, "driven_lanedir": 0.6769768591939229, "sim_render-ego": 0.0679332181519153, "in-drivable-lane": 0.6499999999999979, "agent_compute-ego": 0.1559299394196155, "deviation-heading": 0.2594067356428278, "set_robot_commands": 0.07985573656418744, "deviation-center-line": 0.032459786530846635, "driven_lanedir_consec": 0.6769768591939229, "sim_compute_sim_state": 0.03547357577903598, "sim_compute_performance-ego": 0.06594978126825071, "sim_compute_robot_state-ego": 0.06823892219393861, "sim_compute_robot_state-npc0": 0.0767511246251125, "sim_compute_robot_state-npc1": 0.06849297355203067, "sim_compute_robot_state-npc2": 0.06531707913267847, "sim_compute_robot_state-npc3": 0.06435693011564367}, "udem1-2-0": {"driven_any": 1.272156782174927, "sim_physics": 0.031339049339294434, "survival_time": 3.099999999999997, "driven_lanedir": 1.2659672450373072, "sim_render-ego": 0.06731134845364478, "in-drivable-lane": 0, "agent_compute-ego": 0.14807438465856737, "deviation-heading": 0.22149655353610215, "set_robot_commands": 0.07796687080014136, "deviation-center-line": 0.13094298490844536, "driven_lanedir_consec": 1.2659672450373072, "sim_compute_sim_state": 0.035788859090497414, "sim_compute_performance-ego": 0.06420964579428395, "sim_compute_robot_state-ego": 0.06560951663601783, "sim_compute_robot_state-npc0": 0.07135998049089985, "sim_compute_robot_state-npc1": 0.06375167446751748, "sim_compute_robot_state-npc2": 0.06216635627131308, "sim_compute_robot_state-npc3": 0.06315968498106926}, "udem1-3-0": {"driven_any": 2.029872313755146, "sim_physics": 0.03101212166725321, "survival_time": 4.699999999999991, "driven_lanedir": 1.4545895120774182, "sim_render-ego": 0.06762731582560438, "in-drivable-lane": 1.149999999999996, "agent_compute-ego": 0.14301614812079896, "deviation-heading": 0.40258160232908535, "set_robot_commands": 0.07636907760133134, "deviation-center-line": 0.1370465252692341, "driven_lanedir_consec": 1.454438818080216, "sim_compute_sim_state": 0.03757623915976666, "sim_compute_performance-ego": 0.06475269287190538, "sim_compute_robot_state-ego": 0.06427747138003086, "sim_compute_robot_state-npc0": 0.07092663075061555, "sim_compute_robot_state-npc1": 0.06593504104208439, "sim_compute_robot_state-npc2": 0.06577731193380153, "sim_compute_robot_state-npc3": 0.06648586658721274}, "udem1-4-0": {"driven_any": 1.0062884768337566, "sim_physics": 0.027001014122596152, "survival_time": 2.5999999999999988, "driven_lanedir": 0.8113472594310909, "sim_render-ego": 0.06586132141260001, "in-drivable-lane": 0.3999999999999986, "agent_compute-ego": 0.14214948965952948, "deviation-heading": 0.2855944786164235, "set_robot_commands": 0.07931545606026283, "deviation-center-line": 0.050288299712350874, "driven_lanedir_consec": 0.8113472594310909, "sim_compute_sim_state": 0.03513588813635019, "sim_compute_performance-ego": 0.06542584529289833, "sim_compute_robot_state-ego": 0.06237034155772282, "sim_compute_robot_state-npc0": 0.07133669119614822, "sim_compute_robot_state-npc1": 0.06413168632067166, "sim_compute_robot_state-npc2": 0.06209785204667311, "sim_compute_robot_state-npc3": 0.06143021125059862}}
set_robot_commands_max	0.08039019978235638
set_robot_commands_mean	0.07877946816165586
set_robot_commands_median	0.07931545606026283
set_robot_commands_min	0.07636907760133134
sim_compute_performance-ego_max	0.06698849087669737
sim_compute_performance-ego_mean	0.06546529122080716
sim_compute_performance-ego_median	0.06542584529289833
sim_compute_performance-ego_min	0.06420964579428395
sim_compute_robot_state-ego_max	0.06823892219393861
sim_compute_robot_state-ego_mean	0.06542465698816038
sim_compute_robot_state-ego_median	0.06560951663601783
sim_compute_robot_state-ego_min	0.06237034155772282
sim_compute_robot_state-npc0_max	0.0767511246251125
sim_compute_robot_state-npc0_mean	0.07283563774230589
sim_compute_robot_state-npc0_median	0.07135998049089985
sim_compute_robot_state-npc0_min	0.07092663075061555
sim_compute_robot_state-npc1_max	0.06849297355203067
sim_compute_robot_state-npc1_mean	0.06602780630756902
sim_compute_robot_state-npc1_median	0.06593504104208439
sim_compute_robot_state-npc1_min	0.06375167446751748
sim_compute_robot_state-npc2_max	0.06700167958698576
sim_compute_robot_state-npc2_mean	0.0644720557942904
sim_compute_robot_state-npc2_median	0.06531707913267847
sim_compute_robot_state-npc2_min	0.06209785204667311
sim_compute_robot_state-npc3_max	0.06648586658721274
sim_compute_robot_state-npc3_mean	0.06420549062659321
sim_compute_robot_state-npc3_median	0.06435693011564367
sim_compute_robot_state-npc3_min	0.06143021125059862
sim_compute_sim_state_max	0.03757623915976666
sim_compute_sim_state_mean	0.03606380142132216
sim_compute_sim_state_median	0.035788859090497414
sim_compute_sim_state_min	0.03513588813635019
sim_physics_max	0.03220579359266493
sim_physics_mean	0.030289316117178843
sim_physics_median	0.03101212166725321
sim_physics_min	0.027001014122596152
sim_render-ego_max	0.06881400517054967
sim_render-ego_mean	0.06750944180286282
sim_render-ego_median	0.06762731582560438
sim_render-ego_min	0.06586132141260001
simulation-passed	1
survival_time_max	4.699999999999991
survival_time_mean	3.2199999999999966
survival_time_min	2.549999999999999

No reset possible

18591

2861

challenge-aido_LF-baseline-duckietown

step1-simulation

error

2019-04-20 08:22:47+00:00

2019-04-20 08:44:23+00:00

0:21:36

Waited 1201 seconds [...]

Waited 1201 seconds for container to finish. Giving up.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

18584

2516

Liam Paull 🇨🇦

challenge-aido_LF-baseline-duckietown

step1-simulation

error

2019-04-20 08:20:34+00:00

2019-04-20 08:22:10+00:00

0:01:36

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

18581

2865

challenge-aido_LF-baseline-duckietown

step1-simulation

host-error

2019-04-20 08:17:38+00:00

2019-04-20 08:20:22+00:00

0:02:44

Uncaught exception: [...]

Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 481, in get_cr
    uploaded = upload_files(wd, aws_config)
  File "/project/src/duckietown_challenges_runner/runner.py", line 1016, in upload_files
    uploaded = upload(aws_config, toupload)
  File "/project/src/duckietown_challenges_runner/runner.py", line 1171, in upload
    sha256hex = compute_sha256hex(realfile)
  File "/project/src/duckietown_challenges_runner/runner.py", line 1217, in compute_sha256hex
    res: bytes = subprocess.check_output(cmd)
  File "/usr/lib/python3.6/subprocess.py", line 336, in check_output
    **kwargs).stdout
  File "/usr/lib/python3.6/subprocess.py", line 418, in run
    output=stdout, stderr=stderr)
subprocess.CalledProcessError: Command '['shasum', '-a', '256', '/tmp/duckietown/DT18/evaluator/executions/aido2-LFVI-sim-validation/submission2865/step1-simulation-idsc-rudolf-9560-job18581/tmp/tmpprwdqviv/attempts/udem1-0-0.attempt0/drawing.svg']' returned non-zero exit status 1.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

18577

2832

challenge-aido_LF-baseline-duckietown

step1-simulation

error

2019-04-20 08:15:43+00:00

2019-04-20 08:16:58+00:00

0:01:15

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

18570

2867

Peter Almasi 🇭🇺

Baseline solution using reinforcement learning

step1-simulation

success

2019-04-19 22:27:33+00:00

2019-04-19 22:33:58+00:00

0:06:25

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.6431967647291108
survival_time_median	2.2
deviation-center-line_median	0.048951084302092066
in-drivable-lane_median	0.6499999999999995

other stats

agent_compute-ego_max	0.20415376699887788
agent_compute-ego_mean	0.1908488215227407
agent_compute-ego_median	0.19212384356392753
agent_compute-ego_min	0.17931557243520563
deviation-center-line_max	0.3192039159496959
deviation-center-line_mean	0.10390096187880768
deviation-center-line_min	0.02766774404190132
deviation-heading_max	1.5490208025837795
deviation-heading_mean	0.6121677924678164
deviation-heading_median	0.33578328786157874
deviation-heading_min	0.22021346062682975
driven_any_max	2.5431478172269837
driven_any_mean	1.2589950145734323
driven_any_median	1.0761958707701014
driven_any_min	0.5017154662612839
driven_lanedir_consec_max	1.7433660118534713
driven_lanedir_consec_mean	0.7636518760538027
driven_lanedir_consec_min	0.16407658422912252
driven_lanedir_max	2.020788770101926
driven_lanedir_mean	0.8198062996158747
driven_lanedir_median	0.6440431636966908
driven_lanedir_min	0.16407658422912252
in-drivable-lane_max	0.9000000000000008
in-drivable-lane_mean	0.6499999999999992
in-drivable-lane_min	0.4999999999999982
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0761958707701014, "sim_physics": 0.01577770709991455, "survival_time": 2.2, "driven_lanedir": 0.6440431636966908, "sim_render-ego": 0.07095520062880083, "in-drivable-lane": 0.6499999999999995, "agent_compute-ego": 0.17931557243520563, "deviation-heading": 0.33578328786157874, "set_robot_commands": 0.07918847690929066, "deviation-center-line": 0.03692656750432076, "driven_lanedir_consec": 0.6431967647291108, "sim_compute_sim_state": 0.04295714335008101, "sim_compute_performance-ego": 0.07115707072344693, "sim_compute_robot_state-ego": 0.06552745537324385}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.2939325001715247, "sim_physics": 0.017949915768807393, "survival_time": 2.849999999999998, "driven_lanedir": 0.906124263933602, "sim_render-ego": 0.07187524176480477, "in-drivable-lane": 0.4999999999999982, "agent_compute-ego": 0.18312747436657287, "deviation-heading": 0.6603259658629277, "set_robot_commands": 0.07734821553815875, "deviation-center-line": 0.08675549759602841, "driven_lanedir_consec": 0.9036213033392768, "sim_compute_sim_state": 0.04319529784353156, "sim_compute_performance-ego": 0.06824193921005517, "sim_compute_robot_state-ego": 0.06702446519282826}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 2.5431478172269837, "sim_physics": 0.017167415883806016, "survival_time": 5.399999999999989, "driven_lanedir": 2.020788770101926, "sim_render-ego": 0.07058653125056515, "in-drivable-lane": 0.6999999999999975, "agent_compute-ego": 0.19212384356392753, "deviation-heading": 1.5490208025837795, "set_robot_commands": 0.07870043207097936, "deviation-center-line": 0.3192039159496959, "driven_lanedir_consec": 1.7433660118534713, "sim_compute_sim_state": 0.042000384242446336, "sim_compute_performance-ego": 0.06828505021554453, "sim_compute_robot_state-ego": 0.06560215243586788}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.8799834184372685, "sim_physics": 0.016560529407701995, "survival_time": 1.900000000000001, "driven_lanedir": 0.363998716118032, "sim_render-ego": 0.06873544893766705, "in-drivable-lane": 0.9000000000000008, "agent_compute-ego": 0.1955234502491198, "deviation-heading": 0.22021346062682975, "set_robot_commands": 0.07589999625557348, "deviation-center-line": 0.048951084302092066, "driven_lanedir_consec": 0.363998716118032, "sim_compute_sim_state": 0.04344625222055536, "sim_compute_performance-ego": 0.07207948283145302, "sim_compute_robot_state-ego": 0.06695710985284102}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.5017154662612839, "sim_physics": 0.016864749101492073, "survival_time": 1.3000000000000005, "driven_lanedir": 0.16407658422912252, "sim_render-ego": 0.07215609917273888, "in-drivable-lane": 0.5000000000000003, "agent_compute-ego": 0.20415376699887788, "deviation-heading": 0.29549544540396594, "set_robot_commands": 0.07847887736100417, "deviation-center-line": 0.02766774404190132, "driven_lanedir_consec": 0.16407658422912252, "sim_compute_sim_state": 0.04391805942241962, "sim_compute_performance-ego": 0.07104085958920993, "sim_compute_robot_state-ego": 0.06903227475973275}}
set_robot_commands_max	0.07918847690929066
set_robot_commands_mean	0.07792319962700128
set_robot_commands_median	0.07847887736100417
set_robot_commands_min	0.07589999625557348
sim_compute_performance-ego_max	0.07207948283145302
sim_compute_performance-ego_mean	0.07016088051394191
sim_compute_performance-ego_median	0.07104085958920993
sim_compute_performance-ego_min	0.06824193921005517
sim_compute_robot_state-ego_max	0.06903227475973275
sim_compute_robot_state-ego_mean	0.06682869152290276
sim_compute_robot_state-ego_median	0.06695710985284102
sim_compute_robot_state-ego_min	0.06552745537324385
sim_compute_sim_state_max	0.04391805942241962
sim_compute_sim_state_mean	0.04310342741580677
sim_compute_sim_state_median	0.04319529784353156
sim_compute_sim_state_min	0.042000384242446336
sim_physics_max	0.017949915768807393
sim_physics_mean	0.016864063452344407
sim_physics_median	0.016864749101492073
sim_physics_min	0.01577770709991455
sim_render-ego_max	0.07215609917273888
sim_render-ego_mean	0.07086170435091532
sim_render-ego_median	0.07095520062880083
sim_render-ego_min	0.06873544893766705
simulation-passed	1
survival_time_max	5.399999999999989
survival_time_mean	2.7299999999999978
survival_time_min	1.3000000000000005

No reset possible

18569

2866

Konstantin Chaika

challenge-aido_LF-baseline-duckietown

step1-simulation

success

2019-04-19 17:58:54+00:00

2019-04-19 18:10:19+00:00

0:11:25

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.4588676380601058
survival_time_median	6.649999999999984
deviation-center-line_median	0.15451286069050738
in-drivable-lane_median	0.14999999999999947

other stats

agent_compute-ego_max	0.09420613776472278
agent_compute-ego_mean	0.09138777751114736
agent_compute-ego_median	0.09180772872198197
agent_compute-ego_min	0.08853075172327741
deviation-center-line_max	0.24911784572201637
deviation-center-line_mean	0.16001342046274156
deviation-center-line_min	0.09686004935262749
deviation-heading_max	1.691377379333223
deviation-heading_mean	1.561216802735824
deviation-heading_median	1.6025668156033372
deviation-heading_min	1.4239968592214904
driven_any_max	1.1766816643587727
driven_any_mean	0.5885832106678948
driven_any_median	0.5108724254674314
driven_any_min	0.2938870827440656
driven_lanedir_consec_max	0.6208329675101485
driven_lanedir_consec_mean	0.4151185012922386
driven_lanedir_consec_min	0.22490795994047963
driven_lanedir_max	0.6208329675101485
driven_lanedir_mean	0.4151185012922386
driven_lanedir_median	0.4588676380601058
driven_lanedir_min	0.22490795994047963
in-drivable-lane_max	7.600000000000091
in-drivable-lane_mean	1.620000000000018
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.1766816643587727, "sim_physics": 0.015383165677388509, "survival_time": 14.950000000000076, "driven_lanedir": 0.515964338070924, "sim_render-ego": 0.059579774538675946, "in-drivable-lane": 7.600000000000091, "agent_compute-ego": 0.09354153633117676, "deviation-heading": 1.648721557953461, "set_robot_commands": 0.08124037424723307, "deviation-center-line": 0.18364251894430147, "driven_lanedir_consec": 0.515964338070924, "sim_compute_sim_state": 0.040274771054585774, "sim_compute_performance-ego": 0.06130960623423259, "sim_compute_robot_state-ego": 0.06290190776189168}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.2938870827440656, "sim_physics": 0.015446056293535836, "survival_time": 3.949999999999994, "driven_lanedir": 0.22490795994047963, "sim_render-ego": 0.05603311635270904, "in-drivable-lane": 0.29999999999999893, "agent_compute-ego": 0.08853075172327741, "deviation-heading": 1.439421401567608, "set_robot_commands": 0.08116659333434285, "deviation-center-line": 0.09686004935262749, "driven_lanedir_consec": 0.22490795994047963, "sim_compute_sim_state": 0.03710471225690238, "sim_compute_performance-ego": 0.05733238896237144, "sim_compute_robot_state-ego": 0.05975890461402603}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.30996219998420443, "sim_physics": 0.016307698674948818, "survival_time": 4.149999999999993, "driven_lanedir": 0.25501960287953507, "sim_render-ego": 0.05820694314428123, "in-drivable-lane": 0.14999999999999947, "agent_compute-ego": 0.08885273301457784, "deviation-heading": 1.4239968592214904, "set_robot_commands": 0.0792583787297628, "deviation-center-line": 0.1159338276042551, "driven_lanedir_consec": 0.25501960287953507, "sim_compute_sim_state": 0.03981757451252765, "sim_compute_performance-ego": 0.05991284531283091, "sim_compute_robot_state-ego": 0.06138134002685547}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.6515126807849994, "sim_physics": 0.01582505731355576, "survival_time": 8.399999999999984, "driven_lanedir": 0.6208329675101485, "sim_render-ego": 0.060062781685874575, "in-drivable-lane": 0, "agent_compute-ego": 0.09180772872198197, "deviation-heading": 1.6025668156033372, "set_robot_commands": 0.07871484046890623, "deviation-center-line": 0.24911784572201637, "driven_lanedir_consec": 0.6208329675101485, "sim_compute_sim_state": 0.04075490718796139, "sim_compute_performance-ego": 0.06067781079383123, "sim_compute_robot_state-ego": 0.062112179540452506}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.5108724254674314, "sim_physics": 0.017064698656698817, "survival_time": 6.649999999999984, "driven_lanedir": 0.4588676380601058, "sim_render-ego": 0.06372001655119702, "in-drivable-lane": 0.04999999999999982, "agent_compute-ego": 0.09420613776472278, "deviation-heading": 1.691377379333223, "set_robot_commands": 0.07774812834603446, "deviation-center-line": 0.15451286069050738, "driven_lanedir_consec": 0.4588676380601058, "sim_compute_sim_state": 0.042058781573646946, "sim_compute_performance-ego": 0.06364351286923975, "sim_compute_robot_state-ego": 0.06566833732719708}}
set_robot_commands_max	0.08124037424723307
set_robot_commands_mean	0.07962566302525588
set_robot_commands_median	0.0792583787297628
set_robot_commands_min	0.07774812834603446
sim_compute_performance-ego_max	0.06364351286923975
sim_compute_performance-ego_mean	0.06057523283450118
sim_compute_performance-ego_median	0.06067781079383123
sim_compute_performance-ego_min	0.05733238896237144
sim_compute_robot_state-ego_max	0.06566833732719708
sim_compute_robot_state-ego_mean	0.06236453385408456
sim_compute_robot_state-ego_median	0.062112179540452506
sim_compute_robot_state-ego_min	0.05975890461402603
sim_compute_sim_state_max	0.042058781573646946
sim_compute_sim_state_mean	0.04000214931712483
sim_compute_sim_state_median	0.040274771054585774
sim_compute_sim_state_min	0.03710471225690238
sim_physics_max	0.017064698656698817
sim_physics_mean	0.01600533532322555
sim_physics_median	0.01582505731355576
sim_physics_min	0.015383165677388509
sim_render-ego_max	0.06372001655119702
sim_render-ego_mean	0.05952052645454756
sim_render-ego_median	0.059579774538675946
sim_render-ego_min	0.05603311635270904
simulation-passed	1
survival_time_max	14.950000000000076
survival_time_mean	7.620000000000006
survival_time_min	3.949999999999994

No reset possible

18564

2861

challenge-aido_LF-baseline-duckietown

step1-simulation

error

2019-04-19 17:32:42+00:00

2019-04-19 17:54:10+00:00

0:21:28

Waited 1201 seconds [...]

Waited 1201 seconds for container to finish. Giving up.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

18554

2367

Andrea Censi 🇨🇭

random_agent

step1-simulation

success

2019-04-19 16:17:35+00:00

2019-04-19 16:29:10+00:00

0:11:35

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.9585846921942625
survival_time_median	3.099999999999997
deviation-center-line_median	0.13094298490844536
in-drivable-lane_median	0.4999999999999982

other stats

agent_compute-ego_max	0.13631499967267435
agent_compute-ego_mean	0.13225811063902543
agent_compute-ego_median	0.13408195211532267
agent_compute-ego_min	0.1260286936393151
deviation-center-line_max	0.1934674474960452
deviation-center-line_mean	0.10884100878338444
deviation-center-line_min	0.032459786530846635
deviation-heading_max	0.7356226190209126
deviation-heading_mean	0.3809403978290703
deviation-heading_median	0.2855944786164235
deviation-heading_min	0.22149655353610215
driven_any_max	2.029872313755146
driven_any_mean	1.3151025945779695
driven_any_median	1.2614050434743518
driven_any_min	1.0057903566516673
driven_lanedir_consec_max	1.454438818080216
driven_lanedir_consec_mean	1.0334629747873598
driven_lanedir_consec_min	0.6769768591939229
driven_lanedir_max	1.4545895120774182
driven_lanedir_mean	1.0334931135868004
driven_lanedir_median	0.9585846921942625
driven_lanedir_min	0.6769768591939229
in-drivable-lane_max	1.149999999999996
in-drivable-lane_mean	0.539999999999998
in-drivable-lane_min	0
per-episodes	details {"udem1-0-0": {"driven_any": 1.2614050434743518, "sim_physics": 0.03092096722315228, "survival_time": 3.149999999999997, "driven_lanedir": 0.9585846921942625, "sim_render-ego": 0.06444468573918419, "in-drivable-lane": 0.4999999999999982, "agent_compute-ego": 0.13010114336770678, "deviation-heading": 0.7356226190209126, "set_robot_commands": 0.07896897149464441, "deviation-center-line": 0.1934674474960452, "driven_lanedir_consec": 0.9585846921942625, "sim_compute_sim_state": 0.034706055171906, "sim_compute_performance-ego": 0.0643220515478225, "sim_compute_robot_state-ego": 0.06538172373695979, "sim_compute_robot_state-npc0": 0.07156388721768818, "sim_compute_robot_state-npc1": 0.06604113654484825, "sim_compute_robot_state-npc2": 0.06242908750261579, "sim_compute_robot_state-npc3": 0.06307997400798494}, "udem1-1-0": {"driven_any": 1.0057903566516673, "sim_physics": 0.03034396732554716, "survival_time": 2.549999999999999, "driven_lanedir": 0.6769768591939229, "sim_render-ego": 0.0708303217794381, "in-drivable-lane": 0.6499999999999979, "agent_compute-ego": 0.13476376440010818, "deviation-heading": 0.2594067356428278, "set_robot_commands": 0.07665521490807627, "deviation-center-line": 0.032459786530846635, "driven_lanedir_consec": 0.6769768591939229, "sim_compute_sim_state": 0.04027740628111596, "sim_compute_performance-ego": 0.06424361584233303, "sim_compute_robot_state-ego": 0.06741840699139763, "sim_compute_robot_state-npc0": 0.07540628021838618, "sim_compute_robot_state-npc1": 0.07049088852078307, "sim_compute_robot_state-npc2": 0.06684691298241709, "sim_compute_robot_state-npc3": 0.06845505564820532}, "udem1-2-0": {"driven_any": 1.272156782174927, "sim_physics": 0.031015769127876527, "survival_time": 3.099999999999997, "driven_lanedir": 1.2659672450373072, "sim_render-ego": 0.06929780206372661, "in-drivable-lane": 0, "agent_compute-ego": 0.13631499967267435, "deviation-heading": 0.22149655353610215, "set_robot_commands": 0.08179415425946636, "deviation-center-line": 0.13094298490844536, "driven_lanedir_consec": 1.2659672450373072, "sim_compute_sim_state": 0.036472866612095985, "sim_compute_performance-ego": 0.0666765897504745, "sim_compute_robot_state-ego": 0.0667254501773465, "sim_compute_robot_state-npc0": 0.07061618758786109, "sim_compute_robot_state-npc1": 0.06655492705683555, "sim_compute_robot_state-npc2": 0.06477122537551387, "sim_compute_robot_state-npc3": 0.06392469329218711}, "udem1-3-0": {"driven_any": 2.029872313755146, "sim_physics": 0.03232851180624455, "survival_time": 4.699999999999991, "driven_lanedir": 1.4545895120774182, "sim_render-ego": 0.06884106169355676, "in-drivable-lane": 1.149999999999996, "agent_compute-ego": 0.13408195211532267, "deviation-heading": 0.40258160232908535, "set_robot_commands": 0.07929767953588608, "deviation-center-line": 0.1370465252692341, "driven_lanedir_consec": 1.454438818080216, "sim_compute_sim_state": 0.03898861814052501, "sim_compute_performance-ego": 0.06581384070376133, "sim_compute_robot_state-ego": 0.06592952951471856, "sim_compute_robot_state-npc0": 0.07417238012273261, "sim_compute_robot_state-npc1": 0.06881979171265946, "sim_compute_robot_state-npc2": 0.06834601341409886, "sim_compute_robot_state-npc3": 0.06919032715736552}, "udem1-4-0": {"driven_any": 1.0062884768337566, "sim_physics": 0.02747507278735821, "survival_time": 2.5999999999999988, "driven_lanedir": 0.8113472594310909, "sim_render-ego": 0.06796239889585055, "in-drivable-lane": 0.3999999999999986, "agent_compute-ego": 0.1260286936393151, "deviation-heading": 0.2855944786164235, "set_robot_commands": 0.07559998677327083, "deviation-center-line": 0.050288299712350874, "driven_lanedir_consec": 0.8113472594310909, "sim_compute_sim_state": 0.03747302293777466, "sim_compute_performance-ego": 0.0663417623593257, "sim_compute_robot_state-ego": 0.06596496013494638, "sim_compute_robot_state-npc0": 0.07255227749164288, "sim_compute_robot_state-npc1": 0.07057592960504386, "sim_compute_robot_state-npc2": 0.06901616316575271, "sim_compute_robot_state-npc3": 0.06872438925963181}}
set_robot_commands_max	0.08179415425946636
set_robot_commands_mean	0.0784632013942688
set_robot_commands_median	0.07896897149464441
set_robot_commands_min	0.07559998677327083
sim_compute_performance-ego_max	0.0666765897504745
sim_compute_performance-ego_mean	0.06547957204074341
sim_compute_performance-ego_median	0.06581384070376133
sim_compute_performance-ego_min	0.06424361584233303
sim_compute_robot_state-ego_max	0.06741840699139763
sim_compute_robot_state-ego_mean	0.06628401411107376
sim_compute_robot_state-ego_median	0.06596496013494638
sim_compute_robot_state-ego_min	0.06538172373695979
sim_compute_robot_state-npc0_max	0.07540628021838618
sim_compute_robot_state-npc0_mean	0.07286220252766219
sim_compute_robot_state-npc0_median	0.07255227749164288
sim_compute_robot_state-npc0_min	0.07061618758786109
sim_compute_robot_state-npc1_max	0.07057592960504386
sim_compute_robot_state-npc1_mean	0.06849653468803404
sim_compute_robot_state-npc1_median	0.06881979171265946
sim_compute_robot_state-npc1_min	0.06604113654484825
sim_compute_robot_state-npc2_max	0.06901616316575271
sim_compute_robot_state-npc2_mean	0.06628188048807966
sim_compute_robot_state-npc2_median	0.06684691298241709
sim_compute_robot_state-npc2_min	0.06242908750261579
sim_compute_robot_state-npc3_max	0.06919032715736552
sim_compute_robot_state-npc3_mean	0.06667488787307493
sim_compute_robot_state-npc3_median	0.06845505564820532
sim_compute_robot_state-npc3_min	0.06307997400798494
sim_compute_sim_state_max	0.04027740628111596
sim_compute_sim_state_mean	0.03758359382868352
sim_compute_sim_state_median	0.03747302293777466
sim_compute_sim_state_min	0.034706055171906
sim_physics_max	0.03232851180624455
sim_physics_mean	0.030416857654035744
sim_physics_median	0.03092096722315228
sim_physics_min	0.02747507278735821
sim_render-ego_max	0.0708303217794381
sim_render-ego_mean	0.06827525403435124
sim_render-ego_median	0.06884106169355676
sim_render-ego_min	0.06444468573918419
simulation-passed	1
survival_time_max	4.699999999999991
survival_time_mean	3.2199999999999966
survival_time_min	2.549999999999999

No reset possible

18542

2378

Liam Paull 🇨🇦

minimal_agent_python2 (Python 2)

step1-simulation

success

2019-04-19 15:59:20+00:00

2019-04-19 16:16:54+00:00

0:17:34

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	1.2394590679116675
survival_time_median	5.549999999999988
deviation-center-line_median	0.04756893535888313
in-drivable-lane_median	0.9999999999999964

other stats

agent_compute-ego_max	0.05540583155176661
agent_compute-ego_mean	0.054185594267792646
agent_compute-ego_median	0.054255073134963576
agent_compute-ego_min	0.052747630410724215
deviation-center-line_max	0.06628124520952136
deviation-center-line_mean	0.0513113298520783
deviation-center-line_min	0.04756874938348469
deviation-heading_max	0.3902119203851745
deviation-heading_mean	0.3813380184189976
deviation-heading_median	0.39020902164128224
deviation-heading_min	0.3458513477489306
driven_any_max	2.7471689201187153
driven_any_mean	1.6941689201588157
driven_any_median	1.5771689201187176
driven_any_min	0.9921689203192088
driven_lanedir_consec_max	2.5148965539064285
driven_lanedir_consec_mean	1.377546484191465
driven_lanedir_consec_min	0.6544587706938922
driven_lanedir_max	2.5148965539064285
driven_lanedir_mean	1.377546484191465
driven_lanedir_median	1.2394590679116675
driven_lanedir_min	0.6544587706938922
in-drivable-lane_max	0.9999999999999964
in-drivable-lane_mean	0.9399999999999992
in-drivable-lane_min	0.70000000000001
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.9921689203192088, "sim_physics": 0.02638932400279575, "survival_time": 3.599999999999995, "driven_lanedir": 0.6544587706938922, "sim_render-ego": 0.06474890973832872, "in-drivable-lane": 0.9999999999999964, "agent_compute-ego": 0.052747630410724215, "deviation-heading": 0.3902119203851745, "set_robot_commands": 0.07593305243386163, "deviation-center-line": 0.04756896992501765, "driven_lanedir_consec": 0.6544587706938922, "sim_compute_sim_state": 0.03705366452534994, "sim_compute_performance-ego": 0.06261209977997674, "sim_compute_robot_state-ego": 0.0633155107498169, "sim_compute_robot_state-npc0": 0.07116804851426019, "sim_compute_robot_state-npc1": 0.07024121946758694, "sim_compute_robot_state-npc2": 0.06482216053538853, "sim_compute_robot_state-npc3": 0.06395811504787868}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 2.7471689201187153, "sim_physics": 0.027177465025079315, "survival_time": 9.45, "driven_lanedir": 2.5148965539064285, "sim_render-ego": 0.0633264180844423, "in-drivable-lane": 0.70000000000001, "agent_compute-ego": 0.05431700635839392, "deviation-heading": 0.3458513477489306, "set_robot_commands": 0.07574865300819357, "deviation-center-line": 0.06628124520952136, "driven_lanedir_consec": 2.5148965539064285, "sim_compute_sim_state": 0.03570322889499564, "sim_compute_performance-ego": 0.06218893187386649, "sim_compute_robot_state-ego": 0.06134481026382042, "sim_compute_robot_state-npc0": 0.06961316784853658, "sim_compute_robot_state-npc1": 0.06609188185797797, "sim_compute_robot_state-npc2": 0.06410084451947894, "sim_compute_robot_state-npc3": 0.06189647048869461}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.5771689201187176, "sim_physics": 0.02587559631278923, "survival_time": 5.549999999999988, "driven_lanedir": 1.2394590679116675, "sim_render-ego": 0.06677341890764667, "in-drivable-lane": 0.9999999999999964, "agent_compute-ego": 0.054255073134963576, "deviation-heading": 0.39020902164128224, "set_robot_commands": 0.07767753128532891, "deviation-center-line": 0.04756874938348469, "driven_lanedir_consec": 1.2394590679116675, "sim_compute_sim_state": 0.03615041896029635, "sim_compute_performance-ego": 0.0650869167602814, "sim_compute_robot_state-ego": 0.06465039811692797, "sim_compute_robot_state-npc0": 0.07104078499046532, "sim_compute_robot_state-npc1": 0.06489995363596324, "sim_compute_robot_state-npc2": 0.06498432589006854, "sim_compute_robot_state-npc3": 0.06359580830410794}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.5771689201187176, "sim_physics": 0.02729593955718719, "survival_time": 5.549999999999988, "driven_lanedir": 1.2394590679116675, "sim_render-ego": 0.0671760842606828, "in-drivable-lane": 0.9999999999999964, "agent_compute-ego": 0.054202429883114925, "deviation-heading": 0.39020902164128224, "set_robot_commands": 0.07643285957542625, "deviation-center-line": 0.04756874938348469, "driven_lanedir_consec": 1.2394590679116675, "sim_compute_sim_state": 0.03797624991820739, "sim_compute_performance-ego": 0.06479655514966261, "sim_compute_robot_state-ego": 0.06629480327571835, "sim_compute_robot_state-npc0": 0.07284618497968794, "sim_compute_robot_state-npc1": 0.06714994628150184, "sim_compute_robot_state-npc2": 0.06711484720041086, "sim_compute_robot_state-npc3": 0.06573702623178293}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.577168920118719, "sim_physics": 0.026880341607171135, "survival_time": 5.549999999999988, "driven_lanedir": 1.23945896053367, "sim_render-ego": 0.06704664445138192, "in-drivable-lane": 0.9999999999999964, "agent_compute-ego": 0.05540583155176661, "deviation-heading": 0.3902087806783182, "set_robot_commands": 0.07617923375722524, "deviation-center-line": 0.04756893535888313, "driven_lanedir_consec": 1.23945896053367, "sim_compute_sim_state": 0.03694467286805849, "sim_compute_performance-ego": 0.063793962066238, "sim_compute_robot_state-ego": 0.06555089005478867, "sim_compute_robot_state-npc0": 0.07398053976866575, "sim_compute_robot_state-npc1": 0.06590860169213097, "sim_compute_robot_state-npc2": 0.06584428237365172, "sim_compute_robot_state-npc3": 0.06582061449686687}}
set_robot_commands_max	0.07767753128532891
set_robot_commands_mean	0.07639426601200712
set_robot_commands_median	0.07617923375722524
set_robot_commands_min	0.07574865300819357
sim_compute_performance-ego_max	0.0650869167602814
sim_compute_performance-ego_mean	0.06369569312600505
sim_compute_performance-ego_median	0.063793962066238
sim_compute_performance-ego_min	0.06218893187386649
sim_compute_robot_state-ego_max	0.06629480327571835
sim_compute_robot_state-ego_mean	0.06423128249221446
sim_compute_robot_state-ego_median	0.06465039811692797
sim_compute_robot_state-ego_min	0.06134481026382042
sim_compute_robot_state-npc0_max	0.07398053976866575
sim_compute_robot_state-npc0_mean	0.07172974522032316
sim_compute_robot_state-npc0_median	0.07116804851426019
sim_compute_robot_state-npc0_min	0.06961316784853658
sim_compute_robot_state-npc1_max	0.07024121946758694
sim_compute_robot_state-npc1_mean	0.0668583205870322
sim_compute_robot_state-npc1_median	0.06609188185797797
sim_compute_robot_state-npc1_min	0.06489995363596324
sim_compute_robot_state-npc2_max	0.06711484720041086
sim_compute_robot_state-npc2_mean	0.06537329210379972
sim_compute_robot_state-npc2_median	0.06498432589006854
sim_compute_robot_state-npc2_min	0.06410084451947894
sim_compute_robot_state-npc3_max	0.06582061449686687
sim_compute_robot_state-npc3_mean	0.06420160691386621
sim_compute_robot_state-npc3_median	0.06395811504787868
sim_compute_robot_state-npc3_min	0.06189647048869461
sim_compute_sim_state_max	0.03797624991820739
sim_compute_sim_state_mean	0.03676564703338157
sim_compute_sim_state_median	0.03694467286805849
sim_compute_sim_state_min	0.03570322889499564
sim_physics_max	0.02729593955718719
sim_physics_mean	0.026723733301004526
sim_physics_median	0.026880341607171135
sim_physics_min	0.02587559631278923
sim_render-ego_max	0.0671760842606828
sim_render-ego_mean	0.06581429508849648
sim_render-ego_median	0.06677341890764667
sim_render-ego_min	0.0633264180844423
simulation-passed	1
survival_time_max	9.45
survival_time_mean	5.939999999999992
survival_time_min	3.599999999999995

No reset possible

18538

2384

Andrea Censi 🇨🇭

Baseline solution using reinforcement learning

step1-simulation

success

2019-04-19 15:54:38+00:00

2019-04-19 15:59:00+00:00

0:04:22

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.08591362261545621
survival_time_median	1.3500000000000003
deviation-center-line_median	0.04228235621958391
in-drivable-lane_median	0.20000000000000015

other stats

agent_compute-ego_max	0.26378082275390624
agent_compute-ego_mean	0.21248565502220867
agent_compute-ego_median	0.2002367228269577
agent_compute-ego_min	0.1661463245268791
deviation-center-line_max	0.05284330342917561
deviation-center-line_mean	0.04342279184007208
deviation-center-line_min	0.03364127815137936
deviation-heading_max	0.7271839207131114
deviation-heading_mean	0.6742184736384935
deviation-heading_median	0.6652048015110592
deviation-heading_min	0.622369155753405
driven_any_max	0.1622786637906895
driven_any_mean	0.1574612775061195
driven_any_median	0.1573190128697238
driven_any_min	0.15214363403990147
driven_lanedir_consec_max	0.09758511407507207
driven_lanedir_consec_mean	0.08440683267634859
driven_lanedir_consec_min	0.07493124017735431
driven_lanedir_max	0.09758511407507207
driven_lanedir_mean	0.08440683267634859
driven_lanedir_median	0.08591362261545621
driven_lanedir_min	0.07493124017735431
in-drivable-lane_max	0.4500000000000004
in-drivable-lane_mean	0.2400000000000002
in-drivable-lane_min	0.05000000000000005
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.1622786637906895, "sim_physics": 0.018357999863163117, "survival_time": 1.5500000000000007, "driven_lanedir": 0.07644555623533567, "sim_render-ego": 0.06725732741817352, "in-drivable-lane": 0.4500000000000004, "agent_compute-ego": 0.1661463245268791, "deviation-heading": 0.622369155753405, "set_robot_commands": 0.07822325152735557, "deviation-center-line": 0.03364127815137936, "driven_lanedir_consec": 0.07644555623533567, "sim_compute_sim_state": 0.04125268228592411, "sim_compute_performance-ego": 0.06216579098855295, "sim_compute_robot_state-ego": 0.06654837054591026}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.15214363403990147, "sim_physics": 0.015515356063842774, "survival_time": 1.2500000000000004, "driven_lanedir": 0.08715863027852466, "sim_render-ego": 0.05911397933959961, "in-drivable-lane": 0.05000000000000005, "agent_compute-ego": 0.17931326866149902, "deviation-heading": 0.7271839207131114, "set_robot_commands": 0.07356452941894531, "deviation-center-line": 0.05284330342917561, "driven_lanedir_consec": 0.08715863027852466, "sim_compute_sim_state": 0.04057144165039062, "sim_compute_performance-ego": 0.06011554718017578, "sim_compute_robot_state-ego": 0.06346545219421387}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.15987418235648682, "sim_physics": 0.015846602618694305, "survival_time": 1.6000000000000008, "driven_lanedir": 0.07493124017735431, "sim_render-ego": 0.06609972566366196, "in-drivable-lane": 0.4500000000000004, "agent_compute-ego": 0.2002367228269577, "deviation-heading": 0.6652048015110592, "set_robot_commands": 0.07605556398630142, "deviation-center-line": 0.03707094101643475, "driven_lanedir_consec": 0.07493124017735431, "sim_compute_sim_state": 0.04222404956817627, "sim_compute_performance-ego": 0.06740090996026993, "sim_compute_robot_state-ego": 0.06518090516328812}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.1573190128697238, "sim_physics": 0.01717057228088379, "survival_time": 1.2500000000000004, "driven_lanedir": 0.09758511407507207, "sim_render-ego": 0.06182302474975586, "in-drivable-lane": 0.05000000000000005, "agent_compute-ego": 0.26378082275390624, "deviation-heading": 0.6989190018925228, "set_robot_commands": 0.07338825225830078, "deviation-center-line": 0.0512760803837868, "driven_lanedir_consec": 0.09758511407507207, "sim_compute_sim_state": 0.03591335296630859, "sim_compute_performance-ego": 0.06346601486206055, "sim_compute_robot_state-ego": 0.06596061706542969}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.15569089447379597, "sim_physics": 0.017033073637220595, "survival_time": 1.3500000000000003, "driven_lanedir": 0.08591362261545621, "sim_render-ego": 0.06009581353929308, "in-drivable-lane": 0.20000000000000015, "agent_compute-ego": 0.2529511363418014, "deviation-heading": 0.6574154883223693, "set_robot_commands": 0.07503829178986726, "deviation-center-line": 0.04228235621958391, "driven_lanedir_consec": 0.08591362261545621, "sim_compute_sim_state": 0.038694143295288086, "sim_compute_performance-ego": 0.05990589989556207, "sim_compute_robot_state-ego": 0.058747565304791485}}
set_robot_commands_max	0.07822325152735557
set_robot_commands_mean	0.07525397779615407
set_robot_commands_median	0.07503829178986726
set_robot_commands_min	0.07338825225830078
sim_compute_performance-ego_max	0.06740090996026993
sim_compute_performance-ego_mean	0.06261083257732425
sim_compute_performance-ego_median	0.06216579098855295
sim_compute_performance-ego_min	0.05990589989556207
sim_compute_robot_state-ego_max	0.06654837054591026
sim_compute_robot_state-ego_mean	0.06398058205472669
sim_compute_robot_state-ego_median	0.06518090516328812
sim_compute_robot_state-ego_min	0.058747565304791485
sim_compute_sim_state_max	0.04222404956817627
sim_compute_sim_state_mean	0.039731133953217534
sim_compute_sim_state_median	0.04057144165039062
sim_compute_sim_state_min	0.03591335296630859
sim_physics_max	0.018357999863163117
sim_physics_mean	0.016784720892760917
sim_physics_median	0.017033073637220595
sim_physics_min	0.015515356063842774
sim_render-ego_max	0.06725732741817352
sim_render-ego_mean	0.06287797414209681
sim_render-ego_median	0.06182302474975586
sim_render-ego_min	0.05911397933959961
simulation-passed	1
survival_time_max	1.6000000000000008
survival_time_mean	1.4000000000000006
survival_time_min	1.2500000000000004

No reset possible

18529

2395

Liam Paull 🇨🇦

random_agent

step1-simulation

success

2019-04-19 15:44:35+00:00

2019-04-19 15:54:16+00:00

0:09:41

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.9097625228344608
survival_time_median	2.3999999999999995
deviation-center-line_median	0.09850417100304978
in-drivable-lane_median	0

other stats

agent_compute-ego_max	0.1339196527705473
agent_compute-ego_mean	0.12943161637369768
agent_compute-ego_median	0.12911516825358074
agent_compute-ego_min	0.12533186066825436
deviation-center-line_max	0.13882443387861454
deviation-center-line_mean	0.10656223356403702
deviation-center-line_min	0.07952733817751276
deviation-heading_max	0.26115230540596424
deviation-heading_mean	0.23093022559873316
deviation-heading_median	0.23417405060778035
deviation-heading_min	0.1984807025035913
driven_any_max	1.4367438864906794
driven_any_mean	1.0309070915612302
driven_any_median	0.9157141892899948
driven_any_min	0.8462726558162903
driven_lanedir_consec_max	0.9542194653539162
driven_lanedir_consec_mean	0.8288426551719738
driven_lanedir_consec_min	0.5348503251906886
driven_lanedir_max	0.9542194653539162
driven_lanedir_mean	0.8288426551719738
driven_lanedir_median	0.9097625228344608
driven_lanedir_min	0.5348503251906886
in-drivable-lane_max	1.099999999999998
in-drivable-lane_mean	0.4199999999999989
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0405624261079018, "sim_physics": 0.025712454094077054, "survival_time": 2.6499999999999986, "driven_lanedir": 0.5348503251906886, "sim_render-ego": 0.058882267969959184, "in-drivable-lane": 1.099999999999998, "agent_compute-ego": 0.12533186066825436, "deviation-heading": 0.24579559783100224, "set_robot_commands": 0.0770078200214314, "deviation-center-line": 0.07952733817751276, "driven_lanedir_consec": 0.5348503251906886, "sim_compute_sim_state": 0.035018970381538825, "sim_compute_performance-ego": 0.059834151897790296, "sim_compute_robot_state-ego": 0.06426429748535156, "sim_compute_robot_state-npc0": 0.06907240399774515, "sim_compute_robot_state-npc1": 0.06429804046199007, "sim_compute_robot_state-npc2": 0.06244702609080189, "sim_compute_robot_state-npc3": 0.06097322589946243}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.8462726558162903, "sim_physics": 0.027003331617875537, "survival_time": 2.2, "driven_lanedir": 0.8350786826190175, "sim_render-ego": 0.06111473386937922, "in-drivable-lane": 0, "agent_compute-ego": 0.12757215716622092, "deviation-heading": 0.23417405060778035, "set_robot_commands": 0.07973288406025279, "deviation-center-line": 0.09491150723296102, "driven_lanedir_consec": 0.8350786826190175, "sim_compute_sim_state": 0.035183391787789085, "sim_compute_performance-ego": 0.0658999193798412, "sim_compute_robot_state-ego": 0.06384467536752875, "sim_compute_robot_state-npc0": 0.07035931132056496, "sim_compute_robot_state-npc1": 0.06475837664170699, "sim_compute_robot_state-npc2": 0.06501125747507269, "sim_compute_robot_state-npc3": 0.06287291916933926}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.9152423001012856, "sim_physics": 0.0250530030992296, "survival_time": 2.25, "driven_lanedir": 0.9097625228344608, "sim_render-ego": 0.06614510748121473, "in-drivable-lane": 0, "agent_compute-ego": 0.12911516825358074, "deviation-heading": 0.1984807025035913, "set_robot_commands": 0.07834258079528808, "deviation-center-line": 0.12104371752804705, "driven_lanedir_consec": 0.9097625228344608, "sim_compute_sim_state": 0.03575002352396647, "sim_compute_performance-ego": 0.06448133256700304, "sim_compute_robot_state-ego": 0.061106427510579424, "sim_compute_robot_state-npc0": 0.06731939315795898, "sim_compute_robot_state-npc1": 0.06607769860161675, "sim_compute_robot_state-npc2": 0.06864083078172471, "sim_compute_robot_state-npc3": 0.06567244529724121}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.9157141892899948, "sim_physics": 0.02599198619524638, "survival_time": 2.3999999999999995, "driven_lanedir": 0.910302279861786, "sim_render-ego": 0.06410610675811768, "in-drivable-lane": 0, "agent_compute-ego": 0.13121924300988516, "deviation-heading": 0.2150484716453277, "set_robot_commands": 0.07781291504700978, "deviation-center-line": 0.13882443387861454, "driven_lanedir_consec": 0.910302279861786, "sim_compute_sim_state": 0.03516339759031931, "sim_compute_performance-ego": 0.06395100553830464, "sim_compute_robot_state-ego": 0.06408603986104329, "sim_compute_robot_state-npc0": 0.07270281513532002, "sim_compute_robot_state-npc1": 0.066173255443573, "sim_compute_robot_state-npc2": 0.06623555719852448, "sim_compute_robot_state-npc3": 0.06388899683952332}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.4367438864906794, "sim_physics": 0.02681821584701538, "survival_time": 3.399999999999996, "driven_lanedir": 0.9542194653539162, "sim_render-ego": 0.06621563785216387, "in-drivable-lane": 0.9999999999999964, "agent_compute-ego": 0.1339196527705473, "deviation-heading": 0.26115230540596424, "set_robot_commands": 0.07901189257116879, "deviation-center-line": 0.09850417100304978, "driven_lanedir_consec": 0.9542194653539162, "sim_compute_sim_state": 0.03719901337343104, "sim_compute_performance-ego": 0.06598359697005328, "sim_compute_robot_state-ego": 0.0638969715903787, "sim_compute_robot_state-npc0": 0.06889824656879201, "sim_compute_robot_state-npc1": 0.06587360185735366, "sim_compute_robot_state-npc2": 0.06418440271826352, "sim_compute_robot_state-npc3": 0.0667263620039996}}
set_robot_commands_max	0.07973288406025279
set_robot_commands_mean	0.07838161849903016
set_robot_commands_median	0.07834258079528808
set_robot_commands_min	0.0770078200214314
sim_compute_performance-ego_max	0.06598359697005328
sim_compute_performance-ego_mean	0.06403000127059849
sim_compute_performance-ego_median	0.06448133256700304
sim_compute_performance-ego_min	0.059834151897790296
sim_compute_robot_state-ego_max	0.06426429748535156
sim_compute_robot_state-ego_mean	0.06343968236297634
sim_compute_robot_state-ego_median	0.0638969715903787
sim_compute_robot_state-ego_min	0.061106427510579424
sim_compute_robot_state-npc0_max	0.07270281513532002
sim_compute_robot_state-npc0_mean	0.06967043403607623
sim_compute_robot_state-npc0_median	0.06907240399774515
sim_compute_robot_state-npc0_min	0.06731939315795898
sim_compute_robot_state-npc1_max	0.066173255443573
sim_compute_robot_state-npc1_mean	0.0654361946012481
sim_compute_robot_state-npc1_median	0.06587360185735366
sim_compute_robot_state-npc1_min	0.06429804046199007
sim_compute_robot_state-npc2_max	0.06864083078172471
sim_compute_robot_state-npc2_mean	0.06530381485287746
sim_compute_robot_state-npc2_median	0.06501125747507269
sim_compute_robot_state-npc2_min	0.06244702609080189
sim_compute_robot_state-npc3_max	0.0667263620039996
sim_compute_robot_state-npc3_mean	0.06402678984191316
sim_compute_robot_state-npc3_median	0.06388899683952332
sim_compute_robot_state-npc3_min	0.06097322589946243
sim_compute_sim_state_max	0.03719901337343104
sim_compute_sim_state_mean	0.03566295933140894
sim_compute_sim_state_median	0.035183391787789085
sim_compute_sim_state_min	0.035018970381538825
sim_physics_max	0.027003331617875537
sim_physics_mean	0.026115798170688792
sim_physics_median	0.02599198619524638
sim_physics_min	0.0250530030992296
sim_render-ego_max	0.06621563785216387
sim_render-ego_mean	0.06329277078616694
sim_render-ego_median	0.06410610675811768
sim_render-ego_min	0.058882267969959184
simulation-passed	1
survival_time_max	3.399999999999996
survival_time_mean	2.579999999999999
survival_time_min	2.2

No reset possible

18526

2401

Bhairav Mehta

Baseline solution using reinforcement learning

step1-simulation

error

2019-04-19 15:43:30+00:00

2019-04-19 15:44:08+00:00

0:00:38

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

18519

2407

Victor Guerra 🇫🇷

Baseline solution using reinforcement learning

step1-simulation

success

2019-04-19 15:28:12+00:00

2019-04-19 15:43:17+00:00

0:15:05

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.043829460440370616
survival_time_median	1.6500000000000008
deviation-center-line_median	0.021261662167602297
in-drivable-lane_median	0.6500000000000005

other stats

agent_compute-ego_max	0.2810479727658359
agent_compute-ego_mean	0.2656256605657664
agent_compute-ego_median	0.2600973158171683
agent_compute-ego_min	0.25500378767649334
deviation-center-line_max	0.32916246113506337
deviation-center-line_mean	0.08201954115375902
deviation-center-line_min	0.015384369482422895
deviation-heading_max	5.799081040038353
deviation-heading_mean	1.606703587223666
deviation-heading_median	0.5933954094609692
deviation-heading_min	0.4967758423233013
driven_any_max	1.7169565530970436
driven_any_mean	0.46123969687036864
driven_any_median	0.1507293514764109
driven_any_min	0.14172107592572883
driven_lanedir_consec_max	0.5357789837295097
driven_lanedir_consec_mean	0.14537426547980656
driven_lanedir_consec_min	0.04146047128826824
driven_lanedir_max	0.5357789837295097
driven_lanedir_mean	0.14537426547980656
driven_lanedir_median	0.043829460440370616
driven_lanedir_min	0.04146047128826824
in-drivable-lane_max	7.300000000000032
in-drivable-lane_mean	1.940000000000007
in-drivable-lane_min	0.5000000000000004
per-episodes	details {"udem1-0-0": {"driven_any": 1.7169565530970436, "sim_physics": 0.028690653642018636, "survival_time": 14.950000000000076, "driven_lanedir": 0.5357789837295097, "sim_render-ego": 0.06454098065694173, "in-drivable-lane": 7.300000000000032, "agent_compute-ego": 0.25500378767649334, "deviation-heading": 5.799081040038353, "set_robot_commands": 0.07698901732762654, "deviation-center-line": 0.32916246113506337, "driven_lanedir_consec": 0.5357789837295097, "sim_compute_sim_state": 0.03632314523061116, "sim_compute_performance-ego": 0.06373490492502848, "sim_compute_robot_state-ego": 0.06305175224939982, "sim_compute_robot_state-npc0": 0.07062138636906942, "sim_compute_robot_state-npc1": 0.06493094205856323, "sim_compute_robot_state-npc2": 0.06441465139389038, "sim_compute_robot_state-npc3": 0.06456927299499511}, "udem1-1-0": {"driven_any": 0.1507293514764109, "sim_physics": 0.029639612544666637, "survival_time": 1.6500000000000008, "driven_lanedir": 0.06340339215333701, "sim_render-ego": 0.06493705691713275, "in-drivable-lane": 0.5500000000000005, "agent_compute-ego": 0.2810479727658359, "deviation-heading": 0.613601912680153, "set_robot_commands": 0.07584706942240398, "deviation-center-line": 0.026563393954412148, "driven_lanedir_consec": 0.06340339215333701, "sim_compute_sim_state": 0.03608465917182691, "sim_compute_performance-ego": 0.06323279756488222, "sim_compute_robot_state-ego": 0.06169231010205818, "sim_compute_robot_state-npc0": 0.06750134988264604, "sim_compute_robot_state-npc1": 0.06432531819199071, "sim_compute_robot_state-npc2": 0.0685232046878699, "sim_compute_robot_state-npc3": 0.0663256211714311}, "udem1-2-0": {"driven_any": 0.15423110224971143, "sim_physics": 0.031073912978172306, "survival_time": 1.6000000000000008, "driven_lanedir": 0.04239901978754723, "sim_render-ego": 0.0611913800239563, "in-drivable-lane": 0.6500000000000005, "agent_compute-ego": 0.2731870487332344, "deviation-heading": 0.5306637316155532, "set_robot_commands": 0.07601965218782425, "deviation-center-line": 0.017725819029294432, "driven_lanedir_consec": 0.04239901978754723, "sim_compute_sim_state": 0.03635556995868683, "sim_compute_performance-ego": 0.06597136706113815, "sim_compute_robot_state-ego": 0.06446687132120132, "sim_compute_robot_state-npc0": 0.06781896203756332, "sim_compute_robot_state-npc1": 0.06572224944829941, "sim_compute_robot_state-npc2": 0.06266240030527115, "sim_compute_robot_state-npc3": 0.06475638598203659}, "udem1-3-0": {"driven_any": 0.14256040160294822, "sim_physics": 0.03283097743988037, "survival_time": 1.5000000000000009, "driven_lanedir": 0.04146047128826824, "sim_render-ego": 0.07049473921457926, "in-drivable-lane": 0.5000000000000004, "agent_compute-ego": 0.25879217783610026, "deviation-heading": 0.5933954094609692, "set_robot_commands": 0.07757723331451416, "deviation-center-line": 0.021261662167602297, "driven_lanedir_consec": 0.04146047128826824, "sim_compute_sim_state": 0.03894602457682292, "sim_compute_performance-ego": 0.06657133102416993, "sim_compute_robot_state-ego": 0.0653569221496582, "sim_compute_robot_state-npc0": 0.0759345293045044, "sim_compute_robot_state-npc1": 0.0653864860534668, "sim_compute_robot_state-npc2": 0.06536187330881754, "sim_compute_robot_state-npc3": 0.06369523207346599}, "udem1-4-0": {"driven_any": 0.14172107592572883, "sim_physics": 0.02638940377668901, "survival_time": 1.6500000000000008, "driven_lanedir": 0.043829460440370616, "sim_render-ego": 0.06559429746685606, "in-drivable-lane": 0.7000000000000005, "agent_compute-ego": 0.2600973158171683, "deviation-heading": 0.4967758423233013, "set_robot_commands": 0.07318185314987645, "deviation-center-line": 0.015384369482422895, "driven_lanedir_consec": 0.043829460440370616, "sim_compute_sim_state": 0.034577376914746834, "sim_compute_performance-ego": 0.06366967432426685, "sim_compute_robot_state-ego": 0.061436551989931046, "sim_compute_robot_state-npc0": 0.06943221525712447, "sim_compute_robot_state-npc1": 0.06508783860640092, "sim_compute_robot_state-npc2": 0.0618460395119407, "sim_compute_robot_state-npc3": 0.06365190130291563}}
set_robot_commands_max	0.07757723331451416
set_robot_commands_mean	0.07592296508044907
set_robot_commands_median	0.07601965218782425
set_robot_commands_min	0.07318185314987645
sim_compute_performance-ego_max	0.06657133102416993
sim_compute_performance-ego_mean	0.06463601497989713
sim_compute_performance-ego_median	0.06373490492502848
sim_compute_performance-ego_min	0.06323279756488222
sim_compute_robot_state-ego_max	0.0653569221496582
sim_compute_robot_state-ego_mean	0.06320088156244971
sim_compute_robot_state-ego_median	0.06305175224939982
sim_compute_robot_state-ego_min	0.061436551989931046
sim_compute_robot_state-npc0_max	0.0759345293045044
sim_compute_robot_state-npc0_mean	0.07026168857018153
sim_compute_robot_state-npc0_median	0.06943221525712447
sim_compute_robot_state-npc0_min	0.06750134988264604
sim_compute_robot_state-npc1_max	0.06572224944829941
sim_compute_robot_state-npc1_mean	0.06509056687174422
sim_compute_robot_state-npc1_median	0.06508783860640092
sim_compute_robot_state-npc1_min	0.06432531819199071
sim_compute_robot_state-npc2_max	0.0685232046878699
sim_compute_robot_state-npc2_mean	0.06456163384155793
sim_compute_robot_state-npc2_median	0.06441465139389038
sim_compute_robot_state-npc2_min	0.0618460395119407
sim_compute_robot_state-npc3_max	0.0663256211714311
sim_compute_robot_state-npc3_mean	0.06459968270496888
sim_compute_robot_state-npc3_median	0.06456927299499511
sim_compute_robot_state-npc3_min	0.06365190130291563
sim_compute_sim_state_max	0.03894602457682292
sim_compute_sim_state_mean	0.03645735517053893
sim_compute_sim_state_median	0.03632314523061116
sim_compute_sim_state_min	0.034577376914746834
sim_physics_max	0.03283097743988037
sim_physics_mean	0.02972491207628539
sim_physics_median	0.029639612544666637
sim_physics_min	0.02638940377668901
sim_render-ego_max	0.07049473921457926
sim_render-ego_mean	0.06535169085589324
sim_render-ego_median	0.06493705691713275
sim_render-ego_min	0.0611913800239563
simulation-passed	1
survival_time_max	14.950000000000076
survival_time_mean	4.270000000000016
survival_time_min	1.5000000000000009

No reset possible

18511

2421

Andrea Censi 🇨🇭

random_agent

step1-simulation

success

2019-04-19 15:18:35+00:00

2019-04-19 15:28:00+00:00

0:09:25

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.9097625228344608
survival_time_median	2.3999999999999995
deviation-center-line_median	0.09850417100304978
in-drivable-lane_median	0

other stats

agent_compute-ego_max	0.13552660246690115
agent_compute-ego_mean	0.13158735832362395
agent_compute-ego_median	0.13233882730657404
agent_compute-ego_min	0.12609793345133463
deviation-center-line_max	0.13882443387861454
deviation-center-line_mean	0.10656223356403702
deviation-center-line_min	0.07952733817751276
deviation-heading_max	0.26115230540596424
deviation-heading_mean	0.23093022559873316
deviation-heading_median	0.23417405060778035
deviation-heading_min	0.1984807025035913
driven_any_max	1.4367438864906794
driven_any_mean	1.0309070915612302
driven_any_median	0.9157141892899948
driven_any_min	0.8462726558162903
driven_lanedir_consec_max	0.9542194653539162
driven_lanedir_consec_mean	0.8288426551719738
driven_lanedir_consec_min	0.5348503251906886
driven_lanedir_max	0.9542194653539162
driven_lanedir_mean	0.8288426551719738
driven_lanedir_median	0.9097625228344608
driven_lanedir_min	0.5348503251906886
in-drivable-lane_max	1.099999999999998
in-drivable-lane_mean	0.4199999999999989
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0405624261079018, "sim_physics": 0.02456669087679881, "survival_time": 2.6499999999999986, "driven_lanedir": 0.5348503251906886, "sim_render-ego": 0.06027405217008771, "in-drivable-lane": 1.099999999999998, "agent_compute-ego": 0.12888146796316471, "deviation-heading": 0.24579559783100224, "set_robot_commands": 0.08122308299226581, "deviation-center-line": 0.07952733817751276, "driven_lanedir_consec": 0.5348503251906886, "sim_compute_sim_state": 0.03343700462917112, "sim_compute_performance-ego": 0.06315394617476554, "sim_compute_robot_state-ego": 0.06297245565450417, "sim_compute_robot_state-npc0": 0.07226129297940236, "sim_compute_robot_state-npc1": 0.06513123242360241, "sim_compute_robot_state-npc2": 0.06216611502305517, "sim_compute_robot_state-npc3": 0.0629172774980653}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.8462726558162903, "sim_physics": 0.027193118225444447, "survival_time": 2.2, "driven_lanedir": 0.8350786826190175, "sim_render-ego": 0.06350973519411954, "in-drivable-lane": 0, "agent_compute-ego": 0.13233882730657404, "deviation-heading": 0.23417405060778035, "set_robot_commands": 0.07669901847839355, "deviation-center-line": 0.09491150723296102, "driven_lanedir_consec": 0.8350786826190175, "sim_compute_sim_state": 0.03738542036576704, "sim_compute_performance-ego": 0.06425958329981024, "sim_compute_robot_state-ego": 0.06312078779393976, "sim_compute_robot_state-npc0": 0.07061129266565497, "sim_compute_robot_state-npc1": 0.06412296403538097, "sim_compute_robot_state-npc2": 0.06193715875799006, "sim_compute_robot_state-npc3": 0.0635571696541526}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.9152423001012856, "sim_physics": 0.025586462020874026, "survival_time": 2.25, "driven_lanedir": 0.9097625228344608, "sim_render-ego": 0.06641265021430122, "in-drivable-lane": 0, "agent_compute-ego": 0.12609793345133463, "deviation-heading": 0.1984807025035913, "set_robot_commands": 0.07678207291497124, "deviation-center-line": 0.12104371752804705, "driven_lanedir_consec": 0.9097625228344608, "sim_compute_sim_state": 0.03430182668897841, "sim_compute_performance-ego": 0.06370140711466471, "sim_compute_robot_state-ego": 0.06213536262512207, "sim_compute_robot_state-npc0": 0.06896348529391819, "sim_compute_robot_state-npc1": 0.06175821622212728, "sim_compute_robot_state-npc2": 0.06506198777092828, "sim_compute_robot_state-npc3": 0.06330561637878418}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.9157141892899948, "sim_physics": 0.025835941235224407, "survival_time": 2.3999999999999995, "driven_lanedir": 0.910302279861786, "sim_render-ego": 0.0645560622215271, "in-drivable-lane": 0, "agent_compute-ego": 0.13552660246690115, "deviation-heading": 0.2150484716453277, "set_robot_commands": 0.07819852232933044, "deviation-center-line": 0.13882443387861454, "driven_lanedir_consec": 0.910302279861786, "sim_compute_sim_state": 0.034350683291753135, "sim_compute_performance-ego": 0.06047716240088145, "sim_compute_robot_state-ego": 0.06189628938833872, "sim_compute_robot_state-npc0": 0.06770242750644684, "sim_compute_robot_state-npc1": 0.06478840112686157, "sim_compute_robot_state-npc2": 0.06468536456425984, "sim_compute_robot_state-npc3": 0.06388952334721883}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.4367438864906794, "sim_physics": 0.026388000039493337, "survival_time": 3.399999999999996, "driven_lanedir": 0.9542194653539162, "sim_render-ego": 0.06340524378944845, "in-drivable-lane": 0.9999999999999964, "agent_compute-ego": 0.13509196043014526, "deviation-heading": 0.26115230540596424, "set_robot_commands": 0.07857629481483908, "deviation-center-line": 0.09850417100304978, "driven_lanedir_consec": 0.9542194653539162, "sim_compute_sim_state": 0.036506530116586125, "sim_compute_performance-ego": 0.06469833850860596, "sim_compute_robot_state-ego": 0.06484385097728056, "sim_compute_robot_state-npc0": 0.07234387538012337, "sim_compute_robot_state-npc1": 0.06658290414249196, "sim_compute_robot_state-npc2": 0.06334462586571188, "sim_compute_robot_state-npc3": 0.06459600083968219}}
set_robot_commands_max	0.08122308299226581
set_robot_commands_mean	0.07829579830596003
set_robot_commands_median	0.07819852232933044
set_robot_commands_min	0.07669901847839355
sim_compute_performance-ego_max	0.06469833850860596
sim_compute_performance-ego_mean	0.06325808749974558
sim_compute_performance-ego_median	0.06370140711466471
sim_compute_performance-ego_min	0.06047716240088145
sim_compute_robot_state-ego_max	0.06484385097728056
sim_compute_robot_state-ego_mean	0.06299374928783705
sim_compute_robot_state-ego_median	0.06297245565450417
sim_compute_robot_state-ego_min	0.06189628938833872
sim_compute_robot_state-npc0_max	0.07234387538012337
sim_compute_robot_state-npc0_mean	0.07037647476510914
sim_compute_robot_state-npc0_median	0.07061129266565497
sim_compute_robot_state-npc0_min	0.06770242750644684
sim_compute_robot_state-npc1_max	0.06658290414249196
sim_compute_robot_state-npc1_mean	0.06447674359009284
sim_compute_robot_state-npc1_median	0.06478840112686157
sim_compute_robot_state-npc1_min	0.06175821622212728
sim_compute_robot_state-npc2_max	0.06506198777092828
sim_compute_robot_state-npc2_mean	0.06343905039638904
sim_compute_robot_state-npc2_median	0.06334462586571188
sim_compute_robot_state-npc2_min	0.06193715875799006
sim_compute_robot_state-npc3_max	0.06459600083968219
sim_compute_robot_state-npc3_mean	0.06365311754358062
sim_compute_robot_state-npc3_median	0.0635571696541526
sim_compute_robot_state-npc3_min	0.0629172774980653
sim_compute_sim_state_max	0.03738542036576704
sim_compute_sim_state_mean	0.03519629301845116
sim_compute_sim_state_median	0.034350683291753135
sim_compute_sim_state_min	0.03343700462917112
sim_physics_max	0.027193118225444447
sim_physics_mean	0.02591404247956701
sim_physics_median	0.025835941235224407
sim_physics_min	0.02456669087679881
sim_render-ego_max	0.06641265021430122
sim_render-ego_mean	0.06363154871789681
sim_render-ego_median	0.06350973519411954
sim_render-ego_min	0.06027405217008771
simulation-passed	1
survival_time_max	3.399999999999996
survival_time_mean	2.579999999999999
survival_time_min	2.2

No reset possible

18502

2433

Andrea Censi 🇨🇭

random_agent

step1-simulation

error

2019-04-19 15:17:16+00:00

2019-04-19 15:17:57+00:00

0:00:41

The container "solut [...]

The container "solution" exited with code 2.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

18490

2448

Nicky Eichmann

Baseline solution using reinforcement learning

step1-simulation

error

2019-04-19 14:55:25+00:00

2019-04-19 15:16:56+00:00

0:21:31

Waited 1204 seconds [...]

Waited 1204 seconds for container to finish. Giving up.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

18484

2455

Liam Paull 🇨🇦

challenge-aido_LF-template-ros

step1-simulation

error

2019-04-19 14:54:08+00:00

2019-04-19 14:54:46+00:00

0:00:38

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

18482

2459

Liam Paull 🇨🇦

challenge-aido_LF-template-ros

step1-simulation

error

2019-04-19 14:53:11+00:00

2019-04-19 14:53:48+00:00

0:00:37

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

18481

2463

Liam Paull 🇨🇦

challenge-aido_LF-template-ros

step1-simulation

error

2019-04-19 14:52:12+00:00

2019-04-19 14:52:50+00:00

0:00:38

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

18480

2464

Liam Paull 🇨🇦

challenge-aido_LF-template-ros

step1-simulation

error

2019-04-19 14:51:22+00:00

2019-04-19 14:51:59+00:00

0:00:37

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

18463

2499

Liam Paull 🇨🇦

challenge-aido_LF-template-pytorch

step1-simulation

success

2019-04-19 14:39:47+00:00

2019-04-19 14:50:45+00:00

0:10:58

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.09109139811505518
survival_time_median	1.7500000000000009
deviation-center-line_median	0.04129978804830459
in-drivable-lane_median	0.5000000000000004

other stats

agent_compute-ego_max	0.2589130907347708
agent_compute-ego_mean	0.2403674880854098
agent_compute-ego_median	0.25216064453125
agent_compute-ego_min	0.2094625677817907
deviation-center-line_max	0.1184274013793678
deviation-center-line_mean	0.0543200124745359
deviation-center-line_min	0.023377270676912164
deviation-heading_max	3.0218916724900646
deviation-heading_mean	1.1341502377312094
deviation-heading_median	0.6855185785596738
deviation-heading_min	0.6133446300329327
driven_any_max	0.8525924098637234
driven_any_mean	0.30822155834055864
driven_any_median	0.17689999032799322
driven_any_min	0.15063035221893556
driven_lanedir_consec_max	0.30063930349058055
driven_lanedir_consec_mean	0.1256877880660013
driven_lanedir_consec_min	0.055244473193483135
driven_lanedir_max	0.30063930349058055
driven_lanedir_mean	0.1256877880660013
driven_lanedir_median	0.09109139811505518
driven_lanedir_min	0.055244473193483135
in-drivable-lane_max	3.5999999999999908
in-drivable-lane_mean	1.1399999999999983
in-drivable-lane_min	0.4500000000000004
per-episodes	details {"udem1-0-0": {"driven_any": 0.17689999032799322, "sim_physics": 0.02868293993400805, "survival_time": 1.6500000000000008, "driven_lanedir": 0.08024480552735347, "sim_render-ego": 0.06278016350486061, "in-drivable-lane": 0.4500000000000004, "agent_compute-ego": 0.2589130907347708, "deviation-heading": 0.6855185785596738, "set_robot_commands": 0.07663364121408174, "deviation-center-line": 0.04129978804830459, "driven_lanedir_consec": 0.08024480552735347, "sim_compute_sim_state": 0.0373173121250037, "sim_compute_performance-ego": 0.06316628600611832, "sim_compute_robot_state-ego": 0.06114750197439483, "sim_compute_robot_state-npc0": 0.0681175896615693, "sim_compute_robot_state-npc1": 0.06144819837627989, "sim_compute_robot_state-npc2": 0.059633218880855675, "sim_compute_robot_state-npc3": 0.06248039910287568}, "udem1-1-0": {"driven_any": 0.1872535404138368, "sim_physics": 0.027621289661952427, "survival_time": 1.7500000000000009, "driven_lanedir": 0.10121896000353424, "sim_render-ego": 0.06868768419538225, "in-drivable-lane": 0.5000000000000004, "agent_compute-ego": 0.2248373167855399, "deviation-heading": 0.6403070430572593, "set_robot_commands": 0.07589631080627442, "deviation-center-line": 0.03971581577568123, "driven_lanedir_consec": 0.10121896000353424, "sim_compute_sim_state": 0.03240647315979004, "sim_compute_performance-ego": 0.06235577038356236, "sim_compute_robot_state-ego": 0.060067578724452425, "sim_compute_robot_state-npc0": 0.06794636590140206, "sim_compute_robot_state-npc1": 0.06466412544250488, "sim_compute_robot_state-npc2": 0.062246479306902205, "sim_compute_robot_state-npc3": 0.06156400953020368}, "udem1-2-0": {"driven_any": 0.8525924098637234, "sim_physics": 0.0309259906793252, "survival_time": 7.79999999999998, "driven_lanedir": 0.30063930349058055, "sim_render-ego": 0.06521727030093853, "in-drivable-lane": 3.5999999999999908, "agent_compute-ego": 0.2094625677817907, "deviation-heading": 3.0218916724900646, "set_robot_commands": 0.07549920143225254, "deviation-center-line": 0.1184274013793678, "driven_lanedir_consec": 0.30063930349058055, "sim_compute_sim_state": 0.036937401844904974, "sim_compute_performance-ego": 0.06340001943783882, "sim_compute_robot_state-ego": 0.06283752734844501, "sim_compute_robot_state-npc0": 0.06999816802831796, "sim_compute_robot_state-npc1": 0.06478389409872201, "sim_compute_robot_state-npc2": 0.06573757147177672, "sim_compute_robot_state-npc3": 0.06549221735734206}, "udem1-3-0": {"driven_any": 0.17373149887830414, "sim_physics": 0.02808352197919573, "survival_time": 1.7500000000000009, "driven_lanedir": 0.09109139811505518, "sim_render-ego": 0.06577918870108468, "in-drivable-lane": 0.5000000000000004, "agent_compute-ego": 0.25216064453125, "deviation-heading": 0.7096892645161158, "set_robot_commands": 0.0792846611567906, "deviation-center-line": 0.048779786492413685, "driven_lanedir_consec": 0.09109139811505518, "sim_compute_sim_state": 0.034046963282993864, "sim_compute_performance-ego": 0.06113518306187221, "sim_compute_robot_state-ego": 0.061009304864065986, "sim_compute_robot_state-npc0": 0.0663712910243443, "sim_compute_robot_state-npc1": 0.06366278784615653, "sim_compute_robot_state-npc2": 0.06362454550606864, "sim_compute_robot_state-npc3": 0.06331888607570103}, "udem1-4-0": {"driven_any": 0.15063035221893556, "sim_physics": 0.0286541257585798, "survival_time": 1.7500000000000009, "driven_lanedir": 0.055244473193483135, "sim_render-ego": 0.06527998106820243, "in-drivable-lane": 0.6500000000000006, "agent_compute-ego": 0.2564638205936977, "deviation-heading": 0.6133446300329327, "set_robot_commands": 0.07329115186418805, "deviation-center-line": 0.023377270676912164, "driven_lanedir_consec": 0.055244473193483135, "sim_compute_sim_state": 0.03968630518232073, "sim_compute_performance-ego": 0.06223063468933106, "sim_compute_robot_state-ego": 0.06198578562055315, "sim_compute_robot_state-npc0": 0.06813684872218541, "sim_compute_robot_state-npc1": 0.06607728685651507, "sim_compute_robot_state-npc2": 0.0631636619567871, "sim_compute_robot_state-npc3": 0.06496389933994838}}
set_robot_commands_max	0.0792846611567906
set_robot_commands_mean	0.07612099329471747
set_robot_commands_median	0.07589631080627442
set_robot_commands_min	0.07329115186418805
sim_compute_performance-ego_max	0.06340001943783882
sim_compute_performance-ego_mean	0.06245757871574455
sim_compute_performance-ego_median	0.06235577038356236
sim_compute_performance-ego_min	0.06113518306187221
sim_compute_robot_state-ego_max	0.06283752734844501
sim_compute_robot_state-ego_mean	0.06140953970638228
sim_compute_robot_state-ego_median	0.06114750197439483
sim_compute_robot_state-ego_min	0.060067578724452425
sim_compute_robot_state-npc0_max	0.06999816802831796
sim_compute_robot_state-npc0_mean	0.0681140526675638
sim_compute_robot_state-npc0_median	0.0681175896615693
sim_compute_robot_state-npc0_min	0.0663712910243443
sim_compute_robot_state-npc1_max	0.06607728685651507
sim_compute_robot_state-npc1_mean	0.06412725852403567
sim_compute_robot_state-npc1_median	0.06466412544250488
sim_compute_robot_state-npc1_min	0.06144819837627989
sim_compute_robot_state-npc2_max	0.06573757147177672
sim_compute_robot_state-npc2_mean	0.06288109542447806
sim_compute_robot_state-npc2_median	0.0631636619567871
sim_compute_robot_state-npc2_min	0.059633218880855675
sim_compute_robot_state-npc3_max	0.06549221735734206
sim_compute_robot_state-npc3_mean	0.06356388228121417
sim_compute_robot_state-npc3_median	0.06331888607570103
sim_compute_robot_state-npc3_min	0.06156400953020368
sim_compute_sim_state_max	0.03968630518232073
sim_compute_sim_state_mean	0.036078891119002664
sim_compute_sim_state_median	0.036937401844904974
sim_compute_sim_state_min	0.03240647315979004
sim_physics_max	0.0309259906793252
sim_physics_mean	0.028793573602612244
sim_physics_median	0.0286541257585798
sim_physics_min	0.027621289661952427
sim_render-ego_max	0.06868768419538225
sim_render-ego_mean	0.0655488575540937
sim_render-ego_median	0.06527998106820243
sim_render-ego_min	0.06278016350486061
simulation-passed	1
survival_time_max	7.79999999999998
survival_time_mean	2.9399999999999964
survival_time_min	1.6500000000000008

No reset possible

18427

2543

Liam Paull 🇨🇦

challenge-aido_LF-template-random

step1-simulation

success

2019-04-19 14:33:53+00:00

2019-04-19 14:39:35+00:00

0:05:42

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.909759304183658
survival_time_median	2.3999999999999995
deviation-center-line_median	0.0985043663838993
in-drivable-lane_median	0.3499999999999992

other stats

agent_compute-ego_max	0.14812801778316498
agent_compute-ego_mean	0.13967902923975703
agent_compute-ego_median	0.1410130122128655
agent_compute-ego_min	0.13175392692739313
deviation-center-line_max	0.13882443387861454
deviation-center-line_mean	0.10001813696907735
deviation-center-line_min	0.06219077976537568
deviation-heading_max	0.26115230540596424
deviation-heading_mean	0.2318832073723368
deviation-heading_median	0.23893895947579852
deviation-heading_min	0.1984807025035912
driven_any_max	1.4367438864906803
driven_any_mean	1.030907091561231
driven_any_median	0.9157141892899948
driven_any_min	0.8462726558162896
driven_lanedir_consec_max	0.9542197633771314
driven_lanedir_consec_mean	0.795970343519684
driven_lanedir_consec_min	0.5348503251906886
driven_lanedir_max	0.9542197633771314
driven_lanedir_mean	0.795970343519684
driven_lanedir_median	0.909759304183658
driven_lanedir_min	0.5348503251906886
in-drivable-lane_max	1.099999999999998
in-drivable-lane_mean	0.4899999999999987
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0405624261079018, "sim_physics": 0.0155390073668282, "survival_time": 2.6499999999999986, "driven_lanedir": 0.5348503251906886, "sim_render-ego": 0.056594214349422814, "in-drivable-lane": 1.099999999999998, "agent_compute-ego": 0.1345638059220224, "deviation-heading": 0.24579559783100224, "set_robot_commands": 0.07042011224998618, "deviation-center-line": 0.07952733817751276, "driven_lanedir_consec": 0.5348503251906886, "sim_compute_sim_state": 0.037362206656977814, "sim_compute_performance-ego": 0.0572575218272659, "sim_compute_robot_state-ego": 0.05947550737632895}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.8462726558162896, "sim_physics": 0.015699473294344814, "survival_time": 2.2, "driven_lanedir": 0.6707200449851557, "sim_render-ego": 0.056939455595883454, "in-drivable-lane": 0.3499999999999992, "agent_compute-ego": 0.13175392692739313, "deviation-heading": 0.23893895947579852, "set_robot_commands": 0.07165381041440097, "deviation-center-line": 0.06219077976537568, "driven_lanedir_consec": 0.6707200449851557, "sim_compute_sim_state": 0.037359318949959495, "sim_compute_performance-ego": 0.05988935448906638, "sim_compute_robot_state-ego": 0.06004860184409402}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.9152423001012878, "sim_physics": 0.015608098771837022, "survival_time": 2.25, "driven_lanedir": 0.909759304183658, "sim_render-ego": 0.06367666986253527, "in-drivable-lane": 0, "agent_compute-ego": 0.1429363833533393, "deviation-heading": 0.1984807025035912, "set_robot_commands": 0.0761933167775472, "deviation-center-line": 0.1210437666399845, "driven_lanedir_consec": 0.909759304183658, "sim_compute_sim_state": 0.04109768867492676, "sim_compute_performance-ego": 0.06302042007446289, "sim_compute_robot_state-ego": 0.0621324963039822}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.9157141892899948, "sim_physics": 0.01620638370513916, "survival_time": 2.3999999999999995, "driven_lanedir": 0.910302279861786, "sim_render-ego": 0.06538769602775574, "in-drivable-lane": 0, "agent_compute-ego": 0.14812801778316498, "deviation-heading": 0.2150484716453277, "set_robot_commands": 0.07517388959725697, "deviation-center-line": 0.13882443387861454, "driven_lanedir_consec": 0.910302279861786, "sim_compute_sim_state": 0.040180464585622154, "sim_compute_performance-ego": 0.06387515862782796, "sim_compute_robot_state-ego": 0.06526399155457814}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.4367438864906803, "sim_physics": 0.016798839849584243, "survival_time": 3.399999999999996, "driven_lanedir": 0.9542197633771314, "sim_render-ego": 0.059256644809947294, "in-drivable-lane": 0.9999999999999964, "agent_compute-ego": 0.1410130122128655, "deviation-heading": 0.26115230540596424, "set_robot_commands": 0.07472660261041977, "deviation-center-line": 0.0985043663838993, "driven_lanedir_consec": 0.9542197633771314, "sim_compute_sim_state": 0.037574382389293, "sim_compute_performance-ego": 0.059597972561331355, "sim_compute_robot_state-ego": 0.06081959429909201}}
set_robot_commands_max	0.0761933167775472
set_robot_commands_mean	0.07363354632992222
set_robot_commands_median	0.07472660261041977
set_robot_commands_min	0.07042011224998618
sim_compute_performance-ego_max	0.06387515862782796
sim_compute_performance-ego_mean	0.06072808551599089
sim_compute_performance-ego_median	0.05988935448906638
sim_compute_performance-ego_min	0.0572575218272659
sim_compute_robot_state-ego_max	0.06526399155457814
sim_compute_robot_state-ego_mean	0.06154803827561507
sim_compute_robot_state-ego_median	0.06081959429909201
sim_compute_robot_state-ego_min	0.05947550737632895
sim_compute_sim_state_max	0.04109768867492676
sim_compute_sim_state_mean	0.03871481225135585
sim_compute_sim_state_median	0.037574382389293
sim_compute_sim_state_min	0.037359318949959495
sim_physics_max	0.016798839849584243
sim_physics_mean	0.01597036059754669
sim_physics_median	0.015699473294344814
sim_physics_min	0.0155390073668282
sim_render-ego_max	0.06538769602775574
sim_render-ego_mean	0.06037093612910891
sim_render-ego_median	0.059256644809947294
sim_render-ego_min	0.056594214349422814
simulation-passed	1
survival_time_max	3.399999999999996
survival_time_mean	2.579999999999999
survival_time_min	2.2

No reset possible

18424

2547

Andrea Censi 🇨🇭

challenge-aido_LF-template-ros - Template solution using ROS

step1-simulation

success

2019-04-19 14:27:51+00:00

2019-04-19 14:33:35+00:00

0:05:44

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.5487126868955534
survival_time_median	2.3499999999999996
deviation-center-line_median	0.11041377901227004
in-drivable-lane_median	0

other stats

agent_compute-ego_max	0.06783724845723903
agent_compute-ego_mean	0.06505155689581452
agent_compute-ego_median	0.06543370393606332
agent_compute-ego_min	0.0616958548383015
deviation-center-line_max	0.12791029264553877
deviation-center-line_mean	0.10518143804729678
deviation-center-line_min	0.06917252689874298
deviation-heading_max	0.4712184191829178
deviation-heading_mean	0.3828337640550056
deviation-heading_median	0.3636820162885191
deviation-heading_min	0.3257229985354382
driven_any_max	1.259664216011687
driven_any_mean	0.7702827269903463
driven_any_median	0.6642785413158997
driven_any_min	0.3059207793076624
driven_lanedir_consec_max	0.9402632878459154
driven_lanedir_consec_mean	0.5880385612453785
driven_lanedir_consec_min	0.2802213062291129
driven_lanedir_max	0.9402632878459154
driven_lanedir_mean	0.5880385612453785
driven_lanedir_median	0.5487126868955534
driven_lanedir_min	0.2802213062291129
in-drivable-lane_max	1.8499999999999936
in-drivable-lane_mean	0.559999999999998
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0590446751809168, "sim_physics": 0.017436024619311822, "survival_time": 4.099999999999993, "driven_lanedir": 0.5205812780744896, "sim_render-ego": 0.06333314790958311, "in-drivable-lane": 1.8499999999999936, "agent_compute-ego": 0.0616958548383015, "deviation-heading": 0.4069710981449338, "set_robot_commands": 0.07491619121737597, "deviation-center-line": 0.105230017637756, "driven_lanedir_consec": 0.5205812780744896, "sim_compute_sim_state": 0.038401911898357115, "sim_compute_performance-ego": 0.0632407083743956, "sim_compute_robot_state-ego": 0.06059006946842845}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.3059207793076624, "sim_physics": 0.018021757786090557, "survival_time": 1.3000000000000005, "driven_lanedir": 0.2802213062291129, "sim_render-ego": 0.0700222528897799, "in-drivable-lane": 0, "agent_compute-ego": 0.06543370393606332, "deviation-heading": 0.3636820162885191, "set_robot_commands": 0.07492014994988075, "deviation-center-line": 0.06917252689874298, "driven_lanedir_consec": 0.2802213062291129, "sim_compute_sim_state": 0.0443344024511484, "sim_compute_performance-ego": 0.06890507844778207, "sim_compute_robot_state-ego": 0.06768407271458553}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.6642785413158997, "sim_physics": 0.01614419957424732, "survival_time": 2.3499999999999996, "driven_lanedir": 0.6504142471818213, "sim_render-ego": 0.06384538082366294, "in-drivable-lane": 0, "agent_compute-ego": 0.06783724845723903, "deviation-heading": 0.34657428812321933, "set_robot_commands": 0.07797411654857879, "deviation-center-line": 0.12791029264553877, "driven_lanedir_consec": 0.6504142471818213, "sim_compute_sim_state": 0.039513861879389336, "sim_compute_performance-ego": 0.06341192062864913, "sim_compute_robot_state-ego": 0.06278903433617125}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.259664216011687, "sim_physics": 0.01962357038980002, "survival_time": 4.549999999999992, "driven_lanedir": 0.9402632878459154, "sim_render-ego": 0.0641772537441044, "in-drivable-lane": 0.9499999999999966, "agent_compute-ego": 0.06662606406997848, "deviation-heading": 0.4712184191829178, "set_robot_commands": 0.07681636757903047, "deviation-center-line": 0.1131805740421762, "driven_lanedir_consec": 0.9402632878459154, "sim_compute_sim_state": 0.040560085694868485, "sim_compute_performance-ego": 0.0635409040765448, "sim_compute_robot_state-ego": 0.06300568056630564}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.5625054231355648, "sim_physics": 0.015978599849500154, "survival_time": 1.900000000000001, "driven_lanedir": 0.5487126868955534, "sim_render-ego": 0.06071297745955618, "in-drivable-lane": 0, "agent_compute-ego": 0.06366491317749023, "deviation-heading": 0.3257229985354382, "set_robot_commands": 0.07630818768551476, "deviation-center-line": 0.11041377901227004, "driven_lanedir_consec": 0.5487126868955534, "sim_compute_sim_state": 0.03826234215184262, "sim_compute_performance-ego": 0.06375501657787122, "sim_compute_robot_state-ego": 0.06261644865337171}}
set_robot_commands_max	0.07797411654857879
set_robot_commands_mean	0.07618700259607616
set_robot_commands_median	0.07630818768551476
set_robot_commands_min	0.07491619121737597
sim_compute_performance-ego_max	0.06890507844778207
sim_compute_performance-ego_mean	0.06457072562104856
sim_compute_performance-ego_median	0.0635409040765448
sim_compute_performance-ego_min	0.0632407083743956
sim_compute_robot_state-ego_max	0.06768407271458553
sim_compute_robot_state-ego_mean	0.06333706114777252
sim_compute_robot_state-ego_median	0.06278903433617125
sim_compute_robot_state-ego_min	0.06059006946842845
sim_compute_sim_state_max	0.0443344024511484
sim_compute_sim_state_mean	0.04021452081512119
sim_compute_sim_state_median	0.039513861879389336
sim_compute_sim_state_min	0.03826234215184262
sim_physics_max	0.01962357038980002
sim_physics_mean	0.017440830443789974
sim_physics_median	0.017436024619311822
sim_physics_min	0.015978599849500154
sim_render-ego_max	0.0700222528897799
sim_render-ego_mean	0.0644182025653373
sim_render-ego_median	0.06384538082366294
sim_render-ego_min	0.06071297745955618
simulation-passed	1
survival_time_max	4.549999999999992
survival_time_mean	2.839999999999997
survival_time_min	1.3000000000000005

No reset possible

18414

2564

challenge-aido_LF-template-ros - Template solution using ROS

step1-simulation

success

2019-04-19 14:17:32+00:00

2019-04-19 14:27:15+00:00

0:09:43

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.5487132829419987
survival_time_median	2.3499999999999996
deviation-center-line_median	0.11041400208354252
in-drivable-lane_median	0

other stats

agent_compute-ego_max	0.06995007624992958
agent_compute-ego_mean	0.0674721794887832
agent_compute-ego_median	0.06736362234075019
agent_compute-ego_min	0.06512700332390083
deviation-center-line_max	0.1279102488429998
deviation-center-line_mean	0.10518151035257096
deviation-center-line_min	0.06917270915638028
deviation-heading_max	0.4712184191829178
deviation-heading_mean	0.3828337640550057
deviation-heading_median	0.36368201628851926
deviation-heading_min	0.3257229985354382
driven_any_max	1.259664216011687
driven_any_mean	0.7702827269903464
driven_any_median	0.6642785413159032
driven_any_min	0.3059207793076613
driven_lanedir_consec_max	0.9402632878459154
driven_lanedir_consec_mean	0.588039443394122
driven_lanedir_consec_min	0.28022225990343186
driven_lanedir_max	0.9402632878459154
driven_lanedir_mean	0.588039443394122
driven_lanedir_median	0.5487132829419987
driven_lanedir_min	0.28022225990343186
in-drivable-lane_max	1.8499999999999936
in-drivable-lane_mean	0.559999999999998
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0590446751809168, "sim_physics": 0.027538878161732745, "survival_time": 4.099999999999993, "driven_lanedir": 0.5205812780744896, "sim_render-ego": 0.06501954939307236, "in-drivable-lane": 1.8499999999999936, "agent_compute-ego": 0.06721019744873047, "deviation-heading": 0.4069710981449338, "set_robot_commands": 0.07679833435430759, "deviation-center-line": 0.105230017637756, "driven_lanedir_consec": 0.5205812780744896, "sim_compute_sim_state": 0.03478515148162842, "sim_compute_performance-ego": 0.06366923669489419, "sim_compute_robot_state-ego": 0.06365243400015481, "sim_compute_robot_state-npc0": 0.07043935322180027, "sim_compute_robot_state-npc1": 0.06483913049465273, "sim_compute_robot_state-npc2": 0.06271144529668296, "sim_compute_robot_state-npc3": 0.06331001839986662}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.3059207793076613, "sim_physics": 0.027141543535085823, "survival_time": 1.3000000000000005, "driven_lanedir": 0.28022225990343186, "sim_render-ego": 0.0673614556972797, "in-drivable-lane": 0, "agent_compute-ego": 0.06995007624992958, "deviation-heading": 0.36368201628851926, "set_robot_commands": 0.07722409871908334, "deviation-center-line": 0.06917270915638028, "driven_lanedir_consec": 0.28022225990343186, "sim_compute_sim_state": 0.03522022870870737, "sim_compute_performance-ego": 0.06284169967357929, "sim_compute_robot_state-ego": 0.061538787988516, "sim_compute_robot_state-npc0": 0.06998232694772574, "sim_compute_robot_state-npc1": 0.0643153924208421, "sim_compute_robot_state-npc2": 0.06437525382408729, "sim_compute_robot_state-npc3": 0.06573647719163161}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.6642785413159032, "sim_physics": 0.027460458430838077, "survival_time": 2.3499999999999996, "driven_lanedir": 0.6504171082047745, "sim_render-ego": 0.06823179062376632, "in-drivable-lane": 0, "agent_compute-ego": 0.06736362234075019, "deviation-heading": 0.34657428812321933, "set_robot_commands": 0.07854346518820905, "deviation-center-line": 0.1279102488429998, "driven_lanedir_consec": 0.6504171082047745, "sim_compute_sim_state": 0.03765443538097625, "sim_compute_performance-ego": 0.06530446701861442, "sim_compute_robot_state-ego": 0.0647486778015786, "sim_compute_robot_state-npc0": 0.07235659436976656, "sim_compute_robot_state-npc1": 0.0659157063098664, "sim_compute_robot_state-npc2": 0.06428068242174514, "sim_compute_robot_state-npc3": 0.06561036820107317}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.259664216011687, "sim_physics": 0.0248368651002318, "survival_time": 4.549999999999992, "driven_lanedir": 0.9402632878459154, "sim_render-ego": 0.06398231904585283, "in-drivable-lane": 0.9499999999999966, "agent_compute-ego": 0.06512700332390083, "deviation-heading": 0.4712184191829178, "set_robot_commands": 0.075254731125884, "deviation-center-line": 0.1131805740421762, "driven_lanedir_consec": 0.9402632878459154, "sim_compute_sim_state": 0.03476135023347624, "sim_compute_performance-ego": 0.06429874504005516, "sim_compute_robot_state-ego": 0.05996407257331597, "sim_compute_robot_state-npc0": 0.07010828269706977, "sim_compute_robot_state-npc1": 0.06513580123146812, "sim_compute_robot_state-npc2": 0.06398030951782897, "sim_compute_robot_state-npc3": 0.06215008798536364}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.5625054231355635, "sim_physics": 0.02483831581316496, "survival_time": 1.900000000000001, "driven_lanedir": 0.5487132829419987, "sim_render-ego": 0.06242319784666363, "in-drivable-lane": 0, "agent_compute-ego": 0.06770999808060496, "deviation-heading": 0.3257229985354382, "set_robot_commands": 0.07983133039976421, "deviation-center-line": 0.11041400208354252, "driven_lanedir_consec": 0.5487132829419987, "sim_compute_sim_state": 0.03786177384225946, "sim_compute_performance-ego": 0.06667492264195492, "sim_compute_robot_state-ego": 0.06441047944520649, "sim_compute_robot_state-npc0": 0.06655231902473852, "sim_compute_robot_state-npc1": 0.0670567374480398, "sim_compute_robot_state-npc2": 0.06458024602187307, "sim_compute_robot_state-npc3": 0.06836391122717607}}
set_robot_commands_max	0.07983133039976421
set_robot_commands_mean	0.07753039195744962
set_robot_commands_median	0.07722409871908334
set_robot_commands_min	0.075254731125884
sim_compute_performance-ego_max	0.06667492264195492
sim_compute_performance-ego_mean	0.06455781421381959
sim_compute_performance-ego_median	0.06429874504005516
sim_compute_performance-ego_min	0.06284169967357929
sim_compute_robot_state-ego_max	0.0647486778015786
sim_compute_robot_state-ego_mean	0.06286289036175438
sim_compute_robot_state-ego_median	0.06365243400015481
sim_compute_robot_state-ego_min	0.05996407257331597
sim_compute_robot_state-npc0_max	0.07235659436976656
sim_compute_robot_state-npc0_mean	0.06988777525222016
sim_compute_robot_state-npc0_median	0.07010828269706977
sim_compute_robot_state-npc0_min	0.06655231902473852
sim_compute_robot_state-npc1_max	0.0670567374480398
sim_compute_robot_state-npc1_mean	0.06545255358097382
sim_compute_robot_state-npc1_median	0.06513580123146812
sim_compute_robot_state-npc1_min	0.0643153924208421
sim_compute_robot_state-npc2_max	0.06458024602187307
sim_compute_robot_state-npc2_mean	0.06398558741644349
sim_compute_robot_state-npc2_median	0.06428068242174514
sim_compute_robot_state-npc2_min	0.06271144529668296
sim_compute_robot_state-npc3_max	0.06836391122717607
sim_compute_robot_state-npc3_mean	0.06503417260102222
sim_compute_robot_state-npc3_median	0.06561036820107317
sim_compute_robot_state-npc3_min	0.06215008798536364
sim_compute_sim_state_max	0.03786177384225946
sim_compute_sim_state_mean	0.03605658792940954
sim_compute_sim_state_median	0.03522022870870737
sim_compute_sim_state_min	0.03476135023347624
sim_physics_max	0.027538878161732745
sim_physics_mean	0.02636321220821068
sim_physics_median	0.027141543535085823
sim_physics_min	0.0248368651002318
sim_render-ego_max	0.06823179062376632
sim_render-ego_mean	0.06540366252132697
sim_render-ego_median	0.06501954939307236
sim_render-ego_min	0.06242319784666363
simulation-passed	1
survival_time_max	4.549999999999992
survival_time_mean	2.839999999999997
survival_time_min	1.3000000000000005

No reset possible

18396

2594

Julian Zilly

baseline-IL-logs-tensorflow

step1-simulation

success

2019-04-19 14:00:16+00:00

2019-04-19 14:16:47+00:00

0:16:31

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.23795404663004316
survival_time_median	5.14999999999999
deviation-center-line_median	0.2606035373920279
in-drivable-lane_median	0

other stats

agent_compute-ego_max	0.18880690603840108
agent_compute-ego_mean	0.18513635862050404
agent_compute-ego_median	0.18427317188336295
agent_compute-ego_min	0.1803991313164051
deviation-center-line_max	0.281392875860773
deviation-center-line_mean	0.2610933720545472
deviation-center-line_min	0.23801467613375468
deviation-heading_max	2.136897908810123
deviation-heading_mean	2.0259919415712746
deviation-heading_median	2.0202847697086748
deviation-heading_min	1.9558421862562307
driven_any_max	0.283253695334737
driven_any_mean	0.2771323820874597
driven_any_median	0.2759999584097152
driven_any_min	0.2738122136867922
driven_lanedir_consec_max	0.2471347206730008
driven_lanedir_consec_mean	0.23935978142791856
driven_lanedir_consec_min	0.2337769336466484
driven_lanedir_max	0.2471347206730008
driven_lanedir_mean	0.23935978142791856
driven_lanedir_median	0.23795404663004316
driven_lanedir_min	0.2337769336466484
in-drivable-lane_max	0
in-drivable-lane_mean	0
in-drivable-lane_min	0
per-episodes	details {"udem1-0-0": {"driven_any": 0.27478855644706024, "sim_physics": 0.03035999804126973, "survival_time": 4.899999999999991, "driven_lanedir": 0.23757223231190672, "sim_render-ego": 0.06146557720340028, "in-drivable-lane": 0, "agent_compute-ego": 0.18880690603840108, "deviation-heading": 1.9558421862562307, "set_robot_commands": 0.07735551863300558, "deviation-center-line": 0.2606035373920279, "driven_lanedir_consec": 0.23757223231190672, "sim_compute_sim_state": 0.03432815658802889, "sim_compute_performance-ego": 0.05931834298737195, "sim_compute_robot_state-ego": 0.061257016902067224, "sim_compute_robot_state-npc0": 0.0677927270227549, "sim_compute_robot_state-npc1": 0.06154870013801419, "sim_compute_robot_state-npc2": 0.059775673613256336, "sim_compute_robot_state-npc3": 0.0621236903326852}, "udem1-1-0": {"driven_any": 0.2778074865589939, "sim_physics": 0.02902819560124324, "survival_time": 5.1999999999999895, "driven_lanedir": 0.2403609738779937, "sim_render-ego": 0.06176637227718647, "in-drivable-lane": 0, "agent_compute-ego": 0.18427317188336295, "deviation-heading": 1.9563549339869988, "set_robot_commands": 0.07499222801281856, "deviation-center-line": 0.23801467613375468, "driven_lanedir_consec": 0.2403609738779937, "sim_compute_sim_state": 0.03404262661933899, "sim_compute_performance-ego": 0.059432813754448525, "sim_compute_robot_state-ego": 0.05906195594714238, "sim_compute_robot_state-npc0": 0.06719622015953064, "sim_compute_robot_state-npc1": 0.062298556933036216, "sim_compute_robot_state-npc2": 0.06180468889383169, "sim_compute_robot_state-npc3": 0.061237383347291216}, "udem1-2-0": {"driven_any": 0.2759999584097152, "sim_physics": 0.030730041485388306, "survival_time": 5.14999999999999, "driven_lanedir": 0.23795404663004316, "sim_render-ego": 0.0594418488659905, "in-drivable-lane": 0, "agent_compute-ego": 0.1834277620593321, "deviation-heading": 2.136897908810123, "set_robot_commands": 0.07246153794446038, "deviation-center-line": 0.281392875860773, "driven_lanedir_consec": 0.23795404663004316, "sim_compute_sim_state": 0.03234374407425668, "sim_compute_performance-ego": 0.05831944826737191, "sim_compute_robot_state-ego": 0.05866399320583899, "sim_compute_robot_state-npc0": 0.06507879784963663, "sim_compute_robot_state-npc1": 0.06020337169610181, "sim_compute_robot_state-npc2": 0.05889979149531392, "sim_compute_robot_state-npc3": 0.05893558900333145}, "udem1-3-0": {"driven_any": 0.2738122136867922, "sim_physics": 0.031442078260275036, "survival_time": 5.1999999999999895, "driven_lanedir": 0.2337769336466484, "sim_render-ego": 0.06088582139748793, "in-drivable-lane": 0, "agent_compute-ego": 0.1803991313164051, "deviation-heading": 2.060579909094345, "set_robot_commands": 0.07297825813293457, "deviation-center-line": 0.24516592837726828, "driven_lanedir_consec": 0.2337769336466484, "sim_compute_sim_state": 0.03428735412084139, "sim_compute_performance-ego": 0.05917245608109694, "sim_compute_robot_state-ego": 0.0590012761262747, "sim_compute_robot_state-npc0": 0.06503119835486779, "sim_compute_robot_state-npc1": 0.06068505919896639, "sim_compute_robot_state-npc2": 0.05867388844490051, "sim_compute_robot_state-npc3": 0.05976755802447979}, "udem1-4-0": {"driven_any": 0.283253695334737, "sim_physics": 0.02927851209453508, "survival_time": 5.09999999999999, "driven_lanedir": 0.2471347206730008, "sim_render-ego": 0.06478584513944738, "in-drivable-lane": 0, "agent_compute-ego": 0.188774821805019, "deviation-heading": 2.0202847697086748, "set_robot_commands": 0.07457143886416566, "deviation-center-line": 0.2802898425089119, "driven_lanedir_consec": 0.2471347206730008, "sim_compute_sim_state": 0.03522327366997214, "sim_compute_performance-ego": 0.06003686727262011, "sim_compute_robot_state-ego": 0.06031425326478248, "sim_compute_robot_state-npc0": 0.07094194608576157, "sim_compute_robot_state-npc1": 0.06273229215659347, "sim_compute_robot_state-npc2": 0.06197078321494308, "sim_compute_robot_state-npc3": 0.061504090533537024}}
set_robot_commands_max	0.07735551863300558
set_robot_commands_mean	0.07447179631747694
set_robot_commands_median	0.07457143886416566
set_robot_commands_min	0.07246153794446038
sim_compute_performance-ego_max	0.06003686727262011
sim_compute_performance-ego_mean	0.05925598567258189
sim_compute_performance-ego_median	0.05931834298737195
sim_compute_performance-ego_min	0.05831944826737191
sim_compute_robot_state-ego_max	0.061257016902067224
sim_compute_robot_state-ego_mean	0.059659699089221155
sim_compute_robot_state-ego_median	0.05906195594714238
sim_compute_robot_state-ego_min	0.05866399320583899
sim_compute_robot_state-npc0_max	0.07094194608576157
sim_compute_robot_state-npc0_mean	0.06720817789451031
sim_compute_robot_state-npc0_median	0.06719622015953064
sim_compute_robot_state-npc0_min	0.06503119835486779
sim_compute_robot_state-npc1_max	0.06273229215659347
sim_compute_robot_state-npc1_mean	0.06149359602454242
sim_compute_robot_state-npc1_median	0.06154870013801419
sim_compute_robot_state-npc1_min	0.06020337169610181
sim_compute_robot_state-npc2_max	0.06197078321494308
sim_compute_robot_state-npc2_mean	0.06022496513244911
sim_compute_robot_state-npc2_median	0.059775673613256336
sim_compute_robot_state-npc2_min	0.05867388844490051
sim_compute_robot_state-npc3_max	0.0621236903326852
sim_compute_robot_state-npc3_mean	0.06071366224826493
sim_compute_robot_state-npc3_median	0.061237383347291216
sim_compute_robot_state-npc3_min	0.05893558900333145
sim_compute_sim_state_max	0.03522327366997214
sim_compute_sim_state_mean	0.034045031014487616
sim_compute_sim_state_median	0.03428735412084139
sim_compute_sim_state_min	0.03234374407425668
sim_physics_max	0.031442078260275036
sim_physics_mean	0.030167765096542277
sim_physics_median	0.03035999804126973
sim_physics_min	0.02902819560124324
sim_render-ego_max	0.06478584513944738
sim_render-ego_mean	0.06166909297670251
sim_render-ego_median	0.06146557720340028
sim_render-ego_min	0.0594418488659905
simulation-passed	1
survival_time_max	5.1999999999999895
survival_time_mean	5.1099999999999905
survival_time_min	4.899999999999991

No reset possible

18383

2612

Konstantin Chaika

challenge-aido_LF-template-ros - Template solution using ROS

step1-simulation

success

2019-04-19 13:50:12+00:00

2019-04-19 14:00:02+00:00

0:09:50

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.6013276121655571
survival_time_median	2.2
deviation-center-line_median	0.11994879786730762
in-drivable-lane_median	0.09999999999999964

other stats

agent_compute-ego_max	0.06979201969347502
agent_compute-ego_mean	0.0670751483164446
agent_compute-ego_median	0.06655078056531075
agent_compute-ego_min	0.06518798814692968
deviation-center-line_max	0.31602167939174997
deviation-center-line_mean	0.15029477661273552
deviation-center-line_min	0.08465176242372947
deviation-heading_max	1.298091820230251
deviation-heading_mean	0.5590872679348118
deviation-heading_median	0.39186075366845463
deviation-heading_min	0.29133071980288444
driven_any_max	1.2345099137442228
driven_any_mean	0.7773148514182241
driven_any_median	0.6489566174251553
driven_any_min	0.47625793140583145
driven_lanedir_consec_max	0.923268763707114
driven_lanedir_consec_mean	0.634114415404596
driven_lanedir_consec_min	0.4596280139000144
driven_lanedir_max	0.923268763707114
driven_lanedir_mean	0.6342515685671332
driven_lanedir_median	0.6013276121655571
driven_lanedir_min	0.4596280139000144
in-drivable-lane_max	0.9499999999999966
in-drivable-lane_mean	0.3599999999999987
in-drivable-lane_min	0
per-episodes	details {"udem1-0-0": {"driven_any": 1.2345099137442228, "sim_physics": 0.03206267356872559, "survival_time": 4.749999999999991, "driven_lanedir": 0.923268763707114, "sim_render-ego": 0.06740899838899311, "in-drivable-lane": 0.7499999999999973, "agent_compute-ego": 0.06732126035188374, "deviation-heading": 1.298091820230251, "set_robot_commands": 0.07834799415186831, "deviation-center-line": 0.31602167939174997, "driven_lanedir_consec": 0.923268763707114, "sim_compute_sim_state": 0.03865264340450889, "sim_compute_performance-ego": 0.06551291064212197, "sim_compute_robot_state-ego": 0.06403616855019018, "sim_compute_robot_state-npc0": 0.0721824194255628, "sim_compute_robot_state-npc1": 0.06827866152713173, "sim_compute_robot_state-npc2": 0.06756810891000849, "sim_compute_robot_state-npc3": 0.06798835302654066}, "udem1-1-0": {"driven_any": 0.5114621661231735, "sim_physics": 0.02905835603412829, "survival_time": 1.900000000000001, "driven_lanedir": 0.49928522044265344, "sim_render-ego": 0.06514924450924522, "in-drivable-lane": 0, "agent_compute-ego": 0.06979201969347502, "deviation-heading": 0.29133071980288444, "set_robot_commands": 0.07865319753948011, "deviation-center-line": 0.08465176242372947, "driven_lanedir_consec": 0.49928522044265344, "sim_compute_sim_state": 0.038829533677352104, "sim_compute_performance-ego": 0.06734537450890792, "sim_compute_robot_state-ego": 0.06426247170096949, "sim_compute_robot_state-npc0": 0.07356016259444387, "sim_compute_robot_state-npc1": 0.06652283041100752, "sim_compute_robot_state-npc2": 0.06703290813847591, "sim_compute_robot_state-npc3": 0.06500177634389777}, "udem1-2-0": {"driven_any": 0.47625793140583145, "sim_physics": 0.03014765641628167, "survival_time": 1.950000000000001, "driven_lanedir": 0.4596280139000144, "sim_render-ego": 0.06501384270496857, "in-drivable-lane": 0, "agent_compute-ego": 0.06655078056531075, "deviation-heading": 0.39186075366845463, "set_robot_commands": 0.07280373573303223, "deviation-center-line": 0.10378004828632456, "driven_lanedir_consec": 0.4596280139000144, "sim_compute_sim_state": 0.03608314196268717, "sim_compute_performance-ego": 0.06354783742855756, "sim_compute_robot_state-ego": 0.06220620717757787, "sim_compute_robot_state-npc0": 0.07003816580161071, "sim_compute_robot_state-npc1": 0.06494901119134365, "sim_compute_robot_state-npc2": 0.06321419202364408, "sim_compute_robot_state-npc3": 0.06472434753026718}, "udem1-3-0": {"driven_any": 1.0153876283927372, "sim_physics": 0.03166109743252606, "survival_time": 3.5499999999999954, "driven_lanedir": 0.6877482326203274, "sim_render-ego": 0.06503277765193456, "in-drivable-lane": 0.9499999999999966, "agent_compute-ego": 0.06518798814692968, "deviation-heading": 0.47721720082170194, "set_robot_commands": 0.07475601451497682, "deviation-center-line": 0.11994879786730762, "driven_lanedir_consec": 0.6870624668076413, "sim_compute_sim_state": 0.035900455125620664, "sim_compute_performance-ego": 0.06291982153771629, "sim_compute_robot_state-ego": 0.06127477028000523, "sim_compute_robot_state-npc0": 0.07156877450540032, "sim_compute_robot_state-npc1": 0.067022249732219, "sim_compute_robot_state-npc2": 0.0663341031947606, "sim_compute_robot_state-npc3": 0.06476302549872599}, "udem1-4-0": {"driven_any": 0.6489566174251553, "sim_physics": 0.02870749885385687, "survival_time": 2.2, "driven_lanedir": 0.6013276121655571, "sim_render-ego": 0.06857559355822476, "in-drivable-lane": 0.09999999999999964, "agent_compute-ego": 0.0665236928246238, "deviation-heading": 0.3369358451507671, "set_robot_commands": 0.07480680400674994, "deviation-center-line": 0.12707159509456606, "driven_lanedir_consec": 0.6013276121655571, "sim_compute_sim_state": 0.03779823671687733, "sim_compute_performance-ego": 0.06612097133289684, "sim_compute_robot_state-ego": 0.06274685534563931, "sim_compute_robot_state-npc0": 0.0698499083518982, "sim_compute_robot_state-npc1": 0.06936921314759688, "sim_compute_robot_state-npc2": 0.06946123730052602, "sim_compute_robot_state-npc3": 0.06743748079646718}}
set_robot_commands_max	0.07865319753948011
set_robot_commands_mean	0.07587354918922148
set_robot_commands_median	0.07480680400674994
set_robot_commands_min	0.07280373573303223
sim_compute_performance-ego_max	0.06734537450890792
sim_compute_performance-ego_mean	0.06508938309004011
sim_compute_performance-ego_median	0.06551291064212197
sim_compute_performance-ego_min	0.06291982153771629
sim_compute_robot_state-ego_max	0.06426247170096949
sim_compute_robot_state-ego_mean	0.06290529461087642
sim_compute_robot_state-ego_median	0.06274685534563931
sim_compute_robot_state-ego_min	0.06127477028000523
sim_compute_robot_state-npc0_max	0.07356016259444387
sim_compute_robot_state-npc0_mean	0.07143988613578318
sim_compute_robot_state-npc0_median	0.07156877450540032
sim_compute_robot_state-npc0_min	0.0698499083518982
sim_compute_robot_state-npc1_max	0.06936921314759688
sim_compute_robot_state-npc1_mean	0.06722839320185975
sim_compute_robot_state-npc1_median	0.067022249732219
sim_compute_robot_state-npc1_min	0.06494901119134365
sim_compute_robot_state-npc2_max	0.06946123730052602
sim_compute_robot_state-npc2_mean	0.06672210991348301
sim_compute_robot_state-npc2_median	0.06703290813847591
sim_compute_robot_state-npc2_min	0.06321419202364408
sim_compute_robot_state-npc3_max	0.06798835302654066
sim_compute_robot_state-npc3_mean	0.06598299663917975
sim_compute_robot_state-npc3_median	0.06500177634389777
sim_compute_robot_state-npc3_min	0.06472434753026718
sim_compute_sim_state_max	0.038829533677352104
sim_compute_sim_state_mean	0.037452802177409227
sim_compute_sim_state_median	0.03779823671687733
sim_compute_sim_state_min	0.035900455125620664
sim_physics_max	0.03206267356872559
sim_physics_mean	0.030327456461103696
sim_physics_median	0.03014765641628167
sim_physics_min	0.02870749885385687
sim_render-ego_max	0.06857559355822476
sim_render-ego_mean	0.06623609136267325
sim_render-ego_median	0.06514924450924522
sim_render-ego_min	0.06501384270496857
simulation-passed	1
survival_time_max	4.749999999999991
survival_time_mean	2.8699999999999983
survival_time_min	1.900000000000001

No reset possible

18372

2633

Andrea Censi 🇨🇭

challenge-aido_LF-template-random

step1-simulation

success

2019-04-19 13:40:29+00:00

2019-04-19 13:49:42+00:00

0:09:13

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.9097625228344608
survival_time_median	2.3999999999999995
deviation-center-line_median	0.09850417100304978
in-drivable-lane_median	0

other stats

agent_compute-ego_max	0.14976226932862224
agent_compute-ego_mean	0.1442080439089069
agent_compute-ego_median	0.14698432286580404
agent_compute-ego_min	0.13453328384543364
deviation-center-line_max	0.13882443387861454
deviation-center-line_mean	0.10656223356403702
deviation-center-line_min	0.07952733817751276
deviation-heading_max	0.26115230540596424
deviation-heading_mean	0.23093022559873316
deviation-heading_median	0.23417405060778035
deviation-heading_min	0.1984807025035913
driven_any_max	1.4367438864906794
driven_any_mean	1.0309070915612302
driven_any_median	0.9157141892899948
driven_any_min	0.8462726558162903
driven_lanedir_consec_max	0.9542194653539162
driven_lanedir_consec_mean	0.8288426551719738
driven_lanedir_consec_min	0.5348503251906886
driven_lanedir_max	0.9542194653539162
driven_lanedir_mean	0.8288426551719738
driven_lanedir_median	0.9097625228344608
driven_lanedir_min	0.5348503251906886
in-drivable-lane_max	1.099999999999998
in-drivable-lane_mean	0.4199999999999989
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0405624261079018, "sim_physics": 0.023403059761479217, "survival_time": 2.6499999999999986, "driven_lanedir": 0.5348503251906886, "sim_render-ego": 0.05841221899356482, "in-drivable-lane": 1.099999999999998, "agent_compute-ego": 0.13453328384543364, "deviation-heading": 0.24579559783100224, "set_robot_commands": 0.07449702046952157, "deviation-center-line": 0.07952733817751276, "driven_lanedir_consec": 0.5348503251906886, "sim_compute_sim_state": 0.032304624341568854, "sim_compute_performance-ego": 0.05970725473367943, "sim_compute_robot_state-ego": 0.05985953223030522, "sim_compute_robot_state-npc0": 0.06324851737832124, "sim_compute_robot_state-npc1": 0.06096129147511608, "sim_compute_robot_state-npc2": 0.0613542007950117, "sim_compute_robot_state-npc3": 0.06025030927838019}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.8462726558162903, "sim_physics": 0.025281765244223858, "survival_time": 2.2, "driven_lanedir": 0.8350786826190175, "sim_render-ego": 0.06155372749675403, "in-drivable-lane": 0, "agent_compute-ego": 0.14064147797497836, "deviation-heading": 0.23417405060778035, "set_robot_commands": 0.07843495499004018, "deviation-center-line": 0.09491150723296102, "driven_lanedir_consec": 0.8350786826190175, "sim_compute_sim_state": 0.03463977033441717, "sim_compute_performance-ego": 0.06417047435587103, "sim_compute_robot_state-ego": 0.06552326679229736, "sim_compute_robot_state-npc0": 0.07140357385982167, "sim_compute_robot_state-npc1": 0.06442554972388527, "sim_compute_robot_state-npc2": 0.06342228976162997, "sim_compute_robot_state-npc3": 0.06373090093786066}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.9152423001012856, "sim_physics": 0.024870517518785263, "survival_time": 2.25, "driven_lanedir": 0.9097625228344608, "sim_render-ego": 0.06383079952663845, "in-drivable-lane": 0, "agent_compute-ego": 0.14698432286580404, "deviation-heading": 0.1984807025035913, "set_robot_commands": 0.07699254353841146, "deviation-center-line": 0.12104371752804705, "driven_lanedir_consec": 0.9097625228344608, "sim_compute_sim_state": 0.035516648822360566, "sim_compute_performance-ego": 0.06443791389465332, "sim_compute_robot_state-ego": 0.06728428734673395, "sim_compute_robot_state-npc0": 0.07269156244066026, "sim_compute_robot_state-npc1": 0.06869064966837565, "sim_compute_robot_state-npc2": 0.06696831915113662, "sim_compute_robot_state-npc3": 0.0660081598493788}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.9157141892899948, "sim_physics": 0.025914266705513, "survival_time": 2.3999999999999995, "driven_lanedir": 0.910302279861786, "sim_render-ego": 0.06493620077768962, "in-drivable-lane": 0, "agent_compute-ego": 0.14911886552969614, "deviation-heading": 0.2150484716453277, "set_robot_commands": 0.07699903349081676, "deviation-center-line": 0.13882443387861454, "driven_lanedir_consec": 0.910302279861786, "sim_compute_sim_state": 0.03669876356919607, "sim_compute_performance-ego": 0.06511519849300385, "sim_compute_robot_state-ego": 0.06417083243529002, "sim_compute_robot_state-npc0": 0.0731264998515447, "sim_compute_robot_state-npc1": 0.067579319079717, "sim_compute_robot_state-npc2": 0.066117063164711, "sim_compute_robot_state-npc3": 0.0659509797890981}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.4367438864906794, "sim_physics": 0.02620144100750194, "survival_time": 3.399999999999996, "driven_lanedir": 0.9542194653539162, "sim_render-ego": 0.06413500799852259, "in-drivable-lane": 0.9999999999999964, "agent_compute-ego": 0.14976226932862224, "deviation-heading": 0.26115230540596424, "set_robot_commands": 0.07718064504511216, "deviation-center-line": 0.09850417100304978, "driven_lanedir_consec": 0.9542194653539162, "sim_compute_sim_state": 0.03545918534783756, "sim_compute_performance-ego": 0.06365077986436732, "sim_compute_robot_state-ego": 0.06210393765393425, "sim_compute_robot_state-npc0": 0.07007145180421717, "sim_compute_robot_state-npc1": 0.06656809764749863, "sim_compute_robot_state-npc2": 0.0631223531330333, "sim_compute_robot_state-npc3": 0.06554226664935842}}
set_robot_commands_max	0.07843495499004018
set_robot_commands_mean	0.07682083950678043
set_robot_commands_median	0.07699903349081676
set_robot_commands_min	0.07449702046952157
sim_compute_performance-ego_max	0.06511519849300385
sim_compute_performance-ego_mean	0.06341632426831498
sim_compute_performance-ego_median	0.06417047435587103
sim_compute_performance-ego_min	0.05970725473367943
sim_compute_robot_state-ego_max	0.06728428734673395
sim_compute_robot_state-ego_mean	0.06378837129171215
sim_compute_robot_state-ego_median	0.06417083243529002
sim_compute_robot_state-ego_min	0.05985953223030522
sim_compute_robot_state-npc0_max	0.0731264998515447
sim_compute_robot_state-npc0_mean	0.070108321066913
sim_compute_robot_state-npc0_median	0.07140357385982167
sim_compute_robot_state-npc0_min	0.06324851737832124
sim_compute_robot_state-npc1_max	0.06869064966837565
sim_compute_robot_state-npc1_mean	0.06564498151891854
sim_compute_robot_state-npc1_median	0.06656809764749863
sim_compute_robot_state-npc1_min	0.06096129147511608
sim_compute_robot_state-npc2_max	0.06696831915113662
sim_compute_robot_state-npc2_mean	0.06419684520110451
sim_compute_robot_state-npc2_median	0.06342228976162997
sim_compute_robot_state-npc2_min	0.0613542007950117
sim_compute_robot_state-npc3_max	0.0660081598493788
sim_compute_robot_state-npc3_mean	0.06429652330081523
sim_compute_robot_state-npc3_median	0.06554226664935842
sim_compute_robot_state-npc3_min	0.06025030927838019
sim_compute_sim_state_max	0.03669876356919607
sim_compute_sim_state_mean	0.03492379848307604
sim_compute_sim_state_median	0.03545918534783756
sim_compute_sim_state_min	0.032304624341568854
sim_physics_max	0.02620144100750194
sim_physics_mean	0.025134210047500653
sim_physics_median	0.025281765244223858
sim_physics_min	0.023403059761479217
sim_render-ego_max	0.06493620077768962
sim_render-ego_mean	0.0625735909586339
sim_render-ego_median	0.06383079952663845
sim_render-ego_min	0.05841221899356482
simulation-passed	1
survival_time_max	3.399999999999996
survival_time_mean	2.579999999999999
survival_time_min	2.2

No reset possible

18363

2652

Egor Zamotaev

challenge-aido_LF-baseline-duckietown

step1-simulation

success

2019-04-19 13:24:32+00:00

2019-04-19 13:40:08+00:00

0:15:36

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.9481014306970988
survival_time_median	14.950000000000076
deviation-center-line_median	0.7998644509539837
in-drivable-lane_median	2.0500000000000167

other stats

agent_compute-ego_max	0.05874264796574911
agent_compute-ego_mean	0.05804969004428749
agent_compute-ego_median	0.05857336123784383
agent_compute-ego_min	0.056538280646006266
deviation-center-line_max	1.0574159920267403
deviation-center-line_mean	0.7878329076166682
deviation-center-line_min	0.2648923443285508
deviation-heading_max	6.802458557371375
deviation-heading_mean	3.6143725716931554
deviation-heading_median	2.286338330773966
deviation-heading_min	1.390173442337536
driven_any_max	2.3556271978330763
driven_any_mean	1.8534765717324853
driven_any_median	2.355103416804607
driven_any_min	0.7377228209216489
driven_lanedir_consec_max	1.4201789878830455
driven_lanedir_consec_mean	1.0330413376379166
driven_lanedir_consec_min	0.6682943473458369
driven_lanedir_max	1.701157798263192
driven_lanedir_mean	1.2938279331545826
driven_lanedir_median	1.4201789878830455
driven_lanedir_min	0.6682943473458369
in-drivable-lane_max	6.650000000000085
in-drivable-lane_mean	2.3000000000000225
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.7377228209216489, "sim_physics": 0.014799912770589192, "survival_time": 4.94999999999999, "driven_lanedir": 0.6682943473458369, "sim_render-ego": 0.05182435777452257, "in-drivable-lane": 0, "agent_compute-ego": 0.05864530621152936, "deviation-heading": 1.390173442337536, "set_robot_commands": 0.07204936008260708, "deviation-center-line": 0.2648923443285508, "driven_lanedir_consec": 0.6682943473458369, "sim_compute_sim_state": 0.031081368224789397, "sim_compute_performance-ego": 0.051531399139250166, "sim_compute_robot_state-ego": 0.05339795411235154}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 2.3556271978330763, "sim_physics": 0.01480651060740153, "survival_time": 14.950000000000076, "driven_lanedir": 1.2028314090072871, "sim_render-ego": 0.05149746735890706, "in-drivable-lane": 6.650000000000085, "agent_compute-ego": 0.056538280646006266, "deviation-heading": 2.286338330773966, "set_robot_commands": 0.06963385423024496, "deviation-center-line": 0.7608693951645964, "driven_lanedir_consec": 1.2028314090072871, "sim_compute_sim_state": 0.032838568687438965, "sim_compute_performance-ego": 0.05294549942016601, "sim_compute_robot_state-ego": 0.054797975222269694}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 2.355257403302285, "sim_physics": 0.01503800630569458, "survival_time": 14.950000000000076, "driven_lanedir": 1.701157798263192, "sim_render-ego": 0.05594383239746094, "in-drivable-lane": 2.0500000000000167, "agent_compute-ego": 0.05857336123784383, "deviation-heading": 5.771435676328997, "set_robot_commands": 0.07390017827351889, "deviation-center-line": 1.05612235560947, "driven_lanedir_consec": 0.9258005132563144, "sim_compute_sim_state": 0.035066989262898765, "sim_compute_performance-ego": 0.05709928830464681, "sim_compute_robot_state-ego": 0.05791183630625407}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.4636720198008086, "sim_physics": 0.015200306760503893, "survival_time": 9.4, "driven_lanedir": 1.4201789878830455, "sim_render-ego": 0.05327156122694624, "in-drivable-lane": 0, "agent_compute-ego": 0.05774885416030884, "deviation-heading": 1.8214568516539051, "set_robot_commands": 0.0707781251440657, "deviation-center-line": 0.7998644509539837, "driven_lanedir_consec": 1.4201789878830455, "sim_compute_sim_state": 0.033434027052940206, "sim_compute_performance-ego": 0.05367716703009098, "sim_compute_robot_state-ego": 0.05653626107155008}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 2.355103416804607, "sim_physics": 0.014517616430918376, "survival_time": 14.950000000000076, "driven_lanedir": 1.4766771232735514, "sim_render-ego": 0.05559752623240153, "in-drivable-lane": 2.8000000000000096, "agent_compute-ego": 0.05874264796574911, "deviation-heading": 6.802458557371375, "set_robot_commands": 0.07099444071451823, "deviation-center-line": 1.0574159920267403, "driven_lanedir_consec": 0.9481014306970988, "sim_compute_sim_state": 0.03555203119913737, "sim_compute_performance-ego": 0.05555499156316122, "sim_compute_robot_state-ego": 0.05820123751958211}}
set_robot_commands_max	0.07390017827351889
set_robot_commands_mean	0.07147119168899096
set_robot_commands_median	0.07099444071451823
set_robot_commands_min	0.06963385423024496
sim_compute_performance-ego_max	0.05709928830464681
sim_compute_performance-ego_mean	0.05416166909146304
sim_compute_performance-ego_median	0.05367716703009098
sim_compute_performance-ego_min	0.051531399139250166
sim_compute_robot_state-ego_max	0.05820123751958211
sim_compute_robot_state-ego_mean	0.0561690528464015
sim_compute_robot_state-ego_median	0.05653626107155008
sim_compute_robot_state-ego_min	0.05339795411235154
sim_compute_sim_state_max	0.03555203119913737
sim_compute_sim_state_mean	0.03359459688544094
sim_compute_sim_state_median	0.033434027052940206
sim_compute_sim_state_min	0.031081368224789397
sim_physics_max	0.015200306760503893
sim_physics_mean	0.014872470575021515
sim_physics_median	0.01480651060740153
sim_physics_min	0.014517616430918376
sim_render-ego_max	0.05594383239746094
sim_render-ego_mean	0.053626948998047666
sim_render-ego_median	0.05327156122694624
sim_render-ego_min	0.05149746735890706
simulation-passed	1
survival_time_max	14.950000000000076
survival_time_mean	11.840000000000046
survival_time_min	4.94999999999999

No reset possible

18344

2685

Rami Al-Naim 🇷🇺

challenge-aido_LF-baseline-duckietown

step1-simulation

success

2019-04-19 13:04:43+00:00

2019-04-19 13:23:51+00:00

0:19:08

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.4243494419434204
survival_time_median	3.7999999999999945
deviation-center-line_median	0.13613403195813212
in-drivable-lane_median	0

other stats

agent_compute-ego_max	0.05938277746501722
agent_compute-ego_mean	0.05809390345354466
agent_compute-ego_median	0.05768511030409071
agent_compute-ego_min	0.0570958948135376
deviation-center-line_max	1.1553069999551415
deviation-center-line_mean	0.5068136094707265
deviation-center-line_min	0.08331334360442348
deviation-heading_max	3.341466007194369
deviation-heading_mean	1.6193181870137956
deviation-heading_median	1.4485135646035086
deviation-heading_min	0.7061574036888227
driven_any_max	2.355673568543327
driven_any_mean	1.0388378439783277
driven_any_median	0.5635928618566513
driven_any_min	0.2422165366653391
driven_lanedir_consec_max	2.2640556184094844
driven_lanedir_consec_mean	0.9684684670827084
driven_lanedir_consec_min	0.19866767902641147
driven_lanedir_max	2.2654576125389996
driven_lanedir_mean	0.9692705669279686
driven_lanedir_median	0.4243494419434204
driven_lanedir_min	0.19866767902641147
in-drivable-lane_max	0.3999999999999986
in-drivable-lane_mean	0.07999999999999971
in-drivable-lane_min	0
per-episodes	details {"udem1-0-0": {"driven_any": 1.7904774681386713, "sim_physics": 0.024722316990727963, "survival_time": 11.500000000000028, "driven_lanedir": 1.7551611940547651, "sim_render-ego": 0.05246475468511167, "in-drivable-lane": 0, "agent_compute-ego": 0.057351787193961765, "deviation-heading": 1.870246619217332, "set_robot_commands": 0.07296857108240543, "deviation-center-line": 1.1553069999551415, "driven_lanedir_consec": 1.7525526889579794, "sim_compute_sim_state": 0.030754679182301396, "sim_compute_performance-ego": 0.053210207690363345, "sim_compute_robot_state-ego": 0.05423220447871996, "sim_compute_robot_state-npc0": 0.056640248713286025, "sim_compute_robot_state-npc1": 0.05505086339038352, "sim_compute_robot_state-npc2": 0.0552224003750345, "sim_compute_robot_state-npc3": 0.05444524910139001}, "udem1-1-0": {"driven_any": 0.2422165366653391, "sim_physics": 0.025357524553934738, "survival_time": 1.800000000000001, "driven_lanedir": 0.19866767902641147, "sim_render-ego": 0.0512198011080424, "in-drivable-lane": 0, "agent_compute-ego": 0.05768511030409071, "deviation-heading": 0.7302073403649447, "set_robot_commands": 0.06947874360614353, "deviation-center-line": 0.08490820708849992, "driven_lanedir_consec": 0.19866767902641147, "sim_compute_sim_state": 0.030544307496812608, "sim_compute_performance-ego": 0.05144654379950629, "sim_compute_robot_state-ego": 0.05374160077836779, "sim_compute_robot_state-npc0": 0.05506247282028198, "sim_compute_robot_state-npc1": 0.05337797933154636, "sim_compute_robot_state-npc2": 0.053101029660966664, "sim_compute_robot_state-npc3": 0.05513632297515869}, "udem1-2-0": {"driven_any": 0.5635928618566513, "sim_physics": 0.031060614083942617, "survival_time": 3.7999999999999945, "driven_lanedir": 0.4243494419434204, "sim_render-ego": 0.052653990293803965, "in-drivable-lane": 0.3999999999999986, "agent_compute-ego": 0.05938277746501722, "deviation-heading": 1.4485135646035086, "set_robot_commands": 0.07155965817602057, "deviation-center-line": 0.13613403195813212, "driven_lanedir_consec": 0.4243494419434204, "sim_compute_sim_state": 0.03092666048752634, "sim_compute_performance-ego": 0.05344905978754947, "sim_compute_robot_state-ego": 0.05371755675265664, "sim_compute_robot_state-npc0": 0.05801231610147577, "sim_compute_robot_state-npc1": 0.05539787756769281, "sim_compute_robot_state-npc2": 0.054690354748776086, "sim_compute_robot_state-npc3": 0.05501997470855713}, "udem1-3-0": {"driven_any": 0.24222878468764816, "sim_physics": 0.026186022493574355, "survival_time": 1.800000000000001, "driven_lanedir": 0.20271690707624648, "sim_render-ego": 0.052773515383402504, "in-drivable-lane": 0, "agent_compute-ego": 0.058953947491115995, "deviation-heading": 0.7061574036888227, "set_robot_commands": 0.0703487065103319, "deviation-center-line": 0.08331334360442348, "driven_lanedir_consec": 0.20271690707624648, "sim_compute_sim_state": 0.03419480721155802, "sim_compute_performance-ego": 0.05375517076916165, "sim_compute_robot_state-ego": 0.05546962552600437, "sim_compute_robot_state-npc0": 0.05429585774739584, "sim_compute_robot_state-npc1": 0.056202299065060086, "sim_compute_robot_state-npc2": 0.05399872197045221, "sim_compute_robot_state-npc3": 0.05387629403008355}, "udem1-4-0": {"driven_any": 2.355673568543327, "sim_physics": 0.025183730125427246, "survival_time": 14.950000000000076, "driven_lanedir": 2.2654576125389996, "sim_render-ego": 0.052557568550109866, "in-drivable-lane": 0, "agent_compute-ego": 0.0570958948135376, "deviation-heading": 3.341466007194369, "set_robot_commands": 0.07050618807474772, "deviation-center-line": 1.0744054647474357, "driven_lanedir_consec": 2.2640556184094844, "sim_compute_sim_state": 0.0305830717086792, "sim_compute_performance-ego": 0.054348662694295245, "sim_compute_robot_state-ego": 0.05559149344762166, "sim_compute_robot_state-npc0": 0.05857819716135661, "sim_compute_robot_state-npc1": 0.05471516291300456, "sim_compute_robot_state-npc2": 0.05390393018722534, "sim_compute_robot_state-npc3": 0.05418318669001261}}
set_robot_commands_max	0.07296857108240543
set_robot_commands_mean	0.07097237348992984
set_robot_commands_median	0.07050618807474772
set_robot_commands_min	0.06947874360614353
sim_compute_performance-ego_max	0.054348662694295245
sim_compute_performance-ego_mean	0.0532419289481752
sim_compute_performance-ego_median	0.05344905978754947
sim_compute_performance-ego_min	0.05144654379950629
sim_compute_robot_state-ego_max	0.05559149344762166
sim_compute_robot_state-ego_mean	0.05455049619667408
sim_compute_robot_state-ego_median	0.05423220447871996
sim_compute_robot_state-ego_min	0.05371755675265664
sim_compute_robot_state-npc0_max	0.05857819716135661
sim_compute_robot_state-npc0_mean	0.05651781850875924
sim_compute_robot_state-npc0_median	0.056640248713286025
sim_compute_robot_state-npc0_min	0.05429585774739584
sim_compute_robot_state-npc1_max	0.056202299065060086
sim_compute_robot_state-npc1_mean	0.054948836453537465
sim_compute_robot_state-npc1_median	0.05505086339038352
sim_compute_robot_state-npc1_min	0.05337797933154636
sim_compute_robot_state-npc2_max	0.0552224003750345
sim_compute_robot_state-npc2_mean	0.054183287388490965
sim_compute_robot_state-npc2_median	0.05399872197045221
sim_compute_robot_state-npc2_min	0.053101029660966664
sim_compute_robot_state-npc3_max	0.05513632297515869
sim_compute_robot_state-npc3_mean	0.0545322055010404
sim_compute_robot_state-npc3_median	0.05444524910139001
sim_compute_robot_state-npc3_min	0.05387629403008355
sim_compute_sim_state_max	0.03419480721155802
sim_compute_sim_state_mean	0.03140070521737551
sim_compute_sim_state_median	0.030754679182301396
sim_compute_sim_state_min	0.030544307496812608
sim_physics_max	0.031060614083942617
sim_physics_mean	0.026502041649521375
sim_physics_median	0.025357524553934738
sim_physics_min	0.024722316990727963
sim_render-ego_max	0.052773515383402504
sim_render-ego_mean	0.052333926004094075
sim_render-ego_median	0.052557568550109866
sim_render-ego_min	0.0512198011080424
simulation-passed	1
survival_time_max	14.950000000000076
survival_time_mean	6.77000000000002
survival_time_min	1.800000000000001

No reset possible

18330

2711

Rami Al-Naim 🇷🇺

challenge-aido_LF-baseline-duckietown

step1-simulation

success

2019-04-19 12:45:50+00:00

2019-04-19 13:04:19+00:00

0:18:29

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.31686452314728863
survival_time_median	5.1999999999999895
deviation-center-line_median	0.2134265533016553
in-drivable-lane_median	0.05000000000000005

other stats

agent_compute-ego_max	0.060972002836374134
agent_compute-ego_mean	0.05949952056367065
agent_compute-ego_median	0.0599822113845522
agent_compute-ego_min	0.05751866579055786
deviation-center-line_max	1.05579971268191
deviation-center-line_mean	0.3996799950043136
deviation-center-line_min	0.05721230895871599
deviation-heading_max	4.529144337057334
deviation-heading_mean	1.8771769118850463
deviation-heading_median	1.317500512459369
deviation-heading_min	0.6639146794102129
driven_any_max	2.3555815362548462
driven_any_mean	0.940770340540664
driven_any_median	0.7885885108610363
driven_any_min	0.20203032028042153
driven_lanedir_consec_max	1.12809584335053
driven_lanedir_consec_mean	0.5128177260895788
driven_lanedir_consec_min	0.14567081024551864
driven_lanedir_max	1.9985813365671663
driven_lanedir_mean	0.7534431874348162
driven_lanedir_median	0.3449745023985349
driven_lanedir_min	0.14567081024551864
in-drivable-lane_max	1.7499999999999938
in-drivable-lane_mean	0.5499999999999996
in-drivable-lane_min	0
per-episodes	details {"udem1-0-0": {"driven_any": 1.1556185522035838, "sim_physics": 0.027509525122231995, "survival_time": 7.549999999999981, "driven_lanedir": 1.1291717227672342, "sim_render-ego": 0.05761405490092095, "in-drivable-lane": 0, "agent_compute-ego": 0.0599822113845522, "deviation-heading": 1.317500512459369, "set_robot_commands": 0.07221605604058069, "deviation-center-line": 0.6133519553284255, "driven_lanedir_consec": 1.12809584335053, "sim_compute_sim_state": 0.03206204104897202, "sim_compute_performance-ego": 0.056995489739424345, "sim_compute_robot_state-ego": 0.05722573735066597, "sim_compute_robot_state-npc0": 0.06008568662681327, "sim_compute_robot_state-npc1": 0.05819379099157472, "sim_compute_robot_state-npc2": 0.05736200383167393, "sim_compute_robot_state-npc3": 0.05737253845922205}, "udem1-1-0": {"driven_any": 0.20203032028042153, "sim_physics": 0.02541586660569714, "survival_time": 1.5500000000000007, "driven_lanedir": 0.14567081024551864, "sim_render-ego": 0.05404460814691359, "in-drivable-lane": 0.05000000000000005, "agent_compute-ego": 0.05852039398685578, "deviation-heading": 0.6880271529466183, "set_robot_commands": 0.07421848850865517, "deviation-center-line": 0.058609444750861515, "driven_lanedir_consec": 0.14567081024551864, "sim_compute_sim_state": 0.03236512214906754, "sim_compute_performance-ego": 0.05390316440213111, "sim_compute_robot_state-ego": 0.05779169451805853, "sim_compute_robot_state-npc0": 0.05860430194485572, "sim_compute_robot_state-npc1": 0.05721081456830425, "sim_compute_robot_state-npc2": 0.05564918825703283, "sim_compute_robot_state-npc3": 0.05625961672875189}, "udem1-2-0": {"driven_any": 2.3555815362548462, "sim_physics": 0.026162304878234864, "survival_time": 14.950000000000076, "driven_lanedir": 1.9985813365671663, "sim_render-ego": 0.05513965209325155, "in-drivable-lane": 0.9000000000000039, "agent_compute-ego": 0.05751866579055786, "deviation-heading": 4.529144337057334, "set_robot_commands": 0.07169007698694865, "deviation-center-line": 1.05579971268191, "driven_lanedir_consec": 0.8246398885089298, "sim_compute_sim_state": 0.031037664413452147, "sim_compute_performance-ego": 0.05553327878316243, "sim_compute_robot_state-ego": 0.05628056049346924, "sim_compute_robot_state-npc0": 0.0595533561706543, "sim_compute_robot_state-npc1": 0.05613224267959595, "sim_compute_robot_state-npc2": 0.05697551409403483, "sim_compute_robot_state-npc3": 0.05556937138239543}, "udem1-3-0": {"driven_any": 0.20203278310343192, "sim_physics": 0.02655044678718813, "survival_time": 1.5500000000000007, "driven_lanedir": 0.14881756519562628, "sim_render-ego": 0.05651871619686004, "in-drivable-lane": 0.05000000000000005, "agent_compute-ego": 0.060504328820013234, "deviation-heading": 0.6639146794102129, "set_robot_commands": 0.07336775718196746, "deviation-center-line": 0.05721230895871599, "driven_lanedir_consec": 0.14881756519562628, "sim_compute_sim_state": 0.03378941935877646, "sim_compute_performance-ego": 0.05620512654704432, "sim_compute_robot_state-ego": 0.05895802282517956, "sim_compute_robot_state-npc0": 0.06412599163670693, "sim_compute_robot_state-npc1": 0.06173378421414283, "sim_compute_robot_state-npc2": 0.05628982667000063, "sim_compute_robot_state-npc3": 0.057561259115895914}, "udem1-4-0": {"driven_any": 0.7885885108610363, "sim_physics": 0.02888828057509202, "survival_time": 5.1999999999999895, "driven_lanedir": 0.3449745023985349, "sim_render-ego": 0.05581594888980572, "in-drivable-lane": 1.7499999999999938, "agent_compute-ego": 0.060972002836374134, "deviation-heading": 2.1872978775516985, "set_robot_commands": 0.07276791563400856, "deviation-center-line": 0.2134265533016553, "driven_lanedir_consec": 0.31686452314728863, "sim_compute_sim_state": 0.03206982750159044, "sim_compute_performance-ego": 0.05520508839533879, "sim_compute_robot_state-ego": 0.055989166864982017, "sim_compute_robot_state-npc0": 0.06269652568376981, "sim_compute_robot_state-npc1": 0.05792946769640995, "sim_compute_robot_state-npc2": 0.055920857649583086, "sim_compute_robot_state-npc3": 0.05681798549798819}}
set_robot_commands_max	0.07421848850865517
set_robot_commands_mean	0.07285205887043211
set_robot_commands_median	0.07276791563400856
set_robot_commands_min	0.07169007698694865
sim_compute_performance-ego_max	0.056995489739424345
sim_compute_performance-ego_mean	0.05556842957342019
sim_compute_performance-ego_median	0.05553327878316243
sim_compute_performance-ego_min	0.05390316440213111
sim_compute_robot_state-ego_max	0.05895802282517956
sim_compute_robot_state-ego_mean	0.05724903641047106
sim_compute_robot_state-ego_median	0.05722573735066597
sim_compute_robot_state-ego_min	0.055989166864982017
sim_compute_robot_state-npc0_max	0.06412599163670693
sim_compute_robot_state-npc0_mean	0.06101317241256
sim_compute_robot_state-npc0_median	0.06008568662681327
sim_compute_robot_state-npc0_min	0.05860430194485572
sim_compute_robot_state-npc1_max	0.06173378421414283
sim_compute_robot_state-npc1_mean	0.058240020030005536
sim_compute_robot_state-npc1_median	0.05792946769640995
sim_compute_robot_state-npc1_min	0.05613224267959595
sim_compute_robot_state-npc2_max	0.05736200383167393
sim_compute_robot_state-npc2_mean	0.056439478100465054
sim_compute_robot_state-npc2_median	0.05628982667000063
sim_compute_robot_state-npc2_min	0.05564918825703283
sim_compute_robot_state-npc3_max	0.057561259115895914
sim_compute_robot_state-npc3_mean	0.05671615423685069
sim_compute_robot_state-npc3_median	0.05681798549798819
sim_compute_robot_state-npc3_min	0.05556937138239543
sim_compute_sim_state_max	0.03378941935877646
sim_compute_sim_state_mean	0.032264814894371725
sim_compute_sim_state_median	0.03206982750159044
sim_compute_sim_state_min	0.031037664413452147
sim_physics_max	0.02888828057509202
sim_physics_mean	0.026905284793688828
sim_physics_median	0.02655044678718813
sim_physics_min	0.02541586660569714
sim_render-ego_max	0.05761405490092095
sim_render-ego_mean	0.05582659604555037
sim_render-ego_median	0.05581594888980572
sim_render-ego_min	0.05404460814691359
simulation-passed	1
survival_time_max	14.950000000000076
survival_time_mean	6.16000000000001
survival_time_min	1.5500000000000007

No reset possible

18321

2727

test for ppo

step1-simulation

error

2019-04-19 12:44:12+00:00

2019-04-19 12:45:09+00:00

0:00:57

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "experiment_manager.py", line 136, in main
    physics_dt=config.physics_dt)
  File "experiment_manager.py", line 301, in run_episode
    sim_ci.write_topic_and_expect_zero('set_robot_commands', commands)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 102, in write_topic_and_expect_zero
    nickname=self.nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 283, in read_until_over
    raise RemoteNodeAborted(m)
zuper_nodes.structures.RemoteNodeAborted: External node "simulator" aborted:

error in simulator |Exception while handling a message on topic "set_robot_commands".
                   |
                   || Traceback (most recent call last):
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 274, in loop
                   ||     handle_message_node(parsed, receiver0, context0)
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 428, in handle_message_node
                   ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/utils.py", line 18, in call_if_fun_exists
                   ||     f(**kwargs)
                   ||   File "gym_bridge.py", line 261, in on_received_set_robot_commands
                   ||     raise Exception(msg)
                   || Exception: Received invalid PWM commands. They should be between -1 and +1. Received left = {l}, right = {r}.
                   ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
    yield cie
  File "experiment_manager.py", line 435, in <module>
    wrap(cie)
  File "experiment_manager.py", line 423, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 186, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

 > Traceback (most recent call last):
 >   File "experiment_manager.py", line 136, in main
 >     physics_dt=config.physics_dt)
 >   File "experiment_manager.py", line 301, in run_episode
 >     sim_ci.write_topic_and_expect_zero('set_robot_commands', commands)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 102, in write_topic_and_expect_zero
 >     nickname=self.nickname)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
 >     others = read_until_over(fpout, timeout=timeout, nickname=nickname)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 283, in read_until_over
 >     raise RemoteNodeAborted(m)
 > zuper_nodes.structures.RemoteNodeAborted: External node "simulator" aborted:
 > 
 > error in simulator |Exception while handling a message on topic "set_robot_commands".
 >                    |
 >                    || Traceback (most recent call last):
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 274, in loop
 >                    ||     handle_message_node(parsed, receiver0, context0)
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 428, in handle_message_node
 >                    ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/utils.py", line 18, in call_if_fun_exists
 >                    ||     f(**kwargs)
 >                    ||   File "gym_bridge.py", line 261, in on_received_set_robot_commands
 >                    ||     raise Exception(msg)
 >                    || Exception: Received invalid PWM commands. They should be between -1 and +1. Received left = {l}, right = {r}.
 >                    ||
 >

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

18316

2746

Rami Al-Naim 🇷🇺

challenge-aido_LF-baseline-duckietown

step1-simulation

failed

2019-04-19 12:42:14+00:00

2019-04-19 12:43:53+00:00

0:01:39

InvalidSubmission: T [...]

InvalidSubmission:
Traceback (most recent call last):
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 174, in read_one
    nickname=self.nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 293, in read_until_over
    raise TimeoutError(msg) from None
TimeoutError: Timeout while reading output of node "agent".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "experiment_manager.py", line 293, in run_episode
    r: MsgReceived = agent.write_topic_and_expect('get_commands', expect='commands')
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 93, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 236, in read_one
    raise TimeoutError(msg) from e
TimeoutError: Timeout detected on /fifos/agent-out after 1 messages. Expected topic "commands".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
    yield cie
  File "experiment_manager.py", line 435, in <module>
    wrap(cie)
  File "experiment_manager.py", line 423, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 136, in main
    physics_dt=config.physics_dt)
  File "experiment_manager.py", line 297, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

18312

2751

Rami Al-Naim 🇷🇺

challenge-aido_LF-baseline-duckietown

step1-simulation

failed

2019-04-19 12:40:01+00:00

2019-04-19 12:41:40+00:00

0:01:39

InvalidSubmission: T [...]

InvalidSubmission:
Traceback (most recent call last):
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 174, in read_one
    nickname=self.nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 293, in read_until_over
    raise TimeoutError(msg) from None
TimeoutError: Timeout while reading output of node "agent".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "experiment_manager.py", line 293, in run_episode
    r: MsgReceived = agent.write_topic_and_expect('get_commands', expect='commands')
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 93, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 236, in read_one
    raise TimeoutError(msg) from e
TimeoutError: Timeout detected on /fifos/agent-out after 1 messages. Expected topic "commands".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
    yield cie
  File "experiment_manager.py", line 435, in <module>
    wrap(cie)
  File "experiment_manager.py", line 423, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 136, in main
    physics_dt=config.physics_dt)
  File "experiment_manager.py", line 297, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

18308

2759

Bhairav Mehta

challenge-aido_LF-template-ros - Template solution using ROS

step1-simulation

success

2019-04-19 12:30:18+00:00

2019-04-19 12:39:54+00:00

0:09:36

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.5487132829419987
survival_time_median	2.3499999999999996
deviation-center-line_median	0.11041400208354252
in-drivable-lane_median	0

other stats

agent_compute-ego_max	0.07080999704507682
agent_compute-ego_mean	0.06182996765820241
agent_compute-ego_median	0.060060044552417514
agent_compute-ego_min	0.058686587868667234
deviation-center-line_max	0.1279102488429998
deviation-center-line_mean	0.10518151035257096
deviation-center-line_min	0.06917270915638028
deviation-heading_max	0.4712184191829178
deviation-heading_mean	0.3828337640550057
deviation-heading_median	0.36368201628851926
deviation-heading_min	0.3257229985354382
driven_any_max	1.259664216011687
driven_any_mean	0.7702827269903464
driven_any_median	0.6642785413159032
driven_any_min	0.3059207793076613
driven_lanedir_consec_max	0.9402632878459154
driven_lanedir_consec_mean	0.588039443394122
driven_lanedir_consec_min	0.28022225990343186
driven_lanedir_max	0.9402632878459154
driven_lanedir_mean	0.588039443394122
driven_lanedir_median	0.5487132829419987
driven_lanedir_min	0.28022225990343186
in-drivable-lane_max	1.8499999999999936
in-drivable-lane_mean	0.559999999999998
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0590446751809168, "sim_physics": 0.026557230367893127, "survival_time": 4.099999999999993, "driven_lanedir": 0.5205812780744896, "sim_render-ego": 0.05854332156297637, "in-drivable-lane": 1.8499999999999936, "agent_compute-ego": 0.058686587868667234, "deviation-heading": 0.4069710981449338, "set_robot_commands": 0.0742078060057105, "deviation-center-line": 0.105230017637756, "driven_lanedir_consec": 0.5205812780744896, "sim_compute_sim_state": 0.03430581092834473, "sim_compute_performance-ego": 0.05975794792175293, "sim_compute_robot_state-ego": 0.059645222454536254, "sim_compute_robot_state-npc0": 0.06298014594287407, "sim_compute_robot_state-npc1": 0.059864977510964, "sim_compute_robot_state-npc2": 0.05946091035517251, "sim_compute_robot_state-npc3": 0.059712223890351086}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.3059207793076613, "sim_physics": 0.026104239317087028, "survival_time": 1.3000000000000005, "driven_lanedir": 0.28022225990343186, "sim_render-ego": 0.06100027377788837, "in-drivable-lane": 0, "agent_compute-ego": 0.07080999704507682, "deviation-heading": 0.36368201628851926, "set_robot_commands": 0.07359456098996676, "deviation-center-line": 0.06917270915638028, "driven_lanedir_consec": 0.28022225990343186, "sim_compute_sim_state": 0.03271875014671913, "sim_compute_performance-ego": 0.06147468090057373, "sim_compute_robot_state-ego": 0.058498235849233776, "sim_compute_robot_state-npc0": 0.06657983706547664, "sim_compute_robot_state-npc1": 0.0643778580885667, "sim_compute_robot_state-npc2": 0.05946204295525184, "sim_compute_robot_state-npc3": 0.05791844771458553}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.6642785413159032, "sim_physics": 0.025318374025060777, "survival_time": 2.3499999999999996, "driven_lanedir": 0.6504171082047745, "sim_render-ego": 0.056908795174132006, "in-drivable-lane": 0, "agent_compute-ego": 0.060060044552417514, "deviation-heading": 0.34657428812321933, "set_robot_commands": 0.07792168982485508, "deviation-center-line": 0.1279102488429998, "driven_lanedir_consec": 0.6504171082047745, "sim_compute_sim_state": 0.03342965815929656, "sim_compute_performance-ego": 0.05738060017849537, "sim_compute_robot_state-ego": 0.058788872779683865, "sim_compute_robot_state-npc0": 0.0642800584752509, "sim_compute_robot_state-npc1": 0.060203658773543986, "sim_compute_robot_state-npc2": 0.05899387724856113, "sim_compute_robot_state-npc3": 0.057695206175459195}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.259664216011687, "sim_physics": 0.025009702850174117, "survival_time": 4.549999999999992, "driven_lanedir": 0.9402632878459154, "sim_render-ego": 0.05821180081629491, "in-drivable-lane": 0.9499999999999966, "agent_compute-ego": 0.059279682872059584, "deviation-heading": 0.4712184191829178, "set_robot_commands": 0.07400556187053303, "deviation-center-line": 0.1131805740421762, "driven_lanedir_consec": 0.9402632878459154, "sim_compute_sim_state": 0.03392404776353102, "sim_compute_performance-ego": 0.057942086523705784, "sim_compute_robot_state-ego": 0.05847575114323543, "sim_compute_robot_state-npc0": 0.06246264426262824, "sim_compute_robot_state-npc1": 0.059622130551181, "sim_compute_robot_state-npc2": 0.058571503712580755, "sim_compute_robot_state-npc3": 0.059791892439454465}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.5625054231355635, "sim_physics": 0.021928774683099044, "survival_time": 1.900000000000001, "driven_lanedir": 0.5487132829419987, "sim_render-ego": 0.05771450619948538, "in-drivable-lane": 0, "agent_compute-ego": 0.060313525952790915, "deviation-heading": 0.3257229985354382, "set_robot_commands": 0.0764904398667185, "deviation-center-line": 0.11041400208354252, "driven_lanedir_consec": 0.5487132829419987, "sim_compute_sim_state": 0.03311118954106381, "sim_compute_performance-ego": 0.059123101987336814, "sim_compute_robot_state-ego": 0.05543151027277896, "sim_compute_robot_state-npc0": 0.06276444384926244, "sim_compute_robot_state-npc1": 0.06170318001195004, "sim_compute_robot_state-npc2": 0.0600382967999107, "sim_compute_robot_state-npc3": 0.05913139017004715}}
set_robot_commands_max	0.07792168982485508
set_robot_commands_mean	0.07524401171155679
set_robot_commands_median	0.0742078060057105
set_robot_commands_min	0.07359456098996676
sim_compute_performance-ego_max	0.06147468090057373
sim_compute_performance-ego_mean	0.05913568350237293
sim_compute_performance-ego_median	0.059123101987336814
sim_compute_performance-ego_min	0.05738060017849537
sim_compute_robot_state-ego_max	0.059645222454536254
sim_compute_robot_state-ego_mean	0.05816791849989367
sim_compute_robot_state-ego_median	0.058498235849233776
sim_compute_robot_state-ego_min	0.05543151027277896
sim_compute_robot_state-npc0_max	0.06657983706547664
sim_compute_robot_state-npc0_mean	0.06381342591909846
sim_compute_robot_state-npc0_median	0.06298014594287407
sim_compute_robot_state-npc0_min	0.06246264426262824
sim_compute_robot_state-npc1_max	0.0643778580885667
sim_compute_robot_state-npc1_mean	0.06115436098724114
sim_compute_robot_state-npc1_median	0.060203658773543986
sim_compute_robot_state-npc1_min	0.059622130551181
sim_compute_robot_state-npc2_max	0.0600382967999107
sim_compute_robot_state-npc2_mean	0.059305326214295385
sim_compute_robot_state-npc2_median	0.05946091035517251
sim_compute_robot_state-npc2_min	0.058571503712580755
sim_compute_robot_state-npc3_max	0.059791892439454465
sim_compute_robot_state-npc3_mean	0.05884983207797949
sim_compute_robot_state-npc3_median	0.05913139017004715
sim_compute_robot_state-npc3_min	0.057695206175459195
sim_compute_sim_state_max	0.03430581092834473
sim_compute_sim_state_mean	0.03349789130779105
sim_compute_sim_state_median	0.03342965815929656
sim_compute_sim_state_min	0.03271875014671913
sim_physics_max	0.026557230367893127
sim_physics_mean	0.024983664248662826
sim_physics_median	0.025318374025060777
sim_physics_min	0.021928774683099044
sim_render-ego_max	0.06100027377788837
sim_render-ego_mean	0.05847573950615541
sim_render-ego_median	0.05821180081629491
sim_render-ego_min	0.056908795174132006
simulation-passed	1
survival_time_max	4.549999999999992
survival_time_mean	2.839999999999997
survival_time_min	1.3000000000000005

No reset possible

18288

2809

Andrea Censi 🇨🇭

challenge-aido_LF-template-random - random_agent

step1-simulation

success

2019-04-19 12:20:28+00:00

2019-04-19 12:29:52+00:00

0:09:24

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.9097625228344608
survival_time_median	2.3999999999999995
deviation-center-line_median	0.09850417100304978
in-drivable-lane_median	0

other stats

agent_compute-ego_max	0.14530017640855578
agent_compute-ego_mean	0.1428682088946816
agent_compute-ego_median	0.14237610860304398
agent_compute-ego_min	0.14069512311150045
deviation-center-line_max	0.13882443387861454
deviation-center-line_mean	0.10656223356403702
deviation-center-line_min	0.07952733817751276
deviation-heading_max	0.26115230540596424
deviation-heading_mean	0.23093022559873316
deviation-heading_median	0.23417405060778035
deviation-heading_min	0.1984807025035913
driven_any_max	1.4367438864906794
driven_any_mean	1.0309070915612302
driven_any_median	0.9157141892899948
driven_any_min	0.8462726558162903
driven_lanedir_consec_max	0.9542194653539162
driven_lanedir_consec_mean	0.8288426551719738
driven_lanedir_consec_min	0.5348503251906886
driven_lanedir_max	0.9542194653539162
driven_lanedir_mean	0.8288426551719738
driven_lanedir_median	0.9097625228344608
driven_lanedir_min	0.5348503251906886
in-drivable-lane_max	1.099999999999998
in-drivable-lane_mean	0.4199999999999989
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0405624261079018, "sim_physics": 0.02388982502919323, "survival_time": 2.6499999999999986, "driven_lanedir": 0.5348503251906886, "sim_render-ego": 0.06335796050305637, "in-drivable-lane": 1.099999999999998, "agent_compute-ego": 0.14367803087774314, "deviation-heading": 0.24579559783100224, "set_robot_commands": 0.07323695128818727, "deviation-center-line": 0.07952733817751276, "driven_lanedir_consec": 0.5348503251906886, "sim_compute_sim_state": 0.03600144836137879, "sim_compute_performance-ego": 0.06254093602018536, "sim_compute_robot_state-ego": 0.06097424705073519, "sim_compute_robot_state-npc0": 0.06584691101650023, "sim_compute_robot_state-npc1": 0.062445487616197115, "sim_compute_robot_state-npc2": 0.06224430282160921, "sim_compute_robot_state-npc3": 0.06157191744390523}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.8462726558162903, "sim_physics": 0.02524424141103571, "survival_time": 2.2, "driven_lanedir": 0.8350786826190175, "sim_render-ego": 0.06416162577542392, "in-drivable-lane": 0, "agent_compute-ego": 0.14237610860304398, "deviation-heading": 0.23417405060778035, "set_robot_commands": 0.07539236545562744, "deviation-center-line": 0.09491150723296102, "driven_lanedir_consec": 0.8350786826190175, "sim_compute_sim_state": 0.03629030422730879, "sim_compute_performance-ego": 0.06565861268477007, "sim_compute_robot_state-ego": 0.06601248546080156, "sim_compute_robot_state-npc0": 0.07233640280636874, "sim_compute_robot_state-npc1": 0.06677550077438354, "sim_compute_robot_state-npc2": 0.06415991349653764, "sim_compute_robot_state-npc3": 0.06388418782841075}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.9152423001012856, "sim_physics": 0.02433380020989312, "survival_time": 2.25, "driven_lanedir": 0.9097625228344608, "sim_render-ego": 0.06551323466830783, "in-drivable-lane": 0, "agent_compute-ego": 0.14530017640855578, "deviation-heading": 0.1984807025035913, "set_robot_commands": 0.07651355001661513, "deviation-center-line": 0.12104371752804705, "driven_lanedir_consec": 0.9097625228344608, "sim_compute_sim_state": 0.034392028384738496, "sim_compute_performance-ego": 0.062362056308322485, "sim_compute_robot_state-ego": 0.06257189644707574, "sim_compute_robot_state-npc0": 0.06915979915195042, "sim_compute_robot_state-npc1": 0.06581474410163032, "sim_compute_robot_state-npc2": 0.06589376131693522, "sim_compute_robot_state-npc3": 0.06269088851081}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.9157141892899948, "sim_physics": 0.02552396555741628, "survival_time": 2.3999999999999995, "driven_lanedir": 0.910302279861786, "sim_render-ego": 0.0663197785615921, "in-drivable-lane": 0, "agent_compute-ego": 0.1422916054725647, "deviation-heading": 0.2150484716453277, "set_robot_commands": 0.07709182798862457, "deviation-center-line": 0.13882443387861454, "driven_lanedir_consec": 0.910302279861786, "sim_compute_sim_state": 0.03795779248078664, "sim_compute_performance-ego": 0.06367652118206024, "sim_compute_robot_state-ego": 0.0628721018632253, "sim_compute_robot_state-npc0": 0.0739283412694931, "sim_compute_robot_state-npc1": 0.06658507883548737, "sim_compute_robot_state-npc2": 0.0668370674053828, "sim_compute_robot_state-npc3": 0.06920242806275685}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.4367438864906794, "sim_physics": 0.025212074027341956, "survival_time": 3.399999999999996, "driven_lanedir": 0.9542194653539162, "sim_render-ego": 0.061054001836215746, "in-drivable-lane": 0.9999999999999964, "agent_compute-ego": 0.14069512311150045, "deviation-heading": 0.26115230540596424, "set_robot_commands": 0.07612542194478653, "deviation-center-line": 0.09850417100304978, "driven_lanedir_consec": 0.9542194653539162, "sim_compute_sim_state": 0.03392309301039752, "sim_compute_performance-ego": 0.06271680312998154, "sim_compute_robot_state-ego": 0.06062876827576581, "sim_compute_robot_state-npc0": 0.06561543310389799, "sim_compute_robot_state-npc1": 0.06249160976970897, "sim_compute_robot_state-npc2": 0.06139066990684061, "sim_compute_robot_state-npc3": 0.060301500208237595}}
set_robot_commands_max	0.07709182798862457
set_robot_commands_mean	0.07567202333876819
set_robot_commands_median	0.07612542194478653
set_robot_commands_min	0.07323695128818727
sim_compute_performance-ego_max	0.06565861268477007
sim_compute_performance-ego_mean	0.06339098586506393
sim_compute_performance-ego_median	0.06271680312998154
sim_compute_performance-ego_min	0.062362056308322485
sim_compute_robot_state-ego_max	0.06601248546080156
sim_compute_robot_state-ego_mean	0.06261189981952071
sim_compute_robot_state-ego_median	0.06257189644707574
sim_compute_robot_state-ego_min	0.06062876827576581
sim_compute_robot_state-npc0_max	0.0739283412694931
sim_compute_robot_state-npc0_mean	0.0693773774696421
sim_compute_robot_state-npc0_median	0.06915979915195042
sim_compute_robot_state-npc0_min	0.06561543310389799
sim_compute_robot_state-npc1_max	0.06677550077438354
sim_compute_robot_state-npc1_mean	0.06482248421948146
sim_compute_robot_state-npc1_median	0.06581474410163032
sim_compute_robot_state-npc1_min	0.062445487616197115
sim_compute_robot_state-npc2_max	0.0668370674053828
sim_compute_robot_state-npc2_mean	0.0641051429894611
sim_compute_robot_state-npc2_median	0.06415991349653764
sim_compute_robot_state-npc2_min	0.06139066990684061
sim_compute_robot_state-npc3_max	0.06920242806275685
sim_compute_robot_state-npc3_mean	0.06353018441082409
sim_compute_robot_state-npc3_median	0.06269088851081
sim_compute_robot_state-npc3_min	0.060301500208237595
sim_compute_sim_state_max	0.03795779248078664
sim_compute_sim_state_mean	0.03571293329292204
sim_compute_sim_state_median	0.03600144836137879
sim_compute_sim_state_min	0.03392309301039752
sim_physics_max	0.02552396555741628
sim_physics_mean	0.024840781246976057
sim_physics_median	0.025212074027341956
sim_physics_min	0.02388982502919323
sim_render-ego_max	0.0663197785615921
sim_render-ego_mean	0.06408132026891919
sim_render-ego_median	0.06416162577542392
sim_render-ego_min	0.061054001836215746
simulation-passed	1
survival_time_max	3.399999999999996
survival_time_mean	2.579999999999999
survival_time_min	2.2

No reset possible

18278

2822

Liam Paull 🇨🇦

challenge-aido_LF-template-random

step1-simulation

success

2019-04-19 12:11:02+00:00

2019-04-19 12:20:16+00:00

0:09:14

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.9097625228344608
survival_time_median	2.3999999999999995
deviation-center-line_median	0.09850417100304978
in-drivable-lane_median	0

other stats

agent_compute-ego_max	0.14058666229248046
agent_compute-ego_mean	0.1348483908065965
agent_compute-ego_median	0.13501292963822684
agent_compute-ego_min	0.13037049545432036
deviation-center-line_max	0.13882443387861454
deviation-center-line_mean	0.10656223356403702
deviation-center-line_min	0.07952733817751276
deviation-heading_max	0.26115230540596424
deviation-heading_mean	0.23093022559873316
deviation-heading_median	0.23417405060778035
deviation-heading_min	0.1984807025035913
driven_any_max	1.4367438864906794
driven_any_mean	1.0309070915612302
driven_any_median	0.9157141892899948
driven_any_min	0.8462726558162903
driven_lanedir_consec_max	0.9542194653539162
driven_lanedir_consec_mean	0.8288426551719738
driven_lanedir_consec_min	0.5348503251906886
driven_lanedir_max	0.9542194653539162
driven_lanedir_mean	0.8288426551719738
driven_lanedir_median	0.9097625228344608
driven_lanedir_min	0.5348503251906886
in-drivable-lane_max	1.099999999999998
in-drivable-lane_mean	0.4199999999999989
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0405624261079018, "sim_physics": 0.02376597782350936, "survival_time": 2.6499999999999986, "driven_lanedir": 0.5348503251906886, "sim_render-ego": 0.05763543326899691, "in-drivable-lane": 1.099999999999998, "agent_compute-ego": 0.13037049545432036, "deviation-heading": 0.24579559783100224, "set_robot_commands": 0.07146888409020766, "deviation-center-line": 0.07952733817751276, "driven_lanedir_consec": 0.5348503251906886, "sim_compute_sim_state": 0.03305725781422741, "sim_compute_performance-ego": 0.057426475129037535, "sim_compute_robot_state-ego": 0.05910263871246914, "sim_compute_robot_state-npc0": 0.06255376563881929, "sim_compute_robot_state-npc1": 0.05923349002622209, "sim_compute_robot_state-npc2": 0.06047978041306982, "sim_compute_robot_state-npc3": 0.0615387682644826}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.8462726558162903, "sim_physics": 0.025082181800495495, "survival_time": 2.2, "driven_lanedir": 0.8350786826190175, "sim_render-ego": 0.058799261396581474, "in-drivable-lane": 0, "agent_compute-ego": 0.13281010497700085, "deviation-heading": 0.23417405060778035, "set_robot_commands": 0.07189939780668779, "deviation-center-line": 0.09491150723296102, "driven_lanedir_consec": 0.8350786826190175, "sim_compute_sim_state": 0.03141375563361428, "sim_compute_performance-ego": 0.05891199545426802, "sim_compute_robot_state-ego": 0.05932503938674927, "sim_compute_robot_state-npc0": 0.06647331064397638, "sim_compute_robot_state-npc1": 0.06100576574152166, "sim_compute_robot_state-npc2": 0.05861699039285833, "sim_compute_robot_state-npc3": 0.06043068387291648}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.9152423001012856, "sim_physics": 0.025760618845621745, "survival_time": 2.25, "driven_lanedir": 0.9097625228344608, "sim_render-ego": 0.061828120549519854, "in-drivable-lane": 0, "agent_compute-ego": 0.14058666229248046, "deviation-heading": 0.1984807025035913, "set_robot_commands": 0.07364253997802735, "deviation-center-line": 0.12104371752804705, "driven_lanedir_consec": 0.9097625228344608, "sim_compute_sim_state": 0.034397358364529076, "sim_compute_performance-ego": 0.06277716424730088, "sim_compute_robot_state-ego": 0.06057958602905274, "sim_compute_robot_state-npc0": 0.06632318496704101, "sim_compute_robot_state-npc1": 0.06259670257568359, "sim_compute_robot_state-npc2": 0.06173300213283962, "sim_compute_robot_state-npc3": 0.06007690959506565}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.9157141892899948, "sim_physics": 0.025339325269063313, "survival_time": 2.3999999999999995, "driven_lanedir": 0.910302279861786, "sim_render-ego": 0.058272590239842735, "in-drivable-lane": 0, "agent_compute-ego": 0.13501292963822684, "deviation-heading": 0.2150484716453277, "set_robot_commands": 0.07477479676405589, "deviation-center-line": 0.13882443387861454, "driven_lanedir_consec": 0.910302279861786, "sim_compute_sim_state": 0.03425488372643789, "sim_compute_performance-ego": 0.05857057372728983, "sim_compute_robot_state-ego": 0.058391054471333824, "sim_compute_robot_state-npc0": 0.06979111830393474, "sim_compute_robot_state-npc1": 0.06417202949523926, "sim_compute_robot_state-npc2": 0.06211594740549723, "sim_compute_robot_state-npc3": 0.06229983766873678}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.4367438864906794, "sim_physics": 0.025667562204248765, "survival_time": 3.399999999999996, "driven_lanedir": 0.9542194653539162, "sim_render-ego": 0.05870109796524048, "in-drivable-lane": 0.9999999999999964, "agent_compute-ego": 0.13546176167095408, "deviation-heading": 0.26115230540596424, "set_robot_commands": 0.07468490390216603, "deviation-center-line": 0.09850417100304978, "driven_lanedir_consec": 0.9542194653539162, "sim_compute_sim_state": 0.034466410384458655, "sim_compute_performance-ego": 0.059806297807132494, "sim_compute_robot_state-ego": 0.06011666269863353, "sim_compute_robot_state-npc0": 0.0663261518758886, "sim_compute_robot_state-npc1": 0.06175251918680528, "sim_compute_robot_state-npc2": 0.06063440617393045, "sim_compute_robot_state-npc3": 0.06156883520238539}}
set_robot_commands_max	0.07477479676405589
set_robot_commands_mean	0.07329410450822894
set_robot_commands_median	0.07364253997802735
set_robot_commands_min	0.07146888409020766
sim_compute_performance-ego_max	0.06277716424730088
sim_compute_performance-ego_mean	0.05949850127300575
sim_compute_performance-ego_median	0.05891199545426802
sim_compute_performance-ego_min	0.057426475129037535
sim_compute_robot_state-ego_max	0.06057958602905274
sim_compute_robot_state-ego_mean	0.0595029962596477
sim_compute_robot_state-ego_median	0.05932503938674927
sim_compute_robot_state-ego_min	0.058391054471333824
sim_compute_robot_state-npc0_max	0.06979111830393474
sim_compute_robot_state-npc0_mean	0.066293506285932
sim_compute_robot_state-npc0_median	0.0663261518758886
sim_compute_robot_state-npc0_min	0.06255376563881929
sim_compute_robot_state-npc1_max	0.06417202949523926
sim_compute_robot_state-npc1_mean	0.06175210140509437
sim_compute_robot_state-npc1_median	0.06175251918680528
sim_compute_robot_state-npc1_min	0.05923349002622209
sim_compute_robot_state-npc2_max	0.06211594740549723
sim_compute_robot_state-npc2_mean	0.060716025303639086
sim_compute_robot_state-npc2_median	0.06063440617393045
sim_compute_robot_state-npc2_min	0.05861699039285833
sim_compute_robot_state-npc3_max	0.06229983766873678
sim_compute_robot_state-npc3_mean	0.06118300692071739
sim_compute_robot_state-npc3_median	0.0615387682644826
sim_compute_robot_state-npc3_min	0.06007690959506565
sim_compute_sim_state_max	0.034466410384458655
sim_compute_sim_state_mean	0.033517933184653466
sim_compute_sim_state_median	0.03425488372643789
sim_compute_sim_state_min	0.03141375563361428
sim_physics_max	0.025760618845621745
sim_physics_mean	0.025123133188587735
sim_physics_median	0.025339325269063313
sim_physics_min	0.02376597782350936
sim_render-ego_max	0.061828120549519854
sim_render-ego_mean	0.0590473006840363
sim_render-ego_median	0.05870109796524048
sim_render-ego_min	0.05763543326899691
simulation-passed	1
survival_time_max	3.399999999999996
survival_time_mean	2.579999999999999
survival_time_min	2.2

No reset possible

18274

2835

challenge-aido_LF-baseline-duckietown

step1-simulation

error

2019-04-19 12:10:09+00:00

2019-04-19 12:10:48+00:00

0:00:39

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

18251

2819

Liam Paull 🇨🇦

challenge-aido_LF-template-random

step1-simulation

success

2019-04-19 12:03:49+00:00

2019-04-19 12:09:48+00:00

0:05:59

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.909759304183658
survival_time_median	2.3999999999999995
deviation-center-line_median	0.0985043663838993
in-drivable-lane_median	0.3499999999999992

other stats

agent_compute-ego_max	0.14383498227821206
agent_compute-ego_mean	0.13928018796034186
agent_compute-ego_median	0.13944338162740072
agent_compute-ego_min	0.13412633362938375
deviation-center-line_max	0.13882443387861454
deviation-center-line_mean	0.10001813696907735
deviation-center-line_min	0.06219077976537568
deviation-heading_max	0.26115230540596424
deviation-heading_mean	0.2318832073723368
deviation-heading_median	0.23893895947579852
deviation-heading_min	0.1984807025035912
driven_any_max	1.4367438864906803
driven_any_mean	1.030907091561231
driven_any_median	0.9157141892899948
driven_any_min	0.8462726558162896
driven_lanedir_consec_max	0.9542197633771314
driven_lanedir_consec_mean	0.795970343519684
driven_lanedir_consec_min	0.5348503251906886
driven_lanedir_max	0.9542197633771314
driven_lanedir_mean	0.795970343519684
driven_lanedir_median	0.909759304183658
driven_lanedir_min	0.5348503251906886
in-drivable-lane_max	1.099999999999998
in-drivable-lane_mean	0.4899999999999987
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0405624261079018, "sim_physics": 0.016467737701703917, "survival_time": 2.6499999999999986, "driven_lanedir": 0.5348503251906886, "sim_render-ego": 0.065581942504307, "in-drivable-lane": 1.099999999999998, "agent_compute-ego": 0.14383498227821206, "deviation-heading": 0.24579559783100224, "set_robot_commands": 0.07714237357085606, "deviation-center-line": 0.07952733817751276, "driven_lanedir_consec": 0.5348503251906886, "sim_compute_sim_state": 0.04136018932990308, "sim_compute_performance-ego": 0.06441652549887603, "sim_compute_robot_state-ego": 0.06478280391333238}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.8462726558162896, "sim_physics": 0.014488382772965864, "survival_time": 2.2, "driven_lanedir": 0.6707200449851557, "sim_render-ego": 0.06264054775238037, "in-drivable-lane": 0.3499999999999992, "agent_compute-ego": 0.14381561496041037, "deviation-heading": 0.23893895947579852, "set_robot_commands": 0.07704196734861894, "deviation-center-line": 0.06219077976537568, "driven_lanedir_consec": 0.6707200449851557, "sim_compute_sim_state": 0.037028285590085114, "sim_compute_performance-ego": 0.0637522664937106, "sim_compute_robot_state-ego": 0.06105346571315418}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.9152423001012878, "sim_physics": 0.01458926730685764, "survival_time": 2.25, "driven_lanedir": 0.909759304183658, "sim_render-ego": 0.061148352093166776, "in-drivable-lane": 0, "agent_compute-ego": 0.13944338162740072, "deviation-heading": 0.1984807025035912, "set_robot_commands": 0.07632065878974068, "deviation-center-line": 0.1210437666399845, "driven_lanedir_consec": 0.909759304183658, "sim_compute_sim_state": 0.0361635684967041, "sim_compute_performance-ego": 0.05998623106214735, "sim_compute_robot_state-ego": 0.060663202073838976}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.9157141892899948, "sim_physics": 0.015498379866282145, "survival_time": 2.3999999999999995, "driven_lanedir": 0.910302279861786, "sim_render-ego": 0.058151582876841225, "in-drivable-lane": 0, "agent_compute-ego": 0.1351806273063024, "deviation-heading": 0.2150484716453277, "set_robot_commands": 0.0747707982858022, "deviation-center-line": 0.13882443387861454, "driven_lanedir_consec": 0.910302279861786, "sim_compute_sim_state": 0.03804023563861847, "sim_compute_performance-ego": 0.060623496770858765, "sim_compute_robot_state-ego": 0.05948499838511149}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.4367438864906803, "sim_physics": 0.015928065075593835, "survival_time": 3.399999999999996, "driven_lanedir": 0.9542197633771314, "sim_render-ego": 0.05869217479930205, "in-drivable-lane": 0.9999999999999964, "agent_compute-ego": 0.13412633362938375, "deviation-heading": 0.26115230540596424, "set_robot_commands": 0.07536714217242073, "deviation-center-line": 0.0985043663838993, "driven_lanedir_consec": 0.9542197633771314, "sim_compute_sim_state": 0.036875675706302416, "sim_compute_performance-ego": 0.05802500949186437, "sim_compute_robot_state-ego": 0.05947936983669505}}
set_robot_commands_max	0.07714237357085606
set_robot_commands_mean	0.07612858803348772
set_robot_commands_median	0.07632065878974068
set_robot_commands_min	0.0747707982858022
sim_compute_performance-ego_max	0.06441652549887603
sim_compute_performance-ego_mean	0.061360705863491426
sim_compute_performance-ego_median	0.060623496770858765
sim_compute_performance-ego_min	0.05802500949186437
sim_compute_robot_state-ego_max	0.06478280391333238
sim_compute_robot_state-ego_mean	0.06109276798442642
sim_compute_robot_state-ego_median	0.060663202073838976
sim_compute_robot_state-ego_min	0.05947936983669505
sim_compute_sim_state_max	0.04136018932990308
sim_compute_sim_state_mean	0.03789359095232263
sim_compute_sim_state_median	0.037028285590085114
sim_compute_sim_state_min	0.0361635684967041
sim_physics_max	0.016467737701703917
sim_physics_mean	0.01539436654468068
sim_physics_median	0.015498379866282145
sim_physics_min	0.014488382772965864
sim_render-ego_max	0.065581942504307
sim_render-ego_mean	0.06124292000519947
sim_render-ego_median	0.061148352093166776
sim_render-ego_min	0.058151582876841225
simulation-passed	1
survival_time_max	3.399999999999996
survival_time_mean	2.579999999999999
survival_time_min	2.2

No reset possible

18245

2391

Liam Paull 🇨🇦

random_agent

step1-simulation

success

2019-04-19 11:06:06+00:00

2019-04-19 11:11:52+00:00

0:05:46

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.909759304183658
survival_time_median	2.3999999999999995
deviation-center-line_median	0.0985043663838993
in-drivable-lane_median	0.3499999999999992

other stats

agent_compute-ego_max	0.13574226463542266
agent_compute-ego_mean	0.12672202275730687
agent_compute-ego_median	0.12466788821750216
agent_compute-ego_min	0.12086649916388773
deviation-center-line_max	0.13882443387861454
deviation-center-line_mean	0.10001813696907735
deviation-center-line_min	0.06219077976537568
deviation-heading_max	0.26115230540596424
deviation-heading_mean	0.2318832073723368
deviation-heading_median	0.23893895947579852
deviation-heading_min	0.1984807025035912
driven_any_max	1.4367438864906803
driven_any_mean	1.030907091561231
driven_any_median	0.9157141892899948
driven_any_min	0.8462726558162896
driven_lanedir_consec_max	0.9542197633771314
driven_lanedir_consec_mean	0.795970343519684
driven_lanedir_consec_min	0.5348503251906886
driven_lanedir_max	0.9542197633771314
driven_lanedir_mean	0.795970343519684
driven_lanedir_median	0.909759304183658
driven_lanedir_min	0.5348503251906886
in-drivable-lane_max	1.099999999999998
in-drivable-lane_mean	0.4899999999999987
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0405624261079018, "sim_physics": 0.01657843139936339, "survival_time": 2.6499999999999986, "driven_lanedir": 0.5348503251906886, "sim_render-ego": 0.06516731460139437, "in-drivable-lane": 1.099999999999998, "agent_compute-ego": 0.12794304343889346, "deviation-heading": 0.24579559783100224, "set_robot_commands": 0.07949438634908425, "deviation-center-line": 0.07952733817751276, "driven_lanedir_consec": 0.5348503251906886, "sim_compute_sim_state": 0.04115961182792232, "sim_compute_performance-ego": 0.06258242984987655, "sim_compute_robot_state-ego": 0.061947260262831205}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.8462726558162896, "sim_physics": 0.016437969424507835, "survival_time": 2.2, "driven_lanedir": 0.6707200449851557, "sim_render-ego": 0.06235116178339178, "in-drivable-lane": 0.3499999999999992, "agent_compute-ego": 0.12086649916388773, "deviation-heading": 0.23893895947579852, "set_robot_commands": 0.07492912899364125, "deviation-center-line": 0.06219077976537568, "driven_lanedir_consec": 0.6707200449851557, "sim_compute_sim_state": 0.04288936203176325, "sim_compute_performance-ego": 0.06156598979776556, "sim_compute_robot_state-ego": 0.06412056901238182}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.9152423001012878, "sim_physics": 0.016337776184082033, "survival_time": 2.25, "driven_lanedir": 0.909759304183658, "sim_render-ego": 0.06113673845926921, "in-drivable-lane": 0, "agent_compute-ego": 0.12466788821750216, "deviation-heading": 0.1984807025035912, "set_robot_commands": 0.074850861231486, "deviation-center-line": 0.1210437666399845, "driven_lanedir_consec": 0.909759304183658, "sim_compute_sim_state": 0.03906185891893175, "sim_compute_performance-ego": 0.06036606364780002, "sim_compute_robot_state-ego": 0.06125517421298557}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.9157141892899948, "sim_physics": 0.01649590830008189, "survival_time": 2.3999999999999995, "driven_lanedir": 0.910302279861786, "sim_render-ego": 0.06634418666362762, "in-drivable-lane": 0, "agent_compute-ego": 0.12439041833082835, "deviation-heading": 0.2150484716453277, "set_robot_commands": 0.0750806878010432, "deviation-center-line": 0.13882443387861454, "driven_lanedir_consec": 0.910302279861786, "sim_compute_sim_state": 0.040388221542040505, "sim_compute_performance-ego": 0.06354740262031555, "sim_compute_robot_state-ego": 0.06294393042723338}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.4367438864906803, "sim_physics": 0.017453425070818734, "survival_time": 3.399999999999996, "driven_lanedir": 0.9542197633771314, "sim_render-ego": 0.06807975909289192, "in-drivable-lane": 0.9999999999999964, "agent_compute-ego": 0.13574226463542266, "deviation-heading": 0.26115230540596424, "set_robot_commands": 0.08091937794404871, "deviation-center-line": 0.0985043663838993, "driven_lanedir_consec": 0.9542197633771314, "sim_compute_sim_state": 0.04393912062925451, "sim_compute_performance-ego": 0.06634385094923131, "sim_compute_robot_state-ego": 0.06573967022054336}}
set_robot_commands_max	0.08091937794404871
set_robot_commands_mean	0.07705488846386069
set_robot_commands_median	0.0750806878010432
set_robot_commands_min	0.074850861231486
sim_compute_performance-ego_max	0.06634385094923131
sim_compute_performance-ego_mean	0.0628811473729978
sim_compute_performance-ego_median	0.06258242984987655
sim_compute_performance-ego_min	0.06036606364780002
sim_compute_robot_state-ego_max	0.06573967022054336
sim_compute_robot_state-ego_mean	0.06320132082719507
sim_compute_robot_state-ego_median	0.06294393042723338
sim_compute_robot_state-ego_min	0.06125517421298557
sim_compute_sim_state_max	0.04393912062925451
sim_compute_sim_state_mean	0.041487634989982466
sim_compute_sim_state_median	0.04115961182792232
sim_compute_sim_state_min	0.03906185891893175
sim_physics_max	0.017453425070818734
sim_physics_mean	0.016660702075770775
sim_physics_median	0.01649590830008189
sim_physics_min	0.016337776184082033
sim_render-ego_max	0.06807975909289192
sim_render-ego_mean	0.06461583212011499
sim_render-ego_median	0.06516731460139437
sim_render-ego_min	0.06113673845926921
simulation-passed	1
survival_time_max	3.399999999999996
survival_time_mean	2.579999999999999
survival_time_min	2.2

No reset possible

18234

2467

Liam Paull 🇨🇦

challenge-aido_LF-template-random

step1-simulation

success

2019-04-19 10:59:59+00:00

2019-04-19 11:05:38+00:00

0:05:39

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.909759304183658
survival_time_median	2.3999999999999995
deviation-center-line_median	0.0985043663838993
in-drivable-lane_median	0.3499999999999992

other stats

agent_compute-ego_max	0.14442033276838415
agent_compute-ego_mean	0.13734938175183448
agent_compute-ego_median	0.1395642704433865
agent_compute-ego_min	0.12843604385852814
deviation-center-line_max	0.13882443387861454
deviation-center-line_mean	0.10001813696907735
deviation-center-line_min	0.06219077976537568
deviation-heading_max	0.26115230540596424
deviation-heading_mean	0.2318832073723368
deviation-heading_median	0.23893895947579852
deviation-heading_min	0.1984807025035912
driven_any_max	1.4367438864906803
driven_any_mean	1.030907091561231
driven_any_median	0.9157141892899948
driven_any_min	0.8462726558162896
driven_lanedir_consec_max	0.9542197633771314
driven_lanedir_consec_mean	0.795970343519684
driven_lanedir_consec_min	0.5348503251906886
driven_lanedir_max	0.9542197633771314
driven_lanedir_mean	0.795970343519684
driven_lanedir_median	0.909759304183658
driven_lanedir_min	0.5348503251906886
in-drivable-lane_max	1.099999999999998
in-drivable-lane_mean	0.4899999999999987
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0405624261079018, "sim_physics": 0.014337913045343363, "survival_time": 2.6499999999999986, "driven_lanedir": 0.5348503251906886, "sim_render-ego": 0.05758951744943295, "in-drivable-lane": 1.099999999999998, "agent_compute-ego": 0.14279020057534272, "deviation-heading": 0.24579559783100224, "set_robot_commands": 0.07543315977420446, "deviation-center-line": 0.07952733817751276, "driven_lanedir_consec": 0.5348503251906886, "sim_compute_sim_state": 0.03809619849582888, "sim_compute_performance-ego": 0.06000874627311275, "sim_compute_robot_state-ego": 0.06256022093431005}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.8462726558162896, "sim_physics": 0.014264383099295876, "survival_time": 2.2, "driven_lanedir": 0.6707200449851557, "sim_render-ego": 0.05395634607835249, "in-drivable-lane": 0.3499999999999992, "agent_compute-ego": 0.13153606111353094, "deviation-heading": 0.23893895947579852, "set_robot_commands": 0.07318429513411089, "deviation-center-line": 0.06219077976537568, "driven_lanedir_consec": 0.6707200449851557, "sim_compute_sim_state": 0.032673451033505524, "sim_compute_performance-ego": 0.053998118097131904, "sim_compute_robot_state-ego": 0.05684909495440396}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.9152423001012878, "sim_physics": 0.01588346693250868, "survival_time": 2.25, "driven_lanedir": 0.909759304183658, "sim_render-ego": 0.06025853157043457, "in-drivable-lane": 0, "agent_compute-ego": 0.1395642704433865, "deviation-heading": 0.1984807025035912, "set_robot_commands": 0.0774661382039388, "deviation-center-line": 0.1210437666399845, "driven_lanedir_consec": 0.909759304183658, "sim_compute_sim_state": 0.037913216484917536, "sim_compute_performance-ego": 0.05990642441643609, "sim_compute_robot_state-ego": 0.06400558153788248}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.9157141892899948, "sim_physics": 0.016180967291196186, "survival_time": 2.3999999999999995, "driven_lanedir": 0.910302279861786, "sim_render-ego": 0.05663709839185079, "in-drivable-lane": 0, "agent_compute-ego": 0.12843604385852814, "deviation-heading": 0.2150484716453277, "set_robot_commands": 0.0740132878224055, "deviation-center-line": 0.13882443387861454, "driven_lanedir_consec": 0.910302279861786, "sim_compute_sim_state": 0.034206897020339966, "sim_compute_performance-ego": 0.05708605547746023, "sim_compute_robot_state-ego": 0.05986091991265615}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.4367438864906803, "sim_physics": 0.01746199411504409, "survival_time": 3.399999999999996, "driven_lanedir": 0.9542197633771314, "sim_render-ego": 0.0635563661070431, "in-drivable-lane": 0.9999999999999964, "agent_compute-ego": 0.14442033276838415, "deviation-heading": 0.26115230540596424, "set_robot_commands": 0.07990330457687378, "deviation-center-line": 0.0985043663838993, "driven_lanedir_consec": 0.9542197633771314, "sim_compute_sim_state": 0.038746381507200355, "sim_compute_performance-ego": 0.061663561007555795, "sim_compute_robot_state-ego": 0.062494288472568285}}
set_robot_commands_max	0.07990330457687378
set_robot_commands_mean	0.07600003710230668
set_robot_commands_median	0.07543315977420446
set_robot_commands_min	0.07318429513411089
sim_compute_performance-ego_max	0.061663561007555795
sim_compute_performance-ego_mean	0.05853258105433936
sim_compute_performance-ego_median	0.05990642441643609
sim_compute_performance-ego_min	0.053998118097131904
sim_compute_robot_state-ego_max	0.06400558153788248
sim_compute_robot_state-ego_mean	0.061154021162364194
sim_compute_robot_state-ego_median	0.062494288472568285
sim_compute_robot_state-ego_min	0.05684909495440396
sim_compute_sim_state_max	0.038746381507200355
sim_compute_sim_state_mean	0.03632722890835845
sim_compute_sim_state_median	0.037913216484917536
sim_compute_sim_state_min	0.032673451033505524
sim_physics_max	0.01746199411504409
sim_physics_mean	0.01562574489667764
sim_physics_median	0.01588346693250868
sim_physics_min	0.014264383099295876
sim_render-ego_max	0.0635563661070431
sim_render-ego_mean	0.05839957191942278
sim_render-ego_median	0.05758951744943295
sim_render-ego_min	0.05395634607835249
simulation-passed	1
survival_time_max	3.399999999999996
survival_time_mean	2.579999999999999
survival_time_min	2.2

No reset possible

18231

2501

test for ppo

step1-simulation

error

2019-04-19 10:58:58+00:00

2019-04-19 10:59:45+00:00

0:00:47

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

18226

2540

test for ppo

step1-simulation

error

2019-04-19 10:56:20+00:00

2019-04-19 10:58:26+00:00

0:02:06

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

18219

2547

Andrea Censi 🇨🇭

challenge-aido_LF-template-ros - Template solution using ROS

step1-simulation

success

2019-04-19 10:50:31+00:00

2019-04-19 10:56:05+00:00

0:05:34

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.5487126868955534
survival_time_median	2.3499999999999996
deviation-center-line_median	0.11041377901227004
in-drivable-lane_median	0

other stats

agent_compute-ego_max	0.06551693036006047
agent_compute-ego_mean	0.06328952916988677
agent_compute-ego_median	0.0629166288578764
agent_compute-ego_min	0.06086995575454209
deviation-center-line_max	0.12791029264553877
deviation-center-line_mean	0.10518143804729678
deviation-center-line_min	0.06917252689874298
deviation-heading_max	0.4712184191829178
deviation-heading_mean	0.3828337640550056
deviation-heading_median	0.3636820162885191
deviation-heading_min	0.3257229985354382
driven_any_max	1.259664216011687
driven_any_mean	0.7702827269903463
driven_any_median	0.6642785413158997
driven_any_min	0.3059207793076624
driven_lanedir_consec_max	0.9402632878459154
driven_lanedir_consec_mean	0.5880385612453785
driven_lanedir_consec_min	0.2802213062291129
driven_lanedir_max	0.9402632878459154
driven_lanedir_mean	0.5880385612453785
driven_lanedir_median	0.5487126868955534
driven_lanedir_min	0.2802213062291129
in-drivable-lane_max	1.8499999999999936
in-drivable-lane_mean	0.559999999999998
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0590446751809168, "sim_physics": 0.01667621077560797, "survival_time": 4.099999999999993, "driven_lanedir": 0.5205812780744896, "sim_render-ego": 0.0580554938897854, "in-drivable-lane": 1.8499999999999936, "agent_compute-ego": 0.06235307891194413, "deviation-heading": 0.4069710981449338, "set_robot_commands": 0.0748283194332588, "deviation-center-line": 0.105230017637756, "driven_lanedir_consec": 0.5205812780744896, "sim_compute_sim_state": 0.03696505034842142, "sim_compute_performance-ego": 0.05841922178501036, "sim_compute_robot_state-ego": 0.059022417882593665}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.3059207793076624, "sim_physics": 0.014344316262465255, "survival_time": 1.3000000000000005, "driven_lanedir": 0.2802213062291129, "sim_render-ego": 0.0583348641028771, "in-drivable-lane": 0, "agent_compute-ego": 0.06551693036006047, "deviation-heading": 0.3636820162885191, "set_robot_commands": 0.07285424379202035, "deviation-center-line": 0.06917252689874298, "driven_lanedir_consec": 0.2802213062291129, "sim_compute_sim_state": 0.035219357563899115, "sim_compute_performance-ego": 0.0587770755474384, "sim_compute_robot_state-ego": 0.05751636395087609}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.6642785413158997, "sim_physics": 0.015337081665688371, "survival_time": 2.3499999999999996, "driven_lanedir": 0.6504142471818213, "sim_render-ego": 0.06032275646290881, "in-drivable-lane": 0, "agent_compute-ego": 0.0629166288578764, "deviation-heading": 0.34657428812321933, "set_robot_commands": 0.07243551091944918, "deviation-center-line": 0.12791029264553877, "driven_lanedir_consec": 0.6504142471818213, "sim_compute_sim_state": 0.03584248461621873, "sim_compute_performance-ego": 0.05989222323640864, "sim_compute_robot_state-ego": 0.06067763998153362}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.259664216011687, "sim_physics": 0.017915091671786464, "survival_time": 4.549999999999992, "driven_lanedir": 0.9402632878459154, "sim_render-ego": 0.05769323516678024, "in-drivable-lane": 0.9499999999999966, "agent_compute-ego": 0.06086995575454209, "deviation-heading": 0.4712184191829178, "set_robot_commands": 0.07329784382830609, "deviation-center-line": 0.1131805740421762, "driven_lanedir_consec": 0.9402632878459154, "sim_compute_sim_state": 0.03679416729853703, "sim_compute_performance-ego": 0.05746757591163719, "sim_compute_robot_state-ego": 0.05757122511392111}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.5625054231355648, "sim_physics": 0.015364571621543482, "survival_time": 1.900000000000001, "driven_lanedir": 0.5487126868955534, "sim_render-ego": 0.06137499056364361, "in-drivable-lane": 0, "agent_compute-ego": 0.0647910519650108, "deviation-heading": 0.3257229985354382, "set_robot_commands": 0.07380447262211849, "deviation-center-line": 0.11041377901227004, "driven_lanedir_consec": 0.5487126868955534, "sim_compute_sim_state": 0.035309703726517525, "sim_compute_performance-ego": 0.05939046332710668, "sim_compute_robot_state-ego": 0.06229612701817563}}
set_robot_commands_max	0.0748283194332588
set_robot_commands_mean	0.07344407811903059
set_robot_commands_median	0.07329784382830609
set_robot_commands_min	0.07243551091944918
sim_compute_performance-ego_max	0.05989222323640864
sim_compute_performance-ego_mean	0.05878931196152025
sim_compute_performance-ego_median	0.0587770755474384
sim_compute_performance-ego_min	0.05746757591163719
sim_compute_robot_state-ego_max	0.06229612701817563
sim_compute_robot_state-ego_mean	0.05941675478942001
sim_compute_robot_state-ego_median	0.059022417882593665
sim_compute_robot_state-ego_min	0.05751636395087609
sim_compute_sim_state_max	0.03696505034842142
sim_compute_sim_state_mean	0.03602615271071876
sim_compute_sim_state_median	0.03584248461621873
sim_compute_sim_state_min	0.035219357563899115
sim_physics_max	0.017915091671786464
sim_physics_mean	0.015927454399418308
sim_physics_median	0.015364571621543482
sim_physics_min	0.014344316262465255
sim_render-ego_max	0.06137499056364361
sim_render-ego_mean	0.059156268037199033
sim_render-ego_median	0.0583348641028771
sim_render-ego_min	0.05769323516678024
simulation-passed	1
survival_time_max	4.549999999999992
survival_time_mean	2.839999999999997
survival_time_min	1.3000000000000005

No reset possible

18218

2557

Liam Paull 🇨🇦

challenge-aido_LF-baseline-duckietown

step1-simulation

error

2019-04-19 10:49:38+00:00

2019-04-19 10:50:25+00:00

0:00:47

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

18208

2599

Liam Paull 🇨🇦

challenge-aido_LF-template-pytorch

step1-simulation

success

2019-04-19 10:43:28+00:00

2019-04-19 10:49:12+00:00

0:05:44

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.057067803220765434
survival_time_median	1.5500000000000007
deviation-center-line_median	0.02370786337530236
in-drivable-lane_median	0.4500000000000004

other stats

agent_compute-ego_max	0.20468977838754657
agent_compute-ego_mean	0.18260439129038075
agent_compute-ego_median	0.1926676158247323
agent_compute-ego_min	0.1499869738306318
deviation-center-line_max	0.04089737250502878
deviation-center-line_mean	0.027792860496586858
deviation-center-line_min	0.020311801662838143
deviation-heading_max	0.6655312718004507
deviation-heading_mean	0.5938027320545431
deviation-heading_median	0.5969033469682867
deviation-heading_min	0.5225648584795248
driven_any_max	0.16633707492175848
driven_any_mean	0.15443211649306696
driven_any_median	0.15284200514497143
driven_any_min	0.14657146746231645
driven_lanedir_consec_max	0.08061321533235766
driven_lanedir_consec_mean	0.05850828534381251
driven_lanedir_consec_min	0.04584265595898396
driven_lanedir_max	0.08061321533235766
driven_lanedir_mean	0.05850828534381251
driven_lanedir_median	0.057067803220765434
driven_lanedir_min	0.04584265595898396
in-drivable-lane_max	0.6000000000000005
in-drivable-lane_mean	0.4800000000000004
in-drivable-lane_min	0.3500000000000003
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.14829817147133653, "sim_physics": 0.015078775584697723, "survival_time": 1.6000000000000008, "driven_lanedir": 0.04913901116194808, "sim_render-ego": 0.053633593022823334, "in-drivable-lane": 0.6000000000000005, "agent_compute-ego": 0.20468977838754657, "deviation-heading": 0.5452093044538777, "set_robot_commands": 0.07532590627670288, "deviation-center-line": 0.020311801662838143, "driven_lanedir_consec": 0.04913901116194808, "sim_compute_sim_state": 0.0342220738530159, "sim_compute_performance-ego": 0.05544372648000717, "sim_compute_robot_state-ego": 0.055318333208560944}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.16633707492175848, "sim_physics": 0.014110580567390688, "survival_time": 1.5500000000000007, "driven_lanedir": 0.08061321533235766, "sim_render-ego": 0.05425212460179483, "in-drivable-lane": 0.4000000000000003, "agent_compute-ego": 0.19832160395960657, "deviation-heading": 0.6655312718004507, "set_robot_commands": 0.07145139478868054, "deviation-center-line": 0.04089737250502878, "driven_lanedir_consec": 0.08061321533235766, "sim_compute_sim_state": 0.035384985708421274, "sim_compute_performance-ego": 0.0553558103499874, "sim_compute_robot_state-ego": 0.05459101738468293}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.15284200514497143, "sim_physics": 0.01579108089208603, "survival_time": 1.6000000000000008, "driven_lanedir": 0.057067803220765434, "sim_render-ego": 0.059778936207294464, "in-drivable-lane": 0.6000000000000005, "agent_compute-ego": 0.1673559844493866, "deviation-heading": 0.5225648584795248, "set_robot_commands": 0.07525928318500519, "deviation-center-line": 0.021634583010568555, "driven_lanedir_consec": 0.057067803220765434, "sim_compute_sim_state": 0.03806139528751373, "sim_compute_performance-ego": 0.061531223356723785, "sim_compute_robot_state-ego": 0.06400980800390244}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.14657146746231645, "sim_physics": 0.014074753070699756, "survival_time": 1.4500000000000006, "driven_lanedir": 0.04584265595898396, "sim_render-ego": 0.05329303083748653, "in-drivable-lane": 0.4500000000000004, "agent_compute-ego": 0.1926676158247323, "deviation-heading": 0.5969033469682867, "set_robot_commands": 0.07130410753447435, "deviation-center-line": 0.02370786337530236, "driven_lanedir_consec": 0.04584265595898396, "sim_compute_sim_state": 0.034447201367082264, "sim_compute_performance-ego": 0.05396941612506735, "sim_compute_robot_state-ego": 0.05535909225200784}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.15811186346495182, "sim_physics": 0.01589865343911307, "survival_time": 1.4000000000000006, "driven_lanedir": 0.059878741045007455, "sim_render-ego": 0.05833745002746582, "in-drivable-lane": 0.3500000000000003, "agent_compute-ego": 0.1499869738306318, "deviation-heading": 0.6388048785705757, "set_robot_commands": 0.07781247581754412, "deviation-center-line": 0.03241268192919646, "driven_lanedir_consec": 0.059878741045007455, "sim_compute_sim_state": 0.03654921054840088, "sim_compute_performance-ego": 0.05820683070591518, "sim_compute_robot_state-ego": 0.05932550770895822}}
set_robot_commands_max	0.07781247581754412
set_robot_commands_mean	0.07423063352048141
set_robot_commands_median	0.07525928318500519
set_robot_commands_min	0.07130410753447435
sim_compute_performance-ego_max	0.061531223356723785
sim_compute_performance-ego_mean	0.056901401403540185
sim_compute_performance-ego_median	0.05544372648000717
sim_compute_performance-ego_min	0.05396941612506735
sim_compute_robot_state-ego_max	0.06400980800390244
sim_compute_robot_state-ego_mean	0.05772075171162248
sim_compute_robot_state-ego_median	0.05535909225200784
sim_compute_robot_state-ego_min	0.05459101738468293
sim_compute_sim_state_max	0.03806139528751373
sim_compute_sim_state_mean	0.03573297335288681
sim_compute_sim_state_median	0.035384985708421274
sim_compute_sim_state_min	0.0342220738530159
sim_physics_max	0.01589865343911307
sim_physics_mean	0.014990768710797454
sim_physics_median	0.015078775584697723
sim_physics_min	0.014074753070699756
sim_render-ego_max	0.059778936207294464
sim_render-ego_mean	0.05585902693937299
sim_render-ego_median	0.05425212460179483
sim_render-ego_min	0.05329303083748653
simulation-passed	1
survival_time_max	1.6000000000000008
survival_time_mean	1.520000000000001
survival_time_min	1.4000000000000006

No reset possible

18195

2725

test for ppo

step1-simulation

success

2019-04-19 10:31:47+00:00

2019-04-19 10:43:07+00:00

0:11:20

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.080081106294136
survival_time_median	2.9499999999999975
deviation-center-line_median	0.12282040106870584
in-drivable-lane_median	1.0000000000000009

other stats

agent_compute-ego_max	0.2172913970528068
agent_compute-ego_mean	0.18805505550740248
agent_compute-ego_median	0.19124069611231487
agent_compute-ego_min	0.1579705600080819
deviation-center-line_max	0.35307431931154476
deviation-center-line_mean	0.1482815559844701
deviation-center-line_min	0.03588546305460284
deviation-heading_max	2.8319227540347907
deviation-heading_mean	1.6006508331484934
deviation-heading_median	1.498710194838244
deviation-heading_min	0.5142081540672314
driven_any_max	1.7465763583447846
driven_any_mean	0.8920736016667657
driven_any_median	0.5567498983232159
driven_any_min	0.23181932764146823
driven_lanedir_consec_max	0.13100179549818058
driven_lanedir_consec_mean	0.06635492723973242
driven_lanedir_consec_min	-0.030846494968074345
driven_lanedir_max	0.13100179549818058
driven_lanedir_mean	0.10374299824792674
driven_lanedir_median	0.11273478756987744
driven_lanedir_min	0.07356304881779263
in-drivable-lane_max	5.799999999999996
in-drivable-lane_mean	2.609999999999999
in-drivable-lane_min	0.5500000000000004
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.2455260729249304, "sim_physics": 0.015124994165757124, "survival_time": 1.7000000000000008, "driven_lanedir": 0.080081106294136, "sim_render-ego": 0.05374999607310576, "in-drivable-lane": 0.5500000000000005, "agent_compute-ego": 0.17425320428960464, "deviation-heading": 0.6491348982117494, "set_robot_commands": 0.07251953377443202, "deviation-center-line": 0.03588546305460284, "driven_lanedir_consec": 0.080081106294136, "sim_compute_sim_state": 0.035126139135921705, "sim_compute_performance-ego": 0.05552369706770953, "sim_compute_robot_state-ego": 0.05503246363471536}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.7465763583447846, "sim_physics": 0.015149792035420736, "survival_time": 8.999999999999993, "driven_lanedir": 0.07356304881779263, "sim_render-ego": 0.05419179598490397, "in-drivable-lane": 5.149999999999998, "agent_compute-ego": 0.19124069611231487, "deviation-heading": 2.8319227540347907, "set_robot_commands": 0.07333174281650119, "deviation-center-line": 0.35307431931154476, "driven_lanedir_consec": -0.030846494968074345, "sim_compute_sim_state": 0.0339830756187439, "sim_compute_performance-ego": 0.05548615190717909, "sim_compute_robot_state-ego": 0.05710690286424425}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.6796963510994296, "sim_physics": 0.014536270728478065, "survival_time": 9.099999999999994, "driven_lanedir": 0.12133425305964708, "sim_render-ego": 0.057040587886349185, "in-drivable-lane": 5.799999999999996, "agent_compute-ego": 0.2172913970528068, "deviation-heading": 2.509278164590451, "set_robot_commands": 0.07406768825027969, "deviation-center-line": 0.1934824949080525, "driven_lanedir_consec": 0.12133425305964708, "sim_compute_sim_state": 0.035339850645798906, "sim_compute_performance-ego": 0.05725658463907766, "sim_compute_robot_state-ego": 0.0579957922736367}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.23181932764146823, "sim_physics": 0.01485415162711308, "survival_time": 1.4500000000000006, "driven_lanedir": 0.13100179549818058, "sim_render-ego": 0.06296969282216039, "in-drivable-lane": 0.5500000000000004, "agent_compute-ego": 0.1579705600080819, "deviation-heading": 0.5142081540672314, "set_robot_commands": 0.0748009599488357, "deviation-center-line": 0.03614510157944462, "driven_lanedir_consec": 0.13100179549818058, "sim_compute_sim_state": 0.03659504035423542, "sim_compute_performance-ego": 0.05991216363578007, "sim_compute_robot_state-ego": 0.05904984474182129}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.5567498983232159, "sim_physics": 0.015217393131579384, "survival_time": 2.9499999999999975, "driven_lanedir": 0.11273478756987744, "sim_render-ego": 0.05534691729788053, "in-drivable-lane": 1.0000000000000009, "agent_compute-ego": 0.19951942007420423, "deviation-heading": 1.498710194838244, "set_robot_commands": 0.0737222372475317, "deviation-center-line": 0.12282040106870584, "driven_lanedir_consec": 0.030203976314772785, "sim_compute_sim_state": 0.0361420825376349, "sim_compute_performance-ego": 0.057825981560399975, "sim_compute_robot_state-ego": 0.057197845588296145}}
set_robot_commands_max	0.0748009599488357
set_robot_commands_mean	0.07368843240751606
set_robot_commands_median	0.0737222372475317
set_robot_commands_min	0.07251953377443202
sim_compute_performance-ego_max	0.05991216363578007
sim_compute_performance-ego_mean	0.05720091576202927
sim_compute_performance-ego_median	0.05725658463907766
sim_compute_performance-ego_min	0.05548615190717909
sim_compute_robot_state-ego_max	0.05904984474182129
sim_compute_robot_state-ego_mean	0.05727656982054276
sim_compute_robot_state-ego_median	0.057197845588296145
sim_compute_robot_state-ego_min	0.05503246363471536
sim_compute_sim_state_max	0.03659504035423542
sim_compute_sim_state_mean	0.03543723765846697
sim_compute_sim_state_median	0.035339850645798906
sim_compute_sim_state_min	0.0339830756187439
sim_physics_max	0.015217393131579384
sim_physics_mean	0.014976520337669675
sim_physics_median	0.015124994165757124
sim_physics_min	0.014536270728478065
sim_render-ego_max	0.06296969282216039
sim_render-ego_mean	0.05665979801287997
sim_render-ego_median	0.05534691729788053
sim_render-ego_min	0.05374999607310576
simulation-passed	1
survival_time_max	9.099999999999994
survival_time_mean	4.839999999999998
survival_time_min	1.4500000000000006

No reset possible

18192

2516

Liam Paull 🇨🇦

challenge-aido_LF-baseline-duckietown

step1-simulation

error

2019-04-19 10:29:28+00:00

2019-04-19 10:31:07+00:00

0:01:39

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

18188

2831

challenge-aido_LF-baseline-duckietown

step1-simulation

error

2019-04-19 10:27:57+00:00

2019-04-19 10:28:49+00:00

0:00:52

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

18175

2848

challenge-aido_LF-baseline-duckietown

step1-simulation

error

2019-04-18 15:13:12+00:00

2019-04-18 15:13:50+00:00

0:00:38

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

18171

2839

challenge-aido_LF-baseline-duckietown

step1-simulation

error

2019-04-18 15:09:16+00:00

2019-04-18 15:09:55+00:00

0:00:39

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

18160

2827

Liam Paull 🇨🇦

challenge-aido_LF-template-random

step1-simulation

success

2019-04-18 13:43:40+00:00

2019-04-18 13:49:35+00:00

0:05:55

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.6896127428821732
survival_time_median	1.1500000000000004
deviation-center-line_median	0.05610305022565209
in-drivable-lane_median	0.20000000000000007

other stats

agent_compute-ego_max	0.15395449555438498
agent_compute-ego_mean	0.1459744097036358
agent_compute-ego_median	0.14725210269292197
agent_compute-ego_min	0.13745422874178206
deviation-center-line_max	0.07504669169058735
deviation-center-line_mean	0.05629372528587068
deviation-center-line_min	0.031337769455374115
deviation-heading_max	0.4695314592890065
deviation-heading_mean	0.28295632700130013
deviation-heading_median	0.28969351082790473
deviation-heading_min	0.13822734158708538
driven_any_max	1.1972535692377095
driven_any_mean	1.069550703128448
driven_any_median	1.0381750331691957
driven_any_min	1.0257183998178268
driven_lanedir_consec_max	0.8123144800841251
driven_lanedir_consec_mean	0.6312226729648216
driven_lanedir_consec_min	0.4373052105850964
driven_lanedir_max	0.9325407987545682
driven_lanedir_mean	0.7224147694584564
driven_lanedir_median	0.8123144800841251
driven_lanedir_min	0.48318684247252186
in-drivable-lane_max	0.6000000000000004
in-drivable-lane_mean	0.3000000000000002
in-drivable-lane_min	0
per-episodes	details {"udem1-0-0": {"driven_any": 1.1972535692377095, "sim_physics": 0.026178785732814243, "survival_time": 1.4000000000000006, "driven_lanedir": 0.5600308085729072, "sim_render-ego": 0.06248912640980312, "in-drivable-lane": 0.5500000000000003, "agent_compute-ego": 0.13745422874178206, "deviation-heading": 0.4695314592890065, "set_robot_commands": 0.07599744626453944, "deviation-center-line": 0.05610305022565209, "driven_lanedir_consec": 0.4373052105850964, "sim_compute_sim_state": 0.03531143495014736, "sim_compute_performance-ego": 0.06039028508322579, "sim_compute_robot_state-ego": 0.06302742447171893, "sim_compute_robot_state-npc0": 0.06701864515032087, "sim_compute_robot_state-npc1": 0.06161542449678693, "sim_compute_robot_state-npc2": 0.06035596983773368, "sim_compute_robot_state-npc3": 0.06345243964876447}, "udem1-1-0": {"driven_any": 1.036014073841825, "sim_physics": 0.02453916271527608, "survival_time": 1.2000000000000004, "driven_lanedir": 0.48318684247252186, "sim_render-ego": 0.06378008921941121, "in-drivable-lane": 0.6000000000000004, "agent_compute-ego": 0.14725210269292197, "deviation-heading": 0.13822734158708538, "set_robot_commands": 0.07700469096501668, "deviation-center-line": 0.031337769455374115, "driven_lanedir_consec": 0.48318684247252186, "sim_compute_sim_state": 0.03250643610954285, "sim_compute_performance-ego": 0.06254417697588603, "sim_compute_robot_state-ego": 0.06222201387087504, "sim_compute_robot_state-npc0": 0.07025014360745747, "sim_compute_robot_state-npc1": 0.06171184778213501, "sim_compute_robot_state-npc2": 0.06086462736129761, "sim_compute_robot_state-npc3": 0.06653660535812378}, "udem1-2-0": {"driven_any": 1.0257183998178268, "sim_physics": 0.02659558213275412, "survival_time": 1.1500000000000004, "driven_lanedir": 0.9325407987545682, "sim_render-ego": 0.06698309856912364, "in-drivable-lane": 0, "agent_compute-ego": 0.14823407712190048, "deviation-heading": 0.28969351082790473, "set_robot_commands": 0.07896036687104599, "deviation-center-line": 0.07504669169058735, "driven_lanedir_consec": 0.6896127428821732, "sim_compute_sim_state": 0.035166294678397804, "sim_compute_performance-ego": 0.060779239820397415, "sim_compute_robot_state-ego": 0.06068788404050081, "sim_compute_robot_state-npc0": 0.07259427982827892, "sim_compute_robot_state-npc1": 0.06355302230171535, "sim_compute_robot_state-npc2": 0.0649440392203953, "sim_compute_robot_state-npc3": 0.06763360811316449}, "udem1-3-0": {"driven_any": 1.0505924395756825, "sim_physics": 0.026538289111593494, "survival_time": 1.1500000000000004, "driven_lanedir": 0.8240009174081598, "sim_render-ego": 0.06393926039985988, "in-drivable-lane": 0.20000000000000007, "agent_compute-ego": 0.15395449555438498, "deviation-heading": 0.19133902257839172, "set_robot_commands": 0.0763098260630732, "deviation-center-line": 0.04393905052607498, "driven_lanedir_consec": 0.7336940888001914, "sim_compute_sim_state": 0.03414664061173149, "sim_compute_performance-ego": 0.0604935418004575, "sim_compute_robot_state-ego": 0.06433056748431662, "sim_compute_robot_state-npc0": 0.07264320746712062, "sim_compute_robot_state-npc1": 0.06359827000161876, "sim_compute_robot_state-npc2": 0.06106254328852114, "sim_compute_robot_state-npc3": 0.06027884068696395}, "udem1-4-0": {"driven_any": 1.0381750331691957, "sim_physics": 0.02431173946546472, "survival_time": 1.1500000000000004, "driven_lanedir": 0.8123144800841251, "sim_render-ego": 0.06458712660748026, "in-drivable-lane": 0.15000000000000013, "agent_compute-ego": 0.14297714440718942, "deviation-heading": 0.32599030072411245, "set_robot_commands": 0.07719238944675612, "deviation-center-line": 0.07504206453166483, "driven_lanedir_consec": 0.8123144800841251, "sim_compute_sim_state": 0.03374544433925463, "sim_compute_performance-ego": 0.06743538897970448, "sim_compute_robot_state-ego": 0.06398226903832477, "sim_compute_robot_state-npc0": 0.06405219824417778, "sim_compute_robot_state-npc1": 0.06170512282330057, "sim_compute_robot_state-npc2": 0.06394779163858165, "sim_compute_robot_state-npc3": 0.06235642018525497}}
set_robot_commands_max	0.07896036687104599
set_robot_commands_mean	0.0770929439220863
set_robot_commands_median	0.07700469096501668
set_robot_commands_min	0.07599744626453944
sim_compute_performance-ego_max	0.06743538897970448
sim_compute_performance-ego_mean	0.06232852653193425
sim_compute_performance-ego_median	0.060779239820397415
sim_compute_performance-ego_min	0.06039028508322579
sim_compute_robot_state-ego_max	0.06433056748431662
sim_compute_robot_state-ego_mean	0.06285003178114724
sim_compute_robot_state-ego_median	0.06302742447171893
sim_compute_robot_state-ego_min	0.06068788404050081
sim_compute_robot_state-npc0_max	0.07264320746712062
sim_compute_robot_state-npc0_mean	0.06931169485947113
sim_compute_robot_state-npc0_median	0.07025014360745747
sim_compute_robot_state-npc0_min	0.06405219824417778
sim_compute_robot_state-npc1_max	0.06359827000161876
sim_compute_robot_state-npc1_mean	0.06243673748111132
sim_compute_robot_state-npc1_median	0.06171184778213501
sim_compute_robot_state-npc1_min	0.06161542449678693
sim_compute_robot_state-npc2_max	0.0649440392203953
sim_compute_robot_state-npc2_mean	0.06223499426930588
sim_compute_robot_state-npc2_median	0.06106254328852114
sim_compute_robot_state-npc2_min	0.06035596983773368
sim_compute_robot_state-npc3_max	0.06763360811316449
sim_compute_robot_state-npc3_mean	0.06405158279845433
sim_compute_robot_state-npc3_median	0.06345243964876447
sim_compute_robot_state-npc3_min	0.06027884068696395
sim_compute_sim_state_max	0.03531143495014736
sim_compute_sim_state_mean	0.034175250137814826
sim_compute_sim_state_median	0.03414664061173149
sim_compute_sim_state_min	0.03250643610954285
sim_physics_max	0.02659558213275412
sim_physics_mean	0.02563271183158053
sim_physics_median	0.026178785732814243
sim_physics_min	0.02431173946546472
sim_render-ego_max	0.06698309856912364
sim_render-ego_mean	0.06435574024113562
sim_render-ego_median	0.06393926039985988
sim_render-ego_min	0.06248912640980312
simulation-passed	1
survival_time_max	1.4000000000000006
survival_time_mean	1.2100000000000004
survival_time_min	1.1500000000000004

No reset possible

18147

2812

Andrea Censi 🇨🇭

challenge-aido_LF-template-random - random_agent

step1-simulation

success

2019-04-18 12:41:05+00:00

2019-04-18 12:46:52+00:00

0:05:47

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.6896127428821732
survival_time_median	1.1500000000000004
deviation-center-line_median	0.05610305022565209
in-drivable-lane_median	0.20000000000000007

other stats

agent_compute-ego_max	0.1496605043825896
agent_compute-ego_mean	0.14359605060601086
agent_compute-ego_median	0.14744526147842407
agent_compute-ego_min	0.13186833688191005
deviation-center-line_max	0.07504669169058735
deviation-center-line_mean	0.05629372528587068
deviation-center-line_min	0.031337769455374115
deviation-heading_max	0.4695314592890065
deviation-heading_mean	0.28295632700130013
deviation-heading_median	0.28969351082790473
deviation-heading_min	0.13822734158708538
driven_any_max	1.1972535692377095
driven_any_mean	1.069550703128448
driven_any_median	1.0381750331691957
driven_any_min	1.0257183998178268
driven_lanedir_consec_max	0.8123144800841251
driven_lanedir_consec_mean	0.6312226729648216
driven_lanedir_consec_min	0.4373052105850964
driven_lanedir_max	0.9325407987545682
driven_lanedir_mean	0.7224147694584564
driven_lanedir_median	0.8123144800841251
driven_lanedir_min	0.48318684247252186
in-drivable-lane_max	0.6000000000000004
in-drivable-lane_mean	0.3000000000000002
in-drivable-lane_min	0
per-episodes	details {"udem1-0-0": {"driven_any": 1.1972535692377095, "sim_physics": 0.023885420390537808, "survival_time": 1.4000000000000006, "driven_lanedir": 0.5600308085729072, "sim_render-ego": 0.057445670877184184, "in-drivable-lane": 0.5500000000000003, "agent_compute-ego": 0.13186833688191005, "deviation-heading": 0.4695314592890065, "set_robot_commands": 0.07280454465321132, "deviation-center-line": 0.05610305022565209, "driven_lanedir_consec": 0.4373052105850964, "sim_compute_sim_state": 0.031027921608516147, "sim_compute_performance-ego": 0.05510341269629342, "sim_compute_robot_state-ego": 0.05726040261132376, "sim_compute_robot_state-npc0": 0.06258442572184972, "sim_compute_robot_state-npc1": 0.05696225166320801, "sim_compute_robot_state-npc2": 0.05529243605477469, "sim_compute_robot_state-npc3": 0.05524325370788574}, "udem1-1-0": {"driven_any": 1.036014073841825, "sim_physics": 0.02505609393119812, "survival_time": 1.2000000000000004, "driven_lanedir": 0.48318684247252186, "sim_render-ego": 0.06577180822690327, "in-drivable-lane": 0.6000000000000004, "agent_compute-ego": 0.14744526147842407, "deviation-heading": 0.13822734158708538, "set_robot_commands": 0.07608471314112346, "deviation-center-line": 0.031337769455374115, "driven_lanedir_consec": 0.48318684247252186, "sim_compute_sim_state": 0.03500136733055115, "sim_compute_performance-ego": 0.06460177898406982, "sim_compute_robot_state-ego": 0.06569969654083252, "sim_compute_robot_state-npc0": 0.07554893692334493, "sim_compute_robot_state-npc1": 0.06663572788238525, "sim_compute_robot_state-npc2": 0.06588353713353474, "sim_compute_robot_state-npc3": 0.06606318553288777}, "udem1-2-0": {"driven_any": 1.0257183998178268, "sim_physics": 0.027778791344684105, "survival_time": 1.1500000000000004, "driven_lanedir": 0.9325407987545682, "sim_render-ego": 0.05817441318346107, "in-drivable-lane": 0, "agent_compute-ego": 0.1496605043825896, "deviation-heading": 0.28969351082790473, "set_robot_commands": 0.08144357930059018, "deviation-center-line": 0.07504669169058735, "driven_lanedir_consec": 0.6896127428821732, "sim_compute_sim_state": 0.03479565744814665, "sim_compute_performance-ego": 0.060060252314028534, "sim_compute_robot_state-ego": 0.06259167712667714, "sim_compute_robot_state-npc0": 0.06678454772285793, "sim_compute_robot_state-npc1": 0.06192110932391623, "sim_compute_robot_state-npc2": 0.06408435365428096, "sim_compute_robot_state-npc3": 0.06389994206635849}, "udem1-3-0": {"driven_any": 1.0505924395756825, "sim_physics": 0.024306058883666992, "survival_time": 1.1500000000000004, "driven_lanedir": 0.8240009174081598, "sim_render-ego": 0.0620905938355819, "in-drivable-lane": 0.20000000000000007, "agent_compute-ego": 0.140829148499862, "deviation-heading": 0.19133902257839172, "set_robot_commands": 0.07537799296171768, "deviation-center-line": 0.04393905052607498, "driven_lanedir_consec": 0.7336940888001914, "sim_compute_sim_state": 0.03192807280499002, "sim_compute_performance-ego": 0.05791583268538765, "sim_compute_robot_state-ego": 0.05885346039481785, "sim_compute_robot_state-npc0": 0.06957253165867018, "sim_compute_robot_state-npc1": 0.0637822151184082, "sim_compute_robot_state-npc2": 0.0625507002291472, "sim_compute_robot_state-npc3": 0.06239107380742613}, "udem1-4-0": {"driven_any": 1.0381750331691957, "sim_physics": 0.02365911525228749, "survival_time": 1.1500000000000004, "driven_lanedir": 0.8123144800841251, "sim_render-ego": 0.05834769166034201, "in-drivable-lane": 0.15000000000000013, "agent_compute-ego": 0.1481770017872686, "deviation-heading": 0.32599030072411245, "set_robot_commands": 0.07703655699025029, "deviation-center-line": 0.07504206453166483, "driven_lanedir_consec": 0.8123144800841251, "sim_compute_sim_state": 0.03403692660124406, "sim_compute_performance-ego": 0.057839279589445694, "sim_compute_robot_state-ego": 0.05972914073778235, "sim_compute_robot_state-npc0": 0.0687670604042385, "sim_compute_robot_state-npc1": 0.06457604532656462, "sim_compute_robot_state-npc2": 0.06428923814193062, "sim_compute_robot_state-npc3": 0.06040133600649626}}
set_robot_commands_max	0.08144357930059018
set_robot_commands_mean	0.07654947740937859
set_robot_commands_median	0.07608471314112346
set_robot_commands_min	0.07280454465321132
sim_compute_performance-ego_max	0.06460177898406982
sim_compute_performance-ego_mean	0.05910411125384503
sim_compute_performance-ego_median	0.05791583268538765
sim_compute_performance-ego_min	0.05510341269629342
sim_compute_robot_state-ego_max	0.06569969654083252
sim_compute_robot_state-ego_mean	0.06082687548228673
sim_compute_robot_state-ego_median	0.05972914073778235
sim_compute_robot_state-ego_min	0.05726040261132376
sim_compute_robot_state-npc0_max	0.07554893692334493
sim_compute_robot_state-npc0_mean	0.06865150048619224
sim_compute_robot_state-npc0_median	0.0687670604042385
sim_compute_robot_state-npc0_min	0.06258442572184972
sim_compute_robot_state-npc1_max	0.06663572788238525
sim_compute_robot_state-npc1_mean	0.06277546986289646
sim_compute_robot_state-npc1_median	0.0637822151184082
sim_compute_robot_state-npc1_min	0.05696225166320801
sim_compute_robot_state-npc2_max	0.06588353713353474
sim_compute_robot_state-npc2_mean	0.062420053042733646
sim_compute_robot_state-npc2_median	0.06408435365428096
sim_compute_robot_state-npc2_min	0.05529243605477469
sim_compute_robot_state-npc3_max	0.06606318553288777
sim_compute_robot_state-npc3_mean	0.06159975822421088
sim_compute_robot_state-npc3_median	0.06239107380742613
sim_compute_robot_state-npc3_min	0.05524325370788574
sim_compute_sim_state_max	0.03500136733055115
sim_compute_sim_state_mean	0.0333579891586896
sim_compute_sim_state_median	0.03403692660124406
sim_compute_sim_state_min	0.031027921608516147
sim_physics_max	0.027778791344684105
sim_physics_mean	0.024937095960474904
sim_physics_median	0.024306058883666992
sim_physics_min	0.02365911525228749
sim_render-ego_max	0.06577180822690327
sim_render-ego_mean	0.06036603555669449
sim_render-ego_median	0.05834769166034201
sim_render-ego_min	0.057445670877184184
simulation-passed	1
survival_time_max	1.4000000000000006
survival_time_mean	1.2100000000000004
survival_time_min	1.1500000000000004

No reset possible

18140

2792

Rami Al-Naim 🇷🇺

challenge-aido_LF-baseline-duckietown

step1-simulation

error

2019-04-18 10:00:36+00:00

2019-04-18 10:23:10+00:00

0:22:34

Waited 1202 seconds [...]

Waited 1202 seconds for container to finish. Giving up.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

18091

2711

Rami Al-Naim 🇷🇺

challenge-aido_LF-baseline-duckietown

step1-simulation

success

2019-04-17 14:59:07+00:00

2019-04-17 15:10:17+00:00

0:11:10

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.895635978183251
survival_time_median	4.199999999999993
deviation-center-line_median	0.2212205701458552
in-drivable-lane_median	0.35000000000000014

other stats

agent_compute-ego_max	0.06829811442982067
agent_compute-ego_mean	0.06460658229359888
agent_compute-ego_median	0.06478066671462286
agent_compute-ego_min	0.06123801867167155
deviation-center-line_max	0.5457250879368675
deviation-center-line_mean	0.2465736550676903
deviation-center-line_min	0.008698706058485424
deviation-heading_max	1.475539579090298
deviation-heading_mean	0.7814416438599417
deviation-heading_median	0.6298388386991961
deviation-heading_min	0.16575561387135698
driven_any_max	1.765980527898337
driven_any_mean	1.059465977554729
driven_any_median	1.317419184721826
driven_any_min	0.22422296491931587
driven_lanedir_consec_max	1.1537288569161266
driven_lanedir_consec_mean	0.6883237178299769
driven_lanedir_consec_min	0.10212147740818668
driven_lanedir_max	1.4988969892321649
driven_lanedir_mean	0.8371781931204895
driven_lanedir_median	1.1505454317820896
driven_lanedir_min	0.10212147740818668
in-drivable-lane_max	1.499999999999995
in-drivable-lane_mean	0.4899999999999988
in-drivable-lane_min	0
per-episodes	details {"udem1-0-0": {"driven_any": 1.317419184721826, "sim_physics": 0.02799263454618908, "survival_time": 4.199999999999993, "driven_lanedir": 1.2947402223197757, "sim_render-ego": 0.0669231272879101, "in-drivable-lane": 0, "agent_compute-ego": 0.06478066671462286, "deviation-heading": 0.6298388386991961, "set_robot_commands": 0.07442558379400344, "deviation-center-line": 0.44003724742436184, "driven_lanedir_consec": 0.895635978183251, "sim_compute_sim_state": 0.035303717567807154, "sim_compute_performance-ego": 0.06489639055161249, "sim_compute_robot_state-ego": 0.06381510269074213, "sim_compute_robot_state-npc0": 0.07135358027049474, "sim_compute_robot_state-npc1": 0.06613278388977051, "sim_compute_robot_state-npc2": 0.06363615535554432, "sim_compute_robot_state-npc3": 0.06278732277098156}, "udem1-1-0": {"driven_any": 0.24042689215460197, "sim_physics": 0.03165076573689778, "survival_time": 0.7500000000000001, "driven_lanedir": 0.10212147740818668, "sim_render-ego": 0.07166018486022949, "in-drivable-lane": 0.35000000000000014, "agent_compute-ego": 0.06123801867167155, "deviation-heading": 0.16575561387135698, "set_robot_commands": 0.07778846422831218, "deviation-center-line": 0.008698706058485424, "driven_lanedir_consec": 0.10212147740818668, "sim_compute_sim_state": 0.03927167256673177, "sim_compute_performance-ego": 0.06691009203592936, "sim_compute_robot_state-ego": 0.06480191548665365, "sim_compute_robot_state-npc0": 0.07117514610290528, "sim_compute_robot_state-npc1": 0.06524241765340169, "sim_compute_robot_state-npc2": 0.0635408878326416, "sim_compute_robot_state-npc3": 0.0641200065612793}, "udem1-2-0": {"driven_any": 1.765980527898337, "sim_physics": 0.02881243662400679, "survival_time": 5.4999999999999885, "driven_lanedir": 1.4988969892321649, "sim_render-ego": 0.06399964852766557, "in-drivable-lane": 0.4499999999999993, "agent_compute-ego": 0.06829811442982067, "deviation-heading": 1.475539579090298, "set_robot_commands": 0.07477715015411376, "deviation-center-line": 0.5457250879368675, "driven_lanedir_consec": 1.1537288569161266, "sim_compute_sim_state": 0.03580614653500644, "sim_compute_performance-ego": 0.06213344010439786, "sim_compute_robot_state-ego": 0.063724515654824, "sim_compute_robot_state-npc0": 0.07298718799244273, "sim_compute_robot_state-npc1": 0.06854433796622536, "sim_compute_robot_state-npc2": 0.06670937754891136, "sim_compute_robot_state-npc3": 0.06622981808402321}, "udem1-3-0": {"driven_any": 0.22422296491931587, "sim_physics": 0.025550195149012973, "survival_time": 0.7000000000000001, "driven_lanedir": 0.13958684486023087, "sim_render-ego": 0.05721667834690639, "in-drivable-lane": 0.15000000000000013, "agent_compute-ego": 0.06359587396894183, "deviation-heading": 0.2340811613728018, "set_robot_commands": 0.07359394005366734, "deviation-center-line": 0.017186663772881493, "driven_lanedir_consec": 0.13958684486023087, "sim_compute_sim_state": 0.03385734558105469, "sim_compute_performance-ego": 0.062302742685590475, "sim_compute_robot_state-ego": 0.0591435432434082, "sim_compute_robot_state-npc0": 0.06861042976379395, "sim_compute_robot_state-npc1": 0.06043205942426409, "sim_compute_robot_state-npc2": 0.058033619608197896, "sim_compute_robot_state-npc3": 0.05862855911254883}, "udem1-4-0": {"driven_any": 1.7492803180795644, "sim_physics": 0.025960758191729903, "survival_time": 5.449999999999989, "driven_lanedir": 1.1505454317820896, "sim_render-ego": 0.0588976877544998, "in-drivable-lane": 1.499999999999995, "agent_compute-ego": 0.06512023768293748, "deviation-heading": 1.4019930262660558, "set_robot_commands": 0.07450232374558755, "deviation-center-line": 0.2212205701458552, "driven_lanedir_consec": 1.1505454317820896, "sim_compute_sim_state": 0.03205831991423161, "sim_compute_performance-ego": 0.05875565152649486, "sim_compute_robot_state-ego": 0.059388970016339505, "sim_compute_robot_state-npc0": 0.06408446644424298, "sim_compute_robot_state-npc1": 0.0594935417175293, "sim_compute_robot_state-npc2": 0.05815555415022264, "sim_compute_robot_state-npc3": 0.05779325196502406}}
set_robot_commands_max	0.07778846422831218
set_robot_commands_mean	0.07501749239513684
set_robot_commands_median	0.07450232374558755
set_robot_commands_min	0.07359394005366734
sim_compute_performance-ego_max	0.06691009203592936
sim_compute_performance-ego_mean	0.06299966338080501
sim_compute_performance-ego_median	0.062302742685590475
sim_compute_performance-ego_min	0.05875565152649486
sim_compute_robot_state-ego_max	0.06480191548665365
sim_compute_robot_state-ego_mean	0.062174809418393505
sim_compute_robot_state-ego_median	0.063724515654824
sim_compute_robot_state-ego_min	0.0591435432434082
sim_compute_robot_state-npc0_max	0.07298718799244273
sim_compute_robot_state-npc0_mean	0.06964216211477595
sim_compute_robot_state-npc0_median	0.07117514610290528
sim_compute_robot_state-npc0_min	0.06408446644424298
sim_compute_robot_state-npc1_max	0.06854433796622536
sim_compute_robot_state-npc1_mean	0.06396902813023819
sim_compute_robot_state-npc1_median	0.06524241765340169
sim_compute_robot_state-npc1_min	0.0594935417175293
sim_compute_robot_state-npc2_max	0.06670937754891136
sim_compute_robot_state-npc2_mean	0.06201511889910356
sim_compute_robot_state-npc2_median	0.0635408878326416
sim_compute_robot_state-npc2_min	0.058033619608197896
sim_compute_robot_state-npc3_max	0.06622981808402321
sim_compute_robot_state-npc3_mean	0.06191179169877139
sim_compute_robot_state-npc3_median	0.06278732277098156
sim_compute_robot_state-npc3_min	0.05779325196502406
sim_compute_sim_state_max	0.03927167256673177
sim_compute_sim_state_mean	0.03525944043296633
sim_compute_sim_state_median	0.035303717567807154
sim_compute_sim_state_min	0.03205831991423161
sim_physics_max	0.03165076573689778
sim_physics_mean	0.027993358049567308
sim_physics_median	0.02799263454618908
sim_physics_min	0.025550195149012973
sim_render-ego_max	0.07166018486022949
sim_render-ego_mean	0.06373946535544225
sim_render-ego_median	0.06399964852766557
sim_render-ego_min	0.05721667834690639
simulation-passed	1
survival_time_max	5.4999999999999885
survival_time_mean	3.319999999999994
survival_time_min	0.7000000000000001

No reset possible

18084

2700

Artem Ioselevskii

PredictorLast

aido2-PRED

step1-simulation

success